2024-03-26T16:32:51.614 INFO:root:teuthology version: 0.0.1.dev263+g7c79d57 2024-03-26T16:32:51.614 DEBUG:teuthology.run:Teuthology command: teuthology --owner scheduled_vallariag@teuthology --description rbd:nvmeof/{base/install centos_latest conf/{disable-pool-app} workloads/nvmeof_thrash} --name vallariag-2024-03-26_16:25:34-rbd:nvmeof-ceph-nvmeof-mon-distro-default-smithi --verbose --archive /home/teuthworker/archive/vallariag-2024-03-26_16:25:34-rbd:nvmeof-ceph-nvmeof-mon-distro-default-smithi/7623742 -- /home/teuthworker/archive/vallariag-2024-03-26_16:25:34-rbd:nvmeof-ceph-nvmeof-mon-distro-default-smithi/7623742/orig.config.yaml 2024-03-26T16:32:51.646 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-26T16:32:51.731 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/vallariag-2024-03-26_16:25:34-rbd:nvmeof-ceph-nvmeof-mon-distro-default-smithi/7623742 branch: ceph-nvmeof-mon description: rbd:nvmeof/{base/install centos_latest conf/{disable-pool-app} workloads/nvmeof_thrash} email: null first_in_suite: false job_id: '7623742' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi name: vallariag-2024-03-26_16:25:34-rbd:nvmeof-ceph-nvmeof-mon-distro-default-smithi no_nested_subset: false nuke-on-error: true os_type: centos os_version: 9.stream overrides: admin_socket: branch: ceph-nvmeof-mon ceph: conf: global: mon warn on pool no app: false mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: debug ms: 1 debug osd: 20 flavor: default log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) sha1: bf9505fb569e9b95a78f9700ed8c4bd20508ef55 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: default sha1: bf9505fb569e9b95a78f9700ed8c4bd20508ef55 workunit: branch: wip-nvmeof-test-v4-subsystem-debug sha1: b4c4828f419f1247fc297e8069c1036b1d6151f2 owner: scheduled_vallariag@teuthology priority: 30 repo: https://git.ceph.com/ceph-ci.git roles: - - host.a - mon.a - mgr.x - osd.0 - osd.1 - client.0 - ceph.nvmeof.nvmeof.a - - host.b - mon.b - osd.2 - osd.3 - osd.4 - client.1 - ceph.nvmeof.nvmeof.b - - host.c - mon.c - osd.5 - osd.6 - osd.7 - client.2 - ceph.nvmeof.nvmeof.c - - client.3 seed: 3392 sha1: bf9505fb569e9b95a78f9700ed8c4bd20508ef55 sleep_before_teardown: 0 suite: rbd:nvmeof suite_branch: wip-nvmeof-test-v4-subsystem-debug suite_path: /home/teuthworker/src/github.com_vallariag_ceph_b4c4828f419f1247fc297e8069c1036b1d6151f2/qa suite_relpath: qa suite_repo: https://github.com/vallariag/ceph.git suite_sha1: b4c4828f419f1247fc297e8069c1036b1d6151f2 targets: smithi044.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFSIashjG9T3vuQwjf4YXFXPlv1lbAByFjFa+ONeLiRwIxbjPXU4QQmMh6t2A0PL7bjHyBgE1ZHrTa/TOl2+K2A= smithi064.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMJOzji330iAheGPVl6Q67rmi0g72/pPL2waU/cL4nkSlz1G6Me2lzOcsiBmxXDX0VD5lrP+e1qSK3FcZf8/IEs= smithi149.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCyr4TzjgsEn9ZiQfzSIaVsWpJ5zjF6U7LMmRBDc4OVueteU+pLAnUDBQYSHf1483kAv8jdZiZme6d2hUI9TORc= smithi157.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIOO/CWoMI2n8sWrMzIM8IdSzbprJfalVZ8iDWsIoU88YAyo2DenTY1H0sxVNrcrzUBJ6TRW8t5UM3Bv6vxuJJU= tasks: - install: extra_packages: - nvme-cli - cephadm: null - cephadm.shell: host.a: - ceph orch status - ceph orch ps - ceph orch host ls - ceph orch device ls - ceph osd lspools - nvmeof: client: client.0 gateway_config: cli_version: 1.1.0 namespaces_count: 20 subsystems_count: 3 rbd: image_name_prefix: myimage pool_name: mypool version: 1.1.0 - cephadm.wait_for_service: service: nvmeof.mypool - workunit: clients: client.3: - rbd/nvmeof_setup_subsystem.sh - rbd/nvmeof_basic_tests.sh env: RBD_IMAGE_PREFIX: myimage RBD_POOL: mypool no_coverage_and_limits: true - nvmeof.thrash: initiator: client.3 - workunit: clients: client.3: - rbd/nvmeof_fio_test.sh --rbd_iostat env: IOSTAT_INTERVAL: '10' RBD_POOL: mypool RUNTIME: '600' no_coverage_and_limits: true teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: fix-cephadmunit-start teuthology_sha1: 7c79d572ca9e89ddbdc2c40bbb7dac4f505c80ce timestamp: 2024-03-26_16:25:34 tube: smithi use_shaman: true user: vallariag verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-03-26T16:32:51.731 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_vallariag_ceph_b4c4828f419f1247fc297e8069c1036b1d6151f2/qa; will attempt to use it 2024-03-26T16:32:51.732 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_vallariag_ceph_b4c4828f419f1247fc297e8069c1036b1d6151f2/qa/tasks 2024-03-26T16:32:51.732 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-03-26T16:32:51.734 INFO:teuthology.task.internal:Checking packages... 2024-03-26T16:32:51.934 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'bf9505fb569e9b95a78f9700ed8c4bd20508ef55' 2024-03-26T16:32:51.934 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-03-26T16:32:51.934 INFO:teuthology.packaging:ref: None 2024-03-26T16:32:51.934 INFO:teuthology.packaging:tag: None 2024-03-26T16:32:51.934 INFO:teuthology.packaging:branch: ceph-nvmeof-mon 2024-03-26T16:32:51.934 INFO:teuthology.packaging:sha1: bf9505fb569e9b95a78f9700ed8c4bd20508ef55 2024-03-26T16:32:51.935 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=ceph-nvmeof-mon 2024-03-26T16:32:52.101 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-2382.gbf9505fb 2024-03-26T16:32:52.102 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-03-26T16:32:52.110 INFO:teuthology.task.internal:no buildpackages task found 2024-03-26T16:32:52.110 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-03-26T16:32:52.123 INFO:teuthology.task.internal:Saving configuration 2024-03-26T16:32:52.134 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-03-26T16:32:52.139 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-26T16:32:52.164 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi044.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vallariag-2024-03-26_16:25:34-rbd:nvmeof-ceph-nvmeof-mon-distro-default-smithi/7623742', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-26 16:27:25.959558', 'locked_by': 'scheduled_vallariag@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFSIashjG9T3vuQwjf4YXFXPlv1lbAByFjFa+ONeLiRwIxbjPXU4QQmMh6t2A0PL7bjHyBgE1ZHrTa/TOl2+K2A='} 2024-03-26T16:32:52.184 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi064.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vallariag-2024-03-26_16:25:34-rbd:nvmeof-ceph-nvmeof-mon-distro-default-smithi/7623742', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-26 16:27:25.961405', 'locked_by': 'scheduled_vallariag@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMJOzji330iAheGPVl6Q67rmi0g72/pPL2waU/cL4nkSlz1G6Me2lzOcsiBmxXDX0VD5lrP+e1qSK3FcZf8/IEs='} 2024-03-26T16:32:52.204 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi149.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vallariag-2024-03-26_16:25:34-rbd:nvmeof-ceph-nvmeof-mon-distro-default-smithi/7623742', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-26 16:27:25.963060', 'locked_by': 'scheduled_vallariag@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCyr4TzjgsEn9ZiQfzSIaVsWpJ5zjF6U7LMmRBDc4OVueteU+pLAnUDBQYSHf1483kAv8jdZiZme6d2hUI9TORc='} 2024-03-26T16:32:52.225 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi157.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vallariag-2024-03-26_16:25:34-rbd:nvmeof-ceph-nvmeof-mon-distro-default-smithi/7623742', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-26 16:27:25.964759', 'locked_by': 'scheduled_vallariag@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIOO/CWoMI2n8sWrMzIM8IdSzbprJfalVZ8iDWsIoU88YAyo2DenTY1H0sxVNrcrzUBJ6TRW8t5UM3Bv6vxuJJU='} 2024-03-26T16:32:52.225 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-03-26T16:32:52.231 INFO:teuthology.task.internal:roles: ubuntu@smithi044.front.sepia.ceph.com - ['host.a', 'mon.a', 'mgr.x', 'osd.0', 'osd.1', 'client.0', 'ceph.nvmeof.nvmeof.a'] 2024-03-26T16:32:52.231 INFO:teuthology.task.internal:roles: ubuntu@smithi064.front.sepia.ceph.com - ['host.b', 'mon.b', 'osd.2', 'osd.3', 'osd.4', 'client.1', 'ceph.nvmeof.nvmeof.b'] 2024-03-26T16:32:52.231 INFO:teuthology.task.internal:roles: ubuntu@smithi149.front.sepia.ceph.com - ['host.c', 'mon.c', 'osd.5', 'osd.6', 'osd.7', 'client.2', 'ceph.nvmeof.nvmeof.c'] 2024-03-26T16:32:52.231 INFO:teuthology.task.internal:roles: ubuntu@smithi157.front.sepia.ceph.com - ['client.3'] 2024-03-26T16:32:52.231 INFO:teuthology.run_tasks:Running task console_log... 2024-03-26T16:32:52.351 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f2460b0e160>, signals=[15]) 2024-03-26T16:32:52.351 INFO:teuthology.run_tasks:Running task internal.connect... 2024-03-26T16:32:52.358 INFO:teuthology.task.internal:Opening connections... 2024-03-26T16:32:52.358 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi044.front.sepia.ceph.com 2024-03-26T16:32:52.360 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T16:32:52.464 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi064.front.sepia.ceph.com 2024-03-26T16:32:52.465 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T16:32:52.566 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi149.front.sepia.ceph.com 2024-03-26T16:32:52.567 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T16:32:52.656 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi157.front.sepia.ceph.com 2024-03-26T16:32:52.657 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T16:32:52.742 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-03-26T16:32:52.750 DEBUG:teuthology.orchestra.run.smithi044:> uname -m 2024-03-26T16:32:52.768 INFO:teuthology.orchestra.run.smithi044.stdout:x86_64 2024-03-26T16:32:52.768 DEBUG:teuthology.orchestra.run.smithi044:> cat /etc/os-release 2024-03-26T16:32:52.826 INFO:teuthology.orchestra.run.smithi044.stdout:NAME="CentOS Stream" 2024-03-26T16:32:52.826 INFO:teuthology.orchestra.run.smithi044.stdout:VERSION="9" 2024-03-26T16:32:52.826 INFO:teuthology.orchestra.run.smithi044.stdout:ID="centos" 2024-03-26T16:32:52.826 INFO:teuthology.orchestra.run.smithi044.stdout:ID_LIKE="rhel fedora" 2024-03-26T16:32:52.826 INFO:teuthology.orchestra.run.smithi044.stdout:VERSION_ID="9" 2024-03-26T16:32:52.826 INFO:teuthology.orchestra.run.smithi044.stdout:PLATFORM_ID="platform:el9" 2024-03-26T16:32:52.826 INFO:teuthology.orchestra.run.smithi044.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-26T16:32:52.826 INFO:teuthology.orchestra.run.smithi044.stdout:ANSI_COLOR="0;31" 2024-03-26T16:32:52.826 INFO:teuthology.orchestra.run.smithi044.stdout:LOGO="fedora-logo-icon" 2024-03-26T16:32:52.826 INFO:teuthology.orchestra.run.smithi044.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-26T16:32:52.826 INFO:teuthology.orchestra.run.smithi044.stdout:HOME_URL="https://centos.org/" 2024-03-26T16:32:52.826 INFO:teuthology.orchestra.run.smithi044.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-26T16:32:52.827 INFO:teuthology.orchestra.run.smithi044.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-26T16:32:52.827 INFO:teuthology.orchestra.run.smithi044.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-26T16:32:52.827 INFO:teuthology.lock.ops:Updating smithi044.front.sepia.ceph.com on lock server 2024-03-26T16:32:52.851 DEBUG:teuthology.orchestra.run.smithi064:> uname -m 2024-03-26T16:32:52.870 INFO:teuthology.orchestra.run.smithi064.stdout:x86_64 2024-03-26T16:32:52.870 DEBUG:teuthology.orchestra.run.smithi064:> cat /etc/os-release 2024-03-26T16:32:52.928 INFO:teuthology.orchestra.run.smithi064.stdout:NAME="CentOS Stream" 2024-03-26T16:32:52.928 INFO:teuthology.orchestra.run.smithi064.stdout:VERSION="9" 2024-03-26T16:32:52.928 INFO:teuthology.orchestra.run.smithi064.stdout:ID="centos" 2024-03-26T16:32:52.928 INFO:teuthology.orchestra.run.smithi064.stdout:ID_LIKE="rhel fedora" 2024-03-26T16:32:52.928 INFO:teuthology.orchestra.run.smithi064.stdout:VERSION_ID="9" 2024-03-26T16:32:52.928 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM_ID="platform:el9" 2024-03-26T16:32:52.928 INFO:teuthology.orchestra.run.smithi064.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-26T16:32:52.928 INFO:teuthology.orchestra.run.smithi064.stdout:ANSI_COLOR="0;31" 2024-03-26T16:32:52.929 INFO:teuthology.orchestra.run.smithi064.stdout:LOGO="fedora-logo-icon" 2024-03-26T16:32:52.929 INFO:teuthology.orchestra.run.smithi064.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-26T16:32:52.929 INFO:teuthology.orchestra.run.smithi064.stdout:HOME_URL="https://centos.org/" 2024-03-26T16:32:52.929 INFO:teuthology.orchestra.run.smithi064.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-26T16:32:52.929 INFO:teuthology.orchestra.run.smithi064.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-26T16:32:52.929 INFO:teuthology.orchestra.run.smithi064.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-26T16:32:52.929 INFO:teuthology.lock.ops:Updating smithi064.front.sepia.ceph.com on lock server 2024-03-26T16:32:52.951 DEBUG:teuthology.orchestra.run.smithi149:> uname -m 2024-03-26T16:32:52.968 INFO:teuthology.orchestra.run.smithi149.stdout:x86_64 2024-03-26T16:32:52.968 DEBUG:teuthology.orchestra.run.smithi149:> cat /etc/os-release 2024-03-26T16:32:53.026 INFO:teuthology.orchestra.run.smithi149.stdout:NAME="CentOS Stream" 2024-03-26T16:32:53.026 INFO:teuthology.orchestra.run.smithi149.stdout:VERSION="9" 2024-03-26T16:32:53.026 INFO:teuthology.orchestra.run.smithi149.stdout:ID="centos" 2024-03-26T16:32:53.026 INFO:teuthology.orchestra.run.smithi149.stdout:ID_LIKE="rhel fedora" 2024-03-26T16:32:53.026 INFO:teuthology.orchestra.run.smithi149.stdout:VERSION_ID="9" 2024-03-26T16:32:53.026 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM_ID="platform:el9" 2024-03-26T16:32:53.026 INFO:teuthology.orchestra.run.smithi149.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-26T16:32:53.026 INFO:teuthology.orchestra.run.smithi149.stdout:ANSI_COLOR="0;31" 2024-03-26T16:32:53.026 INFO:teuthology.orchestra.run.smithi149.stdout:LOGO="fedora-logo-icon" 2024-03-26T16:32:53.026 INFO:teuthology.orchestra.run.smithi149.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-26T16:32:53.027 INFO:teuthology.orchestra.run.smithi149.stdout:HOME_URL="https://centos.org/" 2024-03-26T16:32:53.027 INFO:teuthology.orchestra.run.smithi149.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-26T16:32:53.027 INFO:teuthology.orchestra.run.smithi149.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-26T16:32:53.027 INFO:teuthology.orchestra.run.smithi149.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-26T16:32:53.027 INFO:teuthology.lock.ops:Updating smithi149.front.sepia.ceph.com on lock server 2024-03-26T16:32:53.051 DEBUG:teuthology.orchestra.run.smithi157:> uname -m 2024-03-26T16:32:53.069 INFO:teuthology.orchestra.run.smithi157.stdout:x86_64 2024-03-26T16:32:53.069 DEBUG:teuthology.orchestra.run.smithi157:> cat /etc/os-release 2024-03-26T16:32:53.126 INFO:teuthology.orchestra.run.smithi157.stdout:NAME="CentOS Stream" 2024-03-26T16:32:53.126 INFO:teuthology.orchestra.run.smithi157.stdout:VERSION="9" 2024-03-26T16:32:53.126 INFO:teuthology.orchestra.run.smithi157.stdout:ID="centos" 2024-03-26T16:32:53.127 INFO:teuthology.orchestra.run.smithi157.stdout:ID_LIKE="rhel fedora" 2024-03-26T16:32:53.127 INFO:teuthology.orchestra.run.smithi157.stdout:VERSION_ID="9" 2024-03-26T16:32:53.127 INFO:teuthology.orchestra.run.smithi157.stdout:PLATFORM_ID="platform:el9" 2024-03-26T16:32:53.127 INFO:teuthology.orchestra.run.smithi157.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-26T16:32:53.127 INFO:teuthology.orchestra.run.smithi157.stdout:ANSI_COLOR="0;31" 2024-03-26T16:32:53.127 INFO:teuthology.orchestra.run.smithi157.stdout:LOGO="fedora-logo-icon" 2024-03-26T16:32:53.127 INFO:teuthology.orchestra.run.smithi157.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-26T16:32:53.127 INFO:teuthology.orchestra.run.smithi157.stdout:HOME_URL="https://centos.org/" 2024-03-26T16:32:53.127 INFO:teuthology.orchestra.run.smithi157.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-26T16:32:53.127 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-26T16:32:53.127 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-26T16:32:53.127 INFO:teuthology.lock.ops:Updating smithi157.front.sepia.ceph.com on lock server 2024-03-26T16:32:53.151 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-03-26T16:32:53.162 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-03-26T16:32:53.167 INFO:teuthology.task.internal:Checking for old test directory... 2024-03-26T16:32:53.168 DEBUG:teuthology.orchestra.run.smithi044:> test '!' -e /home/ubuntu/cephtest 2024-03-26T16:32:53.170 DEBUG:teuthology.orchestra.run.smithi064:> test '!' -e /home/ubuntu/cephtest 2024-03-26T16:32:53.173 DEBUG:teuthology.orchestra.run.smithi149:> test '!' -e /home/ubuntu/cephtest 2024-03-26T16:32:53.175 DEBUG:teuthology.orchestra.run.smithi157:> test '!' -e /home/ubuntu/cephtest 2024-03-26T16:32:53.192 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-03-26T16:32:53.198 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-03-26T16:32:53.198 DEBUG:teuthology.orchestra.run.smithi044:> test -z $(ls -A /var/lib/ceph) 2024-03-26T16:32:53.228 DEBUG:teuthology.orchestra.run.smithi064:> test -z $(ls -A /var/lib/ceph) 2024-03-26T16:32:53.230 DEBUG:teuthology.orchestra.run.smithi149:> test -z $(ls -A /var/lib/ceph) 2024-03-26T16:32:53.232 DEBUG:teuthology.orchestra.run.smithi157:> test -z $(ls -A /var/lib/ceph) 2024-03-26T16:32:53.257 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-03-26T16:32:53.353 INFO:teuthology.run_tasks:Running task kernel... 2024-03-26T16:32:53.367 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2024-03-26T16:32:53.368 INFO:teuthology.task.kernel:config {'host.a': {'kdb': True, 'sha1': 'distro'}, 'host.b': {'kdb': True, 'sha1': 'distro'}, 'host.c': {'kdb': True, 'sha1': 'distro'}, 'client.3': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2024-03-26T16:32:53.368 DEBUG:teuthology.orchestra.run.smithi044:> test -f /run/.containerenv -o -f /.dockerenv 2024-03-26T16:32:53.369 DEBUG:teuthology.orchestra.run.smithi064:> test -f /run/.containerenv -o -f /.dockerenv 2024-03-26T16:32:53.369 DEBUG:teuthology.orchestra.run.smithi149:> test -f /run/.containerenv -o -f /.dockerenv 2024-03-26T16:32:53.369 DEBUG:teuthology.orchestra.run.smithi157:> test -f /run/.containerenv -o -f /.dockerenv 2024-03-26T16:32:53.385 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-26T16:32:53.386 DEBUG:teuthology.orchestra.run.smithi149:> uname -r 2024-03-26T16:32:53.387 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-26T16:32:53.387 DEBUG:teuthology.orchestra.run.smithi157:> uname -r 2024-03-26T16:32:53.388 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-26T16:32:53.388 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-26T16:32:53.389 DEBUG:teuthology.orchestra.run.smithi064:> uname -r 2024-03-26T16:32:53.389 DEBUG:teuthology.orchestra.run.smithi044:> uname -r 2024-03-26T16:32:53.441 INFO:teuthology.orchestra.run.smithi149.stdout:5.14.0-361.el9.x86_64 2024-03-26T16:32:53.442 INFO:teuthology.task.kernel:Running kernel on smithi149: 5.14.0-361.el9.x86_64 2024-03-26T16:32:53.442 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum install -y kernel 2024-03-26T16:32:53.445 INFO:teuthology.orchestra.run.smithi157.stdout:5.14.0-361.el9.x86_64 2024-03-26T16:32:53.445 INFO:teuthology.task.kernel:Running kernel on smithi157: 5.14.0-361.el9.x86_64 2024-03-26T16:32:53.445 DEBUG:teuthology.orchestra.run.smithi157:> sudo yum install -y kernel 2024-03-26T16:32:53.448 INFO:teuthology.orchestra.run.smithi064.stdout:5.14.0-361.el9.x86_64 2024-03-26T16:32:53.448 INFO:teuthology.orchestra.run.smithi044.stdout:5.14.0-361.el9.x86_64 2024-03-26T16:32:53.448 INFO:teuthology.task.kernel:Running kernel on smithi064: 5.14.0-361.el9.x86_64 2024-03-26T16:32:53.449 DEBUG:teuthology.orchestra.run.smithi064:> sudo yum install -y kernel 2024-03-26T16:32:53.449 INFO:teuthology.task.kernel:Running kernel on smithi044: 5.14.0-361.el9.x86_64 2024-03-26T16:32:53.449 DEBUG:teuthology.orchestra.run.smithi044:> sudo yum install -y kernel 2024-03-26T16:32:55.938 INFO:teuthology.orchestra.run.smithi064.stdout:CentOS-9 - AppStream 7.5 MB/s | 6.7 MB 00:00 2024-03-26T16:32:55.980 INFO:teuthology.orchestra.run.smithi149.stdout:CentOS-9 - AppStream 7.5 MB/s | 6.7 MB 00:00 2024-03-26T16:32:57.109 INFO:teuthology.orchestra.run.smithi157.stdout:CentOS-9 - AppStream 3.4 MB/s | 6.7 MB 00:01 2024-03-26T16:32:57.449 INFO:teuthology.orchestra.run.smithi044.stdout:CentOS-9 - AppStream 2.8 MB/s | 6.7 MB 00:02 2024-03-26T16:32:57.788 INFO:teuthology.orchestra.run.smithi064.stdout:CentOS-9 - BaseOS 2.9 MB/s | 2.0 MB 00:00 2024-03-26T16:32:58.467 INFO:teuthology.orchestra.run.smithi157.stdout:CentOS-9 - BaseOS 7.7 MB/s | 2.0 MB 00:00 2024-03-26T16:32:59.356 INFO:teuthology.orchestra.run.smithi149.stdout:CentOS-9 - BaseOS 907 kB/s | 2.0 MB 00:02 2024-03-26T16:32:59.456 INFO:teuthology.orchestra.run.smithi044.stdout:CentOS-9 - BaseOS 2.4 MB/s | 2.0 MB 00:00 2024-03-26T16:32:59.545 INFO:teuthology.orchestra.run.smithi064.stdout:CentOS Stream 9 - BaseOS 5.7 MB/s | 8.0 MB 00:01 2024-03-26T16:33:00.989 INFO:teuthology.orchestra.run.smithi044.stdout:CentOS Stream 9 - BaseOS 6.8 MB/s | 8.0 MB 00:01 2024-03-26T16:33:01.454 INFO:teuthology.orchestra.run.smithi149.stdout:CentOS Stream 9 - BaseOS 4.6 MB/s | 8.0 MB 00:01 2024-03-26T16:33:01.680 INFO:teuthology.orchestra.run.smithi064.stdout:CentOS Stream 9 - AppStream 19 MB/s | 19 MB 00:01 2024-03-26T16:33:02.715 INFO:teuthology.orchestra.run.smithi044.stdout:CentOS Stream 9 - AppStream 29 MB/s | 19 MB 00:00 2024-03-26T16:33:05.830 INFO:teuthology.orchestra.run.smithi064.stdout:CentOS Stream 9 - CRB 13 MB/s | 6.1 MB 00:00 2024-03-26T16:33:06.397 INFO:teuthology.orchestra.run.smithi149.stdout:CentOS Stream 9 - AppStream 4.8 MB/s | 19 MB 00:03 2024-03-26T16:33:06.741 INFO:teuthology.orchestra.run.smithi044.stdout:CentOS Stream 9 - CRB 13 MB/s | 6.1 MB 00:00 2024-03-26T16:33:07.323 INFO:teuthology.orchestra.run.smithi064.stdout:CentOS Stream 9 - Extras packages 61 kB/s | 16 kB 00:00 2024-03-26T16:33:07.423 INFO:teuthology.orchestra.run.smithi157.stdout:CentOS Stream 9 - BaseOS 954 kB/s | 8.0 MB 00:08 2024-03-26T16:33:08.417 INFO:teuthology.orchestra.run.smithi044.stdout:CentOS Stream 9 - Extras packages 33 kB/s | 16 kB 00:00 2024-03-26T16:33:09.895 INFO:teuthology.orchestra.run.smithi044.stdout:Extra Packages for Enterprise Linux 15 MB/s | 21 MB 00:01 2024-03-26T16:33:10.530 INFO:teuthology.orchestra.run.smithi149.stdout:CentOS Stream 9 - CRB 10 MB/s | 6.1 MB 00:00 2024-03-26T16:33:11.207 INFO:teuthology.orchestra.run.smithi064.stdout:Extra Packages for Enterprise Linux 5.5 MB/s | 21 MB 00:03 2024-03-26T16:33:12.224 INFO:teuthology.orchestra.run.smithi157.stdout:CentOS Stream 9 - AppStream 5.0 MB/s | 19 MB 00:03 2024-03-26T16:33:12.297 INFO:teuthology.orchestra.run.smithi149.stdout:CentOS Stream 9 - Extras packages 26 kB/s | 16 kB 00:00 2024-03-26T16:33:13.610 INFO:teuthology.orchestra.run.smithi149.stdout:Extra Packages for Enterprise Linux 17 MB/s | 21 MB 00:01 2024-03-26T16:33:15.010 INFO:teuthology.orchestra.run.smithi044.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-03-26T16:33:16.374 INFO:teuthology.orchestra.run.smithi064.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2024-03-26T16:33:17.291 INFO:teuthology.orchestra.run.smithi044.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-03-26T16:33:17.292 INFO:teuthology.orchestra.run.smithi044.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2024-03-26T16:33:17.382 INFO:teuthology.orchestra.run.smithi044.stdout:Dependencies resolved. 2024-03-26T16:33:17.390 INFO:teuthology.orchestra.run.smithi044.stdout:================================================================================ 2024-03-26T16:33:17.390 INFO:teuthology.orchestra.run.smithi044.stdout: Package Architecture Version Repository Size 2024-03-26T16:33:17.390 INFO:teuthology.orchestra.run.smithi044.stdout:================================================================================ 2024-03-26T16:33:17.390 INFO:teuthology.orchestra.run.smithi044.stdout:Installing: 2024-03-26T16:33:17.390 INFO:teuthology.orchestra.run.smithi044.stdout: kernel x86_64 5.14.0-432.el9 baseos 66 k 2024-03-26T16:33:17.390 INFO:teuthology.orchestra.run.smithi044.stdout:Installing dependencies: 2024-03-26T16:33:17.390 INFO:teuthology.orchestra.run.smithi044.stdout: kernel-core x86_64 5.14.0-432.el9 baseos 15 M 2024-03-26T16:33:17.391 INFO:teuthology.orchestra.run.smithi044.stdout: kernel-modules x86_64 5.14.0-432.el9 baseos 33 M 2024-03-26T16:33:17.391 INFO:teuthology.orchestra.run.smithi044.stdout: kernel-modules-core x86_64 5.14.0-432.el9 baseos 27 M 2024-03-26T16:33:17.391 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-26T16:33:17.391 INFO:teuthology.orchestra.run.smithi044.stdout:Transaction Summary 2024-03-26T16:33:17.391 INFO:teuthology.orchestra.run.smithi044.stdout:================================================================================ 2024-03-26T16:33:17.391 INFO:teuthology.orchestra.run.smithi044.stdout:Install 4 Packages 2024-03-26T16:33:17.391 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-26T16:33:17.392 INFO:teuthology.orchestra.run.smithi044.stdout:Total download size: 76 M 2024-03-26T16:33:17.392 INFO:teuthology.orchestra.run.smithi044.stdout:Installed size: 123 M 2024-03-26T16:33:17.392 INFO:teuthology.orchestra.run.smithi044.stdout:Downloading Packages: 2024-03-26T16:33:17.778 INFO:teuthology.orchestra.run.smithi044.stdout:(1/4): kernel-5.14.0-432.el9.x86_64.rpm 569 kB/s | 66 kB 00:00 2024-03-26T16:33:18.399 INFO:teuthology.orchestra.run.smithi157.stdout:CentOS Stream 9 - CRB 2.3 MB/s | 6.1 MB 00:02 2024-03-26T16:33:18.420 INFO:teuthology.orchestra.run.smithi044.stdout:(2/4): kernel-core-5.14.0-432.el9.x86_64.rpm 20 MB/s | 15 MB 00:00 2024-03-26T16:33:18.547 INFO:teuthology.orchestra.run.smithi064.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-03-26T16:33:18.548 INFO:teuthology.orchestra.run.smithi064.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2024-03-26T16:33:18.656 INFO:teuthology.orchestra.run.smithi064.stdout:Dependencies resolved. 2024-03-26T16:33:18.663 INFO:teuthology.orchestra.run.smithi064.stdout:================================================================================ 2024-03-26T16:33:18.663 INFO:teuthology.orchestra.run.smithi064.stdout: Package Architecture Version Repository Size 2024-03-26T16:33:18.663 INFO:teuthology.orchestra.run.smithi064.stdout:================================================================================ 2024-03-26T16:33:18.663 INFO:teuthology.orchestra.run.smithi064.stdout:Installing: 2024-03-26T16:33:18.663 INFO:teuthology.orchestra.run.smithi064.stdout: kernel x86_64 5.14.0-432.el9 baseos 66 k 2024-03-26T16:33:18.663 INFO:teuthology.orchestra.run.smithi064.stdout:Installing dependencies: 2024-03-26T16:33:18.663 INFO:teuthology.orchestra.run.smithi064.stdout: kernel-core x86_64 5.14.0-432.el9 baseos 15 M 2024-03-26T16:33:18.663 INFO:teuthology.orchestra.run.smithi064.stdout: kernel-modules x86_64 5.14.0-432.el9 baseos 33 M 2024-03-26T16:33:18.663 INFO:teuthology.orchestra.run.smithi064.stdout: kernel-modules-core x86_64 5.14.0-432.el9 baseos 27 M 2024-03-26T16:33:18.664 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-03-26T16:33:18.664 INFO:teuthology.orchestra.run.smithi064.stdout:Transaction Summary 2024-03-26T16:33:18.664 INFO:teuthology.orchestra.run.smithi064.stdout:================================================================================ 2024-03-26T16:33:18.664 INFO:teuthology.orchestra.run.smithi064.stdout:Install 4 Packages 2024-03-26T16:33:18.664 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-03-26T16:33:18.664 INFO:teuthology.orchestra.run.smithi064.stdout:Total download size: 76 M 2024-03-26T16:33:18.664 INFO:teuthology.orchestra.run.smithi064.stdout:Installed size: 123 M 2024-03-26T16:33:18.665 INFO:teuthology.orchestra.run.smithi064.stdout:Downloading Packages: 2024-03-26T16:33:18.715 INFO:teuthology.orchestra.run.smithi149.stdout:lab-extras 20 kB/s | 1.7 kB 00:00 2024-03-26T16:33:18.859 INFO:teuthology.orchestra.run.smithi064.stdout:(1/4): kernel-5.14.0-432.el9.x86_64.rpm 532 kB/s | 66 kB 00:00 2024-03-26T16:33:18.887 INFO:teuthology.orchestra.run.smithi044.stdout:(3/4): kernel-modules-5.14.0-432.el9.x86_64.rpm 27 MB/s | 33 MB 00:01 2024-03-26T16:33:19.329 INFO:teuthology.orchestra.run.smithi044.stdout:(4/4): kernel-modules-core-5.14.0-432.el9.x86_6 18 MB/s | 27 MB 00:01 2024-03-26T16:33:19.329 INFO:teuthology.orchestra.run.smithi044.stdout:-------------------------------------------------------------------------------- 2024-03-26T16:33:19.329 INFO:teuthology.orchestra.run.smithi044.stdout:Total 39 MB/s | 76 MB 00:01 2024-03-26T16:33:19.376 INFO:teuthology.orchestra.run.smithi064.stdout:(2/4): kernel-core-5.14.0-432.el9.x86_64.rpm 23 MB/s | 15 MB 00:00 2024-03-26T16:33:19.675 INFO:teuthology.orchestra.run.smithi157.stdout:CentOS Stream 9 - Extras packages 122 kB/s | 16 kB 00:00 2024-03-26T16:33:19.967 INFO:teuthology.orchestra.run.smithi064.stdout:(3/4): kernel-modules-5.14.0-432.el9.x86_64.rpm 27 MB/s | 33 MB 00:01 2024-03-26T16:33:20.019 INFO:teuthology.orchestra.run.smithi044.stdout:Running transaction check 2024-03-26T16:33:20.310 INFO:teuthology.orchestra.run.smithi064.stdout:(4/4): kernel-modules-core-5.14.0-432.el9.x86_6 19 MB/s | 27 MB 00:01 2024-03-26T16:33:20.310 INFO:teuthology.orchestra.run.smithi064.stdout:-------------------------------------------------------------------------------- 2024-03-26T16:33:20.310 INFO:teuthology.orchestra.run.smithi064.stdout:Total 46 MB/s | 76 MB 00:01 2024-03-26T16:33:20.444 INFO:teuthology.orchestra.run.smithi044.stdout:Transaction check succeeded. 2024-03-26T16:33:20.444 INFO:teuthology.orchestra.run.smithi044.stdout:Running transaction test 2024-03-26T16:33:20.897 INFO:teuthology.orchestra.run.smithi149.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-03-26T16:33:20.898 INFO:teuthology.orchestra.run.smithi149.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2024-03-26T16:33:20.991 INFO:teuthology.orchestra.run.smithi149.stdout:Dependencies resolved. 2024-03-26T16:33:20.998 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-03-26T16:33:20.998 INFO:teuthology.orchestra.run.smithi149.stdout: Package Architecture Version Repository Size 2024-03-26T16:33:20.998 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-03-26T16:33:20.998 INFO:teuthology.orchestra.run.smithi149.stdout:Installing: 2024-03-26T16:33:20.999 INFO:teuthology.orchestra.run.smithi149.stdout: kernel x86_64 5.14.0-432.el9 baseos 66 k 2024-03-26T16:33:20.999 INFO:teuthology.orchestra.run.smithi149.stdout:Installing dependencies: 2024-03-26T16:33:20.999 INFO:teuthology.orchestra.run.smithi149.stdout: kernel-core x86_64 5.14.0-432.el9 baseos 15 M 2024-03-26T16:33:20.999 INFO:teuthology.orchestra.run.smithi149.stdout: kernel-modules x86_64 5.14.0-432.el9 baseos 33 M 2024-03-26T16:33:20.999 INFO:teuthology.orchestra.run.smithi149.stdout: kernel-modules-core x86_64 5.14.0-432.el9 baseos 27 M 2024-03-26T16:33:20.999 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-03-26T16:33:20.999 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction Summary 2024-03-26T16:33:20.999 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-03-26T16:33:20.999 INFO:teuthology.orchestra.run.smithi149.stdout:Install 4 Packages 2024-03-26T16:33:20.999 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-03-26T16:33:21.000 INFO:teuthology.orchestra.run.smithi149.stdout:Total download size: 76 M 2024-03-26T16:33:21.000 INFO:teuthology.orchestra.run.smithi149.stdout:Installed size: 123 M 2024-03-26T16:33:21.000 INFO:teuthology.orchestra.run.smithi149.stdout:Downloading Packages: 2024-03-26T16:33:21.002 INFO:teuthology.orchestra.run.smithi064.stdout:Running transaction check 2024-03-26T16:33:21.208 INFO:teuthology.orchestra.run.smithi149.stdout:(1/4): kernel-5.14.0-432.el9.x86_64.rpm 865 kB/s | 66 kB 00:00 2024-03-26T16:33:21.427 INFO:teuthology.orchestra.run.smithi064.stdout:Transaction check succeeded. 2024-03-26T16:33:21.427 INFO:teuthology.orchestra.run.smithi064.stdout:Running transaction test 2024-03-26T16:33:21.531 INFO:teuthology.orchestra.run.smithi044.stdout:Transaction test succeeded. 2024-03-26T16:33:21.531 INFO:teuthology.orchestra.run.smithi044.stdout:Running transaction 2024-03-26T16:33:22.026 INFO:teuthology.orchestra.run.smithi149.stdout:(2/4): kernel-core-5.14.0-432.el9.x86_64.rpm 17 MB/s | 15 MB 00:00 2024-03-26T16:33:22.495 INFO:teuthology.orchestra.run.smithi064.stdout:Transaction test succeeded. 2024-03-26T16:33:22.495 INFO:teuthology.orchestra.run.smithi064.stdout:Running transaction 2024-03-26T16:33:22.642 INFO:teuthology.orchestra.run.smithi149.stdout:(3/4): kernel-modules-5.14.0-432.el9.x86_64.rpm 22 MB/s | 33 MB 00:01 2024-03-26T16:33:23.101 INFO:teuthology.orchestra.run.smithi149.stdout:(4/4): kernel-modules-core-5.14.0-432.el9.x86_6 15 MB/s | 27 MB 00:01 2024-03-26T16:33:23.102 INFO:teuthology.orchestra.run.smithi149.stdout:-------------------------------------------------------------------------------- 2024-03-26T16:33:23.102 INFO:teuthology.orchestra.run.smithi149.stdout:Total 36 MB/s | 76 MB 00:02 2024-03-26T16:33:23.629 INFO:teuthology.orchestra.run.smithi157.stdout:Extra Packages for Enterprise Linux 5.4 MB/s | 21 MB 00:03 2024-03-26T16:33:23.764 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction check 2024-03-26T16:33:24.147 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction check succeeded. 2024-03-26T16:33:24.147 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction test 2024-03-26T16:33:24.150 INFO:teuthology.orchestra.run.smithi044.stdout: Preparing : 1/1 2024-03-26T16:33:24.795 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : kernel-modules-core-5.14.0-432.el9.x86_64 1/4 2024-03-26T16:33:24.871 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : kernel-core-5.14.0-432.el9.x86_64 2/4 2024-03-26T16:33:25.180 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction test succeeded. 2024-03-26T16:33:25.180 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction 2024-03-26T16:33:25.216 INFO:teuthology.orchestra.run.smithi064.stdout: Preparing : 1/1 2024-03-26T16:33:25.867 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : kernel-modules-core-5.14.0-432.el9.x86_64 1/4 2024-03-26T16:33:25.959 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : kernel-core-5.14.0-432.el9.x86_64 2/4 2024-03-26T16:33:27.675 INFO:teuthology.orchestra.run.smithi149.stdout: Preparing : 1/1 2024-03-26T16:33:27.737 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: kernel-core-5.14.0-432.el9.x86_64 2/4 2024-03-26T16:33:27.874 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : kernel-modules-5.14.0-432.el9.x86_64 3/4 2024-03-26T16:33:28.302 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : kernel-modules-core-5.14.0-432.el9.x86_64 1/4 2024-03-26T16:33:28.384 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : kernel-core-5.14.0-432.el9.x86_64 2/4 2024-03-26T16:33:28.609 INFO:teuthology.orchestra.run.smithi157.stdout:lab-extras 14 kB/s | 1.7 kB 00:00 2024-03-26T16:33:28.841 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: kernel-core-5.14.0-432.el9.x86_64 2/4 2024-03-26T16:33:28.979 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : kernel-modules-5.14.0-432.el9.x86_64 3/4 2024-03-26T16:33:30.766 INFO:teuthology.orchestra.run.smithi157.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-03-26T16:33:30.766 INFO:teuthology.orchestra.run.smithi157.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2024-03-26T16:33:30.851 INFO:teuthology.orchestra.run.smithi157.stdout:Dependencies resolved. 2024-03-26T16:33:30.857 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2024-03-26T16:33:30.857 INFO:teuthology.orchestra.run.smithi157.stdout: Package Architecture Version Repository Size 2024-03-26T16:33:30.857 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2024-03-26T16:33:30.857 INFO:teuthology.orchestra.run.smithi157.stdout:Installing: 2024-03-26T16:33:30.857 INFO:teuthology.orchestra.run.smithi157.stdout: kernel x86_64 5.14.0-432.el9 baseos 66 k 2024-03-26T16:33:30.857 INFO:teuthology.orchestra.run.smithi157.stdout:Installing dependencies: 2024-03-26T16:33:30.858 INFO:teuthology.orchestra.run.smithi157.stdout: kernel-core x86_64 5.14.0-432.el9 baseos 15 M 2024-03-26T16:33:30.858 INFO:teuthology.orchestra.run.smithi157.stdout: kernel-modules x86_64 5.14.0-432.el9 baseos 33 M 2024-03-26T16:33:30.858 INFO:teuthology.orchestra.run.smithi157.stdout: kernel-modules-core x86_64 5.14.0-432.el9 baseos 27 M 2024-03-26T16:33:30.858 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-03-26T16:33:30.858 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction Summary 2024-03-26T16:33:30.858 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2024-03-26T16:33:30.858 INFO:teuthology.orchestra.run.smithi157.stdout:Install 4 Packages 2024-03-26T16:33:30.858 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-03-26T16:33:30.859 INFO:teuthology.orchestra.run.smithi157.stdout:Total download size: 76 M 2024-03-26T16:33:30.859 INFO:teuthology.orchestra.run.smithi157.stdout:Installed size: 123 M 2024-03-26T16:33:30.859 INFO:teuthology.orchestra.run.smithi157.stdout:Downloading Packages: 2024-03-26T16:33:31.102 INFO:teuthology.orchestra.run.smithi157.stdout:(1/4): kernel-5.14.0-432.el9.x86_64.rpm 590 kB/s | 66 kB 00:00 2024-03-26T16:33:31.140 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: kernel-core-5.14.0-432.el9.x86_64 2/4 2024-03-26T16:33:31.279 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : kernel-modules-5.14.0-432.el9.x86_64 3/4 2024-03-26T16:33:31.911 INFO:teuthology.orchestra.run.smithi157.stdout:(2/4): kernel-core-5.14.0-432.el9.x86_64.rpm 16 MB/s | 15 MB 00:00 2024-03-26T16:33:32.436 INFO:teuthology.orchestra.run.smithi157.stdout:(3/4): kernel-modules-5.14.0-432.el9.x86_64.rpm 23 MB/s | 33 MB 00:01 2024-03-26T16:33:32.811 INFO:teuthology.orchestra.run.smithi157.stdout:(4/4): kernel-modules-core-5.14.0-432.el9.x86_6 16 MB/s | 27 MB 00:01 2024-03-26T16:33:32.812 INFO:teuthology.orchestra.run.smithi157.stdout:-------------------------------------------------------------------------------- 2024-03-26T16:33:32.812 INFO:teuthology.orchestra.run.smithi157.stdout:Total 39 MB/s | 76 MB 00:01 2024-03-26T16:33:32.948 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: kernel-modules-5.14.0-432.el9.x86_64 3/4 2024-03-26T16:33:32.991 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : kernel-5.14.0-432.el9.x86_64 4/4 2024-03-26T16:33:33.484 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction check 2024-03-26T16:33:33.882 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction check succeeded. 2024-03-26T16:33:33.883 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction test 2024-03-26T16:33:34.056 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: kernel-modules-5.14.0-432.el9.x86_64 3/4 2024-03-26T16:33:34.102 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : kernel-5.14.0-432.el9.x86_64 4/4 2024-03-26T16:33:34.923 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction test succeeded. 2024-03-26T16:33:34.923 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction 2024-03-26T16:33:36.032 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: kernel-modules-5.14.0-432.el9.x86_64 3/4 2024-03-26T16:33:36.162 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : kernel-5.14.0-432.el9.x86_64 4/4 2024-03-26T16:33:37.409 INFO:teuthology.orchestra.run.smithi157.stdout: Preparing : 1/1 2024-03-26T16:33:38.088 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: kernel-modules-core-5.14.0-432.el9.x86_64 4/4 2024-03-26T16:33:38.095 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : kernel-modules-core-5.14.0-432.el9.x86_64 1/4 2024-03-26T16:33:38.187 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : kernel-core-5.14.0-432.el9.x86_64 2/4 2024-03-26T16:33:39.198 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: kernel-modules-core-5.14.0-432.el9.x86_64 4/4 2024-03-26T16:33:40.916 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: kernel-modules-core-5.14.0-432.el9.x86_64 4/4 2024-03-26T16:33:40.933 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: kernel-core-5.14.0-432.el9.x86_64 2/4 2024-03-26T16:33:41.074 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : kernel-modules-5.14.0-432.el9.x86_64 3/4 2024-03-26T16:33:45.757 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: kernel-modules-5.14.0-432.el9.x86_64 3/4 2024-03-26T16:33:45.832 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : kernel-5.14.0-432.el9.x86_64 4/4 2024-03-26T16:33:50.540 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: kernel-modules-core-5.14.0-432.el9.x86_64 4/4 2024-03-26T16:34:08.891 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: kernel-core-5.14.0-432.el9.x86_64 4/4 2024-03-26T16:34:08.891 INFO:teuthology.orchestra.run.smithi044.stdout:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-03-26T16:34:08.891 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-26T16:34:08.936 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: kernel-modules-5.14.0-432.el9.x86_64 4/4 2024-03-26T16:34:09.323 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: kernel-5.14.0-432.el9.x86_64 4/4 2024-03-26T16:34:09.323 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : kernel-5.14.0-432.el9.x86_64 1/4 2024-03-26T16:34:09.323 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : kernel-core-5.14.0-432.el9.x86_64 2/4 2024-03-26T16:34:09.323 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : kernel-modules-5.14.0-432.el9.x86_64 3/4 2024-03-26T16:34:09.753 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : kernel-modules-core-5.14.0-432.el9.x86_64 4/4 2024-03-26T16:34:09.754 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-26T16:34:09.754 INFO:teuthology.orchestra.run.smithi044.stdout:Installed: 2024-03-26T16:34:09.754 INFO:teuthology.orchestra.run.smithi044.stdout: kernel-5.14.0-432.el9.x86_64 2024-03-26T16:34:09.754 INFO:teuthology.orchestra.run.smithi044.stdout: kernel-core-5.14.0-432.el9.x86_64 2024-03-26T16:34:09.754 INFO:teuthology.orchestra.run.smithi044.stdout: kernel-modules-5.14.0-432.el9.x86_64 2024-03-26T16:34:09.754 INFO:teuthology.orchestra.run.smithi044.stdout: kernel-modules-core-5.14.0-432.el9.x86_64 2024-03-26T16:34:09.754 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-26T16:34:09.754 INFO:teuthology.orchestra.run.smithi044.stdout:Complete! 2024-03-26T16:34:09.945 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: kernel-core-5.14.0-432.el9.x86_64 4/4 2024-03-26T16:34:09.945 INFO:teuthology.orchestra.run.smithi064.stdout:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-03-26T16:34:09.945 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-03-26T16:34:09.990 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: kernel-modules-5.14.0-432.el9.x86_64 4/4 2024-03-26T16:34:10.095 DEBUG:teuthology.orchestra.run.smithi044:> rpm -q kernel | sort -rV | head -n 1 2024-03-26T16:34:10.244 INFO:teuthology.orchestra.run.smithi044.stdout:kernel-5.14.0-432.el9.x86_64 2024-03-26T16:34:10.244 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-432.el9.x86_64 2024-03-26T16:34:10.244 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-432.el9.x86_64 2024-03-26T16:34:10.244 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-03-26T16:34:10.244 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-03-26T16:34:10.244 INFO:teuthology.task.kernel:Installing distro kernel on host.a... 2024-03-26T16:34:10.245 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi044.front.sepia.ceph.com, path=None, version=distro) 2024-03-26T16:34:10.245 DEBUG:teuthology.orchestra.run.smithi044:> rpm -q kernel | sort -rV | head -n 1 2024-03-26T16:34:10.327 INFO:teuthology.orchestra.run.smithi044.stdout:kernel-5.14.0-432.el9.x86_64 2024-03-26T16:34:10.327 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-432.el9.x86_64 2024-03-26T16:34:10.328 DEBUG:teuthology.orchestra.run.smithi044:> sudo rpm -qi grub2-tools 2024-03-26T16:34:10.365 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: kernel-core-5.14.0-432.el9.x86_64 4/4 2024-03-26T16:34:10.365 INFO:teuthology.orchestra.run.smithi149.stdout:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-03-26T16:34:10.365 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-03-26T16:34:10.365 INFO:teuthology.orchestra.run.smithi044.stdout:Name : grub2-tools 2024-03-26T16:34:10.366 INFO:teuthology.orchestra.run.smithi044.stdout:Epoch : 1 2024-03-26T16:34:10.366 INFO:teuthology.orchestra.run.smithi044.stdout:Version : 2.06 2024-03-26T16:34:10.366 INFO:teuthology.orchestra.run.smithi044.stdout:Release : 68.el9 2024-03-26T16:34:10.366 INFO:teuthology.orchestra.run.smithi044.stdout:Architecture: x86_64 2024-03-26T16:34:10.366 INFO:teuthology.orchestra.run.smithi044.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-03-26T16:34:10.366 INFO:teuthology.orchestra.run.smithi044.stdout:Group : Unspecified 2024-03-26T16:34:10.366 INFO:teuthology.orchestra.run.smithi044.stdout:Size : 8264254 2024-03-26T16:34:10.366 INFO:teuthology.orchestra.run.smithi044.stdout:License : GPLv3+ 2024-03-26T16:34:10.366 INFO:teuthology.orchestra.run.smithi044.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-03-26T16:34:10.367 INFO:teuthology.orchestra.run.smithi044.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-03-26T16:34:10.367 INFO:teuthology.orchestra.run.smithi044.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-03-26T16:34:10.367 INFO:teuthology.orchestra.run.smithi044.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-03-26T16:34:10.367 INFO:teuthology.orchestra.run.smithi044.stdout:Packager : builder@centos.org 2024-03-26T16:34:10.367 INFO:teuthology.orchestra.run.smithi044.stdout:Vendor : CentOS 2024-03-26T16:34:10.367 INFO:teuthology.orchestra.run.smithi044.stdout:URL : http://www.gnu.org/software/grub/ 2024-03-26T16:34:10.367 INFO:teuthology.orchestra.run.smithi044.stdout:Summary : Support tools for GRUB. 2024-03-26T16:34:10.367 INFO:teuthology.orchestra.run.smithi044.stdout:Description : 2024-03-26T16:34:10.367 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-26T16:34:10.367 INFO:teuthology.orchestra.run.smithi044.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-03-26T16:34:10.367 INFO:teuthology.orchestra.run.smithi044.stdout:customizable bootloader with modular architecture. It supports a rich 2024-03-26T16:34:10.367 INFO:teuthology.orchestra.run.smithi044.stdout:variety of kernel formats, file systems, computer architectures and 2024-03-26T16:34:10.367 INFO:teuthology.orchestra.run.smithi044.stdout:hardware devices. 2024-03-26T16:34:10.368 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-26T16:34:10.368 INFO:teuthology.orchestra.run.smithi044.stdout:This subpackage provides tools for support of all platforms. 2024-03-26T16:34:10.369 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: kernel-5.14.0-432.el9.x86_64 4/4 2024-03-26T16:34:10.369 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : kernel-5.14.0-432.el9.x86_64 1/4 2024-03-26T16:34:10.369 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : kernel-core-5.14.0-432.el9.x86_64 2/4 2024-03-26T16:34:10.369 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : kernel-modules-5.14.0-432.el9.x86_64 3/4 2024-03-26T16:34:10.369 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-03-26T16:34:10.369 INFO:teuthology.task.kernel:Updating grub on smithi044 to boot 5.14.0-432.el9.x86_64 2024-03-26T16:34:10.370 DEBUG:teuthology.orchestra.run.smithi044:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-03-26T16:34:10.409 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: kernel-modules-5.14.0-432.el9.x86_64 4/4 2024-03-26T16:34:10.831 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : kernel-modules-core-5.14.0-432.el9.x86_64 4/4 2024-03-26T16:34:10.831 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-03-26T16:34:10.831 INFO:teuthology.orchestra.run.smithi064.stdout:Installed: 2024-03-26T16:34:10.831 INFO:teuthology.orchestra.run.smithi064.stdout: kernel-5.14.0-432.el9.x86_64 2024-03-26T16:34:10.831 INFO:teuthology.orchestra.run.smithi064.stdout: kernel-core-5.14.0-432.el9.x86_64 2024-03-26T16:34:10.831 INFO:teuthology.orchestra.run.smithi064.stdout: kernel-modules-5.14.0-432.el9.x86_64 2024-03-26T16:34:10.831 INFO:teuthology.orchestra.run.smithi064.stdout: kernel-modules-core-5.14.0-432.el9.x86_64 2024-03-26T16:34:10.831 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-03-26T16:34:10.831 INFO:teuthology.orchestra.run.smithi064.stdout:Complete! 2024-03-26T16:34:10.846 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: kernel-5.14.0-432.el9.x86_64 4/4 2024-03-26T16:34:10.846 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : kernel-5.14.0-432.el9.x86_64 1/4 2024-03-26T16:34:10.846 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : kernel-core-5.14.0-432.el9.x86_64 2/4 2024-03-26T16:34:10.846 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : kernel-modules-5.14.0-432.el9.x86_64 3/4 2024-03-26T16:34:11.025 INFO:teuthology.orchestra.run.smithi044.stderr:Generating grub configuration file ... 2024-03-26T16:34:11.165 DEBUG:teuthology.orchestra.run.smithi064:> rpm -q kernel | sort -rV | head -n 1 2024-03-26T16:34:11.265 INFO:teuthology.orchestra.run.smithi064.stdout:kernel-5.14.0-432.el9.x86_64 2024-03-26T16:34:11.265 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-432.el9.x86_64 2024-03-26T16:34:11.265 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-432.el9.x86_64 2024-03-26T16:34:11.266 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-03-26T16:34:11.266 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-03-26T16:34:11.266 INFO:teuthology.task.kernel:Installing distro kernel on host.b... 2024-03-26T16:34:11.266 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi064.front.sepia.ceph.com, path=None, version=distro) 2024-03-26T16:34:11.266 DEBUG:teuthology.orchestra.run.smithi064:> rpm -q kernel | sort -rV | head -n 1 2024-03-26T16:34:11.291 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : kernel-modules-core-5.14.0-432.el9.x86_64 4/4 2024-03-26T16:34:11.291 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-03-26T16:34:11.291 INFO:teuthology.orchestra.run.smithi149.stdout:Installed: 2024-03-26T16:34:11.291 INFO:teuthology.orchestra.run.smithi149.stdout: kernel-5.14.0-432.el9.x86_64 2024-03-26T16:34:11.291 INFO:teuthology.orchestra.run.smithi149.stdout: kernel-core-5.14.0-432.el9.x86_64 2024-03-26T16:34:11.291 INFO:teuthology.orchestra.run.smithi149.stdout: kernel-modules-5.14.0-432.el9.x86_64 2024-03-26T16:34:11.291 INFO:teuthology.orchestra.run.smithi149.stdout: kernel-modules-core-5.14.0-432.el9.x86_64 2024-03-26T16:34:11.292 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-03-26T16:34:11.292 INFO:teuthology.orchestra.run.smithi149.stdout:Complete! 2024-03-26T16:34:11.348 INFO:teuthology.orchestra.run.smithi064.stdout:kernel-5.14.0-432.el9.x86_64 2024-03-26T16:34:11.349 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-432.el9.x86_64 2024-03-26T16:34:11.349 DEBUG:teuthology.orchestra.run.smithi064:> sudo rpm -qi grub2-tools 2024-03-26T16:34:11.386 INFO:teuthology.orchestra.run.smithi064.stdout:Name : grub2-tools 2024-03-26T16:34:11.387 INFO:teuthology.orchestra.run.smithi064.stdout:Epoch : 1 2024-03-26T16:34:11.387 INFO:teuthology.orchestra.run.smithi064.stdout:Version : 2.06 2024-03-26T16:34:11.387 INFO:teuthology.orchestra.run.smithi064.stdout:Release : 68.el9 2024-03-26T16:34:11.387 INFO:teuthology.orchestra.run.smithi064.stdout:Architecture: x86_64 2024-03-26T16:34:11.387 INFO:teuthology.orchestra.run.smithi064.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-03-26T16:34:11.387 INFO:teuthology.orchestra.run.smithi064.stdout:Group : Unspecified 2024-03-26T16:34:11.387 INFO:teuthology.orchestra.run.smithi064.stdout:Size : 8264254 2024-03-26T16:34:11.387 INFO:teuthology.orchestra.run.smithi064.stdout:License : GPLv3+ 2024-03-26T16:34:11.387 INFO:teuthology.orchestra.run.smithi064.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-03-26T16:34:11.387 INFO:teuthology.orchestra.run.smithi064.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-03-26T16:34:11.387 INFO:teuthology.orchestra.run.smithi064.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-03-26T16:34:11.387 INFO:teuthology.orchestra.run.smithi064.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-03-26T16:34:11.387 INFO:teuthology.orchestra.run.smithi064.stdout:Packager : builder@centos.org 2024-03-26T16:34:11.387 INFO:teuthology.orchestra.run.smithi064.stdout:Vendor : CentOS 2024-03-26T16:34:11.388 INFO:teuthology.orchestra.run.smithi064.stdout:URL : http://www.gnu.org/software/grub/ 2024-03-26T16:34:11.388 INFO:teuthology.orchestra.run.smithi064.stdout:Summary : Support tools for GRUB. 2024-03-26T16:34:11.388 INFO:teuthology.orchestra.run.smithi064.stdout:Description : 2024-03-26T16:34:11.388 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-03-26T16:34:11.388 INFO:teuthology.orchestra.run.smithi064.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-03-26T16:34:11.388 INFO:teuthology.orchestra.run.smithi064.stdout:customizable bootloader with modular architecture. It supports a rich 2024-03-26T16:34:11.388 INFO:teuthology.orchestra.run.smithi064.stdout:variety of kernel formats, file systems, computer architectures and 2024-03-26T16:34:11.388 INFO:teuthology.orchestra.run.smithi064.stdout:hardware devices. 2024-03-26T16:34:11.388 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-03-26T16:34:11.388 INFO:teuthology.orchestra.run.smithi064.stdout:This subpackage provides tools for support of all platforms. 2024-03-26T16:34:11.389 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-03-26T16:34:11.389 INFO:teuthology.task.kernel:Updating grub on smithi064 to boot 5.14.0-432.el9.x86_64 2024-03-26T16:34:11.389 DEBUG:teuthology.orchestra.run.smithi064:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-03-26T16:34:11.612 DEBUG:teuthology.orchestra.run.smithi149:> rpm -q kernel | sort -rV | head -n 1 2024-03-26T16:34:11.722 INFO:teuthology.orchestra.run.smithi149.stdout:kernel-5.14.0-432.el9.x86_64 2024-03-26T16:34:11.723 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-432.el9.x86_64 2024-03-26T16:34:11.723 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-432.el9.x86_64 2024-03-26T16:34:11.723 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-03-26T16:34:11.723 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-03-26T16:34:11.723 INFO:teuthology.task.kernel:Installing distro kernel on host.c... 2024-03-26T16:34:11.723 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi149.front.sepia.ceph.com, path=None, version=distro) 2024-03-26T16:34:11.723 DEBUG:teuthology.orchestra.run.smithi149:> rpm -q kernel | sort -rV | head -n 1 2024-03-26T16:34:11.805 INFO:teuthology.orchestra.run.smithi149.stdout:kernel-5.14.0-432.el9.x86_64 2024-03-26T16:34:11.806 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-432.el9.x86_64 2024-03-26T16:34:11.806 DEBUG:teuthology.orchestra.run.smithi149:> sudo rpm -qi grub2-tools 2024-03-26T16:34:11.849 INFO:teuthology.orchestra.run.smithi149.stdout:Name : grub2-tools 2024-03-26T16:34:11.849 INFO:teuthology.orchestra.run.smithi149.stdout:Epoch : 1 2024-03-26T16:34:11.849 INFO:teuthology.orchestra.run.smithi149.stdout:Version : 2.06 2024-03-26T16:34:11.849 INFO:teuthology.orchestra.run.smithi149.stdout:Release : 68.el9 2024-03-26T16:34:11.849 INFO:teuthology.orchestra.run.smithi149.stdout:Architecture: x86_64 2024-03-26T16:34:11.849 INFO:teuthology.orchestra.run.smithi149.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-03-26T16:34:11.849 INFO:teuthology.orchestra.run.smithi149.stdout:Group : Unspecified 2024-03-26T16:34:11.849 INFO:teuthology.orchestra.run.smithi149.stdout:Size : 8264254 2024-03-26T16:34:11.849 INFO:teuthology.orchestra.run.smithi149.stdout:License : GPLv3+ 2024-03-26T16:34:11.849 INFO:teuthology.orchestra.run.smithi149.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-03-26T16:34:11.850 INFO:teuthology.orchestra.run.smithi149.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-03-26T16:34:11.850 INFO:teuthology.orchestra.run.smithi149.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-03-26T16:34:11.850 INFO:teuthology.orchestra.run.smithi149.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-03-26T16:34:11.850 INFO:teuthology.orchestra.run.smithi149.stdout:Packager : builder@centos.org 2024-03-26T16:34:11.850 INFO:teuthology.orchestra.run.smithi149.stdout:Vendor : CentOS 2024-03-26T16:34:11.850 INFO:teuthology.orchestra.run.smithi149.stdout:URL : http://www.gnu.org/software/grub/ 2024-03-26T16:34:11.850 INFO:teuthology.orchestra.run.smithi149.stdout:Summary : Support tools for GRUB. 2024-03-26T16:34:11.850 INFO:teuthology.orchestra.run.smithi149.stdout:Description : 2024-03-26T16:34:11.850 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-03-26T16:34:11.850 INFO:teuthology.orchestra.run.smithi149.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-03-26T16:34:11.850 INFO:teuthology.orchestra.run.smithi149.stdout:customizable bootloader with modular architecture. It supports a rich 2024-03-26T16:34:11.850 INFO:teuthology.orchestra.run.smithi149.stdout:variety of kernel formats, file systems, computer architectures and 2024-03-26T16:34:11.850 INFO:teuthology.orchestra.run.smithi149.stdout:hardware devices. 2024-03-26T16:34:11.850 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-03-26T16:34:11.851 INFO:teuthology.orchestra.run.smithi149.stdout:This subpackage provides tools for support of all platforms. 2024-03-26T16:34:11.851 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-03-26T16:34:11.851 INFO:teuthology.task.kernel:Updating grub on smithi149 to boot 5.14.0-432.el9.x86_64 2024-03-26T16:34:11.852 DEBUG:teuthology.orchestra.run.smithi149:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-03-26T16:34:12.027 INFO:teuthology.orchestra.run.smithi064.stderr:Generating grub configuration file ... 2024-03-26T16:34:12.325 INFO:teuthology.orchestra.run.smithi044.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-03-26T16:34:12.360 INFO:teuthology.orchestra.run.smithi044.stderr:done 2024-03-26T16:34:12.362 DEBUG:teuthology.orchestra.run.smithi044:> mktemp 2024-03-26T16:34:12.377 INFO:teuthology.orchestra.run.smithi044.stdout:/tmp/tmp.NKo5pAYRk4 2024-03-26T16:34:12.378 DEBUG:teuthology.orchestra.run.smithi044:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.NKo5pAYRk4 2024-03-26T16:34:12.426 INFO:teuthology.orchestra.run.smithi149.stderr:Generating grub configuration file ... 2024-03-26T16:34:12.449 DEBUG:teuthology.orchestra.run.smithi044:> sudo chmod 0666 /tmp/tmp.NKo5pAYRk4 2024-03-26T16:34:12.596 DEBUG:teuthology.orchestra.remote:smithi044:/tmp/tmp.NKo5pAYRk4 is 6KB 2024-03-26T16:34:12.645 DEBUG:teuthology.orchestra.run.smithi044:> rm -fr /tmp/tmp.NKo5pAYRk4 2024-03-26T16:34:12.659 DEBUG:teuthology.orchestra.run.smithi044:> sudo /bin/ls /boot/loader/entries || true 2024-03-26T16:34:12.728 INFO:teuthology.orchestra.run.smithi044.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-03-26T16:34:12.728 INFO:teuthology.orchestra.run.smithi044.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-03-26T16:34:12.728 INFO:teuthology.orchestra.run.smithi044.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-03-26T16:34:12.728 INFO:teuthology.orchestra.run.smithi044.stdout:15949e3c88704300882482eddfd7baae-5.14.0-432.el9.x86_64.conf 2024-03-26T16:34:12.729 DEBUG:teuthology.orchestra.run.smithi044:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-432.el9.x86_64 2024-03-26T16:34:12.890 DEBUG:teuthology.orchestra.run.smithi044:> sudo shutdown -r now 2024-03-26T16:34:13.453 INFO:teuthology.orchestra.run.smithi064.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-03-26T16:34:13.492 INFO:teuthology.orchestra.run.smithi064.stderr:done 2024-03-26T16:34:13.494 DEBUG:teuthology.orchestra.run.smithi064:> mktemp 2024-03-26T16:34:13.509 INFO:teuthology.orchestra.run.smithi064.stdout:/tmp/tmp.OMP6q8QQDA 2024-03-26T16:34:13.509 DEBUG:teuthology.orchestra.run.smithi064:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.OMP6q8QQDA 2024-03-26T16:34:13.581 DEBUG:teuthology.orchestra.run.smithi064:> sudo chmod 0666 /tmp/tmp.OMP6q8QQDA 2024-03-26T16:34:13.727 DEBUG:teuthology.orchestra.remote:smithi064:/tmp/tmp.OMP6q8QQDA is 6KB 2024-03-26T16:34:13.746 DEBUG:teuthology.orchestra.run.smithi064:> rm -fr /tmp/tmp.OMP6q8QQDA 2024-03-26T16:34:13.761 DEBUG:teuthology.orchestra.run.smithi064:> sudo /bin/ls /boot/loader/entries || true 2024-03-26T16:34:13.779 INFO:teuthology.orchestra.run.smithi149.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-03-26T16:34:13.813 INFO:teuthology.orchestra.run.smithi149.stderr:done 2024-03-26T16:34:13.816 DEBUG:teuthology.orchestra.run.smithi149:> mktemp 2024-03-26T16:34:13.829 INFO:teuthology.orchestra.run.smithi064.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-03-26T16:34:13.829 INFO:teuthology.orchestra.run.smithi064.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-03-26T16:34:13.829 INFO:teuthology.orchestra.run.smithi064.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-03-26T16:34:13.830 INFO:teuthology.orchestra.run.smithi064.stdout:15949e3c88704300882482eddfd7baae-5.14.0-432.el9.x86_64.conf 2024-03-26T16:34:13.830 INFO:teuthology.orchestra.run.smithi149.stdout:/tmp/tmp.H6QvyY6EOq 2024-03-26T16:34:13.831 DEBUG:teuthology.orchestra.run.smithi149:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.H6QvyY6EOq 2024-03-26T16:34:13.832 DEBUG:teuthology.orchestra.run.smithi064:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-432.el9.x86_64 2024-03-26T16:34:13.904 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod 0666 /tmp/tmp.H6QvyY6EOq 2024-03-26T16:34:13.984 DEBUG:teuthology.orchestra.run.smithi064:> sudo shutdown -r now 2024-03-26T16:34:14.039 DEBUG:teuthology.orchestra.remote:smithi149:/tmp/tmp.H6QvyY6EOq is 6KB 2024-03-26T16:34:14.088 DEBUG:teuthology.orchestra.run.smithi149:> rm -fr /tmp/tmp.H6QvyY6EOq 2024-03-26T16:34:14.102 DEBUG:teuthology.orchestra.run.smithi149:> sudo /bin/ls /boot/loader/entries || true 2024-03-26T16:34:14.169 INFO:teuthology.orchestra.run.smithi149.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-03-26T16:34:14.169 INFO:teuthology.orchestra.run.smithi149.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-03-26T16:34:14.169 INFO:teuthology.orchestra.run.smithi149.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-03-26T16:34:14.170 INFO:teuthology.orchestra.run.smithi149.stdout:15949e3c88704300882482eddfd7baae-5.14.0-432.el9.x86_64.conf 2024-03-26T16:34:14.171 DEBUG:teuthology.orchestra.run.smithi149:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-432.el9.x86_64 2024-03-26T16:34:14.334 DEBUG:teuthology.orchestra.run.smithi149:> sudo shutdown -r now 2024-03-26T16:34:19.720 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: kernel-core-5.14.0-432.el9.x86_64 4/4 2024-03-26T16:34:19.720 INFO:teuthology.orchestra.run.smithi157.stdout:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-03-26T16:34:19.720 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-03-26T16:34:19.765 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: kernel-modules-5.14.0-432.el9.x86_64 4/4 2024-03-26T16:34:20.184 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: kernel-5.14.0-432.el9.x86_64 4/4 2024-03-26T16:34:20.184 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : kernel-5.14.0-432.el9.x86_64 1/4 2024-03-26T16:34:20.184 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : kernel-core-5.14.0-432.el9.x86_64 2/4 2024-03-26T16:34:20.184 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : kernel-modules-5.14.0-432.el9.x86_64 3/4 2024-03-26T16:34:20.617 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : kernel-modules-core-5.14.0-432.el9.x86_64 4/4 2024-03-26T16:34:20.618 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-03-26T16:34:20.618 INFO:teuthology.orchestra.run.smithi157.stdout:Installed: 2024-03-26T16:34:20.618 INFO:teuthology.orchestra.run.smithi157.stdout: kernel-5.14.0-432.el9.x86_64 2024-03-26T16:34:20.618 INFO:teuthology.orchestra.run.smithi157.stdout: kernel-core-5.14.0-432.el9.x86_64 2024-03-26T16:34:20.618 INFO:teuthology.orchestra.run.smithi157.stdout: kernel-modules-5.14.0-432.el9.x86_64 2024-03-26T16:34:20.618 INFO:teuthology.orchestra.run.smithi157.stdout: kernel-modules-core-5.14.0-432.el9.x86_64 2024-03-26T16:34:20.618 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-03-26T16:34:20.618 INFO:teuthology.orchestra.run.smithi157.stdout:Complete! 2024-03-26T16:34:20.959 DEBUG:teuthology.orchestra.run.smithi157:> rpm -q kernel | sort -rV | head -n 1 2024-03-26T16:34:21.061 INFO:teuthology.orchestra.run.smithi157.stdout:kernel-5.14.0-432.el9.x86_64 2024-03-26T16:34:21.061 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-432.el9.x86_64 2024-03-26T16:34:21.061 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-432.el9.x86_64 2024-03-26T16:34:21.061 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-03-26T16:34:21.061 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-03-26T16:34:21.062 INFO:teuthology.task.kernel:Installing distro kernel on client.3... 2024-03-26T16:34:21.062 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi157.front.sepia.ceph.com, path=None, version=distro) 2024-03-26T16:34:21.062 DEBUG:teuthology.orchestra.run.smithi157:> rpm -q kernel | sort -rV | head -n 1 2024-03-26T16:34:21.142 INFO:teuthology.orchestra.run.smithi157.stdout:kernel-5.14.0-432.el9.x86_64 2024-03-26T16:34:21.143 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-432.el9.x86_64 2024-03-26T16:34:21.143 DEBUG:teuthology.orchestra.run.smithi157:> sudo rpm -qi grub2-tools 2024-03-26T16:34:21.177 INFO:teuthology.orchestra.run.smithi157.stdout:Name : grub2-tools 2024-03-26T16:34:21.177 INFO:teuthology.orchestra.run.smithi157.stdout:Epoch : 1 2024-03-26T16:34:21.177 INFO:teuthology.orchestra.run.smithi157.stdout:Version : 2.06 2024-03-26T16:34:21.177 INFO:teuthology.orchestra.run.smithi157.stdout:Release : 68.el9 2024-03-26T16:34:21.177 INFO:teuthology.orchestra.run.smithi157.stdout:Architecture: x86_64 2024-03-26T16:34:21.177 INFO:teuthology.orchestra.run.smithi157.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-03-26T16:34:21.177 INFO:teuthology.orchestra.run.smithi157.stdout:Group : Unspecified 2024-03-26T16:34:21.178 INFO:teuthology.orchestra.run.smithi157.stdout:Size : 8264254 2024-03-26T16:34:21.178 INFO:teuthology.orchestra.run.smithi157.stdout:License : GPLv3+ 2024-03-26T16:34:21.178 INFO:teuthology.orchestra.run.smithi157.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-03-26T16:34:21.178 INFO:teuthology.orchestra.run.smithi157.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-03-26T16:34:21.178 INFO:teuthology.orchestra.run.smithi157.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-03-26T16:34:21.178 INFO:teuthology.orchestra.run.smithi157.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-03-26T16:34:21.178 INFO:teuthology.orchestra.run.smithi157.stdout:Packager : builder@centos.org 2024-03-26T16:34:21.178 INFO:teuthology.orchestra.run.smithi157.stdout:Vendor : CentOS 2024-03-26T16:34:21.178 INFO:teuthology.orchestra.run.smithi157.stdout:URL : http://www.gnu.org/software/grub/ 2024-03-26T16:34:21.178 INFO:teuthology.orchestra.run.smithi157.stdout:Summary : Support tools for GRUB. 2024-03-26T16:34:21.178 INFO:teuthology.orchestra.run.smithi157.stdout:Description : 2024-03-26T16:34:21.178 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-03-26T16:34:21.178 INFO:teuthology.orchestra.run.smithi157.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-03-26T16:34:21.178 INFO:teuthology.orchestra.run.smithi157.stdout:customizable bootloader with modular architecture. It supports a rich 2024-03-26T16:34:21.179 INFO:teuthology.orchestra.run.smithi157.stdout:variety of kernel formats, file systems, computer architectures and 2024-03-26T16:34:21.179 INFO:teuthology.orchestra.run.smithi157.stdout:hardware devices. 2024-03-26T16:34:21.179 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-03-26T16:34:21.179 INFO:teuthology.orchestra.run.smithi157.stdout:This subpackage provides tools for support of all platforms. 2024-03-26T16:34:21.179 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-03-26T16:34:21.179 INFO:teuthology.task.kernel:Updating grub on smithi157 to boot 5.14.0-432.el9.x86_64 2024-03-26T16:34:21.180 DEBUG:teuthology.orchestra.run.smithi157:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-03-26T16:34:21.821 INFO:teuthology.orchestra.run.smithi157.stderr:Generating grub configuration file ... 2024-03-26T16:34:23.160 INFO:teuthology.orchestra.run.smithi157.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-03-26T16:34:23.193 INFO:teuthology.orchestra.run.smithi157.stderr:done 2024-03-26T16:34:23.195 DEBUG:teuthology.orchestra.run.smithi157:> mktemp 2024-03-26T16:34:23.210 INFO:teuthology.orchestra.run.smithi157.stdout:/tmp/tmp.SnvSPg7Qh9 2024-03-26T16:34:23.211 DEBUG:teuthology.orchestra.run.smithi157:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.SnvSPg7Qh9 2024-03-26T16:34:23.281 DEBUG:teuthology.orchestra.run.smithi157:> sudo chmod 0666 /tmp/tmp.SnvSPg7Qh9 2024-03-26T16:34:23.421 DEBUG:teuthology.orchestra.remote:smithi157:/tmp/tmp.SnvSPg7Qh9 is 6KB 2024-03-26T16:34:23.470 DEBUG:teuthology.orchestra.run.smithi157:> rm -fr /tmp/tmp.SnvSPg7Qh9 2024-03-26T16:34:23.485 DEBUG:teuthology.orchestra.run.smithi157:> sudo /bin/ls /boot/loader/entries || true 2024-03-26T16:34:23.558 INFO:teuthology.orchestra.run.smithi157.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-03-26T16:34:23.558 INFO:teuthology.orchestra.run.smithi157.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-03-26T16:34:23.558 INFO:teuthology.orchestra.run.smithi157.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-03-26T16:34:23.558 INFO:teuthology.orchestra.run.smithi157.stdout:15949e3c88704300882482eddfd7baae-5.14.0-432.el9.x86_64.conf 2024-03-26T16:34:23.560 DEBUG:teuthology.orchestra.run.smithi157:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-432.el9.x86_64 2024-03-26T16:34:23.714 DEBUG:teuthology.orchestra.run.smithi157:> sudo shutdown -r now 2024-03-26T16:34:42.909 INFO:teuthology.task.kernel:Checking client host.a for new kernel version... 2024-03-26T16:34:42.910 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi044.front.sepia.ceph.com' 2024-03-26T16:34:42.911 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T16:34:43.987 INFO:teuthology.task.kernel:Checking client host.b for new kernel version... 2024-03-26T16:34:43.988 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi064.front.sepia.ceph.com' 2024-03-26T16:34:43.988 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T16:34:44.337 INFO:teuthology.task.kernel:Checking client host.c for new kernel version... 2024-03-26T16:34:44.337 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi149.front.sepia.ceph.com' 2024-03-26T16:34:44.338 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T16:34:53.725 INFO:teuthology.task.kernel:Checking client client.3 for new kernel version... 2024-03-26T16:34:53.725 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi157.front.sepia.ceph.com' 2024-03-26T16:34:53.726 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T16:35:18.943 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.149 2024-03-26T16:35:27.946 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi149.front.sepia.ceph.com' 2024-03-26T16:35:27.947 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T16:35:28.414 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.157 2024-03-26T16:35:37.423 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi157.front.sepia.ceph.com' 2024-03-26T16:35:37.424 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T16:35:40.478 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.157 2024-03-26T16:35:42.915 DEBUG:teuthology.orchestra.remote:timed out 2024-03-26T16:35:43.991 DEBUG:teuthology.orchestra.remote:timed out 2024-03-26T16:35:46.341 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.149 2024-03-26T16:35:51.918 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi044.front.sepia.ceph.com' 2024-03-26T16:35:51.919 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T16:35:52.273 DEBUG:teuthology.orchestra.run.smithi044:> true 2024-03-26T16:35:52.479 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi157.front.sepia.ceph.com' 2024-03-26T16:35:52.480 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T16:35:52.760 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi044.front.sepia.ceph.com' 2024-03-26T16:35:52.760 INFO:teuthology.task.kernel:Checking kernel version of host.a, want "5.14.0-432.el9.x86_64"... 2024-03-26T16:35:52.760 DEBUG:teuthology.orchestra.run.smithi044:> uname -r 2024-03-26T16:35:52.774 INFO:teuthology.orchestra.run.smithi044.stdout:5.14.0-432.el9.x86_64 2024-03-26T16:35:52.774 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-432.el9.x86_64 vs 5.14.0-432.el9.x86_64 2024-03-26T16:35:52.774 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-03-26T16:35:52.775 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-03-26T16:35:52.993 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi064.front.sepia.ceph.com' 2024-03-26T16:35:52.993 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T16:35:53.303 DEBUG:teuthology.orchestra.run.smithi064:> true 2024-03-26T16:35:53.752 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi064.front.sepia.ceph.com' 2024-03-26T16:35:53.752 INFO:teuthology.task.kernel:Checking kernel version of host.b, want "5.14.0-432.el9.x86_64"... 2024-03-26T16:35:53.753 DEBUG:teuthology.orchestra.run.smithi064:> uname -r 2024-03-26T16:35:53.766 INFO:teuthology.orchestra.run.smithi064.stdout:5.14.0-432.el9.x86_64 2024-03-26T16:35:53.766 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-432.el9.x86_64 vs 5.14.0-432.el9.x86_64 2024-03-26T16:35:53.766 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-03-26T16:35:53.766 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-03-26T16:35:53.776 INFO:teuthology.task.kernel:Enabling kdb on host.a... 2024-03-26T16:35:53.776 DEBUG:teuthology.orchestra.run.smithi044:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-03-26T16:35:53.857 INFO:teuthology.orchestra.run.smithi044.stdout:ttyS1 2024-03-26T16:35:53.911 DEBUG:teuthology.parallel:result is None 2024-03-26T16:35:54.767 INFO:teuthology.task.kernel:Enabling kdb on host.b... 2024-03-26T16:35:54.767 DEBUG:teuthology.orchestra.run.smithi064:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-03-26T16:35:54.852 INFO:teuthology.orchestra.run.smithi064.stdout:ttyS1 2024-03-26T16:35:54.903 DEBUG:teuthology.parallel:result is None 2024-03-26T16:35:58.342 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi149.front.sepia.ceph.com' 2024-03-26T16:35:58.343 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T16:36:01.752 DEBUG:teuthology.orchestra.run.smithi149:> true 2024-03-26T16:36:02.274 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi149.front.sepia.ceph.com' 2024-03-26T16:36:02.275 INFO:teuthology.task.kernel:Checking kernel version of host.c, want "5.14.0-432.el9.x86_64"... 2024-03-26T16:36:02.275 DEBUG:teuthology.orchestra.run.smithi149:> uname -r 2024-03-26T16:36:02.289 INFO:teuthology.orchestra.run.smithi149.stdout:5.14.0-432.el9.x86_64 2024-03-26T16:36:02.289 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-432.el9.x86_64 vs 5.14.0-432.el9.x86_64 2024-03-26T16:36:02.289 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-03-26T16:36:02.289 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-03-26T16:36:03.290 INFO:teuthology.task.kernel:Enabling kdb on host.c... 2024-03-26T16:36:03.290 DEBUG:teuthology.orchestra.run.smithi149:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-03-26T16:36:03.382 INFO:teuthology.orchestra.run.smithi149.stdout:ttyS1 2024-03-26T16:36:03.416 DEBUG:teuthology.parallel:result is None 2024-03-26T16:36:10.910 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.157 2024-03-26T16:36:25.913 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi157.front.sepia.ceph.com' 2024-03-26T16:36:25.914 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T16:36:26.273 DEBUG:teuthology.orchestra.run.smithi157:> true 2024-03-26T16:36:26.690 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi157.front.sepia.ceph.com' 2024-03-26T16:36:26.690 INFO:teuthology.task.kernel:Checking kernel version of client.3, want "5.14.0-432.el9.x86_64"... 2024-03-26T16:36:26.690 DEBUG:teuthology.orchestra.run.smithi157:> uname -r 2024-03-26T16:36:26.705 INFO:teuthology.orchestra.run.smithi157.stdout:5.14.0-432.el9.x86_64 2024-03-26T16:36:26.705 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-432.el9.x86_64 vs 5.14.0-432.el9.x86_64 2024-03-26T16:36:26.705 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-03-26T16:36:26.705 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-03-26T16:36:27.706 INFO:teuthology.task.kernel:Enabling kdb on client.3... 2024-03-26T16:36:27.706 DEBUG:teuthology.orchestra.run.smithi157:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-03-26T16:36:27.774 INFO:teuthology.orchestra.run.smithi157.stdout:ttyS1 2024-03-26T16:36:27.803 DEBUG:teuthology.parallel:result is None 2024-03-26T16:36:27.803 INFO:teuthology.run_tasks:Running task internal.base... 2024-03-26T16:36:27.812 INFO:teuthology.task.internal:Creating test directory... 2024-03-26T16:36:27.812 DEBUG:teuthology.orchestra.run.smithi044:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-03-26T16:36:27.815 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-03-26T16:36:27.818 DEBUG:teuthology.orchestra.run.smithi149:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-03-26T16:36:27.821 DEBUG:teuthology.orchestra.run.smithi157:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-03-26T16:36:27.838 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-03-26T16:36:27.849 INFO:teuthology.run_tasks:Running task internal.archive... 2024-03-26T16:36:27.863 INFO:teuthology.task.internal:Creating archive directory... 2024-03-26T16:36:27.863 DEBUG:teuthology.orchestra.run.smithi044:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-03-26T16:36:27.874 DEBUG:teuthology.orchestra.run.smithi064:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-03-26T16:36:27.876 DEBUG:teuthology.orchestra.run.smithi149:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-03-26T16:36:27.880 DEBUG:teuthology.orchestra.run.smithi157:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-03-26T16:36:27.973 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-03-26T16:36:27.984 INFO:teuthology.task.internal:Enabling coredump saving... 2024-03-26T16:36:27.985 DEBUG:teuthology.orchestra.run.smithi044:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-03-26T16:36:27.987 DEBUG:teuthology.orchestra.run.smithi064:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-03-26T16:36:27.989 DEBUG:teuthology.orchestra.run.smithi149:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-03-26T16:36:27.991 DEBUG:teuthology.orchestra.run.smithi157:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-03-26T16:36:28.018 INFO:teuthology.orchestra.run.smithi044.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-26T16:36:28.022 INFO:teuthology.orchestra.run.smithi149.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-26T16:36:28.026 INFO:teuthology.orchestra.run.smithi064.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-26T16:36:28.029 INFO:teuthology.orchestra.run.smithi157.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-26T16:36:28.032 INFO:teuthology.orchestra.run.smithi044.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-26T16:36:28.036 INFO:teuthology.orchestra.run.smithi149.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-26T16:36:28.040 INFO:teuthology.orchestra.run.smithi064.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-26T16:36:28.042 INFO:teuthology.orchestra.run.smithi157.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-26T16:36:28.044 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-03-26T16:36:28.052 INFO:teuthology.task.internal:Configuring sudo... 2024-03-26T16:36:28.052 DEBUG:teuthology.orchestra.run.smithi044:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-03-26T16:36:28.076 DEBUG:teuthology.orchestra.run.smithi064:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-03-26T16:36:28.085 DEBUG:teuthology.orchestra.run.smithi149:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-03-26T16:36:28.087 DEBUG:teuthology.orchestra.run.smithi157:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-03-26T16:36:28.114 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-03-26T16:36:28.124 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-03-26T16:36:28.124 DEBUG:teuthology.orchestra.run.smithi044:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-03-26T16:36:28.146 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-03-26T16:36:28.154 DEBUG:teuthology.orchestra.run.smithi149:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-03-26T16:36:28.156 DEBUG:teuthology.orchestra.run.smithi157:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-03-26T16:36:28.170 DEBUG:teuthology.orchestra.run.smithi044:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-26T16:36:28.245 DEBUG:teuthology.orchestra.run.smithi044:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-26T16:36:28.292 DEBUG:teuthology.orchestra.run.smithi044:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-26T16:36:28.376 DEBUG:teuthology.orchestra.run.smithi044:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-26T16:36:28.418 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-03-26T16:36:28.418 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-03-26T16:36:28.485 DEBUG:teuthology.orchestra.run.smithi064:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-26T16:36:28.524 DEBUG:teuthology.orchestra.run.smithi064:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-26T16:36:28.585 DEBUG:teuthology.orchestra.run.smithi064:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-26T16:36:28.669 DEBUG:teuthology.orchestra.run.smithi064:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-26T16:36:28.713 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-03-26T16:36:28.713 DEBUG:teuthology.orchestra.run.smithi064:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-03-26T16:36:28.781 DEBUG:teuthology.orchestra.run.smithi149:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-26T16:36:28.829 DEBUG:teuthology.orchestra.run.smithi149:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-26T16:36:28.882 DEBUG:teuthology.orchestra.run.smithi149:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-26T16:36:28.966 DEBUG:teuthology.orchestra.run.smithi149:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-26T16:36:29.010 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-03-26T16:36:29.010 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-03-26T16:36:29.079 DEBUG:teuthology.orchestra.run.smithi157:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-26T16:36:29.121 DEBUG:teuthology.orchestra.run.smithi157:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-26T16:36:29.160 DEBUG:teuthology.orchestra.run.smithi157:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-26T16:36:29.230 DEBUG:teuthology.orchestra.run.smithi157:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-26T16:36:29.277 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-03-26T16:36:29.277 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-03-26T16:36:29.341 DEBUG:teuthology.orchestra.run.smithi044:> sudo service rsyslog restart 2024-03-26T16:36:29.343 DEBUG:teuthology.orchestra.run.smithi064:> sudo service rsyslog restart 2024-03-26T16:36:29.346 DEBUG:teuthology.orchestra.run.smithi149:> sudo service rsyslog restart 2024-03-26T16:36:29.348 DEBUG:teuthology.orchestra.run.smithi157:> sudo service rsyslog restart 2024-03-26T16:36:29.399 INFO:teuthology.orchestra.run.smithi044.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-26T16:36:29.401 INFO:teuthology.orchestra.run.smithi149.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-26T16:36:29.403 INFO:teuthology.orchestra.run.smithi064.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-26T16:36:29.437 INFO:teuthology.orchestra.run.smithi157.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-26T16:36:29.848 INFO:teuthology.run_tasks:Running task internal.timer... 2024-03-26T16:36:29.859 INFO:teuthology.task.internal:Starting timer... 2024-03-26T16:36:29.859 INFO:teuthology.run_tasks:Running task pcp... 2024-03-26T16:36:29.875 INFO:teuthology.run_tasks:Running task selinux... 2024-03-26T16:36:29.889 DEBUG:teuthology.orchestra.run.smithi044:> sudo service auditd rotate 2024-03-26T16:36:29.951 INFO:teuthology.orchestra.run.smithi044.stdout:Rotating logs: 2024-03-26T16:36:29.953 DEBUG:teuthology.orchestra.run.smithi064:> sudo service auditd rotate 2024-03-26T16:36:30.017 INFO:teuthology.orchestra.run.smithi064.stdout:Rotating logs: 2024-03-26T16:36:30.019 DEBUG:teuthology.orchestra.run.smithi149:> sudo service auditd rotate 2024-03-26T16:36:30.074 INFO:teuthology.orchestra.run.smithi149.stdout:Rotating logs: 2024-03-26T16:36:30.077 DEBUG:teuthology.orchestra.run.smithi157:> sudo service auditd rotate 2024-03-26T16:36:30.158 INFO:teuthology.orchestra.run.smithi157.stdout:Rotating logs: 2024-03-26T16:36:30.160 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-03-26T16:36:30.160 DEBUG:teuthology.orchestra.run.smithi044:> /usr/sbin/getenforce 2024-03-26T16:36:30.178 INFO:teuthology.orchestra.run.smithi044.stdout:Permissive 2024-03-26T16:36:30.179 DEBUG:teuthology.orchestra.run.smithi064:> /usr/sbin/getenforce 2024-03-26T16:36:30.213 INFO:teuthology.orchestra.run.smithi064.stdout:Permissive 2024-03-26T16:36:30.214 DEBUG:teuthology.orchestra.run.smithi149:> /usr/sbin/getenforce 2024-03-26T16:36:30.242 INFO:teuthology.orchestra.run.smithi149.stdout:Permissive 2024-03-26T16:36:30.242 DEBUG:teuthology.orchestra.run.smithi157:> /usr/sbin/getenforce 2024-03-26T16:36:30.261 INFO:teuthology.orchestra.run.smithi157.stdout:Permissive 2024-03-26T16:36:30.262 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi044.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi064.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi149.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi157.front.sepia.ceph.com': 'permissive'} 2024-03-26T16:36:30.262 DEBUG:teuthology.orchestra.run.smithi044:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-03-26T16:36:30.290 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-26T16:36:30.291 DEBUG:teuthology.orchestra.run.smithi064:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-03-26T16:36:30.321 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-26T16:36:30.321 DEBUG:teuthology.orchestra.run.smithi149:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-03-26T16:36:30.351 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-26T16:36:30.352 DEBUG:teuthology.orchestra.run.smithi157:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-03-26T16:36:30.379 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-26T16:36:30.379 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-03-26T16:36:30.380 DEBUG:teuthology.orchestra.run.smithi044:> sudo /usr/sbin/setenforce permissive 2024-03-26T16:36:30.413 DEBUG:teuthology.orchestra.run.smithi064:> sudo /usr/sbin/setenforce permissive 2024-03-26T16:36:30.448 DEBUG:teuthology.orchestra.run.smithi149:> sudo /usr/sbin/setenforce permissive 2024-03-26T16:36:30.502 DEBUG:teuthology.orchestra.run.smithi157:> sudo /usr/sbin/setenforce permissive 2024-03-26T16:36:30.538 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-03-26T16:36:30.549 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-03-26T16:36:30.554 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-03-26T16:36:30.701 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-03-26T16:36:30.716 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-03-26T16:36:30.717 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi044.front.sepia.ceph.com,smithi064.front.sepia.ceph.com,smithi149.front.sepia.ceph.com,smithi157.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-03-26T16:40:55.861 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi044.front.sepia.ceph.com'), Remote(name='ubuntu@smithi064.front.sepia.ceph.com'), Remote(name='ubuntu@smithi149.front.sepia.ceph.com'), Remote(name='ubuntu@smithi157.front.sepia.ceph.com')] 2024-03-26T16:40:55.862 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi044.front.sepia.ceph.com' 2024-03-26T16:40:55.863 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T16:40:55.957 DEBUG:teuthology.orchestra.run.smithi044:> true 2024-03-26T16:40:56.034 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi044.front.sepia.ceph.com' 2024-03-26T16:40:56.035 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi064.front.sepia.ceph.com' 2024-03-26T16:40:56.035 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T16:40:56.122 DEBUG:teuthology.orchestra.run.smithi064:> true 2024-03-26T16:40:56.198 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi064.front.sepia.ceph.com' 2024-03-26T16:40:56.198 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi149.front.sepia.ceph.com' 2024-03-26T16:40:56.199 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T16:40:56.290 DEBUG:teuthology.orchestra.run.smithi149:> true 2024-03-26T16:40:56.370 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi149.front.sepia.ceph.com' 2024-03-26T16:40:56.371 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi157.front.sepia.ceph.com' 2024-03-26T16:40:56.371 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T16:40:56.460 DEBUG:teuthology.orchestra.run.smithi157:> true 2024-03-26T16:40:56.544 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi157.front.sepia.ceph.com' 2024-03-26T16:40:56.545 INFO:teuthology.run_tasks:Running task clock... 2024-03-26T16:40:56.560 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-03-26T16:40:56.560 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-03-26T16:40:56.561 DEBUG:teuthology.orchestra.run.smithi044:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-26T16:40:56.563 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-03-26T16:40:56.564 DEBUG:teuthology.orchestra.run.smithi064:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-26T16:40:56.566 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-03-26T16:40:56.566 DEBUG:teuthology.orchestra.run.smithi149:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-26T16:40:56.568 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-03-26T16:40:56.568 DEBUG:teuthology.orchestra.run.smithi157:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-26T16:40:56.597 INFO:teuthology.orchestra.run.smithi044.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-03-26T16:40:56.599 INFO:teuthology.orchestra.run.smithi064.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-03-26T16:40:56.600 INFO:teuthology.orchestra.run.smithi149.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-03-26T16:40:56.615 INFO:teuthology.orchestra.run.smithi044.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-03-26T16:40:56.617 INFO:teuthology.orchestra.run.smithi149.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-03-26T16:40:56.618 INFO:teuthology.orchestra.run.smithi064.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-03-26T16:40:56.618 INFO:teuthology.orchestra.run.smithi157.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-03-26T16:40:56.636 INFO:teuthology.orchestra.run.smithi157.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-03-26T16:40:56.646 INFO:teuthology.orchestra.run.smithi044.stderr:sudo: ntpd: command not found 2024-03-26T16:40:56.648 INFO:teuthology.orchestra.run.smithi149.stderr:sudo: ntpd: command not found 2024-03-26T16:40:56.649 INFO:teuthology.orchestra.run.smithi064.stderr:sudo: ntpd: command not found 2024-03-26T16:40:56.660 INFO:teuthology.orchestra.run.smithi044.stdout:506 Cannot talk to daemon 2024-03-26T16:40:56.662 INFO:teuthology.orchestra.run.smithi149.stdout:506 Cannot talk to daemon 2024-03-26T16:40:56.663 INFO:teuthology.orchestra.run.smithi064.stdout:506 Cannot talk to daemon 2024-03-26T16:40:56.667 INFO:teuthology.orchestra.run.smithi157.stderr:sudo: ntpd: command not found 2024-03-26T16:40:56.676 INFO:teuthology.orchestra.run.smithi044.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-03-26T16:40:56.679 INFO:teuthology.orchestra.run.smithi149.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-03-26T16:40:56.680 INFO:teuthology.orchestra.run.smithi064.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-03-26T16:40:56.681 INFO:teuthology.orchestra.run.smithi157.stdout:506 Cannot talk to daemon 2024-03-26T16:40:56.693 INFO:teuthology.orchestra.run.smithi044.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-03-26T16:40:56.696 INFO:teuthology.orchestra.run.smithi149.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-03-26T16:40:56.697 INFO:teuthology.orchestra.run.smithi064.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-03-26T16:40:56.698 INFO:teuthology.orchestra.run.smithi157.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-03-26T16:40:56.714 INFO:teuthology.orchestra.run.smithi157.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-03-26T16:40:56.743 INFO:teuthology.orchestra.run.smithi044.stderr:bash: line 1: ntpq: command not found 2024-03-26T16:40:56.747 INFO:teuthology.orchestra.run.smithi044.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-26T16:40:56.747 INFO:teuthology.orchestra.run.smithi044.stdout:=============================================================================== 2024-03-26T16:40:56.747 INFO:teuthology.orchestra.run.smithi044.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-26T16:40:56.747 INFO:teuthology.orchestra.run.smithi044.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-26T16:40:56.747 INFO:teuthology.orchestra.run.smithi044.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-26T16:40:56.748 INFO:teuthology.orchestra.run.smithi044.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-26T16:40:56.748 INFO:teuthology.orchestra.run.smithi149.stderr:bash: line 1: ntpq: command not found 2024-03-26T16:40:56.751 INFO:teuthology.orchestra.run.smithi149.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-26T16:40:56.751 INFO:teuthology.orchestra.run.smithi149.stdout:=============================================================================== 2024-03-26T16:40:56.751 INFO:teuthology.orchestra.run.smithi149.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-26T16:40:56.752 INFO:teuthology.orchestra.run.smithi149.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-26T16:40:56.752 INFO:teuthology.orchestra.run.smithi149.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-26T16:40:56.752 INFO:teuthology.orchestra.run.smithi149.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-26T16:40:56.752 INFO:teuthology.orchestra.run.smithi064.stderr:bash: line 1: ntpq: command not found 2024-03-26T16:40:56.755 INFO:teuthology.orchestra.run.smithi064.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-26T16:40:56.755 INFO:teuthology.orchestra.run.smithi064.stdout:=============================================================================== 2024-03-26T16:40:56.755 INFO:teuthology.orchestra.run.smithi064.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-26T16:40:56.755 INFO:teuthology.orchestra.run.smithi064.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-26T16:40:56.755 INFO:teuthology.orchestra.run.smithi064.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-26T16:40:56.755 INFO:teuthology.orchestra.run.smithi064.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-26T16:40:56.766 INFO:teuthology.orchestra.run.smithi157.stderr:bash: line 1: ntpq: command not found 2024-03-26T16:40:56.769 INFO:teuthology.orchestra.run.smithi157.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-26T16:40:56.769 INFO:teuthology.orchestra.run.smithi157.stdout:=============================================================================== 2024-03-26T16:40:56.769 INFO:teuthology.orchestra.run.smithi157.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-26T16:40:56.769 INFO:teuthology.orchestra.run.smithi157.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-26T16:40:56.769 INFO:teuthology.orchestra.run.smithi157.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-26T16:40:56.769 INFO:teuthology.orchestra.run.smithi157.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-26T16:40:56.770 INFO:teuthology.run_tasks:Running task install... 2024-03-26T16:40:56.779 DEBUG:teuthology.task.install:project ceph 2024-03-26T16:40:56.779 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'bf9505fb569e9b95a78f9700ed8c4bd20508ef55'}} 2024-03-26T16:40:56.779 DEBUG:teuthology.task.install:config {'extra_packages': ['nvme-cli'], 'flavor': 'default', 'sha1': 'bf9505fb569e9b95a78f9700ed8c4bd20508ef55'} 2024-03-26T16:40:56.779 INFO:teuthology.task.install:Using flavor: default 2024-03-26T16:40:56.784 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-03-26T16:40:56.784 INFO:teuthology.task.install:extra packages: ['nvme-cli'] 2024-03-26T16:40:56.785 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': ['nvme-cli'], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'bf9505fb569e9b95a78f9700ed8c4bd20508ef55', 'tag': None, 'wait_for_package': False} 2024-03-26T16:40:56.785 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=bf9505fb569e9b95a78f9700ed8c4bd20508ef55 2024-03-26T16:40:56.787 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': ['nvme-cli'], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'bf9505fb569e9b95a78f9700ed8c4bd20508ef55', 'tag': None, 'wait_for_package': False} 2024-03-26T16:40:56.787 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=bf9505fb569e9b95a78f9700ed8c4bd20508ef55 2024-03-26T16:40:56.788 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': ['nvme-cli'], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'bf9505fb569e9b95a78f9700ed8c4bd20508ef55', 'tag': None, 'wait_for_package': False} 2024-03-26T16:40:56.788 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=bf9505fb569e9b95a78f9700ed8c4bd20508ef55 2024-03-26T16:40:56.789 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': ['nvme-cli'], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'bf9505fb569e9b95a78f9700ed8c4bd20508ef55', 'tag': None, 'wait_for_package': False} 2024-03-26T16:40:56.789 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=bf9505fb569e9b95a78f9700ed8c4bd20508ef55 2024-03-26T16:40:57.011 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/ceph-nvmeof-mon/bf9505fb569e9b95a78f9700ed8c4bd20508ef55/centos/9/flavors/default/ 2024-03-26T16:40:57.011 INFO:teuthology.task.install.rpm:Package version is 19.0.0-2382.gbf9505fb 2024-03-26T16:40:57.015 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/ceph-nvmeof-mon/bf9505fb569e9b95a78f9700ed8c4bd20508ef55/centos/9/flavors/default/ 2024-03-26T16:40:57.015 INFO:teuthology.task.install.rpm:Package version is 19.0.0-2382.gbf9505fb 2024-03-26T16:40:57.023 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/ceph-nvmeof-mon/bf9505fb569e9b95a78f9700ed8c4bd20508ef55/centos/9/flavors/default/ 2024-03-26T16:40:57.023 INFO:teuthology.task.install.rpm:Package version is 19.0.0-2382.gbf9505fb 2024-03-26T16:40:57.026 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/ceph-nvmeof-mon/bf9505fb569e9b95a78f9700ed8c4bd20508ef55/centos/9/flavors/default/ 2024-03-26T16:40:57.026 INFO:teuthology.task.install.rpm:Package version is 19.0.0-2382.gbf9505fb 2024-03-26T16:40:57.135 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/ceph-nvmeof-mon/bf9505fb569e9b95a78f9700ed8c4bd20508ef55/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/ceph-nvmeof-mon/bf9505fb569e9b95a78f9700ed8c4bd20508ef55/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/ceph-nvmeof-mon/bf9505fb569e9b95a78f9700ed8c4bd20508ef55/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-03-26T16:40:57.135 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-03-26T16:40:57.135 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-03-26T16:40:57.164 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, nvme-cli on remote rpm x86_64 2024-03-26T16:40:57.164 DEBUG:teuthology.orchestra.run.smithi044:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/bf9505fb569e9b95a78f9700ed8c4bd20508ef55/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-03-26T16:40:57.190 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/ceph-nvmeof-mon/bf9505fb569e9b95a78f9700ed8c4bd20508ef55/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/ceph-nvmeof-mon/bf9505fb569e9b95a78f9700ed8c4bd20508ef55/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/ceph-nvmeof-mon/bf9505fb569e9b95a78f9700ed8c4bd20508ef55/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-03-26T16:40:57.190 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-03-26T16:40:57.191 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-03-26T16:40:57.208 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/ceph-nvmeof-mon/bf9505fb569e9b95a78f9700ed8c4bd20508ef55/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/ceph-nvmeof-mon/bf9505fb569e9b95a78f9700ed8c4bd20508ef55/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/ceph-nvmeof-mon/bf9505fb569e9b95a78f9700ed8c4bd20508ef55/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-03-26T16:40:57.208 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-03-26T16:40:57.208 DEBUG:teuthology.orchestra.run.smithi064:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-03-26T16:40:57.210 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/ceph-nvmeof-mon/bf9505fb569e9b95a78f9700ed8c4bd20508ef55/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/ceph-nvmeof-mon/bf9505fb569e9b95a78f9700ed8c4bd20508ef55/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/ceph-nvmeof-mon/bf9505fb569e9b95a78f9700ed8c4bd20508ef55/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-03-26T16:40:57.210 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-03-26T16:40:57.211 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-03-26T16:40:57.219 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, nvme-cli on remote rpm x86_64 2024-03-26T16:40:57.219 DEBUG:teuthology.orchestra.run.smithi157:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/bf9505fb569e9b95a78f9700ed8c4bd20508ef55/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-03-26T16:40:57.232 DEBUG:teuthology.orchestra.run.smithi044:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-03-26T16:40:57.239 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, nvme-cli on remote rpm x86_64 2024-03-26T16:40:57.239 DEBUG:teuthology.orchestra.run.smithi149:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/bf9505fb569e9b95a78f9700ed8c4bd20508ef55/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-03-26T16:40:57.240 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, nvme-cli on remote rpm x86_64 2024-03-26T16:40:57.240 DEBUG:teuthology.orchestra.run.smithi064:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/bf9505fb569e9b95a78f9700ed8c4bd20508ef55/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-03-26T16:40:57.288 DEBUG:teuthology.orchestra.run.smithi157:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-03-26T16:40:57.307 DEBUG:teuthology.orchestra.run.smithi149:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-03-26T16:40:57.308 DEBUG:teuthology.orchestra.run.smithi064:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-03-26T16:40:57.315 DEBUG:teuthology.orchestra.run.smithi044:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-03-26T16:40:57.369 DEBUG:teuthology.orchestra.run.smithi157:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-03-26T16:40:57.382 INFO:teuthology.orchestra.run.smithi044.stdout:check_obsoletes = 1 2024-03-26T16:40:57.383 DEBUG:teuthology.orchestra.run.smithi044:> sudo yum clean all 2024-03-26T16:40:57.386 DEBUG:teuthology.orchestra.run.smithi149:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-03-26T16:40:57.389 DEBUG:teuthology.orchestra.run.smithi064:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-03-26T16:40:57.435 INFO:teuthology.orchestra.run.smithi157.stdout:check_obsoletes = 1 2024-03-26T16:40:57.437 DEBUG:teuthology.orchestra.run.smithi157:> sudo yum clean all 2024-03-26T16:40:57.453 INFO:teuthology.orchestra.run.smithi149.stdout:check_obsoletes = 1 2024-03-26T16:40:57.454 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum clean all 2024-03-26T16:40:57.455 INFO:teuthology.orchestra.run.smithi064.stdout:check_obsoletes = 1 2024-03-26T16:40:57.457 DEBUG:teuthology.orchestra.run.smithi064:> sudo yum clean all 2024-03-26T16:40:57.644 INFO:teuthology.orchestra.run.smithi044.stdout:74 files removed 2024-03-26T16:40:57.672 DEBUG:teuthology.orchestra.run.smithi044:> sudo yum -y install ceph-radosgw 2024-03-26T16:40:57.677 INFO:teuthology.orchestra.run.smithi157.stdout:74 files removed 2024-03-26T16:40:57.700 INFO:teuthology.orchestra.run.smithi149.stdout:74 files removed 2024-03-26T16:40:57.703 INFO:teuthology.orchestra.run.smithi064.stdout:74 files removed 2024-03-26T16:40:57.704 DEBUG:teuthology.orchestra.run.smithi157:> sudo yum -y install ceph-radosgw 2024-03-26T16:40:57.728 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum -y install ceph-radosgw 2024-03-26T16:40:57.730 DEBUG:teuthology.orchestra.run.smithi064:> sudo yum -y install ceph-radosgw 2024-03-26T16:40:58.394 INFO:teuthology.orchestra.run.smithi157.stdout:ceph packages for x86_64 217 kB/s | 84 kB 00:00 2024-03-26T16:40:58.395 INFO:teuthology.orchestra.run.smithi044.stdout:ceph packages for x86_64 200 kB/s | 84 kB 00:00 2024-03-26T16:40:58.411 INFO:teuthology.orchestra.run.smithi149.stdout:ceph packages for x86_64 222 kB/s | 84 kB 00:00 2024-03-26T16:40:58.455 INFO:teuthology.orchestra.run.smithi064.stdout:ceph packages for x86_64 200 kB/s | 84 kB 00:00 2024-03-26T16:40:58.754 INFO:teuthology.orchestra.run.smithi044.stdout:ceph noarch packages 37 kB/s | 11 kB 00:00 2024-03-26T16:40:58.755 INFO:teuthology.orchestra.run.smithi149.stdout:ceph noarch packages 39 kB/s | 11 kB 00:00 2024-03-26T16:40:58.778 INFO:teuthology.orchestra.run.smithi157.stdout:ceph noarch packages 34 kB/s | 11 kB 00:00 2024-03-26T16:40:58.848 INFO:teuthology.orchestra.run.smithi064.stdout:ceph noarch packages 34 kB/s | 11 kB 00:00 2024-03-26T16:40:59.105 INFO:teuthology.orchestra.run.smithi044.stdout:ceph source packages 6.2 kB/s | 1.9 kB 00:00 2024-03-26T16:40:59.129 INFO:teuthology.orchestra.run.smithi149.stdout:ceph source packages 5.7 kB/s | 1.9 kB 00:00 2024-03-26T16:40:59.162 INFO:teuthology.orchestra.run.smithi157.stdout:ceph source packages 5.5 kB/s | 1.9 kB 00:00 2024-03-26T16:40:59.198 INFO:teuthology.orchestra.run.smithi064.stdout:ceph source packages 6.2 kB/s | 1.9 kB 00:00 2024-03-26T16:40:59.564 INFO:teuthology.orchestra.run.smithi157.stdout:CentOS-9 - AppStream 18 MB/s | 6.7 MB 00:00 2024-03-26T16:40:59.659 INFO:teuthology.orchestra.run.smithi064.stdout:CentOS-9 - AppStream 16 MB/s | 6.7 MB 00:00 2024-03-26T16:40:59.932 INFO:teuthology.orchestra.run.smithi149.stdout:CentOS-9 - AppStream 8.7 MB/s | 6.7 MB 00:00 2024-03-26T16:40:59.949 INFO:teuthology.orchestra.run.smithi044.stdout:CentOS-9 - AppStream 8.3 MB/s | 6.7 MB 00:00 2024-03-26T16:41:01.072 INFO:teuthology.orchestra.run.smithi157.stdout:CentOS-9 - BaseOS 5.2 MB/s | 2.0 MB 00:00 2024-03-26T16:41:01.117 INFO:teuthology.orchestra.run.smithi064.stdout:CentOS-9 - BaseOS 7.1 MB/s | 2.0 MB 00:00 2024-03-26T16:41:01.432 INFO:teuthology.orchestra.run.smithi149.stdout:CentOS-9 - BaseOS 5.2 MB/s | 2.0 MB 00:00 2024-03-26T16:41:01.441 INFO:teuthology.orchestra.run.smithi044.stdout:CentOS-9 - BaseOS 6.1 MB/s | 2.0 MB 00:00 2024-03-26T16:41:02.080 INFO:teuthology.orchestra.run.smithi157.stdout:CentOS Stream 9 - BaseOS 12 MB/s | 8.0 MB 00:00 2024-03-26T16:41:02.399 INFO:teuthology.orchestra.run.smithi044.stdout:CentOS Stream 9 - BaseOS 13 MB/s | 8.0 MB 00:00 2024-03-26T16:41:02.431 INFO:teuthology.orchestra.run.smithi149.stdout:CentOS Stream 9 - BaseOS 12 MB/s | 8.0 MB 00:00 2024-03-26T16:41:03.892 INFO:teuthology.orchestra.run.smithi064.stdout:CentOS Stream 9 - BaseOS 3.3 MB/s | 8.0 MB 00:02 2024-03-26T16:41:07.450 INFO:teuthology.orchestra.run.smithi044.stdout:CentOS Stream 9 - AppStream 4.8 MB/s | 19 MB 00:03 2024-03-26T16:41:08.684 INFO:teuthology.orchestra.run.smithi064.stdout:CentOS Stream 9 - AppStream 5.1 MB/s | 19 MB 00:03 2024-03-26T16:41:08.782 INFO:teuthology.orchestra.run.smithi149.stdout:CentOS Stream 9 - AppStream 3.6 MB/s | 19 MB 00:05 2024-03-26T16:41:11.205 INFO:teuthology.orchestra.run.smithi157.stdout:CentOS Stream 9 - AppStream 2.3 MB/s | 19 MB 00:08 2024-03-26T16:41:11.751 INFO:teuthology.orchestra.run.smithi044.stdout:CentOS Stream 9 - CRB 9.4 MB/s | 6.1 MB 00:00 2024-03-26T16:41:13.619 INFO:teuthology.orchestra.run.smithi044.stdout:CentOS Stream 9 - Extras packages 24 kB/s | 16 kB 00:00 2024-03-26T16:41:13.849 INFO:teuthology.orchestra.run.smithi149.stdout:CentOS Stream 9 - CRB 3.9 MB/s | 6.1 MB 00:01 2024-03-26T16:41:14.160 INFO:teuthology.orchestra.run.smithi064.stdout:CentOS Stream 9 - CRB 3.4 MB/s | 6.1 MB 00:01 2024-03-26T16:41:15.836 INFO:teuthology.orchestra.run.smithi064.stdout:CentOS Stream 9 - Extras packages 33 kB/s | 16 kB 00:00 2024-03-26T16:41:16.131 INFO:teuthology.orchestra.run.smithi157.stdout:CentOS Stream 9 - CRB 4.3 MB/s | 6.1 MB 00:01 2024-03-26T16:41:16.358 INFO:teuthology.orchestra.run.smithi149.stdout:CentOS Stream 9 - Extras packages 13 kB/s | 16 kB 00:01 2024-03-26T16:41:17.556 INFO:teuthology.orchestra.run.smithi157.stdout:CentOS Stream 9 - Extras packages 57 kB/s | 16 kB 00:00 2024-03-26T16:41:17.835 INFO:teuthology.orchestra.run.smithi149.stdout:Extra Packages for Enterprise Linux 15 MB/s | 21 MB 00:01 2024-03-26T16:41:17.889 INFO:teuthology.orchestra.run.smithi064.stdout:Extra Packages for Enterprise Linux 11 MB/s | 21 MB 00:01 2024-03-26T16:41:18.713 INFO:teuthology.orchestra.run.smithi157.stdout:Extra Packages for Enterprise Linux 20 MB/s | 21 MB 00:01 2024-03-26T16:41:22.893 INFO:teuthology.orchestra.run.smithi149.stdout:lab-extras 13 kB/s | 1.7 kB 00:00 2024-03-26T16:41:22.987 INFO:teuthology.orchestra.run.smithi064.stdout:lab-extras 47 kB/s | 1.7 kB 00:00 2024-03-26T16:41:23.583 INFO:teuthology.orchestra.run.smithi157.stdout:lab-extras 27 kB/s | 1.7 kB 00:00 2024-03-26T16:41:25.366 INFO:teuthology.orchestra.run.smithi149.stdout:Dependencies resolved. 2024-03-26T16:41:25.374 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-03-26T16:41:25.374 INFO:teuthology.orchestra.run.smithi149.stdout: Package Arch Version Repository Size 2024-03-26T16:41:25.375 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-03-26T16:41:25.375 INFO:teuthology.orchestra.run.smithi149.stdout:Installing: 2024-03-26T16:41:25.375 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-radosgw x86_64 2:19.0.0-2382.gbf9505fb.el9 ceph 9.8 M 2024-03-26T16:41:25.375 INFO:teuthology.orchestra.run.smithi149.stdout:Upgrading: 2024-03-26T16:41:25.375 INFO:teuthology.orchestra.run.smithi149.stdout: librados2 x86_64 2:19.0.0-2382.gbf9505fb.el9 ceph 3.4 M 2024-03-26T16:41:25.375 INFO:teuthology.orchestra.run.smithi149.stdout: librbd1 x86_64 2:19.0.0-2382.gbf9505fb.el9 ceph 3.1 M 2024-03-26T16:41:25.375 INFO:teuthology.orchestra.run.smithi149.stdout:Installing dependencies: 2024-03-26T16:41:25.375 INFO:teuthology.orchestra.run.smithi149.stdout: boost-program-options 2024-03-26T16:41:25.375 INFO:teuthology.orchestra.run.smithi149.stdout: x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2024-03-26T16:41:25.375 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-base x86_64 2:19.0.0-2382.gbf9505fb.el9 ceph 5.4 M 2024-03-26T16:41:25.375 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-common x86_64 2:19.0.0-2382.gbf9505fb.el9 ceph 21 M 2024-03-26T16:41:25.375 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-selinux x86_64 2:19.0.0-2382.gbf9505fb.el9 ceph 25 k 2024-03-26T16:41:25.375 INFO:teuthology.orchestra.run.smithi149.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-03-26T16:41:25.376 INFO:teuthology.orchestra.run.smithi149.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-03-26T16:41:25.376 INFO:teuthology.orchestra.run.smithi149.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-03-26T16:41:25.376 INFO:teuthology.orchestra.run.smithi149.stdout: libcephfs2 x86_64 2:19.0.0-2382.gbf9505fb.el9 ceph 747 k 2024-03-26T16:41:25.376 INFO:teuthology.orchestra.run.smithi149.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-03-26T16:41:25.376 INFO:teuthology.orchestra.run.smithi149.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2024-03-26T16:41:25.376 INFO:teuthology.orchestra.run.smithi149.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2024-03-26T16:41:25.376 INFO:teuthology.orchestra.run.smithi149.stdout: libradosstriper1 x86_64 2:19.0.0-2382.gbf9505fb.el9 ceph 500 k 2024-03-26T16:41:25.376 INFO:teuthology.orchestra.run.smithi149.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2024-03-26T16:41:25.376 INFO:teuthology.orchestra.run.smithi149.stdout: librgw2 x86_64 2:19.0.0-2382.gbf9505fb.el9 ceph 5.1 M 2024-03-26T16:41:25.376 INFO:teuthology.orchestra.run.smithi149.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-03-26T16:41:25.376 INFO:teuthology.orchestra.run.smithi149.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2024-03-26T16:41:25.376 INFO:teuthology.orchestra.run.smithi149.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-03-26T16:41:25.376 INFO:teuthology.orchestra.run.smithi149.stdout: python3-ceph-argparse 2024-03-26T16:41:25.377 INFO:teuthology.orchestra.run.smithi149.stdout: x86_64 2:19.0.0-2382.gbf9505fb.el9 ceph 45 k 2024-03-26T16:41:25.377 INFO:teuthology.orchestra.run.smithi149.stdout: python3-ceph-common x86_64 2:19.0.0-2382.gbf9505fb.el9 ceph 133 k 2024-03-26T16:41:25.377 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cephfs x86_64 2:19.0.0-2382.gbf9505fb.el9 ceph 162 k 2024-03-26T16:41:25.377 INFO:teuthology.orchestra.run.smithi149.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2024-03-26T16:41:25.377 INFO:teuthology.orchestra.run.smithi149.stdout: python3-rados x86_64 2:19.0.0-2382.gbf9505fb.el9 ceph 321 k 2024-03-26T16:41:25.377 INFO:teuthology.orchestra.run.smithi149.stdout: python3-rbd x86_64 2:19.0.0-2382.gbf9505fb.el9 ceph 298 k 2024-03-26T16:41:25.377 INFO:teuthology.orchestra.run.smithi149.stdout: python3-rgw x86_64 2:19.0.0-2382.gbf9505fb.el9 ceph 99 k 2024-03-26T16:41:25.377 INFO:teuthology.orchestra.run.smithi149.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-03-26T16:41:25.377 INFO:teuthology.orchestra.run.smithi149.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-03-26T16:41:25.377 INFO:teuthology.orchestra.run.smithi149.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-03-26T16:41:25.377 INFO:teuthology.orchestra.run.smithi149.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-03-26T16:41:25.377 INFO:teuthology.orchestra.run.smithi149.stdout:Installing weak dependencies: 2024-03-26T16:41:25.377 INFO:teuthology.orchestra.run.smithi149.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-03-26T16:41:25.377 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-03-26T16:41:25.377 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction Summary 2024-03-26T16:41:25.377 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-03-26T16:41:25.378 INFO:teuthology.orchestra.run.smithi149.stdout:Install 30 Packages 2024-03-26T16:41:25.378 INFO:teuthology.orchestra.run.smithi149.stdout:Upgrade 2 Packages 2024-03-26T16:41:25.378 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-03-26T16:41:25.378 INFO:teuthology.orchestra.run.smithi149.stdout:Total download size: 59 M 2024-03-26T16:41:25.378 INFO:teuthology.orchestra.run.smithi149.stdout:Downloading Packages: 2024-03-26T16:41:25.546 INFO:teuthology.orchestra.run.smithi064.stdout:Dependencies resolved. 2024-03-26T16:41:25.550 INFO:teuthology.orchestra.run.smithi064.stdout:================================================================================ 2024-03-26T16:41:25.550 INFO:teuthology.orchestra.run.smithi064.stdout: Package Arch Version Repository Size 2024-03-26T16:41:25.550 INFO:teuthology.orchestra.run.smithi064.stdout:================================================================================ 2024-03-26T16:41:25.550 INFO:teuthology.orchestra.run.smithi064.stdout:Installing: 2024-03-26T16:41:25.550 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-radosgw x86_64 2:19.0.0-2382.gbf9505fb.el9 ceph 9.8 M 2024-03-26T16:41:25.550 INFO:teuthology.orchestra.run.smithi064.stdout:Upgrading: 2024-03-26T16:41:25.550 INFO:teuthology.orchestra.run.smithi064.stdout: librados2 x86_64 2:19.0.0-2382.gbf9505fb.el9 ceph 3.4 M 2024-03-26T16:41:25.550 INFO:teuthology.orchestra.run.smithi064.stdout: librbd1 x86_64 2:19.0.0-2382.gbf9505fb.el9 ceph 3.1 M 2024-03-26T16:41:25.550 INFO:teuthology.orchestra.run.smithi064.stdout:Installing dependencies: 2024-03-26T16:41:25.550 INFO:teuthology.orchestra.run.smithi064.stdout: boost-program-options 2024-03-26T16:41:25.551 INFO:teuthology.orchestra.run.smithi064.stdout: x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2024-03-26T16:41:25.551 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-base x86_64 2:19.0.0-2382.gbf9505fb.el9 ceph 5.4 M 2024-03-26T16:41:25.551 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-common x86_64 2:19.0.0-2382.gbf9505fb.el9 ceph 21 M 2024-03-26T16:41:25.551 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-selinux x86_64 2:19.0.0-2382.gbf9505fb.el9 ceph 25 k 2024-03-26T16:41:25.551 INFO:teuthology.orchestra.run.smithi064.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-03-26T16:41:25.551 INFO:teuthology.orchestra.run.smithi064.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-03-26T16:41:25.551 INFO:teuthology.orchestra.run.smithi064.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-03-26T16:41:25.551 INFO:teuthology.orchestra.run.smithi064.stdout: libcephfs2 x86_64 2:19.0.0-2382.gbf9505fb.el9 ceph 747 k 2024-03-26T16:41:25.551 INFO:teuthology.orchestra.run.smithi064.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-03-26T16:41:25.551 INFO:teuthology.orchestra.run.smithi064.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2024-03-26T16:41:25.551 INFO:teuthology.orchestra.run.smithi064.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2024-03-26T16:41:25.551 INFO:teuthology.orchestra.run.smithi064.stdout: libradosstriper1 x86_64 2:19.0.0-2382.gbf9505fb.el9 ceph 500 k 2024-03-26T16:41:25.551 INFO:teuthology.orchestra.run.smithi064.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2024-03-26T16:41:25.551 INFO:teuthology.orchestra.run.smithi064.stdout: librgw2 x86_64 2:19.0.0-2382.gbf9505fb.el9 ceph 5.1 M 2024-03-26T16:41:25.552 INFO:teuthology.orchestra.run.smithi064.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-03-26T16:41:25.552 INFO:teuthology.orchestra.run.smithi064.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2024-03-26T16:41:25.552 INFO:teuthology.orchestra.run.smithi064.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-03-26T16:41:25.552 INFO:teuthology.orchestra.run.smithi064.stdout: python3-ceph-argparse 2024-03-26T16:41:25.552 INFO:teuthology.orchestra.run.smithi064.stdout: x86_64 2:19.0.0-2382.gbf9505fb.el9 ceph 45 k 2024-03-26T16:41:25.552 INFO:teuthology.orchestra.run.smithi064.stdout: python3-ceph-common x86_64 2:19.0.0-2382.gbf9505fb.el9 ceph 133 k 2024-03-26T16:41:25.552 INFO:teuthology.orchestra.run.smithi064.stdout: python3-cephfs x86_64 2:19.0.0-2382.gbf9505fb.el9 ceph 162 k 2024-03-26T16:41:25.552 INFO:teuthology.orchestra.run.smithi064.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2024-03-26T16:41:25.552 INFO:teuthology.orchestra.run.smithi064.stdout: python3-rados x86_64 2:19.0.0-2382.gbf9505fb.el9 ceph 321 k 2024-03-26T16:41:25.552 INFO:teuthology.orchestra.run.smithi064.stdout: python3-rbd x86_64 2:19.0.0-2382.gbf9505fb.el9 ceph 298 k 2024-03-26T16:41:25.552 INFO:teuthology.orchestra.run.smithi064.stdout: python3-rgw x86_64 2:19.0.0-2382.gbf9505fb.el9 ceph 99 k 2024-03-26T16:41:25.552 INFO:teuthology.orchestra.run.smithi064.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-03-26T16:41:25.552 INFO:teuthology.orchestra.run.smithi064.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-03-26T16:41:25.553 INFO:teuthology.orchestra.run.smithi064.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-03-26T16:41:25.553 INFO:teuthology.orchestra.run.smithi064.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-03-26T16:41:25.553 INFO:teuthology.orchestra.run.smithi064.stdout:Installing weak dependencies: 2024-03-26T16:41:25.553 INFO:teuthology.orchestra.run.smithi064.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-03-26T16:41:25.553 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-03-26T16:41:25.553 INFO:teuthology.orchestra.run.smithi064.stdout:Transaction Summary 2024-03-26T16:41:25.553 INFO:teuthology.orchestra.run.smithi064.stdout:================================================================================ 2024-03-26T16:41:25.553 INFO:teuthology.orchestra.run.smithi064.stdout:Install 30 Packages 2024-03-26T16:41:25.553 INFO:teuthology.orchestra.run.smithi064.stdout:Upgrade 2 Packages 2024-03-26T16:41:25.553 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-03-26T16:41:25.554 INFO:teuthology.orchestra.run.smithi064.stdout:Total download size: 59 M 2024-03-26T16:41:25.554 INFO:teuthology.orchestra.run.smithi064.stdout:Downloading Packages: 2024-03-26T16:41:26.060 INFO:teuthology.orchestra.run.smithi157.stdout:Dependencies resolved. 2024-03-26T16:41:26.079 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2024-03-26T16:41:26.079 INFO:teuthology.orchestra.run.smithi157.stdout: Package Arch Version Repository Size 2024-03-26T16:41:26.079 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2024-03-26T16:41:26.079 INFO:teuthology.orchestra.run.smithi157.stdout:Installing: 2024-03-26T16:41:26.079 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-radosgw x86_64 2:19.0.0-2382.gbf9505fb.el9 ceph 9.8 M 2024-03-26T16:41:26.079 INFO:teuthology.orchestra.run.smithi157.stdout:Upgrading: 2024-03-26T16:41:26.079 INFO:teuthology.orchestra.run.smithi157.stdout: librados2 x86_64 2:19.0.0-2382.gbf9505fb.el9 ceph 3.4 M 2024-03-26T16:41:26.080 INFO:teuthology.orchestra.run.smithi157.stdout: librbd1 x86_64 2:19.0.0-2382.gbf9505fb.el9 ceph 3.1 M 2024-03-26T16:41:26.080 INFO:teuthology.orchestra.run.smithi157.stdout:Installing dependencies: 2024-03-26T16:41:26.080 INFO:teuthology.orchestra.run.smithi157.stdout: boost-program-options 2024-03-26T16:41:26.080 INFO:teuthology.orchestra.run.smithi157.stdout: x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2024-03-26T16:41:26.080 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-base x86_64 2:19.0.0-2382.gbf9505fb.el9 ceph 5.4 M 2024-03-26T16:41:26.080 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-common x86_64 2:19.0.0-2382.gbf9505fb.el9 ceph 21 M 2024-03-26T16:41:26.080 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-selinux x86_64 2:19.0.0-2382.gbf9505fb.el9 ceph 25 k 2024-03-26T16:41:26.080 INFO:teuthology.orchestra.run.smithi157.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-03-26T16:41:26.081 INFO:teuthology.orchestra.run.smithi157.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-03-26T16:41:26.081 INFO:teuthology.orchestra.run.smithi157.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-03-26T16:41:26.081 INFO:teuthology.orchestra.run.smithi157.stdout: libcephfs2 x86_64 2:19.0.0-2382.gbf9505fb.el9 ceph 747 k 2024-03-26T16:41:26.081 INFO:teuthology.orchestra.run.smithi157.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-03-26T16:41:26.081 INFO:teuthology.orchestra.run.smithi157.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2024-03-26T16:41:26.081 INFO:teuthology.orchestra.run.smithi157.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2024-03-26T16:41:26.081 INFO:teuthology.orchestra.run.smithi157.stdout: libradosstriper1 x86_64 2:19.0.0-2382.gbf9505fb.el9 ceph 500 k 2024-03-26T16:41:26.081 INFO:teuthology.orchestra.run.smithi157.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2024-03-26T16:41:26.081 INFO:teuthology.orchestra.run.smithi157.stdout: librgw2 x86_64 2:19.0.0-2382.gbf9505fb.el9 ceph 5.1 M 2024-03-26T16:41:26.082 INFO:teuthology.orchestra.run.smithi157.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-03-26T16:41:26.082 INFO:teuthology.orchestra.run.smithi157.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2024-03-26T16:41:26.082 INFO:teuthology.orchestra.run.smithi157.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-03-26T16:41:26.082 INFO:teuthology.orchestra.run.smithi157.stdout: python3-ceph-argparse 2024-03-26T16:41:26.082 INFO:teuthology.orchestra.run.smithi157.stdout: x86_64 2:19.0.0-2382.gbf9505fb.el9 ceph 45 k 2024-03-26T16:41:26.082 INFO:teuthology.orchestra.run.smithi157.stdout: python3-ceph-common x86_64 2:19.0.0-2382.gbf9505fb.el9 ceph 133 k 2024-03-26T16:41:26.082 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cephfs x86_64 2:19.0.0-2382.gbf9505fb.el9 ceph 162 k 2024-03-26T16:41:26.082 INFO:teuthology.orchestra.run.smithi157.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2024-03-26T16:41:26.082 INFO:teuthology.orchestra.run.smithi157.stdout: python3-rados x86_64 2:19.0.0-2382.gbf9505fb.el9 ceph 321 k 2024-03-26T16:41:26.083 INFO:teuthology.orchestra.run.smithi157.stdout: python3-rbd x86_64 2:19.0.0-2382.gbf9505fb.el9 ceph 298 k 2024-03-26T16:41:26.083 INFO:teuthology.orchestra.run.smithi157.stdout: python3-rgw x86_64 2:19.0.0-2382.gbf9505fb.el9 ceph 99 k 2024-03-26T16:41:26.083 INFO:teuthology.orchestra.run.smithi157.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-03-26T16:41:26.083 INFO:teuthology.orchestra.run.smithi157.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-03-26T16:41:26.083 INFO:teuthology.orchestra.run.smithi157.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-03-26T16:41:26.083 INFO:teuthology.orchestra.run.smithi157.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-03-26T16:41:26.083 INFO:teuthology.orchestra.run.smithi157.stdout:Installing weak dependencies: 2024-03-26T16:41:26.083 INFO:teuthology.orchestra.run.smithi157.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-03-26T16:41:26.083 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-03-26T16:41:26.083 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction Summary 2024-03-26T16:41:26.083 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2024-03-26T16:41:26.084 INFO:teuthology.orchestra.run.smithi157.stdout:Install 30 Packages 2024-03-26T16:41:26.084 INFO:teuthology.orchestra.run.smithi157.stdout:Upgrade 2 Packages 2024-03-26T16:41:26.084 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-03-26T16:41:26.085 INFO:teuthology.orchestra.run.smithi157.stdout:Total download size: 59 M 2024-03-26T16:41:26.085 INFO:teuthology.orchestra.run.smithi157.stdout:Downloading Packages: 2024-03-26T16:41:27.280 INFO:teuthology.orchestra.run.smithi064.stdout:(1/32): ceph-common-19.0.0-2382.gbf9505fb.el9.x 13 MB/s | 21 MB 00:01 2024-03-26T16:41:27.322 INFO:teuthology.orchestra.run.smithi064.stdout:(2/32): ceph-selinux-19.0.0-2382.gbf9505fb.el9. 606 kB/s | 25 kB 00:00 2024-03-26T16:41:27.416 INFO:teuthology.orchestra.run.smithi064.stdout:(3/32): libcephfs2-19.0.0-2382.gbf9505fb.el9.x8 7.8 MB/s | 747 kB 00:00 2024-03-26T16:41:27.499 INFO:teuthology.orchestra.run.smithi064.stdout:(4/32): libradosstriper1-19.0.0-2382.gbf9505fb. 5.9 MB/s | 500 kB 00:00 2024-03-26T16:41:28.075 INFO:teuthology.orchestra.run.smithi064.stdout:(5/32): librgw2-19.0.0-2382.gbf9505fb.el9.x86_6 8.9 MB/s | 5.1 MB 00:00 2024-03-26T16:41:28.150 INFO:teuthology.orchestra.run.smithi064.stdout:(6/32): python3-ceph-argparse-19.0.0-2382.gbf95 603 kB/s | 45 kB 00:00 2024-03-26T16:41:28.225 INFO:teuthology.orchestra.run.smithi064.stdout:(7/32): python3-ceph-common-19.0.0-2382.gbf9505 1.7 MB/s | 133 kB 00:00 2024-03-26T16:41:28.275 INFO:teuthology.orchestra.run.smithi064.stdout:(8/32): python3-cephfs-19.0.0-2382.gbf9505fb.el 3.2 MB/s | 162 kB 00:00 2024-03-26T16:41:28.334 INFO:teuthology.orchestra.run.smithi064.stdout:(9/32): python3-rados-19.0.0-2382.gbf9505fb.el9 5.4 MB/s | 321 kB 00:00 2024-03-26T16:41:28.393 INFO:teuthology.orchestra.run.smithi064.stdout:(10/32): python3-rbd-19.0.0-2382.gbf9505fb.el9. 5.0 MB/s | 298 kB 00:00 2024-03-26T16:41:28.410 INFO:teuthology.orchestra.run.smithi149.stdout:(1/32): ceph-common-19.0.0-2382.gbf9505fb.el9.x 7.6 MB/s | 21 MB 00:02 2024-03-26T16:41:28.443 INFO:teuthology.orchestra.run.smithi064.stdout:(11/32): python3-rgw-19.0.0-2382.gbf9505fb.el9. 1.9 MB/s | 99 kB 00:00 2024-03-26T16:41:28.460 INFO:teuthology.orchestra.run.smithi149.stdout:(2/32): ceph-selinux-19.0.0-2382.gbf9505fb.el9. 505 kB/s | 25 kB 00:00 2024-03-26T16:41:28.552 INFO:teuthology.orchestra.run.smithi149.stdout:(3/32): libcephfs2-19.0.0-2382.gbf9505fb.el9.x8 8.0 MB/s | 747 kB 00:00 2024-03-26T16:41:28.611 INFO:teuthology.orchestra.run.smithi149.stdout:(4/32): libradosstriper1-19.0.0-2382.gbf9505fb. 8.4 MB/s | 500 kB 00:00 2024-03-26T16:41:28.650 INFO:teuthology.orchestra.run.smithi157.stdout:(1/32): ceph-base-19.0.0-2382.gbf9505fb.el9.x86 2.8 MB/s | 5.4 MB 00:01 2024-03-26T16:41:28.767 INFO:teuthology.orchestra.run.smithi157.stdout:(2/32): ceph-selinux-19.0.0-2382.gbf9505fb.el9. 216 kB/s | 25 kB 00:00 2024-03-26T16:41:28.768 INFO:teuthology.orchestra.run.smithi064.stdout:(12/32): boost-program-options-1.75.0-8.el9.x86 325 kB/s | 106 kB 00:00 2024-03-26T16:41:28.885 INFO:teuthology.orchestra.run.smithi064.stdout:(13/32): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.3 MB/s | 159 kB 00:00 2024-03-26T16:41:28.927 INFO:teuthology.orchestra.run.smithi064.stdout:(14/32): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.0 MB/s | 44 kB 00:00 2024-03-26T16:41:29.011 INFO:teuthology.orchestra.run.smithi064.stdout:(15/32): librdkafka-1.6.1-102.el9.x86_64.rpm 7.7 MB/s | 661 kB 00:00 2024-03-26T16:41:29.017 INFO:teuthology.orchestra.run.smithi157.stdout:(3/32): libcephfs2-19.0.0-2382.gbf9505fb.el9.x8 2.9 MB/s | 747 kB 00:00 2024-03-26T16:41:29.078 INFO:teuthology.orchestra.run.smithi064.stdout:(16/32): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.1 MB/s | 282 kB 00:00 2024-03-26T16:41:29.103 INFO:teuthology.orchestra.run.smithi064.stdout:(17/32): python3-prettytable-0.7.2-27.el9.noarc 1.6 MB/s | 41 kB 00:00 2024-03-26T16:41:29.111 INFO:teuthology.orchestra.run.smithi149.stdout:(5/32): librgw2-19.0.0-2382.gbf9505fb.el9.x86_6 10 MB/s | 5.1 MB 00:00 2024-03-26T16:41:29.170 INFO:teuthology.orchestra.run.smithi149.stdout:(6/32): python3-ceph-argparse-19.0.0-2382.gbf95 774 kB/s | 45 kB 00:00 2024-03-26T16:41:29.194 INFO:teuthology.orchestra.run.smithi157.stdout:(4/32): libradosstriper1-19.0.0-2382.gbf9505fb. 2.8 MB/s | 500 kB 00:00 2024-03-26T16:41:29.220 INFO:teuthology.orchestra.run.smithi149.stdout:(7/32): python3-ceph-common-19.0.0-2382.gbf9505 2.6 MB/s | 133 kB 00:00 2024-03-26T16:41:29.279 INFO:teuthology.orchestra.run.smithi149.stdout:(8/32): python3-cephfs-19.0.0-2382.gbf9505fb.el 2.7 MB/s | 162 kB 00:00 2024-03-26T16:41:29.345 INFO:teuthology.orchestra.run.smithi149.stdout:(9/32): python3-rados-19.0.0-2382.gbf9505fb.el9 4.7 MB/s | 321 kB 00:00 2024-03-26T16:41:29.353 INFO:teuthology.orchestra.run.smithi064.stdout:(18/32): qatlib-24.02.0-1.el9.x86_64.rpm 884 kB/s | 221 kB 00:00 2024-03-26T16:41:29.395 INFO:teuthology.orchestra.run.smithi064.stdout:(19/32): qatlib-service-24.02.0-1.el9.x86_64.rp 863 kB/s | 36 kB 00:00 2024-03-26T16:41:29.421 INFO:teuthology.orchestra.run.smithi149.stdout:(10/32): python3-rbd-19.0.0-2382.gbf9505fb.el9. 3.9 MB/s | 298 kB 00:00 2024-03-26T16:41:29.437 INFO:teuthology.orchestra.run.smithi064.stdout:(20/32): qatzip-libs-1.2.0-1.el9.x86_64.rpm 1.1 MB/s | 47 kB 00:00 2024-03-26T16:41:29.479 INFO:teuthology.orchestra.run.smithi149.stdout:(11/32): python3-rgw-19.0.0-2382.gbf9505fb.el9. 1.7 MB/s | 99 kB 00:00 2024-03-26T16:41:29.596 INFO:teuthology.orchestra.run.smithi064.stdout:(21/32): ceph-base-19.0.0-2382.gbf9505fb.el9.x8 1.4 MB/s | 5.4 MB 00:03 2024-03-26T16:41:29.597 INFO:teuthology.orchestra.run.smithi149.stdout:(12/32): boost-program-options-1.75.0-8.el9.x86 905 kB/s | 106 kB 00:00 2024-03-26T16:41:29.697 INFO:teuthology.orchestra.run.smithi149.stdout:(13/32): ceph-radosgw-19.0.0-2382.gbf9505fb.el9 2.5 MB/s | 9.8 MB 00:04 2024-03-26T16:41:29.722 INFO:teuthology.orchestra.run.smithi149.stdout:(14/32): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.2 MB/s | 159 kB 00:00 2024-03-26T16:41:29.747 INFO:teuthology.orchestra.run.smithi149.stdout:(15/32): librabbitmq-0.11.0-7.el9.x86_64.rpm 887 kB/s | 44 kB 00:00 2024-03-26T16:41:29.814 INFO:teuthology.orchestra.run.smithi149.stdout:(16/32): librdkafka-1.6.1-102.el9.x86_64.rpm 7.0 MB/s | 661 kB 00:00 2024-03-26T16:41:29.840 INFO:teuthology.orchestra.run.smithi149.stdout:(17/32): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.0 MB/s | 282 kB 00:00 2024-03-26T16:41:29.851 INFO:teuthology.orchestra.run.smithi157.stdout:(5/32): ceph-radosgw-19.0.0-2382.gbf9505fb.el9. 3.1 MB/s | 9.8 MB 00:03 2024-03-26T16:41:29.865 INFO:teuthology.orchestra.run.smithi149.stdout:(18/32): python3-prettytable-0.7.2-27.el9.noarc 826 kB/s | 41 kB 00:00 2024-03-26T16:41:29.927 INFO:teuthology.orchestra.run.smithi157.stdout:(6/32): python3-ceph-argparse-19.0.0-2382.gbf95 603 kB/s | 45 kB 00:00 2024-03-26T16:41:29.963 INFO:teuthology.orchestra.run.smithi064.stdout:(22/32): gperftools-libs-2.9.1-2.el9.x86_64.rpm 588 kB/s | 309 kB 00:00 2024-03-26T16:41:30.002 INFO:teuthology.orchestra.run.smithi157.stdout:(7/32): python3-ceph-common-19.0.0-2382.gbf9505 1.7 MB/s | 133 kB 00:00 2024-03-26T16:41:30.007 INFO:teuthology.orchestra.run.smithi149.stdout:(19/32): qatlib-service-24.02.0-1.el9.x86_64.rp 253 kB/s | 36 kB 00:00 2024-03-26T16:41:30.055 INFO:teuthology.orchestra.run.smithi064.stdout:(23/32): libarrow-doc-9.0.0-10.el9.noarch.rpm 283 kB/s | 26 kB 00:00 2024-03-26T16:41:30.060 INFO:teuthology.orchestra.run.smithi157.stdout:(8/32): python3-cephfs-19.0.0-2382.gbf9505fb.el 2.7 MB/s | 162 kB 00:00 2024-03-26T16:41:30.082 INFO:teuthology.orchestra.run.smithi149.stdout:(20/32): qatzip-libs-1.2.0-1.el9.x86_64.rpm 632 kB/s | 47 kB 00:00 2024-03-26T16:41:30.116 INFO:teuthology.orchestra.run.smithi149.stdout:(21/32): qatlib-24.02.0-1.el9.x86_64.rpm 801 kB/s | 221 kB 00:00 2024-03-26T16:41:30.144 INFO:teuthology.orchestra.run.smithi157.stdout:(9/32): librgw2-19.0.0-2382.gbf9505fb.el9.x86_6 5.4 MB/s | 5.1 MB 00:00 2024-03-26T16:41:30.155 INFO:teuthology.orchestra.run.smithi064.stdout:(24/32): liboath-2.6.7-2.el9.x86_64.rpm 487 kB/s | 49 kB 00:00 2024-03-26T16:41:30.169 INFO:teuthology.orchestra.run.smithi157.stdout:(10/32): python3-rados-19.0.0-2382.gbf9505fb.el 2.9 MB/s | 321 kB 00:00 2024-03-26T16:41:30.219 INFO:teuthology.orchestra.run.smithi157.stdout:(11/32): python3-rbd-19.0.0-2382.gbf9505fb.el9. 3.9 MB/s | 298 kB 00:00 2024-03-26T16:41:30.245 INFO:teuthology.orchestra.run.smithi157.stdout:(12/32): python3-rgw-19.0.0-2382.gbf9505fb.el9. 1.3 MB/s | 99 kB 00:00 2024-03-26T16:41:30.255 INFO:teuthology.orchestra.run.smithi064.stdout:(25/32): libunwind-1.6.2-1.el9.x86_64.rpm 674 kB/s | 67 kB 00:00 2024-03-26T16:41:30.291 INFO:teuthology.orchestra.run.smithi149.stdout:(22/32): gperftools-libs-2.9.1-2.el9.x86_64.rpm 1.4 MB/s | 309 kB 00:00 2024-03-26T16:41:30.342 INFO:teuthology.orchestra.run.smithi149.stdout:(23/32): libarrow-doc-9.0.0-10.el9.noarch.rpm 519 kB/s | 26 kB 00:00 2024-03-26T16:41:30.417 INFO:teuthology.orchestra.run.smithi149.stdout:(24/32): libarrow-9.0.0-10.el9.x86_64.rpm 15 MB/s | 4.4 MB 00:00 2024-03-26T16:41:30.428 INFO:teuthology.orchestra.run.smithi157.stdout:(13/32): libpmemobj-1.12.1-1.el9.x86_64.rpm 868 kB/s | 159 kB 00:00 2024-03-26T16:41:30.442 INFO:teuthology.orchestra.run.smithi149.stdout:(25/32): liboath-2.6.7-2.el9.x86_64.rpm 486 kB/s | 49 kB 00:00 2024-03-26T16:41:30.453 INFO:teuthology.orchestra.run.smithi157.stdout:(14/32): boost-program-options-1.75.0-8.el9.x86 453 kB/s | 106 kB 00:00 2024-03-26T16:41:30.467 INFO:teuthology.orchestra.run.smithi149.stdout:(26/32): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-03-26T16:41:30.470 INFO:teuthology.orchestra.run.smithi157.stdout:(15/32): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.0 MB/s | 44 kB 00:00 2024-03-26T16:41:30.509 INFO:teuthology.orchestra.run.smithi149.stdout:(27/32): re2-20211101-3.el9.x86_64.rpm 4.5 MB/s | 192 kB 00:00 2024-03-26T16:41:30.543 INFO:teuthology.orchestra.run.smithi149.stdout:(28/32): parquet-libs-9.0.0-10.el9.x86_64.rpm 8.1 MB/s | 838 kB 00:00 2024-03-26T16:41:30.571 INFO:teuthology.orchestra.run.smithi157.stdout:(16/32): librdkafka-1.6.1-102.el9.x86_64.rpm 5.5 MB/s | 661 kB 00:00 2024-03-26T16:41:30.585 INFO:teuthology.orchestra.run.smithi149.stdout:(29/32): thrift-0.15.0-2.el9.x86_64.rpm 21 MB/s | 1.6 MB 00:00 2024-03-26T16:41:30.596 INFO:teuthology.orchestra.run.smithi157.stdout:(17/32): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.2 MB/s | 282 kB 00:00 2024-03-26T16:41:30.613 INFO:teuthology.orchestra.run.smithi157.stdout:(18/32): python3-prettytable-0.7.2-27.el9.noarc 990 kB/s | 41 kB 00:00 2024-03-26T16:41:30.652 INFO:teuthology.orchestra.run.smithi149.stdout:(30/32): ceph-base-19.0.0-2382.gbf9505fb.el9.x8 1.1 MB/s | 5.4 MB 00:04 2024-03-26T16:41:30.655 INFO:teuthology.orchestra.run.smithi157.stdout:(19/32): qatlib-service-24.02.0-1.el9.x86_64.rp 862 kB/s | 36 kB 00:00 2024-03-26T16:41:30.697 INFO:teuthology.orchestra.run.smithi157.stdout:(20/32): qatlib-24.02.0-1.el9.x86_64.rpm 2.2 MB/s | 221 kB 00:00 2024-03-26T16:41:30.714 INFO:teuthology.orchestra.run.smithi157.stdout:(21/32): qatzip-libs-1.2.0-1.el9.x86_64.rpm 809 kB/s | 47 kB 00:00 2024-03-26T16:41:30.805 INFO:teuthology.orchestra.run.smithi064.stdout:(26/32): parquet-libs-9.0.0-10.el9.x86_64.rpm 1.5 MB/s | 838 kB 00:00 2024-03-26T16:41:30.906 INFO:teuthology.orchestra.run.smithi064.stdout:(27/32): ceph-radosgw-19.0.0-2382.gbf9505fb.el9 1.9 MB/s | 9.8 MB 00:05 2024-03-26T16:41:30.918 INFO:teuthology.orchestra.run.smithi149.stdout:(31/32): librados2-19.0.0-2382.gbf9505fb.el9.x8 9.1 MB/s | 3.4 MB 00:00 2024-03-26T16:41:30.981 INFO:teuthology.orchestra.run.smithi064.stdout:(28/32): re2-20211101-3.el9.x86_64.rpm 1.1 MB/s | 192 kB 00:00 2024-03-26T16:41:31.131 INFO:teuthology.orchestra.run.smithi157.stdout:(22/32): gperftools-libs-2.9.1-2.el9.x86_64.rpm 712 kB/s | 309 kB 00:00 2024-03-26T16:41:31.198 INFO:teuthology.orchestra.run.smithi157.stdout:(23/32): libarrow-doc-9.0.0-10.el9.noarch.rpm 391 kB/s | 26 kB 00:00 2024-03-26T16:41:31.235 INFO:teuthology.orchestra.run.smithi149.stdout:(32/32): librbd1-19.0.0-2382.gbf9505fb.el9.x86_ 4.8 MB/s | 3.1 MB 00:00 2024-03-26T16:41:31.238 INFO:teuthology.orchestra.run.smithi149.stdout:-------------------------------------------------------------------------------- 2024-03-26T16:41:31.239 INFO:teuthology.orchestra.run.smithi149.stdout:Total 10 MB/s | 59 MB 00:05 2024-03-26T16:41:31.272 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction check 2024-03-26T16:41:31.281 INFO:teuthology.orchestra.run.smithi157.stdout:(24/32): liboath-2.6.7-2.el9.x86_64.rpm 584 kB/s | 49 kB 00:00 2024-03-26T16:41:31.308 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction check succeeded. 2024-03-26T16:41:31.308 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction test 2024-03-26T16:41:31.382 INFO:teuthology.orchestra.run.smithi157.stdout:(25/32): libunwind-1.6.2-1.el9.x86_64.rpm 673 kB/s | 67 kB 00:00 2024-03-26T16:41:31.441 INFO:teuthology.orchestra.run.smithi157.stdout:(26/32): libarrow-9.0.0-10.el9.x86_64.rpm 6.1 MB/s | 4.4 MB 00:00 2024-03-26T16:41:31.533 INFO:teuthology.orchestra.run.smithi157.stdout:(27/32): re2-20211101-3.el9.x86_64.rpm 2.0 MB/s | 192 kB 00:00 2024-03-26T16:41:31.566 INFO:teuthology.orchestra.run.smithi157.stdout:(28/32): parquet-libs-9.0.0-10.el9.x86_64.rpm 4.5 MB/s | 838 kB 00:00 2024-03-26T16:41:31.598 INFO:teuthology.orchestra.run.smithi064.stdout:(29/32): thrift-0.15.0-2.el9.x86_64.rpm 2.3 MB/s | 1.6 MB 00:00 2024-03-26T16:41:31.641 INFO:teuthology.orchestra.run.smithi157.stdout:(29/32): thrift-0.15.0-2.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-03-26T16:41:31.792 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction test succeeded. 2024-03-26T16:41:31.792 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction 2024-03-26T16:41:31.875 INFO:teuthology.orchestra.run.smithi157.stdout:(30/32): ceph-common-19.0.0-2382.gbf9505fb.el9. 4.0 MB/s | 21 MB 00:05 2024-03-26T16:41:31.889 INFO:teuthology.orchestra.run.smithi064.stdout:(30/32): librbd1-19.0.0-2382.gbf9505fb.el9.x86_ 11 MB/s | 3.1 MB 00:00 2024-03-26T16:41:32.157 INFO:teuthology.orchestra.run.smithi064.stdout:(31/32): librados2-19.0.0-2382.gbf9505fb.el9.x8 2.9 MB/s | 3.4 MB 00:01 2024-03-26T16:41:32.183 INFO:teuthology.orchestra.run.smithi157.stdout:(31/32): librbd1-19.0.0-2382.gbf9505fb.el9.x86_ 5.8 MB/s | 3.1 MB 00:00 2024-03-26T16:41:32.275 INFO:teuthology.orchestra.run.smithi157.stdout:(32/32): librados2-19.0.0-2382.gbf9505fb.el9.x8 4.8 MB/s | 3.4 MB 00:00 2024-03-26T16:41:32.281 INFO:teuthology.orchestra.run.smithi157.stdout:-------------------------------------------------------------------------------- 2024-03-26T16:41:32.281 INFO:teuthology.orchestra.run.smithi157.stdout:Total 9.5 MB/s | 59 MB 00:06 2024-03-26T16:41:32.312 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction check 2024-03-26T16:41:32.348 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction check succeeded. 2024-03-26T16:41:32.348 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction test 2024-03-26T16:41:32.666 INFO:teuthology.orchestra.run.smithi064.stdout:(32/32): libarrow-9.0.0-10.el9.x86_64.rpm 1.4 MB/s | 4.4 MB 00:03 2024-03-26T16:41:32.669 INFO:teuthology.orchestra.run.smithi064.stdout:-------------------------------------------------------------------------------- 2024-03-26T16:41:32.669 INFO:teuthology.orchestra.run.smithi064.stdout:Total 8.3 MB/s | 59 MB 00:07 2024-03-26T16:41:32.705 INFO:teuthology.orchestra.run.smithi064.stdout:Running transaction check 2024-03-26T16:41:32.747 INFO:teuthology.orchestra.run.smithi064.stdout:Transaction check succeeded. 2024-03-26T16:41:32.747 INFO:teuthology.orchestra.run.smithi064.stdout:Running transaction test 2024-03-26T16:41:32.831 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction test succeeded. 2024-03-26T16:41:32.831 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction 2024-03-26T16:41:33.245 INFO:teuthology.orchestra.run.smithi064.stdout:Transaction test succeeded. 2024-03-26T16:41:33.245 INFO:teuthology.orchestra.run.smithi064.stdout:Running transaction 2024-03-26T16:41:33.274 INFO:teuthology.orchestra.run.smithi149.stdout: Preparing : 1/1 2024-03-26T16:41:33.347 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/34 2024-03-26T16:41:33.389 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/34 2024-03-26T16:41:33.520 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/34 2024-03-26T16:41:33.555 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-03-26T16:41:33.572 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-03-26T16:41:33.715 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 5/34 2024-03-26T16:41:33.769 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 5/34 2024-03-26T16:41:34.096 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/34 2024-03-26T16:41:34.150 INFO:teuthology.orchestra.run.smithi149.stdout: Upgrading : librados2-2:19.0.0-2382.gbf9505fb.el9.x86_64 7/34 2024-03-26T16:41:34.243 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: librados2-2:19.0.0-2382.gbf9505fb.el9.x86_64 7/34 2024-03-26T16:41:34.303 INFO:teuthology.orchestra.run.smithi157.stdout: Preparing : 1/1 2024-03-26T16:41:34.330 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-rados-2:19.0.0-2382.gbf9505fb.el9.x86_64 8/34 2024-03-26T16:41:34.360 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libcephfs2-2:19.0.0-2382.gbf9505fb.el9.x86_64 9/34 2024-03-26T16:41:34.384 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/34 2024-03-26T16:41:34.415 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: libcephfs2-2:19.0.0-2382.gbf9505fb.el9.x86_64 9/34 2024-03-26T16:41:34.452 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : liboath-2.6.7-2.el9.x86_64 10/34 2024-03-26T16:41:34.494 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/34 2024-03-26T16:41:34.496 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-ceph-argparse-2:19.0.0-2382.gbf9505fb.el9. 11/34 2024-03-26T16:41:34.566 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-cephfs-2:19.0.0-2382.gbf9505fb.el9.x86_64 12/34 2024-03-26T16:41:34.596 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libradosstriper1-2:19.0.0-2382.gbf9505fb.el9.x86_6 13/34 2024-03-26T16:41:34.597 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/34 2024-03-26T16:41:34.620 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-03-26T16:41:34.638 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-03-26T16:41:34.652 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: libradosstriper1-2:19.0.0-2382.gbf9505fb.el9.x86_6 13/34 2024-03-26T16:41:34.686 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 14/34 2024-03-26T16:41:34.789 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : re2-1:20211101-3.el9.x86_64 15/34 2024-03-26T16:41:34.820 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 16/34 2024-03-26T16:41:34.830 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 5/34 2024-03-26T16:41:34.861 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/34 2024-03-26T16:41:34.893 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 5/34 2024-03-26T16:41:34.894 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 18/34 2024-03-26T16:41:34.922 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 19/34 2024-03-26T16:41:34.955 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 20/34 2024-03-26T16:41:35.129 INFO:teuthology.orchestra.run.smithi064.stdout: Preparing : 1/1 2024-03-26T16:41:35.222 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/34 2024-03-26T16:41:35.237 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/34 2024-03-26T16:41:35.262 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/34 2024-03-26T16:41:35.271 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 21/34 2024-03-26T16:41:35.287 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/34 2024-03-26T16:41:35.291 INFO:teuthology.orchestra.run.smithi157.stdout: Upgrading : librados2-2:19.0.0-2382.gbf9505fb.el9.x86_64 7/34 2024-03-26T16:41:35.310 INFO:teuthology.orchestra.run.smithi149.stdout: Upgrading : librbd1-2:19.0.0-2382.gbf9505fb.el9.x86_64 22/34 2024-03-26T16:41:35.318 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-03-26T16:41:35.335 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-03-26T16:41:35.376 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: librados2-2:19.0.0-2382.gbf9505fb.el9.x86_64 7/34 2024-03-26T16:41:35.396 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: librbd1-2:19.0.0-2382.gbf9505fb.el9.x86_64 22/34 2024-03-26T16:41:35.431 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-rbd-2:19.0.0-2382.gbf9505fb.el9.x86_64 23/34 2024-03-26T16:41:35.464 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-rados-2:19.0.0-2382.gbf9505fb.el9.x86_64 8/34 2024-03-26T16:41:35.476 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 24/34 2024-03-26T16:41:35.492 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : libcephfs2-2:19.0.0-2382.gbf9505fb.el9.x86_64 9/34 2024-03-26T16:41:35.535 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 5/34 2024-03-26T16:41:35.538 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: libcephfs2-2:19.0.0-2382.gbf9505fb.el9.x86_64 9/34 2024-03-26T16:41:35.567 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : liboath-2.6.7-2.el9.x86_64 10/34 2024-03-26T16:41:35.591 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 5/34 2024-03-26T16:41:35.611 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-ceph-argparse-2:19.0.0-2382.gbf9505fb.el9. 11/34 2024-03-26T16:41:35.681 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-cephfs-2:19.0.0-2382.gbf9505fb.el9.x86_64 12/34 2024-03-26T16:41:35.703 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : libradosstriper1-2:19.0.0-2382.gbf9505fb.el9.x86_6 13/34 2024-03-26T16:41:35.750 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: libradosstriper1-2:19.0.0-2382.gbf9505fb.el9.x86_6 13/34 2024-03-26T16:41:35.785 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 14/34 2024-03-26T16:41:35.897 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : re2-1:20211101-3.el9.x86_64 15/34 2024-03-26T16:41:35.927 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 16/34 2024-03-26T16:41:35.939 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 25/34 2024-03-26T16:41:35.941 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/34 2024-03-26T16:41:35.968 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/34 2024-03-26T16:41:35.971 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : librgw2-2:19.0.0-2382.gbf9505fb.el9.x86_64 26/34 2024-03-26T16:41:35.989 INFO:teuthology.orchestra.run.smithi064.stdout: Upgrading : librados2-2:19.0.0-2382.gbf9505fb.el9.x86_64 7/34 2024-03-26T16:41:36.009 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 18/34 2024-03-26T16:41:36.042 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: librgw2-2:19.0.0-2382.gbf9505fb.el9.x86_64 26/34 2024-03-26T16:41:36.046 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 19/34 2024-03-26T16:41:36.079 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 20/34 2024-03-26T16:41:36.082 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: librados2-2:19.0.0-2382.gbf9505fb.el9.x86_64 7/34 2024-03-26T16:41:36.110 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-rgw-2:19.0.0-2382.gbf9505fb.el9.x86_64 27/34 2024-03-26T16:41:36.140 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-ceph-common-2:19.0.0-2382.gbf9505fb.el9.x8 28/34 2024-03-26T16:41:36.171 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-rados-2:19.0.0-2382.gbf9505fb.el9.x86_64 8/34 2024-03-26T16:41:36.199 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : libcephfs2-2:19.0.0-2382.gbf9505fb.el9.x86_64 9/34 2024-03-26T16:41:36.261 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: libcephfs2-2:19.0.0-2382.gbf9505fb.el9.x86_64 9/34 2024-03-26T16:41:36.290 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : liboath-2.6.7-2.el9.x86_64 10/34 2024-03-26T16:41:36.334 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-ceph-argparse-2:19.0.0-2382.gbf9505fb.el9. 11/34 2024-03-26T16:41:36.404 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-cephfs-2:19.0.0-2382.gbf9505fb.el9.x86_64 12/34 2024-03-26T16:41:36.412 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 21/34 2024-03-26T16:41:36.417 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : libradosstriper1-2:19.0.0-2382.gbf9505fb.el9.x86_6 13/34 2024-03-26T16:41:36.442 INFO:teuthology.orchestra.run.smithi157.stdout: Upgrading : librbd1-2:19.0.0-2382.gbf9505fb.el9.x86_64 22/34 2024-03-26T16:41:36.482 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: libradosstriper1-2:19.0.0-2382.gbf9505fb.el9.x86_6 13/34 2024-03-26T16:41:36.508 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 14/34 2024-03-26T16:41:36.533 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: librbd1-2:19.0.0-2382.gbf9505fb.el9.x86_64 22/34 2024-03-26T16:41:36.580 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-rbd-2:19.0.0-2382.gbf9505fb.el9.x86_64 23/34 2024-03-26T16:41:36.620 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : re2-1:20211101-3.el9.x86_64 15/34 2024-03-26T16:41:36.621 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 24/34 2024-03-26T16:41:36.759 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 16/34 2024-03-26T16:41:36.800 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/34 2024-03-26T16:41:36.832 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 18/34 2024-03-26T16:41:36.861 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 19/34 2024-03-26T16:41:36.894 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 20/34 2024-03-26T16:41:37.086 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 25/34 2024-03-26T16:41:37.112 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : librgw2-2:19.0.0-2382.gbf9505fb.el9.x86_64 26/34 2024-03-26T16:41:37.183 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: librgw2-2:19.0.0-2382.gbf9505fb.el9.x86_64 26/34 2024-03-26T16:41:37.222 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 21/34 2024-03-26T16:41:37.251 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-rgw-2:19.0.0-2382.gbf9505fb.el9.x86_64 27/34 2024-03-26T16:41:37.257 INFO:teuthology.orchestra.run.smithi064.stdout: Upgrading : librbd1-2:19.0.0-2382.gbf9505fb.el9.x86_64 22/34 2024-03-26T16:41:37.297 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-ceph-common-2:19.0.0-2382.gbf9505fb.el9.x8 28/34 2024-03-26T16:41:37.351 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: librbd1-2:19.0.0-2382.gbf9505fb.el9.x86_64 22/34 2024-03-26T16:41:37.378 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-rbd-2:19.0.0-2382.gbf9505fb.el9.x86_64 23/34 2024-03-26T16:41:37.415 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 24/34 2024-03-26T16:41:37.905 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 25/34 2024-03-26T16:41:37.934 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : librgw2-2:19.0.0-2382.gbf9505fb.el9.x86_64 26/34 2024-03-26T16:41:38.006 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: librgw2-2:19.0.0-2382.gbf9505fb.el9.x86_64 26/34 2024-03-26T16:41:38.085 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-rgw-2:19.0.0-2382.gbf9505fb.el9.x86_64 27/34 2024-03-26T16:41:38.111 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-ceph-common-2:19.0.0-2382.gbf9505fb.el9.x8 28/34 2024-03-26T16:41:38.443 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-common-2:19.0.0-2382.gbf9505fb.el9.x86_64 29/34 2024-03-26T16:41:38.478 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-common-2:19.0.0-2382.gbf9505fb.el9.x86_64 29/34 2024-03-26T16:41:39.036 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-common-2:19.0.0-2382.gbf9505fb.el9.x86_64 29/34 2024-03-26T16:41:39.073 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-base-2:19.0.0-2382.gbf9505fb.el9.x86_64 30/34 2024-03-26T16:41:39.168 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-base-2:19.0.0-2382.gbf9505fb.el9.x86_64 30/34 2024-03-26T16:41:39.169 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-03-26T16:41:39.169 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-03-26T16:41:39.169 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-03-26T16:41:39.199 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-selinux-2:19.0.0-2382.gbf9505fb.el9.x86_64 31/34 2024-03-26T16:41:39.508 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-common-2:19.0.0-2382.gbf9505fb.el9.x86_64 29/34 2024-03-26T16:41:39.552 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-common-2:19.0.0-2382.gbf9505fb.el9.x86_64 29/34 2024-03-26T16:41:40.101 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-common-2:19.0.0-2382.gbf9505fb.el9.x86_64 29/34 2024-03-26T16:41:40.139 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-base-2:19.0.0-2382.gbf9505fb.el9.x86_64 30/34 2024-03-26T16:41:40.215 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-base-2:19.0.0-2382.gbf9505fb.el9.x86_64 30/34 2024-03-26T16:41:40.215 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-03-26T16:41:40.215 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-03-26T16:41:40.215 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-03-26T16:41:40.248 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-selinux-2:19.0.0-2382.gbf9505fb.el9.x86_64 31/34 2024-03-26T16:41:40.381 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: ceph-common-2:19.0.0-2382.gbf9505fb.el9.x86_64 29/34 2024-03-26T16:41:40.433 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : ceph-common-2:19.0.0-2382.gbf9505fb.el9.x86_64 29/34 2024-03-26T16:41:41.010 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: ceph-common-2:19.0.0-2382.gbf9505fb.el9.x86_64 29/34 2024-03-26T16:41:41.044 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : ceph-base-2:19.0.0-2382.gbf9505fb.el9.x86_64 30/34 2024-03-26T16:41:41.128 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: ceph-base-2:19.0.0-2382.gbf9505fb.el9.x86_64 30/34 2024-03-26T16:41:41.128 INFO:teuthology.orchestra.run.smithi064.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-03-26T16:41:41.128 INFO:teuthology.orchestra.run.smithi064.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-03-26T16:41:41.128 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-03-26T16:41:41.162 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : ceph-selinux-2:19.0.0-2382.gbf9505fb.el9.x86_64 31/34 2024-03-26T16:41:48.677 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-selinux-2:19.0.0-2382.gbf9505fb.el9.x86_64 31/34 2024-03-26T16:41:48.677 INFO:teuthology.orchestra.run.smithi149.stdout:skipping the directory /sys 2024-03-26T16:41:48.677 INFO:teuthology.orchestra.run.smithi149.stdout:skipping the directory /proc 2024-03-26T16:41:48.677 INFO:teuthology.orchestra.run.smithi149.stdout:skipping the directory /mnt 2024-03-26T16:41:48.677 INFO:teuthology.orchestra.run.smithi149.stdout:skipping the directory /var/tmp 2024-03-26T16:41:48.677 INFO:teuthology.orchestra.run.smithi149.stdout:skipping the directory /home 2024-03-26T16:41:48.677 INFO:teuthology.orchestra.run.smithi149.stdout:skipping the directory /root 2024-03-26T16:41:48.677 INFO:teuthology.orchestra.run.smithi149.stdout:skipping the directory /tmp 2024-03-26T16:41:48.677 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-03-26T16:41:49.594 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-radosgw-2:19.0.0-2382.gbf9505fb.el9.x86_64 32/34 2024-03-26T16:41:49.619 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-2382.gbf9505fb.el9.x86_64 32/34 2024-03-26T16:41:49.619 INFO:teuthology.orchestra.run.smithi149.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-26T16:41:49.619 INFO:teuthology.orchestra.run.smithi149.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-03-26T16:41:49.619 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-26T16:41:49.620 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-26T16:41:49.620 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-03-26T16:41:49.621 INFO:teuthology.orchestra.run.smithi149.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-03-26T16:41:49.705 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-03-26T16:41:49.705 INFO:teuthology.orchestra.run.smithi149.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 34/34 2024-03-26T16:41:49.860 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-selinux-2:19.0.0-2382.gbf9505fb.el9.x86_64 31/34 2024-03-26T16:41:49.860 INFO:teuthology.orchestra.run.smithi157.stdout:skipping the directory /sys 2024-03-26T16:41:49.860 INFO:teuthology.orchestra.run.smithi157.stdout:skipping the directory /proc 2024-03-26T16:41:49.861 INFO:teuthology.orchestra.run.smithi157.stdout:skipping the directory /mnt 2024-03-26T16:41:49.861 INFO:teuthology.orchestra.run.smithi157.stdout:skipping the directory /var/tmp 2024-03-26T16:41:49.861 INFO:teuthology.orchestra.run.smithi157.stdout:skipping the directory /home 2024-03-26T16:41:49.861 INFO:teuthology.orchestra.run.smithi157.stdout:skipping the directory /root 2024-03-26T16:41:49.861 INFO:teuthology.orchestra.run.smithi157.stdout:skipping the directory /tmp 2024-03-26T16:41:49.861 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-03-26T16:41:50.789 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-radosgw-2:19.0.0-2382.gbf9505fb.el9.x86_64 32/34 2024-03-26T16:41:50.813 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-2382.gbf9505fb.el9.x86_64 32/34 2024-03-26T16:41:50.813 INFO:teuthology.orchestra.run.smithi157.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-26T16:41:50.813 INFO:teuthology.orchestra.run.smithi157.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-03-26T16:41:50.813 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-26T16:41:50.813 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-26T16:41:50.813 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-03-26T16:41:50.815 INFO:teuthology.orchestra.run.smithi157.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-03-26T16:41:50.834 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 34/34 2024-03-26T16:41:50.834 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-base-2:19.0.0-2382.gbf9505fb.el9.x86_64 1/34 2024-03-26T16:41:50.834 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-common-2:19.0.0-2382.gbf9505fb.el9.x86_64 2/34 2024-03-26T16:41:50.834 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-radosgw-2:19.0.0-2382.gbf9505fb.el9.x86_64 3/34 2024-03-26T16:41:50.834 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-selinux-2:19.0.0-2382.gbf9505fb.el9.x86_64 4/34 2024-03-26T16:41:50.834 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libcephfs2-2:19.0.0-2382.gbf9505fb.el9.x86_64 5/34 2024-03-26T16:41:50.834 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libradosstriper1-2:19.0.0-2382.gbf9505fb.el9.x86_6 6/34 2024-03-26T16:41:50.834 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : librgw2-2:19.0.0-2382.gbf9505fb.el9.x86_64 7/34 2024-03-26T16:41:50.834 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-ceph-argparse-2:19.0.0-2382.gbf9505fb.el9. 8/34 2024-03-26T16:41:50.835 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-ceph-common-2:19.0.0-2382.gbf9505fb.el9.x8 9/34 2024-03-26T16:41:50.835 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-cephfs-2:19.0.0-2382.gbf9505fb.el9.x86_64 10/34 2024-03-26T16:41:50.835 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-rados-2:19.0.0-2382.gbf9505fb.el9.x86_64 11/34 2024-03-26T16:41:50.835 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-rbd-2:19.0.0-2382.gbf9505fb.el9.x86_64 12/34 2024-03-26T16:41:50.835 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-rgw-2:19.0.0-2382.gbf9505fb.el9.x86_64 13/34 2024-03-26T16:41:50.835 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/34 2024-03-26T16:41:50.835 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/34 2024-03-26T16:41:50.835 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/34 2024-03-26T16:41:50.835 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/34 2024-03-26T16:41:50.835 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/34 2024-03-26T16:41:50.835 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/34 2024-03-26T16:41:50.835 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 20/34 2024-03-26T16:41:50.835 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 21/34 2024-03-26T16:41:50.835 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 22/34 2024-03-26T16:41:50.836 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 23/34 2024-03-26T16:41:50.836 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 24/34 2024-03-26T16:41:50.836 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 25/34 2024-03-26T16:41:50.836 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 26/34 2024-03-26T16:41:50.836 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 27/34 2024-03-26T16:41:50.837 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 28/34 2024-03-26T16:41:50.837 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : re2-1:20211101-3.el9.x86_64 29/34 2024-03-26T16:41:50.837 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 30/34 2024-03-26T16:41:50.837 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : librados2-2:19.0.0-2382.gbf9505fb.el9.x86_64 31/34 2024-03-26T16:41:50.837 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 32/34 2024-03-26T16:41:50.837 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : librbd1-2:19.0.0-2382.gbf9505fb.el9.x86_64 33/34 2024-03-26T16:41:50.894 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-03-26T16:41:50.894 INFO:teuthology.orchestra.run.smithi157.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 34/34 2024-03-26T16:41:51.231 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: ceph-selinux-2:19.0.0-2382.gbf9505fb.el9.x86_64 31/34 2024-03-26T16:41:51.232 INFO:teuthology.orchestra.run.smithi064.stdout:skipping the directory /sys 2024-03-26T16:41:51.232 INFO:teuthology.orchestra.run.smithi064.stdout:skipping the directory /proc 2024-03-26T16:41:51.232 INFO:teuthology.orchestra.run.smithi064.stdout:skipping the directory /mnt 2024-03-26T16:41:51.232 INFO:teuthology.orchestra.run.smithi064.stdout:skipping the directory /var/tmp 2024-03-26T16:41:51.232 INFO:teuthology.orchestra.run.smithi064.stdout:skipping the directory /home 2024-03-26T16:41:51.232 INFO:teuthology.orchestra.run.smithi064.stdout:skipping the directory /root 2024-03-26T16:41:51.232 INFO:teuthology.orchestra.run.smithi064.stdout:skipping the directory /tmp 2024-03-26T16:41:51.232 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-03-26T16:41:51.914 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 34/34 2024-03-26T16:41:51.915 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-03-26T16:41:51.915 INFO:teuthology.orchestra.run.smithi149.stdout:Upgraded: 2024-03-26T16:41:51.915 INFO:teuthology.orchestra.run.smithi149.stdout: librados2-2:19.0.0-2382.gbf9505fb.el9.x86_64 2024-03-26T16:41:51.915 INFO:teuthology.orchestra.run.smithi149.stdout: librbd1-2:19.0.0-2382.gbf9505fb.el9.x86_64 2024-03-26T16:41:51.915 INFO:teuthology.orchestra.run.smithi149.stdout:Installed: 2024-03-26T16:41:51.915 INFO:teuthology.orchestra.run.smithi149.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-03-26T16:41:51.915 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-base-2:19.0.0-2382.gbf9505fb.el9.x86_64 2024-03-26T16:41:51.915 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-common-2:19.0.0-2382.gbf9505fb.el9.x86_64 2024-03-26T16:41:51.915 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-radosgw-2:19.0.0-2382.gbf9505fb.el9.x86_64 2024-03-26T16:41:51.915 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-selinux-2:19.0.0-2382.gbf9505fb.el9.x86_64 2024-03-26T16:41:51.915 INFO:teuthology.orchestra.run.smithi149.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-03-26T16:41:51.915 INFO:teuthology.orchestra.run.smithi149.stdout: libarrow-9.0.0-10.el9.x86_64 2024-03-26T16:41:51.915 INFO:teuthology.orchestra.run.smithi149.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-03-26T16:41:51.915 INFO:teuthology.orchestra.run.smithi149.stdout: libcephfs2-2:19.0.0-2382.gbf9505fb.el9.x86_64 2024-03-26T16:41:51.916 INFO:teuthology.orchestra.run.smithi149.stdout: liboath-2.6.7-2.el9.x86_64 2024-03-26T16:41:51.916 INFO:teuthology.orchestra.run.smithi149.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-03-26T16:41:51.916 INFO:teuthology.orchestra.run.smithi149.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-03-26T16:41:51.916 INFO:teuthology.orchestra.run.smithi149.stdout: libradosstriper1-2:19.0.0-2382.gbf9505fb.el9.x86_64 2024-03-26T16:41:51.916 INFO:teuthology.orchestra.run.smithi149.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-03-26T16:41:51.916 INFO:teuthology.orchestra.run.smithi149.stdout: librgw2-2:19.0.0-2382.gbf9505fb.el9.x86_64 2024-03-26T16:41:51.916 INFO:teuthology.orchestra.run.smithi149.stdout: libunwind-1.6.2-1.el9.x86_64 2024-03-26T16:41:51.916 INFO:teuthology.orchestra.run.smithi149.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-03-26T16:41:51.916 INFO:teuthology.orchestra.run.smithi149.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-03-26T16:41:51.916 INFO:teuthology.orchestra.run.smithi149.stdout: python3-ceph-argparse-2:19.0.0-2382.gbf9505fb.el9.x86_64 2024-03-26T16:41:51.916 INFO:teuthology.orchestra.run.smithi149.stdout: python3-ceph-common-2:19.0.0-2382.gbf9505fb.el9.x86_64 2024-03-26T16:41:51.916 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cephfs-2:19.0.0-2382.gbf9505fb.el9.x86_64 2024-03-26T16:41:51.916 INFO:teuthology.orchestra.run.smithi149.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-03-26T16:41:51.916 INFO:teuthology.orchestra.run.smithi149.stdout: python3-rados-2:19.0.0-2382.gbf9505fb.el9.x86_64 2024-03-26T16:41:51.917 INFO:teuthology.orchestra.run.smithi149.stdout: python3-rbd-2:19.0.0-2382.gbf9505fb.el9.x86_64 2024-03-26T16:41:51.917 INFO:teuthology.orchestra.run.smithi149.stdout: python3-rgw-2:19.0.0-2382.gbf9505fb.el9.x86_64 2024-03-26T16:41:51.917 INFO:teuthology.orchestra.run.smithi149.stdout: qatlib-24.02.0-1.el9.x86_64 2024-03-26T16:41:51.917 INFO:teuthology.orchestra.run.smithi149.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-03-26T16:41:51.917 INFO:teuthology.orchestra.run.smithi149.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-03-26T16:41:51.917 INFO:teuthology.orchestra.run.smithi149.stdout: re2-1:20211101-3.el9.x86_64 2024-03-26T16:41:51.917 INFO:teuthology.orchestra.run.smithi149.stdout: thrift-0.15.0-2.el9.x86_64 2024-03-26T16:41:51.917 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-03-26T16:41:51.917 INFO:teuthology.orchestra.run.smithi149.stdout:Complete! 2024-03-26T16:41:52.021 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 34/34 2024-03-26T16:41:52.021 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-base-2:19.0.0-2382.gbf9505fb.el9.x86_64 1/34 2024-03-26T16:41:52.021 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-common-2:19.0.0-2382.gbf9505fb.el9.x86_64 2/34 2024-03-26T16:41:52.021 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-radosgw-2:19.0.0-2382.gbf9505fb.el9.x86_64 3/34 2024-03-26T16:41:52.021 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-selinux-2:19.0.0-2382.gbf9505fb.el9.x86_64 4/34 2024-03-26T16:41:52.022 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : libcephfs2-2:19.0.0-2382.gbf9505fb.el9.x86_64 5/34 2024-03-26T16:41:52.022 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : libradosstriper1-2:19.0.0-2382.gbf9505fb.el9.x86_6 6/34 2024-03-26T16:41:52.022 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : librgw2-2:19.0.0-2382.gbf9505fb.el9.x86_64 7/34 2024-03-26T16:41:52.022 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-ceph-argparse-2:19.0.0-2382.gbf9505fb.el9. 8/34 2024-03-26T16:41:52.022 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-ceph-common-2:19.0.0-2382.gbf9505fb.el9.x8 9/34 2024-03-26T16:41:52.022 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-cephfs-2:19.0.0-2382.gbf9505fb.el9.x86_64 10/34 2024-03-26T16:41:52.022 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-rados-2:19.0.0-2382.gbf9505fb.el9.x86_64 11/34 2024-03-26T16:41:52.022 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-rbd-2:19.0.0-2382.gbf9505fb.el9.x86_64 12/34 2024-03-26T16:41:52.022 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-rgw-2:19.0.0-2382.gbf9505fb.el9.x86_64 13/34 2024-03-26T16:41:52.022 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/34 2024-03-26T16:41:52.022 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/34 2024-03-26T16:41:52.023 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/34 2024-03-26T16:41:52.023 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/34 2024-03-26T16:41:52.023 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/34 2024-03-26T16:41:52.023 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/34 2024-03-26T16:41:52.023 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 20/34 2024-03-26T16:41:52.023 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 21/34 2024-03-26T16:41:52.023 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 22/34 2024-03-26T16:41:52.023 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 23/34 2024-03-26T16:41:52.023 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 24/34 2024-03-26T16:41:52.023 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 25/34 2024-03-26T16:41:52.024 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 26/34 2024-03-26T16:41:52.024 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 27/34 2024-03-26T16:41:52.024 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 28/34 2024-03-26T16:41:52.024 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : re2-1:20211101-3.el9.x86_64 29/34 2024-03-26T16:41:52.025 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 30/34 2024-03-26T16:41:52.025 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : librados2-2:19.0.0-2382.gbf9505fb.el9.x86_64 31/34 2024-03-26T16:41:52.025 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 32/34 2024-03-26T16:41:52.025 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : librbd1-2:19.0.0-2382.gbf9505fb.el9.x86_64 33/34 2024-03-26T16:41:52.180 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : ceph-radosgw-2:19.0.0-2382.gbf9505fb.el9.x86_64 32/34 2024-03-26T16:41:52.205 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-2382.gbf9505fb.el9.x86_64 32/34 2024-03-26T16:41:52.205 INFO:teuthology.orchestra.run.smithi064.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-26T16:41:52.205 INFO:teuthology.orchestra.run.smithi064.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-03-26T16:41:52.205 INFO:teuthology.orchestra.run.smithi064.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-26T16:41:52.206 INFO:teuthology.orchestra.run.smithi064.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-26T16:41:52.206 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-03-26T16:41:52.207 INFO:teuthology.orchestra.run.smithi064.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-03-26T16:41:52.226 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum -y install ceph-test 2024-03-26T16:41:52.291 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-03-26T16:41:52.292 INFO:teuthology.orchestra.run.smithi064.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 34/34 2024-03-26T16:41:52.791 INFO:teuthology.orchestra.run.smithi149.stdout:Last metadata expiration check: 0:00:30 ago on Tue 26 Mar 2024 04:41:22 PM UTC. 2024-03-26T16:41:52.943 INFO:teuthology.orchestra.run.smithi149.stdout:Dependencies resolved. 2024-03-26T16:41:52.943 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-03-26T16:41:52.943 INFO:teuthology.orchestra.run.smithi149.stdout: Package Arch Version Repository Size 2024-03-26T16:41:52.944 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-03-26T16:41:52.944 INFO:teuthology.orchestra.run.smithi149.stdout:Installing: 2024-03-26T16:41:52.944 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-test x86_64 2:19.0.0-2382.gbf9505fb.el9 ceph 48 M 2024-03-26T16:41:52.944 INFO:teuthology.orchestra.run.smithi149.stdout:Installing dependencies: 2024-03-26T16:41:52.944 INFO:teuthology.orchestra.run.smithi149.stdout: jq x86_64 1.6-16.el9 baseos 187 k 2024-03-26T16:41:52.944 INFO:teuthology.orchestra.run.smithi149.stdout: libcephsqlite x86_64 2:19.0.0-2382.gbf9505fb.el9 ceph 163 k 2024-03-26T16:41:52.944 INFO:teuthology.orchestra.run.smithi149.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2024-03-26T16:41:52.944 INFO:teuthology.orchestra.run.smithi149.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2024-03-26T16:41:52.944 INFO:teuthology.orchestra.run.smithi149.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2024-03-26T16:41:52.944 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-03-26T16:41:52.944 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction Summary 2024-03-26T16:41:52.945 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-03-26T16:41:52.945 INFO:teuthology.orchestra.run.smithi149.stdout:Install 6 Packages 2024-03-26T16:41:52.945 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-03-26T16:41:52.945 INFO:teuthology.orchestra.run.smithi149.stdout:Total download size: 49 M 2024-03-26T16:41:52.945 INFO:teuthology.orchestra.run.smithi149.stdout:Installed size: 206 M 2024-03-26T16:41:52.945 INFO:teuthology.orchestra.run.smithi149.stdout:Downloading Packages: 2024-03-26T16:41:53.169 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 34/34 2024-03-26T16:41:53.170 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-03-26T16:41:53.170 INFO:teuthology.orchestra.run.smithi157.stdout:Upgraded: 2024-03-26T16:41:53.170 INFO:teuthology.orchestra.run.smithi157.stdout: librados2-2:19.0.0-2382.gbf9505fb.el9.x86_64 2024-03-26T16:41:53.170 INFO:teuthology.orchestra.run.smithi157.stdout: librbd1-2:19.0.0-2382.gbf9505fb.el9.x86_64 2024-03-26T16:41:53.170 INFO:teuthology.orchestra.run.smithi157.stdout:Installed: 2024-03-26T16:41:53.170 INFO:teuthology.orchestra.run.smithi157.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-03-26T16:41:53.170 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-base-2:19.0.0-2382.gbf9505fb.el9.x86_64 2024-03-26T16:41:53.170 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-common-2:19.0.0-2382.gbf9505fb.el9.x86_64 2024-03-26T16:41:53.170 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-radosgw-2:19.0.0-2382.gbf9505fb.el9.x86_64 2024-03-26T16:41:53.170 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-selinux-2:19.0.0-2382.gbf9505fb.el9.x86_64 2024-03-26T16:41:53.170 INFO:teuthology.orchestra.run.smithi157.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-03-26T16:41:53.171 INFO:teuthology.orchestra.run.smithi157.stdout: libarrow-9.0.0-10.el9.x86_64 2024-03-26T16:41:53.171 INFO:teuthology.orchestra.run.smithi157.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-03-26T16:41:53.171 INFO:teuthology.orchestra.run.smithi157.stdout: libcephfs2-2:19.0.0-2382.gbf9505fb.el9.x86_64 2024-03-26T16:41:53.171 INFO:teuthology.orchestra.run.smithi157.stdout: liboath-2.6.7-2.el9.x86_64 2024-03-26T16:41:53.171 INFO:teuthology.orchestra.run.smithi157.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-03-26T16:41:53.171 INFO:teuthology.orchestra.run.smithi157.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-03-26T16:41:53.171 INFO:teuthology.orchestra.run.smithi157.stdout: libradosstriper1-2:19.0.0-2382.gbf9505fb.el9.x86_64 2024-03-26T16:41:53.171 INFO:teuthology.orchestra.run.smithi157.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-03-26T16:41:53.171 INFO:teuthology.orchestra.run.smithi157.stdout: librgw2-2:19.0.0-2382.gbf9505fb.el9.x86_64 2024-03-26T16:41:53.171 INFO:teuthology.orchestra.run.smithi157.stdout: libunwind-1.6.2-1.el9.x86_64 2024-03-26T16:41:53.171 INFO:teuthology.orchestra.run.smithi157.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-03-26T16:41:53.171 INFO:teuthology.orchestra.run.smithi157.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-03-26T16:41:53.171 INFO:teuthology.orchestra.run.smithi157.stdout: python3-ceph-argparse-2:19.0.0-2382.gbf9505fb.el9.x86_64 2024-03-26T16:41:53.172 INFO:teuthology.orchestra.run.smithi157.stdout: python3-ceph-common-2:19.0.0-2382.gbf9505fb.el9.x86_64 2024-03-26T16:41:53.172 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cephfs-2:19.0.0-2382.gbf9505fb.el9.x86_64 2024-03-26T16:41:53.172 INFO:teuthology.orchestra.run.smithi157.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-03-26T16:41:53.172 INFO:teuthology.orchestra.run.smithi157.stdout: python3-rados-2:19.0.0-2382.gbf9505fb.el9.x86_64 2024-03-26T16:41:53.172 INFO:teuthology.orchestra.run.smithi157.stdout: python3-rbd-2:19.0.0-2382.gbf9505fb.el9.x86_64 2024-03-26T16:41:53.172 INFO:teuthology.orchestra.run.smithi157.stdout: python3-rgw-2:19.0.0-2382.gbf9505fb.el9.x86_64 2024-03-26T16:41:53.172 INFO:teuthology.orchestra.run.smithi157.stdout: qatlib-24.02.0-1.el9.x86_64 2024-03-26T16:41:53.172 INFO:teuthology.orchestra.run.smithi157.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-03-26T16:41:53.172 INFO:teuthology.orchestra.run.smithi157.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-03-26T16:41:53.172 INFO:teuthology.orchestra.run.smithi157.stdout: re2-1:20211101-3.el9.x86_64 2024-03-26T16:41:53.172 INFO:teuthology.orchestra.run.smithi157.stdout: thrift-0.15.0-2.el9.x86_64 2024-03-26T16:41:53.172 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-03-26T16:41:53.172 INFO:teuthology.orchestra.run.smithi157.stdout:Complete! 2024-03-26T16:41:53.173 INFO:teuthology.orchestra.run.smithi149.stdout:(1/6): oniguruma-6.9.6-1.el9.5.x86_64.rpm 1.3 MB/s | 217 kB 00:00 2024-03-26T16:41:53.234 INFO:teuthology.orchestra.run.smithi149.stdout:(2/6): socat-1.7.4.1-5.el9.x86_64.rpm 4.4 MB/s | 300 kB 00:00 2024-03-26T16:41:53.259 INFO:teuthology.orchestra.run.smithi149.stdout:(3/6): libcephsqlite-19.0.0-2382.gbf9505fb.el9. 645 kB/s | 163 kB 00:00 2024-03-26T16:41:53.276 INFO:teuthology.orchestra.run.smithi149.stdout:(4/6): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.5 MB/s | 63 kB 00:00 2024-03-26T16:41:53.402 INFO:teuthology.orchestra.run.smithi149.stdout:(5/6): jq-1.6-16.el9.x86_64.rpm 1.3 MB/s | 187 kB 00:00 2024-03-26T16:41:53.454 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 34/34 2024-03-26T16:41:53.454 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : ceph-base-2:19.0.0-2382.gbf9505fb.el9.x86_64 1/34 2024-03-26T16:41:53.454 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : ceph-common-2:19.0.0-2382.gbf9505fb.el9.x86_64 2/34 2024-03-26T16:41:53.454 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : ceph-radosgw-2:19.0.0-2382.gbf9505fb.el9.x86_64 3/34 2024-03-26T16:41:53.454 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : ceph-selinux-2:19.0.0-2382.gbf9505fb.el9.x86_64 4/34 2024-03-26T16:41:53.454 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : libcephfs2-2:19.0.0-2382.gbf9505fb.el9.x86_64 5/34 2024-03-26T16:41:53.454 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : libradosstriper1-2:19.0.0-2382.gbf9505fb.el9.x86_6 6/34 2024-03-26T16:41:53.454 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : librgw2-2:19.0.0-2382.gbf9505fb.el9.x86_64 7/34 2024-03-26T16:41:53.454 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-ceph-argparse-2:19.0.0-2382.gbf9505fb.el9. 8/34 2024-03-26T16:41:53.455 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-ceph-common-2:19.0.0-2382.gbf9505fb.el9.x8 9/34 2024-03-26T16:41:53.455 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-cephfs-2:19.0.0-2382.gbf9505fb.el9.x86_64 10/34 2024-03-26T16:41:53.455 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-rados-2:19.0.0-2382.gbf9505fb.el9.x86_64 11/34 2024-03-26T16:41:53.455 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-rbd-2:19.0.0-2382.gbf9505fb.el9.x86_64 12/34 2024-03-26T16:41:53.455 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-rgw-2:19.0.0-2382.gbf9505fb.el9.x86_64 13/34 2024-03-26T16:41:53.455 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/34 2024-03-26T16:41:53.455 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/34 2024-03-26T16:41:53.455 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/34 2024-03-26T16:41:53.455 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/34 2024-03-26T16:41:53.455 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/34 2024-03-26T16:41:53.455 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/34 2024-03-26T16:41:53.455 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 20/34 2024-03-26T16:41:53.455 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 21/34 2024-03-26T16:41:53.456 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 22/34 2024-03-26T16:41:53.456 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 23/34 2024-03-26T16:41:53.456 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 24/34 2024-03-26T16:41:53.456 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 25/34 2024-03-26T16:41:53.456 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 26/34 2024-03-26T16:41:53.456 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 27/34 2024-03-26T16:41:53.456 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 28/34 2024-03-26T16:41:53.456 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : re2-1:20211101-3.el9.x86_64 29/34 2024-03-26T16:41:53.456 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 30/34 2024-03-26T16:41:53.456 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : librados2-2:19.0.0-2382.gbf9505fb.el9.x86_64 31/34 2024-03-26T16:41:53.456 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 32/34 2024-03-26T16:41:53.456 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : librbd1-2:19.0.0-2382.gbf9505fb.el9.x86_64 33/34 2024-03-26T16:41:53.516 DEBUG:teuthology.orchestra.run.smithi157:> sudo yum -y install ceph-test 2024-03-26T16:41:54.082 INFO:teuthology.orchestra.run.smithi157.stdout:Last metadata expiration check: 0:00:31 ago on Tue 26 Mar 2024 04:41:23 PM UTC. 2024-03-26T16:41:54.241 INFO:teuthology.orchestra.run.smithi157.stdout:Dependencies resolved. 2024-03-26T16:41:54.242 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2024-03-26T16:41:54.242 INFO:teuthology.orchestra.run.smithi157.stdout: Package Arch Version Repository Size 2024-03-26T16:41:54.242 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2024-03-26T16:41:54.242 INFO:teuthology.orchestra.run.smithi157.stdout:Installing: 2024-03-26T16:41:54.242 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-test x86_64 2:19.0.0-2382.gbf9505fb.el9 ceph 48 M 2024-03-26T16:41:54.242 INFO:teuthology.orchestra.run.smithi157.stdout:Installing dependencies: 2024-03-26T16:41:54.242 INFO:teuthology.orchestra.run.smithi157.stdout: jq x86_64 1.6-16.el9 baseos 187 k 2024-03-26T16:41:54.242 INFO:teuthology.orchestra.run.smithi157.stdout: libcephsqlite x86_64 2:19.0.0-2382.gbf9505fb.el9 ceph 163 k 2024-03-26T16:41:54.242 INFO:teuthology.orchestra.run.smithi157.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2024-03-26T16:41:54.242 INFO:teuthology.orchestra.run.smithi157.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2024-03-26T16:41:54.242 INFO:teuthology.orchestra.run.smithi157.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2024-03-26T16:41:54.242 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-03-26T16:41:54.243 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction Summary 2024-03-26T16:41:54.243 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2024-03-26T16:41:54.243 INFO:teuthology.orchestra.run.smithi157.stdout:Install 6 Packages 2024-03-26T16:41:54.243 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-03-26T16:41:54.243 INFO:teuthology.orchestra.run.smithi157.stdout:Total download size: 49 M 2024-03-26T16:41:54.243 INFO:teuthology.orchestra.run.smithi157.stdout:Installed size: 206 M 2024-03-26T16:41:54.243 INFO:teuthology.orchestra.run.smithi157.stdout:Downloading Packages: 2024-03-26T16:41:54.575 INFO:teuthology.orchestra.run.smithi157.stdout:(1/6): oniguruma-6.9.6-1.el9.5.x86_64.rpm 1.0 MB/s | 217 kB 00:00 2024-03-26T16:41:54.675 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 34/34 2024-03-26T16:41:54.675 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-03-26T16:41:54.675 INFO:teuthology.orchestra.run.smithi064.stdout:Upgraded: 2024-03-26T16:41:54.676 INFO:teuthology.orchestra.run.smithi064.stdout: librados2-2:19.0.0-2382.gbf9505fb.el9.x86_64 2024-03-26T16:41:54.676 INFO:teuthology.orchestra.run.smithi064.stdout: librbd1-2:19.0.0-2382.gbf9505fb.el9.x86_64 2024-03-26T16:41:54.676 INFO:teuthology.orchestra.run.smithi064.stdout:Installed: 2024-03-26T16:41:54.676 INFO:teuthology.orchestra.run.smithi064.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-03-26T16:41:54.676 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-base-2:19.0.0-2382.gbf9505fb.el9.x86_64 2024-03-26T16:41:54.676 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-common-2:19.0.0-2382.gbf9505fb.el9.x86_64 2024-03-26T16:41:54.676 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-radosgw-2:19.0.0-2382.gbf9505fb.el9.x86_64 2024-03-26T16:41:54.676 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-selinux-2:19.0.0-2382.gbf9505fb.el9.x86_64 2024-03-26T16:41:54.676 INFO:teuthology.orchestra.run.smithi064.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-03-26T16:41:54.676 INFO:teuthology.orchestra.run.smithi064.stdout: libarrow-9.0.0-10.el9.x86_64 2024-03-26T16:41:54.676 INFO:teuthology.orchestra.run.smithi064.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-03-26T16:41:54.676 INFO:teuthology.orchestra.run.smithi064.stdout: libcephfs2-2:19.0.0-2382.gbf9505fb.el9.x86_64 2024-03-26T16:41:54.676 INFO:teuthology.orchestra.run.smithi064.stdout: liboath-2.6.7-2.el9.x86_64 2024-03-26T16:41:54.676 INFO:teuthology.orchestra.run.smithi064.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-03-26T16:41:54.677 INFO:teuthology.orchestra.run.smithi064.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-03-26T16:41:54.677 INFO:teuthology.orchestra.run.smithi064.stdout: libradosstriper1-2:19.0.0-2382.gbf9505fb.el9.x86_64 2024-03-26T16:41:54.677 INFO:teuthology.orchestra.run.smithi064.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-03-26T16:41:54.677 INFO:teuthology.orchestra.run.smithi064.stdout: librgw2-2:19.0.0-2382.gbf9505fb.el9.x86_64 2024-03-26T16:41:54.677 INFO:teuthology.orchestra.run.smithi064.stdout: libunwind-1.6.2-1.el9.x86_64 2024-03-26T16:41:54.677 INFO:teuthology.orchestra.run.smithi064.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-03-26T16:41:54.677 INFO:teuthology.orchestra.run.smithi064.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-03-26T16:41:54.677 INFO:teuthology.orchestra.run.smithi064.stdout: python3-ceph-argparse-2:19.0.0-2382.gbf9505fb.el9.x86_64 2024-03-26T16:41:54.677 INFO:teuthology.orchestra.run.smithi064.stdout: python3-ceph-common-2:19.0.0-2382.gbf9505fb.el9.x86_64 2024-03-26T16:41:54.677 INFO:teuthology.orchestra.run.smithi064.stdout: python3-cephfs-2:19.0.0-2382.gbf9505fb.el9.x86_64 2024-03-26T16:41:54.677 INFO:teuthology.orchestra.run.smithi064.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-03-26T16:41:54.677 INFO:teuthology.orchestra.run.smithi064.stdout: python3-rados-2:19.0.0-2382.gbf9505fb.el9.x86_64 2024-03-26T16:41:54.677 INFO:teuthology.orchestra.run.smithi064.stdout: python3-rbd-2:19.0.0-2382.gbf9505fb.el9.x86_64 2024-03-26T16:41:54.677 INFO:teuthology.orchestra.run.smithi064.stdout: python3-rgw-2:19.0.0-2382.gbf9505fb.el9.x86_64 2024-03-26T16:41:54.677 INFO:teuthology.orchestra.run.smithi064.stdout: qatlib-24.02.0-1.el9.x86_64 2024-03-26T16:41:54.678 INFO:teuthology.orchestra.run.smithi064.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-03-26T16:41:54.678 INFO:teuthology.orchestra.run.smithi064.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-03-26T16:41:54.678 INFO:teuthology.orchestra.run.smithi064.stdout: re2-1:20211101-3.el9.x86_64 2024-03-26T16:41:54.678 INFO:teuthology.orchestra.run.smithi064.stdout: thrift-0.15.0-2.el9.x86_64 2024-03-26T16:41:54.678 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-03-26T16:41:54.678 INFO:teuthology.orchestra.run.smithi064.stdout:Complete! 2024-03-26T16:41:54.750 INFO:teuthology.orchestra.run.smithi157.stdout:(2/6): libcephsqlite-19.0.0-2382.gbf9505fb.el9. 416 kB/s | 163 kB 00:00 2024-03-26T16:41:54.792 INFO:teuthology.orchestra.run.smithi157.stdout:(3/6): socat-1.7.4.1-5.el9.x86_64.rpm 1.4 MB/s | 300 kB 00:00 2024-03-26T16:41:54.817 INFO:teuthology.orchestra.run.smithi157.stdout:(4/6): xmlstarlet-1.6.1-20.el9.x86_64.rpm 939 kB/s | 63 kB 00:00 2024-03-26T16:41:54.942 INFO:teuthology.orchestra.run.smithi157.stdout:(5/6): jq-1.6-16.el9.x86_64.rpm 1.2 MB/s | 187 kB 00:00 2024-03-26T16:41:54.990 DEBUG:teuthology.orchestra.run.smithi064:> sudo yum -y install ceph-test 2024-03-26T16:41:55.555 INFO:teuthology.orchestra.run.smithi064.stdout:Last metadata expiration check: 0:00:33 ago on Tue 26 Mar 2024 04:41:22 PM UTC. 2024-03-26T16:41:55.710 INFO:teuthology.orchestra.run.smithi064.stdout:Dependencies resolved. 2024-03-26T16:41:55.711 INFO:teuthology.orchestra.run.smithi064.stdout:================================================================================ 2024-03-26T16:41:55.711 INFO:teuthology.orchestra.run.smithi064.stdout: Package Arch Version Repository Size 2024-03-26T16:41:55.711 INFO:teuthology.orchestra.run.smithi064.stdout:================================================================================ 2024-03-26T16:41:55.711 INFO:teuthology.orchestra.run.smithi064.stdout:Installing: 2024-03-26T16:41:55.711 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-test x86_64 2:19.0.0-2382.gbf9505fb.el9 ceph 48 M 2024-03-26T16:41:55.711 INFO:teuthology.orchestra.run.smithi064.stdout:Installing dependencies: 2024-03-26T16:41:55.711 INFO:teuthology.orchestra.run.smithi064.stdout: jq x86_64 1.6-16.el9 baseos 187 k 2024-03-26T16:41:55.712 INFO:teuthology.orchestra.run.smithi064.stdout: libcephsqlite x86_64 2:19.0.0-2382.gbf9505fb.el9 ceph 163 k 2024-03-26T16:41:55.712 INFO:teuthology.orchestra.run.smithi064.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2024-03-26T16:41:55.712 INFO:teuthology.orchestra.run.smithi064.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2024-03-26T16:41:55.712 INFO:teuthology.orchestra.run.smithi064.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2024-03-26T16:41:55.712 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-03-26T16:41:55.712 INFO:teuthology.orchestra.run.smithi064.stdout:Transaction Summary 2024-03-26T16:41:55.712 INFO:teuthology.orchestra.run.smithi064.stdout:================================================================================ 2024-03-26T16:41:55.712 INFO:teuthology.orchestra.run.smithi064.stdout:Install 6 Packages 2024-03-26T16:41:55.712 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-03-26T16:41:55.713 INFO:teuthology.orchestra.run.smithi064.stdout:Total download size: 49 M 2024-03-26T16:41:55.713 INFO:teuthology.orchestra.run.smithi064.stdout:Installed size: 206 M 2024-03-26T16:41:55.713 INFO:teuthology.orchestra.run.smithi064.stdout:Downloading Packages: 2024-03-26T16:41:55.844 INFO:teuthology.orchestra.run.smithi149.stdout:(6/6): ceph-test-19.0.0-2382.gbf9505fb.el9.x86_ 17 MB/s | 48 MB 00:02 2024-03-26T16:41:55.847 INFO:teuthology.orchestra.run.smithi149.stdout:-------------------------------------------------------------------------------- 2024-03-26T16:41:55.847 INFO:teuthology.orchestra.run.smithi149.stdout:Total 17 MB/s | 49 MB 00:02 2024-03-26T16:41:55.862 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction check 2024-03-26T16:41:55.884 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction check succeeded. 2024-03-26T16:41:55.884 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction test 2024-03-26T16:41:56.005 INFO:teuthology.orchestra.run.smithi064.stdout:(1/6): oniguruma-6.9.6-1.el9.5.x86_64.rpm 853 kB/s | 217 kB 00:00 2024-03-26T16:41:56.146 INFO:teuthology.orchestra.run.smithi064.stdout:(2/6): socat-1.7.4.1-5.el9.x86_64.rpm 2.1 MB/s | 300 kB 00:00 2024-03-26T16:41:56.289 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction test succeeded. 2024-03-26T16:41:56.289 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction 2024-03-26T16:41:56.347 INFO:teuthology.orchestra.run.smithi064.stdout:(3/6): xmlstarlet-1.6.1-20.el9.x86_64.rpm 313 kB/s | 63 kB 00:00 2024-03-26T16:41:56.372 INFO:teuthology.orchestra.run.smithi064.stdout:(4/6): libcephsqlite-19.0.0-2382.gbf9505fb.el9. 263 kB/s | 163 kB 00:00 2024-03-26T16:41:56.447 INFO:teuthology.orchestra.run.smithi064.stdout:(5/6): jq-1.6-16.el9.x86_64.rpm 1.8 MB/s | 187 kB 00:00 2024-03-26T16:41:56.888 INFO:teuthology.orchestra.run.smithi149.stdout: Preparing : 1/1 2024-03-26T16:41:56.970 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/6 2024-03-26T16:41:57.019 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 2/6 2024-03-26T16:41:57.051 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 3/6 2024-03-26T16:41:57.094 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : jq-1.6-16.el9.x86_64 4/6 2024-03-26T16:41:57.122 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libcephsqlite-2:19.0.0-2382.gbf9505fb.el9.x86_64 5/6 2024-03-26T16:41:58.131 INFO:teuthology.orchestra.run.smithi064.stdout:(6/6): ceph-test-19.0.0-2382.gbf9505fb.el9.x86_ 20 MB/s | 48 MB 00:02 2024-03-26T16:41:58.133 INFO:teuthology.orchestra.run.smithi064.stdout:-------------------------------------------------------------------------------- 2024-03-26T16:41:58.134 INFO:teuthology.orchestra.run.smithi064.stdout:Total 20 MB/s | 49 MB 00:02 2024-03-26T16:41:58.148 INFO:teuthology.orchestra.run.smithi064.stdout:Running transaction check 2024-03-26T16:41:58.171 INFO:teuthology.orchestra.run.smithi064.stdout:Transaction check succeeded. 2024-03-26T16:41:58.171 INFO:teuthology.orchestra.run.smithi064.stdout:Running transaction test 2024-03-26T16:41:58.586 INFO:teuthology.orchestra.run.smithi064.stdout:Transaction test succeeded. 2024-03-26T16:41:58.586 INFO:teuthology.orchestra.run.smithi064.stdout:Running transaction 2024-03-26T16:41:59.293 INFO:teuthology.orchestra.run.smithi064.stdout: Preparing : 1/1 2024-03-26T16:41:59.374 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/6 2024-03-26T16:41:59.410 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 2/6 2024-03-26T16:41:59.438 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 3/6 2024-03-26T16:41:59.481 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : jq-1.6-16.el9.x86_64 4/6 2024-03-26T16:41:59.508 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : libcephsqlite-2:19.0.0-2382.gbf9505fb.el9.x86_64 5/6 2024-03-26T16:42:01.689 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: libcephsqlite-2:19.0.0-2382.gbf9505fb.el9.x86_64 5/6 2024-03-26T16:42:01.772 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-test-2:19.0.0-2382.gbf9505fb.el9.x86_64 6/6 2024-03-26T16:42:04.269 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: libcephsqlite-2:19.0.0-2382.gbf9505fb.el9.x86_64 5/6 2024-03-26T16:42:04.332 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-test-2:19.0.0-2382.gbf9505fb.el9.x86_64 6/6 2024-03-26T16:42:04.332 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-test-2:19.0.0-2382.gbf9505fb.el9.x86_64 1/6 2024-03-26T16:42:04.332 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libcephsqlite-2:19.0.0-2382.gbf9505fb.el9.x86_64 2/6 2024-03-26T16:42:04.332 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 3/6 2024-03-26T16:42:04.332 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 4/6 2024-03-26T16:42:04.332 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 5/6 2024-03-26T16:42:04.352 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : ceph-test-2:19.0.0-2382.gbf9505fb.el9.x86_64 6/6 2024-03-26T16:42:04.734 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : jq-1.6-16.el9.x86_64 6/6 2024-03-26T16:42:04.734 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-03-26T16:42:04.734 INFO:teuthology.orchestra.run.smithi149.stdout:Installed: 2024-03-26T16:42:04.734 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-test-2:19.0.0-2382.gbf9505fb.el9.x86_64 2024-03-26T16:42:04.734 INFO:teuthology.orchestra.run.smithi149.stdout: jq-1.6-16.el9.x86_64 2024-03-26T16:42:04.734 INFO:teuthology.orchestra.run.smithi149.stdout: libcephsqlite-2:19.0.0-2382.gbf9505fb.el9.x86_64 2024-03-26T16:42:04.734 INFO:teuthology.orchestra.run.smithi149.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-03-26T16:42:04.734 INFO:teuthology.orchestra.run.smithi149.stdout: socat-1.7.4.1-5.el9.x86_64 2024-03-26T16:42:04.734 INFO:teuthology.orchestra.run.smithi149.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-03-26T16:42:04.734 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-03-26T16:42:04.735 INFO:teuthology.orchestra.run.smithi149.stdout:Complete! 2024-03-26T16:42:05.027 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum -y install ceph 2024-03-26T16:42:05.608 INFO:teuthology.orchestra.run.smithi149.stdout:Last metadata expiration check: 0:00:43 ago on Tue 26 Mar 2024 04:41:22 PM UTC. 2024-03-26T16:42:05.785 INFO:teuthology.orchestra.run.smithi149.stdout:Dependencies resolved. 2024-03-26T16:42:05.788 INFO:teuthology.orchestra.run.smithi149.stdout:========================================================================================= 2024-03-26T16:42:05.788 INFO:teuthology.orchestra.run.smithi149.stdout: Package Arch Version Repository Size 2024-03-26T16:42:05.788 INFO:teuthology.orchestra.run.smithi149.stdout:========================================================================================= 2024-03-26T16:42:05.788 INFO:teuthology.orchestra.run.smithi149.stdout:Installing: 2024-03-26T16:42:05.788 INFO:teuthology.orchestra.run.smithi149.stdout: ceph x86_64 2:19.0.0-2382.gbf9505fb.el9 ceph 6.6 k 2024-03-26T16:42:05.788 INFO:teuthology.orchestra.run.smithi149.stdout:Installing dependencies: 2024-03-26T16:42:05.789 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mds x86_64 2:19.0.0-2382.gbf9505fb.el9 ceph 2.4 M 2024-03-26T16:42:05.789 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr x86_64 2:19.0.0-2382.gbf9505fb.el9 ceph 1.5 M 2024-03-26T16:42:05.789 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-modules-core noarch 2:19.0.0-2382.gbf9505fb.el9 ceph-noarch 248 k 2024-03-26T16:42:05.789 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mon x86_64 2:19.0.0-2382.gbf9505fb.el9 ceph 4.8 M 2024-03-26T16:42:05.789 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-osd x86_64 2:19.0.0-2382.gbf9505fb.el9 ceph 17 M 2024-03-26T16:42:05.789 INFO:teuthology.orchestra.run.smithi149.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2024-03-26T16:42:05.789 INFO:teuthology.orchestra.run.smithi149.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-03-26T16:42:05.789 INFO:teuthology.orchestra.run.smithi149.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-03-26T16:42:05.789 INFO:teuthology.orchestra.run.smithi149.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-03-26T16:42:05.789 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2024-03-26T16:42:05.789 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-03-26T16:42:05.790 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-03-26T16:42:05.790 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2024-03-26T16:42:05.790 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-03-26T16:42:05.790 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-03-26T16:42:05.790 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-03-26T16:42:05.790 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-03-26T16:42:05.790 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-03-26T16:42:05.790 INFO:teuthology.orchestra.run.smithi149.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-03-26T16:42:05.790 INFO:teuthology.orchestra.run.smithi149.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2024-03-26T16:42:05.791 INFO:teuthology.orchestra.run.smithi149.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2024-03-26T16:42:05.791 INFO:teuthology.orchestra.run.smithi149.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-03-26T16:42:05.791 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-03-26T16:42:05.791 INFO:teuthology.orchestra.run.smithi149.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2024-03-26T16:42:05.791 INFO:teuthology.orchestra.run.smithi149.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-03-26T16:42:05.791 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-03-26T16:42:05.791 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2024-03-26T16:42:05.791 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2024-03-26T16:42:05.791 INFO:teuthology.orchestra.run.smithi149.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-03-26T16:42:05.791 INFO:teuthology.orchestra.run.smithi149.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-03-26T16:42:05.791 INFO:teuthology.orchestra.run.smithi149.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2024-03-26T16:42:05.792 INFO:teuthology.orchestra.run.smithi149.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2024-03-26T16:42:05.792 INFO:teuthology.orchestra.run.smithi149.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-03-26T16:42:05.792 INFO:teuthology.orchestra.run.smithi149.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-03-26T16:42:05.792 INFO:teuthology.orchestra.run.smithi149.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-03-26T16:42:05.792 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-03-26T16:42:05.792 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction Summary 2024-03-26T16:42:05.792 INFO:teuthology.orchestra.run.smithi149.stdout:========================================================================================= 2024-03-26T16:42:05.792 INFO:teuthology.orchestra.run.smithi149.stdout:Install 36 Packages 2024-03-26T16:42:05.792 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-03-26T16:42:05.793 INFO:teuthology.orchestra.run.smithi149.stdout:Total download size: 30 M 2024-03-26T16:42:05.793 INFO:teuthology.orchestra.run.smithi149.stdout:Installed size: 108 M 2024-03-26T16:42:05.793 INFO:teuthology.orchestra.run.smithi149.stdout:Downloading Packages: 2024-03-26T16:42:06.423 INFO:teuthology.orchestra.run.smithi149.stdout:(1/36): ceph-19.0.0-2382.gbf9505fb.el9.x86_64.r 39 kB/s | 6.6 kB 00:00 2024-03-26T16:42:06.673 INFO:teuthology.orchestra.run.smithi149.stdout:(2/36): ceph-mgr-19.0.0-2382.gbf9505fb.el9.x86_ 3.6 MB/s | 1.5 MB 00:00 2024-03-26T16:42:06.713 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: ceph-test-2:19.0.0-2382.gbf9505fb.el9.x86_64 6/6 2024-03-26T16:42:06.713 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : ceph-test-2:19.0.0-2382.gbf9505fb.el9.x86_64 1/6 2024-03-26T16:42:06.713 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : libcephsqlite-2:19.0.0-2382.gbf9505fb.el9.x86_64 2/6 2024-03-26T16:42:06.714 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 3/6 2024-03-26T16:42:06.714 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 4/6 2024-03-26T16:42:06.714 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 5/6 2024-03-26T16:42:07.048 INFO:teuthology.orchestra.run.smithi149.stdout:(3/36): ceph-mon-19.0.0-2382.gbf9505fb.el9.x86_ 7.6 MB/s | 4.8 MB 00:00 2024-03-26T16:42:07.136 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : jq-1.6-16.el9.x86_64 6/6 2024-03-26T16:42:07.136 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-03-26T16:42:07.137 INFO:teuthology.orchestra.run.smithi064.stdout:Installed: 2024-03-26T16:42:07.137 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-test-2:19.0.0-2382.gbf9505fb.el9.x86_64 2024-03-26T16:42:07.137 INFO:teuthology.orchestra.run.smithi064.stdout: jq-1.6-16.el9.x86_64 2024-03-26T16:42:07.137 INFO:teuthology.orchestra.run.smithi064.stdout: libcephsqlite-2:19.0.0-2382.gbf9505fb.el9.x86_64 2024-03-26T16:42:07.137 INFO:teuthology.orchestra.run.smithi064.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-03-26T16:42:07.137 INFO:teuthology.orchestra.run.smithi064.stdout: socat-1.7.4.1-5.el9.x86_64 2024-03-26T16:42:07.137 INFO:teuthology.orchestra.run.smithi064.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-03-26T16:42:07.137 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-03-26T16:42:07.137 INFO:teuthology.orchestra.run.smithi064.stdout:Complete! 2024-03-26T16:42:07.257 INFO:teuthology.orchestra.run.smithi149.stdout:(4/36): ceph-mds-19.0.0-2382.gbf9505fb.el9.x86_ 2.4 MB/s | 2.4 MB 00:01 2024-03-26T16:42:07.391 INFO:teuthology.orchestra.run.smithi149.stdout:(5/36): lua-5.4.4-4.el9.x86_64.rpm 1.4 MB/s | 187 kB 00:00 2024-03-26T16:42:07.399 DEBUG:teuthology.orchestra.run.smithi064:> sudo yum -y install ceph 2024-03-26T16:42:07.441 INFO:teuthology.orchestra.run.smithi149.stdout:(6/36): python3-mako-1.1.4-6.el9.noarch.rpm 2.8 MB/s | 144 kB 00:00 2024-03-26T16:42:07.466 INFO:teuthology.orchestra.run.smithi149.stdout:(7/36): ceph-mgr-modules-core-19.0.0-2382.gbf95 595 kB/s | 248 kB 00:00 2024-03-26T16:42:07.483 INFO:teuthology.orchestra.run.smithi149.stdout:(8/36): python3-markupsafe-1.1.1-12.el9.x86_64. 754 kB/s | 32 kB 00:00 2024-03-26T16:42:07.500 INFO:teuthology.orchestra.run.smithi149.stdout:(9/36): python3-pytz-2021.1-5.el9.noarch.rpm 1.4 MB/s | 47 kB 00:00 2024-03-26T16:42:07.525 INFO:teuthology.orchestra.run.smithi149.stdout:(10/36): python3-toml-0.10.2-6.el9.noarch.rpm 914 kB/s | 39 kB 00:00 2024-03-26T16:42:07.551 INFO:teuthology.orchestra.run.smithi149.stdout:(11/36): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.7 MB/s | 241 kB 00:00 2024-03-26T16:42:07.609 INFO:teuthology.orchestra.run.smithi149.stdout:(12/36): python3-cryptography-36.0.1-4.el9.x86_ 14 MB/s | 1.1 MB 00:00 2024-03-26T16:42:07.634 INFO:teuthology.orchestra.run.smithi149.stdout:(13/36): python3-ply-3.11-14.el9.noarch.rpm 1.2 MB/s | 103 kB 00:00 2024-03-26T16:42:07.660 INFO:teuthology.orchestra.run.smithi149.stdout:(14/36): python3-pycparser-2.20-6.el9.noarch.rp 2.4 MB/s | 124 kB 00:00 2024-03-26T16:42:07.685 INFO:teuthology.orchestra.run.smithi149.stdout:(15/36): python3-urllib3-1.26.5-5.el9.noarch.rp 3.7 MB/s | 187 kB 00:00 2024-03-26T16:42:07.786 INFO:teuthology.orchestra.run.smithi149.stdout:(16/36): lua-devel-5.4.4-4.el9.x86_64.rpm 222 kB/s | 22 kB 00:00 2024-03-26T16:42:07.977 INFO:teuthology.orchestra.run.smithi064.stdout:Last metadata expiration check: 0:00:45 ago on Tue 26 Mar 2024 04:41:22 PM UTC. 2024-03-26T16:42:07.978 INFO:teuthology.orchestra.run.smithi149.stdout:(17/36): ceph-osd-19.0.0-2382.gbf9505fb.el9.x86 13 MB/s | 17 MB 00:01 2024-03-26T16:42:08.141 INFO:teuthology.orchestra.run.smithi064.stdout:Dependencies resolved. 2024-03-26T16:42:08.143 INFO:teuthology.orchestra.run.smithi064.stdout:========================================================================================= 2024-03-26T16:42:08.144 INFO:teuthology.orchestra.run.smithi064.stdout: Package Arch Version Repository Size 2024-03-26T16:42:08.144 INFO:teuthology.orchestra.run.smithi064.stdout:========================================================================================= 2024-03-26T16:42:08.144 INFO:teuthology.orchestra.run.smithi064.stdout:Installing: 2024-03-26T16:42:08.144 INFO:teuthology.orchestra.run.smithi064.stdout: ceph x86_64 2:19.0.0-2382.gbf9505fb.el9 ceph 6.6 k 2024-03-26T16:42:08.144 INFO:teuthology.orchestra.run.smithi064.stdout:Installing dependencies: 2024-03-26T16:42:08.144 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-mds x86_64 2:19.0.0-2382.gbf9505fb.el9 ceph 2.4 M 2024-03-26T16:42:08.144 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-mgr x86_64 2:19.0.0-2382.gbf9505fb.el9 ceph 1.5 M 2024-03-26T16:42:08.144 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-mgr-modules-core noarch 2:19.0.0-2382.gbf9505fb.el9 ceph-noarch 248 k 2024-03-26T16:42:08.144 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-mon x86_64 2:19.0.0-2382.gbf9505fb.el9 ceph 4.8 M 2024-03-26T16:42:08.144 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-osd x86_64 2:19.0.0-2382.gbf9505fb.el9 ceph 17 M 2024-03-26T16:42:08.144 INFO:teuthology.orchestra.run.smithi064.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2024-03-26T16:42:08.144 INFO:teuthology.orchestra.run.smithi064.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-03-26T16:42:08.144 INFO:teuthology.orchestra.run.smithi064.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-03-26T16:42:08.145 INFO:teuthology.orchestra.run.smithi064.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-03-26T16:42:08.145 INFO:teuthology.orchestra.run.smithi064.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2024-03-26T16:42:08.145 INFO:teuthology.orchestra.run.smithi064.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-03-26T16:42:08.145 INFO:teuthology.orchestra.run.smithi064.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-03-26T16:42:08.145 INFO:teuthology.orchestra.run.smithi064.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2024-03-26T16:42:08.145 INFO:teuthology.orchestra.run.smithi064.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-03-26T16:42:08.145 INFO:teuthology.orchestra.run.smithi064.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-03-26T16:42:08.145 INFO:teuthology.orchestra.run.smithi064.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-03-26T16:42:08.145 INFO:teuthology.orchestra.run.smithi064.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-03-26T16:42:08.145 INFO:teuthology.orchestra.run.smithi064.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-03-26T16:42:08.145 INFO:teuthology.orchestra.run.smithi064.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-03-26T16:42:08.145 INFO:teuthology.orchestra.run.smithi064.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2024-03-26T16:42:08.145 INFO:teuthology.orchestra.run.smithi064.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2024-03-26T16:42:08.145 INFO:teuthology.orchestra.run.smithi064.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-03-26T16:42:08.145 INFO:teuthology.orchestra.run.smithi064.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-03-26T16:42:08.146 INFO:teuthology.orchestra.run.smithi064.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2024-03-26T16:42:08.146 INFO:teuthology.orchestra.run.smithi064.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-03-26T16:42:08.146 INFO:teuthology.orchestra.run.smithi064.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-03-26T16:42:08.146 INFO:teuthology.orchestra.run.smithi064.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2024-03-26T16:42:08.146 INFO:teuthology.orchestra.run.smithi064.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2024-03-26T16:42:08.146 INFO:teuthology.orchestra.run.smithi064.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-03-26T16:42:08.146 INFO:teuthology.orchestra.run.smithi064.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-03-26T16:42:08.146 INFO:teuthology.orchestra.run.smithi064.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2024-03-26T16:42:08.146 INFO:teuthology.orchestra.run.smithi064.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2024-03-26T16:42:08.146 INFO:teuthology.orchestra.run.smithi064.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-03-26T16:42:08.146 INFO:teuthology.orchestra.run.smithi064.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-03-26T16:42:08.146 INFO:teuthology.orchestra.run.smithi064.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-03-26T16:42:08.146 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-03-26T16:42:08.147 INFO:teuthology.orchestra.run.smithi064.stdout:Transaction Summary 2024-03-26T16:42:08.147 INFO:teuthology.orchestra.run.smithi064.stdout:========================================================================================= 2024-03-26T16:42:08.147 INFO:teuthology.orchestra.run.smithi064.stdout:Install 36 Packages 2024-03-26T16:42:08.147 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-03-26T16:42:08.147 INFO:teuthology.orchestra.run.smithi064.stdout:Total download size: 30 M 2024-03-26T16:42:08.147 INFO:teuthology.orchestra.run.smithi064.stdout:Installed size: 108 M 2024-03-26T16:42:08.147 INFO:teuthology.orchestra.run.smithi064.stdout:Downloading Packages: 2024-03-26T16:42:08.194 INFO:teuthology.orchestra.run.smithi149.stdout:(18/36): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 201 kB/s | 43 kB 00:00 2024-03-26T16:42:08.220 INFO:teuthology.orchestra.run.smithi149.stdout:(19/36): python3-requests-2.25.1-8.el9.noarch.r 223 kB/s | 125 kB 00:00 2024-03-26T16:42:08.245 INFO:teuthology.orchestra.run.smithi149.stdout:(20/36): luarocks-3.9.2-1.el9.noarch.rpm 329 kB/s | 151 kB 00:00 2024-03-26T16:42:08.337 INFO:teuthology.orchestra.run.smithi149.stdout:(21/36): python3-jaraco-8.2.1-3.el9.noarch.rpm 117 kB/s | 11 kB 00:00 2024-03-26T16:42:08.404 INFO:teuthology.orchestra.run.smithi149.stdout:(22/36): python3-cheroot-8.6.0-4.el9.noarch.rpm 821 kB/s | 172 kB 00:00 2024-03-26T16:42:08.429 INFO:teuthology.orchestra.run.smithi149.stdout:(23/36): python3-jaraco-classes-3.2.1-5.el9.noa 192 kB/s | 18 kB 00:00 2024-03-26T16:42:08.488 INFO:teuthology.orchestra.run.smithi149.stdout:(24/36): python3-jaraco-collections-3.0.0-8.el9 277 kB/s | 23 kB 00:00 2024-03-26T16:42:08.513 INFO:teuthology.orchestra.run.smithi149.stdout:(25/36): python3-jaraco-functools-3.5.0-2.el9.n 232 kB/s | 19 kB 00:00 2024-03-26T16:42:08.580 INFO:teuthology.orchestra.run.smithi149.stdout:(26/36): python3-jaraco-text-3.2.0-6.el9.noarch 214 kB/s | 20 kB 00:00 2024-03-26T16:42:08.605 INFO:teuthology.orchestra.run.smithi149.stdout:(27/36): python3-logutils-0.3.5-21.el9.noarch.r 503 kB/s | 46 kB 00:00 2024-03-26T16:42:08.630 INFO:teuthology.orchestra.run.smithi149.stdout:(28/36): python3-cherrypy-18.6.1-2.el9.noarch.r 873 kB/s | 358 kB 00:00 2024-03-26T16:42:08.655 INFO:teuthology.orchestra.run.smithi149.stdout:(29/36): python3-more-itertools-8.12.0-2.el9.no 1.0 MB/s | 79 kB 00:00 2024-03-26T16:42:08.833 INFO:teuthology.orchestra.run.smithi157.stdout:(6/6): ceph-test-19.0.0-2382.gbf9505fb.el9.x86_ 3.3 MB/s | 48 MB 00:14 2024-03-26T16:42:08.836 INFO:teuthology.orchestra.run.smithi157.stdout:-------------------------------------------------------------------------------- 2024-03-26T16:42:08.836 INFO:teuthology.orchestra.run.smithi157.stdout:Total 3.3 MB/s | 49 MB 00:14 2024-03-26T16:42:08.850 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction check 2024-03-26T16:42:08.871 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction check succeeded. 2024-03-26T16:42:08.872 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction test 2024-03-26T16:42:08.917 INFO:teuthology.orchestra.run.smithi064.stdout:(1/36): ceph-19.0.0-2382.gbf9505fb.el9.x86_64.r 28 kB/s | 6.6 kB 00:00 2024-03-26T16:42:08.948 INFO:teuthology.orchestra.run.smithi149.stdout:(30/36): python3-pecan-1.4.2-3.el9.noarch.rpm 795 kB/s | 272 kB 00:00 2024-03-26T16:42:08.973 INFO:teuthology.orchestra.run.smithi149.stdout:(31/36): python3-portend-3.1.0-2.el9.noarch.rpm 48 kB/s | 16 kB 00:00 2024-03-26T16:42:08.998 INFO:teuthology.orchestra.run.smithi149.stdout:(32/36): python3-pyOpenSSL-21.0.0-1.el9.noarch. 263 kB/s | 90 kB 00:00 2024-03-26T16:42:09.015 INFO:teuthology.orchestra.run.smithi149.stdout:(33/36): python3-tempora-5.0.0-2.el9.noarch.rpm 533 kB/s | 36 kB 00:00 2024-03-26T16:42:09.132 INFO:teuthology.orchestra.run.smithi149.stdout:(34/36): python3-webob-1.8.7-6.el9.noarch.rpm 1.4 MB/s | 230 kB 00:00 2024-03-26T16:42:09.149 INFO:teuthology.orchestra.run.smithi149.stdout:(35/36): python3-zc-lockfile-2.0-10.el9.noarch. 150 kB/s | 20 kB 00:00 2024-03-26T16:42:09.174 INFO:teuthology.orchestra.run.smithi149.stdout:(36/36): python3-werkzeug-2.0.3-3.el9.1.noarch. 2.4 MB/s | 427 kB 00:00 2024-03-26T16:42:09.177 INFO:teuthology.orchestra.run.smithi149.stdout:-------------------------------------------------------------------------------- 2024-03-26T16:42:09.177 INFO:teuthology.orchestra.run.smithi149.stdout:Total 8.9 MB/s | 30 MB 00:03 2024-03-26T16:42:09.200 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction check 2024-03-26T16:42:09.241 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction check succeeded. 2024-03-26T16:42:09.241 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction test 2024-03-26T16:42:09.270 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction test succeeded. 2024-03-26T16:42:09.270 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction 2024-03-26T16:42:09.275 INFO:teuthology.orchestra.run.smithi064.stdout:(2/36): ceph-mgr-19.0.0-2382.gbf9505fb.el9.x86_ 2.5 MB/s | 1.5 MB 00:00 2024-03-26T16:42:09.326 INFO:teuthology.orchestra.run.smithi064.stdout:(3/36): ceph-mds-19.0.0-2382.gbf9505fb.el9.x86_ 3.7 MB/s | 2.4 MB 00:00 2024-03-26T16:42:09.426 INFO:teuthology.orchestra.run.smithi064.stdout:(4/36): ceph-mgr-modules-core-19.0.0-2382.gbf95 2.4 MB/s | 248 kB 00:00 2024-03-26T16:42:09.618 INFO:teuthology.orchestra.run.smithi064.stdout:(5/36): lua-5.4.4-4.el9.x86_64.rpm 974 kB/s | 187 kB 00:00 2024-03-26T16:42:09.672 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction test succeeded. 2024-03-26T16:42:09.672 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction 2024-03-26T16:42:09.727 INFO:teuthology.orchestra.run.smithi064.stdout:(6/36): ceph-mon-19.0.0-2382.gbf9505fb.el9.x86_ 5.9 MB/s | 4.8 MB 00:00 2024-03-26T16:42:09.752 INFO:teuthology.orchestra.run.smithi064.stdout:(7/36): python3-mako-1.1.4-6.el9.noarch.rpm 1.1 MB/s | 144 kB 00:00 2024-03-26T16:42:09.794 INFO:teuthology.orchestra.run.smithi064.stdout:(8/36): python3-markupsafe-1.1.1-12.el9.x86_64. 471 kB/s | 32 kB 00:00 2024-03-26T16:42:09.819 INFO:teuthology.orchestra.run.smithi064.stdout:(9/36): python3-pytz-2021.1-5.el9.noarch.rpm 708 kB/s | 47 kB 00:00 2024-03-26T16:42:09.848 INFO:teuthology.orchestra.run.smithi157.stdout: Preparing : 1/1 2024-03-26T16:42:09.853 INFO:teuthology.orchestra.run.smithi064.stdout:(10/36): python3-toml-0.10.2-6.el9.noarch.rpm 661 kB/s | 39 kB 00:00 2024-03-26T16:42:09.895 INFO:teuthology.orchestra.run.smithi064.stdout:(11/36): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.1 MB/s | 241 kB 00:00 2024-03-26T16:42:09.925 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/6 2024-03-26T16:42:09.968 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 2/6 2024-03-26T16:42:09.998 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 3/6 2024-03-26T16:42:10.041 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : jq-1.6-16.el9.x86_64 4/6 2024-03-26T16:42:10.053 INFO:teuthology.orchestra.run.smithi064.stdout:(12/36): python3-cryptography-36.0.1-4.el9.x86_ 5.7 MB/s | 1.1 MB 00:00 2024-03-26T16:42:10.069 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : libcephsqlite-2:19.0.0-2382.gbf9505fb.el9.x86_64 5/6 2024-03-26T16:42:10.078 INFO:teuthology.orchestra.run.smithi064.stdout:(13/36): python3-ply-3.11-14.el9.noarch.rpm 561 kB/s | 103 kB 00:00 2024-03-26T16:42:10.245 INFO:teuthology.orchestra.run.smithi064.stdout:(14/36): ceph-osd-19.0.0-2382.gbf9505fb.el9.x86 17 MB/s | 17 MB 00:00 2024-03-26T16:42:10.271 INFO:teuthology.orchestra.run.smithi064.stdout:(15/36): python3-pycparser-2.20-6.el9.noarch.rp 571 kB/s | 124 kB 00:00 2024-03-26T16:42:10.296 INFO:teuthology.orchestra.run.smithi064.stdout:(16/36): python3-urllib3-1.26.5-5.el9.noarch.rp 862 kB/s | 187 kB 00:00 2024-03-26T16:42:10.446 INFO:teuthology.orchestra.run.smithi064.stdout:(17/36): lua-devel-5.4.4-4.el9.x86_64.rpm 148 kB/s | 22 kB 00:00 2024-03-26T16:42:10.547 INFO:teuthology.orchestra.run.smithi064.stdout:(18/36): python3-requests-2.25.1-8.el9.noarch.r 416 kB/s | 125 kB 00:00 2024-03-26T16:42:10.981 INFO:teuthology.orchestra.run.smithi149.stdout: Preparing : 1/1 2024-03-26T16:42:11.035 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/36 2024-03-26T16:42:11.067 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/36 2024-03-26T16:42:11.104 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/36 2024-03-26T16:42:11.173 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/36 2024-03-26T16:42:11.220 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : luarocks-3.9.2-1.el9.noarch 5/36 2024-03-26T16:42:11.252 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/36 2024-03-26T16:42:11.344 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/36 2024-03-26T16:42:11.413 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/36 2024-03-26T16:42:11.463 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 9/36 2024-03-26T16:42:11.535 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/36 2024-03-26T16:42:11.538 INFO:teuthology.orchestra.run.smithi064.stdout:(19/36): luarocks-3.9.2-1.el9.noarch.rpm 122 kB/s | 151 kB 00:01 2024-03-26T16:42:11.589 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 11/36 2024-03-26T16:42:11.636 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 12/36 2024-03-26T16:42:11.647 INFO:teuthology.orchestra.run.smithi064.stdout:(20/36): python3-cherrypy-18.6.1-2.el9.noarch.r 3.2 MB/s | 358 kB 00:00 2024-03-26T16:42:11.684 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-ply-3.11-14.el9.noarch 13/36 2024-03-26T16:42:11.697 INFO:teuthology.orchestra.run.smithi064.stdout:(21/36): python3-jaraco-8.2.1-3.el9.noarch.rpm 214 kB/s | 11 kB 00:00 2024-03-26T16:42:11.731 INFO:teuthology.orchestra.run.smithi064.stdout:(22/36): python3-cheroot-8.6.0-4.el9.noarch.rpm 145 kB/s | 172 kB 00:01 2024-03-26T16:42:11.740 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 14/36 2024-03-26T16:42:11.748 INFO:teuthology.orchestra.run.smithi064.stdout:(23/36): python3-jaraco-classes-3.2.1-5.el9.noa 351 kB/s | 18 kB 00:00 2024-03-26T16:42:11.781 INFO:teuthology.orchestra.run.smithi064.stdout:(24/36): python3-jaraco-collections-3.0.0-8.el9 461 kB/s | 23 kB 00:00 2024-03-26T16:42:11.798 INFO:teuthology.orchestra.run.smithi064.stdout:(25/36): python3-jaraco-functools-3.5.0-2.el9.n 388 kB/s | 19 kB 00:00 2024-03-26T16:42:11.832 INFO:teuthology.orchestra.run.smithi064.stdout:(26/36): python3-jaraco-text-3.2.0-6.el9.noarch 391 kB/s | 20 kB 00:00 2024-03-26T16:42:11.849 INFO:teuthology.orchestra.run.smithi064.stdout:(27/36): python3-logutils-0.3.5-21.el9.noarch.r 924 kB/s | 46 kB 00:00 2024-03-26T16:42:11.882 INFO:teuthology.orchestra.run.smithi064.stdout:(28/36): python3-more-itertools-8.12.0-2.el9.no 1.5 MB/s | 79 kB 00:00 2024-03-26T16:42:11.924 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 15/36 2024-03-26T16:42:11.941 INFO:teuthology.orchestra.run.smithi064.stdout:(29/36): python3-pecan-1.4.2-3.el9.noarch.rpm 2.9 MB/s | 272 kB 00:00 2024-03-26T16:42:11.966 INFO:teuthology.orchestra.run.smithi064.stdout:(30/36): python3-portend-3.1.0-2.el9.noarch.rpm 196 kB/s | 16 kB 00:00 2024-03-26T16:42:11.974 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 16/36 2024-03-26T16:42:12.000 INFO:teuthology.orchestra.run.smithi064.stdout:(31/36): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.5 MB/s | 90 kB 00:00 2024-03-26T16:42:12.011 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 17/36 2024-03-26T16:42:12.025 INFO:teuthology.orchestra.run.smithi064.stdout:(32/36): python3-tempora-5.0.0-2.el9.noarch.rpm 610 kB/s | 36 kB 00:00 2024-03-26T16:42:12.047 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 18/36 2024-03-26T16:42:12.067 INFO:teuthology.orchestra.run.smithi064.stdout:(33/36): python3-webob-1.8.7-6.el9.noarch.rpm 3.4 MB/s | 230 kB 00:00 2024-03-26T16:42:12.077 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 19/36 2024-03-26T16:42:12.134 INFO:teuthology.orchestra.run.smithi064.stdout:(34/36): python3-zc-lockfile-2.0-10.el9.noarch. 300 kB/s | 20 kB 00:00 2024-03-26T16:42:12.153 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 20/36 2024-03-26T16:42:12.159 INFO:teuthology.orchestra.run.smithi064.stdout:(35/36): python3-werkzeug-2.0.3-3.el9.1.noarch. 3.1 MB/s | 427 kB 00:00 2024-03-26T16:42:12.188 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 21/36 2024-03-26T16:42:12.221 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 22/36 2024-03-26T16:42:12.252 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 23/36 2024-03-26T16:42:12.288 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 24/36 2024-03-26T16:42:12.323 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 25/36 2024-03-26T16:42:12.411 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 26/36 2024-03-26T16:42:12.453 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 27/36 2024-03-26T16:42:12.526 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 28/36 2024-03-26T16:42:12.662 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 29/36 2024-03-26T16:42:12.788 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 30/36 2024-03-26T16:42:12.947 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-2382.gbf9505fb.el9. 31/36 2024-03-26T16:42:12.975 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-mgr-2:19.0.0-2382.gbf9505fb.el9.x86_64 32/36 2024-03-26T16:42:13.001 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-mgr-2:19.0.0-2382.gbf9505fb.el9.x86_64 32/36 2024-03-26T16:42:13.001 INFO:teuthology.orchestra.run.smithi149.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-26T16:42:13.001 INFO:teuthology.orchestra.run.smithi149.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-03-26T16:42:13.001 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-26T16:42:13.001 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-26T16:42:13.001 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-03-26T16:42:14.434 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-osd-2:19.0.0-2382.gbf9505fb.el9.x86_64 33/36 2024-03-26T16:42:14.461 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-osd-2:19.0.0-2382.gbf9505fb.el9.x86_64 33/36 2024-03-26T16:42:14.462 INFO:teuthology.orchestra.run.smithi149.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-26T16:42:14.462 INFO:teuthology.orchestra.run.smithi149.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-03-26T16:42:14.462 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-26T16:42:14.462 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-26T16:42:14.462 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-03-26T16:42:14.623 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: libcephsqlite-2:19.0.0-2382.gbf9505fb.el9.x86_64 5/6 2024-03-26T16:42:14.701 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-test-2:19.0.0-2382.gbf9505fb.el9.x86_64 6/6 2024-03-26T16:42:14.919 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-mon-2:19.0.0-2382.gbf9505fb.el9.x86_64 34/36 2024-03-26T16:42:14.942 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-mon-2:19.0.0-2382.gbf9505fb.el9.x86_64 34/36 2024-03-26T16:42:14.942 INFO:teuthology.orchestra.run.smithi149.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-26T16:42:14.942 INFO:teuthology.orchestra.run.smithi149.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-03-26T16:42:14.942 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-26T16:42:14.942 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-26T16:42:14.942 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-03-26T16:42:15.169 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-mds-2:19.0.0-2382.gbf9505fb.el9.x86_64 35/36 2024-03-26T16:42:15.192 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-mds-2:19.0.0-2382.gbf9505fb.el9.x86_64 35/36 2024-03-26T16:42:15.192 INFO:teuthology.orchestra.run.smithi149.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-26T16:42:15.193 INFO:teuthology.orchestra.run.smithi149.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-03-26T16:42:15.193 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-26T16:42:15.193 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-26T16:42:15.193 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-03-26T16:42:15.258 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-2:19.0.0-2382.gbf9505fb.el9.x86_64 36/36 2024-03-26T16:42:16.979 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-2:19.0.0-2382.gbf9505fb.el9.x86_64 36/36 2024-03-26T16:42:16.979 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-2:19.0.0-2382.gbf9505fb.el9.x86_64 1/36 2024-03-26T16:42:16.979 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-mds-2:19.0.0-2382.gbf9505fb.el9.x86_64 2/36 2024-03-26T16:42:16.979 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-mgr-2:19.0.0-2382.gbf9505fb.el9.x86_64 3/36 2024-03-26T16:42:16.979 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-mon-2:19.0.0-2382.gbf9505fb.el9.x86_64 4/36 2024-03-26T16:42:16.979 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-osd-2:19.0.0-2382.gbf9505fb.el9.x86_64 5/36 2024-03-26T16:42:16.979 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-2382.gbf9505fb.el9. 6/36 2024-03-26T16:42:16.979 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : lua-5.4.4-4.el9.x86_64 7/36 2024-03-26T16:42:16.979 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 8/36 2024-03-26T16:42:16.979 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 9/36 2024-03-26T16:42:16.980 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 10/36 2024-03-26T16:42:16.980 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 11/36 2024-03-26T16:42:16.980 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 12/36 2024-03-26T16:42:16.980 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 13/36 2024-03-26T16:42:16.980 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-ply-3.11-14.el9.noarch 14/36 2024-03-26T16:42:16.980 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 15/36 2024-03-26T16:42:16.980 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 16/36 2024-03-26T16:42:16.980 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 17/36 2024-03-26T16:42:16.980 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 18/36 2024-03-26T16:42:16.980 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 19/36 2024-03-26T16:42:16.981 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 20/36 2024-03-26T16:42:16.981 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 21/36 2024-03-26T16:42:16.981 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 22/36 2024-03-26T16:42:16.981 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 23/36 2024-03-26T16:42:16.981 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 24/36 2024-03-26T16:42:16.981 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 25/36 2024-03-26T16:42:16.981 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 26/36 2024-03-26T16:42:16.981 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 27/36 2024-03-26T16:42:16.981 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 28/36 2024-03-26T16:42:16.981 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 29/36 2024-03-26T16:42:16.981 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 30/36 2024-03-26T16:42:16.981 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 31/36 2024-03-26T16:42:16.981 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 32/36 2024-03-26T16:42:16.981 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 33/36 2024-03-26T16:42:16.982 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 34/36 2024-03-26T16:42:16.982 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 35/36 2024-03-26T16:42:17.023 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-test-2:19.0.0-2382.gbf9505fb.el9.x86_64 6/6 2024-03-26T16:42:17.024 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-test-2:19.0.0-2382.gbf9505fb.el9.x86_64 1/6 2024-03-26T16:42:17.024 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : libcephsqlite-2:19.0.0-2382.gbf9505fb.el9.x86_64 2/6 2024-03-26T16:42:17.024 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 3/6 2024-03-26T16:42:17.024 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 4/6 2024-03-26T16:42:17.024 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 5/6 2024-03-26T16:42:17.408 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : jq-1.6-16.el9.x86_64 6/6 2024-03-26T16:42:17.408 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-03-26T16:42:17.408 INFO:teuthology.orchestra.run.smithi157.stdout:Installed: 2024-03-26T16:42:17.408 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-test-2:19.0.0-2382.gbf9505fb.el9.x86_64 2024-03-26T16:42:17.408 INFO:teuthology.orchestra.run.smithi157.stdout: jq-1.6-16.el9.x86_64 2024-03-26T16:42:17.408 INFO:teuthology.orchestra.run.smithi157.stdout: libcephsqlite-2:19.0.0-2382.gbf9505fb.el9.x86_64 2024-03-26T16:42:17.408 INFO:teuthology.orchestra.run.smithi157.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-03-26T16:42:17.408 INFO:teuthology.orchestra.run.smithi157.stdout: socat-1.7.4.1-5.el9.x86_64 2024-03-26T16:42:17.408 INFO:teuthology.orchestra.run.smithi157.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-03-26T16:42:17.408 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-03-26T16:42:17.408 INFO:teuthology.orchestra.run.smithi157.stdout:Complete! 2024-03-26T16:42:17.742 DEBUG:teuthology.orchestra.run.smithi157:> sudo yum -y install ceph 2024-03-26T16:42:17.772 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 36/36 2024-03-26T16:42:17.772 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-03-26T16:42:17.772 INFO:teuthology.orchestra.run.smithi149.stdout:Installed: 2024-03-26T16:42:17.772 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-2:19.0.0-2382.gbf9505fb.el9.x86_64 2024-03-26T16:42:17.772 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mds-2:19.0.0-2382.gbf9505fb.el9.x86_64 2024-03-26T16:42:17.773 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-2:19.0.0-2382.gbf9505fb.el9.x86_64 2024-03-26T16:42:17.773 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-modules-core-2:19.0.0-2382.gbf9505fb.el9.noarch 2024-03-26T16:42:17.773 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mon-2:19.0.0-2382.gbf9505fb.el9.x86_64 2024-03-26T16:42:17.773 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-osd-2:19.0.0-2382.gbf9505fb.el9.x86_64 2024-03-26T16:42:17.773 INFO:teuthology.orchestra.run.smithi149.stdout: lua-5.4.4-4.el9.x86_64 2024-03-26T16:42:17.773 INFO:teuthology.orchestra.run.smithi149.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-03-26T16:42:17.773 INFO:teuthology.orchestra.run.smithi149.stdout: luarocks-3.9.2-1.el9.noarch 2024-03-26T16:42:17.773 INFO:teuthology.orchestra.run.smithi149.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-03-26T16:42:17.774 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-03-26T16:42:17.774 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-03-26T16:42:17.774 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-03-26T16:42:17.774 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-03-26T16:42:17.774 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-03-26T16:42:17.774 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-03-26T16:42:17.775 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-03-26T16:42:17.775 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-03-26T16:42:17.775 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-03-26T16:42:17.775 INFO:teuthology.orchestra.run.smithi149.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-03-26T16:42:17.775 INFO:teuthology.orchestra.run.smithi149.stdout: python3-mako-1.1.4-6.el9.noarch 2024-03-26T16:42:17.775 INFO:teuthology.orchestra.run.smithi149.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-03-26T16:42:17.776 INFO:teuthology.orchestra.run.smithi149.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-03-26T16:42:17.776 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-03-26T16:42:17.776 INFO:teuthology.orchestra.run.smithi149.stdout: python3-ply-3.11-14.el9.noarch 2024-03-26T16:42:17.776 INFO:teuthology.orchestra.run.smithi149.stdout: python3-portend-3.1.0-2.el9.noarch 2024-03-26T16:42:17.776 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-03-26T16:42:17.776 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pycparser-2.20-6.el9.noarch 2024-03-26T16:42:17.776 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pytz-2021.1-5.el9.noarch 2024-03-26T16:42:17.776 INFO:teuthology.orchestra.run.smithi149.stdout: python3-requests-2.25.1-8.el9.noarch 2024-03-26T16:42:17.776 INFO:teuthology.orchestra.run.smithi149.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-03-26T16:42:17.776 INFO:teuthology.orchestra.run.smithi149.stdout: python3-toml-0.10.2-6.el9.noarch 2024-03-26T16:42:17.776 INFO:teuthology.orchestra.run.smithi149.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-03-26T16:42:17.776 INFO:teuthology.orchestra.run.smithi149.stdout: python3-webob-1.8.7-6.el9.noarch 2024-03-26T16:42:17.776 INFO:teuthology.orchestra.run.smithi149.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-03-26T16:42:17.776 INFO:teuthology.orchestra.run.smithi149.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-03-26T16:42:17.777 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-03-26T16:42:17.777 INFO:teuthology.orchestra.run.smithi149.stdout:Complete! 2024-03-26T16:42:18.147 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum -y install ceph-base 2024-03-26T16:42:18.305 INFO:teuthology.orchestra.run.smithi157.stdout:Last metadata expiration check: 0:00:55 ago on Tue 26 Mar 2024 04:41:23 PM UTC. 2024-03-26T16:42:18.459 INFO:teuthology.orchestra.run.smithi157.stdout:Dependencies resolved. 2024-03-26T16:42:18.461 INFO:teuthology.orchestra.run.smithi157.stdout:========================================================================================= 2024-03-26T16:42:18.461 INFO:teuthology.orchestra.run.smithi157.stdout: Package Arch Version Repository Size 2024-03-26T16:42:18.461 INFO:teuthology.orchestra.run.smithi157.stdout:========================================================================================= 2024-03-26T16:42:18.461 INFO:teuthology.orchestra.run.smithi157.stdout:Installing: 2024-03-26T16:42:18.462 INFO:teuthology.orchestra.run.smithi157.stdout: ceph x86_64 2:19.0.0-2382.gbf9505fb.el9 ceph 6.6 k 2024-03-26T16:42:18.462 INFO:teuthology.orchestra.run.smithi157.stdout:Installing dependencies: 2024-03-26T16:42:18.462 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mds x86_64 2:19.0.0-2382.gbf9505fb.el9 ceph 2.4 M 2024-03-26T16:42:18.462 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr x86_64 2:19.0.0-2382.gbf9505fb.el9 ceph 1.5 M 2024-03-26T16:42:18.462 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr-modules-core noarch 2:19.0.0-2382.gbf9505fb.el9 ceph-noarch 248 k 2024-03-26T16:42:18.462 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mon x86_64 2:19.0.0-2382.gbf9505fb.el9 ceph 4.8 M 2024-03-26T16:42:18.462 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-osd x86_64 2:19.0.0-2382.gbf9505fb.el9 ceph 17 M 2024-03-26T16:42:18.462 INFO:teuthology.orchestra.run.smithi157.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2024-03-26T16:42:18.462 INFO:teuthology.orchestra.run.smithi157.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-03-26T16:42:18.462 INFO:teuthology.orchestra.run.smithi157.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-03-26T16:42:18.462 INFO:teuthology.orchestra.run.smithi157.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-03-26T16:42:18.462 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2024-03-26T16:42:18.462 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-03-26T16:42:18.463 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-03-26T16:42:18.463 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2024-03-26T16:42:18.463 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-03-26T16:42:18.463 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-03-26T16:42:18.463 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-03-26T16:42:18.463 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-03-26T16:42:18.463 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-03-26T16:42:18.463 INFO:teuthology.orchestra.run.smithi157.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-03-26T16:42:18.463 INFO:teuthology.orchestra.run.smithi157.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2024-03-26T16:42:18.463 INFO:teuthology.orchestra.run.smithi157.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2024-03-26T16:42:18.463 INFO:teuthology.orchestra.run.smithi157.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-03-26T16:42:18.463 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-03-26T16:42:18.463 INFO:teuthology.orchestra.run.smithi157.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2024-03-26T16:42:18.463 INFO:teuthology.orchestra.run.smithi157.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-03-26T16:42:18.464 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-03-26T16:42:18.464 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2024-03-26T16:42:18.464 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2024-03-26T16:42:18.464 INFO:teuthology.orchestra.run.smithi157.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-03-26T16:42:18.464 INFO:teuthology.orchestra.run.smithi157.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-03-26T16:42:18.464 INFO:teuthology.orchestra.run.smithi157.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2024-03-26T16:42:18.464 INFO:teuthology.orchestra.run.smithi157.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2024-03-26T16:42:18.464 INFO:teuthology.orchestra.run.smithi157.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-03-26T16:42:18.464 INFO:teuthology.orchestra.run.smithi157.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-03-26T16:42:18.464 INFO:teuthology.orchestra.run.smithi157.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-03-26T16:42:18.464 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-03-26T16:42:18.464 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction Summary 2024-03-26T16:42:18.464 INFO:teuthology.orchestra.run.smithi157.stdout:========================================================================================= 2024-03-26T16:42:18.464 INFO:teuthology.orchestra.run.smithi157.stdout:Install 36 Packages 2024-03-26T16:42:18.464 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-03-26T16:42:18.465 INFO:teuthology.orchestra.run.smithi157.stdout:Total download size: 30 M 2024-03-26T16:42:18.465 INFO:teuthology.orchestra.run.smithi157.stdout:Installed size: 108 M 2024-03-26T16:42:18.465 INFO:teuthology.orchestra.run.smithi157.stdout:Downloading Packages: 2024-03-26T16:42:18.725 INFO:teuthology.orchestra.run.smithi149.stdout:Last metadata expiration check: 0:00:56 ago on Tue 26 Mar 2024 04:41:22 PM UTC. 2024-03-26T16:42:18.822 INFO:teuthology.orchestra.run.smithi149.stdout:Package ceph-base-2:19.0.0-2382.gbf9505fb.el9.x86_64 is already installed. 2024-03-26T16:42:18.873 INFO:teuthology.orchestra.run.smithi149.stdout:Dependencies resolved. 2024-03-26T16:42:18.874 INFO:teuthology.orchestra.run.smithi149.stdout:Nothing to do. 2024-03-26T16:42:18.875 INFO:teuthology.orchestra.run.smithi149.stdout:Complete! 2024-03-26T16:42:18.943 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum -y install cephadm 2024-03-26T16:42:19.227 INFO:teuthology.orchestra.run.smithi157.stdout:(1/36): ceph-19.0.0-2382.gbf9505fb.el9.x86_64.r 31 kB/s | 6.6 kB 00:00 2024-03-26T16:42:19.361 INFO:teuthology.orchestra.run.smithi157.stdout:(2/36): ceph-mgr-19.0.0-2382.gbf9505fb.el9.x86_ 4.4 MB/s | 1.5 MB 00:00 2024-03-26T16:42:19.514 INFO:teuthology.orchestra.run.smithi149.stdout:Last metadata expiration check: 0:00:57 ago on Tue 26 Mar 2024 04:41:22 PM UTC. 2024-03-26T16:42:19.663 INFO:teuthology.orchestra.run.smithi149.stdout:Dependencies resolved. 2024-03-26T16:42:19.664 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-03-26T16:42:19.664 INFO:teuthology.orchestra.run.smithi149.stdout: Package Arch Version Repository Size 2024-03-26T16:42:19.664 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-03-26T16:42:19.664 INFO:teuthology.orchestra.run.smithi149.stdout:Installing: 2024-03-26T16:42:19.664 INFO:teuthology.orchestra.run.smithi149.stdout: cephadm noarch 2:19.0.0-2382.gbf9505fb.el9 ceph-noarch 750 k 2024-03-26T16:42:19.664 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-03-26T16:42:19.664 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction Summary 2024-03-26T16:42:19.664 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-03-26T16:42:19.664 INFO:teuthology.orchestra.run.smithi149.stdout:Install 1 Package 2024-03-26T16:42:19.665 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-03-26T16:42:19.665 INFO:teuthology.orchestra.run.smithi149.stdout:Total download size: 750 k 2024-03-26T16:42:19.665 INFO:teuthology.orchestra.run.smithi149.stdout:Installed size: 756 k 2024-03-26T16:42:19.665 INFO:teuthology.orchestra.run.smithi149.stdout:Downloading Packages: 2024-03-26T16:42:20.194 INFO:teuthology.orchestra.run.smithi157.stdout:(3/36): ceph-osd-19.0.0-2382.gbf9505fb.el9.x86_ 20 MB/s | 17 MB 00:00 2024-03-26T16:42:20.244 INFO:teuthology.orchestra.run.smithi157.stdout:(4/36): ceph-mgr-modules-core-19.0.0-2382.gbf95 4.9 MB/s | 248 kB 00:00 2024-03-26T16:42:20.578 INFO:teuthology.orchestra.run.smithi157.stdout:(5/36): ceph-mds-19.0.0-2382.gbf9505fb.el9.x86_ 1.5 MB/s | 2.4 MB 00:01 2024-03-26T16:42:20.603 INFO:teuthology.orchestra.run.smithi157.stdout:(6/36): lua-5.4.4-4.el9.x86_64.rpm 520 kB/s | 187 kB 00:00 2024-03-26T16:42:20.670 INFO:teuthology.orchestra.run.smithi157.stdout:(7/36): python3-mako-1.1.4-6.el9.noarch.rpm 1.5 MB/s | 144 kB 00:00 2024-03-26T16:42:20.688 INFO:teuthology.orchestra.run.smithi149.stdout:cephadm-19.0.0-2382.gbf9505fb.el9.noarch.rpm 733 kB/s | 750 kB 00:01 2024-03-26T16:42:20.689 INFO:teuthology.orchestra.run.smithi149.stdout:-------------------------------------------------------------------------------- 2024-03-26T16:42:20.689 INFO:teuthology.orchestra.run.smithi149.stdout:Total 731 kB/s | 750 kB 00:01 2024-03-26T16:42:20.690 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction check 2024-03-26T16:42:20.695 INFO:teuthology.orchestra.run.smithi157.stdout:(8/36): python3-markupsafe-1.1.1-12.el9.x86_64. 343 kB/s | 32 kB 00:00 2024-03-26T16:42:20.696 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction check succeeded. 2024-03-26T16:42:20.696 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction test 2024-03-26T16:42:20.701 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction test succeeded. 2024-03-26T16:42:20.702 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction 2024-03-26T16:42:20.737 INFO:teuthology.orchestra.run.smithi157.stdout:(9/36): python3-pytz-2021.1-5.el9.noarch.rpm 708 kB/s | 47 kB 00:00 2024-03-26T16:42:20.762 INFO:teuthology.orchestra.run.smithi157.stdout:(10/36): python3-toml-0.10.2-6.el9.noarch.rpm 578 kB/s | 39 kB 00:00 2024-03-26T16:42:20.776 INFO:teuthology.orchestra.run.smithi149.stdout: Preparing : 1/1 2024-03-26T16:42:20.838 INFO:teuthology.orchestra.run.smithi157.stdout:(11/36): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.3 MB/s | 241 kB 00:00 2024-03-26T16:42:20.963 INFO:teuthology.orchestra.run.smithi157.stdout:(12/36): python3-cryptography-36.0.1-4.el9.x86_ 5.7 MB/s | 1.1 MB 00:00 2024-03-26T16:42:20.997 INFO:teuthology.orchestra.run.smithi157.stdout:(13/36): python3-ply-3.11-14.el9.noarch.rpm 650 kB/s | 103 kB 00:00 2024-03-26T16:42:21.030 INFO:teuthology.orchestra.run.smithi157.stdout:(14/36): python3-pycparser-2.20-6.el9.noarch.rp 1.8 MB/s | 124 kB 00:00 2024-03-26T16:42:21.089 INFO:teuthology.orchestra.run.smithi157.stdout:(15/36): python3-urllib3-1.26.5-5.el9.noarch.rp 2.0 MB/s | 187 kB 00:00 2024-03-26T16:42:21.225 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: cephadm-2:19.0.0-2382.gbf9505fb.el9.noarch 1/1 2024-03-26T16:42:21.289 INFO:teuthology.orchestra.run.smithi157.stdout:(16/36): python3-requests-2.25.1-8.el9.noarch.r 483 kB/s | 125 kB 00:00 2024-03-26T16:42:21.312 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : cephadm-2:19.0.0-2382.gbf9505fb.el9.noarch 1/1 2024-03-26T16:42:21.323 INFO:teuthology.orchestra.run.smithi157.stdout:(17/36): lua-devel-5.4.4-4.el9.x86_64.rpm 95 kB/s | 22 kB 00:00 2024-03-26T16:42:21.607 INFO:teuthology.orchestra.run.smithi157.stdout:(18/36): ceph-mon-19.0.0-2382.gbf9505fb.el9.x86 2.0 MB/s | 4.8 MB 00:02 2024-03-26T16:42:21.640 INFO:teuthology.orchestra.run.smithi157.stdout:(19/36): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 137 kB/s | 43 kB 00:00 2024-03-26T16:42:21.682 INFO:teuthology.orchestra.run.smithi157.stdout:(20/36): luarocks-3.9.2-1.el9.noarch.rpm 385 kB/s | 151 kB 00:00 2024-03-26T16:42:21.698 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: cephadm-2:19.0.0-2382.gbf9505fb.el9.noarch 1/1 2024-03-26T16:42:21.791 INFO:teuthology.orchestra.run.smithi157.stdout:(21/36): python3-jaraco-8.2.1-3.el9.noarch.rpm 99 kB/s | 11 kB 00:00 2024-03-26T16:42:21.891 INFO:teuthology.orchestra.run.smithi157.stdout:(22/36): python3-jaraco-classes-3.2.1-5.el9.noa 177 kB/s | 18 kB 00:00 2024-03-26T16:42:21.950 INFO:teuthology.orchestra.run.smithi157.stdout:(23/36): python3-cherrypy-18.6.1-2.el9.noarch.r 1.1 MB/s | 358 kB 00:00 2024-03-26T16:42:21.970 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : cephadm-2:19.0.0-2382.gbf9505fb.el9.noarch 1/1 2024-03-26T16:42:21.970 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-03-26T16:42:21.971 INFO:teuthology.orchestra.run.smithi149.stdout:Installed: 2024-03-26T16:42:21.971 INFO:teuthology.orchestra.run.smithi149.stdout: cephadm-2:19.0.0-2382.gbf9505fb.el9.noarch 2024-03-26T16:42:21.971 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-03-26T16:42:21.971 INFO:teuthology.orchestra.run.smithi149.stdout:Complete! 2024-03-26T16:42:21.986 INFO:teuthology.orchestra.run.smithi157.stdout:(24/36): python3-jaraco-collections-3.0.0-8.el9 252 kB/s | 23 kB 00:00 2024-03-26T16:42:22.042 INFO:teuthology.orchestra.run.smithi157.stdout:(25/36): python3-jaraco-functools-3.5.0-2.el9.n 211 kB/s | 19 kB 00:00 2024-03-26T16:42:22.067 INFO:teuthology.orchestra.run.smithi157.stdout:(26/36): python3-cheroot-8.6.0-4.el9.noarch.rpm 373 kB/s | 172 kB 00:00 2024-03-26T16:42:22.092 INFO:teuthology.orchestra.run.smithi157.stdout:(27/36): python3-jaraco-text-3.2.0-6.el9.noarch 181 kB/s | 20 kB 00:00 2024-03-26T16:42:22.134 INFO:teuthology.orchestra.run.smithi157.stdout:(28/36): python3-logutils-0.3.5-21.el9.noarch.r 502 kB/s | 46 kB 00:00 2024-03-26T16:42:22.142 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum -y install ceph-immutable-object-cache 2024-03-26T16:42:22.159 INFO:teuthology.orchestra.run.smithi157.stdout:(29/36): python3-more-itertools-8.12.0-2.el9.no 855 kB/s | 79 kB 00:00 2024-03-26T16:42:22.226 INFO:teuthology.orchestra.run.smithi157.stdout:(30/36): python3-portend-3.1.0-2.el9.noarch.rpm 179 kB/s | 16 kB 00:00 2024-03-26T16:42:22.243 INFO:teuthology.orchestra.run.smithi157.stdout:(31/36): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.1 MB/s | 90 kB 00:00 2024-03-26T16:42:22.268 INFO:teuthology.orchestra.run.smithi157.stdout:(32/36): python3-pecan-1.4.2-3.el9.noarch.rpm 1.5 MB/s | 272 kB 00:00 2024-03-26T16:42:22.310 INFO:teuthology.orchestra.run.smithi157.stdout:(33/36): python3-tempora-5.0.0-2.el9.noarch.rpm 427 kB/s | 36 kB 00:00 2024-03-26T16:42:22.369 INFO:teuthology.orchestra.run.smithi157.stdout:(34/36): python3-werkzeug-2.0.3-3.el9.1.noarch. 4.2 MB/s | 427 kB 00:00 2024-03-26T16:42:22.402 INFO:teuthology.orchestra.run.smithi157.stdout:(35/36): python3-zc-lockfile-2.0-10.el9.noarch. 217 kB/s | 20 kB 00:00 2024-03-26T16:42:22.427 INFO:teuthology.orchestra.run.smithi157.stdout:(36/36): python3-webob-1.8.7-6.el9.noarch.rpm 1.2 MB/s | 230 kB 00:00 2024-03-26T16:42:22.430 INFO:teuthology.orchestra.run.smithi157.stdout:-------------------------------------------------------------------------------- 2024-03-26T16:42:22.430 INFO:teuthology.orchestra.run.smithi157.stdout:Total 7.6 MB/s | 30 MB 00:03 2024-03-26T16:42:22.455 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction check 2024-03-26T16:42:22.497 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction check succeeded. 2024-03-26T16:42:22.497 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction test 2024-03-26T16:42:22.722 INFO:teuthology.orchestra.run.smithi149.stdout:Last metadata expiration check: 0:01:00 ago on Tue 26 Mar 2024 04:41:22 PM UTC. 2024-03-26T16:42:22.877 INFO:teuthology.orchestra.run.smithi149.stdout:Dependencies resolved. 2024-03-26T16:42:22.878 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-03-26T16:42:22.878 INFO:teuthology.orchestra.run.smithi149.stdout: Package Arch Version Repo Size 2024-03-26T16:42:22.878 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-03-26T16:42:22.878 INFO:teuthology.orchestra.run.smithi149.stdout:Installing: 2024-03-26T16:42:22.878 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-2382.gbf9505fb.el9 ceph 145 k 2024-03-26T16:42:22.878 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-03-26T16:42:22.878 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction Summary 2024-03-26T16:42:22.878 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-03-26T16:42:22.878 INFO:teuthology.orchestra.run.smithi149.stdout:Install 1 Package 2024-03-26T16:42:22.878 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-03-26T16:42:22.879 INFO:teuthology.orchestra.run.smithi149.stdout:Total download size: 145 k 2024-03-26T16:42:22.879 INFO:teuthology.orchestra.run.smithi149.stdout:Installed size: 435 k 2024-03-26T16:42:22.879 INFO:teuthology.orchestra.run.smithi149.stdout:Downloading Packages: 2024-03-26T16:42:22.903 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction test succeeded. 2024-03-26T16:42:22.904 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction 2024-03-26T16:42:23.228 INFO:teuthology.orchestra.run.smithi149.stdout:ceph-immutable-object-cache-19.0.0-2382.gbf9505 414 kB/s | 145 kB 00:00 2024-03-26T16:42:23.229 INFO:teuthology.orchestra.run.smithi149.stdout:-------------------------------------------------------------------------------- 2024-03-26T16:42:23.229 INFO:teuthology.orchestra.run.smithi149.stdout:Total 412 kB/s | 145 kB 00:00 2024-03-26T16:42:23.229 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction check 2024-03-26T16:42:23.237 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction check succeeded. 2024-03-26T16:42:23.237 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction test 2024-03-26T16:42:23.290 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction test succeeded. 2024-03-26T16:42:23.290 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction 2024-03-26T16:42:23.428 INFO:teuthology.orchestra.run.smithi149.stdout: Preparing : 1/1 2024-03-26T16:42:23.488 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-2382.gbf9505fb. 1/1 2024-03-26T16:42:23.513 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-2382.gbf9505fb. 1/1 2024-03-26T16:42:23.513 INFO:teuthology.orchestra.run.smithi149.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-26T16:42:23.513 INFO:teuthology.orchestra.run.smithi149.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-03-26T16:42:23.513 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-03-26T16:42:24.263 INFO:teuthology.orchestra.run.smithi157.stdout: Preparing : 1/1 2024-03-26T16:42:24.330 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/36 2024-03-26T16:42:24.363 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/36 2024-03-26T16:42:24.391 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/36 2024-03-26T16:42:24.462 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/36 2024-03-26T16:42:24.532 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-2382.gbf9505fb. 1/1 2024-03-26T16:42:24.532 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-03-26T16:42:24.532 INFO:teuthology.orchestra.run.smithi149.stdout:Installed: 2024-03-26T16:42:24.532 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-immutable-object-cache-2:19.0.0-2382.gbf9505fb.el9.x86_64 2024-03-26T16:42:24.532 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-03-26T16:42:24.532 INFO:teuthology.orchestra.run.smithi149.stdout:Complete! 2024-03-26T16:42:24.540 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : luarocks-3.9.2-1.el9.noarch 5/36 2024-03-26T16:42:24.573 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/36 2024-03-26T16:42:24.656 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/36 2024-03-26T16:42:24.734 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/36 2024-03-26T16:42:24.775 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 9/36 2024-03-26T16:42:24.816 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum -y install ceph-mgr 2024-03-26T16:42:24.847 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/36 2024-03-26T16:42:24.917 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 11/36 2024-03-26T16:42:24.956 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 12/36 2024-03-26T16:42:25.004 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-ply-3.11-14.el9.noarch 13/36 2024-03-26T16:42:25.060 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 14/36 2024-03-26T16:42:25.245 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 15/36 2024-03-26T16:42:25.302 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 16/36 2024-03-26T16:42:25.347 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 17/36 2024-03-26T16:42:25.383 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 18/36 2024-03-26T16:42:25.397 INFO:teuthology.orchestra.run.smithi149.stdout:Last metadata expiration check: 0:01:03 ago on Tue 26 Mar 2024 04:41:22 PM UTC. 2024-03-26T16:42:25.413 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 19/36 2024-03-26T16:42:25.489 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 20/36 2024-03-26T16:42:25.497 INFO:teuthology.orchestra.run.smithi149.stdout:Package ceph-mgr-2:19.0.0-2382.gbf9505fb.el9.x86_64 is already installed. 2024-03-26T16:42:25.524 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 21/36 2024-03-26T16:42:25.549 INFO:teuthology.orchestra.run.smithi149.stdout:Dependencies resolved. 2024-03-26T16:42:25.549 INFO:teuthology.orchestra.run.smithi149.stdout:Nothing to do. 2024-03-26T16:42:25.550 INFO:teuthology.orchestra.run.smithi149.stdout:Complete! 2024-03-26T16:42:25.557 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 22/36 2024-03-26T16:42:25.589 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 23/36 2024-03-26T16:42:25.614 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum -y install ceph-mgr-dashboard 2024-03-26T16:42:25.624 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 24/36 2024-03-26T16:42:25.658 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 25/36 2024-03-26T16:42:25.748 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 26/36 2024-03-26T16:42:25.790 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 27/36 2024-03-26T16:42:25.861 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 28/36 2024-03-26T16:42:25.999 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 29/36 2024-03-26T16:42:26.124 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 30/36 2024-03-26T16:42:26.192 INFO:teuthology.orchestra.run.smithi149.stdout:Last metadata expiration check: 0:01:04 ago on Tue 26 Mar 2024 04:41:22 PM UTC. 2024-03-26T16:42:26.290 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-2382.gbf9505fb.el9. 31/36 2024-03-26T16:42:26.319 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-mgr-2:19.0.0-2382.gbf9505fb.el9.x86_64 32/36 2024-03-26T16:42:26.344 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-mgr-2:19.0.0-2382.gbf9505fb.el9.x86_64 32/36 2024-03-26T16:42:26.344 INFO:teuthology.orchestra.run.smithi157.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-26T16:42:26.344 INFO:teuthology.orchestra.run.smithi157.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-03-26T16:42:26.344 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-26T16:42:26.344 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-26T16:42:26.345 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-03-26T16:42:26.346 INFO:teuthology.orchestra.run.smithi149.stdout:Dependencies resolved. 2024-03-26T16:42:26.347 INFO:teuthology.orchestra.run.smithi149.stdout:====================================================================================== 2024-03-26T16:42:26.347 INFO:teuthology.orchestra.run.smithi149.stdout: Package Arch Version Repository Size 2024-03-26T16:42:26.348 INFO:teuthology.orchestra.run.smithi149.stdout:====================================================================================== 2024-03-26T16:42:26.348 INFO:teuthology.orchestra.run.smithi149.stdout:Installing: 2024-03-26T16:42:26.348 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-dashboard noarch 2:19.0.0-2382.gbf9505fb.el9 ceph-noarch 3.5 M 2024-03-26T16:42:26.348 INFO:teuthology.orchestra.run.smithi149.stdout:Installing dependencies: 2024-03-26T16:42:26.348 INFO:teuthology.orchestra.run.smithi149.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-03-26T16:42:26.348 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-grafana-dashboards noarch 2:19.0.0-2382.gbf9505fb.el9 ceph-noarch 34 k 2024-03-26T16:42:26.348 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-prometheus-alerts noarch 2:19.0.0-2382.gbf9505fb.el9 ceph-noarch 16 k 2024-03-26T16:42:26.348 INFO:teuthology.orchestra.run.smithi149.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-03-26T16:42:26.348 INFO:teuthology.orchestra.run.smithi149.stdout: protobuf x86_64 3.14.0-13.el9 CentOS-AppStream 1.0 M 2024-03-26T16:42:26.348 INFO:teuthology.orchestra.run.smithi149.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-03-26T16:42:26.348 INFO:teuthology.orchestra.run.smithi149.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-03-26T16:42:26.348 INFO:teuthology.orchestra.run.smithi149.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-03-26T16:42:26.349 INFO:teuthology.orchestra.run.smithi149.stdout: python3-protobuf noarch 3.14.0-13.el9 CentOS-AppStream 238 k 2024-03-26T16:42:26.349 INFO:teuthology.orchestra.run.smithi149.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-03-26T16:42:26.349 INFO:teuthology.orchestra.run.smithi149.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-03-26T16:42:26.349 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-03-26T16:42:26.349 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction Summary 2024-03-26T16:42:26.349 INFO:teuthology.orchestra.run.smithi149.stdout:====================================================================================== 2024-03-26T16:42:26.349 INFO:teuthology.orchestra.run.smithi149.stdout:Install 12 Packages 2024-03-26T16:42:26.349 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-03-26T16:42:26.350 INFO:teuthology.orchestra.run.smithi149.stdout:Total download size: 8.6 M 2024-03-26T16:42:26.350 INFO:teuthology.orchestra.run.smithi149.stdout:Installed size: 103 M 2024-03-26T16:42:26.350 INFO:teuthology.orchestra.run.smithi149.stdout:Downloading Packages: 2024-03-26T16:42:26.874 INFO:teuthology.orchestra.run.smithi149.stdout:(1/12): ceph-grafana-dashboards-19.0.0-2382.gbf 184 kB/s | 34 kB 00:00 2024-03-26T16:42:26.967 INFO:teuthology.orchestra.run.smithi149.stdout:(2/12): ceph-prometheus-alerts-19.0.0-2382.gbf9 59 kB/s | 16 kB 00:00 2024-03-26T16:42:27.017 INFO:teuthology.orchestra.run.smithi149.stdout:(3/12): protobuf-3.14.0-13.el9.x86_64.rpm 7.1 MB/s | 1.0 MB 00:00 2024-03-26T16:42:27.042 INFO:teuthology.orchestra.run.smithi149.stdout:(4/12): python3-protobuf-3.14.0-13.el9.noarch.r 3.1 MB/s | 238 kB 00:00 2024-03-26T16:42:27.142 INFO:teuthology.orchestra.run.smithi149.stdout:(5/12): ceph-mgr-dashboard-19.0.0-2382.gbf9505f 7.8 MB/s | 3.5 MB 00:00 2024-03-26T16:42:27.401 INFO:teuthology.orchestra.run.smithi149.stdout:(6/12): grpc-data-1.46.7-10.el9.noarch.rpm 83 kB/s | 19 kB 00:00 2024-03-26T16:42:27.551 INFO:teuthology.orchestra.run.smithi149.stdout:(7/12): abseil-cpp-20211102.0-3.el9.x86_64.rpm 1.1 MB/s | 548 kB 00:00 2024-03-26T16:42:27.635 INFO:teuthology.orchestra.run.smithi149.stdout:(8/12): python3-grpcio-tools-1.46.7-10.el9.x86_ 1.7 MB/s | 144 kB 00:00 2024-03-26T16:42:27.677 INFO:teuthology.orchestra.run.smithi149.stdout:(9/12): protobuf-compiler-3.14.0-13.el9.x86_64. 1.3 MB/s | 863 kB 00:00 2024-03-26T16:42:27.719 INFO:teuthology.orchestra.run.smithi149.stdout:(10/12): python3-repoze-lru-0.7-16.el9.noarch.r 368 kB/s | 31 kB 00:00 2024-03-26T16:42:27.778 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-osd-2:19.0.0-2382.gbf9505fb.el9.x86_64 33/36 2024-03-26T16:42:27.805 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-osd-2:19.0.0-2382.gbf9505fb.el9.x86_64 33/36 2024-03-26T16:42:27.805 INFO:teuthology.orchestra.run.smithi157.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-26T16:42:27.805 INFO:teuthology.orchestra.run.smithi157.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-03-26T16:42:27.805 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-26T16:42:27.805 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-26T16:42:27.805 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-03-26T16:42:27.811 INFO:teuthology.orchestra.run.smithi149.stdout:(11/12): python3-grpcio-1.46.7-10.el9.x86_64.rp 5.0 MB/s | 2.0 MB 00:00 2024-03-26T16:42:28.061 INFO:teuthology.orchestra.run.smithi149.stdout:(12/12): python3-routes-2.5.1-5.el9.noarch.rpm 491 kB/s | 188 kB 00:00 2024-03-26T16:42:28.066 INFO:teuthology.orchestra.run.smithi149.stdout:-------------------------------------------------------------------------------- 2024-03-26T16:42:28.066 INFO:teuthology.orchestra.run.smithi149.stdout:Total 5.0 MB/s | 8.6 MB 00:01 2024-03-26T16:42:28.084 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction check 2024-03-26T16:42:28.101 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction check succeeded. 2024-03-26T16:42:28.101 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction test 2024-03-26T16:42:28.279 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-mon-2:19.0.0-2382.gbf9505fb.el9.x86_64 34/36 2024-03-26T16:42:28.282 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction test succeeded. 2024-03-26T16:42:28.283 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction 2024-03-26T16:42:28.302 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-mon-2:19.0.0-2382.gbf9505fb.el9.x86_64 34/36 2024-03-26T16:42:28.302 INFO:teuthology.orchestra.run.smithi157.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-26T16:42:28.302 INFO:teuthology.orchestra.run.smithi157.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-03-26T16:42:28.303 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-26T16:42:28.303 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-26T16:42:28.303 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-03-26T16:42:28.530 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-mds-2:19.0.0-2382.gbf9505fb.el9.x86_64 35/36 2024-03-26T16:42:28.553 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-mds-2:19.0.0-2382.gbf9505fb.el9.x86_64 35/36 2024-03-26T16:42:28.553 INFO:teuthology.orchestra.run.smithi157.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-26T16:42:28.553 INFO:teuthology.orchestra.run.smithi157.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-03-26T16:42:28.553 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-26T16:42:28.553 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-26T16:42:28.553 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-03-26T16:42:28.620 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-2:19.0.0-2382.gbf9505fb.el9.x86_64 36/36 2024-03-26T16:42:28.811 INFO:teuthology.orchestra.run.smithi149.stdout: Preparing : 1/1 2024-03-26T16:42:28.887 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 1/12 2024-03-26T16:42:28.930 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 2/12 2024-03-26T16:42:28.977 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/12 2024-03-26T16:42:29.007 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/12 2024-03-26T16:42:29.115 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 5/12 2024-03-26T16:42:29.241 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 6/12 2024-03-26T16:42:29.344 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 7/12 2024-03-26T16:42:29.387 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 8/12 2024-03-26T16:42:29.424 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/12 2024-03-26T16:42:29.456 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-2382.gbf9505fb.el9 10/12 2024-03-26T16:42:30.448 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-2:19.0.0-2382.gbf9505fb.el9.x86_64 36/36 2024-03-26T16:42:30.449 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-2:19.0.0-2382.gbf9505fb.el9.x86_64 1/36 2024-03-26T16:42:30.449 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-mds-2:19.0.0-2382.gbf9505fb.el9.x86_64 2/36 2024-03-26T16:42:30.449 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-mgr-2:19.0.0-2382.gbf9505fb.el9.x86_64 3/36 2024-03-26T16:42:30.449 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-mon-2:19.0.0-2382.gbf9505fb.el9.x86_64 4/36 2024-03-26T16:42:30.449 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-osd-2:19.0.0-2382.gbf9505fb.el9.x86_64 5/36 2024-03-26T16:42:30.449 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-2382.gbf9505fb.el9. 6/36 2024-03-26T16:42:30.449 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : lua-5.4.4-4.el9.x86_64 7/36 2024-03-26T16:42:30.449 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 8/36 2024-03-26T16:42:30.449 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 9/36 2024-03-26T16:42:30.450 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 10/36 2024-03-26T16:42:30.450 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 11/36 2024-03-26T16:42:30.450 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 12/36 2024-03-26T16:42:30.450 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 13/36 2024-03-26T16:42:30.450 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-ply-3.11-14.el9.noarch 14/36 2024-03-26T16:42:30.450 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 15/36 2024-03-26T16:42:30.450 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 16/36 2024-03-26T16:42:30.450 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 17/36 2024-03-26T16:42:30.450 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 18/36 2024-03-26T16:42:30.450 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 19/36 2024-03-26T16:42:30.450 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 20/36 2024-03-26T16:42:30.450 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 21/36 2024-03-26T16:42:30.450 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 22/36 2024-03-26T16:42:30.450 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 23/36 2024-03-26T16:42:30.451 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 24/36 2024-03-26T16:42:30.451 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 25/36 2024-03-26T16:42:30.451 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 26/36 2024-03-26T16:42:30.451 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 27/36 2024-03-26T16:42:30.451 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 28/36 2024-03-26T16:42:30.451 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 29/36 2024-03-26T16:42:30.451 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 30/36 2024-03-26T16:42:30.451 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 31/36 2024-03-26T16:42:30.451 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 32/36 2024-03-26T16:42:30.451 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 33/36 2024-03-26T16:42:30.451 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 34/36 2024-03-26T16:42:30.451 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 35/36 2024-03-26T16:42:30.513 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-2382.gbf9505fb.el 11/12 2024-03-26T16:42:30.556 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-2382.gbf9505fb.el9.noa 12/12 2024-03-26T16:42:31.506 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 36/36 2024-03-26T16:42:31.506 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-03-26T16:42:31.506 INFO:teuthology.orchestra.run.smithi157.stdout:Installed: 2024-03-26T16:42:31.506 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-2:19.0.0-2382.gbf9505fb.el9.x86_64 2024-03-26T16:42:31.506 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mds-2:19.0.0-2382.gbf9505fb.el9.x86_64 2024-03-26T16:42:31.506 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr-2:19.0.0-2382.gbf9505fb.el9.x86_64 2024-03-26T16:42:31.506 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr-modules-core-2:19.0.0-2382.gbf9505fb.el9.noarch 2024-03-26T16:42:31.507 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mon-2:19.0.0-2382.gbf9505fb.el9.x86_64 2024-03-26T16:42:31.507 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-osd-2:19.0.0-2382.gbf9505fb.el9.x86_64 2024-03-26T16:42:31.507 INFO:teuthology.orchestra.run.smithi157.stdout: lua-5.4.4-4.el9.x86_64 2024-03-26T16:42:31.507 INFO:teuthology.orchestra.run.smithi157.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-03-26T16:42:31.507 INFO:teuthology.orchestra.run.smithi157.stdout: luarocks-3.9.2-1.el9.noarch 2024-03-26T16:42:31.507 INFO:teuthology.orchestra.run.smithi157.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-03-26T16:42:31.507 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-03-26T16:42:31.507 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-03-26T16:42:31.507 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-03-26T16:42:31.507 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-03-26T16:42:31.507 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-03-26T16:42:31.507 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-03-26T16:42:31.507 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-03-26T16:42:31.507 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-03-26T16:42:31.508 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-03-26T16:42:31.508 INFO:teuthology.orchestra.run.smithi157.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-03-26T16:42:31.508 INFO:teuthology.orchestra.run.smithi157.stdout: python3-mako-1.1.4-6.el9.noarch 2024-03-26T16:42:31.508 INFO:teuthology.orchestra.run.smithi157.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-03-26T16:42:31.508 INFO:teuthology.orchestra.run.smithi157.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-03-26T16:42:31.508 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-03-26T16:42:31.508 INFO:teuthology.orchestra.run.smithi157.stdout: python3-ply-3.11-14.el9.noarch 2024-03-26T16:42:31.508 INFO:teuthology.orchestra.run.smithi157.stdout: python3-portend-3.1.0-2.el9.noarch 2024-03-26T16:42:31.508 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-03-26T16:42:31.508 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pycparser-2.20-6.el9.noarch 2024-03-26T16:42:31.508 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pytz-2021.1-5.el9.noarch 2024-03-26T16:42:31.508 INFO:teuthology.orchestra.run.smithi157.stdout: python3-requests-2.25.1-8.el9.noarch 2024-03-26T16:42:31.508 INFO:teuthology.orchestra.run.smithi157.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-03-26T16:42:31.509 INFO:teuthology.orchestra.run.smithi157.stdout: python3-toml-0.10.2-6.el9.noarch 2024-03-26T16:42:31.509 INFO:teuthology.orchestra.run.smithi157.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-03-26T16:42:31.509 INFO:teuthology.orchestra.run.smithi157.stdout: python3-webob-1.8.7-6.el9.noarch 2024-03-26T16:42:31.509 INFO:teuthology.orchestra.run.smithi157.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-03-26T16:42:31.509 INFO:teuthology.orchestra.run.smithi157.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-03-26T16:42:31.509 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-03-26T16:42:31.509 INFO:teuthology.orchestra.run.smithi157.stdout:Complete! 2024-03-26T16:42:31.821 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-2382.gbf9505fb.el9.noa 12/12 2024-03-26T16:42:31.822 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-2382.gbf9505fb.el 1/12 2024-03-26T16:42:31.822 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-2382.gbf9505fb.el9.noa 2/12 2024-03-26T16:42:31.822 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-2382.gbf9505fb.el9 3/12 2024-03-26T16:42:31.822 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 4/12 2024-03-26T16:42:31.822 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 5/12 2024-03-26T16:42:31.822 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 6/12 2024-03-26T16:42:31.822 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 7/12 2024-03-26T16:42:31.822 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 8/12 2024-03-26T16:42:31.822 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 9/12 2024-03-26T16:42:31.822 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 10/12 2024-03-26T16:42:31.822 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 11/12 2024-03-26T16:42:31.882 DEBUG:teuthology.orchestra.run.smithi157:> sudo yum -y install ceph-base 2024-03-26T16:42:32.178 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 12/12 2024-03-26T16:42:32.178 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-03-26T16:42:32.178 INFO:teuthology.orchestra.run.smithi149.stdout:Installed: 2024-03-26T16:42:32.178 INFO:teuthology.orchestra.run.smithi149.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-03-26T16:42:32.178 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-grafana-dashboards-2:19.0.0-2382.gbf9505fb.el9.noarch 2024-03-26T16:42:32.178 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-dashboard-2:19.0.0-2382.gbf9505fb.el9.noarch 2024-03-26T16:42:32.178 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-prometheus-alerts-2:19.0.0-2382.gbf9505fb.el9.noarch 2024-03-26T16:42:32.179 INFO:teuthology.orchestra.run.smithi149.stdout: grpc-data-1.46.7-10.el9.noarch 2024-03-26T16:42:32.179 INFO:teuthology.orchestra.run.smithi149.stdout: protobuf-3.14.0-13.el9.x86_64 2024-03-26T16:42:32.179 INFO:teuthology.orchestra.run.smithi149.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-03-26T16:42:32.179 INFO:teuthology.orchestra.run.smithi149.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-03-26T16:42:32.179 INFO:teuthology.orchestra.run.smithi149.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-03-26T16:42:32.179 INFO:teuthology.orchestra.run.smithi149.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-03-26T16:42:32.179 INFO:teuthology.orchestra.run.smithi149.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-03-26T16:42:32.179 INFO:teuthology.orchestra.run.smithi149.stdout: python3-routes-2.5.1-5.el9.noarch 2024-03-26T16:42:32.179 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-03-26T16:42:32.179 INFO:teuthology.orchestra.run.smithi149.stdout:Complete! 2024-03-26T16:42:32.419 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum -y install ceph-mgr-diskprediction-local 2024-03-26T16:42:32.445 INFO:teuthology.orchestra.run.smithi157.stdout:Last metadata expiration check: 0:01:09 ago on Tue 26 Mar 2024 04:41:23 PM UTC. 2024-03-26T16:42:32.542 INFO:teuthology.orchestra.run.smithi157.stdout:Package ceph-base-2:19.0.0-2382.gbf9505fb.el9.x86_64 is already installed. 2024-03-26T16:42:32.593 INFO:teuthology.orchestra.run.smithi157.stdout:Dependencies resolved. 2024-03-26T16:42:32.594 INFO:teuthology.orchestra.run.smithi157.stdout:Nothing to do. 2024-03-26T16:42:32.594 INFO:teuthology.orchestra.run.smithi157.stdout:Complete! 2024-03-26T16:42:32.671 DEBUG:teuthology.orchestra.run.smithi157:> sudo yum -y install cephadm 2024-03-26T16:42:32.990 INFO:teuthology.orchestra.run.smithi149.stdout:Last metadata expiration check: 0:01:10 ago on Tue 26 Mar 2024 04:41:22 PM UTC. 2024-03-26T16:42:33.143 INFO:teuthology.orchestra.run.smithi149.stdout:Dependencies resolved. 2024-03-26T16:42:33.144 INFO:teuthology.orchestra.run.smithi149.stdout:============================================================================================ 2024-03-26T16:42:33.144 INFO:teuthology.orchestra.run.smithi149.stdout: Package Arch Version Repository Size 2024-03-26T16:42:33.144 INFO:teuthology.orchestra.run.smithi149.stdout:============================================================================================ 2024-03-26T16:42:33.144 INFO:teuthology.orchestra.run.smithi149.stdout:Installing: 2024-03-26T16:42:33.144 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-2382.gbf9505fb.el9 ceph-noarch 7.4 M 2024-03-26T16:42:33.144 INFO:teuthology.orchestra.run.smithi149.stdout:Installing dependencies: 2024-03-26T16:42:33.144 INFO:teuthology.orchestra.run.smithi149.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2024-03-26T16:42:33.144 INFO:teuthology.orchestra.run.smithi149.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2024-03-26T16:42:33.144 INFO:teuthology.orchestra.run.smithi149.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2024-03-26T16:42:33.144 INFO:teuthology.orchestra.run.smithi149.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-03-26T16:42:33.145 INFO:teuthology.orchestra.run.smithi149.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-03-26T16:42:33.145 INFO:teuthology.orchestra.run.smithi149.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2024-03-26T16:42:33.145 INFO:teuthology.orchestra.run.smithi149.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2024-03-26T16:42:33.145 INFO:teuthology.orchestra.run.smithi149.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-03-26T16:42:33.145 INFO:teuthology.orchestra.run.smithi149.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2024-03-26T16:42:33.145 INFO:teuthology.orchestra.run.smithi149.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2024-03-26T16:42:33.145 INFO:teuthology.orchestra.run.smithi149.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2024-03-26T16:42:33.145 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-03-26T16:42:33.145 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction Summary 2024-03-26T16:42:33.145 INFO:teuthology.orchestra.run.smithi149.stdout:============================================================================================ 2024-03-26T16:42:33.145 INFO:teuthology.orchestra.run.smithi149.stdout:Install 12 Packages 2024-03-26T16:42:33.145 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-03-26T16:42:33.146 INFO:teuthology.orchestra.run.smithi149.stdout:Total download size: 37 M 2024-03-26T16:42:33.146 INFO:teuthology.orchestra.run.smithi149.stdout:Installed size: 209 M 2024-03-26T16:42:33.146 INFO:teuthology.orchestra.run.smithi149.stdout:Downloading Packages: 2024-03-26T16:42:33.226 INFO:teuthology.orchestra.run.smithi157.stdout:Last metadata expiration check: 0:01:10 ago on Tue 26 Mar 2024 04:41:23 PM UTC. 2024-03-26T16:42:33.374 INFO:teuthology.orchestra.run.smithi157.stdout:Dependencies resolved. 2024-03-26T16:42:33.375 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2024-03-26T16:42:33.375 INFO:teuthology.orchestra.run.smithi157.stdout: Package Arch Version Repository Size 2024-03-26T16:42:33.375 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2024-03-26T16:42:33.375 INFO:teuthology.orchestra.run.smithi157.stdout:Installing: 2024-03-26T16:42:33.376 INFO:teuthology.orchestra.run.smithi157.stdout: cephadm noarch 2:19.0.0-2382.gbf9505fb.el9 ceph-noarch 750 k 2024-03-26T16:42:33.376 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-03-26T16:42:33.376 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction Summary 2024-03-26T16:42:33.376 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2024-03-26T16:42:33.376 INFO:teuthology.orchestra.run.smithi157.stdout:Install 1 Package 2024-03-26T16:42:33.376 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-03-26T16:42:33.376 INFO:teuthology.orchestra.run.smithi157.stdout:Total download size: 750 k 2024-03-26T16:42:33.376 INFO:teuthology.orchestra.run.smithi157.stdout:Installed size: 756 k 2024-03-26T16:42:33.376 INFO:teuthology.orchestra.run.smithi157.stdout:Downloading Packages: 2024-03-26T16:42:33.670 INFO:teuthology.orchestra.run.smithi157.stdout:cephadm-19.0.0-2382.gbf9505fb.el9.noarch.rpm 2.5 MB/s | 750 kB 00:00 2024-03-26T16:42:33.670 INFO:teuthology.orchestra.run.smithi157.stdout:-------------------------------------------------------------------------------- 2024-03-26T16:42:33.670 INFO:teuthology.orchestra.run.smithi157.stdout:Total 2.5 MB/s | 750 kB 00:00 2024-03-26T16:42:33.671 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction check 2024-03-26T16:42:33.676 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction check succeeded. 2024-03-26T16:42:33.676 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction test 2024-03-26T16:42:33.681 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction test succeeded. 2024-03-26T16:42:33.682 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction 2024-03-26T16:42:33.694 INFO:teuthology.orchestra.run.smithi149.stdout:(1/12): flexiblas-3.0.4-8.el9.x86_64.rpm 205 kB/s | 32 kB 00:00 2024-03-26T16:42:33.727 INFO:teuthology.orchestra.run.smithi149.stdout:(2/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 524 kB/s | 17 kB 00:00 2024-03-26T16:42:33.754 INFO:teuthology.orchestra.run.smithi157.stdout: Preparing : 1/1 2024-03-26T16:42:33.769 INFO:teuthology.orchestra.run.smithi149.stdout:(3/12): openblas-0.3.21-2.el9.x86_64.rpm 845 kB/s | 34 kB 00:00 2024-03-26T16:42:33.828 INFO:teuthology.orchestra.run.smithi149.stdout:(4/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 10 MB/s | 3.0 MB 00:00 2024-03-26T16:42:33.995 INFO:teuthology.orchestra.run.smithi149.stdout:(5/12): openblas-openmp-0.3.21-2.el9.x86_64.rpm 21 MB/s | 4.7 MB 00:00 2024-03-26T16:42:34.062 INFO:teuthology.orchestra.run.smithi149.stdout:(6/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 20 MB/s | 4.8 MB 00:00 2024-03-26T16:42:34.104 INFO:teuthology.orchestra.run.smithi149.stdout:(7/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 2.0 MB/s | 217 kB 00:00 2024-03-26T16:42:34.219 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: cephadm-2:19.0.0-2382.gbf9505fb.el9.noarch 1/1 2024-03-26T16:42:34.298 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : cephadm-2:19.0.0-2382.gbf9505fb.el9.noarch 1/1 2024-03-26T16:42:34.379 INFO:teuthology.orchestra.run.smithi149.stdout:(8/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 50 MB/s | 16 MB 00:00 2024-03-26T16:42:34.538 INFO:teuthology.orchestra.run.smithi149.stdout:(9/12): ceph-mgr-diskprediction-local-19.0.0-23 7.4 MB/s | 7.4 MB 00:00 2024-03-26T16:42:34.667 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: cephadm-2:19.0.0-2382.gbf9505fb.el9.noarch 1/1 2024-03-26T16:42:34.911 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : cephadm-2:19.0.0-2382.gbf9505fb.el9.noarch 1/1 2024-03-26T16:42:34.911 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-03-26T16:42:34.911 INFO:teuthology.orchestra.run.smithi157.stdout:Installed: 2024-03-26T16:42:34.911 INFO:teuthology.orchestra.run.smithi157.stdout: cephadm-2:19.0.0-2382.gbf9505fb.el9.noarch 2024-03-26T16:42:34.911 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-03-26T16:42:34.911 INFO:teuthology.orchestra.run.smithi157.stdout:Complete! 2024-03-26T16:42:35.071 INFO:teuthology.orchestra.run.smithi149.stdout:(10/12): python3-devel-3.9.17-2.el9.x86_64.rpm 482 kB/s | 245 kB 00:00 2024-03-26T16:42:35.124 DEBUG:teuthology.orchestra.run.smithi157:> sudo yum -y install ceph-immutable-object-cache 2024-03-26T16:42:35.330 INFO:teuthology.orchestra.run.smithi149.stdout:(11/12): libquadmath-11.4.1-3.el9.x86_64.rpm 206 kB/s | 195 kB 00:00 2024-03-26T16:42:35.688 INFO:teuthology.orchestra.run.smithi157.stdout:Last metadata expiration check: 0:01:12 ago on Tue 26 Mar 2024 04:41:23 PM UTC. 2024-03-26T16:42:35.843 INFO:teuthology.orchestra.run.smithi157.stdout:Dependencies resolved. 2024-03-26T16:42:35.843 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2024-03-26T16:42:35.844 INFO:teuthology.orchestra.run.smithi157.stdout: Package Arch Version Repo Size 2024-03-26T16:42:35.844 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2024-03-26T16:42:35.844 INFO:teuthology.orchestra.run.smithi157.stdout:Installing: 2024-03-26T16:42:35.844 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-2382.gbf9505fb.el9 ceph 145 k 2024-03-26T16:42:35.844 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-03-26T16:42:35.844 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction Summary 2024-03-26T16:42:35.844 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2024-03-26T16:42:35.844 INFO:teuthology.orchestra.run.smithi157.stdout:Install 1 Package 2024-03-26T16:42:35.844 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-03-26T16:42:35.845 INFO:teuthology.orchestra.run.smithi157.stdout:Total download size: 145 k 2024-03-26T16:42:35.845 INFO:teuthology.orchestra.run.smithi157.stdout:Installed size: 435 k 2024-03-26T16:42:35.845 INFO:teuthology.orchestra.run.smithi157.stdout:Downloading Packages: 2024-03-26T16:42:35.922 INFO:teuthology.orchestra.run.smithi149.stdout:(12/12): libgfortran-11.4.1-3.el9.x86_64.rpm 442 kB/s | 803 kB 00:01 2024-03-26T16:42:35.925 INFO:teuthology.orchestra.run.smithi149.stdout:-------------------------------------------------------------------------------- 2024-03-26T16:42:35.925 INFO:teuthology.orchestra.run.smithi149.stdout:Total 13 MB/s | 37 MB 00:02 2024-03-26T16:42:35.969 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction check 2024-03-26T16:42:35.995 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction check succeeded. 2024-03-26T16:42:35.995 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction test 2024-03-26T16:42:36.076 INFO:teuthology.orchestra.run.smithi157.stdout:ceph-immutable-object-cache-19.0.0-2382.gbf9505 628 kB/s | 145 kB 00:00 2024-03-26T16:42:36.077 INFO:teuthology.orchestra.run.smithi157.stdout:-------------------------------------------------------------------------------- 2024-03-26T16:42:36.077 INFO:teuthology.orchestra.run.smithi157.stdout:Total 622 kB/s | 145 kB 00:00 2024-03-26T16:42:36.077 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction check 2024-03-26T16:42:36.085 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction check succeeded. 2024-03-26T16:42:36.085 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction test 2024-03-26T16:42:36.138 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction test succeeded. 2024-03-26T16:42:36.138 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction 2024-03-26T16:42:36.285 INFO:teuthology.orchestra.run.smithi157.stdout: Preparing : 1/1 2024-03-26T16:42:36.359 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction test succeeded. 2024-03-26T16:42:36.359 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction 2024-03-26T16:42:36.369 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-2382.gbf9505fb. 1/1 2024-03-26T16:42:36.393 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-2382.gbf9505fb. 1/1 2024-03-26T16:42:36.394 INFO:teuthology.orchestra.run.smithi157.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-26T16:42:36.394 INFO:teuthology.orchestra.run.smithi157.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-03-26T16:42:36.394 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-03-26T16:42:37.065 INFO:teuthology.orchestra.run.smithi149.stdout: Preparing : 1/1 2024-03-26T16:42:37.128 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 1/12 2024-03-26T16:42:37.159 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 2/12 2024-03-26T16:42:37.253 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 3/12 2024-03-26T16:42:37.296 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 4/12 2024-03-26T16:42:37.359 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-2382.gbf9505fb. 1/1 2024-03-26T16:42:37.359 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-03-26T16:42:37.359 INFO:teuthology.orchestra.run.smithi157.stdout:Installed: 2024-03-26T16:42:37.359 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-immutable-object-cache-2:19.0.0-2382.gbf9505fb.el9.x86_64 2024-03-26T16:42:37.359 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-03-26T16:42:37.359 INFO:teuthology.orchestra.run.smithi157.stdout:Complete! 2024-03-26T16:42:37.474 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : openblas-0.3.21-2.el9.x86_64 5/12 2024-03-26T16:42:37.495 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2024-03-26T16:42:37.583 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-03-26T16:42:37.616 DEBUG:teuthology.orchestra.run.smithi157:> sudo yum -y install ceph-mgr 2024-03-26T16:42:38.188 INFO:teuthology.orchestra.run.smithi157.stdout:Last metadata expiration check: 0:01:15 ago on Tue 26 Mar 2024 04:41:23 PM UTC. 2024-03-26T16:42:38.240 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-03-26T16:42:38.286 INFO:teuthology.orchestra.run.smithi157.stdout:Package ceph-mgr-2:19.0.0-2382.gbf9505fb.el9.x86_64 is already installed. 2024-03-26T16:42:38.337 INFO:teuthology.orchestra.run.smithi157.stdout:Dependencies resolved. 2024-03-26T16:42:38.338 INFO:teuthology.orchestra.run.smithi157.stdout:Nothing to do. 2024-03-26T16:42:38.338 INFO:teuthology.orchestra.run.smithi157.stdout:Complete! 2024-03-26T16:42:38.348 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-03-26T16:42:38.408 DEBUG:teuthology.orchestra.run.smithi157:> sudo yum -y install ceph-mgr-dashboard 2024-03-26T16:42:38.965 INFO:teuthology.orchestra.run.smithi157.stdout:Last metadata expiration check: 0:01:15 ago on Tue 26 Mar 2024 04:41:23 PM UTC. 2024-03-26T16:42:39.115 INFO:teuthology.orchestra.run.smithi157.stdout:Dependencies resolved. 2024-03-26T16:42:39.116 INFO:teuthology.orchestra.run.smithi157.stdout:====================================================================================== 2024-03-26T16:42:39.117 INFO:teuthology.orchestra.run.smithi157.stdout: Package Arch Version Repository Size 2024-03-26T16:42:39.117 INFO:teuthology.orchestra.run.smithi157.stdout:====================================================================================== 2024-03-26T16:42:39.117 INFO:teuthology.orchestra.run.smithi157.stdout:Installing: 2024-03-26T16:42:39.117 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr-dashboard noarch 2:19.0.0-2382.gbf9505fb.el9 ceph-noarch 3.5 M 2024-03-26T16:42:39.117 INFO:teuthology.orchestra.run.smithi157.stdout:Installing dependencies: 2024-03-26T16:42:39.117 INFO:teuthology.orchestra.run.smithi157.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-03-26T16:42:39.117 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-grafana-dashboards noarch 2:19.0.0-2382.gbf9505fb.el9 ceph-noarch 34 k 2024-03-26T16:42:39.117 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-prometheus-alerts noarch 2:19.0.0-2382.gbf9505fb.el9 ceph-noarch 16 k 2024-03-26T16:42:39.117 INFO:teuthology.orchestra.run.smithi157.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-03-26T16:42:39.117 INFO:teuthology.orchestra.run.smithi157.stdout: protobuf x86_64 3.14.0-13.el9 CentOS-AppStream 1.0 M 2024-03-26T16:42:39.117 INFO:teuthology.orchestra.run.smithi157.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-03-26T16:42:39.117 INFO:teuthology.orchestra.run.smithi157.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-03-26T16:42:39.117 INFO:teuthology.orchestra.run.smithi157.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-03-26T16:42:39.118 INFO:teuthology.orchestra.run.smithi157.stdout: python3-protobuf noarch 3.14.0-13.el9 CentOS-AppStream 238 k 2024-03-26T16:42:39.118 INFO:teuthology.orchestra.run.smithi157.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-03-26T16:42:39.118 INFO:teuthology.orchestra.run.smithi157.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-03-26T16:42:39.118 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-03-26T16:42:39.118 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction Summary 2024-03-26T16:42:39.118 INFO:teuthology.orchestra.run.smithi157.stdout:====================================================================================== 2024-03-26T16:42:39.118 INFO:teuthology.orchestra.run.smithi157.stdout:Install 12 Packages 2024-03-26T16:42:39.118 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-03-26T16:42:39.119 INFO:teuthology.orchestra.run.smithi157.stdout:Total download size: 8.6 M 2024-03-26T16:42:39.119 INFO:teuthology.orchestra.run.smithi157.stdout:Installed size: 103 M 2024-03-26T16:42:39.119 INFO:teuthology.orchestra.run.smithi157.stdout:Downloading Packages: 2024-03-26T16:42:39.513 INFO:teuthology.orchestra.run.smithi157.stdout:(1/12): ceph-grafana-dashboards-19.0.0-2382.gbf 176 kB/s | 34 kB 00:00 2024-03-26T16:42:39.538 INFO:teuthology.orchestra.run.smithi157.stdout:(2/12): ceph-prometheus-alerts-19.0.0-2382.gbf9 75 kB/s | 16 kB 00:00 2024-03-26T16:42:39.572 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-03-26T16:42:39.663 INFO:teuthology.orchestra.run.smithi157.stdout:(3/12): python3-protobuf-3.14.0-13.el9.noarch.r 1.9 MB/s | 238 kB 00:00 2024-03-26T16:42:39.722 INFO:teuthology.orchestra.run.smithi157.stdout:(4/12): protobuf-3.14.0-13.el9.x86_64.rpm 4.8 MB/s | 1.0 MB 00:00 2024-03-26T16:42:39.797 INFO:teuthology.orchestra.run.smithi157.stdout:(5/12): ceph-mgr-dashboard-19.0.0-2382.gbf9505f 7.4 MB/s | 3.5 MB 00:00 2024-03-26T16:42:40.048 INFO:teuthology.orchestra.run.smithi157.stdout:(6/12): grpc-data-1.46.7-10.el9.noarch.rpm 86 kB/s | 19 kB 00:00 2024-03-26T16:42:40.073 INFO:teuthology.orchestra.run.smithi157.stdout:(7/12): protobuf-compiler-3.14.0-13.el9.x86_64. 2.1 MB/s | 863 kB 00:00 2024-03-26T16:42:40.181 INFO:teuthology.orchestra.run.smithi157.stdout:(8/12): abseil-cpp-20211102.0-3.el9.x86_64.rpm 1.2 MB/s | 548 kB 00:00 2024-03-26T16:42:40.248 INFO:teuthology.orchestra.run.smithi157.stdout:(9/12): python3-repoze-lru-0.7-16.el9.noarch.rp 468 kB/s | 31 kB 00:00 2024-03-26T16:42:40.324 INFO:teuthology.orchestra.run.smithi157.stdout:(10/12): python3-routes-2.5.1-5.el9.noarch.rpm 2.5 MB/s | 188 kB 00:00 2024-03-26T16:42:40.399 INFO:teuthology.orchestra.run.smithi157.stdout:(11/12): python3-grpcio-tools-1.46.7-10.el9.x86 443 kB/s | 144 kB 00:00 2024-03-26T16:42:40.441 INFO:teuthology.orchestra.run.smithi157.stdout:(12/12): python3-grpcio-1.46.7-10.el9.x86_64.rp 5.2 MB/s | 2.0 MB 00:00 2024-03-26T16:42:40.445 INFO:teuthology.orchestra.run.smithi157.stdout:-------------------------------------------------------------------------------- 2024-03-26T16:42:40.446 INFO:teuthology.orchestra.run.smithi157.stdout:Total 6.5 MB/s | 8.6 MB 00:01 2024-03-26T16:42:40.463 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction check 2024-03-26T16:42:40.480 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction check succeeded. 2024-03-26T16:42:40.480 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction test 2024-03-26T16:42:40.598 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-03-26T16:42:40.628 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-2382.gbf950 12/12 2024-03-26T16:42:40.665 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction test succeeded. 2024-03-26T16:42:40.665 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction 2024-03-26T16:42:41.187 INFO:teuthology.orchestra.run.smithi157.stdout: Preparing : 1/1 2024-03-26T16:42:41.258 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 1/12 2024-03-26T16:42:41.301 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 2/12 2024-03-26T16:42:41.348 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/12 2024-03-26T16:42:41.387 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/12 2024-03-26T16:42:41.489 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 5/12 2024-03-26T16:42:41.613 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 6/12 2024-03-26T16:42:41.731 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 7/12 2024-03-26T16:42:41.783 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 8/12 2024-03-26T16:42:41.820 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/12 2024-03-26T16:42:41.852 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-2382.gbf9505fb.el9 10/12 2024-03-26T16:42:42.907 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-2382.gbf9505fb.el 11/12 2024-03-26T16:42:42.944 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-2382.gbf9505fb.el9.noa 12/12 2024-03-26T16:42:43.195 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-2382.gbf950 12/12 2024-03-26T16:42:43.195 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-2382.gbf950 1/12 2024-03-26T16:42:43.195 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 2/12 2024-03-26T16:42:43.195 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 3/12 2024-03-26T16:42:43.195 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 4/12 2024-03-26T16:42:43.195 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 5/12 2024-03-26T16:42:43.195 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2024-03-26T16:42:43.195 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 7/12 2024-03-26T16:42:43.195 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 8/12 2024-03-26T16:42:43.195 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 9/12 2024-03-26T16:42:43.195 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 10/12 2024-03-26T16:42:43.196 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 11/12 2024-03-26T16:42:43.665 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 12/12 2024-03-26T16:42:43.665 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-03-26T16:42:43.666 INFO:teuthology.orchestra.run.smithi149.stdout:Installed: 2024-03-26T16:42:43.666 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-diskprediction-local-2:19.0.0-2382.gbf9505fb.el9.noarch 2024-03-26T16:42:43.666 INFO:teuthology.orchestra.run.smithi149.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-03-26T16:42:43.666 INFO:teuthology.orchestra.run.smithi149.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-03-26T16:42:43.666 INFO:teuthology.orchestra.run.smithi149.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-03-26T16:42:43.666 INFO:teuthology.orchestra.run.smithi149.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-03-26T16:42:43.666 INFO:teuthology.orchestra.run.smithi149.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-03-26T16:42:43.666 INFO:teuthology.orchestra.run.smithi149.stdout: openblas-0.3.21-2.el9.x86_64 2024-03-26T16:42:43.667 INFO:teuthology.orchestra.run.smithi149.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-03-26T16:42:43.667 INFO:teuthology.orchestra.run.smithi149.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-03-26T16:42:43.667 INFO:teuthology.orchestra.run.smithi149.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-03-26T16:42:43.667 INFO:teuthology.orchestra.run.smithi149.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-03-26T16:42:43.667 INFO:teuthology.orchestra.run.smithi149.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-03-26T16:42:43.667 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-03-26T16:42:43.667 INFO:teuthology.orchestra.run.smithi149.stdout:Complete! 2024-03-26T16:42:44.011 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum -y install ceph-mgr-rook 2024-03-26T16:42:44.255 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-2382.gbf9505fb.el9.noa 12/12 2024-03-26T16:42:44.255 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-2382.gbf9505fb.el 1/12 2024-03-26T16:42:44.255 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-2382.gbf9505fb.el9.noa 2/12 2024-03-26T16:42:44.255 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-2382.gbf9505fb.el9 3/12 2024-03-26T16:42:44.255 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 4/12 2024-03-26T16:42:44.255 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 5/12 2024-03-26T16:42:44.255 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 6/12 2024-03-26T16:42:44.255 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 7/12 2024-03-26T16:42:44.255 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 8/12 2024-03-26T16:42:44.255 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 9/12 2024-03-26T16:42:44.255 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 10/12 2024-03-26T16:42:44.255 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 11/12 2024-03-26T16:42:44.598 INFO:teuthology.orchestra.run.smithi149.stdout:Last metadata expiration check: 0:01:22 ago on Tue 26 Mar 2024 04:41:22 PM UTC. 2024-03-26T16:42:44.618 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 12/12 2024-03-26T16:42:44.618 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-03-26T16:42:44.618 INFO:teuthology.orchestra.run.smithi157.stdout:Installed: 2024-03-26T16:42:44.618 INFO:teuthology.orchestra.run.smithi157.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-03-26T16:42:44.618 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-grafana-dashboards-2:19.0.0-2382.gbf9505fb.el9.noarch 2024-03-26T16:42:44.619 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr-dashboard-2:19.0.0-2382.gbf9505fb.el9.noarch 2024-03-26T16:42:44.619 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-prometheus-alerts-2:19.0.0-2382.gbf9505fb.el9.noarch 2024-03-26T16:42:44.619 INFO:teuthology.orchestra.run.smithi157.stdout: grpc-data-1.46.7-10.el9.noarch 2024-03-26T16:42:44.619 INFO:teuthology.orchestra.run.smithi157.stdout: protobuf-3.14.0-13.el9.x86_64 2024-03-26T16:42:44.619 INFO:teuthology.orchestra.run.smithi157.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-03-26T16:42:44.619 INFO:teuthology.orchestra.run.smithi157.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-03-26T16:42:44.619 INFO:teuthology.orchestra.run.smithi157.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-03-26T16:42:44.620 INFO:teuthology.orchestra.run.smithi157.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-03-26T16:42:44.620 INFO:teuthology.orchestra.run.smithi157.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-03-26T16:42:44.620 INFO:teuthology.orchestra.run.smithi157.stdout: python3-routes-2.5.1-5.el9.noarch 2024-03-26T16:42:44.620 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-03-26T16:42:44.620 INFO:teuthology.orchestra.run.smithi157.stdout:Complete! 2024-03-26T16:42:44.748 INFO:teuthology.orchestra.run.smithi149.stdout:Dependencies resolved. 2024-03-26T16:42:44.750 INFO:teuthology.orchestra.run.smithi149.stdout:======================================================================================== 2024-03-26T16:42:44.750 INFO:teuthology.orchestra.run.smithi149.stdout: Package Arch Version Repository Size 2024-03-26T16:42:44.750 INFO:teuthology.orchestra.run.smithi149.stdout:======================================================================================== 2024-03-26T16:42:44.750 INFO:teuthology.orchestra.run.smithi149.stdout:Installing: 2024-03-26T16:42:44.750 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-rook noarch 2:19.0.0-2382.gbf9505fb.el9 ceph-noarch 49 k 2024-03-26T16:42:44.750 INFO:teuthology.orchestra.run.smithi149.stdout:Installing dependencies: 2024-03-26T16:42:44.750 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-03-26T16:42:44.750 INFO:teuthology.orchestra.run.smithi149.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-03-26T16:42:44.750 INFO:teuthology.orchestra.run.smithi149.stdout: python3-google-auth noarch 1:2.28.2-1.el9 epel 203 k 2024-03-26T16:42:44.750 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2024-03-26T16:42:44.751 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2024-03-26T16:42:44.751 INFO:teuthology.orchestra.run.smithi149.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-03-26T16:42:44.751 INFO:teuthology.orchestra.run.smithi149.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2024-03-26T16:42:44.751 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2024-03-26T16:42:44.751 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2024-03-26T16:42:44.751 INFO:teuthology.orchestra.run.smithi149.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2024-03-26T16:42:44.751 INFO:teuthology.orchestra.run.smithi149.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-03-26T16:42:44.751 INFO:teuthology.orchestra.run.smithi149.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-03-26T16:42:44.751 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-03-26T16:42:44.751 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction Summary 2024-03-26T16:42:44.751 INFO:teuthology.orchestra.run.smithi149.stdout:======================================================================================== 2024-03-26T16:42:44.751 INFO:teuthology.orchestra.run.smithi149.stdout:Install 13 Packages 2024-03-26T16:42:44.751 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-03-26T16:42:44.752 INFO:teuthology.orchestra.run.smithi149.stdout:Total download size: 2.0 M 2024-03-26T16:42:44.752 INFO:teuthology.orchestra.run.smithi149.stdout:Installed size: 26 M 2024-03-26T16:42:44.752 INFO:teuthology.orchestra.run.smithi149.stdout:Downloading Packages: 2024-03-26T16:42:44.873 DEBUG:teuthology.orchestra.run.smithi157:> sudo yum -y install ceph-mgr-diskprediction-local 2024-03-26T16:42:44.946 INFO:teuthology.orchestra.run.smithi149.stdout:(1/13): python3-jsonpatch-1.21-16.el9.noarch.rp 200 kB/s | 24 kB 00:00 2024-03-26T16:42:44.972 INFO:teuthology.orchestra.run.smithi149.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 123 kB/s | 18 kB 00:00 2024-03-26T16:42:45.022 INFO:teuthology.orchestra.run.smithi149.stdout:(3/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 2.3 MB/s | 174 kB 00:00 2024-03-26T16:42:45.047 INFO:teuthology.orchestra.run.smithi149.stdout:(4/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.7 MB/s | 132 kB 00:00 2024-03-26T16:42:45.072 INFO:teuthology.orchestra.run.smithi149.stdout:(5/13): python3-pyasn1-modules-0.4.8-6.el9.noar 4.1 MB/s | 211 kB 00:00 2024-03-26T16:42:45.098 INFO:teuthology.orchestra.run.smithi149.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 854 kB/s | 43 kB 00:00 2024-03-26T16:42:45.123 INFO:teuthology.orchestra.run.smithi149.stdout:(7/13): ceph-mgr-rook-19.0.0-2382.gbf9505fb.el9 165 kB/s | 49 kB 00:00 2024-03-26T16:42:45.182 INFO:teuthology.orchestra.run.smithi149.stdout:(8/13): python3-certifi-2021.10.8-2.el9.noarch. 179 kB/s | 15 kB 00:00 2024-03-26T16:42:45.207 INFO:teuthology.orchestra.run.smithi149.stdout:(9/13): python3-cachetools-4.2.4-1.el9.noarch.r 240 kB/s | 32 kB 00:00 2024-03-26T16:42:45.232 INFO:teuthology.orchestra.run.smithi149.stdout:(10/13): python3-google-auth-2.28.2-1.el9.noarc 1.8 MB/s | 203 kB 00:00 2024-03-26T16:42:45.266 INFO:teuthology.orchestra.run.smithi149.stdout:(11/13): python3-rsa-4.9-2.el9.noarch.rpm 1.0 MB/s | 59 kB 00:00 2024-03-26T16:42:45.291 INFO:teuthology.orchestra.run.smithi149.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 1.5 MB/s | 90 kB 00:00 2024-03-26T16:42:45.325 INFO:teuthology.orchestra.run.smithi149.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 7.2 MB/s | 1.0 MB 00:00 2024-03-26T16:42:45.326 INFO:teuthology.orchestra.run.smithi149.stdout:-------------------------------------------------------------------------------- 2024-03-26T16:42:45.327 INFO:teuthology.orchestra.run.smithi149.stdout:Total 3.6 MB/s | 2.0 MB 00:00 2024-03-26T16:42:45.327 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction check 2024-03-26T16:42:45.340 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction check succeeded. 2024-03-26T16:42:45.341 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction test 2024-03-26T16:42:45.432 INFO:teuthology.orchestra.run.smithi157.stdout:Last metadata expiration check: 0:01:22 ago on Tue 26 Mar 2024 04:41:23 PM UTC. 2024-03-26T16:42:45.434 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction test succeeded. 2024-03-26T16:42:45.435 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction 2024-03-26T16:42:45.583 INFO:teuthology.orchestra.run.smithi157.stdout:Dependencies resolved. 2024-03-26T16:42:45.584 INFO:teuthology.orchestra.run.smithi157.stdout:============================================================================================ 2024-03-26T16:42:45.584 INFO:teuthology.orchestra.run.smithi157.stdout: Package Arch Version Repository Size 2024-03-26T16:42:45.584 INFO:teuthology.orchestra.run.smithi157.stdout:============================================================================================ 2024-03-26T16:42:45.584 INFO:teuthology.orchestra.run.smithi157.stdout:Installing: 2024-03-26T16:42:45.584 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-2382.gbf9505fb.el9 ceph-noarch 7.4 M 2024-03-26T16:42:45.584 INFO:teuthology.orchestra.run.smithi157.stdout:Installing dependencies: 2024-03-26T16:42:45.584 INFO:teuthology.orchestra.run.smithi157.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2024-03-26T16:42:45.584 INFO:teuthology.orchestra.run.smithi157.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2024-03-26T16:42:45.584 INFO:teuthology.orchestra.run.smithi157.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2024-03-26T16:42:45.584 INFO:teuthology.orchestra.run.smithi157.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-03-26T16:42:45.585 INFO:teuthology.orchestra.run.smithi157.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-03-26T16:42:45.585 INFO:teuthology.orchestra.run.smithi157.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2024-03-26T16:42:45.585 INFO:teuthology.orchestra.run.smithi157.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2024-03-26T16:42:45.585 INFO:teuthology.orchestra.run.smithi157.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-03-26T16:42:45.585 INFO:teuthology.orchestra.run.smithi157.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2024-03-26T16:42:45.585 INFO:teuthology.orchestra.run.smithi157.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2024-03-26T16:42:45.585 INFO:teuthology.orchestra.run.smithi157.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2024-03-26T16:42:45.585 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-03-26T16:42:45.585 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction Summary 2024-03-26T16:42:45.585 INFO:teuthology.orchestra.run.smithi157.stdout:============================================================================================ 2024-03-26T16:42:45.585 INFO:teuthology.orchestra.run.smithi157.stdout:Install 12 Packages 2024-03-26T16:42:45.585 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-03-26T16:42:45.586 INFO:teuthology.orchestra.run.smithi157.stdout:Total download size: 37 M 2024-03-26T16:42:45.586 INFO:teuthology.orchestra.run.smithi157.stdout:Installed size: 209 M 2024-03-26T16:42:45.586 INFO:teuthology.orchestra.run.smithi157.stdout:Downloading Packages: 2024-03-26T16:42:45.899 INFO:teuthology.orchestra.run.smithi157.stdout:(1/12): flexiblas-3.0.4-8.el9.x86_64.rpm 228 kB/s | 32 kB 00:00 2024-03-26T16:42:45.932 INFO:teuthology.orchestra.run.smithi157.stdout:(2/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 536 kB/s | 17 kB 00:00 2024-03-26T16:42:45.957 INFO:teuthology.orchestra.run.smithi149.stdout: Preparing : 1/1 2024-03-26T16:42:45.974 INFO:teuthology.orchestra.run.smithi157.stdout:(3/12): openblas-0.3.21-2.el9.x86_64.rpm 854 kB/s | 34 kB 00:00 2024-03-26T16:42:46.033 INFO:teuthology.orchestra.run.smithi157.stdout:(4/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 11 MB/s | 3.0 MB 00:00 2024-03-26T16:42:46.130 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-03-26T16:42:46.192 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-03-26T16:42:46.200 INFO:teuthology.orchestra.run.smithi157.stdout:(5/12): openblas-openmp-0.3.21-2.el9.x86_64.rpm 21 MB/s | 4.7 MB 00:00 2024-03-26T16:42:46.248 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-03-26T16:42:46.267 INFO:teuthology.orchestra.run.smithi157.stdout:(6/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 20 MB/s | 4.8 MB 00:00 2024-03-26T16:42:46.285 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-03-26T16:42:46.292 INFO:teuthology.orchestra.run.smithi157.stdout:(7/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 2.4 MB/s | 217 kB 00:00 2024-03-26T16:42:46.326 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 5/13 2024-03-26T16:42:46.419 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-03-26T16:42:46.451 INFO:teuthology.orchestra.run.smithi157.stdout:(8/12): libgfortran-11.4.1-3.el9.x86_64.rpm 5.0 MB/s | 803 kB 00:00 2024-03-26T16:42:46.528 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-google-auth-1:2.28.2-1.el9.noarch 7/13 2024-03-26T16:42:46.586 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-03-26T16:42:46.626 INFO:teuthology.orchestra.run.smithi157.stdout:(9/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 44 MB/s | 16 MB 00:00 2024-03-26T16:42:46.718 INFO:teuthology.orchestra.run.smithi157.stdout:(10/12): ceph-mgr-diskprediction-local-19.0.0-2 7.7 MB/s | 7.4 MB 00:00 2024-03-26T16:42:46.768 INFO:teuthology.orchestra.run.smithi157.stdout:(11/12): libquadmath-11.4.1-3.el9.x86_64.rpm 617 kB/s | 195 kB 00:00 2024-03-26T16:42:47.010 INFO:teuthology.orchestra.run.smithi157.stdout:(12/12): python3-devel-3.9.17-2.el9.x86_64.rpm 640 kB/s | 245 kB 00:00 2024-03-26T16:42:47.013 INFO:teuthology.orchestra.run.smithi157.stdout:-------------------------------------------------------------------------------- 2024-03-26T16:42:47.013 INFO:teuthology.orchestra.run.smithi157.stdout:Total 26 MB/s | 37 MB 00:01 2024-03-26T16:42:47.057 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction check 2024-03-26T16:42:47.084 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction check succeeded. 2024-03-26T16:42:47.084 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction test 2024-03-26T16:42:47.311 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-03-26T16:42:47.358 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-03-26T16:42:47.392 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-03-26T16:42:47.439 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction test succeeded. 2024-03-26T16:42:47.439 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction 2024-03-26T16:42:47.440 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-03-26T16:42:47.462 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-mgr-rook-2:19.0.0-2382.gbf9505fb.el9.noarch 13/13 2024-03-26T16:42:48.138 INFO:teuthology.orchestra.run.smithi157.stdout: Preparing : 1/1 2024-03-26T16:42:48.216 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 1/12 2024-03-26T16:42:48.246 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-2382.gbf9505fb.el9.noarch 13/13 2024-03-26T16:42:48.246 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-mgr-rook-2:19.0.0-2382.gbf9505fb.el9.noarch 1/13 2024-03-26T16:42:48.246 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-03-26T16:42:48.246 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-03-26T16:42:48.246 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-03-26T16:42:48.246 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-03-26T16:42:48.246 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-03-26T16:42:48.247 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-03-26T16:42:48.247 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-03-26T16:42:48.247 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 9/13 2024-03-26T16:42:48.247 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-google-auth-1:2.28.2-1.el9.noarch 10/13 2024-03-26T16:42:48.247 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-03-26T16:42:48.247 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-03-26T16:42:48.256 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 2/12 2024-03-26T16:42:48.349 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 3/12 2024-03-26T16:42:48.401 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 4/12 2024-03-26T16:42:48.578 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : openblas-0.3.21-2.el9.x86_64 5/12 2024-03-26T16:42:48.608 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2024-03-26T16:42:48.612 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-03-26T16:42:48.612 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-03-26T16:42:48.612 INFO:teuthology.orchestra.run.smithi149.stdout:Installed: 2024-03-26T16:42:48.612 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-rook-2:19.0.0-2382.gbf9505fb.el9.noarch 2024-03-26T16:42:48.612 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-03-26T16:42:48.612 INFO:teuthology.orchestra.run.smithi149.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-03-26T16:42:48.612 INFO:teuthology.orchestra.run.smithi149.stdout: python3-google-auth-1:2.28.2-1.el9.noarch 2024-03-26T16:42:48.612 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-03-26T16:42:48.612 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-03-26T16:42:48.612 INFO:teuthology.orchestra.run.smithi149.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-03-26T16:42:48.612 INFO:teuthology.orchestra.run.smithi149.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-03-26T16:42:48.612 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-03-26T16:42:48.613 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-03-26T16:42:48.613 INFO:teuthology.orchestra.run.smithi149.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-03-26T16:42:48.613 INFO:teuthology.orchestra.run.smithi149.stdout: python3-rsa-4.9-2.el9.noarch 2024-03-26T16:42:48.613 INFO:teuthology.orchestra.run.smithi149.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-03-26T16:42:48.613 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-03-26T16:42:48.613 INFO:teuthology.orchestra.run.smithi149.stdout:Complete! 2024-03-26T16:42:48.690 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-03-26T16:42:48.889 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum -y install ceph-mgr-cephadm 2024-03-26T16:42:49.357 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-03-26T16:42:49.462 INFO:teuthology.orchestra.run.smithi149.stdout:Last metadata expiration check: 0:01:27 ago on Tue 26 Mar 2024 04:41:22 PM UTC. 2024-03-26T16:42:49.462 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-03-26T16:42:49.613 INFO:teuthology.orchestra.run.smithi149.stdout:Dependencies resolved. 2024-03-26T16:42:49.613 INFO:teuthology.orchestra.run.smithi149.stdout:======================================================================================== 2024-03-26T16:42:49.613 INFO:teuthology.orchestra.run.smithi149.stdout: Package Arch Version Repository Size 2024-03-26T16:42:49.613 INFO:teuthology.orchestra.run.smithi149.stdout:======================================================================================== 2024-03-26T16:42:49.613 INFO:teuthology.orchestra.run.smithi149.stdout:Installing: 2024-03-26T16:42:49.613 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-cephadm noarch 2:19.0.0-2382.gbf9505fb.el9 ceph-noarch 140 k 2024-03-26T16:42:49.614 INFO:teuthology.orchestra.run.smithi149.stdout:Installing dependencies: 2024-03-26T16:42:49.614 INFO:teuthology.orchestra.run.smithi149.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-03-26T16:42:49.614 INFO:teuthology.orchestra.run.smithi149.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2024-03-26T16:42:49.614 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-03-26T16:42:49.614 INFO:teuthology.orchestra.run.smithi149.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-03-26T16:42:49.614 INFO:teuthology.orchestra.run.smithi149.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-03-26T16:42:49.614 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-03-26T16:42:49.614 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction Summary 2024-03-26T16:42:49.614 INFO:teuthology.orchestra.run.smithi149.stdout:======================================================================================== 2024-03-26T16:42:49.614 INFO:teuthology.orchestra.run.smithi149.stdout:Install 6 Packages 2024-03-26T16:42:49.614 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-03-26T16:42:49.615 INFO:teuthology.orchestra.run.smithi149.stdout:Total download size: 6.8 M 2024-03-26T16:42:49.615 INFO:teuthology.orchestra.run.smithi149.stdout:Installed size: 33 M 2024-03-26T16:42:49.615 INFO:teuthology.orchestra.run.smithi149.stdout:Downloading Packages: 2024-03-26T16:42:50.319 INFO:teuthology.orchestra.run.smithi149.stdout:(1/6): python3-babel-2.9.1-2.el9.noarch.rpm 23 MB/s | 5.8 MB 00:00 2024-03-26T16:42:50.444 INFO:teuthology.orchestra.run.smithi149.stdout:(2/6): ceph-mgr-cephadm-19.0.0-2382.gbf9505fb.e 371 kB/s | 140 kB 00:00 2024-03-26T16:42:50.695 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-03-26T16:42:51.044 INFO:teuthology.orchestra.run.smithi149.stdout:(3/6): python3-jinja2-2.11.3-5.el9.noarch.rpm 253 kB/s | 248 kB 00:00 2024-03-26T16:42:51.136 INFO:teuthology.orchestra.run.smithi149.stdout:(4/6): python3-typing-extensions-4.4.0-2.el9.no 557 kB/s | 51 kB 00:00 2024-03-26T16:42:51.378 INFO:teuthology.orchestra.run.smithi149.stdout:(5/6): python3-natsort-7.1.1-5.el9.noarch.rpm 62 kB/s | 58 kB 00:00 2024-03-26T16:42:51.537 INFO:teuthology.orchestra.run.smithi149.stdout:(6/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 459 kB/s | 548 kB 00:01 2024-03-26T16:42:51.538 INFO:teuthology.orchestra.run.smithi149.stdout:-------------------------------------------------------------------------------- 2024-03-26T16:42:51.538 INFO:teuthology.orchestra.run.smithi149.stdout:Total 3.5 MB/s | 6.8 MB 00:01 2024-03-26T16:42:51.554 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction check 2024-03-26T16:42:51.571 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction check succeeded. 2024-03-26T16:42:51.571 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction test 2024-03-26T16:42:51.668 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction test succeeded. 2024-03-26T16:42:51.670 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction 2024-03-26T16:42:51.716 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-03-26T16:42:51.741 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-2382.gbf950 12/12 2024-03-26T16:42:51.970 INFO:teuthology.orchestra.run.smithi149.stdout: Preparing : 1/1 2024-03-26T16:42:52.128 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 1/6 2024-03-26T16:42:52.180 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-03-26T16:42:52.694 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-03-26T16:42:52.774 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-03-26T16:42:52.837 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 5/6 2024-03-26T16:42:52.867 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-2382.gbf9505fb.el9.noarch 6/6 2024-03-26T16:42:53.695 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-2382.gbf9505fb.el9.noarch 6/6 2024-03-26T16:42:53.695 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-2382.gbf9505fb.el9.noarch 1/6 2024-03-26T16:42:53.695 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-03-26T16:42:53.695 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 3/6 2024-03-26T16:42:53.695 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-03-26T16:42:53.695 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-03-26T16:42:53.991 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 6/6 2024-03-26T16:42:53.991 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-03-26T16:42:53.991 INFO:teuthology.orchestra.run.smithi149.stdout:Installed: 2024-03-26T16:42:53.991 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-cephadm-2:19.0.0-2382.gbf9505fb.el9.noarch 2024-03-26T16:42:53.991 INFO:teuthology.orchestra.run.smithi149.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-03-26T16:42:53.991 INFO:teuthology.orchestra.run.smithi149.stdout: python3-babel-2.9.1-2.el9.noarch 2024-03-26T16:42:53.991 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-03-26T16:42:53.991 INFO:teuthology.orchestra.run.smithi149.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-03-26T16:42:53.991 INFO:teuthology.orchestra.run.smithi149.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-03-26T16:42:53.991 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-03-26T16:42:53.992 INFO:teuthology.orchestra.run.smithi149.stdout:Complete! 2024-03-26T16:42:54.234 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum -y install ceph-fuse 2024-03-26T16:42:54.267 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-2382.gbf950 12/12 2024-03-26T16:42:54.267 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-2382.gbf950 1/12 2024-03-26T16:42:54.267 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 2/12 2024-03-26T16:42:54.268 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 3/12 2024-03-26T16:42:54.268 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 4/12 2024-03-26T16:42:54.268 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 5/12 2024-03-26T16:42:54.268 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2024-03-26T16:42:54.268 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 7/12 2024-03-26T16:42:54.268 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 8/12 2024-03-26T16:42:54.268 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 9/12 2024-03-26T16:42:54.268 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 10/12 2024-03-26T16:42:54.268 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 11/12 2024-03-26T16:42:54.735 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 12/12 2024-03-26T16:42:54.735 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-03-26T16:42:54.735 INFO:teuthology.orchestra.run.smithi157.stdout:Installed: 2024-03-26T16:42:54.735 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr-diskprediction-local-2:19.0.0-2382.gbf9505fb.el9.noarch 2024-03-26T16:42:54.735 INFO:teuthology.orchestra.run.smithi157.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-03-26T16:42:54.735 INFO:teuthology.orchestra.run.smithi157.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-03-26T16:42:54.735 INFO:teuthology.orchestra.run.smithi157.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-03-26T16:42:54.735 INFO:teuthology.orchestra.run.smithi157.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-03-26T16:42:54.735 INFO:teuthology.orchestra.run.smithi157.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-03-26T16:42:54.736 INFO:teuthology.orchestra.run.smithi157.stdout: openblas-0.3.21-2.el9.x86_64 2024-03-26T16:42:54.736 INFO:teuthology.orchestra.run.smithi157.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-03-26T16:42:54.736 INFO:teuthology.orchestra.run.smithi157.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-03-26T16:42:54.736 INFO:teuthology.orchestra.run.smithi157.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-03-26T16:42:54.736 INFO:teuthology.orchestra.run.smithi157.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-03-26T16:42:54.736 INFO:teuthology.orchestra.run.smithi157.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-03-26T16:42:54.736 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-03-26T16:42:54.736 INFO:teuthology.orchestra.run.smithi157.stdout:Complete! 2024-03-26T16:42:54.802 INFO:teuthology.orchestra.run.smithi149.stdout:Last metadata expiration check: 0:01:32 ago on Tue 26 Mar 2024 04:41:22 PM UTC. 2024-03-26T16:42:54.954 INFO:teuthology.orchestra.run.smithi149.stdout:Dependencies resolved. 2024-03-26T16:42:54.954 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-03-26T16:42:54.955 INFO:teuthology.orchestra.run.smithi149.stdout: Package Arch Version Repository Size 2024-03-26T16:42:54.955 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-03-26T16:42:54.955 INFO:teuthology.orchestra.run.smithi149.stdout:Installing: 2024-03-26T16:42:54.955 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-fuse x86_64 2:19.0.0-2382.gbf9505fb.el9 ceph 891 k 2024-03-26T16:42:54.955 INFO:teuthology.orchestra.run.smithi149.stdout:Installing dependencies: 2024-03-26T16:42:54.955 INFO:teuthology.orchestra.run.smithi149.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2024-03-26T16:42:54.955 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-03-26T16:42:54.955 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction Summary 2024-03-26T16:42:54.955 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-03-26T16:42:54.955 INFO:teuthology.orchestra.run.smithi149.stdout:Install 2 Packages 2024-03-26T16:42:54.955 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-03-26T16:42:54.955 INFO:teuthology.orchestra.run.smithi149.stdout:Total download size: 969 k 2024-03-26T16:42:54.955 INFO:teuthology.orchestra.run.smithi149.stdout:Installed size: 2.8 M 2024-03-26T16:42:54.955 INFO:teuthology.orchestra.run.smithi149.stdout:Downloading Packages: 2024-03-26T16:42:55.080 INFO:teuthology.orchestra.run.smithi149.stdout:(1/2): fuse-2.9.9-15.el9.x86_64.rpm 633 kB/s | 79 kB 00:00 2024-03-26T16:42:55.134 DEBUG:teuthology.orchestra.run.smithi157:> sudo yum -y install ceph-mgr-rook 2024-03-26T16:42:55.288 INFO:teuthology.orchestra.run.smithi149.stdout:(2/2): ceph-fuse-19.0.0-2382.gbf9505fb.el9.x86_ 2.6 MB/s | 891 kB 00:00 2024-03-26T16:42:55.289 INFO:teuthology.orchestra.run.smithi149.stdout:-------------------------------------------------------------------------------- 2024-03-26T16:42:55.290 INFO:teuthology.orchestra.run.smithi149.stdout:Total 2.8 MB/s | 969 kB 00:00 2024-03-26T16:42:55.290 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction check 2024-03-26T16:42:55.311 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction check succeeded. 2024-03-26T16:42:55.311 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction test 2024-03-26T16:42:55.386 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction test succeeded. 2024-03-26T16:42:55.386 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction 2024-03-26T16:42:55.577 INFO:teuthology.orchestra.run.smithi149.stdout: Preparing : 1/1 2024-03-26T16:42:55.704 INFO:teuthology.orchestra.run.smithi157.stdout:Last metadata expiration check: 0:01:32 ago on Tue 26 Mar 2024 04:41:23 PM UTC. 2024-03-26T16:42:55.714 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : fuse-2.9.9-15.el9.x86_64 1/2 2024-03-26T16:42:55.780 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-fuse-2:19.0.0-2382.gbf9505fb.el9.x86_64 2/2 2024-03-26T16:42:55.853 INFO:teuthology.orchestra.run.smithi157.stdout:Dependencies resolved. 2024-03-26T16:42:55.854 INFO:teuthology.orchestra.run.smithi157.stdout:======================================================================================== 2024-03-26T16:42:55.854 INFO:teuthology.orchestra.run.smithi157.stdout: Package Arch Version Repository Size 2024-03-26T16:42:55.854 INFO:teuthology.orchestra.run.smithi157.stdout:======================================================================================== 2024-03-26T16:42:55.854 INFO:teuthology.orchestra.run.smithi157.stdout:Installing: 2024-03-26T16:42:55.855 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr-rook noarch 2:19.0.0-2382.gbf9505fb.el9 ceph-noarch 49 k 2024-03-26T16:42:55.855 INFO:teuthology.orchestra.run.smithi157.stdout:Installing dependencies: 2024-03-26T16:42:55.855 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-03-26T16:42:55.855 INFO:teuthology.orchestra.run.smithi157.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-03-26T16:42:55.855 INFO:teuthology.orchestra.run.smithi157.stdout: python3-google-auth noarch 1:2.28.2-1.el9 epel 203 k 2024-03-26T16:42:55.855 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2024-03-26T16:42:55.855 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2024-03-26T16:42:55.855 INFO:teuthology.orchestra.run.smithi157.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-03-26T16:42:55.855 INFO:teuthology.orchestra.run.smithi157.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2024-03-26T16:42:55.855 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2024-03-26T16:42:55.855 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2024-03-26T16:42:55.855 INFO:teuthology.orchestra.run.smithi157.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2024-03-26T16:42:55.855 INFO:teuthology.orchestra.run.smithi157.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-03-26T16:42:55.856 INFO:teuthology.orchestra.run.smithi157.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-03-26T16:42:55.856 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-03-26T16:42:55.856 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction Summary 2024-03-26T16:42:55.856 INFO:teuthology.orchestra.run.smithi157.stdout:======================================================================================== 2024-03-26T16:42:55.856 INFO:teuthology.orchestra.run.smithi157.stdout:Install 13 Packages 2024-03-26T16:42:55.856 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-03-26T16:42:55.856 INFO:teuthology.orchestra.run.smithi157.stdout:Total download size: 2.0 M 2024-03-26T16:42:55.856 INFO:teuthology.orchestra.run.smithi157.stdout:Installed size: 26 M 2024-03-26T16:42:55.857 INFO:teuthology.orchestra.run.smithi157.stdout:Downloading Packages: 2024-03-26T16:42:56.332 INFO:teuthology.orchestra.run.smithi157.stdout:(1/13): python3-jsonpatch-1.21-16.el9.noarch.rp 182 kB/s | 24 kB 00:00 2024-03-26T16:42:56.357 INFO:teuthology.orchestra.run.smithi157.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 113 kB/s | 18 kB 00:00 2024-03-26T16:42:56.407 INFO:teuthology.orchestra.run.smithi157.stdout:(3/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 2.3 MB/s | 174 kB 00:00 2024-03-26T16:42:56.433 INFO:teuthology.orchestra.run.smithi157.stdout:(4/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.7 MB/s | 132 kB 00:00 2024-03-26T16:42:56.458 INFO:teuthology.orchestra.run.smithi157.stdout:(5/13): python3-pyasn1-modules-0.4.8-6.el9.noar 4.1 MB/s | 211 kB 00:00 2024-03-26T16:42:56.475 INFO:teuthology.orchestra.run.smithi157.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 1.0 MB/s | 43 kB 00:00 2024-03-26T16:42:56.492 INFO:teuthology.orchestra.run.smithi157.stdout:(7/13): ceph-mgr-rook-19.0.0-2382.gbf9505fb.el9 168 kB/s | 49 kB 00:00 2024-03-26T16:42:56.493 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-fuse-2:19.0.0-2382.gbf9505fb.el9.x86_64 2/2 2024-03-26T16:42:56.493 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-fuse-2:19.0.0-2382.gbf9505fb.el9.x86_64 1/2 2024-03-26T16:42:56.811 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 2/2 2024-03-26T16:42:56.811 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-03-26T16:42:56.811 INFO:teuthology.orchestra.run.smithi149.stdout:Installed: 2024-03-26T16:42:56.811 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-fuse-2:19.0.0-2382.gbf9505fb.el9.x86_64 fuse-2.9.9-15.el9.x86_64 2024-03-26T16:42:56.811 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-03-26T16:42:56.811 INFO:teuthology.orchestra.run.smithi149.stdout:Complete! 2024-03-26T16:42:56.876 INFO:teuthology.orchestra.run.smithi157.stdout:(8/13): python3-certifi-2021.10.8-2.el9.noarch. 37 kB/s | 15 kB 00:00 2024-03-26T16:42:56.892 INFO:teuthology.orchestra.run.smithi157.stdout:(9/13): python3-cachetools-4.2.4-1.el9.noarch.r 74 kB/s | 32 kB 00:00 2024-03-26T16:42:57.084 INFO:teuthology.orchestra.run.smithi157.stdout:(10/13): python3-rsa-4.9-2.el9.noarch.rpm 309 kB/s | 59 kB 00:00 2024-03-26T16:42:57.116 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum -y install ceph-volume 2024-03-26T16:42:57.134 INFO:teuthology.orchestra.run.smithi157.stdout:(11/13): python3-google-auth-2.28.2-1.el9.noarc 315 kB/s | 203 kB 00:00 2024-03-26T16:42:57.251 INFO:teuthology.orchestra.run.smithi157.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 537 kB/s | 90 kB 00:00 2024-03-26T16:42:57.476 INFO:teuthology.orchestra.run.smithi157.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 1.7 MB/s | 1.0 MB 00:00 2024-03-26T16:42:57.481 INFO:teuthology.orchestra.run.smithi157.stdout:-------------------------------------------------------------------------------- 2024-03-26T16:42:57.481 INFO:teuthology.orchestra.run.smithi157.stdout:Total 1.3 MB/s | 2.0 MB 00:01 2024-03-26T16:42:57.482 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction check 2024-03-26T16:42:57.496 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction check succeeded. 2024-03-26T16:42:57.496 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction test 2024-03-26T16:42:57.594 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction test succeeded. 2024-03-26T16:42:57.596 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction 2024-03-26T16:42:57.708 INFO:teuthology.orchestra.run.smithi149.stdout:Last metadata expiration check: 0:01:35 ago on Tue 26 Mar 2024 04:41:22 PM UTC. 2024-03-26T16:42:57.859 INFO:teuthology.orchestra.run.smithi149.stdout:Dependencies resolved. 2024-03-26T16:42:57.859 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-03-26T16:42:57.860 INFO:teuthology.orchestra.run.smithi149.stdout: Package Arch Version Repository Size 2024-03-26T16:42:57.860 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-03-26T16:42:57.860 INFO:teuthology.orchestra.run.smithi149.stdout:Installing: 2024-03-26T16:42:57.860 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-volume noarch 2:19.0.0-2382.gbf9505fb.el9 ceph-noarch 264 k 2024-03-26T16:42:57.860 INFO:teuthology.orchestra.run.smithi149.stdout:Installing dependencies: 2024-03-26T16:42:57.860 INFO:teuthology.orchestra.run.smithi149.stdout: python3-packaging noarch 20.9-5.el9 CentOS-AppStream 69 k 2024-03-26T16:42:57.860 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-03-26T16:42:57.860 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction Summary 2024-03-26T16:42:57.860 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-03-26T16:42:57.860 INFO:teuthology.orchestra.run.smithi149.stdout:Install 2 Packages 2024-03-26T16:42:57.860 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-03-26T16:42:57.861 INFO:teuthology.orchestra.run.smithi149.stdout:Total download size: 332 k 2024-03-26T16:42:57.861 INFO:teuthology.orchestra.run.smithi149.stdout:Installed size: 1.5 M 2024-03-26T16:42:57.861 INFO:teuthology.orchestra.run.smithi149.stdout:Downloading Packages: 2024-03-26T16:42:57.977 INFO:teuthology.orchestra.run.smithi149.stdout:(1/2): python3-packaging-20.9-5.el9.noarch.rpm 594 kB/s | 69 kB 00:00 2024-03-26T16:42:58.119 INFO:teuthology.orchestra.run.smithi157.stdout: Preparing : 1/1 2024-03-26T16:42:58.277 INFO:teuthology.orchestra.run.smithi149.stdout:(2/2): ceph-volume-19.0.0-2382.gbf9505fb.el9.no 634 kB/s | 264 kB 00:00 2024-03-26T16:42:58.278 INFO:teuthology.orchestra.run.smithi149.stdout:-------------------------------------------------------------------------------- 2024-03-26T16:42:58.278 INFO:teuthology.orchestra.run.smithi149.stdout:Total 795 kB/s | 332 kB 00:00 2024-03-26T16:42:58.279 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction check 2024-03-26T16:42:58.279 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-03-26T16:42:58.287 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction check succeeded. 2024-03-26T16:42:58.287 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction test 2024-03-26T16:42:58.327 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction test succeeded. 2024-03-26T16:42:58.328 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction 2024-03-26T16:42:58.344 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-03-26T16:42:58.398 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-03-26T16:42:58.445 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-03-26T16:42:58.481 INFO:teuthology.orchestra.run.smithi149.stdout: Preparing : 1/1 2024-03-26T16:42:58.486 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 5/13 2024-03-26T16:42:58.579 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-03-26T16:42:58.668 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-packaging-20.9-5.el9.noarch 1/2 2024-03-26T16:42:58.680 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-google-auth-1:2.28.2-1.el9.noarch 7/13 2024-03-26T16:42:58.705 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-volume-2:19.0.0-2382.gbf9505fb.el9.noarch 2/2 2024-03-26T16:42:58.720 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-volume-2:19.0.0-2382.gbf9505fb.el9.noarch 2/2 2024-03-26T16:42:58.720 INFO:teuthology.orchestra.run.smithi149.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-26T16:42:58.720 INFO:teuthology.orchestra.run.smithi149.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-03-26T16:42:58.721 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-03-26T16:42:58.729 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-03-26T16:42:59.434 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-volume-2:19.0.0-2382.gbf9505fb.el9.noarch 1/2 2024-03-26T16:42:59.443 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-03-26T16:42:59.493 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-03-26T16:42:59.527 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-03-26T16:42:59.584 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-03-26T16:42:59.613 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-mgr-rook-2:19.0.0-2382.gbf9505fb.el9.noarch 13/13 2024-03-26T16:42:59.773 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 2/2 2024-03-26T16:42:59.774 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-03-26T16:42:59.774 INFO:teuthology.orchestra.run.smithi149.stdout:Installed: 2024-03-26T16:42:59.774 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-volume-2:19.0.0-2382.gbf9505fb.el9.noarch 2024-03-26T16:42:59.774 INFO:teuthology.orchestra.run.smithi149.stdout: python3-packaging-20.9-5.el9.noarch 2024-03-26T16:42:59.774 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-03-26T16:42:59.774 INFO:teuthology.orchestra.run.smithi149.stdout:Complete! 2024-03-26T16:43:00.112 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum -y install librados-devel 2024-03-26T16:43:00.400 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-2382.gbf9505fb.el9.noarch 13/13 2024-03-26T16:43:00.400 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-mgr-rook-2:19.0.0-2382.gbf9505fb.el9.noarch 1/13 2024-03-26T16:43:00.400 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-03-26T16:43:00.400 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-03-26T16:43:00.401 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-03-26T16:43:00.401 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-03-26T16:43:00.401 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-03-26T16:43:00.401 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-03-26T16:43:00.401 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-03-26T16:43:00.401 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 9/13 2024-03-26T16:43:00.401 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-google-auth-1:2.28.2-1.el9.noarch 10/13 2024-03-26T16:43:00.401 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-03-26T16:43:00.401 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-03-26T16:43:00.696 INFO:teuthology.orchestra.run.smithi149.stdout:Last metadata expiration check: 0:01:38 ago on Tue 26 Mar 2024 04:41:22 PM UTC. 2024-03-26T16:43:00.757 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-03-26T16:43:00.757 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-03-26T16:43:00.757 INFO:teuthology.orchestra.run.smithi157.stdout:Installed: 2024-03-26T16:43:00.757 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr-rook-2:19.0.0-2382.gbf9505fb.el9.noarch 2024-03-26T16:43:00.757 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-03-26T16:43:00.757 INFO:teuthology.orchestra.run.smithi157.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-03-26T16:43:00.757 INFO:teuthology.orchestra.run.smithi157.stdout: python3-google-auth-1:2.28.2-1.el9.noarch 2024-03-26T16:43:00.757 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-03-26T16:43:00.757 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-03-26T16:43:00.757 INFO:teuthology.orchestra.run.smithi157.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-03-26T16:43:00.757 INFO:teuthology.orchestra.run.smithi157.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-03-26T16:43:00.757 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-03-26T16:43:00.758 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-03-26T16:43:00.758 INFO:teuthology.orchestra.run.smithi157.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-03-26T16:43:00.758 INFO:teuthology.orchestra.run.smithi157.stdout: python3-rsa-4.9-2.el9.noarch 2024-03-26T16:43:00.758 INFO:teuthology.orchestra.run.smithi157.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-03-26T16:43:00.758 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-03-26T16:43:00.758 INFO:teuthology.orchestra.run.smithi157.stdout:Complete! 2024-03-26T16:43:00.847 INFO:teuthology.orchestra.run.smithi149.stdout:Dependencies resolved. 2024-03-26T16:43:00.847 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-03-26T16:43:00.848 INFO:teuthology.orchestra.run.smithi149.stdout: Package Arch Version Repo Size 2024-03-26T16:43:00.848 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-03-26T16:43:00.848 INFO:teuthology.orchestra.run.smithi149.stdout:Installing: 2024-03-26T16:43:00.848 INFO:teuthology.orchestra.run.smithi149.stdout: librados-devel x86_64 2:19.0.0-2382.gbf9505fb.el9 ceph 127 k 2024-03-26T16:43:00.848 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-03-26T16:43:00.848 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction Summary 2024-03-26T16:43:00.848 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-03-26T16:43:00.848 INFO:teuthology.orchestra.run.smithi149.stdout:Install 1 Package 2024-03-26T16:43:00.848 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-03-26T16:43:00.848 INFO:teuthology.orchestra.run.smithi149.stdout:Total download size: 127 k 2024-03-26T16:43:00.848 INFO:teuthology.orchestra.run.smithi149.stdout:Installed size: 456 k 2024-03-26T16:43:00.848 INFO:teuthology.orchestra.run.smithi149.stdout:Downloading Packages: 2024-03-26T16:43:01.018 DEBUG:teuthology.orchestra.run.smithi157:> sudo yum -y install ceph-mgr-cephadm 2024-03-26T16:43:01.069 INFO:teuthology.orchestra.run.smithi149.stdout:librados-devel-19.0.0-2382.gbf9505fb.el9.x86_64 574 kB/s | 127 kB 00:00 2024-03-26T16:43:01.069 INFO:teuthology.orchestra.run.smithi149.stdout:-------------------------------------------------------------------------------- 2024-03-26T16:43:01.070 INFO:teuthology.orchestra.run.smithi149.stdout:Total 571 kB/s | 127 kB 00:00 2024-03-26T16:43:01.070 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction check 2024-03-26T16:43:01.075 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction check succeeded. 2024-03-26T16:43:01.075 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction test 2024-03-26T16:43:01.130 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction test succeeded. 2024-03-26T16:43:01.130 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction 2024-03-26T16:43:01.273 INFO:teuthology.orchestra.run.smithi149.stdout: Preparing : 1/1 2024-03-26T16:43:01.384 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : librados-devel-2:19.0.0-2382.gbf9505fb.el9.x86_64 1/1 2024-03-26T16:43:01.580 INFO:teuthology.orchestra.run.smithi157.stdout:Last metadata expiration check: 0:01:38 ago on Tue 26 Mar 2024 04:41:23 PM UTC. 2024-03-26T16:43:01.730 INFO:teuthology.orchestra.run.smithi157.stdout:Dependencies resolved. 2024-03-26T16:43:01.730 INFO:teuthology.orchestra.run.smithi157.stdout:======================================================================================== 2024-03-26T16:43:01.730 INFO:teuthology.orchestra.run.smithi157.stdout: Package Arch Version Repository Size 2024-03-26T16:43:01.730 INFO:teuthology.orchestra.run.smithi157.stdout:======================================================================================== 2024-03-26T16:43:01.731 INFO:teuthology.orchestra.run.smithi157.stdout:Installing: 2024-03-26T16:43:01.731 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr-cephadm noarch 2:19.0.0-2382.gbf9505fb.el9 ceph-noarch 140 k 2024-03-26T16:43:01.731 INFO:teuthology.orchestra.run.smithi157.stdout:Installing dependencies: 2024-03-26T16:43:01.731 INFO:teuthology.orchestra.run.smithi157.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-03-26T16:43:01.731 INFO:teuthology.orchestra.run.smithi157.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2024-03-26T16:43:01.731 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-03-26T16:43:01.731 INFO:teuthology.orchestra.run.smithi157.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-03-26T16:43:01.731 INFO:teuthology.orchestra.run.smithi157.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-03-26T16:43:01.731 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-03-26T16:43:01.731 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction Summary 2024-03-26T16:43:01.731 INFO:teuthology.orchestra.run.smithi157.stdout:======================================================================================== 2024-03-26T16:43:01.731 INFO:teuthology.orchestra.run.smithi157.stdout:Install 6 Packages 2024-03-26T16:43:01.731 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-03-26T16:43:01.732 INFO:teuthology.orchestra.run.smithi157.stdout:Total download size: 6.8 M 2024-03-26T16:43:01.732 INFO:teuthology.orchestra.run.smithi157.stdout:Installed size: 33 M 2024-03-26T16:43:01.732 INFO:teuthology.orchestra.run.smithi157.stdout:Downloading Packages: 2024-03-26T16:43:01.861 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: librados-devel-2:19.0.0-2382.gbf9505fb.el9.x86_64 1/1 2024-03-26T16:43:02.120 INFO:teuthology.orchestra.run.smithi157.stdout:(1/6): python3-babel-2.9.1-2.el9.noarch.rpm 22 MB/s | 5.8 MB 00:00 2024-03-26T16:43:02.142 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : librados-devel-2:19.0.0-2382.gbf9505fb.el9.x86_64 1/1 2024-03-26T16:43:02.142 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-03-26T16:43:02.142 INFO:teuthology.orchestra.run.smithi149.stdout:Installed: 2024-03-26T16:43:02.142 INFO:teuthology.orchestra.run.smithi149.stdout: librados-devel-2:19.0.0-2382.gbf9505fb.el9.x86_64 2024-03-26T16:43:02.142 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-03-26T16:43:02.143 INFO:teuthology.orchestra.run.smithi149.stdout:Complete! 2024-03-26T16:43:02.144 INFO:teuthology.orchestra.run.smithi157.stdout:(2/6): ceph-mgr-cephadm-19.0.0-2382.gbf9505fb.e 495 kB/s | 140 kB 00:00 2024-03-26T16:43:02.320 INFO:teuthology.orchestra.run.smithi157.stdout:(3/6): python3-natsort-7.1.1-5.el9.noarch.rpm 329 kB/s | 58 kB 00:00 2024-03-26T16:43:02.378 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum -y install libcephfs2 2024-03-26T16:43:02.403 INFO:teuthology.orchestra.run.smithi157.stdout:(4/6): python3-typing-extensions-4.4.0-2.el9.no 612 kB/s | 51 kB 00:00 2024-03-26T16:43:02.437 INFO:teuthology.orchestra.run.smithi157.stdout:(5/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 1.7 MB/s | 548 kB 00:00 2024-03-26T16:43:02.462 INFO:teuthology.orchestra.run.smithi157.stdout:(6/6): python3-jinja2-2.11.3-5.el9.noarch.rpm 412 kB/s | 248 kB 00:00 2024-03-26T16:43:02.463 INFO:teuthology.orchestra.run.smithi157.stdout:-------------------------------------------------------------------------------- 2024-03-26T16:43:02.463 INFO:teuthology.orchestra.run.smithi157.stdout:Total 9.3 MB/s | 6.8 MB 00:00 2024-03-26T16:43:02.476 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction check 2024-03-26T16:43:02.487 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction check succeeded. 2024-03-26T16:43:02.487 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction test 2024-03-26T16:43:02.575 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction test succeeded. 2024-03-26T16:43:02.575 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction 2024-03-26T16:43:02.880 INFO:teuthology.orchestra.run.smithi157.stdout: Preparing : 1/1 2024-03-26T16:43:02.966 INFO:teuthology.orchestra.run.smithi149.stdout:Last metadata expiration check: 0:01:40 ago on Tue 26 Mar 2024 04:41:22 PM UTC. 2024-03-26T16:43:03.035 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 1/6 2024-03-26T16:43:03.068 INFO:teuthology.orchestra.run.smithi149.stdout:Package libcephfs2-2:19.0.0-2382.gbf9505fb.el9.x86_64 is already installed. 2024-03-26T16:43:03.088 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-03-26T16:43:03.122 INFO:teuthology.orchestra.run.smithi149.stdout:Dependencies resolved. 2024-03-26T16:43:03.124 INFO:teuthology.orchestra.run.smithi149.stdout:Nothing to do. 2024-03-26T16:43:03.124 INFO:teuthology.orchestra.run.smithi149.stdout:Complete! 2024-03-26T16:43:03.201 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum -y install libcephfs-devel 2024-03-26T16:43:03.606 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-03-26T16:43:03.682 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-03-26T16:43:03.745 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 5/6 2024-03-26T16:43:03.776 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-2382.gbf9505fb.el9.noarch 6/6 2024-03-26T16:43:03.777 INFO:teuthology.orchestra.run.smithi149.stdout:Last metadata expiration check: 0:01:41 ago on Tue 26 Mar 2024 04:41:22 PM UTC. 2024-03-26T16:43:03.927 INFO:teuthology.orchestra.run.smithi149.stdout:Dependencies resolved. 2024-03-26T16:43:03.928 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-03-26T16:43:03.928 INFO:teuthology.orchestra.run.smithi149.stdout: Package Arch Version Repo Size 2024-03-26T16:43:03.928 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-03-26T16:43:03.928 INFO:teuthology.orchestra.run.smithi149.stdout:Installing: 2024-03-26T16:43:03.928 INFO:teuthology.orchestra.run.smithi149.stdout: libcephfs-devel x86_64 2:19.0.0-2382.gbf9505fb.el9 ceph 32 k 2024-03-26T16:43:03.929 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-03-26T16:43:03.929 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction Summary 2024-03-26T16:43:03.929 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-03-26T16:43:03.929 INFO:teuthology.orchestra.run.smithi149.stdout:Install 1 Package 2024-03-26T16:43:03.929 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-03-26T16:43:03.929 INFO:teuthology.orchestra.run.smithi149.stdout:Total download size: 32 k 2024-03-26T16:43:03.929 INFO:teuthology.orchestra.run.smithi149.stdout:Installed size: 142 k 2024-03-26T16:43:03.929 INFO:teuthology.orchestra.run.smithi149.stdout:Downloading Packages: 2024-03-26T16:43:04.097 INFO:teuthology.orchestra.run.smithi149.stdout:libcephfs-devel-19.0.0-2382.gbf9505fb.el9.x86_6 188 kB/s | 32 kB 00:00 2024-03-26T16:43:04.098 INFO:teuthology.orchestra.run.smithi149.stdout:-------------------------------------------------------------------------------- 2024-03-26T16:43:04.098 INFO:teuthology.orchestra.run.smithi149.stdout:Total 187 kB/s | 32 kB 00:00 2024-03-26T16:43:04.098 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction check 2024-03-26T16:43:04.101 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction check succeeded. 2024-03-26T16:43:04.102 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction test 2024-03-26T16:43:04.127 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction test succeeded. 2024-03-26T16:43:04.127 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction 2024-03-26T16:43:04.258 INFO:teuthology.orchestra.run.smithi149.stdout: Preparing : 1/1 2024-03-26T16:43:04.346 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libcephfs-devel-2:19.0.0-2382.gbf9505fb.el9.x86_64 1/1 2024-03-26T16:43:04.561 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-2382.gbf9505fb.el9.noarch 6/6 2024-03-26T16:43:04.561 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-2382.gbf9505fb.el9.noarch 1/6 2024-03-26T16:43:04.561 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-03-26T16:43:04.561 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 3/6 2024-03-26T16:43:04.561 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-03-26T16:43:04.561 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-03-26T16:43:04.719 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: libcephfs-devel-2:19.0.0-2382.gbf9505fb.el9.x86_64 1/1 2024-03-26T16:43:04.866 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 6/6 2024-03-26T16:43:04.867 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-03-26T16:43:04.867 INFO:teuthology.orchestra.run.smithi157.stdout:Installed: 2024-03-26T16:43:04.867 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr-cephadm-2:19.0.0-2382.gbf9505fb.el9.noarch 2024-03-26T16:43:04.867 INFO:teuthology.orchestra.run.smithi157.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-03-26T16:43:04.867 INFO:teuthology.orchestra.run.smithi157.stdout: python3-babel-2.9.1-2.el9.noarch 2024-03-26T16:43:04.867 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-03-26T16:43:04.867 INFO:teuthology.orchestra.run.smithi157.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-03-26T16:43:04.867 INFO:teuthology.orchestra.run.smithi157.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-03-26T16:43:04.867 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-03-26T16:43:04.867 INFO:teuthology.orchestra.run.smithi157.stdout:Complete! 2024-03-26T16:43:04.998 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libcephfs-devel-2:19.0.0-2382.gbf9505fb.el9.x86_64 1/1 2024-03-26T16:43:04.998 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-03-26T16:43:04.998 INFO:teuthology.orchestra.run.smithi149.stdout:Installed: 2024-03-26T16:43:04.998 INFO:teuthology.orchestra.run.smithi149.stdout: libcephfs-devel-2:19.0.0-2382.gbf9505fb.el9.x86_64 2024-03-26T16:43:04.999 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-03-26T16:43:04.999 INFO:teuthology.orchestra.run.smithi149.stdout:Complete! 2024-03-26T16:43:05.142 DEBUG:teuthology.orchestra.run.smithi157:> sudo yum -y install ceph-fuse 2024-03-26T16:43:05.180 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum -y install librados2 2024-03-26T16:43:05.702 INFO:teuthology.orchestra.run.smithi157.stdout:Last metadata expiration check: 0:01:42 ago on Tue 26 Mar 2024 04:41:23 PM UTC. 2024-03-26T16:43:05.747 INFO:teuthology.orchestra.run.smithi149.stdout:Last metadata expiration check: 0:01:43 ago on Tue 26 Mar 2024 04:41:22 PM UTC. 2024-03-26T16:43:05.845 INFO:teuthology.orchestra.run.smithi149.stdout:Package librados2-2:19.0.0-2382.gbf9505fb.el9.x86_64 is already installed. 2024-03-26T16:43:05.852 INFO:teuthology.orchestra.run.smithi157.stdout:Dependencies resolved. 2024-03-26T16:43:05.853 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2024-03-26T16:43:05.853 INFO:teuthology.orchestra.run.smithi157.stdout: Package Arch Version Repository Size 2024-03-26T16:43:05.853 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2024-03-26T16:43:05.853 INFO:teuthology.orchestra.run.smithi157.stdout:Installing: 2024-03-26T16:43:05.853 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-fuse x86_64 2:19.0.0-2382.gbf9505fb.el9 ceph 891 k 2024-03-26T16:43:05.853 INFO:teuthology.orchestra.run.smithi157.stdout:Installing dependencies: 2024-03-26T16:43:05.853 INFO:teuthology.orchestra.run.smithi157.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2024-03-26T16:43:05.853 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-03-26T16:43:05.853 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction Summary 2024-03-26T16:43:05.853 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2024-03-26T16:43:05.853 INFO:teuthology.orchestra.run.smithi157.stdout:Install 2 Packages 2024-03-26T16:43:05.853 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-03-26T16:43:05.854 INFO:teuthology.orchestra.run.smithi157.stdout:Total download size: 969 k 2024-03-26T16:43:05.854 INFO:teuthology.orchestra.run.smithi157.stdout:Installed size: 2.8 M 2024-03-26T16:43:05.854 INFO:teuthology.orchestra.run.smithi157.stdout:Downloading Packages: 2024-03-26T16:43:05.897 INFO:teuthology.orchestra.run.smithi149.stdout:Dependencies resolved. 2024-03-26T16:43:05.898 INFO:teuthology.orchestra.run.smithi149.stdout:Nothing to do. 2024-03-26T16:43:05.898 INFO:teuthology.orchestra.run.smithi149.stdout:Complete! 2024-03-26T16:43:05.949 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum -y install librbd1 2024-03-26T16:43:05.980 INFO:teuthology.orchestra.run.smithi157.stdout:(1/2): fuse-2.9.9-15.el9.x86_64.rpm 625 kB/s | 79 kB 00:00 2024-03-26T16:43:06.305 INFO:teuthology.orchestra.run.smithi157.stdout:(2/2): ceph-fuse-19.0.0-2382.gbf9505fb.el9.x86_ 1.9 MB/s | 891 kB 00:00 2024-03-26T16:43:06.306 INFO:teuthology.orchestra.run.smithi157.stdout:-------------------------------------------------------------------------------- 2024-03-26T16:43:06.307 INFO:teuthology.orchestra.run.smithi157.stdout:Total 2.1 MB/s | 969 kB 00:00 2024-03-26T16:43:06.307 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction check 2024-03-26T16:43:06.328 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction check succeeded. 2024-03-26T16:43:06.328 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction test 2024-03-26T16:43:06.402 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction test succeeded. 2024-03-26T16:43:06.403 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction 2024-03-26T16:43:06.520 INFO:teuthology.orchestra.run.smithi149.stdout:Last metadata expiration check: 0:01:44 ago on Tue 26 Mar 2024 04:41:22 PM UTC. 2024-03-26T16:43:06.604 INFO:teuthology.orchestra.run.smithi157.stdout: Preparing : 1/1 2024-03-26T16:43:06.619 INFO:teuthology.orchestra.run.smithi149.stdout:Package librbd1-2:19.0.0-2382.gbf9505fb.el9.x86_64 is already installed. 2024-03-26T16:43:06.671 INFO:teuthology.orchestra.run.smithi149.stdout:Dependencies resolved. 2024-03-26T16:43:06.672 INFO:teuthology.orchestra.run.smithi149.stdout:Nothing to do. 2024-03-26T16:43:06.672 INFO:teuthology.orchestra.run.smithi149.stdout:Complete! 2024-03-26T16:43:06.724 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum -y install python3-rados 2024-03-26T16:43:06.753 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : fuse-2.9.9-15.el9.x86_64 1/2 2024-03-26T16:43:06.824 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-fuse-2:19.0.0-2382.gbf9505fb.el9.x86_64 2/2 2024-03-26T16:43:07.301 INFO:teuthology.orchestra.run.smithi149.stdout:Last metadata expiration check: 0:01:45 ago on Tue 26 Mar 2024 04:41:22 PM UTC. 2024-03-26T16:43:07.399 INFO:teuthology.orchestra.run.smithi149.stdout:Package python3-rados-2:19.0.0-2382.gbf9505fb.el9.x86_64 is already installed. 2024-03-26T16:43:07.452 INFO:teuthology.orchestra.run.smithi149.stdout:Dependencies resolved. 2024-03-26T16:43:07.453 INFO:teuthology.orchestra.run.smithi149.stdout:Nothing to do. 2024-03-26T16:43:07.453 INFO:teuthology.orchestra.run.smithi149.stdout:Complete! 2024-03-26T16:43:07.500 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-fuse-2:19.0.0-2382.gbf9505fb.el9.x86_64 2/2 2024-03-26T16:43:07.500 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-fuse-2:19.0.0-2382.gbf9505fb.el9.x86_64 1/2 2024-03-26T16:43:07.510 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum -y install python3-rgw 2024-03-26T16:43:07.804 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 2/2 2024-03-26T16:43:07.804 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-03-26T16:43:07.804 INFO:teuthology.orchestra.run.smithi157.stdout:Installed: 2024-03-26T16:43:07.804 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-fuse-2:19.0.0-2382.gbf9505fb.el9.x86_64 fuse-2.9.9-15.el9.x86_64 2024-03-26T16:43:07.804 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-03-26T16:43:07.804 INFO:teuthology.orchestra.run.smithi157.stdout:Complete! 2024-03-26T16:43:08.086 INFO:teuthology.orchestra.run.smithi149.stdout:Last metadata expiration check: 0:01:46 ago on Tue 26 Mar 2024 04:41:22 PM UTC. 2024-03-26T16:43:08.103 DEBUG:teuthology.orchestra.run.smithi157:> sudo yum -y install ceph-volume 2024-03-26T16:43:08.185 INFO:teuthology.orchestra.run.smithi149.stdout:Package python3-rgw-2:19.0.0-2382.gbf9505fb.el9.x86_64 is already installed. 2024-03-26T16:43:08.236 INFO:teuthology.orchestra.run.smithi149.stdout:Dependencies resolved. 2024-03-26T16:43:08.237 INFO:teuthology.orchestra.run.smithi149.stdout:Nothing to do. 2024-03-26T16:43:08.237 INFO:teuthology.orchestra.run.smithi149.stdout:Complete! 2024-03-26T16:43:08.290 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum -y install python3-cephfs 2024-03-26T16:43:08.675 INFO:teuthology.orchestra.run.smithi157.stdout:Last metadata expiration check: 0:01:45 ago on Tue 26 Mar 2024 04:41:23 PM UTC. 2024-03-26T16:43:08.829 INFO:teuthology.orchestra.run.smithi157.stdout:Dependencies resolved. 2024-03-26T16:43:08.830 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2024-03-26T16:43:08.830 INFO:teuthology.orchestra.run.smithi157.stdout: Package Arch Version Repository Size 2024-03-26T16:43:08.830 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2024-03-26T16:43:08.830 INFO:teuthology.orchestra.run.smithi157.stdout:Installing: 2024-03-26T16:43:08.830 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-volume noarch 2:19.0.0-2382.gbf9505fb.el9 ceph-noarch 264 k 2024-03-26T16:43:08.830 INFO:teuthology.orchestra.run.smithi157.stdout:Installing dependencies: 2024-03-26T16:43:08.830 INFO:teuthology.orchestra.run.smithi157.stdout: python3-packaging noarch 20.9-5.el9 CentOS-AppStream 69 k 2024-03-26T16:43:08.830 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-03-26T16:43:08.830 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction Summary 2024-03-26T16:43:08.830 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2024-03-26T16:43:08.830 INFO:teuthology.orchestra.run.smithi157.stdout:Install 2 Packages 2024-03-26T16:43:08.831 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-03-26T16:43:08.831 INFO:teuthology.orchestra.run.smithi157.stdout:Total download size: 332 k 2024-03-26T16:43:08.831 INFO:teuthology.orchestra.run.smithi157.stdout:Installed size: 1.5 M 2024-03-26T16:43:08.831 INFO:teuthology.orchestra.run.smithi157.stdout:Downloading Packages: 2024-03-26T16:43:08.863 INFO:teuthology.orchestra.run.smithi149.stdout:Last metadata expiration check: 0:01:46 ago on Tue 26 Mar 2024 04:41:22 PM UTC. 2024-03-26T16:43:08.960 INFO:teuthology.orchestra.run.smithi149.stdout:Package python3-cephfs-2:19.0.0-2382.gbf9505fb.el9.x86_64 is already installed. 2024-03-26T16:43:08.961 INFO:teuthology.orchestra.run.smithi157.stdout:(1/2): python3-packaging-20.9-5.el9.noarch.rpm 528 kB/s | 69 kB 00:00 2024-03-26T16:43:09.012 INFO:teuthology.orchestra.run.smithi149.stdout:Dependencies resolved. 2024-03-26T16:43:09.013 INFO:teuthology.orchestra.run.smithi149.stdout:Nothing to do. 2024-03-26T16:43:09.013 INFO:teuthology.orchestra.run.smithi149.stdout:Complete! 2024-03-26T16:43:09.067 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum -y install python3-rbd 2024-03-26T16:43:09.262 INFO:teuthology.orchestra.run.smithi157.stdout:(2/2): ceph-volume-19.0.0-2382.gbf9505fb.el9.no 613 kB/s | 264 kB 00:00 2024-03-26T16:43:09.263 INFO:teuthology.orchestra.run.smithi157.stdout:-------------------------------------------------------------------------------- 2024-03-26T16:43:09.263 INFO:teuthology.orchestra.run.smithi157.stdout:Total 768 kB/s | 332 kB 00:00 2024-03-26T16:43:09.263 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction check 2024-03-26T16:43:09.272 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction check succeeded. 2024-03-26T16:43:09.272 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction test 2024-03-26T16:43:09.308 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction test succeeded. 2024-03-26T16:43:09.309 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction 2024-03-26T16:43:09.459 INFO:teuthology.orchestra.run.smithi157.stdout: Preparing : 1/1 2024-03-26T16:43:09.638 INFO:teuthology.orchestra.run.smithi149.stdout:Last metadata expiration check: 0:01:47 ago on Tue 26 Mar 2024 04:41:22 PM UTC. 2024-03-26T16:43:09.644 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-packaging-20.9-5.el9.noarch 1/2 2024-03-26T16:43:09.689 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-volume-2:19.0.0-2382.gbf9505fb.el9.noarch 2/2 2024-03-26T16:43:09.705 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-volume-2:19.0.0-2382.gbf9505fb.el9.noarch 2/2 2024-03-26T16:43:09.705 INFO:teuthology.orchestra.run.smithi157.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-26T16:43:09.705 INFO:teuthology.orchestra.run.smithi157.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-03-26T16:43:09.705 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-03-26T16:43:09.735 INFO:teuthology.orchestra.run.smithi149.stdout:Package python3-rbd-2:19.0.0-2382.gbf9505fb.el9.x86_64 is already installed. 2024-03-26T16:43:09.787 INFO:teuthology.orchestra.run.smithi149.stdout:Dependencies resolved. 2024-03-26T16:43:09.787 INFO:teuthology.orchestra.run.smithi149.stdout:Nothing to do. 2024-03-26T16:43:09.787 INFO:teuthology.orchestra.run.smithi149.stdout:Complete! 2024-03-26T16:43:09.840 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum -y install rbd-fuse 2024-03-26T16:43:10.419 INFO:teuthology.orchestra.run.smithi149.stdout:Last metadata expiration check: 0:01:48 ago on Tue 26 Mar 2024 04:41:22 PM UTC. 2024-03-26T16:43:10.477 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-volume-2:19.0.0-2382.gbf9505fb.el9.noarch 1/2 2024-03-26T16:43:10.582 INFO:teuthology.orchestra.run.smithi149.stdout:Dependencies resolved. 2024-03-26T16:43:10.582 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-03-26T16:43:10.583 INFO:teuthology.orchestra.run.smithi149.stdout: Package Architecture Version Repository Size 2024-03-26T16:43:10.583 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-03-26T16:43:10.583 INFO:teuthology.orchestra.run.smithi149.stdout:Installing: 2024-03-26T16:43:10.583 INFO:teuthology.orchestra.run.smithi149.stdout: rbd-fuse x86_64 2:19.0.0-2382.gbf9505fb.el9 ceph 86 k 2024-03-26T16:43:10.583 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-03-26T16:43:10.583 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction Summary 2024-03-26T16:43:10.583 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-03-26T16:43:10.583 INFO:teuthology.orchestra.run.smithi149.stdout:Install 1 Package 2024-03-26T16:43:10.583 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-03-26T16:43:10.584 INFO:teuthology.orchestra.run.smithi149.stdout:Total download size: 86 k 2024-03-26T16:43:10.584 INFO:teuthology.orchestra.run.smithi149.stdout:Installed size: 231 k 2024-03-26T16:43:10.584 INFO:teuthology.orchestra.run.smithi149.stdout:Downloading Packages: 2024-03-26T16:43:10.825 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 2/2 2024-03-26T16:43:10.825 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-03-26T16:43:10.825 INFO:teuthology.orchestra.run.smithi157.stdout:Installed: 2024-03-26T16:43:10.825 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-volume-2:19.0.0-2382.gbf9505fb.el9.noarch 2024-03-26T16:43:10.825 INFO:teuthology.orchestra.run.smithi157.stdout: python3-packaging-20.9-5.el9.noarch 2024-03-26T16:43:10.825 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-03-26T16:43:10.825 INFO:teuthology.orchestra.run.smithi157.stdout:Complete! 2024-03-26T16:43:10.976 INFO:teuthology.orchestra.run.smithi149.stdout:rbd-fuse-19.0.0-2382.gbf9505fb.el9.x86_64.rpm 218 kB/s | 86 kB 00:00 2024-03-26T16:43:10.977 INFO:teuthology.orchestra.run.smithi149.stdout:-------------------------------------------------------------------------------- 2024-03-26T16:43:10.978 INFO:teuthology.orchestra.run.smithi149.stdout:Total 217 kB/s | 86 kB 00:00 2024-03-26T16:43:10.978 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction check 2024-03-26T16:43:10.989 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction check succeeded. 2024-03-26T16:43:10.990 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction test 2024-03-26T16:43:11.072 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction test succeeded. 2024-03-26T16:43:11.072 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction 2024-03-26T16:43:11.136 DEBUG:teuthology.orchestra.run.smithi157:> sudo yum -y install librados-devel 2024-03-26T16:43:11.228 INFO:teuthology.orchestra.run.smithi149.stdout: Preparing : 1/1 2024-03-26T16:43:11.325 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : rbd-fuse-2:19.0.0-2382.gbf9505fb.el9.x86_64 1/1 2024-03-26T16:43:11.708 INFO:teuthology.orchestra.run.smithi157.stdout:Last metadata expiration check: 0:01:48 ago on Tue 26 Mar 2024 04:41:23 PM UTC. 2024-03-26T16:43:11.743 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: rbd-fuse-2:19.0.0-2382.gbf9505fb.el9.x86_64 1/1 2024-03-26T16:43:11.858 INFO:teuthology.orchestra.run.smithi157.stdout:Dependencies resolved. 2024-03-26T16:43:11.858 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2024-03-26T16:43:11.859 INFO:teuthology.orchestra.run.smithi157.stdout: Package Arch Version Repo Size 2024-03-26T16:43:11.859 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2024-03-26T16:43:11.859 INFO:teuthology.orchestra.run.smithi157.stdout:Installing: 2024-03-26T16:43:11.859 INFO:teuthology.orchestra.run.smithi157.stdout: librados-devel x86_64 2:19.0.0-2382.gbf9505fb.el9 ceph 127 k 2024-03-26T16:43:11.859 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-03-26T16:43:11.859 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction Summary 2024-03-26T16:43:11.859 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2024-03-26T16:43:11.859 INFO:teuthology.orchestra.run.smithi157.stdout:Install 1 Package 2024-03-26T16:43:11.859 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-03-26T16:43:11.859 INFO:teuthology.orchestra.run.smithi157.stdout:Total download size: 127 k 2024-03-26T16:43:11.859 INFO:teuthology.orchestra.run.smithi157.stdout:Installed size: 456 k 2024-03-26T16:43:11.859 INFO:teuthology.orchestra.run.smithi157.stdout:Downloading Packages: 2024-03-26T16:43:12.032 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : rbd-fuse-2:19.0.0-2382.gbf9505fb.el9.x86_64 1/1 2024-03-26T16:43:12.032 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-03-26T16:43:12.032 INFO:teuthology.orchestra.run.smithi149.stdout:Installed: 2024-03-26T16:43:12.032 INFO:teuthology.orchestra.run.smithi149.stdout: rbd-fuse-2:19.0.0-2382.gbf9505fb.el9.x86_64 2024-03-26T16:43:12.032 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-03-26T16:43:12.032 INFO:teuthology.orchestra.run.smithi149.stdout:Complete! 2024-03-26T16:43:12.093 INFO:teuthology.orchestra.run.smithi157.stdout:librados-devel-19.0.0-2382.gbf9505fb.el9.x86_64 543 kB/s | 127 kB 00:00 2024-03-26T16:43:12.094 INFO:teuthology.orchestra.run.smithi157.stdout:-------------------------------------------------------------------------------- 2024-03-26T16:43:12.094 INFO:teuthology.orchestra.run.smithi157.stdout:Total 540 kB/s | 127 kB 00:00 2024-03-26T16:43:12.094 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction check 2024-03-26T16:43:12.099 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction check succeeded. 2024-03-26T16:43:12.099 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction test 2024-03-26T16:43:12.156 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction test succeeded. 2024-03-26T16:43:12.156 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction 2024-03-26T16:43:12.286 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum -y install rbd-mirror 2024-03-26T16:43:12.304 INFO:teuthology.orchestra.run.smithi157.stdout: Preparing : 1/1 2024-03-26T16:43:12.400 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : librados-devel-2:19.0.0-2382.gbf9505fb.el9.x86_64 1/1 2024-03-26T16:43:12.872 INFO:teuthology.orchestra.run.smithi149.stdout:Last metadata expiration check: 0:01:50 ago on Tue 26 Mar 2024 04:41:22 PM UTC. 2024-03-26T16:43:12.875 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: librados-devel-2:19.0.0-2382.gbf9505fb.el9.x86_64 1/1 2024-03-26T16:43:13.030 INFO:teuthology.orchestra.run.smithi149.stdout:Dependencies resolved. 2024-03-26T16:43:13.031 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-03-26T16:43:13.031 INFO:teuthology.orchestra.run.smithi149.stdout: Package Arch Version Repo Size 2024-03-26T16:43:13.031 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-03-26T16:43:13.031 INFO:teuthology.orchestra.run.smithi149.stdout:Installing: 2024-03-26T16:43:13.031 INFO:teuthology.orchestra.run.smithi149.stdout: rbd-mirror x86_64 2:19.0.0-2382.gbf9505fb.el9 ceph 3.1 M 2024-03-26T16:43:13.032 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-03-26T16:43:13.032 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction Summary 2024-03-26T16:43:13.032 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-03-26T16:43:13.032 INFO:teuthology.orchestra.run.smithi149.stdout:Install 1 Package 2024-03-26T16:43:13.032 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-03-26T16:43:13.032 INFO:teuthology.orchestra.run.smithi149.stdout:Total download size: 3.1 M 2024-03-26T16:43:13.032 INFO:teuthology.orchestra.run.smithi149.stdout:Installed size: 13 M 2024-03-26T16:43:13.032 INFO:teuthology.orchestra.run.smithi149.stdout:Downloading Packages: 2024-03-26T16:43:13.170 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : librados-devel-2:19.0.0-2382.gbf9505fb.el9.x86_64 1/1 2024-03-26T16:43:13.170 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-03-26T16:43:13.170 INFO:teuthology.orchestra.run.smithi157.stdout:Installed: 2024-03-26T16:43:13.170 INFO:teuthology.orchestra.run.smithi157.stdout: librados-devel-2:19.0.0-2382.gbf9505fb.el9.x86_64 2024-03-26T16:43:13.170 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-03-26T16:43:13.170 INFO:teuthology.orchestra.run.smithi157.stdout:Complete! 2024-03-26T16:43:13.403 DEBUG:teuthology.orchestra.run.smithi157:> sudo yum -y install libcephfs2 2024-03-26T16:43:13.991 INFO:teuthology.orchestra.run.smithi157.stdout:Last metadata expiration check: 0:01:50 ago on Tue 26 Mar 2024 04:41:23 PM UTC. 2024-03-26T16:43:14.098 INFO:teuthology.orchestra.run.smithi157.stdout:Package libcephfs2-2:19.0.0-2382.gbf9505fb.el9.x86_64 is already installed. 2024-03-26T16:43:14.157 INFO:teuthology.orchestra.run.smithi157.stdout:Dependencies resolved. 2024-03-26T16:43:14.158 INFO:teuthology.orchestra.run.smithi157.stdout:Nothing to do. 2024-03-26T16:43:14.158 INFO:teuthology.orchestra.run.smithi157.stdout:Complete! 2024-03-26T16:43:14.236 DEBUG:teuthology.orchestra.run.smithi157:> sudo yum -y install libcephfs-devel 2024-03-26T16:43:14.604 INFO:teuthology.orchestra.run.smithi149.stdout:rbd-mirror-19.0.0-2382.gbf9505fb.el9.x86_64.rpm 2.0 MB/s | 3.1 MB 00:01 2024-03-26T16:43:14.605 INFO:teuthology.orchestra.run.smithi149.stdout:-------------------------------------------------------------------------------- 2024-03-26T16:43:14.605 INFO:teuthology.orchestra.run.smithi149.stdout:Total 2.0 MB/s | 3.1 MB 00:01 2024-03-26T16:43:14.605 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction check 2024-03-26T16:43:14.616 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction check succeeded. 2024-03-26T16:43:14.616 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction test 2024-03-26T16:43:14.697 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction test succeeded. 2024-03-26T16:43:14.698 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction 2024-03-26T16:43:14.824 INFO:teuthology.orchestra.run.smithi157.stdout:Last metadata expiration check: 0:01:51 ago on Tue 26 Mar 2024 04:41:23 PM UTC. 2024-03-26T16:43:14.985 INFO:teuthology.orchestra.run.smithi157.stdout:Dependencies resolved. 2024-03-26T16:43:14.985 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2024-03-26T16:43:14.985 INFO:teuthology.orchestra.run.smithi157.stdout: Package Arch Version Repo Size 2024-03-26T16:43:14.985 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2024-03-26T16:43:14.986 INFO:teuthology.orchestra.run.smithi157.stdout:Installing: 2024-03-26T16:43:14.986 INFO:teuthology.orchestra.run.smithi157.stdout: libcephfs-devel x86_64 2:19.0.0-2382.gbf9505fb.el9 ceph 32 k 2024-03-26T16:43:14.986 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-03-26T16:43:14.986 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction Summary 2024-03-26T16:43:14.986 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2024-03-26T16:43:14.986 INFO:teuthology.orchestra.run.smithi157.stdout:Install 1 Package 2024-03-26T16:43:14.986 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-03-26T16:43:14.987 INFO:teuthology.orchestra.run.smithi157.stdout:Total download size: 32 k 2024-03-26T16:43:14.987 INFO:teuthology.orchestra.run.smithi157.stdout:Installed size: 142 k 2024-03-26T16:43:14.987 INFO:teuthology.orchestra.run.smithi157.stdout:Downloading Packages: 2024-03-26T16:43:15.137 INFO:teuthology.orchestra.run.smithi149.stdout: Preparing : 1/1 2024-03-26T16:43:15.155 INFO:teuthology.orchestra.run.smithi157.stdout:libcephfs-devel-19.0.0-2382.gbf9505fb.el9.x86_6 188 kB/s | 32 kB 00:00 2024-03-26T16:43:15.156 INFO:teuthology.orchestra.run.smithi157.stdout:-------------------------------------------------------------------------------- 2024-03-26T16:43:15.156 INFO:teuthology.orchestra.run.smithi157.stdout:Total 186 kB/s | 32 kB 00:00 2024-03-26T16:43:15.156 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction check 2024-03-26T16:43:15.159 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction check succeeded. 2024-03-26T16:43:15.160 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction test 2024-03-26T16:43:15.192 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction test succeeded. 2024-03-26T16:43:15.192 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction 2024-03-26T16:43:15.213 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : rbd-mirror-2:19.0.0-2382.gbf9505fb.el9.x86_64 1/1 2024-03-26T16:43:15.239 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: rbd-mirror-2:19.0.0-2382.gbf9505fb.el9.x86_64 1/1 2024-03-26T16:43:15.239 INFO:teuthology.orchestra.run.smithi149.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-26T16:43:15.239 INFO:teuthology.orchestra.run.smithi149.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-03-26T16:43:15.239 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-26T16:43:15.239 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-26T16:43:15.239 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-03-26T16:43:15.309 INFO:teuthology.orchestra.run.smithi157.stdout: Preparing : 1/1 2024-03-26T16:43:15.403 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : libcephfs-devel-2:19.0.0-2382.gbf9505fb.el9.x86_64 1/1 2024-03-26T16:43:15.818 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: libcephfs-devel-2:19.0.0-2382.gbf9505fb.el9.x86_64 1/1 2024-03-26T16:43:16.074 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : libcephfs-devel-2:19.0.0-2382.gbf9505fb.el9.x86_64 1/1 2024-03-26T16:43:16.074 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-03-26T16:43:16.074 INFO:teuthology.orchestra.run.smithi157.stdout:Installed: 2024-03-26T16:43:16.074 INFO:teuthology.orchestra.run.smithi157.stdout: libcephfs-devel-2:19.0.0-2382.gbf9505fb.el9.x86_64 2024-03-26T16:43:16.074 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-03-26T16:43:16.074 INFO:teuthology.orchestra.run.smithi157.stdout:Complete! 2024-03-26T16:43:16.247 DEBUG:teuthology.orchestra.run.smithi157:> sudo yum -y install librados2 2024-03-26T16:43:16.392 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : rbd-mirror-2:19.0.0-2382.gbf9505fb.el9.x86_64 1/1 2024-03-26T16:43:16.393 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-03-26T16:43:16.393 INFO:teuthology.orchestra.run.smithi149.stdout:Installed: 2024-03-26T16:43:16.393 INFO:teuthology.orchestra.run.smithi149.stdout: rbd-mirror-2:19.0.0-2382.gbf9505fb.el9.x86_64 2024-03-26T16:43:16.393 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-03-26T16:43:16.393 INFO:teuthology.orchestra.run.smithi149.stdout:Complete! 2024-03-26T16:43:16.653 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum -y install rbd-nbd 2024-03-26T16:43:16.806 INFO:teuthology.orchestra.run.smithi157.stdout:Last metadata expiration check: 0:01:53 ago on Tue 26 Mar 2024 04:41:23 PM UTC. 2024-03-26T16:43:16.905 INFO:teuthology.orchestra.run.smithi157.stdout:Package librados2-2:19.0.0-2382.gbf9505fb.el9.x86_64 is already installed. 2024-03-26T16:43:16.957 INFO:teuthology.orchestra.run.smithi157.stdout:Dependencies resolved. 2024-03-26T16:43:16.958 INFO:teuthology.orchestra.run.smithi157.stdout:Nothing to do. 2024-03-26T16:43:16.958 INFO:teuthology.orchestra.run.smithi157.stdout:Complete! 2024-03-26T16:43:17.012 DEBUG:teuthology.orchestra.run.smithi157:> sudo yum -y install librbd1 2024-03-26T16:43:17.235 INFO:teuthology.orchestra.run.smithi149.stdout:Last metadata expiration check: 0:01:55 ago on Tue 26 Mar 2024 04:41:22 PM UTC. 2024-03-26T16:43:17.385 INFO:teuthology.orchestra.run.smithi149.stdout:Dependencies resolved. 2024-03-26T16:43:17.386 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-03-26T16:43:17.386 INFO:teuthology.orchestra.run.smithi149.stdout: Package Architecture Version Repository Size 2024-03-26T16:43:17.386 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-03-26T16:43:17.386 INFO:teuthology.orchestra.run.smithi149.stdout:Installing: 2024-03-26T16:43:17.386 INFO:teuthology.orchestra.run.smithi149.stdout: rbd-nbd x86_64 2:19.0.0-2382.gbf9505fb.el9 ceph 171 k 2024-03-26T16:43:17.386 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-03-26T16:43:17.386 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction Summary 2024-03-26T16:43:17.386 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-03-26T16:43:17.386 INFO:teuthology.orchestra.run.smithi149.stdout:Install 1 Package 2024-03-26T16:43:17.387 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-03-26T16:43:17.387 INFO:teuthology.orchestra.run.smithi149.stdout:Total download size: 171 k 2024-03-26T16:43:17.387 INFO:teuthology.orchestra.run.smithi149.stdout:Installed size: 494 k 2024-03-26T16:43:17.387 INFO:teuthology.orchestra.run.smithi149.stdout:Downloading Packages: 2024-03-26T16:43:17.576 INFO:teuthology.orchestra.run.smithi157.stdout:Last metadata expiration check: 0:01:54 ago on Tue 26 Mar 2024 04:41:23 PM UTC. 2024-03-26T16:43:17.672 INFO:teuthology.orchestra.run.smithi157.stdout:Package librbd1-2:19.0.0-2382.gbf9505fb.el9.x86_64 is already installed. 2024-03-26T16:43:17.725 INFO:teuthology.orchestra.run.smithi157.stdout:Dependencies resolved. 2024-03-26T16:43:17.726 INFO:teuthology.orchestra.run.smithi157.stdout:Nothing to do. 2024-03-26T16:43:17.726 INFO:teuthology.orchestra.run.smithi157.stdout:Complete! 2024-03-26T16:43:17.733 INFO:teuthology.orchestra.run.smithi149.stdout:rbd-nbd-19.0.0-2382.gbf9505fb.el9.x86_64.rpm 494 kB/s | 171 kB 00:00 2024-03-26T16:43:17.733 INFO:teuthology.orchestra.run.smithi149.stdout:-------------------------------------------------------------------------------- 2024-03-26T16:43:17.733 INFO:teuthology.orchestra.run.smithi149.stdout:Total 492 kB/s | 171 kB 00:00 2024-03-26T16:43:17.733 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction check 2024-03-26T16:43:17.741 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction check succeeded. 2024-03-26T16:43:17.741 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction test 2024-03-26T16:43:17.779 DEBUG:teuthology.orchestra.run.smithi157:> sudo yum -y install python3-rados 2024-03-26T16:43:17.799 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction test succeeded. 2024-03-26T16:43:17.799 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction 2024-03-26T16:43:17.953 INFO:teuthology.orchestra.run.smithi149.stdout: Preparing : 1/1 2024-03-26T16:43:18.056 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : rbd-nbd-2:19.0.0-2382.gbf9505fb.el9.x86_64 1/1 2024-03-26T16:43:18.338 INFO:teuthology.orchestra.run.smithi157.stdout:Last metadata expiration check: 0:01:55 ago on Tue 26 Mar 2024 04:41:23 PM UTC. 2024-03-26T16:43:18.435 INFO:teuthology.orchestra.run.smithi157.stdout:Package python3-rados-2:19.0.0-2382.gbf9505fb.el9.x86_64 is already installed. 2024-03-26T16:43:18.479 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: rbd-nbd-2:19.0.0-2382.gbf9505fb.el9.x86_64 1/1 2024-03-26T16:43:18.486 INFO:teuthology.orchestra.run.smithi157.stdout:Dependencies resolved. 2024-03-26T16:43:18.487 INFO:teuthology.orchestra.run.smithi157.stdout:Nothing to do. 2024-03-26T16:43:18.487 INFO:teuthology.orchestra.run.smithi157.stdout:Complete! 2024-03-26T16:43:18.532 DEBUG:teuthology.orchestra.run.smithi157:> sudo yum -y install python3-rgw 2024-03-26T16:43:18.765 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : rbd-nbd-2:19.0.0-2382.gbf9505fb.el9.x86_64 1/1 2024-03-26T16:43:18.765 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-03-26T16:43:18.765 INFO:teuthology.orchestra.run.smithi149.stdout:Installed: 2024-03-26T16:43:18.765 INFO:teuthology.orchestra.run.smithi149.stdout: rbd-nbd-2:19.0.0-2382.gbf9505fb.el9.x86_64 2024-03-26T16:43:18.765 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-03-26T16:43:18.765 INFO:teuthology.orchestra.run.smithi149.stdout:Complete! 2024-03-26T16:43:18.975 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum -y install nvme-cli 2024-03-26T16:43:19.092 INFO:teuthology.orchestra.run.smithi157.stdout:Last metadata expiration check: 0:01:56 ago on Tue 26 Mar 2024 04:41:23 PM UTC. 2024-03-26T16:43:19.190 INFO:teuthology.orchestra.run.smithi157.stdout:Package python3-rgw-2:19.0.0-2382.gbf9505fb.el9.x86_64 is already installed. 2024-03-26T16:43:19.240 INFO:teuthology.orchestra.run.smithi157.stdout:Dependencies resolved. 2024-03-26T16:43:19.240 INFO:teuthology.orchestra.run.smithi157.stdout:Nothing to do. 2024-03-26T16:43:19.241 INFO:teuthology.orchestra.run.smithi157.stdout:Complete! 2024-03-26T16:43:19.304 DEBUG:teuthology.orchestra.run.smithi157:> sudo yum -y install python3-cephfs 2024-03-26T16:43:19.557 INFO:teuthology.orchestra.run.smithi149.stdout:Last metadata expiration check: 0:01:57 ago on Tue 26 Mar 2024 04:41:22 PM UTC. 2024-03-26T16:43:19.658 INFO:teuthology.orchestra.run.smithi149.stdout:Package nvme-cli-2.4-9.el9.x86_64 is already installed. 2024-03-26T16:43:19.714 INFO:teuthology.orchestra.run.smithi149.stdout:Dependencies resolved. 2024-03-26T16:43:19.715 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-03-26T16:43:19.715 INFO:teuthology.orchestra.run.smithi149.stdout: Package Architecture Version Repository Size 2024-03-26T16:43:19.715 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-03-26T16:43:19.715 INFO:teuthology.orchestra.run.smithi149.stdout:Upgrading: 2024-03-26T16:43:19.715 INFO:teuthology.orchestra.run.smithi149.stdout: libnvme x86_64 1.6-1.el9 baseos 96 k 2024-03-26T16:43:19.715 INFO:teuthology.orchestra.run.smithi149.stdout: nvme-cli x86_64 2.6-5.el9 baseos 841 k 2024-03-26T16:43:19.715 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-03-26T16:43:19.715 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction Summary 2024-03-26T16:43:19.715 INFO:teuthology.orchestra.run.smithi149.stdout:================================================================================ 2024-03-26T16:43:19.715 INFO:teuthology.orchestra.run.smithi149.stdout:Upgrade 2 Packages 2024-03-26T16:43:19.715 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-03-26T16:43:19.716 INFO:teuthology.orchestra.run.smithi149.stdout:Total download size: 937 k 2024-03-26T16:43:19.716 INFO:teuthology.orchestra.run.smithi149.stdout:Downloading Packages: 2024-03-26T16:43:19.864 INFO:teuthology.orchestra.run.smithi157.stdout:Last metadata expiration check: 0:01:56 ago on Tue 26 Mar 2024 04:41:23 PM UTC. 2024-03-26T16:43:19.964 INFO:teuthology.orchestra.run.smithi157.stdout:Package python3-cephfs-2:19.0.0-2382.gbf9505fb.el9.x86_64 is already installed. 2024-03-26T16:43:20.015 INFO:teuthology.orchestra.run.smithi157.stdout:Dependencies resolved. 2024-03-26T16:43:20.016 INFO:teuthology.orchestra.run.smithi157.stdout:Nothing to do. 2024-03-26T16:43:20.016 INFO:teuthology.orchestra.run.smithi157.stdout:Complete! 2024-03-26T16:43:20.079 DEBUG:teuthology.orchestra.run.smithi157:> sudo yum -y install python3-rbd 2024-03-26T16:43:20.103 INFO:teuthology.orchestra.run.smithi149.stdout:(1/2): libnvme-1.6-1.el9.x86_64.rpm 410 kB/s | 96 kB 00:00 2024-03-26T16:43:20.237 INFO:teuthology.orchestra.run.smithi149.stdout:(2/2): nvme-cli-2.6-5.el9.x86_64.rpm 2.2 MB/s | 841 kB 00:00 2024-03-26T16:43:20.237 INFO:teuthology.orchestra.run.smithi149.stdout:-------------------------------------------------------------------------------- 2024-03-26T16:43:20.237 INFO:teuthology.orchestra.run.smithi149.stdout:Total 1.8 MB/s | 937 kB 00:00 2024-03-26T16:43:20.264 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction check 2024-03-26T16:43:20.275 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction check succeeded. 2024-03-26T16:43:20.275 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction test 2024-03-26T16:43:20.379 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction test succeeded. 2024-03-26T16:43:20.380 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction 2024-03-26T16:43:20.610 INFO:teuthology.orchestra.run.smithi149.stdout: Preparing : 1/1 2024-03-26T16:43:20.637 INFO:teuthology.orchestra.run.smithi157.stdout:Last metadata expiration check: 0:01:57 ago on Tue 26 Mar 2024 04:41:23 PM UTC. 2024-03-26T16:43:20.734 INFO:teuthology.orchestra.run.smithi157.stdout:Package python3-rbd-2:19.0.0-2382.gbf9505fb.el9.x86_64 is already installed. 2024-03-26T16:43:20.786 INFO:teuthology.orchestra.run.smithi157.stdout:Dependencies resolved. 2024-03-26T16:43:20.786 INFO:teuthology.orchestra.run.smithi157.stdout:Nothing to do. 2024-03-26T16:43:20.787 INFO:teuthology.orchestra.run.smithi157.stdout:Complete! 2024-03-26T16:43:20.842 DEBUG:teuthology.orchestra.run.smithi157:> sudo yum -y install rbd-fuse 2024-03-26T16:43:20.928 INFO:teuthology.orchestra.run.smithi149.stdout: Upgrading : libnvme-1.6-1.el9.x86_64 1/4 2024-03-26T16:43:20.990 INFO:teuthology.orchestra.run.smithi149.stdout: Upgrading : nvme-cli-2.6-5.el9.x86_64 2/4 2024-03-26T16:43:21.285 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: nvme-cli-2.6-5.el9.x86_64 2/4 2024-03-26T16:43:21.318 INFO:teuthology.orchestra.run.smithi149.stdout: Cleanup : nvme-cli-2.4-9.el9.x86_64 3/4 2024-03-26T16:43:21.394 INFO:teuthology.orchestra.run.smithi157.stdout:Last metadata expiration check: 0:01:58 ago on Tue 26 Mar 2024 04:41:23 PM UTC. 2024-03-26T16:43:21.408 INFO:teuthology.orchestra.run.smithi149.stdout: Cleanup : libnvme-1.4-7.el9.x86_64 4/4 2024-03-26T16:43:21.541 INFO:teuthology.orchestra.run.smithi157.stdout:Dependencies resolved. 2024-03-26T16:43:21.542 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2024-03-26T16:43:21.542 INFO:teuthology.orchestra.run.smithi157.stdout: Package Architecture Version Repository Size 2024-03-26T16:43:21.542 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2024-03-26T16:43:21.542 INFO:teuthology.orchestra.run.smithi157.stdout:Installing: 2024-03-26T16:43:21.542 INFO:teuthology.orchestra.run.smithi157.stdout: rbd-fuse x86_64 2:19.0.0-2382.gbf9505fb.el9 ceph 86 k 2024-03-26T16:43:21.542 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-03-26T16:43:21.542 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction Summary 2024-03-26T16:43:21.542 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2024-03-26T16:43:21.542 INFO:teuthology.orchestra.run.smithi157.stdout:Install 1 Package 2024-03-26T16:43:21.542 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-03-26T16:43:21.543 INFO:teuthology.orchestra.run.smithi157.stdout:Total download size: 86 k 2024-03-26T16:43:21.543 INFO:teuthology.orchestra.run.smithi157.stdout:Installed size: 231 k 2024-03-26T16:43:21.543 INFO:teuthology.orchestra.run.smithi157.stdout:Downloading Packages: 2024-03-26T16:43:21.874 INFO:teuthology.orchestra.run.smithi157.stdout:rbd-fuse-19.0.0-2382.gbf9505fb.el9.x86_64.rpm 258 kB/s | 86 kB 00:00 2024-03-26T16:43:21.875 INFO:teuthology.orchestra.run.smithi157.stdout:-------------------------------------------------------------------------------- 2024-03-26T16:43:21.875 INFO:teuthology.orchestra.run.smithi157.stdout:Total 257 kB/s | 86 kB 00:00 2024-03-26T16:43:21.875 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction check 2024-03-26T16:43:21.882 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction check succeeded. 2024-03-26T16:43:21.882 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction test 2024-03-26T16:43:21.937 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction test succeeded. 2024-03-26T16:43:21.937 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction 2024-03-26T16:43:22.070 INFO:teuthology.orchestra.run.smithi157.stdout: Preparing : 1/1 2024-03-26T16:43:22.164 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : rbd-fuse-2:19.0.0-2382.gbf9505fb.el9.x86_64 1/1 2024-03-26T16:43:22.229 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: libnvme-1.4-7.el9.x86_64 4/4 2024-03-26T16:43:22.230 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libnvme-1.6-1.el9.x86_64 1/4 2024-03-26T16:43:22.230 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libnvme-1.4-7.el9.x86_64 2/4 2024-03-26T16:43:22.230 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : nvme-cli-2.6-5.el9.x86_64 3/4 2024-03-26T16:43:22.543 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: rbd-fuse-2:19.0.0-2382.gbf9505fb.el9.x86_64 1/1 2024-03-26T16:43:22.573 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : nvme-cli-2.4-9.el9.x86_64 4/4 2024-03-26T16:43:22.573 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-03-26T16:43:22.573 INFO:teuthology.orchestra.run.smithi149.stdout:Upgraded: 2024-03-26T16:43:22.573 INFO:teuthology.orchestra.run.smithi149.stdout: libnvme-1.6-1.el9.x86_64 nvme-cli-2.6-5.el9.x86_64 2024-03-26T16:43:22.573 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-03-26T16:43:22.573 INFO:teuthology.orchestra.run.smithi149.stdout:Complete! 2024-03-26T16:43:22.821 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : rbd-fuse-2:19.0.0-2382.gbf9505fb.el9.x86_64 1/1 2024-03-26T16:43:22.821 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-03-26T16:43:22.821 INFO:teuthology.orchestra.run.smithi157.stdout:Installed: 2024-03-26T16:43:22.821 INFO:teuthology.orchestra.run.smithi157.stdout: rbd-fuse-2:19.0.0-2382.gbf9505fb.el9.x86_64 2024-03-26T16:43:22.821 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-03-26T16:43:22.821 INFO:teuthology.orchestra.run.smithi157.stdout:Complete! 2024-03-26T16:43:22.908 DEBUG:teuthology.parallel:result is None 2024-03-26T16:43:23.058 DEBUG:teuthology.orchestra.run.smithi157:> sudo yum -y install rbd-mirror 2024-03-26T16:43:23.631 INFO:teuthology.orchestra.run.smithi157.stdout:Last metadata expiration check: 0:02:00 ago on Tue 26 Mar 2024 04:41:23 PM UTC. 2024-03-26T16:43:23.786 INFO:teuthology.orchestra.run.smithi157.stdout:Dependencies resolved. 2024-03-26T16:43:23.787 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2024-03-26T16:43:23.787 INFO:teuthology.orchestra.run.smithi157.stdout: Package Arch Version Repo Size 2024-03-26T16:43:23.788 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2024-03-26T16:43:23.788 INFO:teuthology.orchestra.run.smithi157.stdout:Installing: 2024-03-26T16:43:23.788 INFO:teuthology.orchestra.run.smithi157.stdout: rbd-mirror x86_64 2:19.0.0-2382.gbf9505fb.el9 ceph 3.1 M 2024-03-26T16:43:23.788 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-03-26T16:43:23.788 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction Summary 2024-03-26T16:43:23.788 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2024-03-26T16:43:23.788 INFO:teuthology.orchestra.run.smithi157.stdout:Install 1 Package 2024-03-26T16:43:23.788 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-03-26T16:43:23.788 INFO:teuthology.orchestra.run.smithi157.stdout:Total download size: 3.1 M 2024-03-26T16:43:23.788 INFO:teuthology.orchestra.run.smithi157.stdout:Installed size: 13 M 2024-03-26T16:43:23.788 INFO:teuthology.orchestra.run.smithi157.stdout:Downloading Packages: 2024-03-26T16:43:24.336 INFO:teuthology.orchestra.run.smithi157.stdout:rbd-mirror-19.0.0-2382.gbf9505fb.el9.x86_64.rpm 5.6 MB/s | 3.1 MB 00:00 2024-03-26T16:43:24.336 INFO:teuthology.orchestra.run.smithi157.stdout:-------------------------------------------------------------------------------- 2024-03-26T16:43:24.337 INFO:teuthology.orchestra.run.smithi157.stdout:Total 5.6 MB/s | 3.1 MB 00:00 2024-03-26T16:43:24.337 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction check 2024-03-26T16:43:24.346 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction check succeeded. 2024-03-26T16:43:24.346 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction test 2024-03-26T16:43:24.429 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction test succeeded. 2024-03-26T16:43:24.429 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction 2024-03-26T16:43:24.855 INFO:teuthology.orchestra.run.smithi157.stdout: Preparing : 1/1 2024-03-26T16:43:24.928 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : rbd-mirror-2:19.0.0-2382.gbf9505fb.el9.x86_64 1/1 2024-03-26T16:43:24.956 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: rbd-mirror-2:19.0.0-2382.gbf9505fb.el9.x86_64 1/1 2024-03-26T16:43:24.956 INFO:teuthology.orchestra.run.smithi157.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-26T16:43:24.956 INFO:teuthology.orchestra.run.smithi157.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-03-26T16:43:24.956 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-26T16:43:24.956 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-26T16:43:24.956 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-03-26T16:43:25.323 INFO:teuthology.orchestra.run.smithi044.stdout:Extra Packages for Enterprise Linux 161 kB/s | 21 MB 02:11 2024-03-26T16:43:26.105 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : rbd-mirror-2:19.0.0-2382.gbf9505fb.el9.x86_64 1/1 2024-03-26T16:43:26.106 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-03-26T16:43:26.106 INFO:teuthology.orchestra.run.smithi157.stdout:Installed: 2024-03-26T16:43:26.106 INFO:teuthology.orchestra.run.smithi157.stdout: rbd-mirror-2:19.0.0-2382.gbf9505fb.el9.x86_64 2024-03-26T16:43:26.106 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-03-26T16:43:26.106 INFO:teuthology.orchestra.run.smithi157.stdout:Complete! 2024-03-26T16:43:26.350 DEBUG:teuthology.orchestra.run.smithi157:> sudo yum -y install rbd-nbd 2024-03-26T16:43:26.914 INFO:teuthology.orchestra.run.smithi157.stdout:Last metadata expiration check: 0:02:03 ago on Tue 26 Mar 2024 04:41:23 PM UTC. 2024-03-26T16:43:27.065 INFO:teuthology.orchestra.run.smithi157.stdout:Dependencies resolved. 2024-03-26T16:43:27.066 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2024-03-26T16:43:27.066 INFO:teuthology.orchestra.run.smithi157.stdout: Package Architecture Version Repository Size 2024-03-26T16:43:27.066 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2024-03-26T16:43:27.066 INFO:teuthology.orchestra.run.smithi157.stdout:Installing: 2024-03-26T16:43:27.066 INFO:teuthology.orchestra.run.smithi157.stdout: rbd-nbd x86_64 2:19.0.0-2382.gbf9505fb.el9 ceph 171 k 2024-03-26T16:43:27.066 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-03-26T16:43:27.066 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction Summary 2024-03-26T16:43:27.066 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2024-03-26T16:43:27.066 INFO:teuthology.orchestra.run.smithi157.stdout:Install 1 Package 2024-03-26T16:43:27.066 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-03-26T16:43:27.067 INFO:teuthology.orchestra.run.smithi157.stdout:Total download size: 171 k 2024-03-26T16:43:27.067 INFO:teuthology.orchestra.run.smithi157.stdout:Installed size: 494 k 2024-03-26T16:43:27.067 INFO:teuthology.orchestra.run.smithi157.stdout:Downloading Packages: 2024-03-26T16:43:27.382 INFO:teuthology.orchestra.run.smithi157.stdout:rbd-nbd-19.0.0-2382.gbf9505fb.el9.x86_64.rpm 545 kB/s | 171 kB 00:00 2024-03-26T16:43:27.382 INFO:teuthology.orchestra.run.smithi157.stdout:-------------------------------------------------------------------------------- 2024-03-26T16:43:27.382 INFO:teuthology.orchestra.run.smithi157.stdout:Total 541 kB/s | 171 kB 00:00 2024-03-26T16:43:27.382 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction check 2024-03-26T16:43:27.390 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction check succeeded. 2024-03-26T16:43:27.390 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction test 2024-03-26T16:43:27.445 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction test succeeded. 2024-03-26T16:43:27.446 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction 2024-03-26T16:43:27.592 INFO:teuthology.orchestra.run.smithi157.stdout: Preparing : 1/1 2024-03-26T16:43:27.696 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : rbd-nbd-2:19.0.0-2382.gbf9505fb.el9.x86_64 1/1 2024-03-26T16:43:28.096 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: rbd-nbd-2:19.0.0-2382.gbf9505fb.el9.x86_64 1/1 2024-03-26T16:43:28.367 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : rbd-nbd-2:19.0.0-2382.gbf9505fb.el9.x86_64 1/1 2024-03-26T16:43:28.368 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-03-26T16:43:28.368 INFO:teuthology.orchestra.run.smithi157.stdout:Installed: 2024-03-26T16:43:28.368 INFO:teuthology.orchestra.run.smithi157.stdout: rbd-nbd-2:19.0.0-2382.gbf9505fb.el9.x86_64 2024-03-26T16:43:28.368 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-03-26T16:43:28.368 INFO:teuthology.orchestra.run.smithi157.stdout:Complete! 2024-03-26T16:43:28.615 DEBUG:teuthology.orchestra.run.smithi157:> sudo yum -y install nvme-cli 2024-03-26T16:43:29.181 INFO:teuthology.orchestra.run.smithi157.stdout:Last metadata expiration check: 0:02:06 ago on Tue 26 Mar 2024 04:41:23 PM UTC. 2024-03-26T16:43:29.282 INFO:teuthology.orchestra.run.smithi157.stdout:Package nvme-cli-2.4-9.el9.x86_64 is already installed. 2024-03-26T16:43:29.338 INFO:teuthology.orchestra.run.smithi157.stdout:Dependencies resolved. 2024-03-26T16:43:29.339 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2024-03-26T16:43:29.339 INFO:teuthology.orchestra.run.smithi157.stdout: Package Architecture Version Repository Size 2024-03-26T16:43:29.339 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2024-03-26T16:43:29.339 INFO:teuthology.orchestra.run.smithi157.stdout:Upgrading: 2024-03-26T16:43:29.339 INFO:teuthology.orchestra.run.smithi157.stdout: libnvme x86_64 1.6-1.el9 baseos 96 k 2024-03-26T16:43:29.339 INFO:teuthology.orchestra.run.smithi157.stdout: nvme-cli x86_64 2.6-5.el9 baseos 841 k 2024-03-26T16:43:29.339 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-03-26T16:43:29.339 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction Summary 2024-03-26T16:43:29.340 INFO:teuthology.orchestra.run.smithi157.stdout:================================================================================ 2024-03-26T16:43:29.340 INFO:teuthology.orchestra.run.smithi157.stdout:Upgrade 2 Packages 2024-03-26T16:43:29.340 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-03-26T16:43:29.340 INFO:teuthology.orchestra.run.smithi157.stdout:Total download size: 937 k 2024-03-26T16:43:29.340 INFO:teuthology.orchestra.run.smithi157.stdout:Downloading Packages: 2024-03-26T16:43:29.526 INFO:teuthology.orchestra.run.smithi157.stdout:(1/2): libnvme-1.6-1.el9.x86_64.rpm 640 kB/s | 96 kB 00:00 2024-03-26T16:43:29.551 INFO:teuthology.orchestra.run.smithi157.stdout:(2/2): nvme-cli-2.6-5.el9.x86_64.rpm 4.7 MB/s | 841 kB 00:00 2024-03-26T16:43:29.551 INFO:teuthology.orchestra.run.smithi157.stdout:-------------------------------------------------------------------------------- 2024-03-26T16:43:29.551 INFO:teuthology.orchestra.run.smithi157.stdout:Total 4.3 MB/s | 937 kB 00:00 2024-03-26T16:43:29.578 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction check 2024-03-26T16:43:29.589 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction check succeeded. 2024-03-26T16:43:29.589 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction test 2024-03-26T16:43:29.685 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction test succeeded. 2024-03-26T16:43:29.685 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction 2024-03-26T16:43:29.918 INFO:teuthology.orchestra.run.smithi157.stdout: Preparing : 1/1 2024-03-26T16:43:30.217 INFO:teuthology.orchestra.run.smithi157.stdout: Upgrading : libnvme-1.6-1.el9.x86_64 1/4 2024-03-26T16:43:30.263 INFO:teuthology.orchestra.run.smithi157.stdout: Upgrading : nvme-cli-2.6-5.el9.x86_64 2/4 2024-03-26T16:43:30.431 INFO:teuthology.orchestra.run.smithi044.stdout:lab-extras 42 kB/s | 1.7 kB 00:00 2024-03-26T16:43:30.559 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: nvme-cli-2.6-5.el9.x86_64 2/4 2024-03-26T16:43:30.600 INFO:teuthology.orchestra.run.smithi157.stdout: Cleanup : nvme-cli-2.4-9.el9.x86_64 3/4 2024-03-26T16:43:30.695 INFO:teuthology.orchestra.run.smithi157.stdout: Cleanup : libnvme-1.4-7.el9.x86_64 4/4 2024-03-26T16:43:31.502 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: libnvme-1.4-7.el9.x86_64 4/4 2024-03-26T16:43:31.503 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : libnvme-1.6-1.el9.x86_64 1/4 2024-03-26T16:43:31.503 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : libnvme-1.4-7.el9.x86_64 2/4 2024-03-26T16:43:31.503 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : nvme-cli-2.6-5.el9.x86_64 3/4 2024-03-26T16:43:31.830 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : nvme-cli-2.4-9.el9.x86_64 4/4 2024-03-26T16:43:31.830 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-03-26T16:43:31.830 INFO:teuthology.orchestra.run.smithi157.stdout:Upgraded: 2024-03-26T16:43:31.830 INFO:teuthology.orchestra.run.smithi157.stdout: libnvme-1.6-1.el9.x86_64 nvme-cli-2.6-5.el9.x86_64 2024-03-26T16:43:31.830 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-03-26T16:43:31.831 INFO:teuthology.orchestra.run.smithi157.stdout:Complete! 2024-03-26T16:43:32.177 DEBUG:teuthology.parallel:result is None 2024-03-26T16:43:32.997 INFO:teuthology.orchestra.run.smithi044.stdout:Dependencies resolved. 2024-03-26T16:43:33.004 INFO:teuthology.orchestra.run.smithi044.stdout:================================================================================ 2024-03-26T16:43:33.004 INFO:teuthology.orchestra.run.smithi044.stdout: Package Arch Version Repository Size 2024-03-26T16:43:33.004 INFO:teuthology.orchestra.run.smithi044.stdout:================================================================================ 2024-03-26T16:43:33.004 INFO:teuthology.orchestra.run.smithi044.stdout:Installing: 2024-03-26T16:43:33.004 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-radosgw x86_64 2:19.0.0-2382.gbf9505fb.el9 ceph 9.8 M 2024-03-26T16:43:33.004 INFO:teuthology.orchestra.run.smithi044.stdout:Upgrading: 2024-03-26T16:43:33.005 INFO:teuthology.orchestra.run.smithi044.stdout: librados2 x86_64 2:19.0.0-2382.gbf9505fb.el9 ceph 3.4 M 2024-03-26T16:43:33.005 INFO:teuthology.orchestra.run.smithi044.stdout: librbd1 x86_64 2:19.0.0-2382.gbf9505fb.el9 ceph 3.1 M 2024-03-26T16:43:33.005 INFO:teuthology.orchestra.run.smithi044.stdout:Installing dependencies: 2024-03-26T16:43:33.005 INFO:teuthology.orchestra.run.smithi044.stdout: boost-program-options 2024-03-26T16:43:33.005 INFO:teuthology.orchestra.run.smithi044.stdout: x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2024-03-26T16:43:33.005 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-base x86_64 2:19.0.0-2382.gbf9505fb.el9 ceph 5.4 M 2024-03-26T16:43:33.005 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-common x86_64 2:19.0.0-2382.gbf9505fb.el9 ceph 21 M 2024-03-26T16:43:33.005 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-selinux x86_64 2:19.0.0-2382.gbf9505fb.el9 ceph 25 k 2024-03-26T16:43:33.005 INFO:teuthology.orchestra.run.smithi044.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-03-26T16:43:33.005 INFO:teuthology.orchestra.run.smithi044.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-03-26T16:43:33.005 INFO:teuthology.orchestra.run.smithi044.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-03-26T16:43:33.005 INFO:teuthology.orchestra.run.smithi044.stdout: libcephfs2 x86_64 2:19.0.0-2382.gbf9505fb.el9 ceph 747 k 2024-03-26T16:43:33.005 INFO:teuthology.orchestra.run.smithi044.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-03-26T16:43:33.005 INFO:teuthology.orchestra.run.smithi044.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2024-03-26T16:43:33.005 INFO:teuthology.orchestra.run.smithi044.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2024-03-26T16:43:33.006 INFO:teuthology.orchestra.run.smithi044.stdout: libradosstriper1 x86_64 2:19.0.0-2382.gbf9505fb.el9 ceph 500 k 2024-03-26T16:43:33.006 INFO:teuthology.orchestra.run.smithi044.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2024-03-26T16:43:33.006 INFO:teuthology.orchestra.run.smithi044.stdout: librgw2 x86_64 2:19.0.0-2382.gbf9505fb.el9 ceph 5.1 M 2024-03-26T16:43:33.006 INFO:teuthology.orchestra.run.smithi044.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-03-26T16:43:33.006 INFO:teuthology.orchestra.run.smithi044.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2024-03-26T16:43:33.006 INFO:teuthology.orchestra.run.smithi044.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-03-26T16:43:33.006 INFO:teuthology.orchestra.run.smithi044.stdout: python3-ceph-argparse 2024-03-26T16:43:33.006 INFO:teuthology.orchestra.run.smithi044.stdout: x86_64 2:19.0.0-2382.gbf9505fb.el9 ceph 45 k 2024-03-26T16:43:33.006 INFO:teuthology.orchestra.run.smithi044.stdout: python3-ceph-common x86_64 2:19.0.0-2382.gbf9505fb.el9 ceph 133 k 2024-03-26T16:43:33.006 INFO:teuthology.orchestra.run.smithi044.stdout: python3-cephfs x86_64 2:19.0.0-2382.gbf9505fb.el9 ceph 162 k 2024-03-26T16:43:33.006 INFO:teuthology.orchestra.run.smithi044.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2024-03-26T16:43:33.006 INFO:teuthology.orchestra.run.smithi044.stdout: python3-rados x86_64 2:19.0.0-2382.gbf9505fb.el9 ceph 321 k 2024-03-26T16:43:33.006 INFO:teuthology.orchestra.run.smithi044.stdout: python3-rbd x86_64 2:19.0.0-2382.gbf9505fb.el9 ceph 298 k 2024-03-26T16:43:33.007 INFO:teuthology.orchestra.run.smithi044.stdout: python3-rgw x86_64 2:19.0.0-2382.gbf9505fb.el9 ceph 99 k 2024-03-26T16:43:33.007 INFO:teuthology.orchestra.run.smithi044.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-03-26T16:43:33.007 INFO:teuthology.orchestra.run.smithi044.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-03-26T16:43:33.007 INFO:teuthology.orchestra.run.smithi044.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-03-26T16:43:33.007 INFO:teuthology.orchestra.run.smithi044.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-03-26T16:43:33.007 INFO:teuthology.orchestra.run.smithi044.stdout:Installing weak dependencies: 2024-03-26T16:43:33.007 INFO:teuthology.orchestra.run.smithi044.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-03-26T16:43:33.007 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-26T16:43:33.007 INFO:teuthology.orchestra.run.smithi044.stdout:Transaction Summary 2024-03-26T16:43:33.007 INFO:teuthology.orchestra.run.smithi044.stdout:================================================================================ 2024-03-26T16:43:33.007 INFO:teuthology.orchestra.run.smithi044.stdout:Install 30 Packages 2024-03-26T16:43:33.008 INFO:teuthology.orchestra.run.smithi044.stdout:Upgrade 2 Packages 2024-03-26T16:43:33.008 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-26T16:43:33.008 INFO:teuthology.orchestra.run.smithi044.stdout:Total download size: 59 M 2024-03-26T16:43:33.008 INFO:teuthology.orchestra.run.smithi044.stdout:Downloading Packages: 2024-03-26T16:43:34.407 INFO:teuthology.orchestra.run.smithi044.stdout:(1/32): ceph-base-19.0.0-2382.gbf9505fb.el9.x86 5.3 MB/s | 5.4 MB 00:01 2024-03-26T16:43:34.474 INFO:teuthology.orchestra.run.smithi044.stdout:(2/32): ceph-selinux-19.0.0-2382.gbf9505fb.el9. 378 kB/s | 25 kB 00:00 2024-03-26T16:43:34.624 INFO:teuthology.orchestra.run.smithi044.stdout:(3/32): libcephfs2-19.0.0-2382.gbf9505fb.el9.x8 4.9 MB/s | 747 kB 00:00 2024-03-26T16:43:34.758 INFO:teuthology.orchestra.run.smithi044.stdout:(4/32): libradosstriper1-19.0.0-2382.gbf9505fb. 3.7 MB/s | 500 kB 00:00 2024-03-26T16:43:35.058 INFO:teuthology.orchestra.run.smithi044.stdout:(5/32): ceph-common-19.0.0-2382.gbf9505fb.el9.x 12 MB/s | 21 MB 00:01 2024-03-26T16:43:35.184 INFO:teuthology.orchestra.run.smithi044.stdout:(6/32): ceph-radosgw-19.0.0-2382.gbf9505fb.el9. 5.5 MB/s | 9.8 MB 00:01 2024-03-26T16:43:35.209 INFO:teuthology.orchestra.run.smithi044.stdout:(7/32): python3-ceph-argparse-19.0.0-2382.gbf95 300 kB/s | 45 kB 00:00 2024-03-26T16:43:35.242 INFO:teuthology.orchestra.run.smithi044.stdout:(8/32): python3-ceph-common-19.0.0-2382.gbf9505 2.2 MB/s | 133 kB 00:00 2024-03-26T16:43:35.268 INFO:teuthology.orchestra.run.smithi044.stdout:(9/32): python3-cephfs-19.0.0-2382.gbf9505fb.el 2.7 MB/s | 162 kB 00:00 2024-03-26T16:43:35.310 INFO:teuthology.orchestra.run.smithi044.stdout:(10/32): python3-rados-19.0.0-2382.gbf9505fb.el 4.7 MB/s | 321 kB 00:00 2024-03-26T16:43:35.385 INFO:teuthology.orchestra.run.smithi044.stdout:(11/32): librgw2-19.0.0-2382.gbf9505fb.el9.x86_ 8.2 MB/s | 5.1 MB 00:00 2024-03-26T16:43:35.410 INFO:teuthology.orchestra.run.smithi044.stdout:(12/32): python3-rbd-19.0.0-2382.gbf9505fb.el9. 2.0 MB/s | 298 kB 00:00 2024-03-26T16:43:35.427 INFO:teuthology.orchestra.run.smithi044.stdout:(13/32): python3-rgw-19.0.0-2382.gbf9505fb.el9. 849 kB/s | 99 kB 00:00 2024-03-26T16:43:35.652 INFO:teuthology.orchestra.run.smithi044.stdout:(14/32): librabbitmq-0.11.0-7.el9.x86_64.rpm 196 kB/s | 44 kB 00:00 2024-03-26T16:43:35.678 INFO:teuthology.orchestra.run.smithi044.stdout:(15/32): boost-program-options-1.75.0-8.el9.x86 396 kB/s | 106 kB 00:00 2024-03-26T16:43:35.736 INFO:teuthology.orchestra.run.smithi044.stdout:(16/32): libpmemobj-1.12.1-1.el9.x86_64.rpm 488 kB/s | 159 kB 00:00 2024-03-26T16:43:35.770 INFO:teuthology.orchestra.run.smithi044.stdout:(17/32): librdkafka-1.6.1-102.el9.x86_64.rpm 5.5 MB/s | 661 kB 00:00 2024-03-26T16:43:35.795 INFO:teuthology.orchestra.run.smithi044.stdout:(18/32): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.4 MB/s | 282 kB 00:00 2024-03-26T16:43:35.820 INFO:teuthology.orchestra.run.smithi044.stdout:(19/32): python3-prettytable-0.7.2-27.el9.noarc 495 kB/s | 41 kB 00:00 2024-03-26T16:43:35.937 INFO:teuthology.orchestra.run.smithi044.stdout:(20/32): qatlib-service-24.02.0-1.el9.x86_64.rp 308 kB/s | 36 kB 00:00 2024-03-26T16:43:35.963 INFO:teuthology.orchestra.run.smithi044.stdout:(21/32): qatzip-libs-1.2.0-1.el9.x86_64.rpm 334 kB/s | 47 kB 00:00 2024-03-26T16:43:35.980 INFO:teuthology.orchestra.run.smithi044.stdout:(22/32): qatlib-24.02.0-1.el9.x86_64.rpm 1.0 MB/s | 221 kB 00:00 2024-03-26T16:43:36.163 INFO:teuthology.orchestra.run.smithi044.stdout:(23/32): libarrow-doc-9.0.0-10.el9.noarch.rpm 141 kB/s | 26 kB 00:00 2024-03-26T16:43:36.272 INFO:teuthology.orchestra.run.smithi044.stdout:(24/32): gperftools-libs-2.9.1-2.el9.x86_64.rpm 924 kB/s | 309 kB 00:00 2024-03-26T16:43:36.297 INFO:teuthology.orchestra.run.smithi044.stdout:(25/32): liboath-2.6.7-2.el9.x86_64.rpm 364 kB/s | 49 kB 00:00 2024-03-26T16:43:36.339 INFO:teuthology.orchestra.run.smithi044.stdout:(26/32): libunwind-1.6.2-1.el9.x86_64.rpm 1.0 MB/s | 67 kB 00:00 2024-03-26T16:43:36.406 INFO:teuthology.orchestra.run.smithi044.stdout:(27/32): libarrow-9.0.0-10.el9.x86_64.rpm 10 MB/s | 4.4 MB 00:00 2024-03-26T16:43:36.456 INFO:teuthology.orchestra.run.smithi044.stdout:(28/32): parquet-libs-9.0.0-10.el9.x86_64.rpm 5.2 MB/s | 838 kB 00:00 2024-03-26T16:43:36.482 INFO:teuthology.orchestra.run.smithi044.stdout:(29/32): re2-20211101-3.el9.x86_64.rpm 1.3 MB/s | 192 kB 00:00 2024-03-26T16:43:36.574 INFO:teuthology.orchestra.run.smithi044.stdout:(30/32): thrift-0.15.0-2.el9.x86_64.rpm 9.5 MB/s | 1.6 MB 00:00 2024-03-26T16:43:36.824 INFO:teuthology.orchestra.run.smithi044.stdout:(31/32): librbd1-19.0.0-2382.gbf9505fb.el9.x86_ 9.2 MB/s | 3.1 MB 00:00 2024-03-26T16:43:36.899 INFO:teuthology.orchestra.run.smithi044.stdout:(32/32): librados2-19.0.0-2382.gbf9505fb.el9.x8 7.7 MB/s | 3.4 MB 00:00 2024-03-26T16:43:36.905 INFO:teuthology.orchestra.run.smithi044.stdout:-------------------------------------------------------------------------------- 2024-03-26T16:43:36.905 INFO:teuthology.orchestra.run.smithi044.stdout:Total 15 MB/s | 59 MB 00:03 2024-03-26T16:43:36.935 INFO:teuthology.orchestra.run.smithi044.stdout:Running transaction check 2024-03-26T16:43:36.975 INFO:teuthology.orchestra.run.smithi044.stdout:Transaction check succeeded. 2024-03-26T16:43:36.975 INFO:teuthology.orchestra.run.smithi044.stdout:Running transaction test 2024-03-26T16:43:37.471 INFO:teuthology.orchestra.run.smithi044.stdout:Transaction test succeeded. 2024-03-26T16:43:37.471 INFO:teuthology.orchestra.run.smithi044.stdout:Running transaction 2024-03-26T16:43:38.986 INFO:teuthology.orchestra.run.smithi044.stdout: Preparing : 1/1 2024-03-26T16:43:39.079 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/34 2024-03-26T16:43:39.112 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/34 2024-03-26T16:43:39.138 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/34 2024-03-26T16:43:39.160 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-03-26T16:43:39.176 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-03-26T16:43:39.352 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 5/34 2024-03-26T16:43:39.409 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 5/34 2024-03-26T16:43:39.790 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/34 2024-03-26T16:43:39.831 INFO:teuthology.orchestra.run.smithi044.stdout: Upgrading : librados2-2:19.0.0-2382.gbf9505fb.el9.x86_64 7/34 2024-03-26T16:43:39.924 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: librados2-2:19.0.0-2382.gbf9505fb.el9.x86_64 7/34 2024-03-26T16:43:40.013 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-rados-2:19.0.0-2382.gbf9505fb.el9.x86_64 8/34 2024-03-26T16:43:40.041 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libcephfs2-2:19.0.0-2382.gbf9505fb.el9.x86_64 9/34 2024-03-26T16:43:40.087 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: libcephfs2-2:19.0.0-2382.gbf9505fb.el9.x86_64 9/34 2024-03-26T16:43:40.116 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : liboath-2.6.7-2.el9.x86_64 10/34 2024-03-26T16:43:40.159 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-ceph-argparse-2:19.0.0-2382.gbf9505fb.el9. 11/34 2024-03-26T16:43:40.230 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-cephfs-2:19.0.0-2382.gbf9505fb.el9.x86_64 12/34 2024-03-26T16:43:40.251 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libradosstriper1-2:19.0.0-2382.gbf9505fb.el9.x86_6 13/34 2024-03-26T16:43:40.316 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: libradosstriper1-2:19.0.0-2382.gbf9505fb.el9.x86_6 13/34 2024-03-26T16:43:40.350 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 14/34 2024-03-26T16:43:40.461 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : re2-1:20211101-3.el9.x86_64 15/34 2024-03-26T16:43:40.502 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 16/34 2024-03-26T16:43:40.542 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/34 2024-03-26T16:43:40.583 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 18/34 2024-03-26T16:43:40.612 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 19/34 2024-03-26T16:43:40.645 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 20/34 2024-03-26T16:43:40.975 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 21/34 2024-03-26T16:43:41.000 INFO:teuthology.orchestra.run.smithi044.stdout: Upgrading : librbd1-2:19.0.0-2382.gbf9505fb.el9.x86_64 22/34 2024-03-26T16:43:41.091 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: librbd1-2:19.0.0-2382.gbf9505fb.el9.x86_64 22/34 2024-03-26T16:43:41.121 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-rbd-2:19.0.0-2382.gbf9505fb.el9.x86_64 23/34 2024-03-26T16:43:41.167 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 24/34 2024-03-26T16:43:41.659 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 25/34 2024-03-26T16:43:41.694 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : librgw2-2:19.0.0-2382.gbf9505fb.el9.x86_64 26/34 2024-03-26T16:43:41.765 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: librgw2-2:19.0.0-2382.gbf9505fb.el9.x86_64 26/34 2024-03-26T16:43:41.837 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-rgw-2:19.0.0-2382.gbf9505fb.el9.x86_64 27/34 2024-03-26T16:43:41.871 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-ceph-common-2:19.0.0-2382.gbf9505fb.el9.x8 28/34 2024-03-26T16:43:44.244 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-common-2:19.0.0-2382.gbf9505fb.el9.x86_64 29/34 2024-03-26T16:43:44.285 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-common-2:19.0.0-2382.gbf9505fb.el9.x86_64 29/34 2024-03-26T16:43:44.867 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-common-2:19.0.0-2382.gbf9505fb.el9.x86_64 29/34 2024-03-26T16:43:44.904 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-base-2:19.0.0-2382.gbf9505fb.el9.x86_64 30/34 2024-03-26T16:43:44.991 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-base-2:19.0.0-2382.gbf9505fb.el9.x86_64 30/34 2024-03-26T16:43:44.992 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-03-26T16:43:44.992 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-03-26T16:43:44.992 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-26T16:43:45.031 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-selinux-2:19.0.0-2382.gbf9505fb.el9.x86_64 31/34 2024-03-26T16:43:55.082 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-selinux-2:19.0.0-2382.gbf9505fb.el9.x86_64 31/34 2024-03-26T16:43:55.082 INFO:teuthology.orchestra.run.smithi044.stdout:skipping the directory /sys 2024-03-26T16:43:55.082 INFO:teuthology.orchestra.run.smithi044.stdout:skipping the directory /proc 2024-03-26T16:43:55.082 INFO:teuthology.orchestra.run.smithi044.stdout:skipping the directory /mnt 2024-03-26T16:43:55.082 INFO:teuthology.orchestra.run.smithi044.stdout:skipping the directory /var/tmp 2024-03-26T16:43:55.083 INFO:teuthology.orchestra.run.smithi044.stdout:skipping the directory /home 2024-03-26T16:43:55.083 INFO:teuthology.orchestra.run.smithi044.stdout:skipping the directory /root 2024-03-26T16:43:55.083 INFO:teuthology.orchestra.run.smithi044.stdout:skipping the directory /tmp 2024-03-26T16:43:55.083 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-26T16:43:56.037 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-radosgw-2:19.0.0-2382.gbf9505fb.el9.x86_64 32/34 2024-03-26T16:43:56.059 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-2382.gbf9505fb.el9.x86_64 32/34 2024-03-26T16:43:56.059 INFO:teuthology.orchestra.run.smithi044.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-26T16:43:56.059 INFO:teuthology.orchestra.run.smithi044.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-03-26T16:43:56.059 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-26T16:43:56.059 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-26T16:43:56.059 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-26T16:43:56.061 INFO:teuthology.orchestra.run.smithi044.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-03-26T16:43:56.141 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-03-26T16:43:56.141 INFO:teuthology.orchestra.run.smithi044.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 34/34 2024-03-26T16:43:57.319 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 34/34 2024-03-26T16:43:57.319 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-base-2:19.0.0-2382.gbf9505fb.el9.x86_64 1/34 2024-03-26T16:43:57.319 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-common-2:19.0.0-2382.gbf9505fb.el9.x86_64 2/34 2024-03-26T16:43:57.319 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-radosgw-2:19.0.0-2382.gbf9505fb.el9.x86_64 3/34 2024-03-26T16:43:57.319 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-selinux-2:19.0.0-2382.gbf9505fb.el9.x86_64 4/34 2024-03-26T16:43:57.319 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libcephfs2-2:19.0.0-2382.gbf9505fb.el9.x86_64 5/34 2024-03-26T16:43:57.319 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libradosstriper1-2:19.0.0-2382.gbf9505fb.el9.x86_6 6/34 2024-03-26T16:43:57.319 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : librgw2-2:19.0.0-2382.gbf9505fb.el9.x86_64 7/34 2024-03-26T16:43:57.319 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-ceph-argparse-2:19.0.0-2382.gbf9505fb.el9. 8/34 2024-03-26T16:43:57.319 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-ceph-common-2:19.0.0-2382.gbf9505fb.el9.x8 9/34 2024-03-26T16:43:57.320 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-cephfs-2:19.0.0-2382.gbf9505fb.el9.x86_64 10/34 2024-03-26T16:43:57.320 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-rados-2:19.0.0-2382.gbf9505fb.el9.x86_64 11/34 2024-03-26T16:43:57.320 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-rbd-2:19.0.0-2382.gbf9505fb.el9.x86_64 12/34 2024-03-26T16:43:57.320 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-rgw-2:19.0.0-2382.gbf9505fb.el9.x86_64 13/34 2024-03-26T16:43:57.320 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/34 2024-03-26T16:43:57.320 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/34 2024-03-26T16:43:57.320 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/34 2024-03-26T16:43:57.320 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/34 2024-03-26T16:43:57.320 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/34 2024-03-26T16:43:57.320 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/34 2024-03-26T16:43:57.320 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 20/34 2024-03-26T16:43:57.320 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 21/34 2024-03-26T16:43:57.320 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 22/34 2024-03-26T16:43:57.320 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 23/34 2024-03-26T16:43:57.321 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 24/34 2024-03-26T16:43:57.321 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 25/34 2024-03-26T16:43:57.321 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 26/34 2024-03-26T16:43:57.321 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 27/34 2024-03-26T16:43:57.321 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 28/34 2024-03-26T16:43:57.321 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : re2-1:20211101-3.el9.x86_64 29/34 2024-03-26T16:43:57.321 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 30/34 2024-03-26T16:43:57.321 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : librados2-2:19.0.0-2382.gbf9505fb.el9.x86_64 31/34 2024-03-26T16:43:57.321 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 32/34 2024-03-26T16:43:57.321 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : librbd1-2:19.0.0-2382.gbf9505fb.el9.x86_64 33/34 2024-03-26T16:43:58.426 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 34/34 2024-03-26T16:43:58.426 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-26T16:43:58.426 INFO:teuthology.orchestra.run.smithi044.stdout:Upgraded: 2024-03-26T16:43:58.426 INFO:teuthology.orchestra.run.smithi044.stdout: librados2-2:19.0.0-2382.gbf9505fb.el9.x86_64 2024-03-26T16:43:58.426 INFO:teuthology.orchestra.run.smithi044.stdout: librbd1-2:19.0.0-2382.gbf9505fb.el9.x86_64 2024-03-26T16:43:58.427 INFO:teuthology.orchestra.run.smithi044.stdout:Installed: 2024-03-26T16:43:58.427 INFO:teuthology.orchestra.run.smithi044.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-03-26T16:43:58.427 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-base-2:19.0.0-2382.gbf9505fb.el9.x86_64 2024-03-26T16:43:58.427 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-common-2:19.0.0-2382.gbf9505fb.el9.x86_64 2024-03-26T16:43:58.427 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-radosgw-2:19.0.0-2382.gbf9505fb.el9.x86_64 2024-03-26T16:43:58.427 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-selinux-2:19.0.0-2382.gbf9505fb.el9.x86_64 2024-03-26T16:43:58.427 INFO:teuthology.orchestra.run.smithi044.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-03-26T16:43:58.427 INFO:teuthology.orchestra.run.smithi044.stdout: libarrow-9.0.0-10.el9.x86_64 2024-03-26T16:43:58.428 INFO:teuthology.orchestra.run.smithi044.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-03-26T16:43:58.428 INFO:teuthology.orchestra.run.smithi044.stdout: libcephfs2-2:19.0.0-2382.gbf9505fb.el9.x86_64 2024-03-26T16:43:58.428 INFO:teuthology.orchestra.run.smithi044.stdout: liboath-2.6.7-2.el9.x86_64 2024-03-26T16:43:58.428 INFO:teuthology.orchestra.run.smithi044.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-03-26T16:43:58.428 INFO:teuthology.orchestra.run.smithi044.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-03-26T16:43:58.428 INFO:teuthology.orchestra.run.smithi044.stdout: libradosstriper1-2:19.0.0-2382.gbf9505fb.el9.x86_64 2024-03-26T16:43:58.429 INFO:teuthology.orchestra.run.smithi044.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-03-26T16:43:58.429 INFO:teuthology.orchestra.run.smithi044.stdout: librgw2-2:19.0.0-2382.gbf9505fb.el9.x86_64 2024-03-26T16:43:58.429 INFO:teuthology.orchestra.run.smithi044.stdout: libunwind-1.6.2-1.el9.x86_64 2024-03-26T16:43:58.429 INFO:teuthology.orchestra.run.smithi044.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-03-26T16:43:58.429 INFO:teuthology.orchestra.run.smithi044.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-03-26T16:43:58.429 INFO:teuthology.orchestra.run.smithi044.stdout: python3-ceph-argparse-2:19.0.0-2382.gbf9505fb.el9.x86_64 2024-03-26T16:43:58.429 INFO:teuthology.orchestra.run.smithi044.stdout: python3-ceph-common-2:19.0.0-2382.gbf9505fb.el9.x86_64 2024-03-26T16:43:58.430 INFO:teuthology.orchestra.run.smithi044.stdout: python3-cephfs-2:19.0.0-2382.gbf9505fb.el9.x86_64 2024-03-26T16:43:58.430 INFO:teuthology.orchestra.run.smithi044.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-03-26T16:43:58.430 INFO:teuthology.orchestra.run.smithi044.stdout: python3-rados-2:19.0.0-2382.gbf9505fb.el9.x86_64 2024-03-26T16:43:58.430 INFO:teuthology.orchestra.run.smithi044.stdout: python3-rbd-2:19.0.0-2382.gbf9505fb.el9.x86_64 2024-03-26T16:43:58.430 INFO:teuthology.orchestra.run.smithi044.stdout: python3-rgw-2:19.0.0-2382.gbf9505fb.el9.x86_64 2024-03-26T16:43:58.430 INFO:teuthology.orchestra.run.smithi044.stdout: qatlib-24.02.0-1.el9.x86_64 2024-03-26T16:43:58.431 INFO:teuthology.orchestra.run.smithi044.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-03-26T16:43:58.431 INFO:teuthology.orchestra.run.smithi044.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-03-26T16:43:58.431 INFO:teuthology.orchestra.run.smithi044.stdout: re2-1:20211101-3.el9.x86_64 2024-03-26T16:43:58.431 INFO:teuthology.orchestra.run.smithi044.stdout: thrift-0.15.0-2.el9.x86_64 2024-03-26T16:43:58.431 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-26T16:43:58.431 INFO:teuthology.orchestra.run.smithi044.stdout:Complete! 2024-03-26T16:43:58.765 DEBUG:teuthology.orchestra.run.smithi044:> sudo yum -y install ceph-test 2024-03-26T16:43:59.336 INFO:teuthology.orchestra.run.smithi044.stdout:Last metadata expiration check: 0:00:29 ago on Tue 26 Mar 2024 04:43:30 PM UTC. 2024-03-26T16:43:59.499 INFO:teuthology.orchestra.run.smithi044.stdout:Dependencies resolved. 2024-03-26T16:43:59.500 INFO:teuthology.orchestra.run.smithi044.stdout:================================================================================ 2024-03-26T16:43:59.500 INFO:teuthology.orchestra.run.smithi044.stdout: Package Arch Version Repository Size 2024-03-26T16:43:59.500 INFO:teuthology.orchestra.run.smithi044.stdout:================================================================================ 2024-03-26T16:43:59.500 INFO:teuthology.orchestra.run.smithi044.stdout:Installing: 2024-03-26T16:43:59.500 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-test x86_64 2:19.0.0-2382.gbf9505fb.el9 ceph 48 M 2024-03-26T16:43:59.500 INFO:teuthology.orchestra.run.smithi044.stdout:Installing dependencies: 2024-03-26T16:43:59.500 INFO:teuthology.orchestra.run.smithi044.stdout: jq x86_64 1.6-16.el9 baseos 187 k 2024-03-26T16:43:59.501 INFO:teuthology.orchestra.run.smithi044.stdout: libcephsqlite x86_64 2:19.0.0-2382.gbf9505fb.el9 ceph 163 k 2024-03-26T16:43:59.501 INFO:teuthology.orchestra.run.smithi044.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2024-03-26T16:43:59.501 INFO:teuthology.orchestra.run.smithi044.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2024-03-26T16:43:59.501 INFO:teuthology.orchestra.run.smithi044.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2024-03-26T16:43:59.501 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-26T16:43:59.501 INFO:teuthology.orchestra.run.smithi044.stdout:Transaction Summary 2024-03-26T16:43:59.501 INFO:teuthology.orchestra.run.smithi044.stdout:================================================================================ 2024-03-26T16:43:59.501 INFO:teuthology.orchestra.run.smithi044.stdout:Install 6 Packages 2024-03-26T16:43:59.501 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-26T16:43:59.502 INFO:teuthology.orchestra.run.smithi044.stdout:Total download size: 49 M 2024-03-26T16:43:59.502 INFO:teuthology.orchestra.run.smithi044.stdout:Installed size: 206 M 2024-03-26T16:43:59.502 INFO:teuthology.orchestra.run.smithi044.stdout:Downloading Packages: 2024-03-26T16:43:59.789 INFO:teuthology.orchestra.run.smithi044.stdout:(1/6): oniguruma-6.9.6-1.el9.5.x86_64.rpm 986 kB/s | 217 kB 00:00 2024-03-26T16:43:59.856 INFO:teuthology.orchestra.run.smithi044.stdout:(2/6): socat-1.7.4.1-5.el9.x86_64.rpm 4.4 MB/s | 300 kB 00:00 2024-03-26T16:43:59.906 INFO:teuthology.orchestra.run.smithi044.stdout:(3/6): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 63 kB 00:00 2024-03-26T16:44:00.023 INFO:teuthology.orchestra.run.smithi044.stdout:(4/6): libcephsqlite-19.0.0-2382.gbf9505fb.el9. 360 kB/s | 163 kB 00:00 2024-03-26T16:44:00.048 INFO:teuthology.orchestra.run.smithi044.stdout:(5/6): jq-1.6-16.el9.x86_64.rpm 1.3 MB/s | 187 kB 00:00 2024-03-26T16:44:02.582 INFO:teuthology.orchestra.run.smithi044.stdout:(6/6): ceph-test-19.0.0-2382.gbf9505fb.el9.x86_ 16 MB/s | 48 MB 00:03 2024-03-26T16:44:02.585 INFO:teuthology.orchestra.run.smithi044.stdout:-------------------------------------------------------------------------------- 2024-03-26T16:44:02.585 INFO:teuthology.orchestra.run.smithi044.stdout:Total 16 MB/s | 49 MB 00:03 2024-03-26T16:44:02.599 INFO:teuthology.orchestra.run.smithi044.stdout:Running transaction check 2024-03-26T16:44:02.622 INFO:teuthology.orchestra.run.smithi044.stdout:Transaction check succeeded. 2024-03-26T16:44:02.622 INFO:teuthology.orchestra.run.smithi044.stdout:Running transaction test 2024-03-26T16:44:03.043 INFO:teuthology.orchestra.run.smithi044.stdout:Transaction test succeeded. 2024-03-26T16:44:03.044 INFO:teuthology.orchestra.run.smithi044.stdout:Running transaction 2024-03-26T16:44:03.633 INFO:teuthology.orchestra.run.smithi044.stdout: Preparing : 1/1 2024-03-26T16:44:03.708 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/6 2024-03-26T16:44:03.760 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 2/6 2024-03-26T16:44:03.789 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 3/6 2024-03-26T16:44:03.832 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : jq-1.6-16.el9.x86_64 4/6 2024-03-26T16:44:03.859 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libcephsqlite-2:19.0.0-2382.gbf9505fb.el9.x86_64 5/6 2024-03-26T16:44:08.622 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: libcephsqlite-2:19.0.0-2382.gbf9505fb.el9.x86_64 5/6 2024-03-26T16:44:08.703 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-test-2:19.0.0-2382.gbf9505fb.el9.x86_64 6/6 2024-03-26T16:44:11.109 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-test-2:19.0.0-2382.gbf9505fb.el9.x86_64 6/6 2024-03-26T16:44:11.109 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-test-2:19.0.0-2382.gbf9505fb.el9.x86_64 1/6 2024-03-26T16:44:11.109 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libcephsqlite-2:19.0.0-2382.gbf9505fb.el9.x86_64 2/6 2024-03-26T16:44:11.110 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 3/6 2024-03-26T16:44:11.110 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 4/6 2024-03-26T16:44:11.110 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 5/6 2024-03-26T16:44:11.482 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : jq-1.6-16.el9.x86_64 6/6 2024-03-26T16:44:11.483 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-26T16:44:11.483 INFO:teuthology.orchestra.run.smithi044.stdout:Installed: 2024-03-26T16:44:11.483 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-test-2:19.0.0-2382.gbf9505fb.el9.x86_64 2024-03-26T16:44:11.483 INFO:teuthology.orchestra.run.smithi044.stdout: jq-1.6-16.el9.x86_64 2024-03-26T16:44:11.483 INFO:teuthology.orchestra.run.smithi044.stdout: libcephsqlite-2:19.0.0-2382.gbf9505fb.el9.x86_64 2024-03-26T16:44:11.483 INFO:teuthology.orchestra.run.smithi044.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-03-26T16:44:11.483 INFO:teuthology.orchestra.run.smithi044.stdout: socat-1.7.4.1-5.el9.x86_64 2024-03-26T16:44:11.483 INFO:teuthology.orchestra.run.smithi044.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-03-26T16:44:11.483 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-26T16:44:11.483 INFO:teuthology.orchestra.run.smithi044.stdout:Complete! 2024-03-26T16:44:11.802 DEBUG:teuthology.orchestra.run.smithi044:> sudo yum -y install ceph 2024-03-26T16:44:12.369 INFO:teuthology.orchestra.run.smithi044.stdout:Last metadata expiration check: 0:00:42 ago on Tue 26 Mar 2024 04:43:30 PM UTC. 2024-03-26T16:44:12.526 INFO:teuthology.orchestra.run.smithi044.stdout:Dependencies resolved. 2024-03-26T16:44:12.529 INFO:teuthology.orchestra.run.smithi044.stdout:========================================================================================= 2024-03-26T16:44:12.529 INFO:teuthology.orchestra.run.smithi044.stdout: Package Arch Version Repository Size 2024-03-26T16:44:12.529 INFO:teuthology.orchestra.run.smithi044.stdout:========================================================================================= 2024-03-26T16:44:12.529 INFO:teuthology.orchestra.run.smithi044.stdout:Installing: 2024-03-26T16:44:12.529 INFO:teuthology.orchestra.run.smithi044.stdout: ceph x86_64 2:19.0.0-2382.gbf9505fb.el9 ceph 6.6 k 2024-03-26T16:44:12.529 INFO:teuthology.orchestra.run.smithi044.stdout:Installing dependencies: 2024-03-26T16:44:12.529 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mds x86_64 2:19.0.0-2382.gbf9505fb.el9 ceph 2.4 M 2024-03-26T16:44:12.530 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mgr x86_64 2:19.0.0-2382.gbf9505fb.el9 ceph 1.5 M 2024-03-26T16:44:12.530 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mgr-modules-core noarch 2:19.0.0-2382.gbf9505fb.el9 ceph-noarch 248 k 2024-03-26T16:44:12.530 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mon x86_64 2:19.0.0-2382.gbf9505fb.el9 ceph 4.8 M 2024-03-26T16:44:12.530 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-osd x86_64 2:19.0.0-2382.gbf9505fb.el9 ceph 17 M 2024-03-26T16:44:12.530 INFO:teuthology.orchestra.run.smithi044.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2024-03-26T16:44:12.530 INFO:teuthology.orchestra.run.smithi044.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-03-26T16:44:12.530 INFO:teuthology.orchestra.run.smithi044.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-03-26T16:44:12.530 INFO:teuthology.orchestra.run.smithi044.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-03-26T16:44:12.530 INFO:teuthology.orchestra.run.smithi044.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2024-03-26T16:44:12.530 INFO:teuthology.orchestra.run.smithi044.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-03-26T16:44:12.530 INFO:teuthology.orchestra.run.smithi044.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-03-26T16:44:12.530 INFO:teuthology.orchestra.run.smithi044.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2024-03-26T16:44:12.531 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-03-26T16:44:12.531 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-03-26T16:44:12.531 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-03-26T16:44:12.531 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-03-26T16:44:12.531 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-03-26T16:44:12.531 INFO:teuthology.orchestra.run.smithi044.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-03-26T16:44:12.531 INFO:teuthology.orchestra.run.smithi044.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2024-03-26T16:44:12.531 INFO:teuthology.orchestra.run.smithi044.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2024-03-26T16:44:12.531 INFO:teuthology.orchestra.run.smithi044.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-03-26T16:44:12.531 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-03-26T16:44:12.531 INFO:teuthology.orchestra.run.smithi044.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2024-03-26T16:44:12.531 INFO:teuthology.orchestra.run.smithi044.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-03-26T16:44:12.532 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-03-26T16:44:12.532 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2024-03-26T16:44:12.532 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2024-03-26T16:44:12.532 INFO:teuthology.orchestra.run.smithi044.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-03-26T16:44:12.532 INFO:teuthology.orchestra.run.smithi044.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-03-26T16:44:12.532 INFO:teuthology.orchestra.run.smithi044.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2024-03-26T16:44:12.532 INFO:teuthology.orchestra.run.smithi044.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2024-03-26T16:44:12.532 INFO:teuthology.orchestra.run.smithi044.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-03-26T16:44:12.532 INFO:teuthology.orchestra.run.smithi044.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-03-26T16:44:12.532 INFO:teuthology.orchestra.run.smithi044.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-03-26T16:44:12.532 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-26T16:44:12.532 INFO:teuthology.orchestra.run.smithi044.stdout:Transaction Summary 2024-03-26T16:44:12.532 INFO:teuthology.orchestra.run.smithi044.stdout:========================================================================================= 2024-03-26T16:44:12.532 INFO:teuthology.orchestra.run.smithi044.stdout:Install 36 Packages 2024-03-26T16:44:12.532 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-26T16:44:12.533 INFO:teuthology.orchestra.run.smithi044.stdout:Total download size: 30 M 2024-03-26T16:44:12.533 INFO:teuthology.orchestra.run.smithi044.stdout:Installed size: 108 M 2024-03-26T16:44:12.533 INFO:teuthology.orchestra.run.smithi044.stdout:Downloading Packages: 2024-03-26T16:44:13.009 INFO:teuthology.orchestra.run.smithi044.stdout:(1/36): ceph-19.0.0-2382.gbf9505fb.el9.x86_64.r 43 kB/s | 6.6 kB 00:00 2024-03-26T16:44:13.251 INFO:teuthology.orchestra.run.smithi044.stdout:(2/36): ceph-mgr-19.0.0-2382.gbf9505fb.el9.x86_ 3.8 MB/s | 1.5 MB 00:00 2024-03-26T16:44:13.593 INFO:teuthology.orchestra.run.smithi044.stdout:(3/36): ceph-mon-19.0.0-2382.gbf9505fb.el9.x86_ 8.1 MB/s | 4.8 MB 00:00 2024-03-26T16:44:13.810 INFO:teuthology.orchestra.run.smithi044.stdout:(4/36): ceph-mds-19.0.0-2382.gbf9505fb.el9.x86_ 2.5 MB/s | 2.4 MB 00:00 2024-03-26T16:44:13.836 INFO:teuthology.orchestra.run.smithi044.stdout:(5/36): ceph-mgr-modules-core-19.0.0-2382.gbf95 1.0 MB/s | 248 kB 00:00 2024-03-26T16:44:13.961 INFO:teuthology.orchestra.run.smithi044.stdout:(6/36): lua-5.4.4-4.el9.x86_64.rpm 1.2 MB/s | 187 kB 00:00 2024-03-26T16:44:13.986 INFO:teuthology.orchestra.run.smithi044.stdout:(7/36): python3-mako-1.1.4-6.el9.noarch.rpm 1.1 MB/s | 144 kB 00:00 2024-03-26T16:44:14.003 INFO:teuthology.orchestra.run.smithi044.stdout:(8/36): python3-markupsafe-1.1.1-12.el9.x86_64. 757 kB/s | 32 kB 00:00 2024-03-26T16:44:14.020 INFO:teuthology.orchestra.run.smithi044.stdout:(9/36): python3-pytz-2021.1-5.el9.noarch.rpm 1.4 MB/s | 47 kB 00:00 2024-03-26T16:44:14.037 INFO:teuthology.orchestra.run.smithi044.stdout:(10/36): python3-toml-0.10.2-6.el9.noarch.rpm 1.1 MB/s | 39 kB 00:00 2024-03-26T16:44:14.070 INFO:teuthology.orchestra.run.smithi044.stdout:(11/36): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.7 MB/s | 241 kB 00:00 2024-03-26T16:44:14.120 INFO:teuthology.orchestra.run.smithi044.stdout:(12/36): python3-cryptography-36.0.1-4.el9.x86_ 14 MB/s | 1.1 MB 00:00 2024-03-26T16:44:14.146 INFO:teuthology.orchestra.run.smithi044.stdout:(13/36): python3-ply-3.11-14.el9.noarch.rpm 1.3 MB/s | 103 kB 00:00 2024-03-26T16:44:14.171 INFO:teuthology.orchestra.run.smithi044.stdout:(14/36): python3-pycparser-2.20-6.el9.noarch.rp 2.4 MB/s | 124 kB 00:00 2024-03-26T16:44:14.196 INFO:teuthology.orchestra.run.smithi044.stdout:(15/36): python3-urllib3-1.26.5-5.el9.noarch.rp 3.7 MB/s | 187 kB 00:00 2024-03-26T16:44:14.355 INFO:teuthology.orchestra.run.smithi044.stdout:(16/36): ceph-osd-19.0.0-2382.gbf9505fb.el9.x86 15 MB/s | 17 MB 00:01 2024-03-26T16:44:14.480 INFO:teuthology.orchestra.run.smithi044.stdout:(17/36): python3-requests-2.25.1-8.el9.noarch.r 405 kB/s | 125 kB 00:00 2024-03-26T16:44:14.681 INFO:teuthology.orchestra.run.smithi044.stdout:(18/36): luarocks-3.9.2-1.el9.noarch.rpm 465 kB/s | 151 kB 00:00 2024-03-26T16:44:14.706 INFO:teuthology.orchestra.run.smithi044.stdout:(19/36): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 193 kB/s | 43 kB 00:00 2024-03-26T16:44:14.756 INFO:teuthology.orchestra.run.smithi044.stdout:(20/36): python3-cheroot-8.6.0-4.el9.noarch.rpm 3.4 MB/s | 172 kB 00:00 2024-03-26T16:44:14.790 INFO:teuthology.orchestra.run.smithi044.stdout:(21/36): python3-cherrypy-18.6.1-2.el9.noarch.r 4.2 MB/s | 358 kB 00:00 2024-03-26T16:44:14.815 INFO:teuthology.orchestra.run.smithi044.stdout:(22/36): python3-jaraco-8.2.1-3.el9.noarch.rpm 185 kB/s | 11 kB 00:00 2024-03-26T16:44:14.840 INFO:teuthology.orchestra.run.smithi044.stdout:(23/36): python3-jaraco-classes-3.2.1-5.el9.noa 354 kB/s | 18 kB 00:00 2024-03-26T16:44:14.865 INFO:teuthology.orchestra.run.smithi044.stdout:(24/36): python3-jaraco-collections-3.0.0-8.el9 461 kB/s | 23 kB 00:00 2024-03-26T16:44:14.891 INFO:teuthology.orchestra.run.smithi044.stdout:(25/36): python3-jaraco-functools-3.5.0-2.el9.n 387 kB/s | 19 kB 00:00 2024-03-26T16:44:14.916 INFO:teuthology.orchestra.run.smithi044.stdout:(26/36): python3-jaraco-text-3.2.0-6.el9.noarch 393 kB/s | 20 kB 00:00 2024-03-26T16:44:14.950 INFO:teuthology.orchestra.run.smithi044.stdout:(27/36): python3-logutils-0.3.5-21.el9.noarch.r 793 kB/s | 46 kB 00:00 2024-03-26T16:44:14.975 INFO:teuthology.orchestra.run.smithi044.stdout:(28/36): lua-devel-5.4.4-4.el9.x86_64.rpm 29 kB/s | 22 kB 00:00 2024-03-26T16:44:14.992 INFO:teuthology.orchestra.run.smithi044.stdout:(29/36): python3-more-itertools-8.12.0-2.el9.no 1.0 MB/s | 79 kB 00:00 2024-03-26T16:44:15.017 INFO:teuthology.orchestra.run.smithi044.stdout:(30/36): python3-pecan-1.4.2-3.el9.noarch.rpm 4.0 MB/s | 272 kB 00:00 2024-03-26T16:44:15.042 INFO:teuthology.orchestra.run.smithi044.stdout:(31/36): python3-portend-3.1.0-2.el9.noarch.rpm 332 kB/s | 16 kB 00:00 2024-03-26T16:44:15.067 INFO:teuthology.orchestra.run.smithi044.stdout:(32/36): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.2 MB/s | 90 kB 00:00 2024-03-26T16:44:15.092 INFO:teuthology.orchestra.run.smithi044.stdout:(33/36): python3-tempora-5.0.0-2.el9.noarch.rpm 478 kB/s | 36 kB 00:00 2024-03-26T16:44:15.118 INFO:teuthology.orchestra.run.smithi044.stdout:(34/36): python3-webob-1.8.7-6.el9.noarch.rpm 4.5 MB/s | 230 kB 00:00 2024-03-26T16:44:15.143 INFO:teuthology.orchestra.run.smithi044.stdout:(35/36): python3-werkzeug-2.0.3-3.el9.1.noarch. 5.6 MB/s | 427 kB 00:00 2024-03-26T16:44:15.160 INFO:teuthology.orchestra.run.smithi044.stdout:(36/36): python3-zc-lockfile-2.0-10.el9.noarch. 305 kB/s | 20 kB 00:00 2024-03-26T16:44:15.165 INFO:teuthology.orchestra.run.smithi044.stdout:-------------------------------------------------------------------------------- 2024-03-26T16:44:15.165 INFO:teuthology.orchestra.run.smithi044.stdout:Total 11 MB/s | 30 MB 00:02 2024-03-26T16:44:15.190 INFO:teuthology.orchestra.run.smithi044.stdout:Running transaction check 2024-03-26T16:44:15.236 INFO:teuthology.orchestra.run.smithi044.stdout:Transaction check succeeded. 2024-03-26T16:44:15.236 INFO:teuthology.orchestra.run.smithi044.stdout:Running transaction test 2024-03-26T16:44:15.651 INFO:teuthology.orchestra.run.smithi044.stdout:Transaction test succeeded. 2024-03-26T16:44:15.652 INFO:teuthology.orchestra.run.smithi044.stdout:Running transaction 2024-03-26T16:44:16.979 INFO:teuthology.orchestra.run.smithi044.stdout: Preparing : 1/1 2024-03-26T16:44:17.046 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/36 2024-03-26T16:44:17.079 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/36 2024-03-26T16:44:17.107 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/36 2024-03-26T16:44:17.181 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/36 2024-03-26T16:44:17.232 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : luarocks-3.9.2-1.el9.noarch 5/36 2024-03-26T16:44:17.264 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/36 2024-03-26T16:44:17.361 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/36 2024-03-26T16:44:17.437 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/36 2024-03-26T16:44:17.484 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 9/36 2024-03-26T16:44:17.561 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/36 2024-03-26T16:44:17.610 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 11/36 2024-03-26T16:44:17.655 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 12/36 2024-03-26T16:44:17.714 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-ply-3.11-14.el9.noarch 13/36 2024-03-26T16:44:17.779 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 14/36 2024-03-26T16:44:17.972 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 15/36 2024-03-26T16:44:18.019 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 16/36 2024-03-26T16:44:18.074 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 17/36 2024-03-26T16:44:18.116 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 18/36 2024-03-26T16:44:18.146 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 19/36 2024-03-26T16:44:18.226 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 20/36 2024-03-26T16:44:18.256 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 21/36 2024-03-26T16:44:18.289 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 22/36 2024-03-26T16:44:18.330 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 23/36 2024-03-26T16:44:18.365 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 24/36 2024-03-26T16:44:18.399 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 25/36 2024-03-26T16:44:18.493 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 26/36 2024-03-26T16:44:18.554 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 27/36 2024-03-26T16:44:18.631 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 28/36 2024-03-26T16:44:18.773 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 29/36 2024-03-26T16:44:18.906 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 30/36 2024-03-26T16:44:19.071 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-2382.gbf9505fb.el9. 31/36 2024-03-26T16:44:19.109 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-mgr-2:19.0.0-2382.gbf9505fb.el9.x86_64 32/36 2024-03-26T16:44:19.135 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-mgr-2:19.0.0-2382.gbf9505fb.el9.x86_64 32/36 2024-03-26T16:44:19.135 INFO:teuthology.orchestra.run.smithi044.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-26T16:44:19.135 INFO:teuthology.orchestra.run.smithi044.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-03-26T16:44:19.135 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-26T16:44:19.135 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-26T16:44:19.135 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-26T16:44:20.192 INFO:teuthology.orchestra.run.smithi064.stdout:[MIRROR] python3-bcrypt-3.2.2-1.el9.x86_64.rpm: Curl error (28): Timeout was reached for http://epel.stl.us.ssimn.org/9/Everything/x86_64/Packages/p/python3-bcrypt-3.2.2-1.el9.x86_64.rpm [Failed to connect to epel.stl.us.ssimn.org port 80: Connection timed out] 2024-03-26T16:44:20.395 INFO:teuthology.orchestra.run.smithi064.stdout:(36/36): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 342 B/s | 43 kB 02:09 2024-03-26T16:44:20.397 INFO:teuthology.orchestra.run.smithi064.stdout:-------------------------------------------------------------------------------- 2024-03-26T16:44:20.397 INFO:teuthology.orchestra.run.smithi064.stdout:Total 233 kB/s | 30 MB 02:12 2024-03-26T16:44:20.418 INFO:teuthology.orchestra.run.smithi064.stdout:Running transaction check 2024-03-26T16:44:20.465 INFO:teuthology.orchestra.run.smithi064.stdout:Transaction check succeeded. 2024-03-26T16:44:20.465 INFO:teuthology.orchestra.run.smithi064.stdout:Running transaction test 2024-03-26T16:44:20.661 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-osd-2:19.0.0-2382.gbf9505fb.el9.x86_64 33/36 2024-03-26T16:44:20.686 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-osd-2:19.0.0-2382.gbf9505fb.el9.x86_64 33/36 2024-03-26T16:44:20.686 INFO:teuthology.orchestra.run.smithi044.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-26T16:44:20.687 INFO:teuthology.orchestra.run.smithi044.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-03-26T16:44:20.687 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-26T16:44:20.687 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-26T16:44:20.687 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-26T16:44:20.892 INFO:teuthology.orchestra.run.smithi064.stdout:Transaction test succeeded. 2024-03-26T16:44:20.893 INFO:teuthology.orchestra.run.smithi064.stdout:Running transaction 2024-03-26T16:44:21.161 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-mon-2:19.0.0-2382.gbf9505fb.el9.x86_64 34/36 2024-03-26T16:44:21.184 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-mon-2:19.0.0-2382.gbf9505fb.el9.x86_64 34/36 2024-03-26T16:44:21.185 INFO:teuthology.orchestra.run.smithi044.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-26T16:44:21.185 INFO:teuthology.orchestra.run.smithi044.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-03-26T16:44:21.185 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-26T16:44:21.185 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-26T16:44:21.185 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-26T16:44:21.420 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-mds-2:19.0.0-2382.gbf9505fb.el9.x86_64 35/36 2024-03-26T16:44:21.443 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-mds-2:19.0.0-2382.gbf9505fb.el9.x86_64 35/36 2024-03-26T16:44:21.443 INFO:teuthology.orchestra.run.smithi044.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-26T16:44:21.443 INFO:teuthology.orchestra.run.smithi044.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-03-26T16:44:21.443 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-26T16:44:21.443 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-26T16:44:21.443 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-26T16:44:21.513 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-2:19.0.0-2382.gbf9505fb.el9.x86_64 36/36 2024-03-26T16:44:22.361 INFO:teuthology.orchestra.run.smithi064.stdout: Preparing : 1/1 2024-03-26T16:44:22.415 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/36 2024-03-26T16:44:22.448 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/36 2024-03-26T16:44:22.492 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/36 2024-03-26T16:44:22.565 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/36 2024-03-26T16:44:22.600 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : luarocks-3.9.2-1.el9.noarch 5/36 2024-03-26T16:44:22.633 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/36 2024-03-26T16:44:22.726 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/36 2024-03-26T16:44:22.920 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/36 2024-03-26T16:44:22.978 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 9/36 2024-03-26T16:44:23.050 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/36 2024-03-26T16:44:23.103 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 11/36 2024-03-26T16:44:23.141 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 12/36 2024-03-26T16:44:23.191 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-ply-3.11-14.el9.noarch 13/36 2024-03-26T16:44:23.247 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 14/36 2024-03-26T16:44:23.328 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-2:19.0.0-2382.gbf9505fb.el9.x86_64 36/36 2024-03-26T16:44:23.328 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-2:19.0.0-2382.gbf9505fb.el9.x86_64 1/36 2024-03-26T16:44:23.328 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-mds-2:19.0.0-2382.gbf9505fb.el9.x86_64 2/36 2024-03-26T16:44:23.328 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-mgr-2:19.0.0-2382.gbf9505fb.el9.x86_64 3/36 2024-03-26T16:44:23.328 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-mon-2:19.0.0-2382.gbf9505fb.el9.x86_64 4/36 2024-03-26T16:44:23.328 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-osd-2:19.0.0-2382.gbf9505fb.el9.x86_64 5/36 2024-03-26T16:44:23.328 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-2382.gbf9505fb.el9. 6/36 2024-03-26T16:44:23.328 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : lua-5.4.4-4.el9.x86_64 7/36 2024-03-26T16:44:23.328 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 8/36 2024-03-26T16:44:23.329 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 9/36 2024-03-26T16:44:23.329 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 10/36 2024-03-26T16:44:23.329 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 11/36 2024-03-26T16:44:23.329 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 12/36 2024-03-26T16:44:23.329 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 13/36 2024-03-26T16:44:23.329 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-ply-3.11-14.el9.noarch 14/36 2024-03-26T16:44:23.329 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 15/36 2024-03-26T16:44:23.329 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 16/36 2024-03-26T16:44:23.329 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 17/36 2024-03-26T16:44:23.329 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 18/36 2024-03-26T16:44:23.329 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 19/36 2024-03-26T16:44:23.329 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 20/36 2024-03-26T16:44:23.329 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 21/36 2024-03-26T16:44:23.330 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 22/36 2024-03-26T16:44:23.330 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 23/36 2024-03-26T16:44:23.330 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 24/36 2024-03-26T16:44:23.330 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 25/36 2024-03-26T16:44:23.330 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 26/36 2024-03-26T16:44:23.330 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 27/36 2024-03-26T16:44:23.330 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 28/36 2024-03-26T16:44:23.330 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 29/36 2024-03-26T16:44:23.330 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 30/36 2024-03-26T16:44:23.330 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 31/36 2024-03-26T16:44:23.330 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 32/36 2024-03-26T16:44:23.330 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 33/36 2024-03-26T16:44:23.330 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 34/36 2024-03-26T16:44:23.331 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 35/36 2024-03-26T16:44:23.437 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 15/36 2024-03-26T16:44:23.479 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 16/36 2024-03-26T16:44:23.524 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 17/36 2024-03-26T16:44:23.560 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 18/36 2024-03-26T16:44:23.590 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 19/36 2024-03-26T16:44:23.668 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 20/36 2024-03-26T16:44:23.701 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 21/36 2024-03-26T16:44:23.734 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 22/36 2024-03-26T16:44:23.775 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 23/36 2024-03-26T16:44:23.973 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 24/36 2024-03-26T16:44:24.002 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 25/36 2024-03-26T16:44:24.096 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 26/36 2024-03-26T16:44:24.133 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 27/36 2024-03-26T16:44:24.215 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 36/36 2024-03-26T16:44:24.216 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-26T16:44:24.216 INFO:teuthology.orchestra.run.smithi044.stdout:Installed: 2024-03-26T16:44:24.216 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-2:19.0.0-2382.gbf9505fb.el9.x86_64 2024-03-26T16:44:24.216 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mds-2:19.0.0-2382.gbf9505fb.el9.x86_64 2024-03-26T16:44:24.216 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mgr-2:19.0.0-2382.gbf9505fb.el9.x86_64 2024-03-26T16:44:24.216 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mgr-modules-core-2:19.0.0-2382.gbf9505fb.el9.noarch 2024-03-26T16:44:24.216 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mon-2:19.0.0-2382.gbf9505fb.el9.x86_64 2024-03-26T16:44:24.216 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-osd-2:19.0.0-2382.gbf9505fb.el9.x86_64 2024-03-26T16:44:24.216 INFO:teuthology.orchestra.run.smithi044.stdout: lua-5.4.4-4.el9.x86_64 2024-03-26T16:44:24.216 INFO:teuthology.orchestra.run.smithi044.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-03-26T16:44:24.216 INFO:teuthology.orchestra.run.smithi044.stdout: luarocks-3.9.2-1.el9.noarch 2024-03-26T16:44:24.216 INFO:teuthology.orchestra.run.smithi044.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-03-26T16:44:24.216 INFO:teuthology.orchestra.run.smithi044.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-03-26T16:44:24.216 INFO:teuthology.orchestra.run.smithi044.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-03-26T16:44:24.217 INFO:teuthology.orchestra.run.smithi044.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-03-26T16:44:24.217 INFO:teuthology.orchestra.run.smithi044.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-03-26T16:44:24.217 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-03-26T16:44:24.217 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-03-26T16:44:24.217 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-03-26T16:44:24.217 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-03-26T16:44:24.217 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-03-26T16:44:24.217 INFO:teuthology.orchestra.run.smithi044.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-03-26T16:44:24.217 INFO:teuthology.orchestra.run.smithi044.stdout: python3-mako-1.1.4-6.el9.noarch 2024-03-26T16:44:24.217 INFO:teuthology.orchestra.run.smithi044.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-03-26T16:44:24.217 INFO:teuthology.orchestra.run.smithi044.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-03-26T16:44:24.217 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-03-26T16:44:24.217 INFO:teuthology.orchestra.run.smithi044.stdout: python3-ply-3.11-14.el9.noarch 2024-03-26T16:44:24.218 INFO:teuthology.orchestra.run.smithi044.stdout: python3-portend-3.1.0-2.el9.noarch 2024-03-26T16:44:24.218 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-03-26T16:44:24.218 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pycparser-2.20-6.el9.noarch 2024-03-26T16:44:24.218 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pytz-2021.1-5.el9.noarch 2024-03-26T16:44:24.218 INFO:teuthology.orchestra.run.smithi044.stdout: python3-requests-2.25.1-8.el9.noarch 2024-03-26T16:44:24.218 INFO:teuthology.orchestra.run.smithi044.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-03-26T16:44:24.218 INFO:teuthology.orchestra.run.smithi044.stdout: python3-toml-0.10.2-6.el9.noarch 2024-03-26T16:44:24.218 INFO:teuthology.orchestra.run.smithi044.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-03-26T16:44:24.218 INFO:teuthology.orchestra.run.smithi044.stdout: python3-webob-1.8.7-6.el9.noarch 2024-03-26T16:44:24.218 INFO:teuthology.orchestra.run.smithi044.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-03-26T16:44:24.218 INFO:teuthology.orchestra.run.smithi044.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-03-26T16:44:24.219 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-26T16:44:24.219 INFO:teuthology.orchestra.run.smithi044.stdout:Complete! 2024-03-26T16:44:24.219 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 28/36 2024-03-26T16:44:24.357 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 29/36 2024-03-26T16:44:24.482 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 30/36 2024-03-26T16:44:24.532 DEBUG:teuthology.orchestra.run.smithi044:> sudo yum -y install ceph-base 2024-03-26T16:44:24.650 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-2382.gbf9505fb.el9. 31/36 2024-03-26T16:44:24.679 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : ceph-mgr-2:19.0.0-2382.gbf9505fb.el9.x86_64 32/36 2024-03-26T16:44:24.703 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: ceph-mgr-2:19.0.0-2382.gbf9505fb.el9.x86_64 32/36 2024-03-26T16:44:24.703 INFO:teuthology.orchestra.run.smithi064.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-26T16:44:24.703 INFO:teuthology.orchestra.run.smithi064.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-03-26T16:44:24.703 INFO:teuthology.orchestra.run.smithi064.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-26T16:44:24.704 INFO:teuthology.orchestra.run.smithi064.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-26T16:44:24.704 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-03-26T16:44:25.103 INFO:teuthology.orchestra.run.smithi044.stdout:Last metadata expiration check: 0:00:55 ago on Tue 26 Mar 2024 04:43:30 PM UTC. 2024-03-26T16:44:25.204 INFO:teuthology.orchestra.run.smithi044.stdout:Package ceph-base-2:19.0.0-2382.gbf9505fb.el9.x86_64 is already installed. 2024-03-26T16:44:25.258 INFO:teuthology.orchestra.run.smithi044.stdout:Dependencies resolved. 2024-03-26T16:44:25.259 INFO:teuthology.orchestra.run.smithi044.stdout:Nothing to do. 2024-03-26T16:44:25.259 INFO:teuthology.orchestra.run.smithi044.stdout:Complete! 2024-03-26T16:44:25.325 DEBUG:teuthology.orchestra.run.smithi044:> sudo yum -y install cephadm 2024-03-26T16:44:25.889 INFO:teuthology.orchestra.run.smithi044.stdout:Last metadata expiration check: 0:00:55 ago on Tue 26 Mar 2024 04:43:30 PM UTC. 2024-03-26T16:44:26.044 INFO:teuthology.orchestra.run.smithi044.stdout:Dependencies resolved. 2024-03-26T16:44:26.044 INFO:teuthology.orchestra.run.smithi044.stdout:================================================================================ 2024-03-26T16:44:26.045 INFO:teuthology.orchestra.run.smithi044.stdout: Package Arch Version Repository Size 2024-03-26T16:44:26.045 INFO:teuthology.orchestra.run.smithi044.stdout:================================================================================ 2024-03-26T16:44:26.045 INFO:teuthology.orchestra.run.smithi044.stdout:Installing: 2024-03-26T16:44:26.045 INFO:teuthology.orchestra.run.smithi044.stdout: cephadm noarch 2:19.0.0-2382.gbf9505fb.el9 ceph-noarch 750 k 2024-03-26T16:44:26.045 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-26T16:44:26.045 INFO:teuthology.orchestra.run.smithi044.stdout:Transaction Summary 2024-03-26T16:44:26.045 INFO:teuthology.orchestra.run.smithi044.stdout:================================================================================ 2024-03-26T16:44:26.045 INFO:teuthology.orchestra.run.smithi044.stdout:Install 1 Package 2024-03-26T16:44:26.045 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-26T16:44:26.045 INFO:teuthology.orchestra.run.smithi044.stdout:Total download size: 750 k 2024-03-26T16:44:26.045 INFO:teuthology.orchestra.run.smithi044.stdout:Installed size: 756 k 2024-03-26T16:44:26.045 INFO:teuthology.orchestra.run.smithi044.stdout:Downloading Packages: 2024-03-26T16:44:26.230 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : ceph-osd-2:19.0.0-2382.gbf9505fb.el9.x86_64 33/36 2024-03-26T16:44:26.255 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: ceph-osd-2:19.0.0-2382.gbf9505fb.el9.x86_64 33/36 2024-03-26T16:44:26.255 INFO:teuthology.orchestra.run.smithi064.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-26T16:44:26.255 INFO:teuthology.orchestra.run.smithi064.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-03-26T16:44:26.255 INFO:teuthology.orchestra.run.smithi064.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-26T16:44:26.256 INFO:teuthology.orchestra.run.smithi064.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-26T16:44:26.256 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-03-26T16:44:26.344 INFO:teuthology.orchestra.run.smithi044.stdout:cephadm-19.0.0-2382.gbf9505fb.el9.noarch.rpm 2.5 MB/s | 750 kB 00:00 2024-03-26T16:44:26.345 INFO:teuthology.orchestra.run.smithi044.stdout:-------------------------------------------------------------------------------- 2024-03-26T16:44:26.345 INFO:teuthology.orchestra.run.smithi044.stdout:Total 2.4 MB/s | 750 kB 00:00 2024-03-26T16:44:26.345 INFO:teuthology.orchestra.run.smithi044.stdout:Running transaction check 2024-03-26T16:44:26.351 INFO:teuthology.orchestra.run.smithi044.stdout:Transaction check succeeded. 2024-03-26T16:44:26.351 INFO:teuthology.orchestra.run.smithi044.stdout:Running transaction test 2024-03-26T16:44:26.357 INFO:teuthology.orchestra.run.smithi044.stdout:Transaction test succeeded. 2024-03-26T16:44:26.357 INFO:teuthology.orchestra.run.smithi044.stdout:Running transaction 2024-03-26T16:44:26.433 INFO:teuthology.orchestra.run.smithi044.stdout: Preparing : 1/1 2024-03-26T16:44:26.722 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : ceph-mon-2:19.0.0-2382.gbf9505fb.el9.x86_64 34/36 2024-03-26T16:44:26.744 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: ceph-mon-2:19.0.0-2382.gbf9505fb.el9.x86_64 34/36 2024-03-26T16:44:26.745 INFO:teuthology.orchestra.run.smithi064.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-26T16:44:26.745 INFO:teuthology.orchestra.run.smithi064.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-03-26T16:44:26.745 INFO:teuthology.orchestra.run.smithi064.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-26T16:44:26.745 INFO:teuthology.orchestra.run.smithi064.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-26T16:44:26.745 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-03-26T16:44:26.827 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: cephadm-2:19.0.0-2382.gbf9505fb.el9.noarch 1/1 2024-03-26T16:44:26.917 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : cephadm-2:19.0.0-2382.gbf9505fb.el9.noarch 1/1 2024-03-26T16:44:26.981 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : ceph-mds-2:19.0.0-2382.gbf9505fb.el9.x86_64 35/36 2024-03-26T16:44:27.003 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: ceph-mds-2:19.0.0-2382.gbf9505fb.el9.x86_64 35/36 2024-03-26T16:44:27.003 INFO:teuthology.orchestra.run.smithi064.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-26T16:44:27.003 INFO:teuthology.orchestra.run.smithi064.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-03-26T16:44:27.003 INFO:teuthology.orchestra.run.smithi064.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-26T16:44:27.003 INFO:teuthology.orchestra.run.smithi064.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-26T16:44:27.004 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-03-26T16:44:27.073 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : ceph-2:19.0.0-2382.gbf9505fb.el9.x86_64 36/36 2024-03-26T16:44:27.256 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: cephadm-2:19.0.0-2382.gbf9505fb.el9.noarch 1/1 2024-03-26T16:44:27.534 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : cephadm-2:19.0.0-2382.gbf9505fb.el9.noarch 1/1 2024-03-26T16:44:27.534 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-26T16:44:27.534 INFO:teuthology.orchestra.run.smithi044.stdout:Installed: 2024-03-26T16:44:27.534 INFO:teuthology.orchestra.run.smithi044.stdout: cephadm-2:19.0.0-2382.gbf9505fb.el9.noarch 2024-03-26T16:44:27.534 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-26T16:44:27.534 INFO:teuthology.orchestra.run.smithi044.stdout:Complete! 2024-03-26T16:44:27.728 DEBUG:teuthology.orchestra.run.smithi044:> sudo yum -y install ceph-immutable-object-cache 2024-03-26T16:44:28.295 INFO:teuthology.orchestra.run.smithi044.stdout:Last metadata expiration check: 0:00:58 ago on Tue 26 Mar 2024 04:43:30 PM UTC. 2024-03-26T16:44:28.450 INFO:teuthology.orchestra.run.smithi044.stdout:Dependencies resolved. 2024-03-26T16:44:28.451 INFO:teuthology.orchestra.run.smithi044.stdout:================================================================================ 2024-03-26T16:44:28.451 INFO:teuthology.orchestra.run.smithi044.stdout: Package Arch Version Repo Size 2024-03-26T16:44:28.451 INFO:teuthology.orchestra.run.smithi044.stdout:================================================================================ 2024-03-26T16:44:28.451 INFO:teuthology.orchestra.run.smithi044.stdout:Installing: 2024-03-26T16:44:28.451 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-2382.gbf9505fb.el9 ceph 145 k 2024-03-26T16:44:28.451 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-26T16:44:28.452 INFO:teuthology.orchestra.run.smithi044.stdout:Transaction Summary 2024-03-26T16:44:28.452 INFO:teuthology.orchestra.run.smithi044.stdout:================================================================================ 2024-03-26T16:44:28.452 INFO:teuthology.orchestra.run.smithi044.stdout:Install 1 Package 2024-03-26T16:44:28.452 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-26T16:44:28.452 INFO:teuthology.orchestra.run.smithi044.stdout:Total download size: 145 k 2024-03-26T16:44:28.452 INFO:teuthology.orchestra.run.smithi044.stdout:Installed size: 435 k 2024-03-26T16:44:28.452 INFO:teuthology.orchestra.run.smithi044.stdout:Downloading Packages: 2024-03-26T16:44:28.677 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: ceph-2:19.0.0-2382.gbf9505fb.el9.x86_64 36/36 2024-03-26T16:44:28.677 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : ceph-2:19.0.0-2382.gbf9505fb.el9.x86_64 1/36 2024-03-26T16:44:28.677 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : ceph-mds-2:19.0.0-2382.gbf9505fb.el9.x86_64 2/36 2024-03-26T16:44:28.677 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : ceph-mgr-2:19.0.0-2382.gbf9505fb.el9.x86_64 3/36 2024-03-26T16:44:28.677 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : ceph-mon-2:19.0.0-2382.gbf9505fb.el9.x86_64 4/36 2024-03-26T16:44:28.677 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : ceph-osd-2:19.0.0-2382.gbf9505fb.el9.x86_64 5/36 2024-03-26T16:44:28.677 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-2382.gbf9505fb.el9. 6/36 2024-03-26T16:44:28.677 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : lua-5.4.4-4.el9.x86_64 7/36 2024-03-26T16:44:28.678 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 8/36 2024-03-26T16:44:28.678 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 9/36 2024-03-26T16:44:28.678 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 10/36 2024-03-26T16:44:28.678 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 11/36 2024-03-26T16:44:28.678 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 12/36 2024-03-26T16:44:28.678 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 13/36 2024-03-26T16:44:28.678 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-ply-3.11-14.el9.noarch 14/36 2024-03-26T16:44:28.678 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 15/36 2024-03-26T16:44:28.678 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 16/36 2024-03-26T16:44:28.678 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 17/36 2024-03-26T16:44:28.678 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 18/36 2024-03-26T16:44:28.678 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 19/36 2024-03-26T16:44:28.678 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 20/36 2024-03-26T16:44:28.678 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 21/36 2024-03-26T16:44:28.679 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 22/36 2024-03-26T16:44:28.679 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 23/36 2024-03-26T16:44:28.679 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 24/36 2024-03-26T16:44:28.679 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 25/36 2024-03-26T16:44:28.679 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 26/36 2024-03-26T16:44:28.679 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 27/36 2024-03-26T16:44:28.679 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 28/36 2024-03-26T16:44:28.679 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 29/36 2024-03-26T16:44:28.679 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 30/36 2024-03-26T16:44:28.679 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 31/36 2024-03-26T16:44:28.679 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 32/36 2024-03-26T16:44:28.679 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 33/36 2024-03-26T16:44:28.679 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 34/36 2024-03-26T16:44:28.679 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 35/36 2024-03-26T16:44:28.680 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-immutable-object-cache-19.0.0-2382.gbf9505 648 kB/s | 145 kB 00:00 2024-03-26T16:44:28.680 INFO:teuthology.orchestra.run.smithi044.stdout:-------------------------------------------------------------------------------- 2024-03-26T16:44:28.680 INFO:teuthology.orchestra.run.smithi044.stdout:Total 645 kB/s | 145 kB 00:00 2024-03-26T16:44:28.680 INFO:teuthology.orchestra.run.smithi044.stdout:Running transaction check 2024-03-26T16:44:28.684 INFO:teuthology.orchestra.run.smithi044.stdout:Transaction check succeeded. 2024-03-26T16:44:28.684 INFO:teuthology.orchestra.run.smithi044.stdout:Running transaction test 2024-03-26T16:44:28.739 INFO:teuthology.orchestra.run.smithi044.stdout:Transaction test succeeded. 2024-03-26T16:44:28.739 INFO:teuthology.orchestra.run.smithi044.stdout:Running transaction 2024-03-26T16:44:28.883 INFO:teuthology.orchestra.run.smithi044.stdout: Preparing : 1/1 2024-03-26T16:44:28.935 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-2382.gbf9505fb. 1/1 2024-03-26T16:44:28.959 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-2382.gbf9505fb. 1/1 2024-03-26T16:44:28.959 INFO:teuthology.orchestra.run.smithi044.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-26T16:44:28.959 INFO:teuthology.orchestra.run.smithi044.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-03-26T16:44:28.959 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-26T16:44:29.659 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 36/36 2024-03-26T16:44:29.659 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-03-26T16:44:29.659 INFO:teuthology.orchestra.run.smithi064.stdout:Installed: 2024-03-26T16:44:29.659 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-2:19.0.0-2382.gbf9505fb.el9.x86_64 2024-03-26T16:44:29.659 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-mds-2:19.0.0-2382.gbf9505fb.el9.x86_64 2024-03-26T16:44:29.659 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-mgr-2:19.0.0-2382.gbf9505fb.el9.x86_64 2024-03-26T16:44:29.659 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-mgr-modules-core-2:19.0.0-2382.gbf9505fb.el9.noarch 2024-03-26T16:44:29.659 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-mon-2:19.0.0-2382.gbf9505fb.el9.x86_64 2024-03-26T16:44:29.660 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-osd-2:19.0.0-2382.gbf9505fb.el9.x86_64 2024-03-26T16:44:29.660 INFO:teuthology.orchestra.run.smithi064.stdout: lua-5.4.4-4.el9.x86_64 2024-03-26T16:44:29.660 INFO:teuthology.orchestra.run.smithi064.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-03-26T16:44:29.660 INFO:teuthology.orchestra.run.smithi064.stdout: luarocks-3.9.2-1.el9.noarch 2024-03-26T16:44:29.660 INFO:teuthology.orchestra.run.smithi064.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-03-26T16:44:29.660 INFO:teuthology.orchestra.run.smithi064.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-03-26T16:44:29.660 INFO:teuthology.orchestra.run.smithi064.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-03-26T16:44:29.660 INFO:teuthology.orchestra.run.smithi064.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-03-26T16:44:29.660 INFO:teuthology.orchestra.run.smithi064.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-03-26T16:44:29.660 INFO:teuthology.orchestra.run.smithi064.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-03-26T16:44:29.660 INFO:teuthology.orchestra.run.smithi064.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-03-26T16:44:29.660 INFO:teuthology.orchestra.run.smithi064.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-03-26T16:44:29.660 INFO:teuthology.orchestra.run.smithi064.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-03-26T16:44:29.660 INFO:teuthology.orchestra.run.smithi064.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-03-26T16:44:29.660 INFO:teuthology.orchestra.run.smithi064.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-03-26T16:44:29.661 INFO:teuthology.orchestra.run.smithi064.stdout: python3-mako-1.1.4-6.el9.noarch 2024-03-26T16:44:29.661 INFO:teuthology.orchestra.run.smithi064.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-03-26T16:44:29.661 INFO:teuthology.orchestra.run.smithi064.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-03-26T16:44:29.661 INFO:teuthology.orchestra.run.smithi064.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-03-26T16:44:29.661 INFO:teuthology.orchestra.run.smithi064.stdout: python3-ply-3.11-14.el9.noarch 2024-03-26T16:44:29.661 INFO:teuthology.orchestra.run.smithi064.stdout: python3-portend-3.1.0-2.el9.noarch 2024-03-26T16:44:29.661 INFO:teuthology.orchestra.run.smithi064.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-03-26T16:44:29.661 INFO:teuthology.orchestra.run.smithi064.stdout: python3-pycparser-2.20-6.el9.noarch 2024-03-26T16:44:29.661 INFO:teuthology.orchestra.run.smithi064.stdout: python3-pytz-2021.1-5.el9.noarch 2024-03-26T16:44:29.661 INFO:teuthology.orchestra.run.smithi064.stdout: python3-requests-2.25.1-8.el9.noarch 2024-03-26T16:44:29.661 INFO:teuthology.orchestra.run.smithi064.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-03-26T16:44:29.661 INFO:teuthology.orchestra.run.smithi064.stdout: python3-toml-0.10.2-6.el9.noarch 2024-03-26T16:44:29.661 INFO:teuthology.orchestra.run.smithi064.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-03-26T16:44:29.661 INFO:teuthology.orchestra.run.smithi064.stdout: python3-webob-1.8.7-6.el9.noarch 2024-03-26T16:44:29.662 INFO:teuthology.orchestra.run.smithi064.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-03-26T16:44:29.662 INFO:teuthology.orchestra.run.smithi064.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-03-26T16:44:29.662 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-03-26T16:44:29.662 INFO:teuthology.orchestra.run.smithi064.stdout:Complete! 2024-03-26T16:44:29.866 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-2382.gbf9505fb. 1/1 2024-03-26T16:44:29.866 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-26T16:44:29.867 INFO:teuthology.orchestra.run.smithi044.stdout:Installed: 2024-03-26T16:44:29.867 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-immutable-object-cache-2:19.0.0-2382.gbf9505fb.el9.x86_64 2024-03-26T16:44:29.867 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-26T16:44:29.867 INFO:teuthology.orchestra.run.smithi044.stdout:Complete! 2024-03-26T16:44:29.994 DEBUG:teuthology.orchestra.run.smithi064:> sudo yum -y install ceph-base 2024-03-26T16:44:30.128 DEBUG:teuthology.orchestra.run.smithi044:> sudo yum -y install ceph-mgr 2024-03-26T16:44:30.564 INFO:teuthology.orchestra.run.smithi064.stdout:Last metadata expiration check: 0:03:08 ago on Tue 26 Mar 2024 04:41:22 PM UTC. 2024-03-26T16:44:30.663 INFO:teuthology.orchestra.run.smithi064.stdout:Package ceph-base-2:19.0.0-2382.gbf9505fb.el9.x86_64 is already installed. 2024-03-26T16:44:30.704 INFO:teuthology.orchestra.run.smithi044.stdout:Last metadata expiration check: 0:01:00 ago on Tue 26 Mar 2024 04:43:30 PM UTC. 2024-03-26T16:44:30.718 INFO:teuthology.orchestra.run.smithi064.stdout:Dependencies resolved. 2024-03-26T16:44:30.719 INFO:teuthology.orchestra.run.smithi064.stdout:Nothing to do. 2024-03-26T16:44:30.719 INFO:teuthology.orchestra.run.smithi064.stdout:Complete! 2024-03-26T16:44:30.777 DEBUG:teuthology.orchestra.run.smithi064:> sudo yum -y install cephadm 2024-03-26T16:44:30.804 INFO:teuthology.orchestra.run.smithi044.stdout:Package ceph-mgr-2:19.0.0-2382.gbf9505fb.el9.x86_64 is already installed. 2024-03-26T16:44:30.861 INFO:teuthology.orchestra.run.smithi044.stdout:Dependencies resolved. 2024-03-26T16:44:30.862 INFO:teuthology.orchestra.run.smithi044.stdout:Nothing to do. 2024-03-26T16:44:30.862 INFO:teuthology.orchestra.run.smithi044.stdout:Complete! 2024-03-26T16:44:30.924 DEBUG:teuthology.orchestra.run.smithi044:> sudo yum -y install ceph-mgr-dashboard 2024-03-26T16:44:31.344 INFO:teuthology.orchestra.run.smithi064.stdout:Last metadata expiration check: 0:03:09 ago on Tue 26 Mar 2024 04:41:22 PM UTC. 2024-03-26T16:44:31.490 INFO:teuthology.orchestra.run.smithi044.stdout:Last metadata expiration check: 0:01:01 ago on Tue 26 Mar 2024 04:43:30 PM UTC. 2024-03-26T16:44:31.497 INFO:teuthology.orchestra.run.smithi064.stdout:Dependencies resolved. 2024-03-26T16:44:31.498 INFO:teuthology.orchestra.run.smithi064.stdout:================================================================================ 2024-03-26T16:44:31.498 INFO:teuthology.orchestra.run.smithi064.stdout: Package Arch Version Repository Size 2024-03-26T16:44:31.498 INFO:teuthology.orchestra.run.smithi064.stdout:================================================================================ 2024-03-26T16:44:31.498 INFO:teuthology.orchestra.run.smithi064.stdout:Installing: 2024-03-26T16:44:31.498 INFO:teuthology.orchestra.run.smithi064.stdout: cephadm noarch 2:19.0.0-2382.gbf9505fb.el9 ceph-noarch 750 k 2024-03-26T16:44:31.498 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-03-26T16:44:31.498 INFO:teuthology.orchestra.run.smithi064.stdout:Transaction Summary 2024-03-26T16:44:31.498 INFO:teuthology.orchestra.run.smithi064.stdout:================================================================================ 2024-03-26T16:44:31.498 INFO:teuthology.orchestra.run.smithi064.stdout:Install 1 Package 2024-03-26T16:44:31.498 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-03-26T16:44:31.499 INFO:teuthology.orchestra.run.smithi064.stdout:Total download size: 750 k 2024-03-26T16:44:31.499 INFO:teuthology.orchestra.run.smithi064.stdout:Installed size: 756 k 2024-03-26T16:44:31.499 INFO:teuthology.orchestra.run.smithi064.stdout:Downloading Packages: 2024-03-26T16:44:31.645 INFO:teuthology.orchestra.run.smithi044.stdout:Dependencies resolved. 2024-03-26T16:44:31.646 INFO:teuthology.orchestra.run.smithi044.stdout:====================================================================================== 2024-03-26T16:44:31.647 INFO:teuthology.orchestra.run.smithi044.stdout: Package Arch Version Repository Size 2024-03-26T16:44:31.647 INFO:teuthology.orchestra.run.smithi044.stdout:====================================================================================== 2024-03-26T16:44:31.647 INFO:teuthology.orchestra.run.smithi044.stdout:Installing: 2024-03-26T16:44:31.647 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mgr-dashboard noarch 2:19.0.0-2382.gbf9505fb.el9 ceph-noarch 3.5 M 2024-03-26T16:44:31.647 INFO:teuthology.orchestra.run.smithi044.stdout:Installing dependencies: 2024-03-26T16:44:31.647 INFO:teuthology.orchestra.run.smithi044.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-03-26T16:44:31.647 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-grafana-dashboards noarch 2:19.0.0-2382.gbf9505fb.el9 ceph-noarch 34 k 2024-03-26T16:44:31.647 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-prometheus-alerts noarch 2:19.0.0-2382.gbf9505fb.el9 ceph-noarch 16 k 2024-03-26T16:44:31.647 INFO:teuthology.orchestra.run.smithi044.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-03-26T16:44:31.647 INFO:teuthology.orchestra.run.smithi044.stdout: protobuf x86_64 3.14.0-13.el9 CentOS-AppStream 1.0 M 2024-03-26T16:44:31.647 INFO:teuthology.orchestra.run.smithi044.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-03-26T16:44:31.647 INFO:teuthology.orchestra.run.smithi044.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-03-26T16:44:31.648 INFO:teuthology.orchestra.run.smithi044.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-03-26T16:44:31.648 INFO:teuthology.orchestra.run.smithi044.stdout: python3-protobuf noarch 3.14.0-13.el9 CentOS-AppStream 238 k 2024-03-26T16:44:31.648 INFO:teuthology.orchestra.run.smithi044.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-03-26T16:44:31.648 INFO:teuthology.orchestra.run.smithi044.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-03-26T16:44:31.648 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-26T16:44:31.648 INFO:teuthology.orchestra.run.smithi044.stdout:Transaction Summary 2024-03-26T16:44:31.648 INFO:teuthology.orchestra.run.smithi044.stdout:====================================================================================== 2024-03-26T16:44:31.648 INFO:teuthology.orchestra.run.smithi044.stdout:Install 12 Packages 2024-03-26T16:44:31.648 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-26T16:44:31.649 INFO:teuthology.orchestra.run.smithi044.stdout:Total download size: 8.6 M 2024-03-26T16:44:31.649 INFO:teuthology.orchestra.run.smithi044.stdout:Installed size: 103 M 2024-03-26T16:44:31.649 INFO:teuthology.orchestra.run.smithi044.stdout:Downloading Packages: 2024-03-26T16:44:31.923 INFO:teuthology.orchestra.run.smithi064.stdout:cephadm-19.0.0-2382.gbf9505fb.el9.noarch.rpm 1.7 MB/s | 750 kB 00:00 2024-03-26T16:44:31.924 INFO:teuthology.orchestra.run.smithi064.stdout:-------------------------------------------------------------------------------- 2024-03-26T16:44:31.924 INFO:teuthology.orchestra.run.smithi064.stdout:Total 1.7 MB/s | 750 kB 00:00 2024-03-26T16:44:31.924 INFO:teuthology.orchestra.run.smithi064.stdout:Running transaction check 2024-03-26T16:44:31.929 INFO:teuthology.orchestra.run.smithi064.stdout:Transaction check succeeded. 2024-03-26T16:44:31.929 INFO:teuthology.orchestra.run.smithi064.stdout:Running transaction test 2024-03-26T16:44:31.935 INFO:teuthology.orchestra.run.smithi064.stdout:Transaction test succeeded. 2024-03-26T16:44:31.936 INFO:teuthology.orchestra.run.smithi064.stdout:Running transaction 2024-03-26T16:44:32.008 INFO:teuthology.orchestra.run.smithi064.stdout: Preparing : 1/1 2024-03-26T16:44:32.071 INFO:teuthology.orchestra.run.smithi044.stdout:(1/12): ceph-grafana-dashboards-19.0.0-2382.gbf 179 kB/s | 34 kB 00:00 2024-03-26T16:44:32.096 INFO:teuthology.orchestra.run.smithi044.stdout:(2/12): ceph-prometheus-alerts-19.0.0-2382.gbf9 76 kB/s | 16 kB 00:00 2024-03-26T16:44:32.255 INFO:teuthology.orchestra.run.smithi044.stdout:(3/12): python3-protobuf-3.14.0-13.el9.noarch.r 1.5 MB/s | 238 kB 00:00 2024-03-26T16:44:32.288 INFO:teuthology.orchestra.run.smithi044.stdout:(4/12): protobuf-3.14.0-13.el9.x86_64.rpm 4.6 MB/s | 1.0 MB 00:00 2024-03-26T16:44:32.482 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: cephadm-2:19.0.0-2382.gbf9505fb.el9.noarch 1/1 2024-03-26T16:44:32.563 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : cephadm-2:19.0.0-2382.gbf9505fb.el9.noarch 1/1 2024-03-26T16:44:32.714 INFO:teuthology.orchestra.run.smithi044.stdout:(5/12): abseil-cpp-20211102.0-3.el9.x86_64.rpm 1.3 MB/s | 548 kB 00:00 2024-03-26T16:44:32.772 INFO:teuthology.orchestra.run.smithi044.stdout:(6/12): grpc-data-1.46.7-10.el9.noarch.rpm 333 kB/s | 19 kB 00:00 2024-03-26T16:44:32.839 INFO:teuthology.orchestra.run.smithi044.stdout:(7/12): ceph-mgr-dashboard-19.0.0-2382.gbf9505f 3.7 MB/s | 3.5 MB 00:00 2024-03-26T16:44:32.948 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: cephadm-2:19.0.0-2382.gbf9505fb.el9.noarch 1/1 2024-03-26T16:44:32.981 INFO:teuthology.orchestra.run.smithi044.stdout:(8/12): python3-grpcio-1.46.7-10.el9.x86_64.rpm 9.8 MB/s | 2.0 MB 00:00 2024-03-26T16:44:33.056 INFO:teuthology.orchestra.run.smithi044.stdout:(9/12): protobuf-compiler-3.14.0-13.el9.x86_64. 1.1 MB/s | 863 kB 00:00 2024-03-26T16:44:33.081 INFO:teuthology.orchestra.run.smithi044.stdout:(10/12): python3-repoze-lru-0.7-16.el9.noarch.r 310 kB/s | 31 kB 00:00 2024-03-26T16:44:33.198 INFO:teuthology.orchestra.run.smithi044.stdout:(11/12): python3-grpcio-tools-1.46.7-10.el9.x86 402 kB/s | 144 kB 00:00 2024-03-26T16:44:33.235 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : cephadm-2:19.0.0-2382.gbf9505fb.el9.noarch 1/1 2024-03-26T16:44:33.235 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-03-26T16:44:33.235 INFO:teuthology.orchestra.run.smithi064.stdout:Installed: 2024-03-26T16:44:33.235 INFO:teuthology.orchestra.run.smithi064.stdout: cephadm-2:19.0.0-2382.gbf9505fb.el9.noarch 2024-03-26T16:44:33.235 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-03-26T16:44:33.235 INFO:teuthology.orchestra.run.smithi064.stdout:Complete! 2024-03-26T16:44:33.407 INFO:teuthology.orchestra.run.smithi044.stdout:(12/12): python3-routes-2.5.1-5.el9.noarch.rpm 538 kB/s | 188 kB 00:00 2024-03-26T16:44:33.412 INFO:teuthology.orchestra.run.smithi044.stdout:-------------------------------------------------------------------------------- 2024-03-26T16:44:33.412 INFO:teuthology.orchestra.run.smithi044.stdout:Total 4.9 MB/s | 8.6 MB 00:01 2024-03-26T16:44:33.430 INFO:teuthology.orchestra.run.smithi044.stdout:Running transaction check 2024-03-26T16:44:33.449 INFO:teuthology.orchestra.run.smithi044.stdout:Transaction check succeeded. 2024-03-26T16:44:33.449 INFO:teuthology.orchestra.run.smithi044.stdout:Running transaction test 2024-03-26T16:44:33.454 DEBUG:teuthology.orchestra.run.smithi064:> sudo yum -y install ceph-immutable-object-cache 2024-03-26T16:44:33.655 INFO:teuthology.orchestra.run.smithi044.stdout:Transaction test succeeded. 2024-03-26T16:44:33.655 INFO:teuthology.orchestra.run.smithi044.stdout:Running transaction 2024-03-26T16:44:34.022 INFO:teuthology.orchestra.run.smithi064.stdout:Last metadata expiration check: 0:03:12 ago on Tue 26 Mar 2024 04:41:22 PM UTC. 2024-03-26T16:44:34.179 INFO:teuthology.orchestra.run.smithi064.stdout:Dependencies resolved. 2024-03-26T16:44:34.180 INFO:teuthology.orchestra.run.smithi064.stdout:================================================================================ 2024-03-26T16:44:34.180 INFO:teuthology.orchestra.run.smithi064.stdout: Package Arch Version Repo Size 2024-03-26T16:44:34.180 INFO:teuthology.orchestra.run.smithi064.stdout:================================================================================ 2024-03-26T16:44:34.180 INFO:teuthology.orchestra.run.smithi064.stdout:Installing: 2024-03-26T16:44:34.180 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-2382.gbf9505fb.el9 ceph 145 k 2024-03-26T16:44:34.180 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-03-26T16:44:34.180 INFO:teuthology.orchestra.run.smithi064.stdout:Transaction Summary 2024-03-26T16:44:34.181 INFO:teuthology.orchestra.run.smithi064.stdout:================================================================================ 2024-03-26T16:44:34.181 INFO:teuthology.orchestra.run.smithi064.stdout:Install 1 Package 2024-03-26T16:44:34.181 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-03-26T16:44:34.181 INFO:teuthology.orchestra.run.smithi064.stdout:Total download size: 145 k 2024-03-26T16:44:34.181 INFO:teuthology.orchestra.run.smithi064.stdout:Installed size: 435 k 2024-03-26T16:44:34.181 INFO:teuthology.orchestra.run.smithi064.stdout:Downloading Packages: 2024-03-26T16:44:34.198 INFO:teuthology.orchestra.run.smithi044.stdout: Preparing : 1/1 2024-03-26T16:44:34.275 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 1/12 2024-03-26T16:44:34.318 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 2/12 2024-03-26T16:44:34.365 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/12 2024-03-26T16:44:34.396 INFO:teuthology.orchestra.run.smithi064.stdout:ceph-immutable-object-cache-19.0.0-2382.gbf9505 671 kB/s | 145 kB 00:00 2024-03-26T16:44:34.396 INFO:teuthology.orchestra.run.smithi064.stdout:-------------------------------------------------------------------------------- 2024-03-26T16:44:34.396 INFO:teuthology.orchestra.run.smithi064.stdout:Total 667 kB/s | 145 kB 00:00 2024-03-26T16:44:34.397 INFO:teuthology.orchestra.run.smithi064.stdout:Running transaction check 2024-03-26T16:44:34.405 INFO:teuthology.orchestra.run.smithi064.stdout:Transaction check succeeded. 2024-03-26T16:44:34.405 INFO:teuthology.orchestra.run.smithi064.stdout:Running transaction test 2024-03-26T16:44:34.444 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/12 2024-03-26T16:44:34.462 INFO:teuthology.orchestra.run.smithi064.stdout:Transaction test succeeded. 2024-03-26T16:44:34.462 INFO:teuthology.orchestra.run.smithi064.stdout:Running transaction 2024-03-26T16:44:34.608 INFO:teuthology.orchestra.run.smithi064.stdout: Preparing : 1/1 2024-03-26T16:44:34.626 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 5/12 2024-03-26T16:44:34.672 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-2382.gbf9505fb. 1/1 2024-03-26T16:44:34.695 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-2382.gbf9505fb. 1/1 2024-03-26T16:44:34.695 INFO:teuthology.orchestra.run.smithi064.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-26T16:44:34.695 INFO:teuthology.orchestra.run.smithi064.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-03-26T16:44:34.695 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-03-26T16:44:34.760 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 6/12 2024-03-26T16:44:34.859 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 7/12 2024-03-26T16:44:34.909 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 8/12 2024-03-26T16:44:34.945 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/12 2024-03-26T16:44:34.977 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-2382.gbf9505fb.el9 10/12 2024-03-26T16:44:35.667 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-2382.gbf9505fb. 1/1 2024-03-26T16:44:35.667 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-03-26T16:44:35.667 INFO:teuthology.orchestra.run.smithi064.stdout:Installed: 2024-03-26T16:44:35.667 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-immutable-object-cache-2:19.0.0-2382.gbf9505fb.el9.x86_64 2024-03-26T16:44:35.667 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-03-26T16:44:35.667 INFO:teuthology.orchestra.run.smithi064.stdout:Complete! 2024-03-26T16:44:35.907 DEBUG:teuthology.orchestra.run.smithi064:> sudo yum -y install ceph-mgr 2024-03-26T16:44:36.082 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-2382.gbf9505fb.el 11/12 2024-03-26T16:44:36.119 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-2382.gbf9505fb.el9.noa 12/12 2024-03-26T16:44:36.477 INFO:teuthology.orchestra.run.smithi064.stdout:Last metadata expiration check: 0:03:14 ago on Tue 26 Mar 2024 04:41:22 PM UTC. 2024-03-26T16:44:36.576 INFO:teuthology.orchestra.run.smithi064.stdout:Package ceph-mgr-2:19.0.0-2382.gbf9505fb.el9.x86_64 is already installed. 2024-03-26T16:44:36.630 INFO:teuthology.orchestra.run.smithi064.stdout:Dependencies resolved. 2024-03-26T16:44:36.631 INFO:teuthology.orchestra.run.smithi064.stdout:Nothing to do. 2024-03-26T16:44:36.632 INFO:teuthology.orchestra.run.smithi064.stdout:Complete! 2024-03-26T16:44:36.685 DEBUG:teuthology.orchestra.run.smithi064:> sudo yum -y install ceph-mgr-dashboard 2024-03-26T16:44:37.253 INFO:teuthology.orchestra.run.smithi064.stdout:Last metadata expiration check: 0:03:15 ago on Tue 26 Mar 2024 04:41:22 PM UTC. 2024-03-26T16:44:37.409 INFO:teuthology.orchestra.run.smithi064.stdout:Dependencies resolved. 2024-03-26T16:44:37.410 INFO:teuthology.orchestra.run.smithi064.stdout:====================================================================================== 2024-03-26T16:44:37.410 INFO:teuthology.orchestra.run.smithi064.stdout: Package Arch Version Repository Size 2024-03-26T16:44:37.411 INFO:teuthology.orchestra.run.smithi064.stdout:====================================================================================== 2024-03-26T16:44:37.411 INFO:teuthology.orchestra.run.smithi064.stdout:Installing: 2024-03-26T16:44:37.411 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-mgr-dashboard noarch 2:19.0.0-2382.gbf9505fb.el9 ceph-noarch 3.5 M 2024-03-26T16:44:37.411 INFO:teuthology.orchestra.run.smithi064.stdout:Installing dependencies: 2024-03-26T16:44:37.411 INFO:teuthology.orchestra.run.smithi064.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-03-26T16:44:37.411 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-grafana-dashboards noarch 2:19.0.0-2382.gbf9505fb.el9 ceph-noarch 34 k 2024-03-26T16:44:37.411 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-prometheus-alerts noarch 2:19.0.0-2382.gbf9505fb.el9 ceph-noarch 16 k 2024-03-26T16:44:37.411 INFO:teuthology.orchestra.run.smithi064.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-03-26T16:44:37.411 INFO:teuthology.orchestra.run.smithi064.stdout: protobuf x86_64 3.14.0-13.el9 CentOS-AppStream 1.0 M 2024-03-26T16:44:37.411 INFO:teuthology.orchestra.run.smithi064.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-03-26T16:44:37.411 INFO:teuthology.orchestra.run.smithi064.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-03-26T16:44:37.411 INFO:teuthology.orchestra.run.smithi064.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-03-26T16:44:37.412 INFO:teuthology.orchestra.run.smithi064.stdout: python3-protobuf noarch 3.14.0-13.el9 CentOS-AppStream 238 k 2024-03-26T16:44:37.412 INFO:teuthology.orchestra.run.smithi064.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-03-26T16:44:37.412 INFO:teuthology.orchestra.run.smithi064.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-03-26T16:44:37.412 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-03-26T16:44:37.412 INFO:teuthology.orchestra.run.smithi064.stdout:Transaction Summary 2024-03-26T16:44:37.412 INFO:teuthology.orchestra.run.smithi064.stdout:====================================================================================== 2024-03-26T16:44:37.412 INFO:teuthology.orchestra.run.smithi064.stdout:Install 12 Packages 2024-03-26T16:44:37.412 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-03-26T16:44:37.413 INFO:teuthology.orchestra.run.smithi064.stdout:Total download size: 8.6 M 2024-03-26T16:44:37.413 INFO:teuthology.orchestra.run.smithi064.stdout:Installed size: 103 M 2024-03-26T16:44:37.413 INFO:teuthology.orchestra.run.smithi064.stdout:Downloading Packages: 2024-03-26T16:44:37.571 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-2382.gbf9505fb.el9.noa 12/12 2024-03-26T16:44:37.571 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-2382.gbf9505fb.el 1/12 2024-03-26T16:44:37.571 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-2382.gbf9505fb.el9.noa 2/12 2024-03-26T16:44:37.572 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-2382.gbf9505fb.el9 3/12 2024-03-26T16:44:37.572 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 4/12 2024-03-26T16:44:37.572 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 5/12 2024-03-26T16:44:37.572 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 6/12 2024-03-26T16:44:37.572 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 7/12 2024-03-26T16:44:37.572 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 8/12 2024-03-26T16:44:37.572 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 9/12 2024-03-26T16:44:37.572 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 10/12 2024-03-26T16:44:37.572 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 11/12 2024-03-26T16:44:37.783 INFO:teuthology.orchestra.run.smithi064.stdout:(1/12): ceph-prometheus-alerts-19.0.0-2382.gbf9 84 kB/s | 16 kB 00:00 2024-03-26T16:44:37.826 INFO:teuthology.orchestra.run.smithi064.stdout:(2/12): ceph-grafana-dashboards-19.0.0-2382.gbf 143 kB/s | 34 kB 00:00 2024-03-26T16:44:37.926 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 12/12 2024-03-26T16:44:37.926 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-26T16:44:37.926 INFO:teuthology.orchestra.run.smithi044.stdout:Installed: 2024-03-26T16:44:37.926 INFO:teuthology.orchestra.run.smithi044.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-03-26T16:44:37.926 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-grafana-dashboards-2:19.0.0-2382.gbf9505fb.el9.noarch 2024-03-26T16:44:37.926 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mgr-dashboard-2:19.0.0-2382.gbf9505fb.el9.noarch 2024-03-26T16:44:37.927 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-prometheus-alerts-2:19.0.0-2382.gbf9505fb.el9.noarch 2024-03-26T16:44:37.927 INFO:teuthology.orchestra.run.smithi044.stdout: grpc-data-1.46.7-10.el9.noarch 2024-03-26T16:44:37.927 INFO:teuthology.orchestra.run.smithi044.stdout: protobuf-3.14.0-13.el9.x86_64 2024-03-26T16:44:37.927 INFO:teuthology.orchestra.run.smithi044.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-03-26T16:44:37.927 INFO:teuthology.orchestra.run.smithi044.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-03-26T16:44:37.927 INFO:teuthology.orchestra.run.smithi044.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-03-26T16:44:37.927 INFO:teuthology.orchestra.run.smithi044.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-03-26T16:44:37.927 INFO:teuthology.orchestra.run.smithi044.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-03-26T16:44:37.927 INFO:teuthology.orchestra.run.smithi044.stdout: python3-routes-2.5.1-5.el9.noarch 2024-03-26T16:44:37.927 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-26T16:44:37.927 INFO:teuthology.orchestra.run.smithi044.stdout:Complete! 2024-03-26T16:44:37.992 INFO:teuthology.orchestra.run.smithi064.stdout:(3/12): python3-protobuf-3.14.0-13.el9.noarch.r 1.4 MB/s | 238 kB 00:00 2024-03-26T16:44:38.026 INFO:teuthology.orchestra.run.smithi064.stdout:(4/12): protobuf-3.14.0-13.el9.x86_64.rpm 4.2 MB/s | 1.0 MB 00:00 2024-03-26T16:44:38.137 DEBUG:teuthology.orchestra.run.smithi044:> sudo yum -y install ceph-mgr-diskprediction-local 2024-03-26T16:44:38.410 INFO:teuthology.orchestra.run.smithi064.stdout:(5/12): abseil-cpp-20211102.0-3.el9.x86_64.rpm 1.4 MB/s | 548 kB 00:00 2024-03-26T16:44:38.468 INFO:teuthology.orchestra.run.smithi064.stdout:(6/12): grpc-data-1.46.7-10.el9.noarch.rpm 334 kB/s | 19 kB 00:00 2024-03-26T16:44:38.535 INFO:teuthology.orchestra.run.smithi064.stdout:(7/12): ceph-mgr-dashboard-19.0.0-2382.gbf9505f 3.7 MB/s | 3.5 MB 00:00 2024-03-26T16:44:38.708 INFO:teuthology.orchestra.run.smithi044.stdout:Last metadata expiration check: 0:01:08 ago on Tue 26 Mar 2024 04:43:30 PM UTC. 2024-03-26T16:44:38.752 INFO:teuthology.orchestra.run.smithi064.stdout:(8/12): python3-grpcio-tools-1.46.7-10.el9.x86_ 667 kB/s | 144 kB 00:00 2024-03-26T16:44:38.777 INFO:teuthology.orchestra.run.smithi064.stdout:(9/12): protobuf-compiler-3.14.0-13.el9.x86_64. 1.1 MB/s | 863 kB 00:00 2024-03-26T16:44:38.819 INFO:teuthology.orchestra.run.smithi064.stdout:(10/12): python3-repoze-lru-0.7-16.el9.noarch.r 460 kB/s | 31 kB 00:00 2024-03-26T16:44:38.861 INFO:teuthology.orchestra.run.smithi064.stdout:(11/12): python3-grpcio-1.46.7-10.el9.x86_64.rp 5.2 MB/s | 2.0 MB 00:00 2024-03-26T16:44:38.864 INFO:teuthology.orchestra.run.smithi044.stdout:Dependencies resolved. 2024-03-26T16:44:38.865 INFO:teuthology.orchestra.run.smithi044.stdout:============================================================================================ 2024-03-26T16:44:38.865 INFO:teuthology.orchestra.run.smithi044.stdout: Package Arch Version Repository Size 2024-03-26T16:44:38.865 INFO:teuthology.orchestra.run.smithi044.stdout:============================================================================================ 2024-03-26T16:44:38.865 INFO:teuthology.orchestra.run.smithi044.stdout:Installing: 2024-03-26T16:44:38.866 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-2382.gbf9505fb.el9 ceph-noarch 7.4 M 2024-03-26T16:44:38.866 INFO:teuthology.orchestra.run.smithi044.stdout:Installing dependencies: 2024-03-26T16:44:38.866 INFO:teuthology.orchestra.run.smithi044.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2024-03-26T16:44:38.866 INFO:teuthology.orchestra.run.smithi044.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2024-03-26T16:44:38.866 INFO:teuthology.orchestra.run.smithi044.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2024-03-26T16:44:38.866 INFO:teuthology.orchestra.run.smithi044.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-03-26T16:44:38.866 INFO:teuthology.orchestra.run.smithi044.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-03-26T16:44:38.866 INFO:teuthology.orchestra.run.smithi044.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2024-03-26T16:44:38.866 INFO:teuthology.orchestra.run.smithi044.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2024-03-26T16:44:38.866 INFO:teuthology.orchestra.run.smithi044.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-03-26T16:44:38.866 INFO:teuthology.orchestra.run.smithi044.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2024-03-26T16:44:38.866 INFO:teuthology.orchestra.run.smithi044.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2024-03-26T16:44:38.867 INFO:teuthology.orchestra.run.smithi044.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2024-03-26T16:44:38.867 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-26T16:44:38.867 INFO:teuthology.orchestra.run.smithi044.stdout:Transaction Summary 2024-03-26T16:44:38.867 INFO:teuthology.orchestra.run.smithi044.stdout:============================================================================================ 2024-03-26T16:44:38.867 INFO:teuthology.orchestra.run.smithi044.stdout:Install 12 Packages 2024-03-26T16:44:38.867 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-26T16:44:38.867 INFO:teuthology.orchestra.run.smithi044.stdout:Total download size: 37 M 2024-03-26T16:44:38.867 INFO:teuthology.orchestra.run.smithi044.stdout:Installed size: 209 M 2024-03-26T16:44:38.868 INFO:teuthology.orchestra.run.smithi044.stdout:Downloading Packages: 2024-03-26T16:44:39.028 INFO:teuthology.orchestra.run.smithi064.stdout:(12/12): python3-routes-2.5.1-5.el9.noarch.rpm 753 kB/s | 188 kB 00:00 2024-03-26T16:44:39.031 INFO:teuthology.orchestra.run.smithi064.stdout:-------------------------------------------------------------------------------- 2024-03-26T16:44:39.031 INFO:teuthology.orchestra.run.smithi064.stdout:Total 5.3 MB/s | 8.6 MB 00:01 2024-03-26T16:44:39.050 INFO:teuthology.orchestra.run.smithi064.stdout:Running transaction check 2024-03-26T16:44:39.069 INFO:teuthology.orchestra.run.smithi064.stdout:Transaction check succeeded. 2024-03-26T16:44:39.069 INFO:teuthology.orchestra.run.smithi064.stdout:Running transaction test 2024-03-26T16:44:39.231 INFO:teuthology.orchestra.run.smithi044.stdout:(1/12): flexiblas-3.0.4-8.el9.x86_64.rpm 234 kB/s | 32 kB 00:00 2024-03-26T16:44:39.252 INFO:teuthology.orchestra.run.smithi064.stdout:Transaction test succeeded. 2024-03-26T16:44:39.253 INFO:teuthology.orchestra.run.smithi064.stdout:Running transaction 2024-03-26T16:44:39.273 INFO:teuthology.orchestra.run.smithi044.stdout:(2/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 423 kB/s | 17 kB 00:00 2024-03-26T16:44:39.357 INFO:teuthology.orchestra.run.smithi044.stdout:(3/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 11 MB/s | 3.0 MB 00:00 2024-03-26T16:44:39.382 INFO:teuthology.orchestra.run.smithi044.stdout:(4/12): openblas-0.3.21-2.el9.x86_64.rpm 320 kB/s | 34 kB 00:00 2024-03-26T16:44:39.624 INFO:teuthology.orchestra.run.smithi044.stdout:(5/12): openblas-openmp-0.3.21-2.el9.x86_64.rpm 18 MB/s | 4.7 MB 00:00 2024-03-26T16:44:39.699 INFO:teuthology.orchestra.run.smithi044.stdout:(6/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 15 MB/s | 4.8 MB 00:00 2024-03-26T16:44:39.725 INFO:teuthology.orchestra.run.smithi044.stdout:(7/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 2.2 MB/s | 217 kB 00:00 2024-03-26T16:44:39.783 INFO:teuthology.orchestra.run.smithi064.stdout: Preparing : 1/1 2024-03-26T16:44:39.879 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 1/12 2024-03-26T16:44:39.915 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 2/12 2024-03-26T16:44:39.963 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/12 2024-03-26T16:44:39.967 INFO:teuthology.orchestra.run.smithi044.stdout:(8/12): ceph-mgr-diskprediction-local-19.0.0-23 8.5 MB/s | 7.4 MB 00:00 2024-03-26T16:44:39.999 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/12 2024-03-26T16:44:40.101 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 5/12 2024-03-26T16:44:40.231 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 6/12 2024-03-26T16:44:40.324 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 7/12 2024-03-26T16:44:40.372 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 8/12 2024-03-26T16:44:40.384 INFO:teuthology.orchestra.run.smithi044.stdout:(9/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 23 MB/s | 16 MB 00:00 2024-03-26T16:44:40.408 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/12 2024-03-26T16:44:40.441 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-2382.gbf9505fb.el9 10/12 2024-03-26T16:44:41.101 INFO:teuthology.orchestra.run.smithi044.stdout:(10/12): libquadmath-11.4.1-3.el9.x86_64.rpm 173 kB/s | 195 kB 00:01 2024-03-26T16:44:41.442 INFO:teuthology.orchestra.run.smithi044.stdout:(11/12): python3-devel-3.9.17-2.el9.x86_64.rpm 237 kB/s | 245 kB 00:01 2024-03-26T16:44:41.551 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-2382.gbf9505fb.el 11/12 2024-03-26T16:44:41.582 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-2382.gbf9505fb.el9.noa 12/12 2024-03-26T16:44:41.667 INFO:teuthology.orchestra.run.smithi044.stdout:(12/12): libgfortran-11.4.1-3.el9.x86_64.rpm 413 kB/s | 803 kB 00:01 2024-03-26T16:44:41.671 INFO:teuthology.orchestra.run.smithi044.stdout:-------------------------------------------------------------------------------- 2024-03-26T16:44:41.671 INFO:teuthology.orchestra.run.smithi044.stdout:Total 13 MB/s | 37 MB 00:02 2024-03-26T16:44:41.717 INFO:teuthology.orchestra.run.smithi044.stdout:Running transaction check 2024-03-26T16:44:41.742 INFO:teuthology.orchestra.run.smithi044.stdout:Transaction check succeeded. 2024-03-26T16:44:41.742 INFO:teuthology.orchestra.run.smithi044.stdout:Running transaction test 2024-03-26T16:44:42.113 INFO:teuthology.orchestra.run.smithi044.stdout:Transaction test succeeded. 2024-03-26T16:44:42.113 INFO:teuthology.orchestra.run.smithi044.stdout:Running transaction 2024-03-26T16:44:42.834 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-2382.gbf9505fb.el9.noa 12/12 2024-03-26T16:44:42.834 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-2382.gbf9505fb.el 1/12 2024-03-26T16:44:42.834 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-2382.gbf9505fb.el9.noa 2/12 2024-03-26T16:44:42.834 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-2382.gbf9505fb.el9 3/12 2024-03-26T16:44:42.834 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 4/12 2024-03-26T16:44:42.834 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 5/12 2024-03-26T16:44:42.834 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 6/12 2024-03-26T16:44:42.834 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 7/12 2024-03-26T16:44:42.834 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 8/12 2024-03-26T16:44:42.834 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 9/12 2024-03-26T16:44:42.834 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 10/12 2024-03-26T16:44:42.834 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 11/12 2024-03-26T16:44:42.861 INFO:teuthology.orchestra.run.smithi044.stdout: Preparing : 1/1 2024-03-26T16:44:42.942 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 1/12 2024-03-26T16:44:42.972 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 2/12 2024-03-26T16:44:43.070 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 3/12 2024-03-26T16:44:43.109 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 4/12 2024-03-26T16:44:43.211 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 12/12 2024-03-26T16:44:43.211 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-03-26T16:44:43.211 INFO:teuthology.orchestra.run.smithi064.stdout:Installed: 2024-03-26T16:44:43.211 INFO:teuthology.orchestra.run.smithi064.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-03-26T16:44:43.211 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-grafana-dashboards-2:19.0.0-2382.gbf9505fb.el9.noarch 2024-03-26T16:44:43.211 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-mgr-dashboard-2:19.0.0-2382.gbf9505fb.el9.noarch 2024-03-26T16:44:43.211 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-prometheus-alerts-2:19.0.0-2382.gbf9505fb.el9.noarch 2024-03-26T16:44:43.211 INFO:teuthology.orchestra.run.smithi064.stdout: grpc-data-1.46.7-10.el9.noarch 2024-03-26T16:44:43.211 INFO:teuthology.orchestra.run.smithi064.stdout: protobuf-3.14.0-13.el9.x86_64 2024-03-26T16:44:43.211 INFO:teuthology.orchestra.run.smithi064.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-03-26T16:44:43.211 INFO:teuthology.orchestra.run.smithi064.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-03-26T16:44:43.212 INFO:teuthology.orchestra.run.smithi064.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-03-26T16:44:43.212 INFO:teuthology.orchestra.run.smithi064.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-03-26T16:44:43.212 INFO:teuthology.orchestra.run.smithi064.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-03-26T16:44:43.212 INFO:teuthology.orchestra.run.smithi064.stdout: python3-routes-2.5.1-5.el9.noarch 2024-03-26T16:44:43.212 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-03-26T16:44:43.212 INFO:teuthology.orchestra.run.smithi064.stdout:Complete! 2024-03-26T16:44:43.294 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : openblas-0.3.21-2.el9.x86_64 5/12 2024-03-26T16:44:43.324 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2024-03-26T16:44:43.403 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-03-26T16:44:43.435 DEBUG:teuthology.orchestra.run.smithi064:> sudo yum -y install ceph-mgr-diskprediction-local 2024-03-26T16:44:44.004 INFO:teuthology.orchestra.run.smithi064.stdout:Last metadata expiration check: 0:03:22 ago on Tue 26 Mar 2024 04:41:22 PM UTC. 2024-03-26T16:44:44.109 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-03-26T16:44:44.166 INFO:teuthology.orchestra.run.smithi064.stdout:Dependencies resolved. 2024-03-26T16:44:44.166 INFO:teuthology.orchestra.run.smithi064.stdout:============================================================================================ 2024-03-26T16:44:44.166 INFO:teuthology.orchestra.run.smithi064.stdout: Package Arch Version Repository Size 2024-03-26T16:44:44.166 INFO:teuthology.orchestra.run.smithi064.stdout:============================================================================================ 2024-03-26T16:44:44.166 INFO:teuthology.orchestra.run.smithi064.stdout:Installing: 2024-03-26T16:44:44.166 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-2382.gbf9505fb.el9 ceph-noarch 7.4 M 2024-03-26T16:44:44.167 INFO:teuthology.orchestra.run.smithi064.stdout:Installing dependencies: 2024-03-26T16:44:44.167 INFO:teuthology.orchestra.run.smithi064.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2024-03-26T16:44:44.167 INFO:teuthology.orchestra.run.smithi064.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2024-03-26T16:44:44.167 INFO:teuthology.orchestra.run.smithi064.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2024-03-26T16:44:44.167 INFO:teuthology.orchestra.run.smithi064.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-03-26T16:44:44.167 INFO:teuthology.orchestra.run.smithi064.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-03-26T16:44:44.167 INFO:teuthology.orchestra.run.smithi064.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2024-03-26T16:44:44.167 INFO:teuthology.orchestra.run.smithi064.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2024-03-26T16:44:44.167 INFO:teuthology.orchestra.run.smithi064.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-03-26T16:44:44.167 INFO:teuthology.orchestra.run.smithi064.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2024-03-26T16:44:44.167 INFO:teuthology.orchestra.run.smithi064.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2024-03-26T16:44:44.167 INFO:teuthology.orchestra.run.smithi064.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2024-03-26T16:44:44.167 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-03-26T16:44:44.167 INFO:teuthology.orchestra.run.smithi064.stdout:Transaction Summary 2024-03-26T16:44:44.167 INFO:teuthology.orchestra.run.smithi064.stdout:============================================================================================ 2024-03-26T16:44:44.168 INFO:teuthology.orchestra.run.smithi064.stdout:Install 12 Packages 2024-03-26T16:44:44.168 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-03-26T16:44:44.168 INFO:teuthology.orchestra.run.smithi064.stdout:Total download size: 37 M 2024-03-26T16:44:44.168 INFO:teuthology.orchestra.run.smithi064.stdout:Installed size: 209 M 2024-03-26T16:44:44.168 INFO:teuthology.orchestra.run.smithi064.stdout:Downloading Packages: 2024-03-26T16:44:44.233 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-03-26T16:44:44.636 INFO:teuthology.orchestra.run.smithi064.stdout:(1/12): flexiblas-3.0.4-8.el9.x86_64.rpm 234 kB/s | 32 kB 00:00 2024-03-26T16:44:44.669 INFO:teuthology.orchestra.run.smithi064.stdout:(2/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 537 kB/s | 17 kB 00:00 2024-03-26T16:44:44.711 INFO:teuthology.orchestra.run.smithi064.stdout:(3/12): openblas-0.3.21-2.el9.x86_64.rpm 849 kB/s | 34 kB 00:00 2024-03-26T16:44:44.770 INFO:teuthology.orchestra.run.smithi064.stdout:(4/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 11 MB/s | 3.0 MB 00:00 2024-03-26T16:44:44.945 INFO:teuthology.orchestra.run.smithi064.stdout:(5/12): openblas-openmp-0.3.21-2.el9.x86_64.rpm 20 MB/s | 4.7 MB 00:00 2024-03-26T16:44:45.013 INFO:teuthology.orchestra.run.smithi064.stdout:(6/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 20 MB/s | 4.8 MB 00:00 2024-03-26T16:44:45.038 INFO:teuthology.orchestra.run.smithi064.stdout:(7/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 2.4 MB/s | 217 kB 00:00 2024-03-26T16:44:45.280 INFO:teuthology.orchestra.run.smithi064.stdout:(8/12): ceph-mgr-diskprediction-local-19.0.0-23 9.5 MB/s | 7.4 MB 00:00 2024-03-26T16:44:45.438 INFO:teuthology.orchestra.run.smithi064.stdout:(9/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 37 MB/s | 16 MB 00:00 2024-03-26T16:44:45.464 INFO:teuthology.orchestra.run.smithi064.stdout:(10/12): libgfortran-11.4.1-3.el9.x86_64.rpm 1.9 MB/s | 803 kB 00:00 2024-03-26T16:44:45.558 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-03-26T16:44:45.572 INFO:teuthology.orchestra.run.smithi064.stdout:(11/12): libquadmath-11.4.1-3.el9.x86_64.rpm 674 kB/s | 195 kB 00:00 2024-03-26T16:44:45.706 INFO:teuthology.orchestra.run.smithi064.stdout:(12/12): python3-devel-3.9.17-2.el9.x86_64.rpm 919 kB/s | 245 kB 00:00 2024-03-26T16:44:45.708 INFO:teuthology.orchestra.run.smithi064.stdout:-------------------------------------------------------------------------------- 2024-03-26T16:44:45.708 INFO:teuthology.orchestra.run.smithi064.stdout:Total 24 MB/s | 37 MB 00:01 2024-03-26T16:44:45.750 INFO:teuthology.orchestra.run.smithi064.stdout:Running transaction check 2024-03-26T16:44:45.775 INFO:teuthology.orchestra.run.smithi064.stdout:Transaction check succeeded. 2024-03-26T16:44:45.775 INFO:teuthology.orchestra.run.smithi064.stdout:Running transaction test 2024-03-26T16:44:46.149 INFO:teuthology.orchestra.run.smithi064.stdout:Transaction test succeeded. 2024-03-26T16:44:46.149 INFO:teuthology.orchestra.run.smithi064.stdout:Running transaction 2024-03-26T16:44:46.638 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-03-26T16:44:46.665 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-2382.gbf950 12/12 2024-03-26T16:44:46.875 INFO:teuthology.orchestra.run.smithi064.stdout: Preparing : 1/1 2024-03-26T16:44:46.954 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 1/12 2024-03-26T16:44:46.985 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 2/12 2024-03-26T16:44:47.082 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 3/12 2024-03-26T16:44:47.122 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 4/12 2024-03-26T16:44:47.307 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : openblas-0.3.21-2.el9.x86_64 5/12 2024-03-26T16:44:47.337 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2024-03-26T16:44:47.434 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-03-26T16:44:48.115 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-03-26T16:44:48.228 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-03-26T16:44:49.187 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-2382.gbf950 12/12 2024-03-26T16:44:49.187 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-2382.gbf950 1/12 2024-03-26T16:44:49.187 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 2/12 2024-03-26T16:44:49.187 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 3/12 2024-03-26T16:44:49.188 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 4/12 2024-03-26T16:44:49.188 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 5/12 2024-03-26T16:44:49.188 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2024-03-26T16:44:49.188 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 7/12 2024-03-26T16:44:49.188 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 8/12 2024-03-26T16:44:49.188 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 9/12 2024-03-26T16:44:49.188 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 10/12 2024-03-26T16:44:49.188 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 11/12 2024-03-26T16:44:49.539 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-03-26T16:44:49.617 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 12/12 2024-03-26T16:44:49.618 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-26T16:44:49.618 INFO:teuthology.orchestra.run.smithi044.stdout:Installed: 2024-03-26T16:44:49.618 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mgr-diskprediction-local-2:19.0.0-2382.gbf9505fb.el9.noarch 2024-03-26T16:44:49.618 INFO:teuthology.orchestra.run.smithi044.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-03-26T16:44:49.618 INFO:teuthology.orchestra.run.smithi044.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-03-26T16:44:49.618 INFO:teuthology.orchestra.run.smithi044.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-03-26T16:44:49.618 INFO:teuthology.orchestra.run.smithi044.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-03-26T16:44:49.618 INFO:teuthology.orchestra.run.smithi044.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-03-26T16:44:49.618 INFO:teuthology.orchestra.run.smithi044.stdout: openblas-0.3.21-2.el9.x86_64 2024-03-26T16:44:49.618 INFO:teuthology.orchestra.run.smithi044.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-03-26T16:44:49.618 INFO:teuthology.orchestra.run.smithi044.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-03-26T16:44:49.619 INFO:teuthology.orchestra.run.smithi044.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-03-26T16:44:49.619 INFO:teuthology.orchestra.run.smithi044.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-03-26T16:44:49.619 INFO:teuthology.orchestra.run.smithi044.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-03-26T16:44:49.619 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-26T16:44:49.619 INFO:teuthology.orchestra.run.smithi044.stdout:Complete! 2024-03-26T16:44:49.995 DEBUG:teuthology.orchestra.run.smithi044:> sudo yum -y install ceph-mgr-rook 2024-03-26T16:44:50.567 INFO:teuthology.orchestra.run.smithi044.stdout:Last metadata expiration check: 0:01:20 ago on Tue 26 Mar 2024 04:43:30 PM UTC. 2024-03-26T16:44:50.616 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-03-26T16:44:50.636 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-2382.gbf950 12/12 2024-03-26T16:44:50.722 INFO:teuthology.orchestra.run.smithi044.stdout:Dependencies resolved. 2024-03-26T16:44:50.723 INFO:teuthology.orchestra.run.smithi044.stdout:======================================================================================== 2024-03-26T16:44:50.724 INFO:teuthology.orchestra.run.smithi044.stdout: Package Arch Version Repository Size 2024-03-26T16:44:50.724 INFO:teuthology.orchestra.run.smithi044.stdout:======================================================================================== 2024-03-26T16:44:50.724 INFO:teuthology.orchestra.run.smithi044.stdout:Installing: 2024-03-26T16:44:50.724 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mgr-rook noarch 2:19.0.0-2382.gbf9505fb.el9 ceph-noarch 49 k 2024-03-26T16:44:50.724 INFO:teuthology.orchestra.run.smithi044.stdout:Installing dependencies: 2024-03-26T16:44:50.724 INFO:teuthology.orchestra.run.smithi044.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-03-26T16:44:50.724 INFO:teuthology.orchestra.run.smithi044.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-03-26T16:44:50.724 INFO:teuthology.orchestra.run.smithi044.stdout: python3-google-auth noarch 1:2.28.2-1.el9 epel 203 k 2024-03-26T16:44:50.724 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2024-03-26T16:44:50.724 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2024-03-26T16:44:50.724 INFO:teuthology.orchestra.run.smithi044.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-03-26T16:44:50.724 INFO:teuthology.orchestra.run.smithi044.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2024-03-26T16:44:50.725 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2024-03-26T16:44:50.725 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2024-03-26T16:44:50.725 INFO:teuthology.orchestra.run.smithi044.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2024-03-26T16:44:50.725 INFO:teuthology.orchestra.run.smithi044.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-03-26T16:44:50.725 INFO:teuthology.orchestra.run.smithi044.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-03-26T16:44:50.725 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-26T16:44:50.725 INFO:teuthology.orchestra.run.smithi044.stdout:Transaction Summary 2024-03-26T16:44:50.725 INFO:teuthology.orchestra.run.smithi044.stdout:======================================================================================== 2024-03-26T16:44:50.725 INFO:teuthology.orchestra.run.smithi044.stdout:Install 13 Packages 2024-03-26T16:44:50.725 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-26T16:44:50.726 INFO:teuthology.orchestra.run.smithi044.stdout:Total download size: 2.0 M 2024-03-26T16:44:50.726 INFO:teuthology.orchestra.run.smithi044.stdout:Installed size: 26 M 2024-03-26T16:44:50.726 INFO:teuthology.orchestra.run.smithi044.stdout:Downloading Packages: 2024-03-26T16:44:50.991 INFO:teuthology.orchestra.run.smithi044.stdout:(1/13): python3-jsonpointer-2.0-4.el9.noarch.rp 151 kB/s | 18 kB 00:00 2024-03-26T16:44:51.008 INFO:teuthology.orchestra.run.smithi044.stdout:(2/13): python3-jsonpatch-1.21-16.el9.noarch.rp 179 kB/s | 24 kB 00:00 2024-03-26T16:44:51.058 INFO:teuthology.orchestra.run.smithi044.stdout:(3/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 2.6 MB/s | 174 kB 00:00 2024-03-26T16:44:51.083 INFO:teuthology.orchestra.run.smithi044.stdout:(4/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.7 MB/s | 132 kB 00:00 2024-03-26T16:44:51.117 INFO:teuthology.orchestra.run.smithi044.stdout:(5/13): python3-pyasn1-modules-0.4.8-6.el9.noar 3.5 MB/s | 211 kB 00:00 2024-03-26T16:44:51.134 INFO:teuthology.orchestra.run.smithi044.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 855 kB/s | 43 kB 00:00 2024-03-26T16:44:51.151 INFO:teuthology.orchestra.run.smithi044.stdout:(7/13): ceph-mgr-rook-19.0.0-2382.gbf9505fb.el9 176 kB/s | 49 kB 00:00 2024-03-26T16:44:51.393 INFO:teuthology.orchestra.run.smithi044.stdout:(8/13): python3-certifi-2021.10.8-2.el9.noarch. 58 kB/s | 15 kB 00:00 2024-03-26T16:44:51.410 INFO:teuthology.orchestra.run.smithi044.stdout:(9/13): python3-cachetools-4.2.4-1.el9.noarch.r 110 kB/s | 32 kB 00:00 2024-03-26T16:44:51.527 INFO:teuthology.orchestra.run.smithi044.stdout:(10/13): python3-rsa-4.9-2.el9.noarch.rpm 506 kB/s | 59 kB 00:00 2024-03-26T16:44:51.561 INFO:teuthology.orchestra.run.smithi044.stdout:(11/13): python3-google-auth-2.28.2-1.el9.noarc 495 kB/s | 203 kB 00:00 2024-03-26T16:44:51.627 INFO:teuthology.orchestra.run.smithi044.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 896 kB/s | 90 kB 00:00 2024-03-26T16:44:51.744 INFO:teuthology.orchestra.run.smithi044.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 2.9 MB/s | 1.0 MB 00:00 2024-03-26T16:44:51.748 INFO:teuthology.orchestra.run.smithi044.stdout:-------------------------------------------------------------------------------- 2024-03-26T16:44:51.748 INFO:teuthology.orchestra.run.smithi044.stdout:Total 2.0 MB/s | 2.0 MB 00:01 2024-03-26T16:44:51.749 INFO:teuthology.orchestra.run.smithi044.stdout:Running transaction check 2024-03-26T16:44:51.763 INFO:teuthology.orchestra.run.smithi044.stdout:Transaction check succeeded. 2024-03-26T16:44:51.763 INFO:teuthology.orchestra.run.smithi044.stdout:Running transaction test 2024-03-26T16:44:51.858 INFO:teuthology.orchestra.run.smithi044.stdout:Transaction test succeeded. 2024-03-26T16:44:51.858 INFO:teuthology.orchestra.run.smithi044.stdout:Running transaction 2024-03-26T16:44:52.381 INFO:teuthology.orchestra.run.smithi044.stdout: Preparing : 1/1 2024-03-26T16:44:52.564 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-03-26T16:44:52.622 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-03-26T16:44:52.678 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-03-26T16:44:52.714 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-03-26T16:44:52.755 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 5/13 2024-03-26T16:44:52.860 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-03-26T16:44:52.970 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-google-auth-1:2.28.2-1.el9.noarch 7/13 2024-03-26T16:44:53.003 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-2382.gbf950 12/12 2024-03-26T16:44:53.004 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-2382.gbf950 1/12 2024-03-26T16:44:53.004 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 2/12 2024-03-26T16:44:53.004 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 3/12 2024-03-26T16:44:53.004 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 4/12 2024-03-26T16:44:53.004 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 5/12 2024-03-26T16:44:53.004 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2024-03-26T16:44:53.004 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 7/12 2024-03-26T16:44:53.004 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 8/12 2024-03-26T16:44:53.004 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 9/12 2024-03-26T16:44:53.004 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 10/12 2024-03-26T16:44:53.004 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 11/12 2024-03-26T16:44:53.023 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-03-26T16:44:53.513 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 12/12 2024-03-26T16:44:53.513 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-03-26T16:44:53.513 INFO:teuthology.orchestra.run.smithi064.stdout:Installed: 2024-03-26T16:44:53.513 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-mgr-diskprediction-local-2:19.0.0-2382.gbf9505fb.el9.noarch 2024-03-26T16:44:53.513 INFO:teuthology.orchestra.run.smithi064.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-03-26T16:44:53.513 INFO:teuthology.orchestra.run.smithi064.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-03-26T16:44:53.513 INFO:teuthology.orchestra.run.smithi064.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-03-26T16:44:53.513 INFO:teuthology.orchestra.run.smithi064.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-03-26T16:44:53.514 INFO:teuthology.orchestra.run.smithi064.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-03-26T16:44:53.514 INFO:teuthology.orchestra.run.smithi064.stdout: openblas-0.3.21-2.el9.x86_64 2024-03-26T16:44:53.514 INFO:teuthology.orchestra.run.smithi064.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-03-26T16:44:53.514 INFO:teuthology.orchestra.run.smithi064.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-03-26T16:44:53.514 INFO:teuthology.orchestra.run.smithi064.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-03-26T16:44:53.514 INFO:teuthology.orchestra.run.smithi064.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-03-26T16:44:53.514 INFO:teuthology.orchestra.run.smithi064.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-03-26T16:44:53.514 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-03-26T16:44:53.514 INFO:teuthology.orchestra.run.smithi064.stdout:Complete! 2024-03-26T16:44:53.789 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-03-26T16:44:53.837 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-03-26T16:44:53.867 DEBUG:teuthology.orchestra.run.smithi064:> sudo yum -y install ceph-mgr-rook 2024-03-26T16:44:53.878 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-03-26T16:44:53.928 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-03-26T16:44:53.957 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-mgr-rook-2:19.0.0-2382.gbf9505fb.el9.noarch 13/13 2024-03-26T16:44:54.436 INFO:teuthology.orchestra.run.smithi064.stdout:Last metadata expiration check: 0:03:32 ago on Tue 26 Mar 2024 04:41:22 PM UTC. 2024-03-26T16:44:54.592 INFO:teuthology.orchestra.run.smithi064.stdout:Dependencies resolved. 2024-03-26T16:44:54.593 INFO:teuthology.orchestra.run.smithi064.stdout:======================================================================================== 2024-03-26T16:44:54.594 INFO:teuthology.orchestra.run.smithi064.stdout: Package Arch Version Repository Size 2024-03-26T16:44:54.594 INFO:teuthology.orchestra.run.smithi064.stdout:======================================================================================== 2024-03-26T16:44:54.594 INFO:teuthology.orchestra.run.smithi064.stdout:Installing: 2024-03-26T16:44:54.594 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-mgr-rook noarch 2:19.0.0-2382.gbf9505fb.el9 ceph-noarch 49 k 2024-03-26T16:44:54.594 INFO:teuthology.orchestra.run.smithi064.stdout:Installing dependencies: 2024-03-26T16:44:54.594 INFO:teuthology.orchestra.run.smithi064.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-03-26T16:44:54.594 INFO:teuthology.orchestra.run.smithi064.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-03-26T16:44:54.594 INFO:teuthology.orchestra.run.smithi064.stdout: python3-google-auth noarch 1:2.28.2-1.el9 epel 203 k 2024-03-26T16:44:54.594 INFO:teuthology.orchestra.run.smithi064.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2024-03-26T16:44:54.594 INFO:teuthology.orchestra.run.smithi064.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2024-03-26T16:44:54.594 INFO:teuthology.orchestra.run.smithi064.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-03-26T16:44:54.595 INFO:teuthology.orchestra.run.smithi064.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2024-03-26T16:44:54.595 INFO:teuthology.orchestra.run.smithi064.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2024-03-26T16:44:54.595 INFO:teuthology.orchestra.run.smithi064.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2024-03-26T16:44:54.595 INFO:teuthology.orchestra.run.smithi064.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2024-03-26T16:44:54.595 INFO:teuthology.orchestra.run.smithi064.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-03-26T16:44:54.595 INFO:teuthology.orchestra.run.smithi064.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-03-26T16:44:54.595 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-03-26T16:44:54.595 INFO:teuthology.orchestra.run.smithi064.stdout:Transaction Summary 2024-03-26T16:44:54.595 INFO:teuthology.orchestra.run.smithi064.stdout:======================================================================================== 2024-03-26T16:44:54.595 INFO:teuthology.orchestra.run.smithi064.stdout:Install 13 Packages 2024-03-26T16:44:54.595 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-03-26T16:44:54.596 INFO:teuthology.orchestra.run.smithi064.stdout:Total download size: 2.0 M 2024-03-26T16:44:54.596 INFO:teuthology.orchestra.run.smithi064.stdout:Installed size: 26 M 2024-03-26T16:44:54.596 INFO:teuthology.orchestra.run.smithi064.stdout:Downloading Packages: 2024-03-26T16:44:54.753 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-2382.gbf9505fb.el9.noarch 13/13 2024-03-26T16:44:54.753 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-mgr-rook-2:19.0.0-2382.gbf9505fb.el9.noarch 1/13 2024-03-26T16:44:54.753 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-03-26T16:44:54.753 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-03-26T16:44:54.753 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-03-26T16:44:54.754 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-03-26T16:44:54.754 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-03-26T16:44:54.754 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-03-26T16:44:54.754 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-03-26T16:44:54.754 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 9/13 2024-03-26T16:44:54.754 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-google-auth-1:2.28.2-1.el9.noarch 10/13 2024-03-26T16:44:54.754 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-03-26T16:44:54.754 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-03-26T16:44:54.761 INFO:teuthology.orchestra.run.smithi064.stdout:(1/13): python3-jsonpatch-1.21-16.el9.noarch.rp 203 kB/s | 24 kB 00:00 2024-03-26T16:44:54.786 INFO:teuthology.orchestra.run.smithi064.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 124 kB/s | 18 kB 00:00 2024-03-26T16:44:54.837 INFO:teuthology.orchestra.run.smithi064.stdout:(3/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 2.3 MB/s | 174 kB 00:00 2024-03-26T16:44:54.862 INFO:teuthology.orchestra.run.smithi064.stdout:(4/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.7 MB/s | 132 kB 00:00 2024-03-26T16:44:54.887 INFO:teuthology.orchestra.run.smithi064.stdout:(5/13): python3-pyasn1-modules-0.4.8-6.el9.noar 4.1 MB/s | 211 kB 00:00 2024-03-26T16:44:54.904 INFO:teuthology.orchestra.run.smithi064.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 1.0 MB/s | 43 kB 00:00 2024-03-26T16:44:54.921 INFO:teuthology.orchestra.run.smithi064.stdout:(7/13): ceph-mgr-rook-19.0.0-2382.gbf9505fb.el9 176 kB/s | 49 kB 00:00 2024-03-26T16:44:54.972 INFO:teuthology.orchestra.run.smithi064.stdout:(8/13): python3-certifi-2021.10.8-2.el9.noarch. 223 kB/s | 15 kB 00:00 2024-03-26T16:44:55.005 INFO:teuthology.orchestra.run.smithi064.stdout:(9/13): python3-cachetools-4.2.4-1.el9.noarch.r 275 kB/s | 32 kB 00:00 2024-03-26T16:44:55.030 INFO:teuthology.orchestra.run.smithi064.stdout:(10/13): python3-google-auth-2.28.2-1.el9.noarc 1.8 MB/s | 203 kB 00:00 2024-03-26T16:44:55.047 INFO:teuthology.orchestra.run.smithi064.stdout:(11/13): python3-rsa-4.9-2.el9.noarch.rpm 1.4 MB/s | 59 kB 00:00 2024-03-26T16:44:55.081 INFO:teuthology.orchestra.run.smithi064.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 1.7 MB/s | 90 kB 00:00 2024-03-26T16:44:55.114 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-03-26T16:44:55.115 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-26T16:44:55.115 INFO:teuthology.orchestra.run.smithi044.stdout:Installed: 2024-03-26T16:44:55.115 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mgr-rook-2:19.0.0-2382.gbf9505fb.el9.noarch 2024-03-26T16:44:55.115 INFO:teuthology.orchestra.run.smithi044.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-03-26T16:44:55.115 INFO:teuthology.orchestra.run.smithi044.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-03-26T16:44:55.115 INFO:teuthology.orchestra.run.smithi044.stdout: python3-google-auth-1:2.28.2-1.el9.noarch 2024-03-26T16:44:55.115 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-03-26T16:44:55.115 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-03-26T16:44:55.115 INFO:teuthology.orchestra.run.smithi044.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-03-26T16:44:55.115 INFO:teuthology.orchestra.run.smithi044.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-03-26T16:44:55.115 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-03-26T16:44:55.115 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-03-26T16:44:55.115 INFO:teuthology.orchestra.run.smithi044.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-03-26T16:44:55.115 INFO:teuthology.orchestra.run.smithi044.stdout: python3-rsa-4.9-2.el9.noarch 2024-03-26T16:44:55.116 INFO:teuthology.orchestra.run.smithi044.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-03-26T16:44:55.116 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-26T16:44:55.116 INFO:teuthology.orchestra.run.smithi044.stdout:Complete! 2024-03-26T16:44:55.214 INFO:teuthology.orchestra.run.smithi064.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 4.2 MB/s | 1.0 MB 00:00 2024-03-26T16:44:55.216 INFO:teuthology.orchestra.run.smithi064.stdout:-------------------------------------------------------------------------------- 2024-03-26T16:44:55.216 INFO:teuthology.orchestra.run.smithi064.stdout:Total 3.3 MB/s | 2.0 MB 00:00 2024-03-26T16:44:55.217 INFO:teuthology.orchestra.run.smithi064.stdout:Running transaction check 2024-03-26T16:44:55.233 INFO:teuthology.orchestra.run.smithi064.stdout:Transaction check succeeded. 2024-03-26T16:44:55.233 INFO:teuthology.orchestra.run.smithi064.stdout:Running transaction test 2024-03-26T16:44:55.330 INFO:teuthology.orchestra.run.smithi064.stdout:Transaction test succeeded. 2024-03-26T16:44:55.331 INFO:teuthology.orchestra.run.smithi064.stdout:Running transaction 2024-03-26T16:44:55.366 DEBUG:teuthology.orchestra.run.smithi044:> sudo yum -y install ceph-mgr-cephadm 2024-03-26T16:44:55.857 INFO:teuthology.orchestra.run.smithi064.stdout: Preparing : 1/1 2024-03-26T16:44:55.936 INFO:teuthology.orchestra.run.smithi044.stdout:Last metadata expiration check: 0:01:25 ago on Tue 26 Mar 2024 04:43:30 PM UTC. 2024-03-26T16:44:56.028 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-03-26T16:44:56.084 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-03-26T16:44:56.091 INFO:teuthology.orchestra.run.smithi044.stdout:Dependencies resolved. 2024-03-26T16:44:56.092 INFO:teuthology.orchestra.run.smithi044.stdout:======================================================================================== 2024-03-26T16:44:56.092 INFO:teuthology.orchestra.run.smithi044.stdout: Package Arch Version Repository Size 2024-03-26T16:44:56.092 INFO:teuthology.orchestra.run.smithi044.stdout:======================================================================================== 2024-03-26T16:44:56.092 INFO:teuthology.orchestra.run.smithi044.stdout:Installing: 2024-03-26T16:44:56.092 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mgr-cephadm noarch 2:19.0.0-2382.gbf9505fb.el9 ceph-noarch 140 k 2024-03-26T16:44:56.092 INFO:teuthology.orchestra.run.smithi044.stdout:Installing dependencies: 2024-03-26T16:44:56.092 INFO:teuthology.orchestra.run.smithi044.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-03-26T16:44:56.093 INFO:teuthology.orchestra.run.smithi044.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2024-03-26T16:44:56.093 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-03-26T16:44:56.093 INFO:teuthology.orchestra.run.smithi044.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-03-26T16:44:56.093 INFO:teuthology.orchestra.run.smithi044.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-03-26T16:44:56.093 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-26T16:44:56.093 INFO:teuthology.orchestra.run.smithi044.stdout:Transaction Summary 2024-03-26T16:44:56.093 INFO:teuthology.orchestra.run.smithi044.stdout:======================================================================================== 2024-03-26T16:44:56.093 INFO:teuthology.orchestra.run.smithi044.stdout:Install 6 Packages 2024-03-26T16:44:56.093 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-26T16:44:56.094 INFO:teuthology.orchestra.run.smithi044.stdout:Total download size: 6.8 M 2024-03-26T16:44:56.094 INFO:teuthology.orchestra.run.smithi044.stdout:Installed size: 33 M 2024-03-26T16:44:56.094 INFO:teuthology.orchestra.run.smithi044.stdout:Downloading Packages: 2024-03-26T16:44:56.139 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-03-26T16:44:56.175 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-03-26T16:44:56.217 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 5/13 2024-03-26T16:44:56.315 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-03-26T16:44:56.424 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-google-auth-1:2.28.2-1.el9.noarch 7/13 2024-03-26T16:44:56.478 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-03-26T16:44:56.855 INFO:teuthology.orchestra.run.smithi044.stdout:(1/6): python3-jinja2-2.11.3-5.el9.noarch.rpm 1.8 MB/s | 248 kB 00:00 2024-03-26T16:44:57.005 INFO:teuthology.orchestra.run.smithi044.stdout:(2/6): python3-babel-2.9.1-2.el9.noarch.rpm 20 MB/s | 5.8 MB 00:00 2024-03-26T16:44:57.072 INFO:teuthology.orchestra.run.smithi044.stdout:(3/6): ceph-mgr-cephadm-19.0.0-2382.gbf9505fb.e 396 kB/s | 140 kB 00:00 2024-03-26T16:44:57.155 INFO:teuthology.orchestra.run.smithi044.stdout:(4/6): python3-typing-extensions-4.4.0-2.el9.no 610 kB/s | 51 kB 00:00 2024-03-26T16:44:57.246 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-03-26T16:44:57.263 INFO:teuthology.orchestra.run.smithi044.stdout:(5/6): python3-natsort-7.1.1-5.el9.noarch.rpm 223 kB/s | 58 kB 00:00 2024-03-26T16:44:57.299 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-03-26T16:44:57.332 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-03-26T16:44:57.381 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-03-26T16:44:57.410 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : ceph-mgr-rook-2:19.0.0-2382.gbf9505fb.el9.noarch 13/13 2024-03-26T16:44:57.639 INFO:teuthology.orchestra.run.smithi044.stdout:(6/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 700 kB/s | 548 kB 00:00 2024-03-26T16:44:57.640 INFO:teuthology.orchestra.run.smithi044.stdout:-------------------------------------------------------------------------------- 2024-03-26T16:44:57.640 INFO:teuthology.orchestra.run.smithi044.stdout:Total 4.4 MB/s | 6.8 MB 00:01 2024-03-26T16:44:57.654 INFO:teuthology.orchestra.run.smithi044.stdout:Running transaction check 2024-03-26T16:44:57.666 INFO:teuthology.orchestra.run.smithi044.stdout:Transaction check succeeded. 2024-03-26T16:44:57.666 INFO:teuthology.orchestra.run.smithi044.stdout:Running transaction test 2024-03-26T16:44:57.762 INFO:teuthology.orchestra.run.smithi044.stdout:Transaction test succeeded. 2024-03-26T16:44:57.762 INFO:teuthology.orchestra.run.smithi044.stdout:Running transaction 2024-03-26T16:44:58.075 INFO:teuthology.orchestra.run.smithi044.stdout: Preparing : 1/1 2024-03-26T16:44:58.175 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-2382.gbf9505fb.el9.noarch 13/13 2024-03-26T16:44:58.175 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : ceph-mgr-rook-2:19.0.0-2382.gbf9505fb.el9.noarch 1/13 2024-03-26T16:44:58.175 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-03-26T16:44:58.175 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-03-26T16:44:58.175 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-03-26T16:44:58.175 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-03-26T16:44:58.175 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-03-26T16:44:58.175 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-03-26T16:44:58.176 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-03-26T16:44:58.176 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 9/13 2024-03-26T16:44:58.176 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-google-auth-1:2.28.2-1.el9.noarch 10/13 2024-03-26T16:44:58.176 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-03-26T16:44:58.176 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-03-26T16:44:58.251 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 1/6 2024-03-26T16:44:58.308 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-03-26T16:44:58.550 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-03-26T16:44:58.550 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-03-26T16:44:58.550 INFO:teuthology.orchestra.run.smithi064.stdout:Installed: 2024-03-26T16:44:58.550 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-mgr-rook-2:19.0.0-2382.gbf9505fb.el9.noarch 2024-03-26T16:44:58.551 INFO:teuthology.orchestra.run.smithi064.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-03-26T16:44:58.551 INFO:teuthology.orchestra.run.smithi064.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-03-26T16:44:58.551 INFO:teuthology.orchestra.run.smithi064.stdout: python3-google-auth-1:2.28.2-1.el9.noarch 2024-03-26T16:44:58.551 INFO:teuthology.orchestra.run.smithi064.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-03-26T16:44:58.551 INFO:teuthology.orchestra.run.smithi064.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-03-26T16:44:58.551 INFO:teuthology.orchestra.run.smithi064.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-03-26T16:44:58.551 INFO:teuthology.orchestra.run.smithi064.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-03-26T16:44:58.551 INFO:teuthology.orchestra.run.smithi064.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-03-26T16:44:58.551 INFO:teuthology.orchestra.run.smithi064.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-03-26T16:44:58.551 INFO:teuthology.orchestra.run.smithi064.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-03-26T16:44:58.551 INFO:teuthology.orchestra.run.smithi064.stdout: python3-rsa-4.9-2.el9.noarch 2024-03-26T16:44:58.551 INFO:teuthology.orchestra.run.smithi064.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-03-26T16:44:58.551 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-03-26T16:44:58.551 INFO:teuthology.orchestra.run.smithi064.stdout:Complete! 2024-03-26T16:44:58.796 DEBUG:teuthology.orchestra.run.smithi064:> sudo yum -y install ceph-mgr-cephadm 2024-03-26T16:44:58.863 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-03-26T16:44:58.964 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-03-26T16:44:59.032 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 5/6 2024-03-26T16:44:59.070 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-2382.gbf9505fb.el9.noarch 6/6 2024-03-26T16:44:59.368 INFO:teuthology.orchestra.run.smithi064.stdout:Last metadata expiration check: 0:03:37 ago on Tue 26 Mar 2024 04:41:22 PM UTC. 2024-03-26T16:44:59.524 INFO:teuthology.orchestra.run.smithi064.stdout:Dependencies resolved. 2024-03-26T16:44:59.524 INFO:teuthology.orchestra.run.smithi064.stdout:======================================================================================== 2024-03-26T16:44:59.525 INFO:teuthology.orchestra.run.smithi064.stdout: Package Arch Version Repository Size 2024-03-26T16:44:59.525 INFO:teuthology.orchestra.run.smithi064.stdout:======================================================================================== 2024-03-26T16:44:59.525 INFO:teuthology.orchestra.run.smithi064.stdout:Installing: 2024-03-26T16:44:59.525 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-mgr-cephadm noarch 2:19.0.0-2382.gbf9505fb.el9 ceph-noarch 140 k 2024-03-26T16:44:59.525 INFO:teuthology.orchestra.run.smithi064.stdout:Installing dependencies: 2024-03-26T16:44:59.525 INFO:teuthology.orchestra.run.smithi064.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-03-26T16:44:59.525 INFO:teuthology.orchestra.run.smithi064.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2024-03-26T16:44:59.525 INFO:teuthology.orchestra.run.smithi064.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-03-26T16:44:59.525 INFO:teuthology.orchestra.run.smithi064.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-03-26T16:44:59.525 INFO:teuthology.orchestra.run.smithi064.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-03-26T16:44:59.525 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-03-26T16:44:59.525 INFO:teuthology.orchestra.run.smithi064.stdout:Transaction Summary 2024-03-26T16:44:59.525 INFO:teuthology.orchestra.run.smithi064.stdout:======================================================================================== 2024-03-26T16:44:59.525 INFO:teuthology.orchestra.run.smithi064.stdout:Install 6 Packages 2024-03-26T16:44:59.526 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-03-26T16:44:59.526 INFO:teuthology.orchestra.run.smithi064.stdout:Total download size: 6.8 M 2024-03-26T16:44:59.526 INFO:teuthology.orchestra.run.smithi064.stdout:Installed size: 33 M 2024-03-26T16:44:59.526 INFO:teuthology.orchestra.run.smithi064.stdout:Downloading Packages: 2024-03-26T16:44:59.849 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-2382.gbf9505fb.el9.noarch 6/6 2024-03-26T16:44:59.849 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-2382.gbf9505fb.el9.noarch 1/6 2024-03-26T16:44:59.849 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-03-26T16:44:59.849 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 3/6 2024-03-26T16:44:59.849 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-03-26T16:44:59.849 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-03-26T16:45:00.162 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 6/6 2024-03-26T16:45:00.163 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-26T16:45:00.163 INFO:teuthology.orchestra.run.smithi044.stdout:Installed: 2024-03-26T16:45:00.163 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mgr-cephadm-2:19.0.0-2382.gbf9505fb.el9.noarch 2024-03-26T16:45:00.163 INFO:teuthology.orchestra.run.smithi044.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-03-26T16:45:00.163 INFO:teuthology.orchestra.run.smithi044.stdout: python3-babel-2.9.1-2.el9.noarch 2024-03-26T16:45:00.163 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-03-26T16:45:00.163 INFO:teuthology.orchestra.run.smithi044.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-03-26T16:45:00.163 INFO:teuthology.orchestra.run.smithi044.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-03-26T16:45:00.163 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-26T16:45:00.163 INFO:teuthology.orchestra.run.smithi044.stdout:Complete! 2024-03-26T16:45:00.276 INFO:teuthology.orchestra.run.smithi064.stdout:(1/6): python3-babel-2.9.1-2.el9.noarch.rpm 21 MB/s | 5.8 MB 00:00 2024-03-26T16:45:00.384 INFO:teuthology.orchestra.run.smithi064.stdout:(2/6): ceph-mgr-cephadm-19.0.0-2382.gbf9505fb.e 361 kB/s | 140 kB 00:00 2024-03-26T16:45:00.393 DEBUG:teuthology.orchestra.run.smithi044:> sudo yum -y install ceph-fuse 2024-03-26T16:45:00.460 INFO:teuthology.orchestra.run.smithi064.stdout:(3/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 2.9 MB/s | 548 kB 00:00 2024-03-26T16:45:00.485 INFO:teuthology.orchestra.run.smithi064.stdout:(4/6): python3-natsort-7.1.1-5.el9.noarch.rpm 576 kB/s | 58 kB 00:00 2024-03-26T16:45:00.510 INFO:teuthology.orchestra.run.smithi064.stdout:(5/6): python3-typing-extensions-4.4.0-2.el9.no 1.0 MB/s | 51 kB 00:00 2024-03-26T16:45:00.569 INFO:teuthology.orchestra.run.smithi064.stdout:(6/6): python3-jinja2-2.11.3-5.el9.noarch.rpm 433 kB/s | 248 kB 00:00 2024-03-26T16:45:00.570 INFO:teuthology.orchestra.run.smithi064.stdout:-------------------------------------------------------------------------------- 2024-03-26T16:45:00.570 INFO:teuthology.orchestra.run.smithi064.stdout:Total 6.5 MB/s | 6.8 MB 00:01 2024-03-26T16:45:00.583 INFO:teuthology.orchestra.run.smithi064.stdout:Running transaction check 2024-03-26T16:45:00.593 INFO:teuthology.orchestra.run.smithi064.stdout:Transaction check succeeded. 2024-03-26T16:45:00.593 INFO:teuthology.orchestra.run.smithi064.stdout:Running transaction test 2024-03-26T16:45:00.686 INFO:teuthology.orchestra.run.smithi064.stdout:Transaction test succeeded. 2024-03-26T16:45:00.686 INFO:teuthology.orchestra.run.smithi064.stdout:Running transaction 2024-03-26T16:45:00.961 INFO:teuthology.orchestra.run.smithi044.stdout:Last metadata expiration check: 0:01:30 ago on Tue 26 Mar 2024 04:43:30 PM UTC. 2024-03-26T16:45:00.994 INFO:teuthology.orchestra.run.smithi064.stdout: Preparing : 1/1 2024-03-26T16:45:01.118 INFO:teuthology.orchestra.run.smithi044.stdout:Dependencies resolved. 2024-03-26T16:45:01.119 INFO:teuthology.orchestra.run.smithi044.stdout:================================================================================ 2024-03-26T16:45:01.119 INFO:teuthology.orchestra.run.smithi044.stdout: Package Arch Version Repository Size 2024-03-26T16:45:01.119 INFO:teuthology.orchestra.run.smithi044.stdout:================================================================================ 2024-03-26T16:45:01.119 INFO:teuthology.orchestra.run.smithi044.stdout:Installing: 2024-03-26T16:45:01.119 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-fuse x86_64 2:19.0.0-2382.gbf9505fb.el9 ceph 891 k 2024-03-26T16:45:01.119 INFO:teuthology.orchestra.run.smithi044.stdout:Installing dependencies: 2024-03-26T16:45:01.119 INFO:teuthology.orchestra.run.smithi044.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2024-03-26T16:45:01.119 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-26T16:45:01.119 INFO:teuthology.orchestra.run.smithi044.stdout:Transaction Summary 2024-03-26T16:45:01.119 INFO:teuthology.orchestra.run.smithi044.stdout:================================================================================ 2024-03-26T16:45:01.119 INFO:teuthology.orchestra.run.smithi044.stdout:Install 2 Packages 2024-03-26T16:45:01.119 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-26T16:45:01.120 INFO:teuthology.orchestra.run.smithi044.stdout:Total download size: 969 k 2024-03-26T16:45:01.120 INFO:teuthology.orchestra.run.smithi044.stdout:Installed size: 2.8 M 2024-03-26T16:45:01.120 INFO:teuthology.orchestra.run.smithi044.stdout:Downloading Packages: 2024-03-26T16:45:01.182 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 1/6 2024-03-26T16:45:01.239 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-03-26T16:45:01.307 INFO:teuthology.orchestra.run.smithi044.stdout:(1/2): fuse-2.9.9-15.el9.x86_64.rpm 422 kB/s | 79 kB 00:00 2024-03-26T16:45:01.798 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-03-26T16:45:01.885 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-03-26T16:45:01.932 INFO:teuthology.orchestra.run.smithi044.stdout:(2/2): ceph-fuse-19.0.0-2382.gbf9505fb.el9.x86_ 1.1 MB/s | 891 kB 00:00 2024-03-26T16:45:01.933 INFO:teuthology.orchestra.run.smithi044.stdout:-------------------------------------------------------------------------------- 2024-03-26T16:45:01.934 INFO:teuthology.orchestra.run.smithi044.stdout:Total 1.2 MB/s | 969 kB 00:00 2024-03-26T16:45:01.934 INFO:teuthology.orchestra.run.smithi044.stdout:Running transaction check 2024-03-26T16:45:01.954 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 5/6 2024-03-26T16:45:01.956 INFO:teuthology.orchestra.run.smithi044.stdout:Transaction check succeeded. 2024-03-26T16:45:01.956 INFO:teuthology.orchestra.run.smithi044.stdout:Running transaction test 2024-03-26T16:45:01.991 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-2382.gbf9505fb.el9.noarch 6/6 2024-03-26T16:45:02.033 INFO:teuthology.orchestra.run.smithi044.stdout:Transaction test succeeded. 2024-03-26T16:45:02.033 INFO:teuthology.orchestra.run.smithi044.stdout:Running transaction 2024-03-26T16:45:02.233 INFO:teuthology.orchestra.run.smithi044.stdout: Preparing : 1/1 2024-03-26T16:45:02.362 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : fuse-2.9.9-15.el9.x86_64 1/2 2024-03-26T16:45:02.434 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-fuse-2:19.0.0-2382.gbf9505fb.el9.x86_64 2/2 2024-03-26T16:45:02.755 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-2382.gbf9505fb.el9.noarch 6/6 2024-03-26T16:45:02.756 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-2382.gbf9505fb.el9.noarch 1/6 2024-03-26T16:45:02.756 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-03-26T16:45:02.756 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 3/6 2024-03-26T16:45:02.756 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-03-26T16:45:02.756 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-03-26T16:45:03.058 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 6/6 2024-03-26T16:45:03.058 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-03-26T16:45:03.058 INFO:teuthology.orchestra.run.smithi064.stdout:Installed: 2024-03-26T16:45:03.058 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-mgr-cephadm-2:19.0.0-2382.gbf9505fb.el9.noarch 2024-03-26T16:45:03.058 INFO:teuthology.orchestra.run.smithi064.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-03-26T16:45:03.058 INFO:teuthology.orchestra.run.smithi064.stdout: python3-babel-2.9.1-2.el9.noarch 2024-03-26T16:45:03.058 INFO:teuthology.orchestra.run.smithi064.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-03-26T16:45:03.058 INFO:teuthology.orchestra.run.smithi064.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-03-26T16:45:03.058 INFO:teuthology.orchestra.run.smithi064.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-03-26T16:45:03.059 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-03-26T16:45:03.059 INFO:teuthology.orchestra.run.smithi064.stdout:Complete! 2024-03-26T16:45:03.096 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-fuse-2:19.0.0-2382.gbf9505fb.el9.x86_64 2/2 2024-03-26T16:45:03.096 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-fuse-2:19.0.0-2382.gbf9505fb.el9.x86_64 1/2 2024-03-26T16:45:03.300 DEBUG:teuthology.orchestra.run.smithi064:> sudo yum -y install ceph-fuse 2024-03-26T16:45:03.411 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 2/2 2024-03-26T16:45:03.411 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-26T16:45:03.411 INFO:teuthology.orchestra.run.smithi044.stdout:Installed: 2024-03-26T16:45:03.411 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-fuse-2:19.0.0-2382.gbf9505fb.el9.x86_64 fuse-2.9.9-15.el9.x86_64 2024-03-26T16:45:03.411 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-26T16:45:03.412 INFO:teuthology.orchestra.run.smithi044.stdout:Complete! 2024-03-26T16:45:03.662 DEBUG:teuthology.orchestra.run.smithi044:> sudo yum -y install ceph-volume 2024-03-26T16:45:03.869 INFO:teuthology.orchestra.run.smithi064.stdout:Last metadata expiration check: 0:03:41 ago on Tue 26 Mar 2024 04:41:22 PM UTC. 2024-03-26T16:45:04.025 INFO:teuthology.orchestra.run.smithi064.stdout:Dependencies resolved. 2024-03-26T16:45:04.025 INFO:teuthology.orchestra.run.smithi064.stdout:================================================================================ 2024-03-26T16:45:04.025 INFO:teuthology.orchestra.run.smithi064.stdout: Package Arch Version Repository Size 2024-03-26T16:45:04.025 INFO:teuthology.orchestra.run.smithi064.stdout:================================================================================ 2024-03-26T16:45:04.026 INFO:teuthology.orchestra.run.smithi064.stdout:Installing: 2024-03-26T16:45:04.026 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-fuse x86_64 2:19.0.0-2382.gbf9505fb.el9 ceph 891 k 2024-03-26T16:45:04.026 INFO:teuthology.orchestra.run.smithi064.stdout:Installing dependencies: 2024-03-26T16:45:04.026 INFO:teuthology.orchestra.run.smithi064.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2024-03-26T16:45:04.026 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-03-26T16:45:04.026 INFO:teuthology.orchestra.run.smithi064.stdout:Transaction Summary 2024-03-26T16:45:04.026 INFO:teuthology.orchestra.run.smithi064.stdout:================================================================================ 2024-03-26T16:45:04.026 INFO:teuthology.orchestra.run.smithi064.stdout:Install 2 Packages 2024-03-26T16:45:04.026 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-03-26T16:45:04.027 INFO:teuthology.orchestra.run.smithi064.stdout:Total download size: 969 k 2024-03-26T16:45:04.027 INFO:teuthology.orchestra.run.smithi064.stdout:Installed size: 2.8 M 2024-03-26T16:45:04.027 INFO:teuthology.orchestra.run.smithi064.stdout:Downloading Packages: 2024-03-26T16:45:04.154 INFO:teuthology.orchestra.run.smithi064.stdout:(1/2): fuse-2.9.9-15.el9.x86_64.rpm 620 kB/s | 79 kB 00:00 2024-03-26T16:45:04.237 INFO:teuthology.orchestra.run.smithi044.stdout:Last metadata expiration check: 0:01:34 ago on Tue 26 Mar 2024 04:43:30 PM UTC. 2024-03-26T16:45:04.392 INFO:teuthology.orchestra.run.smithi044.stdout:Dependencies resolved. 2024-03-26T16:45:04.392 INFO:teuthology.orchestra.run.smithi044.stdout:================================================================================ 2024-03-26T16:45:04.392 INFO:teuthology.orchestra.run.smithi044.stdout: Package Arch Version Repository Size 2024-03-26T16:45:04.392 INFO:teuthology.orchestra.run.smithi044.stdout:================================================================================ 2024-03-26T16:45:04.393 INFO:teuthology.orchestra.run.smithi044.stdout:Installing: 2024-03-26T16:45:04.393 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-volume noarch 2:19.0.0-2382.gbf9505fb.el9 ceph-noarch 264 k 2024-03-26T16:45:04.393 INFO:teuthology.orchestra.run.smithi044.stdout:Installing dependencies: 2024-03-26T16:45:04.393 INFO:teuthology.orchestra.run.smithi044.stdout: python3-packaging noarch 20.9-5.el9 CentOS-AppStream 69 k 2024-03-26T16:45:04.393 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-26T16:45:04.393 INFO:teuthology.orchestra.run.smithi044.stdout:Transaction Summary 2024-03-26T16:45:04.393 INFO:teuthology.orchestra.run.smithi044.stdout:================================================================================ 2024-03-26T16:45:04.393 INFO:teuthology.orchestra.run.smithi044.stdout:Install 2 Packages 2024-03-26T16:45:04.393 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-26T16:45:04.394 INFO:teuthology.orchestra.run.smithi044.stdout:Total download size: 332 k 2024-03-26T16:45:04.394 INFO:teuthology.orchestra.run.smithi044.stdout:Installed size: 1.5 M 2024-03-26T16:45:04.394 INFO:teuthology.orchestra.run.smithi044.stdout:Downloading Packages: 2024-03-26T16:45:04.429 INFO:teuthology.orchestra.run.smithi064.stdout:(2/2): ceph-fuse-19.0.0-2382.gbf9505fb.el9.x86_ 2.2 MB/s | 891 kB 00:00 2024-03-26T16:45:04.431 INFO:teuthology.orchestra.run.smithi064.stdout:-------------------------------------------------------------------------------- 2024-03-26T16:45:04.431 INFO:teuthology.orchestra.run.smithi064.stdout:Total 2.3 MB/s | 969 kB 00:00 2024-03-26T16:45:04.431 INFO:teuthology.orchestra.run.smithi064.stdout:Running transaction check 2024-03-26T16:45:04.452 INFO:teuthology.orchestra.run.smithi064.stdout:Transaction check succeeded. 2024-03-26T16:45:04.453 INFO:teuthology.orchestra.run.smithi064.stdout:Running transaction test 2024-03-26T16:45:04.522 INFO:teuthology.orchestra.run.smithi044.stdout:(1/2): python3-packaging-20.9-5.el9.noarch.rpm 538 kB/s | 69 kB 00:00 2024-03-26T16:45:04.527 INFO:teuthology.orchestra.run.smithi064.stdout:Transaction test succeeded. 2024-03-26T16:45:04.528 INFO:teuthology.orchestra.run.smithi064.stdout:Running transaction 2024-03-26T16:45:04.672 INFO:teuthology.orchestra.run.smithi044.stdout:(2/2): ceph-volume-19.0.0-2382.gbf9505fb.el9.no 949 kB/s | 264 kB 00:00 2024-03-26T16:45:04.673 INFO:teuthology.orchestra.run.smithi044.stdout:-------------------------------------------------------------------------------- 2024-03-26T16:45:04.673 INFO:teuthology.orchestra.run.smithi044.stdout:Total 1.2 MB/s | 332 kB 00:00 2024-03-26T16:45:04.674 INFO:teuthology.orchestra.run.smithi044.stdout:Running transaction check 2024-03-26T16:45:04.683 INFO:teuthology.orchestra.run.smithi044.stdout:Transaction check succeeded. 2024-03-26T16:45:04.684 INFO:teuthology.orchestra.run.smithi044.stdout:Running transaction test 2024-03-26T16:45:04.724 INFO:teuthology.orchestra.run.smithi064.stdout: Preparing : 1/1 2024-03-26T16:45:04.725 INFO:teuthology.orchestra.run.smithi044.stdout:Transaction test succeeded. 2024-03-26T16:45:04.726 INFO:teuthology.orchestra.run.smithi044.stdout:Running transaction 2024-03-26T16:45:04.878 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : fuse-2.9.9-15.el9.x86_64 1/2 2024-03-26T16:45:04.882 INFO:teuthology.orchestra.run.smithi044.stdout: Preparing : 1/1 2024-03-26T16:45:04.956 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : ceph-fuse-2:19.0.0-2382.gbf9505fb.el9.x86_64 2/2 2024-03-26T16:45:05.069 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-packaging-20.9-5.el9.noarch 1/2 2024-03-26T16:45:05.108 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-volume-2:19.0.0-2382.gbf9505fb.el9.noarch 2/2 2024-03-26T16:45:05.124 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-volume-2:19.0.0-2382.gbf9505fb.el9.noarch 2/2 2024-03-26T16:45:05.124 INFO:teuthology.orchestra.run.smithi044.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-26T16:45:05.124 INFO:teuthology.orchestra.run.smithi044.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-03-26T16:45:05.124 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-26T16:45:05.672 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: ceph-fuse-2:19.0.0-2382.gbf9505fb.el9.x86_64 2/2 2024-03-26T16:45:05.672 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : ceph-fuse-2:19.0.0-2382.gbf9505fb.el9.x86_64 1/2 2024-03-26T16:45:05.837 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-volume-2:19.0.0-2382.gbf9505fb.el9.noarch 1/2 2024-03-26T16:45:05.964 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 2/2 2024-03-26T16:45:05.964 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-03-26T16:45:05.964 INFO:teuthology.orchestra.run.smithi064.stdout:Installed: 2024-03-26T16:45:05.964 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-fuse-2:19.0.0-2382.gbf9505fb.el9.x86_64 fuse-2.9.9-15.el9.x86_64 2024-03-26T16:45:05.964 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-03-26T16:45:05.964 INFO:teuthology.orchestra.run.smithi064.stdout:Complete! 2024-03-26T16:45:06.161 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 2/2 2024-03-26T16:45:06.162 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-26T16:45:06.162 INFO:teuthology.orchestra.run.smithi044.stdout:Installed: 2024-03-26T16:45:06.162 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-volume-2:19.0.0-2382.gbf9505fb.el9.noarch 2024-03-26T16:45:06.162 INFO:teuthology.orchestra.run.smithi044.stdout: python3-packaging-20.9-5.el9.noarch 2024-03-26T16:45:06.162 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-26T16:45:06.162 INFO:teuthology.orchestra.run.smithi044.stdout:Complete! 2024-03-26T16:45:06.242 DEBUG:teuthology.orchestra.run.smithi064:> sudo yum -y install ceph-volume 2024-03-26T16:45:06.471 DEBUG:teuthology.orchestra.run.smithi044:> sudo yum -y install librados-devel 2024-03-26T16:45:06.814 INFO:teuthology.orchestra.run.smithi064.stdout:Last metadata expiration check: 0:03:44 ago on Tue 26 Mar 2024 04:41:22 PM UTC. 2024-03-26T16:45:06.969 INFO:teuthology.orchestra.run.smithi064.stdout:Dependencies resolved. 2024-03-26T16:45:06.970 INFO:teuthology.orchestra.run.smithi064.stdout:================================================================================ 2024-03-26T16:45:06.970 INFO:teuthology.orchestra.run.smithi064.stdout: Package Arch Version Repository Size 2024-03-26T16:45:06.970 INFO:teuthology.orchestra.run.smithi064.stdout:================================================================================ 2024-03-26T16:45:06.970 INFO:teuthology.orchestra.run.smithi064.stdout:Installing: 2024-03-26T16:45:06.970 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-volume noarch 2:19.0.0-2382.gbf9505fb.el9 ceph-noarch 264 k 2024-03-26T16:45:06.970 INFO:teuthology.orchestra.run.smithi064.stdout:Installing dependencies: 2024-03-26T16:45:06.970 INFO:teuthology.orchestra.run.smithi064.stdout: python3-packaging noarch 20.9-5.el9 CentOS-AppStream 69 k 2024-03-26T16:45:06.970 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-03-26T16:45:06.970 INFO:teuthology.orchestra.run.smithi064.stdout:Transaction Summary 2024-03-26T16:45:06.970 INFO:teuthology.orchestra.run.smithi064.stdout:================================================================================ 2024-03-26T16:45:06.971 INFO:teuthology.orchestra.run.smithi064.stdout:Install 2 Packages 2024-03-26T16:45:06.971 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-03-26T16:45:06.971 INFO:teuthology.orchestra.run.smithi064.stdout:Total download size: 332 k 2024-03-26T16:45:06.971 INFO:teuthology.orchestra.run.smithi064.stdout:Installed size: 1.5 M 2024-03-26T16:45:06.971 INFO:teuthology.orchestra.run.smithi064.stdout:Downloading Packages: 2024-03-26T16:45:07.047 INFO:teuthology.orchestra.run.smithi044.stdout:Last metadata expiration check: 0:01:37 ago on Tue 26 Mar 2024 04:43:30 PM UTC. 2024-03-26T16:45:07.201 INFO:teuthology.orchestra.run.smithi064.stdout:(1/2): python3-packaging-20.9-5.el9.noarch.rpm 300 kB/s | 69 kB 00:00 2024-03-26T16:45:07.202 INFO:teuthology.orchestra.run.smithi044.stdout:Dependencies resolved. 2024-03-26T16:45:07.203 INFO:teuthology.orchestra.run.smithi044.stdout:================================================================================ 2024-03-26T16:45:07.203 INFO:teuthology.orchestra.run.smithi044.stdout: Package Arch Version Repo Size 2024-03-26T16:45:07.203 INFO:teuthology.orchestra.run.smithi044.stdout:================================================================================ 2024-03-26T16:45:07.203 INFO:teuthology.orchestra.run.smithi044.stdout:Installing: 2024-03-26T16:45:07.203 INFO:teuthology.orchestra.run.smithi044.stdout: librados-devel x86_64 2:19.0.0-2382.gbf9505fb.el9 ceph 127 k 2024-03-26T16:45:07.203 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-26T16:45:07.203 INFO:teuthology.orchestra.run.smithi044.stdout:Transaction Summary 2024-03-26T16:45:07.203 INFO:teuthology.orchestra.run.smithi044.stdout:================================================================================ 2024-03-26T16:45:07.203 INFO:teuthology.orchestra.run.smithi044.stdout:Install 1 Package 2024-03-26T16:45:07.203 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-26T16:45:07.203 INFO:teuthology.orchestra.run.smithi044.stdout:Total download size: 127 k 2024-03-26T16:45:07.204 INFO:teuthology.orchestra.run.smithi044.stdout:Installed size: 456 k 2024-03-26T16:45:07.204 INFO:teuthology.orchestra.run.smithi044.stdout:Downloading Packages: 2024-03-26T16:45:07.409 INFO:teuthology.orchestra.run.smithi064.stdout:(2/2): ceph-volume-19.0.0-2382.gbf9505fb.el9.no 602 kB/s | 264 kB 00:00 2024-03-26T16:45:07.410 INFO:teuthology.orchestra.run.smithi064.stdout:-------------------------------------------------------------------------------- 2024-03-26T16:45:07.411 INFO:teuthology.orchestra.run.smithi064.stdout:Total 755 kB/s | 332 kB 00:00 2024-03-26T16:45:07.411 INFO:teuthology.orchestra.run.smithi064.stdout:Running transaction check 2024-03-26T16:45:07.420 INFO:teuthology.orchestra.run.smithi064.stdout:Transaction check succeeded. 2024-03-26T16:45:07.421 INFO:teuthology.orchestra.run.smithi064.stdout:Running transaction test 2024-03-26T16:45:07.421 INFO:teuthology.orchestra.run.smithi044.stdout:librados-devel-19.0.0-2382.gbf9505fb.el9.x86_64 586 kB/s | 127 kB 00:00 2024-03-26T16:45:07.421 INFO:teuthology.orchestra.run.smithi044.stdout:-------------------------------------------------------------------------------- 2024-03-26T16:45:07.421 INFO:teuthology.orchestra.run.smithi044.stdout:Total 583 kB/s | 127 kB 00:00 2024-03-26T16:45:07.421 INFO:teuthology.orchestra.run.smithi044.stdout:Running transaction check 2024-03-26T16:45:07.426 INFO:teuthology.orchestra.run.smithi044.stdout:Transaction check succeeded. 2024-03-26T16:45:07.426 INFO:teuthology.orchestra.run.smithi044.stdout:Running transaction test 2024-03-26T16:45:07.460 INFO:teuthology.orchestra.run.smithi064.stdout:Transaction test succeeded. 2024-03-26T16:45:07.460 INFO:teuthology.orchestra.run.smithi064.stdout:Running transaction 2024-03-26T16:45:07.484 INFO:teuthology.orchestra.run.smithi044.stdout:Transaction test succeeded. 2024-03-26T16:45:07.485 INFO:teuthology.orchestra.run.smithi044.stdout:Running transaction 2024-03-26T16:45:07.615 INFO:teuthology.orchestra.run.smithi064.stdout: Preparing : 1/1 2024-03-26T16:45:07.637 INFO:teuthology.orchestra.run.smithi044.stdout: Preparing : 1/1 2024-03-26T16:45:07.738 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : librados-devel-2:19.0.0-2382.gbf9505fb.el9.x86_64 1/1 2024-03-26T16:45:07.806 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-packaging-20.9-5.el9.noarch 1/2 2024-03-26T16:45:07.870 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : ceph-volume-2:19.0.0-2382.gbf9505fb.el9.noarch 2/2 2024-03-26T16:45:07.885 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: ceph-volume-2:19.0.0-2382.gbf9505fb.el9.noarch 2/2 2024-03-26T16:45:07.886 INFO:teuthology.orchestra.run.smithi064.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-26T16:45:07.886 INFO:teuthology.orchestra.run.smithi064.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-03-26T16:45:07.886 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-03-26T16:45:08.179 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: librados-devel-2:19.0.0-2382.gbf9505fb.el9.x86_64 1/1 2024-03-26T16:45:08.486 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : librados-devel-2:19.0.0-2382.gbf9505fb.el9.x86_64 1/1 2024-03-26T16:45:08.486 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-26T16:45:08.486 INFO:teuthology.orchestra.run.smithi044.stdout:Installed: 2024-03-26T16:45:08.486 INFO:teuthology.orchestra.run.smithi044.stdout: librados-devel-2:19.0.0-2382.gbf9505fb.el9.x86_64 2024-03-26T16:45:08.486 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-26T16:45:08.486 INFO:teuthology.orchestra.run.smithi044.stdout:Complete! 2024-03-26T16:45:08.654 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : ceph-volume-2:19.0.0-2382.gbf9505fb.el9.noarch 1/2 2024-03-26T16:45:08.705 DEBUG:teuthology.orchestra.run.smithi044:> sudo yum -y install libcephfs2 2024-03-26T16:45:08.971 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 2/2 2024-03-26T16:45:08.971 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-03-26T16:45:08.971 INFO:teuthology.orchestra.run.smithi064.stdout:Installed: 2024-03-26T16:45:08.971 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-volume-2:19.0.0-2382.gbf9505fb.el9.noarch 2024-03-26T16:45:08.971 INFO:teuthology.orchestra.run.smithi064.stdout: python3-packaging-20.9-5.el9.noarch 2024-03-26T16:45:08.972 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-03-26T16:45:08.972 INFO:teuthology.orchestra.run.smithi064.stdout:Complete! 2024-03-26T16:45:09.272 DEBUG:teuthology.orchestra.run.smithi064:> sudo yum -y install librados-devel 2024-03-26T16:45:09.279 INFO:teuthology.orchestra.run.smithi044.stdout:Last metadata expiration check: 0:01:39 ago on Tue 26 Mar 2024 04:43:30 PM UTC. 2024-03-26T16:45:09.379 INFO:teuthology.orchestra.run.smithi044.stdout:Package libcephfs2-2:19.0.0-2382.gbf9505fb.el9.x86_64 is already installed. 2024-03-26T16:45:09.436 INFO:teuthology.orchestra.run.smithi044.stdout:Dependencies resolved. 2024-03-26T16:45:09.437 INFO:teuthology.orchestra.run.smithi044.stdout:Nothing to do. 2024-03-26T16:45:09.437 INFO:teuthology.orchestra.run.smithi044.stdout:Complete! 2024-03-26T16:45:09.500 DEBUG:teuthology.orchestra.run.smithi044:> sudo yum -y install libcephfs-devel 2024-03-26T16:45:09.853 INFO:teuthology.orchestra.run.smithi064.stdout:Last metadata expiration check: 0:03:47 ago on Tue 26 Mar 2024 04:41:22 PM UTC. 2024-03-26T16:45:10.009 INFO:teuthology.orchestra.run.smithi064.stdout:Dependencies resolved. 2024-03-26T16:45:10.010 INFO:teuthology.orchestra.run.smithi064.stdout:================================================================================ 2024-03-26T16:45:10.010 INFO:teuthology.orchestra.run.smithi064.stdout: Package Arch Version Repo Size 2024-03-26T16:45:10.010 INFO:teuthology.orchestra.run.smithi064.stdout:================================================================================ 2024-03-26T16:45:10.010 INFO:teuthology.orchestra.run.smithi064.stdout:Installing: 2024-03-26T16:45:10.010 INFO:teuthology.orchestra.run.smithi064.stdout: librados-devel x86_64 2:19.0.0-2382.gbf9505fb.el9 ceph 127 k 2024-03-26T16:45:10.010 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-03-26T16:45:10.010 INFO:teuthology.orchestra.run.smithi064.stdout:Transaction Summary 2024-03-26T16:45:10.010 INFO:teuthology.orchestra.run.smithi064.stdout:================================================================================ 2024-03-26T16:45:10.010 INFO:teuthology.orchestra.run.smithi064.stdout:Install 1 Package 2024-03-26T16:45:10.010 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-03-26T16:45:10.011 INFO:teuthology.orchestra.run.smithi064.stdout:Total download size: 127 k 2024-03-26T16:45:10.011 INFO:teuthology.orchestra.run.smithi064.stdout:Installed size: 456 k 2024-03-26T16:45:10.011 INFO:teuthology.orchestra.run.smithi064.stdout:Downloading Packages: 2024-03-26T16:45:10.073 INFO:teuthology.orchestra.run.smithi044.stdout:Last metadata expiration check: 0:01:40 ago on Tue 26 Mar 2024 04:43:30 PM UTC. 2024-03-26T16:45:10.229 INFO:teuthology.orchestra.run.smithi044.stdout:Dependencies resolved. 2024-03-26T16:45:10.230 INFO:teuthology.orchestra.run.smithi044.stdout:================================================================================ 2024-03-26T16:45:10.230 INFO:teuthology.orchestra.run.smithi044.stdout: Package Arch Version Repo Size 2024-03-26T16:45:10.230 INFO:teuthology.orchestra.run.smithi044.stdout:================================================================================ 2024-03-26T16:45:10.230 INFO:teuthology.orchestra.run.smithi044.stdout:Installing: 2024-03-26T16:45:10.230 INFO:teuthology.orchestra.run.smithi044.stdout: libcephfs-devel x86_64 2:19.0.0-2382.gbf9505fb.el9 ceph 32 k 2024-03-26T16:45:10.230 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-26T16:45:10.230 INFO:teuthology.orchestra.run.smithi044.stdout:Transaction Summary 2024-03-26T16:45:10.231 INFO:teuthology.orchestra.run.smithi044.stdout:================================================================================ 2024-03-26T16:45:10.231 INFO:teuthology.orchestra.run.smithi044.stdout:Install 1 Package 2024-03-26T16:45:10.231 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-26T16:45:10.231 INFO:teuthology.orchestra.run.smithi044.stdout:Total download size: 32 k 2024-03-26T16:45:10.231 INFO:teuthology.orchestra.run.smithi044.stdout:Installed size: 142 k 2024-03-26T16:45:10.231 INFO:teuthology.orchestra.run.smithi044.stdout:Downloading Packages: 2024-03-26T16:45:10.332 INFO:teuthology.orchestra.run.smithi064.stdout:librados-devel-19.0.0-2382.gbf9505fb.el9.x86_64 395 kB/s | 127 kB 00:00 2024-03-26T16:45:10.332 INFO:teuthology.orchestra.run.smithi064.stdout:-------------------------------------------------------------------------------- 2024-03-26T16:45:10.332 INFO:teuthology.orchestra.run.smithi064.stdout:Total 393 kB/s | 127 kB 00:00 2024-03-26T16:45:10.333 INFO:teuthology.orchestra.run.smithi064.stdout:Running transaction check 2024-03-26T16:45:10.338 INFO:teuthology.orchestra.run.smithi064.stdout:Transaction check succeeded. 2024-03-26T16:45:10.338 INFO:teuthology.orchestra.run.smithi064.stdout:Running transaction test 2024-03-26T16:45:10.398 INFO:teuthology.orchestra.run.smithi064.stdout:Transaction test succeeded. 2024-03-26T16:45:10.398 INFO:teuthology.orchestra.run.smithi064.stdout:Running transaction 2024-03-26T16:45:10.398 INFO:teuthology.orchestra.run.smithi044.stdout:libcephfs-devel-19.0.0-2382.gbf9505fb.el9.x86_6 189 kB/s | 32 kB 00:00 2024-03-26T16:45:10.399 INFO:teuthology.orchestra.run.smithi044.stdout:-------------------------------------------------------------------------------- 2024-03-26T16:45:10.399 INFO:teuthology.orchestra.run.smithi044.stdout:Total 188 kB/s | 32 kB 00:00 2024-03-26T16:45:10.399 INFO:teuthology.orchestra.run.smithi044.stdout:Running transaction check 2024-03-26T16:45:10.403 INFO:teuthology.orchestra.run.smithi044.stdout:Transaction check succeeded. 2024-03-26T16:45:10.403 INFO:teuthology.orchestra.run.smithi044.stdout:Running transaction test 2024-03-26T16:45:10.429 INFO:teuthology.orchestra.run.smithi044.stdout:Transaction test succeeded. 2024-03-26T16:45:10.429 INFO:teuthology.orchestra.run.smithi044.stdout:Running transaction 2024-03-26T16:45:10.550 INFO:teuthology.orchestra.run.smithi044.stdout: Preparing : 1/1 2024-03-26T16:45:10.555 INFO:teuthology.orchestra.run.smithi064.stdout: Preparing : 1/1 2024-03-26T16:45:10.657 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libcephfs-devel-2:19.0.0-2382.gbf9505fb.el9.x86_64 1/1 2024-03-26T16:45:10.667 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : librados-devel-2:19.0.0-2382.gbf9505fb.el9.x86_64 1/1 2024-03-26T16:45:11.039 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: libcephfs-devel-2:19.0.0-2382.gbf9505fb.el9.x86_64 1/1 2024-03-26T16:45:11.125 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: librados-devel-2:19.0.0-2382.gbf9505fb.el9.x86_64 1/1 2024-03-26T16:45:11.312 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libcephfs-devel-2:19.0.0-2382.gbf9505fb.el9.x86_64 1/1 2024-03-26T16:45:11.312 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-26T16:45:11.312 INFO:teuthology.orchestra.run.smithi044.stdout:Installed: 2024-03-26T16:45:11.312 INFO:teuthology.orchestra.run.smithi044.stdout: libcephfs-devel-2:19.0.0-2382.gbf9505fb.el9.x86_64 2024-03-26T16:45:11.312 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-26T16:45:11.312 INFO:teuthology.orchestra.run.smithi044.stdout:Complete! 2024-03-26T16:45:11.397 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : librados-devel-2:19.0.0-2382.gbf9505fb.el9.x86_64 1/1 2024-03-26T16:45:11.397 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-03-26T16:45:11.397 INFO:teuthology.orchestra.run.smithi064.stdout:Installed: 2024-03-26T16:45:11.397 INFO:teuthology.orchestra.run.smithi064.stdout: librados-devel-2:19.0.0-2382.gbf9505fb.el9.x86_64 2024-03-26T16:45:11.397 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-03-26T16:45:11.397 INFO:teuthology.orchestra.run.smithi064.stdout:Complete! 2024-03-26T16:45:11.472 DEBUG:teuthology.orchestra.run.smithi044:> sudo yum -y install librados2 2024-03-26T16:45:11.599 DEBUG:teuthology.orchestra.run.smithi064:> sudo yum -y install libcephfs2 2024-03-26T16:45:12.036 INFO:teuthology.orchestra.run.smithi044.stdout:Last metadata expiration check: 0:01:42 ago on Tue 26 Mar 2024 04:43:30 PM UTC. 2024-03-26T16:45:12.135 INFO:teuthology.orchestra.run.smithi044.stdout:Package librados2-2:19.0.0-2382.gbf9505fb.el9.x86_64 is already installed. 2024-03-26T16:45:12.175 INFO:teuthology.orchestra.run.smithi064.stdout:Last metadata expiration check: 0:03:50 ago on Tue 26 Mar 2024 04:41:22 PM UTC. 2024-03-26T16:45:12.190 INFO:teuthology.orchestra.run.smithi044.stdout:Dependencies resolved. 2024-03-26T16:45:12.191 INFO:teuthology.orchestra.run.smithi044.stdout:Nothing to do. 2024-03-26T16:45:12.191 INFO:teuthology.orchestra.run.smithi044.stdout:Complete! 2024-03-26T16:45:12.241 DEBUG:teuthology.orchestra.run.smithi044:> sudo yum -y install librbd1 2024-03-26T16:45:12.275 INFO:teuthology.orchestra.run.smithi064.stdout:Package libcephfs2-2:19.0.0-2382.gbf9505fb.el9.x86_64 is already installed. 2024-03-26T16:45:12.331 INFO:teuthology.orchestra.run.smithi064.stdout:Dependencies resolved. 2024-03-26T16:45:12.332 INFO:teuthology.orchestra.run.smithi064.stdout:Nothing to do. 2024-03-26T16:45:12.332 INFO:teuthology.orchestra.run.smithi064.stdout:Complete! 2024-03-26T16:45:12.385 DEBUG:teuthology.orchestra.run.smithi064:> sudo yum -y install libcephfs-devel 2024-03-26T16:45:12.806 INFO:teuthology.orchestra.run.smithi044.stdout:Last metadata expiration check: 0:01:42 ago on Tue 26 Mar 2024 04:43:30 PM UTC. 2024-03-26T16:45:12.907 INFO:teuthology.orchestra.run.smithi044.stdout:Package librbd1-2:19.0.0-2382.gbf9505fb.el9.x86_64 is already installed. 2024-03-26T16:45:12.958 INFO:teuthology.orchestra.run.smithi064.stdout:Last metadata expiration check: 0:03:50 ago on Tue 26 Mar 2024 04:41:22 PM UTC. 2024-03-26T16:45:12.963 INFO:teuthology.orchestra.run.smithi044.stdout:Dependencies resolved. 2024-03-26T16:45:12.964 INFO:teuthology.orchestra.run.smithi044.stdout:Nothing to do. 2024-03-26T16:45:12.964 INFO:teuthology.orchestra.run.smithi044.stdout:Complete! 2024-03-26T16:45:13.013 DEBUG:teuthology.orchestra.run.smithi044:> sudo yum -y install python3-rados 2024-03-26T16:45:13.113 INFO:teuthology.orchestra.run.smithi064.stdout:Dependencies resolved. 2024-03-26T16:45:13.114 INFO:teuthology.orchestra.run.smithi064.stdout:================================================================================ 2024-03-26T16:45:13.114 INFO:teuthology.orchestra.run.smithi064.stdout: Package Arch Version Repo Size 2024-03-26T16:45:13.114 INFO:teuthology.orchestra.run.smithi064.stdout:================================================================================ 2024-03-26T16:45:13.114 INFO:teuthology.orchestra.run.smithi064.stdout:Installing: 2024-03-26T16:45:13.114 INFO:teuthology.orchestra.run.smithi064.stdout: libcephfs-devel x86_64 2:19.0.0-2382.gbf9505fb.el9 ceph 32 k 2024-03-26T16:45:13.114 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-03-26T16:45:13.114 INFO:teuthology.orchestra.run.smithi064.stdout:Transaction Summary 2024-03-26T16:45:13.114 INFO:teuthology.orchestra.run.smithi064.stdout:================================================================================ 2024-03-26T16:45:13.114 INFO:teuthology.orchestra.run.smithi064.stdout:Install 1 Package 2024-03-26T16:45:13.114 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-03-26T16:45:13.114 INFO:teuthology.orchestra.run.smithi064.stdout:Total download size: 32 k 2024-03-26T16:45:13.114 INFO:teuthology.orchestra.run.smithi064.stdout:Installed size: 142 k 2024-03-26T16:45:13.115 INFO:teuthology.orchestra.run.smithi064.stdout:Downloading Packages: 2024-03-26T16:45:13.368 INFO:teuthology.orchestra.run.smithi064.stdout:libcephfs-devel-19.0.0-2382.gbf9505fb.el9.x86_6 125 kB/s | 32 kB 00:00 2024-03-26T16:45:13.369 INFO:teuthology.orchestra.run.smithi064.stdout:-------------------------------------------------------------------------------- 2024-03-26T16:45:13.369 INFO:teuthology.orchestra.run.smithi064.stdout:Total 124 kB/s | 32 kB 00:00 2024-03-26T16:45:13.369 INFO:teuthology.orchestra.run.smithi064.stdout:Running transaction check 2024-03-26T16:45:13.372 INFO:teuthology.orchestra.run.smithi064.stdout:Transaction check succeeded. 2024-03-26T16:45:13.372 INFO:teuthology.orchestra.run.smithi064.stdout:Running transaction test 2024-03-26T16:45:13.405 INFO:teuthology.orchestra.run.smithi064.stdout:Transaction test succeeded. 2024-03-26T16:45:13.405 INFO:teuthology.orchestra.run.smithi064.stdout:Running transaction 2024-03-26T16:45:13.515 INFO:teuthology.orchestra.run.smithi064.stdout: Preparing : 1/1 2024-03-26T16:45:13.581 INFO:teuthology.orchestra.run.smithi044.stdout:Last metadata expiration check: 0:01:43 ago on Tue 26 Mar 2024 04:43:30 PM UTC. 2024-03-26T16:45:13.622 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : libcephfs-devel-2:19.0.0-2382.gbf9505fb.el9.x86_64 1/1 2024-03-26T16:45:13.680 INFO:teuthology.orchestra.run.smithi044.stdout:Package python3-rados-2:19.0.0-2382.gbf9505fb.el9.x86_64 is already installed. 2024-03-26T16:45:13.734 INFO:teuthology.orchestra.run.smithi044.stdout:Dependencies resolved. 2024-03-26T16:45:13.735 INFO:teuthology.orchestra.run.smithi044.stdout:Nothing to do. 2024-03-26T16:45:13.735 INFO:teuthology.orchestra.run.smithi044.stdout:Complete! 2024-03-26T16:45:13.788 DEBUG:teuthology.orchestra.run.smithi044:> sudo yum -y install python3-rgw 2024-03-26T16:45:14.000 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: libcephfs-devel-2:19.0.0-2382.gbf9505fb.el9.x86_64 1/1 2024-03-26T16:45:14.272 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : libcephfs-devel-2:19.0.0-2382.gbf9505fb.el9.x86_64 1/1 2024-03-26T16:45:14.272 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-03-26T16:45:14.272 INFO:teuthology.orchestra.run.smithi064.stdout:Installed: 2024-03-26T16:45:14.272 INFO:teuthology.orchestra.run.smithi064.stdout: libcephfs-devel-2:19.0.0-2382.gbf9505fb.el9.x86_64 2024-03-26T16:45:14.272 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-03-26T16:45:14.272 INFO:teuthology.orchestra.run.smithi064.stdout:Complete! 2024-03-26T16:45:14.356 INFO:teuthology.orchestra.run.smithi044.stdout:Last metadata expiration check: 0:01:44 ago on Tue 26 Mar 2024 04:43:30 PM UTC. 2024-03-26T16:45:14.422 DEBUG:teuthology.orchestra.run.smithi064:> sudo yum -y install librados2 2024-03-26T16:45:14.457 INFO:teuthology.orchestra.run.smithi044.stdout:Package python3-rgw-2:19.0.0-2382.gbf9505fb.el9.x86_64 is already installed. 2024-03-26T16:45:14.512 INFO:teuthology.orchestra.run.smithi044.stdout:Dependencies resolved. 2024-03-26T16:45:14.513 INFO:teuthology.orchestra.run.smithi044.stdout:Nothing to do. 2024-03-26T16:45:14.513 INFO:teuthology.orchestra.run.smithi044.stdout:Complete! 2024-03-26T16:45:14.567 DEBUG:teuthology.orchestra.run.smithi044:> sudo yum -y install python3-cephfs 2024-03-26T16:45:14.991 INFO:teuthology.orchestra.run.smithi064.stdout:Last metadata expiration check: 0:03:52 ago on Tue 26 Mar 2024 04:41:22 PM UTC. 2024-03-26T16:45:15.091 INFO:teuthology.orchestra.run.smithi064.stdout:Package librados2-2:19.0.0-2382.gbf9505fb.el9.x86_64 is already installed. 2024-03-26T16:45:15.141 INFO:teuthology.orchestra.run.smithi044.stdout:Last metadata expiration check: 0:01:45 ago on Tue 26 Mar 2024 04:43:30 PM UTC. 2024-03-26T16:45:15.145 INFO:teuthology.orchestra.run.smithi064.stdout:Dependencies resolved. 2024-03-26T16:45:15.147 INFO:teuthology.orchestra.run.smithi064.stdout:Nothing to do. 2024-03-26T16:45:15.147 INFO:teuthology.orchestra.run.smithi064.stdout:Complete! 2024-03-26T16:45:15.191 DEBUG:teuthology.orchestra.run.smithi064:> sudo yum -y install librbd1 2024-03-26T16:45:15.240 INFO:teuthology.orchestra.run.smithi044.stdout:Package python3-cephfs-2:19.0.0-2382.gbf9505fb.el9.x86_64 is already installed. 2024-03-26T16:45:15.295 INFO:teuthology.orchestra.run.smithi044.stdout:Dependencies resolved. 2024-03-26T16:45:15.296 INFO:teuthology.orchestra.run.smithi044.stdout:Nothing to do. 2024-03-26T16:45:15.296 INFO:teuthology.orchestra.run.smithi044.stdout:Complete! 2024-03-26T16:45:15.355 DEBUG:teuthology.orchestra.run.smithi044:> sudo yum -y install python3-rbd 2024-03-26T16:45:15.760 INFO:teuthology.orchestra.run.smithi064.stdout:Last metadata expiration check: 0:03:53 ago on Tue 26 Mar 2024 04:41:22 PM UTC. 2024-03-26T16:45:15.860 INFO:teuthology.orchestra.run.smithi064.stdout:Package librbd1-2:19.0.0-2382.gbf9505fb.el9.x86_64 is already installed. 2024-03-26T16:45:15.915 INFO:teuthology.orchestra.run.smithi064.stdout:Dependencies resolved. 2024-03-26T16:45:15.916 INFO:teuthology.orchestra.run.smithi064.stdout:Nothing to do. 2024-03-26T16:45:15.916 INFO:teuthology.orchestra.run.smithi064.stdout:Complete! 2024-03-26T16:45:15.928 INFO:teuthology.orchestra.run.smithi044.stdout:Last metadata expiration check: 0:01:45 ago on Tue 26 Mar 2024 04:43:30 PM UTC. 2024-03-26T16:45:15.958 DEBUG:teuthology.orchestra.run.smithi064:> sudo yum -y install python3-rados 2024-03-26T16:45:16.028 INFO:teuthology.orchestra.run.smithi044.stdout:Package python3-rbd-2:19.0.0-2382.gbf9505fb.el9.x86_64 is already installed. 2024-03-26T16:45:16.082 INFO:teuthology.orchestra.run.smithi044.stdout:Dependencies resolved. 2024-03-26T16:45:16.083 INFO:teuthology.orchestra.run.smithi044.stdout:Nothing to do. 2024-03-26T16:45:16.083 INFO:teuthology.orchestra.run.smithi044.stdout:Complete! 2024-03-26T16:45:16.129 DEBUG:teuthology.orchestra.run.smithi044:> sudo yum -y install rbd-fuse 2024-03-26T16:45:16.528 INFO:teuthology.orchestra.run.smithi064.stdout:Last metadata expiration check: 0:03:54 ago on Tue 26 Mar 2024 04:41:22 PM UTC. 2024-03-26T16:45:16.628 INFO:teuthology.orchestra.run.smithi064.stdout:Package python3-rados-2:19.0.0-2382.gbf9505fb.el9.x86_64 is already installed. 2024-03-26T16:45:16.682 INFO:teuthology.orchestra.run.smithi064.stdout:Dependencies resolved. 2024-03-26T16:45:16.683 INFO:teuthology.orchestra.run.smithi064.stdout:Nothing to do. 2024-03-26T16:45:16.684 INFO:teuthology.orchestra.run.smithi064.stdout:Complete! 2024-03-26T16:45:16.698 INFO:teuthology.orchestra.run.smithi044.stdout:Last metadata expiration check: 0:01:46 ago on Tue 26 Mar 2024 04:43:30 PM UTC. 2024-03-26T16:45:16.729 DEBUG:teuthology.orchestra.run.smithi064:> sudo yum -y install python3-rgw 2024-03-26T16:45:16.853 INFO:teuthology.orchestra.run.smithi044.stdout:Dependencies resolved. 2024-03-26T16:45:16.854 INFO:teuthology.orchestra.run.smithi044.stdout:================================================================================ 2024-03-26T16:45:16.854 INFO:teuthology.orchestra.run.smithi044.stdout: Package Architecture Version Repository Size 2024-03-26T16:45:16.854 INFO:teuthology.orchestra.run.smithi044.stdout:================================================================================ 2024-03-26T16:45:16.854 INFO:teuthology.orchestra.run.smithi044.stdout:Installing: 2024-03-26T16:45:16.854 INFO:teuthology.orchestra.run.smithi044.stdout: rbd-fuse x86_64 2:19.0.0-2382.gbf9505fb.el9 ceph 86 k 2024-03-26T16:45:16.854 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-26T16:45:16.854 INFO:teuthology.orchestra.run.smithi044.stdout:Transaction Summary 2024-03-26T16:45:16.854 INFO:teuthology.orchestra.run.smithi044.stdout:================================================================================ 2024-03-26T16:45:16.854 INFO:teuthology.orchestra.run.smithi044.stdout:Install 1 Package 2024-03-26T16:45:16.854 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-26T16:45:16.855 INFO:teuthology.orchestra.run.smithi044.stdout:Total download size: 86 k 2024-03-26T16:45:16.855 INFO:teuthology.orchestra.run.smithi044.stdout:Installed size: 231 k 2024-03-26T16:45:16.855 INFO:teuthology.orchestra.run.smithi044.stdout:Downloading Packages: 2024-03-26T16:45:17.193 INFO:teuthology.orchestra.run.smithi044.stdout:rbd-fuse-19.0.0-2382.gbf9505fb.el9.x86_64.rpm 253 kB/s | 86 kB 00:00 2024-03-26T16:45:17.194 INFO:teuthology.orchestra.run.smithi044.stdout:-------------------------------------------------------------------------------- 2024-03-26T16:45:17.194 INFO:teuthology.orchestra.run.smithi044.stdout:Total 252 kB/s | 86 kB 00:00 2024-03-26T16:45:17.194 INFO:teuthology.orchestra.run.smithi044.stdout:Running transaction check 2024-03-26T16:45:17.202 INFO:teuthology.orchestra.run.smithi044.stdout:Transaction check succeeded. 2024-03-26T16:45:17.202 INFO:teuthology.orchestra.run.smithi044.stdout:Running transaction test 2024-03-26T16:45:17.260 INFO:teuthology.orchestra.run.smithi044.stdout:Transaction test succeeded. 2024-03-26T16:45:17.260 INFO:teuthology.orchestra.run.smithi044.stdout:Running transaction 2024-03-26T16:45:17.300 INFO:teuthology.orchestra.run.smithi064.stdout:Last metadata expiration check: 0:03:55 ago on Tue 26 Mar 2024 04:41:22 PM UTC. 2024-03-26T16:45:17.401 INFO:teuthology.orchestra.run.smithi064.stdout:Package python3-rgw-2:19.0.0-2382.gbf9505fb.el9.x86_64 is already installed. 2024-03-26T16:45:17.404 INFO:teuthology.orchestra.run.smithi044.stdout: Preparing : 1/1 2024-03-26T16:45:17.456 INFO:teuthology.orchestra.run.smithi064.stdout:Dependencies resolved. 2024-03-26T16:45:17.456 INFO:teuthology.orchestra.run.smithi064.stdout:Nothing to do. 2024-03-26T16:45:17.456 INFO:teuthology.orchestra.run.smithi064.stdout:Complete! 2024-03-26T16:45:17.503 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : rbd-fuse-2:19.0.0-2382.gbf9505fb.el9.x86_64 1/1 2024-03-26T16:45:17.504 DEBUG:teuthology.orchestra.run.smithi064:> sudo yum -y install python3-cephfs 2024-03-26T16:45:17.878 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: rbd-fuse-2:19.0.0-2382.gbf9505fb.el9.x86_64 1/1 2024-03-26T16:45:18.072 INFO:teuthology.orchestra.run.smithi064.stdout:Last metadata expiration check: 0:03:56 ago on Tue 26 Mar 2024 04:41:22 PM UTC. 2024-03-26T16:45:18.160 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : rbd-fuse-2:19.0.0-2382.gbf9505fb.el9.x86_64 1/1 2024-03-26T16:45:18.160 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-26T16:45:18.160 INFO:teuthology.orchestra.run.smithi044.stdout:Installed: 2024-03-26T16:45:18.160 INFO:teuthology.orchestra.run.smithi044.stdout: rbd-fuse-2:19.0.0-2382.gbf9505fb.el9.x86_64 2024-03-26T16:45:18.160 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-26T16:45:18.161 INFO:teuthology.orchestra.run.smithi044.stdout:Complete! 2024-03-26T16:45:18.172 INFO:teuthology.orchestra.run.smithi064.stdout:Package python3-cephfs-2:19.0.0-2382.gbf9505fb.el9.x86_64 is already installed. 2024-03-26T16:45:18.226 INFO:teuthology.orchestra.run.smithi064.stdout:Dependencies resolved. 2024-03-26T16:45:18.227 INFO:teuthology.orchestra.run.smithi064.stdout:Nothing to do. 2024-03-26T16:45:18.228 INFO:teuthology.orchestra.run.smithi064.stdout:Complete! 2024-03-26T16:45:18.273 DEBUG:teuthology.orchestra.run.smithi064:> sudo yum -y install python3-rbd 2024-03-26T16:45:18.395 DEBUG:teuthology.orchestra.run.smithi044:> sudo yum -y install rbd-mirror 2024-03-26T16:45:18.857 INFO:teuthology.orchestra.run.smithi064.stdout:Last metadata expiration check: 0:03:56 ago on Tue 26 Mar 2024 04:41:22 PM UTC. 2024-03-26T16:45:18.956 INFO:teuthology.orchestra.run.smithi064.stdout:Package python3-rbd-2:19.0.0-2382.gbf9505fb.el9.x86_64 is already installed. 2024-03-26T16:45:18.979 INFO:teuthology.orchestra.run.smithi044.stdout:Last metadata expiration check: 0:01:48 ago on Tue 26 Mar 2024 04:43:30 PM UTC. 2024-03-26T16:45:19.009 INFO:teuthology.orchestra.run.smithi064.stdout:Dependencies resolved. 2024-03-26T16:45:19.011 INFO:teuthology.orchestra.run.smithi064.stdout:Nothing to do. 2024-03-26T16:45:19.011 INFO:teuthology.orchestra.run.smithi064.stdout:Complete! 2024-03-26T16:45:19.056 DEBUG:teuthology.orchestra.run.smithi064:> sudo yum -y install rbd-fuse 2024-03-26T16:45:19.135 INFO:teuthology.orchestra.run.smithi044.stdout:Dependencies resolved. 2024-03-26T16:45:19.136 INFO:teuthology.orchestra.run.smithi044.stdout:================================================================================ 2024-03-26T16:45:19.136 INFO:teuthology.orchestra.run.smithi044.stdout: Package Arch Version Repo Size 2024-03-26T16:45:19.136 INFO:teuthology.orchestra.run.smithi044.stdout:================================================================================ 2024-03-26T16:45:19.136 INFO:teuthology.orchestra.run.smithi044.stdout:Installing: 2024-03-26T16:45:19.136 INFO:teuthology.orchestra.run.smithi044.stdout: rbd-mirror x86_64 2:19.0.0-2382.gbf9505fb.el9 ceph 3.1 M 2024-03-26T16:45:19.137 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-26T16:45:19.137 INFO:teuthology.orchestra.run.smithi044.stdout:Transaction Summary 2024-03-26T16:45:19.137 INFO:teuthology.orchestra.run.smithi044.stdout:================================================================================ 2024-03-26T16:45:19.137 INFO:teuthology.orchestra.run.smithi044.stdout:Install 1 Package 2024-03-26T16:45:19.137 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-26T16:45:19.137 INFO:teuthology.orchestra.run.smithi044.stdout:Total download size: 3.1 M 2024-03-26T16:45:19.138 INFO:teuthology.orchestra.run.smithi044.stdout:Installed size: 13 M 2024-03-26T16:45:19.138 INFO:teuthology.orchestra.run.smithi044.stdout:Downloading Packages: 2024-03-26T16:45:19.622 INFO:teuthology.orchestra.run.smithi064.stdout:Last metadata expiration check: 0:03:57 ago on Tue 26 Mar 2024 04:41:22 PM UTC. 2024-03-26T16:45:19.777 INFO:teuthology.orchestra.run.smithi064.stdout:Dependencies resolved. 2024-03-26T16:45:19.777 INFO:teuthology.orchestra.run.smithi064.stdout:================================================================================ 2024-03-26T16:45:19.778 INFO:teuthology.orchestra.run.smithi064.stdout: Package Architecture Version Repository Size 2024-03-26T16:45:19.778 INFO:teuthology.orchestra.run.smithi064.stdout:================================================================================ 2024-03-26T16:45:19.778 INFO:teuthology.orchestra.run.smithi064.stdout:Installing: 2024-03-26T16:45:19.778 INFO:teuthology.orchestra.run.smithi064.stdout: rbd-fuse x86_64 2:19.0.0-2382.gbf9505fb.el9 ceph 86 k 2024-03-26T16:45:19.778 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-03-26T16:45:19.778 INFO:teuthology.orchestra.run.smithi064.stdout:Transaction Summary 2024-03-26T16:45:19.778 INFO:teuthology.orchestra.run.smithi064.stdout:================================================================================ 2024-03-26T16:45:19.778 INFO:teuthology.orchestra.run.smithi064.stdout:Install 1 Package 2024-03-26T16:45:19.778 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-03-26T16:45:19.778 INFO:teuthology.orchestra.run.smithi064.stdout:Total download size: 86 k 2024-03-26T16:45:19.778 INFO:teuthology.orchestra.run.smithi064.stdout:Installed size: 231 k 2024-03-26T16:45:19.778 INFO:teuthology.orchestra.run.smithi064.stdout:Downloading Packages: 2024-03-26T16:45:19.805 INFO:teuthology.orchestra.run.smithi044.stdout:rbd-mirror-19.0.0-2382.gbf9505fb.el9.x86_64.rpm 4.6 MB/s | 3.1 MB 00:00 2024-03-26T16:45:19.806 INFO:teuthology.orchestra.run.smithi044.stdout:-------------------------------------------------------------------------------- 2024-03-26T16:45:19.806 INFO:teuthology.orchestra.run.smithi044.stdout:Total 4.6 MB/s | 3.1 MB 00:00 2024-03-26T16:45:19.807 INFO:teuthology.orchestra.run.smithi044.stdout:Running transaction check 2024-03-26T16:45:19.817 INFO:teuthology.orchestra.run.smithi044.stdout:Transaction check succeeded. 2024-03-26T16:45:19.817 INFO:teuthology.orchestra.run.smithi044.stdout:Running transaction test 2024-03-26T16:45:19.899 INFO:teuthology.orchestra.run.smithi044.stdout:Transaction test succeeded. 2024-03-26T16:45:19.899 INFO:teuthology.orchestra.run.smithi044.stdout:Running transaction 2024-03-26T16:45:19.989 INFO:teuthology.orchestra.run.smithi064.stdout:rbd-fuse-19.0.0-2382.gbf9505fb.el9.x86_64.rpm 405 kB/s | 86 kB 00:00 2024-03-26T16:45:19.990 INFO:teuthology.orchestra.run.smithi064.stdout:-------------------------------------------------------------------------------- 2024-03-26T16:45:19.990 INFO:teuthology.orchestra.run.smithi064.stdout:Total 403 kB/s | 86 kB 00:00 2024-03-26T16:45:19.990 INFO:teuthology.orchestra.run.smithi064.stdout:Running transaction check 2024-03-26T16:45:19.998 INFO:teuthology.orchestra.run.smithi064.stdout:Transaction check succeeded. 2024-03-26T16:45:19.998 INFO:teuthology.orchestra.run.smithi064.stdout:Running transaction test 2024-03-26T16:45:20.056 INFO:teuthology.orchestra.run.smithi064.stdout:Transaction test succeeded. 2024-03-26T16:45:20.056 INFO:teuthology.orchestra.run.smithi064.stdout:Running transaction 2024-03-26T16:45:20.202 INFO:teuthology.orchestra.run.smithi064.stdout: Preparing : 1/1 2024-03-26T16:45:20.308 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : rbd-fuse-2:19.0.0-2382.gbf9505fb.el9.x86_64 1/1 2024-03-26T16:45:20.351 INFO:teuthology.orchestra.run.smithi044.stdout: Preparing : 1/1 2024-03-26T16:45:20.423 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : rbd-mirror-2:19.0.0-2382.gbf9505fb.el9.x86_64 1/1 2024-03-26T16:45:20.448 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: rbd-mirror-2:19.0.0-2382.gbf9505fb.el9.x86_64 1/1 2024-03-26T16:45:20.448 INFO:teuthology.orchestra.run.smithi044.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-26T16:45:20.448 INFO:teuthology.orchestra.run.smithi044.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-03-26T16:45:20.448 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-26T16:45:20.448 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-26T16:45:20.448 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-26T16:45:20.707 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: rbd-fuse-2:19.0.0-2382.gbf9505fb.el9.x86_64 1/1 2024-03-26T16:45:20.978 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : rbd-fuse-2:19.0.0-2382.gbf9505fb.el9.x86_64 1/1 2024-03-26T16:45:20.978 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-03-26T16:45:20.978 INFO:teuthology.orchestra.run.smithi064.stdout:Installed: 2024-03-26T16:45:20.978 INFO:teuthology.orchestra.run.smithi064.stdout: rbd-fuse-2:19.0.0-2382.gbf9505fb.el9.x86_64 2024-03-26T16:45:20.978 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-03-26T16:45:20.978 INFO:teuthology.orchestra.run.smithi064.stdout:Complete! 2024-03-26T16:45:21.201 DEBUG:teuthology.orchestra.run.smithi064:> sudo yum -y install rbd-mirror 2024-03-26T16:45:21.635 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : rbd-mirror-2:19.0.0-2382.gbf9505fb.el9.x86_64 1/1 2024-03-26T16:45:21.635 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-26T16:45:21.635 INFO:teuthology.orchestra.run.smithi044.stdout:Installed: 2024-03-26T16:45:21.635 INFO:teuthology.orchestra.run.smithi044.stdout: rbd-mirror-2:19.0.0-2382.gbf9505fb.el9.x86_64 2024-03-26T16:45:21.635 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-26T16:45:21.635 INFO:teuthology.orchestra.run.smithi044.stdout:Complete! 2024-03-26T16:45:21.774 INFO:teuthology.orchestra.run.smithi064.stdout:Last metadata expiration check: 0:03:59 ago on Tue 26 Mar 2024 04:41:22 PM UTC. 2024-03-26T16:45:21.879 DEBUG:teuthology.orchestra.run.smithi044:> sudo yum -y install rbd-nbd 2024-03-26T16:45:21.930 INFO:teuthology.orchestra.run.smithi064.stdout:Dependencies resolved. 2024-03-26T16:45:21.931 INFO:teuthology.orchestra.run.smithi064.stdout:================================================================================ 2024-03-26T16:45:21.931 INFO:teuthology.orchestra.run.smithi064.stdout: Package Arch Version Repo Size 2024-03-26T16:45:21.931 INFO:teuthology.orchestra.run.smithi064.stdout:================================================================================ 2024-03-26T16:45:21.931 INFO:teuthology.orchestra.run.smithi064.stdout:Installing: 2024-03-26T16:45:21.931 INFO:teuthology.orchestra.run.smithi064.stdout: rbd-mirror x86_64 2:19.0.0-2382.gbf9505fb.el9 ceph 3.1 M 2024-03-26T16:45:21.931 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-03-26T16:45:21.931 INFO:teuthology.orchestra.run.smithi064.stdout:Transaction Summary 2024-03-26T16:45:21.931 INFO:teuthology.orchestra.run.smithi064.stdout:================================================================================ 2024-03-26T16:45:21.931 INFO:teuthology.orchestra.run.smithi064.stdout:Install 1 Package 2024-03-26T16:45:21.932 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-03-26T16:45:21.932 INFO:teuthology.orchestra.run.smithi064.stdout:Total download size: 3.1 M 2024-03-26T16:45:21.932 INFO:teuthology.orchestra.run.smithi064.stdout:Installed size: 13 M 2024-03-26T16:45:21.932 INFO:teuthology.orchestra.run.smithi064.stdout:Downloading Packages: 2024-03-26T16:45:22.448 INFO:teuthology.orchestra.run.smithi044.stdout:Last metadata expiration check: 0:01:52 ago on Tue 26 Mar 2024 04:43:30 PM UTC. 2024-03-26T16:45:22.604 INFO:teuthology.orchestra.run.smithi044.stdout:Dependencies resolved. 2024-03-26T16:45:22.604 INFO:teuthology.orchestra.run.smithi044.stdout:================================================================================ 2024-03-26T16:45:22.605 INFO:teuthology.orchestra.run.smithi044.stdout: Package Architecture Version Repository Size 2024-03-26T16:45:22.605 INFO:teuthology.orchestra.run.smithi044.stdout:================================================================================ 2024-03-26T16:45:22.605 INFO:teuthology.orchestra.run.smithi044.stdout:Installing: 2024-03-26T16:45:22.605 INFO:teuthology.orchestra.run.smithi044.stdout: rbd-nbd x86_64 2:19.0.0-2382.gbf9505fb.el9 ceph 171 k 2024-03-26T16:45:22.605 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-26T16:45:22.605 INFO:teuthology.orchestra.run.smithi044.stdout:Transaction Summary 2024-03-26T16:45:22.605 INFO:teuthology.orchestra.run.smithi044.stdout:================================================================================ 2024-03-26T16:45:22.605 INFO:teuthology.orchestra.run.smithi044.stdout:Install 1 Package 2024-03-26T16:45:22.605 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-26T16:45:22.605 INFO:teuthology.orchestra.run.smithi044.stdout:Total download size: 171 k 2024-03-26T16:45:22.605 INFO:teuthology.orchestra.run.smithi044.stdout:Installed size: 494 k 2024-03-26T16:45:22.605 INFO:teuthology.orchestra.run.smithi044.stdout:Downloading Packages: 2024-03-26T16:45:22.825 INFO:teuthology.orchestra.run.smithi044.stdout:rbd-nbd-19.0.0-2382.gbf9505fb.el9.x86_64.rpm 777 kB/s | 171 kB 00:00 2024-03-26T16:45:22.826 INFO:teuthology.orchestra.run.smithi044.stdout:-------------------------------------------------------------------------------- 2024-03-26T16:45:22.826 INFO:teuthology.orchestra.run.smithi044.stdout:Total 772 kB/s | 171 kB 00:00 2024-03-26T16:45:22.826 INFO:teuthology.orchestra.run.smithi044.stdout:Running transaction check 2024-03-26T16:45:22.834 INFO:teuthology.orchestra.run.smithi044.stdout:Transaction check succeeded. 2024-03-26T16:45:22.834 INFO:teuthology.orchestra.run.smithi044.stdout:Running transaction test 2024-03-26T16:45:22.884 INFO:teuthology.orchestra.run.smithi064.stdout:rbd-mirror-19.0.0-2382.gbf9505fb.el9.x86_64.rpm 3.2 MB/s | 3.1 MB 00:00 2024-03-26T16:45:22.884 INFO:teuthology.orchestra.run.smithi064.stdout:-------------------------------------------------------------------------------- 2024-03-26T16:45:22.885 INFO:teuthology.orchestra.run.smithi064.stdout:Total 3.2 MB/s | 3.1 MB 00:00 2024-03-26T16:45:22.885 INFO:teuthology.orchestra.run.smithi064.stdout:Running transaction check 2024-03-26T16:45:22.894 INFO:teuthology.orchestra.run.smithi044.stdout:Transaction test succeeded. 2024-03-26T16:45:22.894 INFO:teuthology.orchestra.run.smithi044.stdout:Running transaction 2024-03-26T16:45:22.895 INFO:teuthology.orchestra.run.smithi064.stdout:Transaction check succeeded. 2024-03-26T16:45:22.895 INFO:teuthology.orchestra.run.smithi064.stdout:Running transaction test 2024-03-26T16:45:22.978 INFO:teuthology.orchestra.run.smithi064.stdout:Transaction test succeeded. 2024-03-26T16:45:22.978 INFO:teuthology.orchestra.run.smithi064.stdout:Running transaction 2024-03-26T16:45:23.044 INFO:teuthology.orchestra.run.smithi044.stdout: Preparing : 1/1 2024-03-26T16:45:23.137 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : rbd-nbd-2:19.0.0-2382.gbf9505fb.el9.x86_64 1/1 2024-03-26T16:45:23.435 INFO:teuthology.orchestra.run.smithi064.stdout: Preparing : 1/1 2024-03-26T16:45:23.510 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : rbd-mirror-2:19.0.0-2382.gbf9505fb.el9.x86_64 1/1 2024-03-26T16:45:23.533 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: rbd-mirror-2:19.0.0-2382.gbf9505fb.el9.x86_64 1/1 2024-03-26T16:45:23.533 INFO:teuthology.orchestra.run.smithi064.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-26T16:45:23.533 INFO:teuthology.orchestra.run.smithi064.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-03-26T16:45:23.533 INFO:teuthology.orchestra.run.smithi064.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-26T16:45:23.533 INFO:teuthology.orchestra.run.smithi064.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-26T16:45:23.533 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-03-26T16:45:23.708 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: rbd-nbd-2:19.0.0-2382.gbf9505fb.el9.x86_64 1/1 2024-03-26T16:45:24.026 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : rbd-nbd-2:19.0.0-2382.gbf9505fb.el9.x86_64 1/1 2024-03-26T16:45:24.026 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-26T16:45:24.026 INFO:teuthology.orchestra.run.smithi044.stdout:Installed: 2024-03-26T16:45:24.026 INFO:teuthology.orchestra.run.smithi044.stdout: rbd-nbd-2:19.0.0-2382.gbf9505fb.el9.x86_64 2024-03-26T16:45:24.026 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-26T16:45:24.027 INFO:teuthology.orchestra.run.smithi044.stdout:Complete! 2024-03-26T16:45:24.227 DEBUG:teuthology.orchestra.run.smithi044:> sudo yum -y install nvme-cli 2024-03-26T16:45:24.678 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : rbd-mirror-2:19.0.0-2382.gbf9505fb.el9.x86_64 1/1 2024-03-26T16:45:24.679 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-03-26T16:45:24.679 INFO:teuthology.orchestra.run.smithi064.stdout:Installed: 2024-03-26T16:45:24.679 INFO:teuthology.orchestra.run.smithi064.stdout: rbd-mirror-2:19.0.0-2382.gbf9505fb.el9.x86_64 2024-03-26T16:45:24.679 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-03-26T16:45:24.679 INFO:teuthology.orchestra.run.smithi064.stdout:Complete! 2024-03-26T16:45:24.796 INFO:teuthology.orchestra.run.smithi044.stdout:Last metadata expiration check: 0:01:54 ago on Tue 26 Mar 2024 04:43:30 PM UTC. 2024-03-26T16:45:24.883 DEBUG:teuthology.orchestra.run.smithi064:> sudo yum -y install rbd-nbd 2024-03-26T16:45:24.897 INFO:teuthology.orchestra.run.smithi044.stdout:Package nvme-cli-2.4-9.el9.x86_64 is already installed. 2024-03-26T16:45:24.953 INFO:teuthology.orchestra.run.smithi044.stdout:Dependencies resolved. 2024-03-26T16:45:24.953 INFO:teuthology.orchestra.run.smithi044.stdout:================================================================================ 2024-03-26T16:45:24.953 INFO:teuthology.orchestra.run.smithi044.stdout: Package Architecture Version Repository Size 2024-03-26T16:45:24.954 INFO:teuthology.orchestra.run.smithi044.stdout:================================================================================ 2024-03-26T16:45:24.954 INFO:teuthology.orchestra.run.smithi044.stdout:Upgrading: 2024-03-26T16:45:24.954 INFO:teuthology.orchestra.run.smithi044.stdout: libnvme x86_64 1.6-1.el9 baseos 96 k 2024-03-26T16:45:24.954 INFO:teuthology.orchestra.run.smithi044.stdout: nvme-cli x86_64 2.6-5.el9 baseos 841 k 2024-03-26T16:45:24.954 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-26T16:45:24.954 INFO:teuthology.orchestra.run.smithi044.stdout:Transaction Summary 2024-03-26T16:45:24.954 INFO:teuthology.orchestra.run.smithi044.stdout:================================================================================ 2024-03-26T16:45:24.954 INFO:teuthology.orchestra.run.smithi044.stdout:Upgrade 2 Packages 2024-03-26T16:45:24.954 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-26T16:45:24.955 INFO:teuthology.orchestra.run.smithi044.stdout:Total download size: 937 k 2024-03-26T16:45:24.955 INFO:teuthology.orchestra.run.smithi044.stdout:Downloading Packages: 2024-03-26T16:45:25.455 INFO:teuthology.orchestra.run.smithi064.stdout:Last metadata expiration check: 0:04:03 ago on Tue 26 Mar 2024 04:41:22 PM UTC. 2024-03-26T16:45:25.537 INFO:teuthology.orchestra.run.smithi044.stdout:(1/2): libnvme-1.6-1.el9.x86_64.rpm 307 kB/s | 96 kB 00:00 2024-03-26T16:45:25.596 INFO:teuthology.orchestra.run.smithi044.stdout:(2/2): nvme-cli-2.6-5.el9.x86_64.rpm 2.2 MB/s | 841 kB 00:00 2024-03-26T16:45:25.596 INFO:teuthology.orchestra.run.smithi044.stdout:-------------------------------------------------------------------------------- 2024-03-26T16:45:25.596 INFO:teuthology.orchestra.run.smithi044.stdout:Total 1.4 MB/s | 937 kB 00:00 2024-03-26T16:45:25.608 INFO:teuthology.orchestra.run.smithi064.stdout:Dependencies resolved. 2024-03-26T16:45:25.609 INFO:teuthology.orchestra.run.smithi064.stdout:================================================================================ 2024-03-26T16:45:25.609 INFO:teuthology.orchestra.run.smithi064.stdout: Package Architecture Version Repository Size 2024-03-26T16:45:25.609 INFO:teuthology.orchestra.run.smithi064.stdout:================================================================================ 2024-03-26T16:45:25.609 INFO:teuthology.orchestra.run.smithi064.stdout:Installing: 2024-03-26T16:45:25.609 INFO:teuthology.orchestra.run.smithi064.stdout: rbd-nbd x86_64 2:19.0.0-2382.gbf9505fb.el9 ceph 171 k 2024-03-26T16:45:25.609 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-03-26T16:45:25.609 INFO:teuthology.orchestra.run.smithi064.stdout:Transaction Summary 2024-03-26T16:45:25.609 INFO:teuthology.orchestra.run.smithi064.stdout:================================================================================ 2024-03-26T16:45:25.609 INFO:teuthology.orchestra.run.smithi064.stdout:Install 1 Package 2024-03-26T16:45:25.609 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-03-26T16:45:25.610 INFO:teuthology.orchestra.run.smithi064.stdout:Total download size: 171 k 2024-03-26T16:45:25.610 INFO:teuthology.orchestra.run.smithi064.stdout:Installed size: 494 k 2024-03-26T16:45:25.610 INFO:teuthology.orchestra.run.smithi064.stdout:Downloading Packages: 2024-03-26T16:45:25.623 INFO:teuthology.orchestra.run.smithi044.stdout:Running transaction check 2024-03-26T16:45:25.635 INFO:teuthology.orchestra.run.smithi044.stdout:Transaction check succeeded. 2024-03-26T16:45:25.635 INFO:teuthology.orchestra.run.smithi044.stdout:Running transaction test 2024-03-26T16:45:25.738 INFO:teuthology.orchestra.run.smithi044.stdout:Transaction test succeeded. 2024-03-26T16:45:25.738 INFO:teuthology.orchestra.run.smithi044.stdout:Running transaction 2024-03-26T16:45:25.954 INFO:teuthology.orchestra.run.smithi064.stdout:rbd-nbd-19.0.0-2382.gbf9505fb.el9.x86_64.rpm 497 kB/s | 171 kB 00:00 2024-03-26T16:45:25.955 INFO:teuthology.orchestra.run.smithi064.stdout:-------------------------------------------------------------------------------- 2024-03-26T16:45:25.955 INFO:teuthology.orchestra.run.smithi064.stdout:Total 495 kB/s | 171 kB 00:00 2024-03-26T16:45:25.955 INFO:teuthology.orchestra.run.smithi064.stdout:Running transaction check 2024-03-26T16:45:25.963 INFO:teuthology.orchestra.run.smithi064.stdout:Transaction check succeeded. 2024-03-26T16:45:25.964 INFO:teuthology.orchestra.run.smithi064.stdout:Running transaction test 2024-03-26T16:45:25.994 INFO:teuthology.orchestra.run.smithi044.stdout: Preparing : 1/1 2024-03-26T16:45:26.023 INFO:teuthology.orchestra.run.smithi064.stdout:Transaction test succeeded. 2024-03-26T16:45:26.024 INFO:teuthology.orchestra.run.smithi064.stdout:Running transaction 2024-03-26T16:45:26.176 INFO:teuthology.orchestra.run.smithi064.stdout: Preparing : 1/1 2024-03-26T16:45:26.280 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : rbd-nbd-2:19.0.0-2382.gbf9505fb.el9.x86_64 1/1 2024-03-26T16:45:26.286 INFO:teuthology.orchestra.run.smithi044.stdout: Upgrading : libnvme-1.6-1.el9.x86_64 1/4 2024-03-26T16:45:26.332 INFO:teuthology.orchestra.run.smithi044.stdout: Upgrading : nvme-cli-2.6-5.el9.x86_64 2/4 2024-03-26T16:45:26.625 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: nvme-cli-2.6-5.el9.x86_64 2/4 2024-03-26T16:45:26.660 INFO:teuthology.orchestra.run.smithi044.stdout: Cleanup : nvme-cli-2.4-9.el9.x86_64 3/4 2024-03-26T16:45:26.707 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: rbd-nbd-2:19.0.0-2382.gbf9505fb.el9.x86_64 1/1 2024-03-26T16:45:26.759 INFO:teuthology.orchestra.run.smithi044.stdout: Cleanup : libnvme-1.4-7.el9.x86_64 4/4 2024-03-26T16:45:27.012 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : rbd-nbd-2:19.0.0-2382.gbf9505fb.el9.x86_64 1/1 2024-03-26T16:45:27.012 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-03-26T16:45:27.012 INFO:teuthology.orchestra.run.smithi064.stdout:Installed: 2024-03-26T16:45:27.012 INFO:teuthology.orchestra.run.smithi064.stdout: rbd-nbd-2:19.0.0-2382.gbf9505fb.el9.x86_64 2024-03-26T16:45:27.012 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-03-26T16:45:27.012 INFO:teuthology.orchestra.run.smithi064.stdout:Complete! 2024-03-26T16:45:27.231 DEBUG:teuthology.orchestra.run.smithi064:> sudo yum -y install nvme-cli 2024-03-26T16:45:27.554 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: libnvme-1.4-7.el9.x86_64 4/4 2024-03-26T16:45:27.554 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libnvme-1.6-1.el9.x86_64 1/4 2024-03-26T16:45:27.554 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libnvme-1.4-7.el9.x86_64 2/4 2024-03-26T16:45:27.554 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : nvme-cli-2.6-5.el9.x86_64 3/4 2024-03-26T16:45:27.800 INFO:teuthology.orchestra.run.smithi064.stdout:Last metadata expiration check: 0:04:05 ago on Tue 26 Mar 2024 04:41:22 PM UTC. 2024-03-26T16:45:27.903 INFO:teuthology.orchestra.run.smithi064.stdout:Package nvme-cli-2.4-9.el9.x86_64 is already installed. 2024-03-26T16:45:27.934 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : nvme-cli-2.4-9.el9.x86_64 4/4 2024-03-26T16:45:27.934 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-26T16:45:27.934 INFO:teuthology.orchestra.run.smithi044.stdout:Upgraded: 2024-03-26T16:45:27.934 INFO:teuthology.orchestra.run.smithi044.stdout: libnvme-1.6-1.el9.x86_64 nvme-cli-2.6-5.el9.x86_64 2024-03-26T16:45:27.934 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-26T16:45:27.934 INFO:teuthology.orchestra.run.smithi044.stdout:Complete! 2024-03-26T16:45:27.959 INFO:teuthology.orchestra.run.smithi064.stdout:Dependencies resolved. 2024-03-26T16:45:27.960 INFO:teuthology.orchestra.run.smithi064.stdout:================================================================================ 2024-03-26T16:45:27.960 INFO:teuthology.orchestra.run.smithi064.stdout: Package Architecture Version Repository Size 2024-03-26T16:45:27.960 INFO:teuthology.orchestra.run.smithi064.stdout:================================================================================ 2024-03-26T16:45:27.960 INFO:teuthology.orchestra.run.smithi064.stdout:Upgrading: 2024-03-26T16:45:27.960 INFO:teuthology.orchestra.run.smithi064.stdout: libnvme x86_64 1.6-1.el9 baseos 96 k 2024-03-26T16:45:27.960 INFO:teuthology.orchestra.run.smithi064.stdout: nvme-cli x86_64 2.6-5.el9 baseos 841 k 2024-03-26T16:45:27.960 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-03-26T16:45:27.960 INFO:teuthology.orchestra.run.smithi064.stdout:Transaction Summary 2024-03-26T16:45:27.960 INFO:teuthology.orchestra.run.smithi064.stdout:================================================================================ 2024-03-26T16:45:27.960 INFO:teuthology.orchestra.run.smithi064.stdout:Upgrade 2 Packages 2024-03-26T16:45:27.961 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-03-26T16:45:27.961 INFO:teuthology.orchestra.run.smithi064.stdout:Total download size: 937 k 2024-03-26T16:45:27.961 INFO:teuthology.orchestra.run.smithi064.stdout:Downloading Packages: 2024-03-26T16:45:28.232 DEBUG:teuthology.parallel:result is None 2024-03-26T16:45:28.432 INFO:teuthology.orchestra.run.smithi064.stdout:(1/2): libnvme-1.6-1.el9.x86_64.rpm 221 kB/s | 96 kB 00:00 2024-03-26T16:45:28.741 INFO:teuthology.orchestra.run.smithi064.stdout:(2/2): nvme-cli-2.6-5.el9.x86_64.rpm 1.1 MB/s | 841 kB 00:00 2024-03-26T16:45:28.741 INFO:teuthology.orchestra.run.smithi064.stdout:-------------------------------------------------------------------------------- 2024-03-26T16:45:28.741 INFO:teuthology.orchestra.run.smithi064.stdout:Total 1.2 MB/s | 937 kB 00:00 2024-03-26T16:45:28.768 INFO:teuthology.orchestra.run.smithi064.stdout:Running transaction check 2024-03-26T16:45:28.780 INFO:teuthology.orchestra.run.smithi064.stdout:Transaction check succeeded. 2024-03-26T16:45:28.780 INFO:teuthology.orchestra.run.smithi064.stdout:Running transaction test 2024-03-26T16:45:28.886 INFO:teuthology.orchestra.run.smithi064.stdout:Transaction test succeeded. 2024-03-26T16:45:28.886 INFO:teuthology.orchestra.run.smithi064.stdout:Running transaction 2024-03-26T16:45:29.118 INFO:teuthology.orchestra.run.smithi064.stdout: Preparing : 1/1 2024-03-26T16:45:29.423 INFO:teuthology.orchestra.run.smithi064.stdout: Upgrading : libnvme-1.6-1.el9.x86_64 1/4 2024-03-26T16:45:29.494 INFO:teuthology.orchestra.run.smithi064.stdout: Upgrading : nvme-cli-2.6-5.el9.x86_64 2/4 2024-03-26T16:45:29.803 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: nvme-cli-2.6-5.el9.x86_64 2/4 2024-03-26T16:45:29.846 INFO:teuthology.orchestra.run.smithi064.stdout: Cleanup : nvme-cli-2.4-9.el9.x86_64 3/4 2024-03-26T16:45:29.935 INFO:teuthology.orchestra.run.smithi064.stdout: Cleanup : libnvme-1.4-7.el9.x86_64 4/4 2024-03-26T16:45:30.722 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: libnvme-1.4-7.el9.x86_64 4/4 2024-03-26T16:45:30.722 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : libnvme-1.6-1.el9.x86_64 1/4 2024-03-26T16:45:30.722 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : libnvme-1.4-7.el9.x86_64 2/4 2024-03-26T16:45:30.723 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : nvme-cli-2.6-5.el9.x86_64 3/4 2024-03-26T16:45:31.044 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : nvme-cli-2.4-9.el9.x86_64 4/4 2024-03-26T16:45:31.045 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-03-26T16:45:31.045 INFO:teuthology.orchestra.run.smithi064.stdout:Upgraded: 2024-03-26T16:45:31.045 INFO:teuthology.orchestra.run.smithi064.stdout: libnvme-1.6-1.el9.x86_64 nvme-cli-2.6-5.el9.x86_64 2024-03-26T16:45:31.045 INFO:teuthology.orchestra.run.smithi064.stdout: 2024-03-26T16:45:31.045 INFO:teuthology.orchestra.run.smithi064.stdout:Complete! 2024-03-26T16:45:31.363 DEBUG:teuthology.parallel:result is None 2024-03-26T16:45:31.364 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=bf9505fb569e9b95a78f9700ed8c4bd20508ef55 2024-03-26T16:45:31.509 DEBUG:teuthology.orchestra.run.smithi044:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-03-26T16:45:31.534 INFO:teuthology.orchestra.run.smithi044.stdout:19.0.0-2382.gbf9505fb.el9 2024-03-26T16:45:31.535 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2382.gbf9505fb.el9 2024-03-26T16:45:31.535 INFO:teuthology.task.install:The correct ceph version 19.0.0-2382.gbf9505fb is installed. 2024-03-26T16:45:31.537 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=bf9505fb569e9b95a78f9700ed8c4bd20508ef55 2024-03-26T16:45:31.880 DEBUG:teuthology.orchestra.run.smithi064:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-03-26T16:45:31.901 INFO:teuthology.orchestra.run.smithi064.stdout:19.0.0-2382.gbf9505fb.el9 2024-03-26T16:45:31.902 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2382.gbf9505fb.el9 2024-03-26T16:45:31.902 INFO:teuthology.task.install:The correct ceph version 19.0.0-2382.gbf9505fb is installed. 2024-03-26T16:45:31.903 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=bf9505fb569e9b95a78f9700ed8c4bd20508ef55 2024-03-26T16:45:32.040 DEBUG:teuthology.orchestra.run.smithi149:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-03-26T16:45:32.067 INFO:teuthology.orchestra.run.smithi149.stdout:19.0.0-2382.gbf9505fb.el9 2024-03-26T16:45:32.067 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2382.gbf9505fb.el9 2024-03-26T16:45:32.067 INFO:teuthology.task.install:The correct ceph version 19.0.0-2382.gbf9505fb is installed. 2024-03-26T16:45:32.069 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=bf9505fb569e9b95a78f9700ed8c4bd20508ef55 2024-03-26T16:45:32.214 DEBUG:teuthology.orchestra.run.smithi157:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-03-26T16:45:32.239 INFO:teuthology.orchestra.run.smithi157.stdout:19.0.0-2382.gbf9505fb.el9 2024-03-26T16:45:32.240 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2382.gbf9505fb.el9 2024-03-26T16:45:32.240 INFO:teuthology.task.install:The correct ceph version 19.0.0-2382.gbf9505fb is installed. 2024-03-26T16:45:32.242 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-03-26T16:45:32.242 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-03-26T16:45:32.242 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-03-26T16:45:32.276 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-03-26T16:45:32.276 DEBUG:teuthology.orchestra.run.smithi064:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-03-26T16:45:32.308 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-03-26T16:45:32.308 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-03-26T16:45:32.343 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-03-26T16:45:32.344 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-03-26T16:45:32.378 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-03-26T16:45:32.378 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-03-26T16:45:32.379 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd of=/usr/bin/daemon-helper 2024-03-26T16:45:32.410 DEBUG:teuthology.orchestra.run.smithi044:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-03-26T16:45:32.480 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-03-26T16:45:32.480 DEBUG:teuthology.orchestra.run.smithi064:> sudo dd of=/usr/bin/daemon-helper 2024-03-26T16:45:32.511 DEBUG:teuthology.orchestra.run.smithi064:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-03-26T16:45:32.580 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-03-26T16:45:32.580 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd of=/usr/bin/daemon-helper 2024-03-26T16:45:32.612 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-03-26T16:45:32.683 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-03-26T16:45:32.683 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd of=/usr/bin/daemon-helper 2024-03-26T16:45:32.715 DEBUG:teuthology.orchestra.run.smithi157:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-03-26T16:45:32.784 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-03-26T16:45:32.784 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-03-26T16:45:32.784 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd of=/usr/bin/adjust-ulimits 2024-03-26T16:45:32.815 DEBUG:teuthology.orchestra.run.smithi044:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-03-26T16:45:32.886 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-03-26T16:45:32.886 DEBUG:teuthology.orchestra.run.smithi064:> sudo dd of=/usr/bin/adjust-ulimits 2024-03-26T16:45:32.917 DEBUG:teuthology.orchestra.run.smithi064:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-03-26T16:45:32.988 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-03-26T16:45:32.988 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd of=/usr/bin/adjust-ulimits 2024-03-26T16:45:33.015 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-03-26T16:45:33.082 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-03-26T16:45:33.082 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd of=/usr/bin/adjust-ulimits 2024-03-26T16:45:33.113 DEBUG:teuthology.orchestra.run.smithi157:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-03-26T16:45:33.182 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-03-26T16:45:33.183 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-03-26T16:45:33.183 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd of=/usr/bin/stdin-killer 2024-03-26T16:45:33.214 DEBUG:teuthology.orchestra.run.smithi044:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-03-26T16:45:33.284 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-03-26T16:45:33.285 DEBUG:teuthology.orchestra.run.smithi064:> sudo dd of=/usr/bin/stdin-killer 2024-03-26T16:45:33.316 DEBUG:teuthology.orchestra.run.smithi064:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-03-26T16:45:33.386 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-03-26T16:45:33.387 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd of=/usr/bin/stdin-killer 2024-03-26T16:45:33.413 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-03-26T16:45:33.480 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-03-26T16:45:33.480 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd of=/usr/bin/stdin-killer 2024-03-26T16:45:33.507 DEBUG:teuthology.orchestra.run.smithi157:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-03-26T16:45:33.573 INFO:teuthology.run_tasks:Running task cephadm... 2024-03-26T16:45:33.670 INFO:tasks.cephadm:Config: {'conf': {'global': {'mon warn on pool no app': False}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'debug ms': 1, 'debug osd': 20}}, 'flavor': 'default', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'sha1': 'bf9505fb569e9b95a78f9700ed8c4bd20508ef55'} 2024-03-26T16:45:33.670 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bf9505fb569e9b95a78f9700ed8c4bd20508ef55 2024-03-26T16:45:33.671 INFO:tasks.cephadm:Cluster fsid is 4394d798-eb90-11ee-95d0-87774f69a715 2024-03-26T16:45:33.671 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-03-26T16:45:33.671 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.44', 'mon.b': '172.21.15.64', 'mon.c': '172.21.15.149'} 2024-03-26T16:45:33.671 INFO:tasks.cephadm:First mon is mon.a on smithi044 2024-03-26T16:45:33.671 INFO:tasks.cephadm:First mgr is x 2024-03-26T16:45:33.671 INFO:tasks.cephadm:Normalizing hostnames... 2024-03-26T16:45:33.671 DEBUG:teuthology.orchestra.run.smithi044:> sudo hostname $(hostname -s) 2024-03-26T16:45:33.703 DEBUG:teuthology.orchestra.run.smithi064:> sudo hostname $(hostname -s) 2024-03-26T16:45:33.735 DEBUG:teuthology.orchestra.run.smithi149:> sudo hostname $(hostname -s) 2024-03-26T16:45:33.762 DEBUG:teuthology.orchestra.run.smithi157:> sudo hostname $(hostname -s) 2024-03-26T16:45:33.789 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-03-26T16:45:33.789 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=bf9505fb569e9b95a78f9700ed8c4bd20508ef55 2024-03-26T16:45:33.930 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': 'bf9505fb569e9b95a78f9700ed8c4bd20508ef55', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/77920/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.0.0-2382-gbf9505fb', 'node_name': '172.21.5.34+adami04', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.0.0-2382.gbf9505fb'}, 'url': 'https://2.chacra.ceph.com/r/ceph/ceph-nvmeof-mon/bf9505fb569e9b95a78f9700ed8c4bd20508ef55/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-03-24 18:40:44.295634', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'ceph-nvmeof-mon', 'chacra_url': 'https://2.chacra.ceph.com/repos/ceph/ceph-nvmeof-mon/bf9505fb569e9b95a78f9700ed8c4bd20508ef55/centos/9/flavors/default/', 'archs': ['x86_64', 'source'], 'distro': 'centos'}] 2024-03-26T16:45:34.140 INFO:tasks.util.chacra:got chacra host 2.chacra.ceph.com, ref ceph-nvmeof-mon, sha1 bf9505fb569e9b95a78f9700ed8c4bd20508ef55 from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=bf9505fb569e9b95a78f9700ed8c4bd20508ef55 2024-03-26T16:45:34.141 INFO:tasks.cephadm:Discovered cachra url: https://2.chacra.ceph.com/binaries/ceph/ceph-nvmeof-mon/bf9505fb569e9b95a78f9700ed8c4bd20508ef55/centos/9/x86_64/flavors/default/cephadm 2024-03-26T16:45:34.141 DEBUG:teuthology.orchestra.run.smithi044:> curl --silent -L https://2.chacra.ceph.com/binaries/ceph/ceph-nvmeof-mon/bf9505fb569e9b95a78f9700ed8c4bd20508ef55/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-03-26T16:45:34.632 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r--. 1 ubuntu ubuntu 769068 Mar 26 16:45 /home/ubuntu/cephtest/cephadm 2024-03-26T16:45:34.633 DEBUG:teuthology.orchestra.run.smithi064:> curl --silent -L https://2.chacra.ceph.com/binaries/ceph/ceph-nvmeof-mon/bf9505fb569e9b95a78f9700ed8c4bd20508ef55/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-03-26T16:45:35.285 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r--. 1 ubuntu ubuntu 769068 Mar 26 16:45 /home/ubuntu/cephtest/cephadm 2024-03-26T16:45:35.286 DEBUG:teuthology.orchestra.run.smithi149:> curl --silent -L https://2.chacra.ceph.com/binaries/ceph/ceph-nvmeof-mon/bf9505fb569e9b95a78f9700ed8c4bd20508ef55/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-03-26T16:45:36.141 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r--. 1 ubuntu ubuntu 769068 Mar 26 16:45 /home/ubuntu/cephtest/cephadm 2024-03-26T16:45:36.142 DEBUG:teuthology.orchestra.run.smithi157:> curl --silent -L https://2.chacra.ceph.com/binaries/ceph/ceph-nvmeof-mon/bf9505fb569e9b95a78f9700ed8c4bd20508ef55/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-03-26T16:45:36.936 INFO:teuthology.orchestra.run.smithi157.stdout:-rw-r--r--. 1 ubuntu ubuntu 769068 Mar 26 16:45 /home/ubuntu/cephtest/cephadm 2024-03-26T16:45:36.937 DEBUG:teuthology.orchestra.run.smithi044:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-03-26T16:45:36.955 DEBUG:teuthology.orchestra.run.smithi064:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-03-26T16:45:36.973 DEBUG:teuthology.orchestra.run.smithi149:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-03-26T16:45:36.992 DEBUG:teuthology.orchestra.run.smithi157:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-03-26T16:45:37.024 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bf9505fb569e9b95a78f9700ed8c4bd20508ef55 on all hosts... 2024-03-26T16:45:37.024 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bf9505fb569e9b95a78f9700ed8c4bd20508ef55 pull 2024-03-26T16:45:37.030 DEBUG:teuthology.orchestra.run.smithi064:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bf9505fb569e9b95a78f9700ed8c4bd20508ef55 pull 2024-03-26T16:45:37.033 DEBUG:teuthology.orchestra.run.smithi149:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bf9505fb569e9b95a78f9700ed8c4bd20508ef55 pull 2024-03-26T16:45:37.035 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bf9505fb569e9b95a78f9700ed8c4bd20508ef55 pull 2024-03-26T16:45:37.874 INFO:teuthology.orchestra.run.smithi149.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bf9505fb569e9b95a78f9700ed8c4bd20508ef55... 2024-03-26T16:45:37.888 INFO:teuthology.orchestra.run.smithi157.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bf9505fb569e9b95a78f9700ed8c4bd20508ef55... 2024-03-26T16:45:37.906 INFO:teuthology.orchestra.run.smithi064.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bf9505fb569e9b95a78f9700ed8c4bd20508ef55... 2024-03-26T16:45:37.918 INFO:teuthology.orchestra.run.smithi044.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bf9505fb569e9b95a78f9700ed8c4bd20508ef55... 2024-03-26T16:46:59.513 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-03-26T16:46:59.514 INFO:teuthology.orchestra.run.smithi044.stdout: "ceph_version": "ceph version 19.0.0-2382-gbf9505fb (bf9505fb569e9b95a78f9700ed8c4bd20508ef55) squid (dev)", 2024-03-26T16:46:59.514 INFO:teuthology.orchestra.run.smithi044.stdout: "image_id": "5795ddf102746261652aa1cd1f517ace4dcfb8739ebbf229aeb81830d793ada0", 2024-03-26T16:46:59.514 INFO:teuthology.orchestra.run.smithi044.stdout: "repo_digests": [ 2024-03-26T16:46:59.514 INFO:teuthology.orchestra.run.smithi044.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:01ae7457193b3f46a870db683661dbc281d60ce54f0968f4de09bc4e5ad0a734" 2024-03-26T16:46:59.514 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-03-26T16:46:59.514 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-03-26T16:46:59.757 INFO:teuthology.orchestra.run.smithi064.stdout:{ 2024-03-26T16:46:59.757 INFO:teuthology.orchestra.run.smithi064.stdout: "ceph_version": "ceph version 19.0.0-2382-gbf9505fb (bf9505fb569e9b95a78f9700ed8c4bd20508ef55) squid (dev)", 2024-03-26T16:46:59.758 INFO:teuthology.orchestra.run.smithi064.stdout: "image_id": "5795ddf102746261652aa1cd1f517ace4dcfb8739ebbf229aeb81830d793ada0", 2024-03-26T16:46:59.758 INFO:teuthology.orchestra.run.smithi064.stdout: "repo_digests": [ 2024-03-26T16:46:59.758 INFO:teuthology.orchestra.run.smithi064.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:01ae7457193b3f46a870db683661dbc281d60ce54f0968f4de09bc4e5ad0a734" 2024-03-26T16:46:59.758 INFO:teuthology.orchestra.run.smithi064.stdout: ] 2024-03-26T16:46:59.758 INFO:teuthology.orchestra.run.smithi064.stdout:} 2024-03-26T16:47:02.767 INFO:teuthology.orchestra.run.smithi157.stdout:{ 2024-03-26T16:47:02.767 INFO:teuthology.orchestra.run.smithi157.stdout: "ceph_version": "ceph version 19.0.0-2382-gbf9505fb (bf9505fb569e9b95a78f9700ed8c4bd20508ef55) squid (dev)", 2024-03-26T16:47:02.768 INFO:teuthology.orchestra.run.smithi157.stdout: "image_id": "5795ddf102746261652aa1cd1f517ace4dcfb8739ebbf229aeb81830d793ada0", 2024-03-26T16:47:02.768 INFO:teuthology.orchestra.run.smithi157.stdout: "repo_digests": [ 2024-03-26T16:47:02.768 INFO:teuthology.orchestra.run.smithi157.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:01ae7457193b3f46a870db683661dbc281d60ce54f0968f4de09bc4e5ad0a734" 2024-03-26T16:47:02.768 INFO:teuthology.orchestra.run.smithi157.stdout: ] 2024-03-26T16:47:02.768 INFO:teuthology.orchestra.run.smithi157.stdout:} 2024-03-26T16:47:04.188 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-03-26T16:47:04.188 INFO:teuthology.orchestra.run.smithi149.stdout: "ceph_version": "ceph version 19.0.0-2382-gbf9505fb (bf9505fb569e9b95a78f9700ed8c4bd20508ef55) squid (dev)", 2024-03-26T16:47:04.188 INFO:teuthology.orchestra.run.smithi149.stdout: "image_id": "5795ddf102746261652aa1cd1f517ace4dcfb8739ebbf229aeb81830d793ada0", 2024-03-26T16:47:04.188 INFO:teuthology.orchestra.run.smithi149.stdout: "repo_digests": [ 2024-03-26T16:47:04.188 INFO:teuthology.orchestra.run.smithi149.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:01ae7457193b3f46a870db683661dbc281d60ce54f0968f4de09bc4e5ad0a734" 2024-03-26T16:47:04.188 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-03-26T16:47:04.189 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-03-26T16:47:04.215 DEBUG:teuthology.orchestra.run.smithi044:> sudo mkdir -p /etc/ceph 2024-03-26T16:47:04.251 DEBUG:teuthology.orchestra.run.smithi064:> sudo mkdir -p /etc/ceph 2024-03-26T16:47:04.287 DEBUG:teuthology.orchestra.run.smithi149:> sudo mkdir -p /etc/ceph 2024-03-26T16:47:04.317 DEBUG:teuthology.orchestra.run.smithi157:> sudo mkdir -p /etc/ceph 2024-03-26T16:47:04.351 DEBUG:teuthology.orchestra.run.smithi044:> sudo chmod 777 /etc/ceph 2024-03-26T16:47:04.384 DEBUG:teuthology.orchestra.run.smithi064:> sudo chmod 777 /etc/ceph 2024-03-26T16:47:04.416 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod 777 /etc/ceph 2024-03-26T16:47:04.443 DEBUG:teuthology.orchestra.run.smithi157:> sudo chmod 777 /etc/ceph 2024-03-26T16:47:04.475 INFO:tasks.cephadm:Writing seed config... 2024-03-26T16:47:04.476 INFO:tasks.cephadm: override: [global] mon warn on pool no app = False 2024-03-26T16:47:04.477 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-03-26T16:47:04.477 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-03-26T16:47:04.477 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-03-26T16:47:04.477 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-03-26T16:47:04.477 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-03-26T16:47:04.477 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-03-26T16:47:04.477 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-03-26T16:47:04.478 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-03-26T16:47:04.478 DEBUG:teuthology.orchestra.run.smithi044:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-03-26T16:47:04.496 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 4394d798-eb90-11ee-95d0-87774f69a715 mon warn on pool no app = False [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = true bdev debug aio = true osd sloppy crc = true debug ms = 1 debug osd = 20 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true 2024-03-26T16:47:04.496 DEBUG:teuthology.orchestra.run.smithi044:mon.a> sudo journalctl -f -n 0 -u ceph-4394d798-eb90-11ee-95d0-87774f69a715@mon.a.service 2024-03-26T16:47:04.538 DEBUG:teuthology.orchestra.run.smithi044:mgr.x> sudo journalctl -f -n 0 -u ceph-4394d798-eb90-11ee-95d0-87774f69a715@mgr.x.service 2024-03-26T16:47:04.581 INFO:tasks.cephadm:Bootstrapping... 2024-03-26T16:47:04.582 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bf9505fb569e9b95a78f9700ed8c4bd20508ef55 -v bootstrap --fsid 4394d798-eb90-11ee-95d0-87774f69a715 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.44 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-03-26T16:47:04.782 INFO:teuthology.orchestra.run.smithi044.stdout:-------------------------------------------------------------------------------- 2024-03-26T16:47:04.782 INFO:teuthology.orchestra.run.smithi044.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bf9505fb569e9b95a78f9700ed8c4bd20508ef55', '-v', 'bootstrap', '--fsid', '4394d798-eb90-11ee-95d0-87774f69a715', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.44', '--skip-admin-label'] 2024-03-26T16:47:04.782 INFO:teuthology.orchestra.run.smithi044.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-03-26T16:47:04.783 INFO:teuthology.orchestra.run.smithi044.stdout:Verifying podman|docker is present... 2024-03-26T16:47:04.809 INFO:teuthology.orchestra.run.smithi044.stdout:/bin/podman: stdout 4.9.4-dev 2024-03-26T16:47:04.809 INFO:teuthology.orchestra.run.smithi044.stdout:Verifying lvm2 is present... 2024-03-26T16:47:04.809 INFO:teuthology.orchestra.run.smithi044.stdout:Verifying time synchronization is in place... 2024-03-26T16:47:04.816 INFO:teuthology.orchestra.run.smithi044.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-03-26T16:47:04.816 INFO:teuthology.orchestra.run.smithi044.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-03-26T16:47:04.822 INFO:teuthology.orchestra.run.smithi044.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-03-26T16:47:04.822 INFO:teuthology.orchestra.run.smithi044.stdout:systemctl: stdout inactive 2024-03-26T16:47:04.828 INFO:teuthology.orchestra.run.smithi044.stdout:systemctl: stdout enabled 2024-03-26T16:47:04.834 INFO:teuthology.orchestra.run.smithi044.stdout:systemctl: stdout active 2024-03-26T16:47:04.834 INFO:teuthology.orchestra.run.smithi044.stdout:Unit chronyd.service is enabled and running 2024-03-26T16:47:04.835 INFO:teuthology.orchestra.run.smithi044.stdout:Repeating the final host check... 2024-03-26T16:47:04.857 INFO:teuthology.orchestra.run.smithi044.stdout:/bin/podman: stdout 4.9.4-dev 2024-03-26T16:47:04.857 INFO:teuthology.orchestra.run.smithi044.stdout:podman (/bin/podman) version 4.9.4 is present 2024-03-26T16:47:04.858 INFO:teuthology.orchestra.run.smithi044.stdout:systemctl is present 2024-03-26T16:47:04.858 INFO:teuthology.orchestra.run.smithi044.stdout:lvcreate is present 2024-03-26T16:47:04.863 INFO:teuthology.orchestra.run.smithi044.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-03-26T16:47:04.863 INFO:teuthology.orchestra.run.smithi044.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-03-26T16:47:04.869 INFO:teuthology.orchestra.run.smithi044.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-03-26T16:47:04.869 INFO:teuthology.orchestra.run.smithi044.stdout:systemctl: stdout inactive 2024-03-26T16:47:04.875 INFO:teuthology.orchestra.run.smithi044.stdout:systemctl: stdout enabled 2024-03-26T16:47:04.881 INFO:teuthology.orchestra.run.smithi044.stdout:systemctl: stdout active 2024-03-26T16:47:04.881 INFO:teuthology.orchestra.run.smithi044.stdout:Unit chronyd.service is enabled and running 2024-03-26T16:47:04.881 INFO:teuthology.orchestra.run.smithi044.stdout:Host looks OK 2024-03-26T16:47:04.881 INFO:teuthology.orchestra.run.smithi044.stdout:Cluster fsid: 4394d798-eb90-11ee-95d0-87774f69a715 2024-03-26T16:47:04.881 INFO:teuthology.orchestra.run.smithi044.stdout:Acquiring lock 140117643445200 on /run/cephadm/4394d798-eb90-11ee-95d0-87774f69a715.lock 2024-03-26T16:47:04.881 INFO:teuthology.orchestra.run.smithi044.stdout:Lock 140117643445200 acquired on /run/cephadm/4394d798-eb90-11ee-95d0-87774f69a715.lock 2024-03-26T16:47:04.882 INFO:teuthology.orchestra.run.smithi044.stdout:Verifying IP 172.21.15.44 port 3300 ... 2024-03-26T16:47:04.882 INFO:teuthology.orchestra.run.smithi044.stdout:Verifying IP 172.21.15.44 port 6789 ... 2024-03-26T16:47:04.882 INFO:teuthology.orchestra.run.smithi044.stdout:Base mon IP(s) is [172.21.15.44:3300, 172.21.15.44:6789], mon addrv is [v2:172.21.15.44:3300,v1:172.21.15.44:6789] 2024-03-26T16:47:04.885 INFO:teuthology.orchestra.run.smithi044.stdout:/sbin/ip: stdout default via 172.21.15.254 dev ens1f0 proto dhcp src 172.21.15.44 metric 100 2024-03-26T16:47:04.885 INFO:teuthology.orchestra.run.smithi044.stdout:/sbin/ip: stdout 172.21.0.0/20 dev ens1f0 proto kernel scope link src 172.21.15.44 metric 100 2024-03-26T16:47:04.888 INFO:teuthology.orchestra.run.smithi044.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-03-26T16:47:04.888 INFO:teuthology.orchestra.run.smithi044.stdout:/sbin/ip: stdout fe80::/64 dev ens1f0 proto kernel metric 1024 pref medium 2024-03-26T16:47:04.888 INFO:teuthology.orchestra.run.smithi044.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev ens1f0 proto ra metric 100 pref medium 2024-03-26T16:47:04.890 INFO:teuthology.orchestra.run.smithi044.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-03-26T16:47:04.890 INFO:teuthology.orchestra.run.smithi044.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-03-26T16:47:04.891 INFO:teuthology.orchestra.run.smithi044.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-03-26T16:47:04.891 INFO:teuthology.orchestra.run.smithi044.stdout:/sbin/ip: stdout 4: ens1f0: mtu 1500 state UP qlen 1000 2024-03-26T16:47:04.891 INFO:teuthology.orchestra.run.smithi044.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:febd:1572/64 scope link noprefixroute 2024-03-26T16:47:04.891 INFO:teuthology.orchestra.run.smithi044.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-03-26T16:47:04.891 INFO:teuthology.orchestra.run.smithi044.stdout:Mon IP `172.21.15.44` is in CIDR network `172.21.0.0/20` 2024-03-26T16:47:04.892 INFO:teuthology.orchestra.run.smithi044.stdout:Mon IP `172.21.15.44` is in CIDR network `172.21.0.0/20` 2024-03-26T16:47:04.892 INFO:teuthology.orchestra.run.smithi044.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-03-26T16:47:04.892 INFO:teuthology.orchestra.run.smithi044.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-03-26T16:47:04.892 INFO:teuthology.orchestra.run.smithi044.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bf9505fb569e9b95a78f9700ed8c4bd20508ef55... 2024-03-26T16:47:05.364 INFO:teuthology.orchestra.run.smithi044.stdout:/bin/podman: stdout 5795ddf102746261652aa1cd1f517ace4dcfb8739ebbf229aeb81830d793ada0 2024-03-26T16:47:05.364 INFO:teuthology.orchestra.run.smithi044.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bf9505fb569e9b95a78f9700ed8c4bd20508ef55... 2024-03-26T16:47:05.364 INFO:teuthology.orchestra.run.smithi044.stdout:/bin/podman: stderr Getting image source signatures 2024-03-26T16:47:05.364 INFO:teuthology.orchestra.run.smithi044.stdout:/bin/podman: stderr Copying blob sha256:c22aac03dcc25693e730e9e65ba1ce359580d7b3de72b2abd24312500f74bba1 2024-03-26T16:47:05.364 INFO:teuthology.orchestra.run.smithi044.stdout:/bin/podman: stderr Copying blob sha256:9516588f908cdb14b5e4062a6063db2d9291b355c3f32e2a99864608a4a7b649 2024-03-26T16:47:05.364 INFO:teuthology.orchestra.run.smithi044.stdout:/bin/podman: stderr Copying config sha256:5795ddf102746261652aa1cd1f517ace4dcfb8739ebbf229aeb81830d793ada0 2024-03-26T16:47:05.364 INFO:teuthology.orchestra.run.smithi044.stdout:/bin/podman: stderr Writing manifest to image destination 2024-03-26T16:47:06.261 INFO:teuthology.orchestra.run.smithi044.stdout:ceph: stdout ceph version 19.0.0-2382-gbf9505fb (bf9505fb569e9b95a78f9700ed8c4bd20508ef55) squid (dev) 2024-03-26T16:47:06.261 INFO:teuthology.orchestra.run.smithi044.stdout:Ceph version: ceph version 19.0.0-2382-gbf9505fb (bf9505fb569e9b95a78f9700ed8c4bd20508ef55) squid (dev) 2024-03-26T16:47:06.261 INFO:teuthology.orchestra.run.smithi044.stdout:Extracting ceph user uid/gid from container image... 2024-03-26T16:47:07.233 INFO:teuthology.orchestra.run.smithi044.stdout:stat: stdout 167 167 2024-03-26T16:47:07.234 INFO:teuthology.orchestra.run.smithi044.stdout:Creating initial keys... 2024-03-26T16:47:08.098 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-authtool: stdout AQAL/AJmg5NDIBAAiQFsR1s0Klws8H4eQ8wO+g== 2024-03-26T16:47:08.895 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-authtool: stdout AQAM/AJm1cGvFxAAObp/WoxhwHggXWYg29UtvA== 2024-03-26T16:47:12.801 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-authtool: stdout AQAN/AJm/AAXDhAAJc6oeDZ/5qX3gguNAioW6w== 2024-03-26T16:47:12.801 INFO:teuthology.orchestra.run.smithi044.stdout:Creating initial monmap... 2024-03-26T16:47:19.108 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-03-26T16:47:19.108 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-03-26T16:47:19.108 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 4394d798-eb90-11ee-95d0-87774f69a715 2024-03-26T16:47:19.108 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-03-26T16:47:19.109 INFO:teuthology.orchestra.run.smithi044.stdout:monmaptool for a [v2:172.21.15.44:3300,v1:172.21.15.44:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-03-26T16:47:19.109 INFO:teuthology.orchestra.run.smithi044.stdout:setting min_mon_release = quincy 2024-03-26T16:47:19.109 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/monmaptool: set fsid to 4394d798-eb90-11ee-95d0-87774f69a715 2024-03-26T16:47:19.109 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-03-26T16:47:19.109 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-26T16:47:19.109 INFO:teuthology.orchestra.run.smithi044.stdout:Creating mon... 2024-03-26T16:47:20.463 INFO:teuthology.orchestra.run.smithi044.stdout:create mon.a on 2024-03-26T16:47:20.665 INFO:teuthology.orchestra.run.smithi044.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-03-26T16:47:20.804 INFO:teuthology.orchestra.run.smithi044.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-03-26T16:47:20.975 INFO:teuthology.orchestra.run.smithi044.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-4394d798-eb90-11ee-95d0-87774f69a715.target → /etc/systemd/system/ceph-4394d798-eb90-11ee-95d0-87774f69a715.target. 2024-03-26T16:47:20.975 INFO:teuthology.orchestra.run.smithi044.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-4394d798-eb90-11ee-95d0-87774f69a715.target → /etc/systemd/system/ceph-4394d798-eb90-11ee-95d0-87774f69a715.target. 2024-03-26T16:47:21.217 INFO:teuthology.orchestra.run.smithi044.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-4394d798-eb90-11ee-95d0-87774f69a715@mon.a 2024-03-26T16:47:21.217 INFO:teuthology.orchestra.run.smithi044.stdout:systemctl: stderr Failed to reset failed state of unit ceph-4394d798-eb90-11ee-95d0-87774f69a715@mon.a.service: Unit ceph-4394d798-eb90-11ee-95d0-87774f69a715@mon.a.service not loaded. 2024-03-26T16:47:21.384 INFO:teuthology.orchestra.run.smithi044.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-4394d798-eb90-11ee-95d0-87774f69a715.target.wants/ceph-4394d798-eb90-11ee-95d0-87774f69a715@mon.a.service → /etc/systemd/system/ceph-4394d798-eb90-11ee-95d0-87774f69a715@.service. 2024-03-26T16:47:21.888 INFO:teuthology.orchestra.run.smithi044.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-03-26T16:47:21.888 INFO:teuthology.orchestra.run.smithi044.stdout:systemctl: stdout disabled 2024-03-26T16:47:21.894 INFO:teuthology.orchestra.run.smithi044.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-03-26T16:47:21.894 INFO:teuthology.orchestra.run.smithi044.stdout:systemctl: stdout inactive 2024-03-26T16:47:21.895 INFO:teuthology.orchestra.run.smithi044.stdout:firewalld.service is not enabled 2024-03-26T16:47:21.895 INFO:teuthology.orchestra.run.smithi044.stdout:Not possible to enable service . firewalld.service is not available 2024-03-26T16:47:21.895 INFO:teuthology.orchestra.run.smithi044.stdout:Waiting for mon to start... 2024-03-26T16:47:21.895 INFO:teuthology.orchestra.run.smithi044.stdout:Waiting for mon... 2024-03-26T16:47:22.973 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:22 smithi044 ceph-mon[30251]: from='client.? 172.21.15.44:0/2251099361' entity='client.admin' cmd={"prefix": "status"} : dispatch 2024-03-26T16:47:22.975 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout cluster: 2024-03-26T16:47:22.977 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout id: 4394d798-eb90-11ee-95d0-87774f69a715 2024-03-26T16:47:22.977 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-03-26T16:47:22.977 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout 2024-03-26T16:47:22.977 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout services: 2024-03-26T16:47:22.977 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.523228s) 2024-03-26T16:47:22.977 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-03-26T16:47:22.977 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-03-26T16:47:22.977 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout 2024-03-26T16:47:22.977 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout data: 2024-03-26T16:47:22.977 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-03-26T16:47:22.977 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-03-26T16:47:22.977 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-03-26T16:47:22.977 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout pgs: 2024-03-26T16:47:22.978 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout 2024-03-26T16:47:22.978 INFO:teuthology.orchestra.run.smithi044.stdout:mon is available 2024-03-26T16:47:22.978 INFO:teuthology.orchestra.run.smithi044.stdout:Assimilating anything we can from ceph.conf... 2024-03-26T16:47:24.016 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:23 smithi044 ceph-mon[30251]: from='client.? 172.21.15.44:0/357213730' entity='client.admin' cmd={"prefix": "config assimilate-conf"} : dispatch 2024-03-26T16:47:24.017 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:23 smithi044 ceph-mon[30251]: from='client.? 172.21.15.44:0/357213730' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-03-26T16:47:25.951 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout 2024-03-26T16:47:25.951 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout [global] 2024-03-26T16:47:25.951 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout fsid = 4394d798-eb90-11ee-95d0-87774f69a715 2024-03-26T16:47:25.951 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.44:3300,v1:172.21.15.44:6789] 2024-03-26T16:47:25.951 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-03-26T16:47:25.951 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-03-26T16:47:25.951 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-03-26T16:47:25.951 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-03-26T16:47:25.951 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout 2024-03-26T16:47:25.951 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout [mgr] 2024-03-26T16:47:25.951 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-03-26T16:47:25.951 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout 2024-03-26T16:47:25.951 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout [osd] 2024-03-26T16:47:25.952 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-03-26T16:47:25.952 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-03-26T16:47:25.952 INFO:teuthology.orchestra.run.smithi044.stdout:Generating new minimal ceph.conf... 2024-03-26T16:47:26.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:26 smithi044 ceph-mon[30251]: from='client.? 172.21.15.44:0/2048404779' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T16:47:26.955 INFO:teuthology.orchestra.run.smithi044.stdout:Restarting the monitor... 2024-03-26T16:47:27.215 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:26 smithi044 systemd[1]: Stopping Ceph mon.a for 4394d798-eb90-11ee-95d0-87774f69a715... 2024-03-26T16:47:27.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30247]: 2024-03-26T16:47:27.211+0000 7f13fd055700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-03-26T16:47:27.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30247]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2382-gbf9505fb/rpm/el8/BUILD/ceph-19.0.0-2382-gbf9505fb/src/common/config_obs_mgr.h: In function 'ObserverMgr::config_obs_wptr ObserverMgr::remove_observer(ConfigObs*) [with ConfigObs = ceph::md_config_obs_impl; ObserverMgr::config_obs_wptr = std::weak_ptr*>]' thread 7f13fd055700 time 2024-03-26T16:47:27.213122+0000 2024-03-26T16:47:27.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30247]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2382-gbf9505fb/rpm/el8/BUILD/ceph-19.0.0-2382-gbf9505fb/src/common/config_obs_mgr.h: 84: FAILED ceph_assert(found_obs) 2024-03-26T16:47:27.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30247]: 2024-03-26T16:47:27.211+0000 7f13fd055700 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-03-26T16:47:27.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30247]: ceph version 19.0.0-2382-gbf9505fb (bf9505fb569e9b95a78f9700ed8c4bd20508ef55) squid (dev) 2024-03-26T16:47:27.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30247]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f14054b63cd] 2024-03-26T16:47:27.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30247]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2db593) [0x7f14054b6593] 2024-03-26T16:47:27.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30247]: 3: (ObserverMgr >::remove_observer(ceph::md_config_obs_impl*)+0x196) [0x55f067da9166] 2024-03-26T16:47:27.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30247]: 4: (NVMeofGwMon::on_shutdown()+0x72) [0x55f067e91742] 2024-03-26T16:47:27.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30247]: 5: (Monitor::shutdown()+0x2bc) [0x55f067d7955c] 2024-03-26T16:47:27.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30247]: 6: (SignalHandler::entry()+0x659) [0x55f06805e869] 2024-03-26T16:47:27.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30247]: 7: /lib64/libpthread.so.0(+0x81ca) [0x7f1402c9b1ca] 2024-03-26T16:47:27.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30247]: 8: clone() 2024-03-26T16:47:27.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30247]: 2024-03-26T16:47:27.212+0000 7f13fd055700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2382-gbf9505fb/rpm/el8/BUILD/ceph-19.0.0-2382-gbf9505fb/src/common/config_obs_mgr.h: In function 'ObserverMgr::config_obs_wptr ObserverMgr::remove_observer(ConfigObs*) [with ConfigObs = ceph::md_config_obs_impl; ObserverMgr::config_obs_wptr = std::weak_ptr*>]' thread 7f13fd055700 time 2024-03-26T16:47:27.213122+0000 2024-03-26T16:47:27.517 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30247]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2382-gbf9505fb/rpm/el8/BUILD/ceph-19.0.0-2382-gbf9505fb/src/common/config_obs_mgr.h: 84: FAILED ceph_assert(found_obs) 2024-03-26T16:47:27.517 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30247]: 2024-03-26T16:47:27.517 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30247]: ceph version 19.0.0-2382-gbf9505fb (bf9505fb569e9b95a78f9700ed8c4bd20508ef55) squid (dev) 2024-03-26T16:47:27.517 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30247]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f14054b63cd] 2024-03-26T16:47:27.517 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30247]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2db593) [0x7f14054b6593] 2024-03-26T16:47:27.518 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30247]: 3: (ObserverMgr >::remove_observer(ceph::md_config_obs_impl*)+0x196) [0x55f067da9166] 2024-03-26T16:47:27.518 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30247]: 4: (NVMeofGwMon::on_shutdown()+0x72) [0x55f067e91742] 2024-03-26T16:47:27.518 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30247]: 5: (Monitor::shutdown()+0x2bc) [0x55f067d7955c] 2024-03-26T16:47:27.518 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30247]: 6: (SignalHandler::entry()+0x659) [0x55f06805e869] 2024-03-26T16:47:27.518 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30247]: 7: /lib64/libpthread.so.0(+0x81ca) [0x7f1402c9b1ca] 2024-03-26T16:47:27.518 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30247]: 8: clone() 2024-03-26T16:47:27.518 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30247]: 2024-03-26T16:47:27.518 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30247]: *** Caught signal (Aborted) ** 2024-03-26T16:47:27.518 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30247]: in thread 7f13fd055700 thread_name:signal_handler 2024-03-26T16:47:27.518 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30247]: ceph version 19.0.0-2382-gbf9505fb (bf9505fb569e9b95a78f9700ed8c4bd20508ef55) squid (dev) 2024-03-26T16:47:27.518 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30247]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f1402ca5d20] 2024-03-26T16:47:27.518 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30247]: 2: gsignal() 2024-03-26T16:47:27.518 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30247]: 3: abort() 2024-03-26T16:47:27.519 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30247]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f14054b6427] 2024-03-26T16:47:27.519 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30247]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2db593) [0x7f14054b6593] 2024-03-26T16:47:27.519 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30247]: 6: (ObserverMgr >::remove_observer(ceph::md_config_obs_impl*)+0x196) [0x55f067da9166] 2024-03-26T16:47:27.519 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30247]: 7: (NVMeofGwMon::on_shutdown()+0x72) [0x55f067e91742] 2024-03-26T16:47:27.519 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30247]: 8: (Monitor::shutdown()+0x2bc) [0x55f067d7955c] 2024-03-26T16:47:27.519 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30247]: 9: (SignalHandler::entry()+0x659) [0x55f06805e869] 2024-03-26T16:47:27.519 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30247]: 10: /lib64/libpthread.so.0(+0x81ca) [0x7f1402c9b1ca] 2024-03-26T16:47:27.519 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30247]: 11: clone() 2024-03-26T16:47:27.519 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30247]: 2024-03-26T16:47:27.214+0000 7f13fd055700 -1 *** Caught signal (Aborted) ** 2024-03-26T16:47:27.519 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30247]: in thread 7f13fd055700 thread_name:signal_handler 2024-03-26T16:47:27.519 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30247]: 2024-03-26T16:47:27.519 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30247]: ceph version 19.0.0-2382-gbf9505fb (bf9505fb569e9b95a78f9700ed8c4bd20508ef55) squid (dev) 2024-03-26T16:47:27.519 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30247]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f1402ca5d20] 2024-03-26T16:47:27.520 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30247]: 2: gsignal() 2024-03-26T16:47:27.520 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30247]: 3: abort() 2024-03-26T16:47:27.520 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30247]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f14054b6427] 2024-03-26T16:47:27.520 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30247]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2db593) [0x7f14054b6593] 2024-03-26T16:47:27.520 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30247]: 6: (ObserverMgr >::remove_observer(ceph::md_config_obs_impl*)+0x196) [0x55f067da9166] 2024-03-26T16:47:27.520 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30247]: 7: (NVMeofGwMon::on_shutdown()+0x72) [0x55f067e91742] 2024-03-26T16:47:27.520 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30247]: 8: (Monitor::shutdown()+0x2bc) [0x55f067d7955c] 2024-03-26T16:47:27.520 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30247]: 9: (SignalHandler::entry()+0x659) [0x55f06805e869] 2024-03-26T16:47:27.520 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30247]: 10: /lib64/libpthread.so.0(+0x81ca) [0x7f1402c9b1ca] 2024-03-26T16:47:27.520 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30247]: 11: clone() 2024-03-26T16:47:27.520 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30247]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-26T16:47:27.520 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30247]: 2024-03-26T16:47:27.520 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30247]: -23> 2024-03-26T16:47:27.211+0000 7f13fd055700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-03-26T16:47:27.521 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30247]: -22> 2024-03-26T16:47:27.211+0000 7f13fd055700 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-03-26T16:47:27.521 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30247]: -1> 2024-03-26T16:47:27.212+0000 7f13fd055700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2382-gbf9505fb/rpm/el8/BUILD/ceph-19.0.0-2382-gbf9505fb/src/common/config_obs_mgr.h: In function 'ObserverMgr::config_obs_wptr ObserverMgr::remove_observer(ConfigObs*) [with ConfigObs = ceph::md_config_obs_impl; ObserverMgr::config_obs_wptr = std::weak_ptr*>]' thread 7f13fd055700 time 2024-03-26T16:47:27.213122+0000 2024-03-26T16:47:27.521 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30247]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2382-gbf9505fb/rpm/el8/BUILD/ceph-19.0.0-2382-gbf9505fb/src/common/config_obs_mgr.h: 84: FAILED ceph_assert(found_obs) 2024-03-26T16:47:27.521 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30247]: 2024-03-26T16:47:27.521 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30247]: ceph version 19.0.0-2382-gbf9505fb (bf9505fb569e9b95a78f9700ed8c4bd20508ef55) squid (dev) 2024-03-26T16:47:27.521 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30247]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f14054b63cd] 2024-03-26T16:47:27.521 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30247]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2db593) [0x7f14054b6593] 2024-03-26T16:47:27.521 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30247]: 3: (ObserverMgr >::remove_observer(ceph::md_config_obs_impl*)+0x196) [0x55f067da9166] 2024-03-26T16:47:27.521 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30247]: 4: (NVMeofGwMon::on_shutdown()+0x72) [0x55f067e91742] 2024-03-26T16:47:27.521 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30247]: 5: (Monitor::shutdown()+0x2bc) [0x55f067d7955c] 2024-03-26T16:47:27.521 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30247]: 6: (SignalHandler::entry()+0x659) [0x55f06805e869] 2024-03-26T16:47:27.521 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30247]: 7: /lib64/libpthread.so.0(+0x81ca) [0x7f1402c9b1ca] 2024-03-26T16:47:27.521 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30247]: 8: clone() 2024-03-26T16:47:27.521 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30247]: 2024-03-26T16:47:27.522 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30247]: 0> 2024-03-26T16:47:27.214+0000 7f13fd055700 -1 *** Caught signal (Aborted) ** 2024-03-26T16:47:27.522 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30247]: in thread 7f13fd055700 thread_name:signal_handler 2024-03-26T16:47:27.522 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30247]: 2024-03-26T16:47:27.522 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30247]: ceph version 19.0.0-2382-gbf9505fb (bf9505fb569e9b95a78f9700ed8c4bd20508ef55) squid (dev) 2024-03-26T16:47:27.522 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30247]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f1402ca5d20] 2024-03-26T16:47:27.522 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30247]: 2: gsignal() 2024-03-26T16:47:27.522 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30247]: 3: abort() 2024-03-26T16:47:27.522 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30247]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f14054b6427] 2024-03-26T16:47:27.522 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30247]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2db593) [0x7f14054b6593] 2024-03-26T16:47:27.522 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30247]: 6: (ObserverMgr >::remove_observer(ceph::md_config_obs_impl*)+0x196) [0x55f067da9166] 2024-03-26T16:47:27.522 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30247]: 7: (NVMeofGwMon::on_shutdown()+0x72) [0x55f067e91742] 2024-03-26T16:47:27.522 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30247]: 8: (Monitor::shutdown()+0x2bc) [0x55f067d7955c] 2024-03-26T16:47:27.522 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30247]: 9: (SignalHandler::entry()+0x659) [0x55f06805e869] 2024-03-26T16:47:27.522 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30247]: 10: /lib64/libpthread.so.0(+0x81ca) [0x7f1402c9b1ca] 2024-03-26T16:47:27.523 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30247]: 11: clone() 2024-03-26T16:47:27.523 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30247]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-26T16:47:27.523 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30247]: 2024-03-26T16:47:27.523 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30247]: -23> 2024-03-26T16:47:27.211+0000 7f13fd055700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-03-26T16:47:27.523 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30247]: -22> 2024-03-26T16:47:27.211+0000 7f13fd055700 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-03-26T16:47:27.523 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30247]: -1> 2024-03-26T16:47:27.212+0000 7f13fd055700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2382-gbf9505fb/rpm/el8/BUILD/ceph-19.0.0-2382-gbf9505fb/src/common/config_obs_mgr.h: In function 'ObserverMgr::config_obs_wptr ObserverMgr::remove_observer(ConfigObs*) [with ConfigObs = ceph::md_config_obs_impl; ObserverMgr::config_obs_wptr = std::weak_ptr*>]' thread 7f13fd055700 time 2024-03-26T16:47:27.213122+0000 2024-03-26T16:47:27.523 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30247]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2382-gbf9505fb/rpm/el8/BUILD/ceph-19.0.0-2382-gbf9505fb/src/common/config_obs_mgr.h: 84: FAILED ceph_assert(found_obs) 2024-03-26T16:47:27.523 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30247]: 2024-03-26T16:47:27.523 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30247]: ceph version 19.0.0-2382-gbf9505fb (bf9505fb569e9b95a78f9700ed8c4bd20508ef55) squid (dev) 2024-03-26T16:47:27.523 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30247]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7f14054b63cd] 2024-03-26T16:47:27.523 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30247]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2db593) [0x7f14054b6593] 2024-03-26T16:47:27.523 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30247]: 3: (ObserverMgr >::remove_observer(ceph::md_config_obs_impl*)+0x196) [0x55f067da9166] 2024-03-26T16:47:27.523 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30247]: 4: (NVMeofGwMon::on_shutdown()+0x72) [0x55f067e91742] 2024-03-26T16:47:27.523 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30247]: 5: (Monitor::shutdown()+0x2bc) [0x55f067d7955c] 2024-03-26T16:47:27.524 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30247]: 6: (SignalHandler::entry()+0x659) [0x55f06805e869] 2024-03-26T16:47:27.524 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30247]: 7: /lib64/libpthread.so.0(+0x81ca) [0x7f1402c9b1ca] 2024-03-26T16:47:27.524 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30247]: 8: clone() 2024-03-26T16:47:27.524 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30247]: 2024-03-26T16:47:27.524 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30247]: 0> 2024-03-26T16:47:27.214+0000 7f13fd055700 -1 *** Caught signal (Aborted) ** 2024-03-26T16:47:27.524 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30247]: in thread 7f13fd055700 thread_name:signal_handler 2024-03-26T16:47:27.524 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30247]: 2024-03-26T16:47:27.524 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30247]: ceph version 19.0.0-2382-gbf9505fb (bf9505fb569e9b95a78f9700ed8c4bd20508ef55) squid (dev) 2024-03-26T16:47:27.524 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30247]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f1402ca5d20] 2024-03-26T16:47:27.524 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30247]: 2: gsignal() 2024-03-26T16:47:27.524 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30247]: 3: abort() 2024-03-26T16:47:27.524 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30247]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f14054b6427] 2024-03-26T16:47:27.524 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30247]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2db593) [0x7f14054b6593] 2024-03-26T16:47:27.524 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30247]: 6: (ObserverMgr >::remove_observer(ceph::md_config_obs_impl*)+0x196) [0x55f067da9166] 2024-03-26T16:47:27.524 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30247]: 7: (NVMeofGwMon::on_shutdown()+0x72) [0x55f067e91742] 2024-03-26T16:47:27.525 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30247]: 8: (Monitor::shutdown()+0x2bc) [0x55f067d7955c] 2024-03-26T16:47:27.525 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30247]: 9: (SignalHandler::entry()+0x659) [0x55f06805e869] 2024-03-26T16:47:27.525 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30247]: 10: /lib64/libpthread.so.0(+0x81ca) [0x7f1402c9b1ca] 2024-03-26T16:47:27.525 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30247]: 11: clone() 2024-03-26T16:47:27.525 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30247]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-26T16:47:27.525 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30247]: 2024-03-26T16:47:27.525 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:27 smithi044 podman[30501]: 2024-03-26 16:47:27.232821667 +0000 UTC m=+0.113705749 container died 6fb089de73121b43f820df6f7ce29312ce5d8993b0d725d6fac0e27e7908b08a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bf9505fb569e9b95a78f9700ed8c4bd20508ef55, name=ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240319, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, RELEASE=ceph-nvmeof-mon-bf9505f, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-03-26T16:47:27.766 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:27 smithi044 podman[30501]: 2024-03-26 16:47:27.612595577 +0000 UTC m=+0.493479670 container cleanup 6fb089de73121b43f820df6f7ce29312ce5d8993b0d725d6fac0e27e7908b08a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bf9505fb569e9b95a78f9700ed8c4bd20508ef55, name=ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a, maintainer=Guillaume Abrioux , RELEASE=ceph-nvmeof-mon-bf9505f, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240319, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.33.5) 2024-03-26T16:47:27.767 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:27 smithi044 bash[30501]: ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a 2024-03-26T16:47:28.242 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:27 smithi044 podman[30515]: 2024-03-26 16:47:27.872518413 +0000 UTC m=+0.635079047 container remove 6fb089de73121b43f820df6f7ce29312ce5d8993b0d725d6fac0e27e7908b08a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bf9505fb569e9b95a78f9700ed8c4bd20508ef55, name=ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a, org.label-schema.schema-version=1.0, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240319, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, RELEASE=ceph-nvmeof-mon-bf9505f, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-03-26T16:47:28.242 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:27 smithi044 systemd[1]: ceph-4394d798-eb90-11ee-95d0-87774f69a715@mon.a.service: Main process exited, code=exited, status=134/n/a 2024-03-26T16:47:28.242 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 systemd[1]: ceph-4394d798-eb90-11ee-95d0-87774f69a715@mon.a.service: Failed with result 'exit-code'. 2024-03-26T16:47:28.242 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 systemd[1]: Stopped Ceph mon.a for 4394d798-eb90-11ee-95d0-87774f69a715. 2024-03-26T16:47:28.242 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 systemd[1]: Starting Ceph mon.a for 4394d798-eb90-11ee-95d0-87774f69a715... 2024-03-26T16:47:28.494 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 podman[30605]: 2024-03-26 16:47:28.240024642 +0000 UTC m=+0.109068373 container create c1736fb672320b87ad4069e87f56b069d808cc11e111230b4e8ce7e9fbdd898d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bf9505fb569e9b95a78f9700ed8c4bd20508ef55, name=ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, RELEASE=ceph-nvmeof-mon-bf9505f, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240319) 2024-03-26T16:47:28.494 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 podman[30605]: 2024-03-26 16:47:28.14868648 +0000 UTC m=+0.017730182 image pull 5795ddf102746261652aa1cd1f517ace4dcfb8739ebbf229aeb81830d793ada0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bf9505fb569e9b95a78f9700ed8c4bd20508ef55 2024-03-26T16:47:28.495 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 podman[30605]: 2024-03-26 16:47:28.417245205 +0000 UTC m=+0.286288895 container init c1736fb672320b87ad4069e87f56b069d808cc11e111230b4e8ce7e9fbdd898d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bf9505fb569e9b95a78f9700ed8c4bd20508ef55, name=ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240319, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, RELEASE=ceph-nvmeof-mon-bf9505f) 2024-03-26T16:47:28.495 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 podman[30605]: 2024-03-26 16:47:28.420012326 +0000 UTC m=+0.289056016 container start c1736fb672320b87ad4069e87f56b069d808cc11e111230b4e8ce7e9fbdd898d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bf9505fb569e9b95a78f9700ed8c4bd20508ef55, name=ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=ceph-nvmeof-mon-bf9505f, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240319) 2024-03-26T16:47:28.495 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: set uid:gid to 167:167 (ceph:ceph) 2024-03-26T16:47:28.495 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: ceph version 19.0.0-2382-gbf9505fb (bf9505fb569e9b95a78f9700ed8c4bd20508ef55) squid (dev), process ceph-mon, pid 2 2024-03-26T16:47:28.495 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: pidfile_write: ignore empty --pid-file 2024-03-26T16:47:28.495 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: load: jerasure load: lrc 2024-03-26T16:47:28.495 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: RocksDB version: 7.9.2 2024-03-26T16:47:28.495 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: Git sha 0 2024-03-26T16:47:28.495 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: Compile date 2024-03-24 17:12:44 2024-03-26T16:47:28.495 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: DB SUMMARY 2024-03-26T16:47:28.495 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: DB Session ID: UCDFA6DBLH4HX48CIUMF 2024-03-26T16:47:28.495 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: CURRENT file: CURRENT 2024-03-26T16:47:28.495 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: IDENTITY file: IDENTITY 2024-03-26T16:47:28.495 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-03-26T16:47:28.496 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-03-26T16:47:28.496 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 89328 ; 2024-03-26T16:47:28.496 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: Options.error_if_exists: 0 2024-03-26T16:47:28.496 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: Options.create_if_missing: 0 2024-03-26T16:47:28.496 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: Options.paranoid_checks: 1 2024-03-26T16:47:28.497 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: Options.flush_verify_memtable_count: 1 2024-03-26T16:47:28.497 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-03-26T16:47:28.497 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-03-26T16:47:28.497 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: Options.env: 0x55c4e09c4060 2024-03-26T16:47:28.497 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: Options.fs: PosixFileSystem 2024-03-26T16:47:28.497 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: Options.info_log: 0x55c4e1f77b20 2024-03-26T16:47:28.497 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: Options.max_file_opening_threads: 16 2024-03-26T16:47:28.497 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: Options.statistics: (nil) 2024-03-26T16:47:28.497 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: Options.use_fsync: 0 2024-03-26T16:47:28.497 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: Options.max_log_file_size: 0 2024-03-26T16:47:28.497 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-03-26T16:47:28.497 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: Options.log_file_time_to_roll: 0 2024-03-26T16:47:28.497 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: Options.keep_log_file_num: 1000 2024-03-26T16:47:28.497 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: Options.recycle_log_file_num: 0 2024-03-26T16:47:28.498 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: Options.allow_fallocate: 1 2024-03-26T16:47:28.498 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: Options.allow_mmap_reads: 0 2024-03-26T16:47:28.498 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: Options.allow_mmap_writes: 0 2024-03-26T16:47:28.498 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: Options.use_direct_reads: 0 2024-03-26T16:47:28.498 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-03-26T16:47:28.498 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: Options.create_missing_column_families: 0 2024-03-26T16:47:28.498 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: Options.db_log_dir: 2024-03-26T16:47:28.498 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: Options.wal_dir: 2024-03-26T16:47:28.498 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: Options.table_cache_numshardbits: 6 2024-03-26T16:47:28.498 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: Options.WAL_ttl_seconds: 0 2024-03-26T16:47:28.498 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: Options.WAL_size_limit_MB: 0 2024-03-26T16:47:28.498 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-03-26T16:47:28.498 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-03-26T16:47:28.499 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: Options.is_fd_close_on_exec: 1 2024-03-26T16:47:28.499 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: Options.advise_random_on_open: 1 2024-03-26T16:47:28.499 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: Options.db_write_buffer_size: 0 2024-03-26T16:47:28.499 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: Options.write_buffer_manager: 0x55c4e1f481e0 2024-03-26T16:47:28.499 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-03-26T16:47:28.499 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-03-26T16:47:28.499 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: Options.use_adaptive_mutex: 0 2024-03-26T16:47:28.499 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: Options.rate_limiter: (nil) 2024-03-26T16:47:28.499 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-03-26T16:47:28.499 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: Options.wal_recovery_mode: 2 2024-03-26T16:47:28.499 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: Options.enable_thread_tracking: 0 2024-03-26T16:47:28.499 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: Options.enable_pipelined_write: 0 2024-03-26T16:47:28.499 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: Options.unordered_write: 0 2024-03-26T16:47:28.499 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-03-26T16:47:28.500 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-03-26T16:47:28.500 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-03-26T16:47:28.500 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-03-26T16:47:28.500 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: Options.row_cache: None 2024-03-26T16:47:28.500 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: Options.wal_filter: None 2024-03-26T16:47:28.500 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-03-26T16:47:28.500 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: Options.allow_ingest_behind: 0 2024-03-26T16:47:28.500 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: Options.two_write_queues: 0 2024-03-26T16:47:28.500 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: Options.manual_wal_flush: 0 2024-03-26T16:47:28.500 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: Options.wal_compression: 0 2024-03-26T16:47:28.500 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: Options.atomic_flush: 0 2024-03-26T16:47:28.500 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-03-26T16:47:28.500 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: Options.persist_stats_to_disk: 0 2024-03-26T16:47:28.500 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: Options.write_dbid_to_manifest: 0 2024-03-26T16:47:28.501 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: Options.log_readahead_size: 0 2024-03-26T16:47:28.501 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-03-26T16:47:28.501 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: Options.best_efforts_recovery: 0 2024-03-26T16:47:28.501 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-03-26T16:47:28.501 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-03-26T16:47:28.501 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: Options.allow_data_in_errors: 0 2024-03-26T16:47:28.501 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: Options.db_host_id: __hostname__ 2024-03-26T16:47:28.501 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: Options.enforce_single_del_contracts: true 2024-03-26T16:47:28.501 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: Options.max_background_jobs: 2 2024-03-26T16:47:28.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: Options.max_background_compactions: -1 2024-03-26T16:47:28.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: Options.max_subcompactions: 1 2024-03-26T16:47:28.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-03-26T16:47:28.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-03-26T16:47:28.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: Options.delayed_write_rate : 16777216 2024-03-26T16:47:28.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: Options.max_total_wal_size: 0 2024-03-26T16:47:28.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-03-26T16:47:28.503 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: Options.stats_dump_period_sec: 600 2024-03-26T16:47:28.503 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: Options.stats_persist_period_sec: 600 2024-03-26T16:47:28.503 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-03-26T16:47:28.503 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: Options.max_open_files: -1 2024-03-26T16:47:28.503 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: Options.bytes_per_sync: 0 2024-03-26T16:47:28.503 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: Options.wal_bytes_per_sync: 0 2024-03-26T16:47:28.503 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: Options.strict_bytes_per_sync: 0 2024-03-26T16:47:28.503 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: Options.compaction_readahead_size: 0 2024-03-26T16:47:28.503 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: Options.max_background_flushes: -1 2024-03-26T16:47:28.503 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: Compression algorithms supported: 2024-03-26T16:47:28.503 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-03-26T16:47:28.503 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: kZSTD supported: 0 2024-03-26T16:47:28.503 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: kXpressCompression supported: 0 2024-03-26T16:47:28.504 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: kLZ4HCCompression supported: 1 2024-03-26T16:47:28.504 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: kZlibCompression supported: 1 2024-03-26T16:47:28.504 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: kSnappyCompression supported: 1 2024-03-26T16:47:28.504 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: kLZ4Compression supported: 1 2024-03-26T16:47:28.504 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: kBZip2Compression supported: 0 2024-03-26T16:47:28.504 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: Fast CRC32 supported: Supported on x86 2024-03-26T16:47:28.504 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: DMutex implementation: pthread_mutex_t 2024-03-26T16:47:28.504 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-03-26T16:47:28.504 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-03-26T16:47:28.504 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-03-26T16:47:28.504 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: Options.merge_operator: 2024-03-26T16:47:28.504 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: Options.compaction_filter: None 2024-03-26T16:47:28.504 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: Options.compaction_filter_factory: None 2024-03-26T16:47:28.505 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: Options.sst_partitioner_factory: None 2024-03-26T16:47:28.505 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: Options.memtable_factory: SkipListFactory 2024-03-26T16:47:28.505 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: Options.table_factory: BlockBasedTable 2024-03-26T16:47:28.505 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55c4e1f77c40) 2024-03-26T16:47:28.505 INFO:journalctl@ceph.mon.a.smithi044.stdout: cache_index_and_filter_blocks: 1 2024-03-26T16:47:28.505 INFO:journalctl@ceph.mon.a.smithi044.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-03-26T16:47:28.505 INFO:journalctl@ceph.mon.a.smithi044.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-03-26T16:47:28.505 INFO:journalctl@ceph.mon.a.smithi044.stdout: pin_top_level_index_and_filter: 1 2024-03-26T16:47:28.505 INFO:journalctl@ceph.mon.a.smithi044.stdout: index_type: 0 2024-03-26T16:47:28.505 INFO:journalctl@ceph.mon.a.smithi044.stdout: data_block_index_type: 0 2024-03-26T16:47:28.505 INFO:journalctl@ceph.mon.a.smithi044.stdout: index_shortening: 1 2024-03-26T16:47:28.505 INFO:journalctl@ceph.mon.a.smithi044.stdout: data_block_hash_table_util_ratio: 0.750000 2024-03-26T16:47:28.505 INFO:journalctl@ceph.mon.a.smithi044.stdout: checksum: 4 2024-03-26T16:47:28.505 INFO:journalctl@ceph.mon.a.smithi044.stdout: no_block_cache: 0 2024-03-26T16:47:28.505 INFO:journalctl@ceph.mon.a.smithi044.stdout: block_cache: 0x55c4e1f7b090 2024-03-26T16:47:28.506 INFO:journalctl@ceph.mon.a.smithi044.stdout: block_cache_name: BinnedLRUCache 2024-03-26T16:47:28.506 INFO:journalctl@ceph.mon.a.smithi044.stdout: block_cache_options: 2024-03-26T16:47:28.506 INFO:journalctl@ceph.mon.a.smithi044.stdout: capacity : 536870912 2024-03-26T16:47:28.506 INFO:journalctl@ceph.mon.a.smithi044.stdout: num_shard_bits : 4 2024-03-26T16:47:28.506 INFO:journalctl@ceph.mon.a.smithi044.stdout: strict_capacity_limit : 0 2024-03-26T16:47:28.506 INFO:journalctl@ceph.mon.a.smithi044.stdout: high_pri_pool_ratio: 0.000 2024-03-26T16:47:28.506 INFO:journalctl@ceph.mon.a.smithi044.stdout: block_cache_compressed: (nil) 2024-03-26T16:47:28.506 INFO:journalctl@ceph.mon.a.smithi044.stdout: persistent_cache: (nil) 2024-03-26T16:47:28.506 INFO:journalctl@ceph.mon.a.smithi044.stdout: block_size: 4096 2024-03-26T16:47:28.506 INFO:journalctl@ceph.mon.a.smithi044.stdout: block_size_deviation: 10 2024-03-26T16:47:28.506 INFO:journalctl@ceph.mon.a.smithi044.stdout: block_restart_interval: 16 2024-03-26T16:47:28.507 INFO:journalctl@ceph.mon.a.smithi044.stdout: index_block_restart_interval: 1 2024-03-26T16:47:28.507 INFO:journalctl@ceph.mon.a.smithi044.stdout: metadata_block_size: 4096 2024-03-26T16:47:28.507 INFO:journalctl@ceph.mon.a.smithi044.stdout: partition_filters: 0 2024-03-26T16:47:28.507 INFO:journalctl@ceph.mon.a.smithi044.stdout: use_delta_encoding: 1 2024-03-26T16:47:28.507 INFO:journalctl@ceph.mon.a.smithi044.stdout: filter_policy: bloomfilter 2024-03-26T16:47:28.507 INFO:journalctl@ceph.mon.a.smithi044.stdout: whole_key_filtering: 1 2024-03-26T16:47:28.507 INFO:journalctl@ceph.mon.a.smithi044.stdout: verify_compression: 0 2024-03-26T16:47:28.507 INFO:journalctl@ceph.mon.a.smithi044.stdout: read_amp_bytes_per_bit: 0 2024-03-26T16:47:28.507 INFO:journalctl@ceph.mon.a.smithi044.stdout: format_version: 5 2024-03-26T16:47:28.507 INFO:journalctl@ceph.mon.a.smithi044.stdout: enable_index_compression: 1 2024-03-26T16:47:28.507 INFO:journalctl@ceph.mon.a.smithi044.stdout: block_align: 0 2024-03-26T16:47:28.508 INFO:journalctl@ceph.mon.a.smithi044.stdout: max_auto_readahead_size: 262144 2024-03-26T16:47:28.508 INFO:journalctl@ceph.mon.a.smithi044.stdout: prepopulate_block_cache: 0 2024-03-26T16:47:28.508 INFO:journalctl@ceph.mon.a.smithi044.stdout: initial_auto_readahead_size: 8192 2024-03-26T16:47:28.508 INFO:journalctl@ceph.mon.a.smithi044.stdout: num_file_reads_for_auto_readahead: 2 2024-03-26T16:47:28.508 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: Options.write_buffer_size: 33554432 2024-03-26T16:47:28.508 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: Options.max_write_buffer_number: 2 2024-03-26T16:47:28.508 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: Options.compression: NoCompression 2024-03-26T16:47:28.508 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: Options.bottommost_compression: Disabled 2024-03-26T16:47:28.509 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: Options.prefix_extractor: nullptr 2024-03-26T16:47:28.509 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-03-26T16:47:28.509 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: Options.num_levels: 7 2024-03-26T16:47:28.509 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-03-26T16:47:28.509 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-03-26T16:47:28.509 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-03-26T16:47:28.509 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-03-26T16:47:28.509 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-03-26T16:47:28.509 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-03-26T16:47:28.509 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-03-26T16:47:28.510 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-03-26T16:47:28.510 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-03-26T16:47:28.510 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-03-26T16:47:28.510 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-03-26T16:47:28.510 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-03-26T16:47:28.510 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: Options.compression_opts.window_bits: -14 2024-03-26T16:47:28.510 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: Options.compression_opts.level: 32767 2024-03-26T16:47:28.510 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: Options.compression_opts.strategy: 0 2024-03-26T16:47:28.511 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-03-26T16:47:28.511 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-03-26T16:47:28.511 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-03-26T16:47:28.511 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-03-26T16:47:28.511 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: Options.compression_opts.enabled: false 2024-03-26T16:47:28.511 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-03-26T16:47:28.512 INFO:teuthology.orchestra.run.smithi044.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-03-26T16:47:28.513 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-03-26T16:47:28.513 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-03-26T16:47:28.513 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-03-26T16:47:28.514 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: Options.target_file_size_base: 67108864 2024-03-26T16:47:28.514 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: Options.target_file_size_multiplier: 1 2024-03-26T16:47:28.514 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-03-26T16:47:28.514 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-03-26T16:47:28.514 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-03-26T16:47:28.514 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-03-26T16:47:28.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-03-26T16:47:28.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-03-26T16:47:28.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-03-26T16:47:28.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-03-26T16:47:28.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-03-26T16:47:28.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-03-26T16:47:28.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-03-26T16:47:28.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-03-26T16:47:28.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-03-26T16:47:28.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: Options.arena_block_size: 1048576 2024-03-26T16:47:28.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-03-26T16:47:28.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-03-26T16:47:28.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: Options.disable_auto_compactions: 0 2024-03-26T16:47:28.517 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-03-26T16:47:28.517 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-03-26T16:47:28.517 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-03-26T16:47:28.517 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-03-26T16:47:28.517 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-03-26T16:47:28.517 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-03-26T16:47:28.518 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-03-26T16:47:28.518 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-03-26T16:47:28.518 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-03-26T16:47:28.518 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-03-26T16:47:28.518 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: Options.table_properties_collectors: 2024-03-26T16:47:28.518 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: Options.inplace_update_support: 0 2024-03-26T16:47:28.519 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: Options.inplace_update_num_locks: 10000 2024-03-26T16:47:28.519 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-03-26T16:47:28.519 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-03-26T16:47:28.519 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: Options.memtable_huge_page_size: 0 2024-03-26T16:47:28.519 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: Options.bloom_locality: 0 2024-03-26T16:47:28.519 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: Options.max_successive_merges: 0 2024-03-26T16:47:28.520 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: Options.optimize_filters_for_hits: 0 2024-03-26T16:47:28.520 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: Options.paranoid_file_checks: 0 2024-03-26T16:47:28.520 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: Options.force_consistency_checks: 1 2024-03-26T16:47:28.520 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: Options.report_bg_io_stats: 0 2024-03-26T16:47:28.520 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: Options.ttl: 2592000 2024-03-26T16:47:28.520 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: Options.periodic_compaction_seconds: 0 2024-03-26T16:47:28.520 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-03-26T16:47:28.520 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-03-26T16:47:28.521 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: Options.enable_blob_files: false 2024-03-26T16:47:28.521 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: Options.min_blob_size: 0 2024-03-26T16:47:28.521 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: Options.blob_file_size: 268435456 2024-03-26T16:47:28.521 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: Options.blob_compression_type: NoCompression 2024-03-26T16:47:28.521 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: Options.enable_blob_garbage_collection: false 2024-03-26T16:47:28.521 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-03-26T16:47:28.521 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-03-26T16:47:28.522 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-03-26T16:47:28.522 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: Options.blob_file_starting_level: 0 2024-03-26T16:47:28.522 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-03-26T16:47:28.522 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-03-26T16:47:28.522 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-03-26T16:47:28.522 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 3cddf66c-af3c-45fd-b055-402ad3e5ecab 2024-03-26T16:47:28.523 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: EVENT_LOG_v1 {"time_micros": 1711471648447556, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-03-26T16:47:28.523 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-03-26T16:47:28.523 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: EVENT_LOG_v1 {"time_micros": 1711471648448383, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 85899, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 261, "table_properties": {"data_size": 84072, "index_size": 237, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 581, "raw_key_size": 10270, "raw_average_key_size": 46, "raw_value_size": 78245, "raw_average_value_size": 355, "num_data_blocks": 11, "num_entries": 220, "num_filter_entries": 220, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1711471648, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "3cddf66c-af3c-45fd-b055-402ad3e5ecab", "db_session_id": "UCDFA6DBLH4HX48CIUMF", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-03-26T16:47:28.523 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: EVENT_LOG_v1 {"time_micros": 1711471648448467, "job": 1, "event": "recovery_finished"} 2024-03-26T16:47:28.523 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-03-26T16:47:28.523 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-03-26T16:47:28.524 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55c4e206a000 2024-03-26T16:47:28.524 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: DB pointer 0x55c4e2054000 2024-03-26T16:47:28.524 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-03-26T16:47:28.524 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-03-26T16:47:28.524 INFO:journalctl@ceph.mon.a.smithi044.stdout: ** DB Stats ** 2024-03-26T16:47:28.524 INFO:journalctl@ceph.mon.a.smithi044.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-03-26T16:47:28.525 INFO:journalctl@ceph.mon.a.smithi044.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-03-26T16:47:28.525 INFO:journalctl@ceph.mon.a.smithi044.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-03-26T16:47:28.525 INFO:journalctl@ceph.mon.a.smithi044.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-03-26T16:47:28.525 INFO:journalctl@ceph.mon.a.smithi044.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-03-26T16:47:28.525 INFO:journalctl@ceph.mon.a.smithi044.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-03-26T16:47:28.525 INFO:journalctl@ceph.mon.a.smithi044.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-03-26T16:47:28.526 INFO:journalctl@ceph.mon.a.smithi044.stdout: 2024-03-26T16:47:28.526 INFO:journalctl@ceph.mon.a.smithi044.stdout: ** Compaction Stats [default] ** 2024-03-26T16:47:28.526 INFO:journalctl@ceph.mon.a.smithi044.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-03-26T16:47:28.526 INFO:journalctl@ceph.mon.a.smithi044.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-03-26T16:47:28.526 INFO:journalctl@ceph.mon.a.smithi044.stdout: L0 2/0 85.72 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 156.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-03-26T16:47:28.527 INFO:journalctl@ceph.mon.a.smithi044.stdout: Sum 2/0 85.72 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 156.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-03-26T16:47:28.527 INFO:journalctl@ceph.mon.a.smithi044.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 156.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-03-26T16:47:28.527 INFO:journalctl@ceph.mon.a.smithi044.stdout: 2024-03-26T16:47:28.527 INFO:journalctl@ceph.mon.a.smithi044.stdout: ** Compaction Stats [default] ** 2024-03-26T16:47:28.527 INFO:journalctl@ceph.mon.a.smithi044.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-03-26T16:47:28.527 INFO:journalctl@ceph.mon.a.smithi044.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-03-26T16:47:28.528 INFO:journalctl@ceph.mon.a.smithi044.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 156.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-03-26T16:47:28.528 INFO:journalctl@ceph.mon.a.smithi044.stdout: 2024-03-26T16:47:28.528 INFO:journalctl@ceph.mon.a.smithi044.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-03-26T16:47:28.528 INFO:journalctl@ceph.mon.a.smithi044.stdout: 2024-03-26T16:47:28.528 INFO:journalctl@ceph.mon.a.smithi044.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-03-26T16:47:28.528 INFO:journalctl@ceph.mon.a.smithi044.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-03-26T16:47:28.529 INFO:journalctl@ceph.mon.a.smithi044.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-03-26T16:47:28.529 INFO:journalctl@ceph.mon.a.smithi044.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-03-26T16:47:28.529 INFO:journalctl@ceph.mon.a.smithi044.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-03-26T16:47:28.529 INFO:journalctl@ceph.mon.a.smithi044.stdout: AddFile(Keys): cumulative 0, interval 0 2024-03-26T16:47:28.529 INFO:journalctl@ceph.mon.a.smithi044.stdout: Cumulative compaction: 0.00 GB write, 29.45 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-03-26T16:47:28.529 INFO:journalctl@ceph.mon.a.smithi044.stdout: Interval compaction: 0.00 GB write, 29.45 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-03-26T16:47:28.530 INFO:journalctl@ceph.mon.a.smithi044.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-03-26T16:47:28.530 INFO:journalctl@ceph.mon.a.smithi044.stdout: Block cache BinnedLRUCache@0x55c4e1f7b090#2 capacity: 512.00 MB usage: 1.19 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-03-26T16:47:28.530 INFO:journalctl@ceph.mon.a.smithi044.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.77 KB,0.000146031%) IndexBlock(2,0.42 KB,8.04663e-05%) Misc(1,0.00 KB,0%) 2024-03-26T16:47:28.530 INFO:journalctl@ceph.mon.a.smithi044.stdout: 2024-03-26T16:47:28.530 INFO:journalctl@ceph.mon.a.smithi044.stdout: ** File Read Latency Histogram By Level [default] ** 2024-03-26T16:47:28.530 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: starting mon.a rank 0 at public addrs [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] at bind addrs [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 4394d798-eb90-11ee-95d0-87774f69a715 2024-03-26T16:47:28.531 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: mon.a@-1(???) e1 preinit fsid 4394d798-eb90-11ee-95d0-87774f69a715 2024-03-26T16:47:28.531 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: mon.a@-1(???).mds e1 new map 2024-03-26T16:47:28.531 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: mon.a@-1(???).mds e1 print_map 2024-03-26T16:47:28.531 INFO:journalctl@ceph.mon.a.smithi044.stdout: e1 2024-03-26T16:47:28.531 INFO:journalctl@ceph.mon.a.smithi044.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-03-26T16:47:28.531 INFO:journalctl@ceph.mon.a.smithi044.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-03-26T16:47:28.532 INFO:journalctl@ceph.mon.a.smithi044.stdout: legacy client fscid: -1 2024-03-26T16:47:28.532 INFO:journalctl@ceph.mon.a.smithi044.stdout: 2024-03-26T16:47:28.532 INFO:journalctl@ceph.mon.a.smithi044.stdout: No filesystems configured 2024-03-26T16:47:28.532 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-03-26T16:47:28.532 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-03-26T16:47:28.532 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-03-26T16:47:28.533 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-03-26T16:47:28.533 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-03-26T16:47:28.533 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 bash[30605]: c1736fb672320b87ad4069e87f56b069d808cc11e111230b4e8ce7e9fbdd898d 2024-03-26T16:47:28.533 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 systemd[1]: Started Ceph mon.a for 4394d798-eb90-11ee-95d0-87774f69a715. 2024-03-26T16:47:28.767 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: mon.a is new leader, mons a in quorum (ranks 0) 2024-03-26T16:47:28.767 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: monmap epoch 1 2024-03-26T16:47:28.767 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: fsid 4394d798-eb90-11ee-95d0-87774f69a715 2024-03-26T16:47:28.767 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: last_changed 2024-03-26T16:47:15.492869+0000 2024-03-26T16:47:28.767 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: created 2024-03-26T16:47:15.492869+0000 2024-03-26T16:47:28.767 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: min_mon_release 19 (squid) 2024-03-26T16:47:28.767 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: election_strategy: 1 2024-03-26T16:47:28.767 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: 0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-03-26T16:47:28.767 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: fsmap 2024-03-26T16:47:28.767 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: osdmap e1: 0 total, 0 up, 0 in 2024-03-26T16:47:28.767 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:28 smithi044 ceph-mon[30624]: mgrmap e1: no daemons active 2024-03-26T16:47:29.486 INFO:teuthology.orchestra.run.smithi044.stdout:Wrote config to /etc/ceph/ceph.conf 2024-03-26T16:47:29.767 INFO:teuthology.orchestra.run.smithi044.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-03-26T16:47:29.767 INFO:teuthology.orchestra.run.smithi044.stdout:Creating mgr... 2024-03-26T16:47:29.767 INFO:teuthology.orchestra.run.smithi044.stdout:Verifying port 0.0.0.0:9283 ... 2024-03-26T16:47:29.768 INFO:teuthology.orchestra.run.smithi044.stdout:Verifying port 0.0.0.0:8765 ... 2024-03-26T16:47:30.266 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:29 smithi044 ceph-mon[30624]: from='client.? 172.21.15.44:0/3927151711' entity='client.admin' 2024-03-26T16:47:30.301 INFO:teuthology.orchestra.run.smithi044.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-4394d798-eb90-11ee-95d0-87774f69a715@mgr.x 2024-03-26T16:47:30.301 INFO:teuthology.orchestra.run.smithi044.stdout:systemctl: stderr Failed to reset failed state of unit ceph-4394d798-eb90-11ee-95d0-87774f69a715@mgr.x.service: Unit ceph-4394d798-eb90-11ee-95d0-87774f69a715@mgr.x.service not loaded. 2024-03-26T16:47:30.449 INFO:teuthology.orchestra.run.smithi044.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-4394d798-eb90-11ee-95d0-87774f69a715.target.wants/ceph-4394d798-eb90-11ee-95d0-87774f69a715@mgr.x.service → /etc/systemd/system/ceph-4394d798-eb90-11ee-95d0-87774f69a715@.service. 2024-03-26T16:47:30.670 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Mar 26 16:47:30 smithi044 systemd[1]: Starting Ceph mgr.x for 4394d798-eb90-11ee-95d0-87774f69a715... 2024-03-26T16:47:30.947 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Mar 26 16:47:30 smithi044 podman[30842]: 2024-03-26 16:47:30.667976039 +0000 UTC m=+0.101523883 container create f79a52394b04b43ce91387a88757f723f93cea89c04d754612bff04569d8a169 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bf9505fb569e9b95a78f9700ed8c4bd20508ef55, name=ceph-4394d798-eb90-11ee-95d0-87774f69a715-mgr-x, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=ceph-nvmeof-mon-bf9505f, org.label-schema.license=GPLv2, org.label-schema.build-date=20240319, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True) 2024-03-26T16:47:30.948 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Mar 26 16:47:30 smithi044 podman[30842]: 2024-03-26 16:47:30.583713891 +0000 UTC m=+0.017261702 image pull 5795ddf102746261652aa1cd1f517ace4dcfb8739ebbf229aeb81830d793ada0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bf9505fb569e9b95a78f9700ed8c4bd20508ef55 2024-03-26T16:47:30.948 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Mar 26 16:47:30 smithi044 podman[30842]: 2024-03-26 16:47:30.878673919 +0000 UTC m=+0.312221722 container init f79a52394b04b43ce91387a88757f723f93cea89c04d754612bff04569d8a169 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bf9505fb569e9b95a78f9700ed8c4bd20508ef55, name=ceph-4394d798-eb90-11ee-95d0-87774f69a715-mgr-x, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=ceph-nvmeof-mon-bf9505f, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240319) 2024-03-26T16:47:30.948 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Mar 26 16:47:30 smithi044 podman[30842]: 2024-03-26 16:47:30.881109006 +0000 UTC m=+0.314656809 container start f79a52394b04b43ce91387a88757f723f93cea89c04d754612bff04569d8a169 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bf9505fb569e9b95a78f9700ed8c4bd20508ef55, name=ceph-4394d798-eb90-11ee-95d0-87774f69a715-mgr-x, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_BRANCH=HEAD, org.label-schema.build-date=20240319, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=ceph-nvmeof-mon-bf9505f, org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-26T16:47:30.948 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Mar 26 16:47:30 smithi044 bash[30842]: f79a52394b04b43ce91387a88757f723f93cea89c04d754612bff04569d8a169 2024-03-26T16:47:30.960 INFO:teuthology.orchestra.run.smithi044.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-03-26T16:47:30.961 INFO:teuthology.orchestra.run.smithi044.stdout:systemctl: stdout disabled 2024-03-26T16:47:30.968 INFO:teuthology.orchestra.run.smithi044.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-03-26T16:47:30.968 INFO:teuthology.orchestra.run.smithi044.stdout:systemctl: stdout inactive 2024-03-26T16:47:30.968 INFO:teuthology.orchestra.run.smithi044.stdout:firewalld.service is not enabled 2024-03-26T16:47:30.968 INFO:teuthology.orchestra.run.smithi044.stdout:Not possible to enable service . firewalld.service is not available 2024-03-26T16:47:30.976 INFO:teuthology.orchestra.run.smithi044.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-03-26T16:47:30.976 INFO:teuthology.orchestra.run.smithi044.stdout:systemctl: stdout disabled 2024-03-26T16:47:30.983 INFO:teuthology.orchestra.run.smithi044.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-03-26T16:47:30.983 INFO:teuthology.orchestra.run.smithi044.stdout:systemctl: stdout inactive 2024-03-26T16:47:30.984 INFO:teuthology.orchestra.run.smithi044.stdout:firewalld.service is not enabled 2024-03-26T16:47:30.984 INFO:teuthology.orchestra.run.smithi044.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-03-26T16:47:30.984 INFO:teuthology.orchestra.run.smithi044.stdout:Waiting for mgr to start... 2024-03-26T16:47:30.984 INFO:teuthology.orchestra.run.smithi044.stdout:Waiting for mgr... 2024-03-26T16:47:31.209 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Mar 26 16:47:30 smithi044 systemd[1]: Started Ceph mgr.x for 4394d798-eb90-11ee-95d0-87774f69a715. 2024-03-26T16:47:31.492 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Mar 26 16:47:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mgr-x[30858]: 2024-03-26T16:47:31.447+0000 7f97487cc200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-26T16:47:31.766 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:31 smithi044 ceph-mon[30624]: from='client.? 172.21.15.44:0/3189752475' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2024-03-26T16:47:31.767 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Mar 26 16:47:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mgr-x[30858]: 2024-03-26T16:47:31.553+0000 7f97487cc200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-26T16:47:31.996 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout 2024-03-26T16:47:31.996 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout { 2024-03-26T16:47:31.996 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "fsid": "4394d798-eb90-11ee-95d0-87774f69a715", 2024-03-26T16:47:31.996 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "health": { 2024-03-26T16:47:31.996 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-03-26T16:47:31.996 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-03-26T16:47:31.997 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-03-26T16:47:31.997 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout }, 2024-03-26T16:47:31.997 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-03-26T16:47:31.997 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-03-26T16:47:31.997 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout 0 2024-03-26T16:47:31.997 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout ], 2024-03-26T16:47:31.997 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-03-26T16:47:31.997 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "a" 2024-03-26T16:47:31.997 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout ], 2024-03-26T16:47:31.997 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "quorum_age": 3, 2024-03-26T16:47:31.997 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "monmap": { 2024-03-26T16:47:31.998 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-26T16:47:31.998 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-03-26T16:47:31.998 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-03-26T16:47:31.998 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout }, 2024-03-26T16:47:31.998 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-03-26T16:47:31.998 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-26T16:47:31.998 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-03-26T16:47:31.998 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-03-26T16:47:31.998 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-03-26T16:47:31.998 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-03-26T16:47:31.998 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-03-26T16:47:31.998 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-03-26T16:47:31.998 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout }, 2024-03-26T16:47:31.998 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-03-26T16:47:31.999 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-03-26T16:47:31.999 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-03-26T16:47:31.999 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-03-26T16:47:31.999 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-03-26T16:47:31.999 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-03-26T16:47:31.999 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-03-26T16:47:31.999 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-03-26T16:47:31.999 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-03-26T16:47:31.999 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout }, 2024-03-26T16:47:31.999 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-03-26T16:47:31.999 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-26T16:47:31.999 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-03-26T16:47:31.999 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-03-26T16:47:31.999 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout }, 2024-03-26T16:47:32.000 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-03-26T16:47:32.000 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "available": false, 2024-03-26T16:47:32.000 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-03-26T16:47:32.000 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "modules": [ 2024-03-26T16:47:32.000 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "iostat", 2024-03-26T16:47:32.000 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "nfs", 2024-03-26T16:47:32.000 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "restful" 2024-03-26T16:47:32.000 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout ], 2024-03-26T16:47:32.000 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "services": {} 2024-03-26T16:47:32.000 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout }, 2024-03-26T16:47:32.000 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-03-26T16:47:32.000 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-26T16:47:32.000 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "modified": "2024-03-26T16:47:21.868432+0000", 2024-03-26T16:47:32.000 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "services": {} 2024-03-26T16:47:32.000 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout }, 2024-03-26T16:47:32.000 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-03-26T16:47:32.001 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout } 2024-03-26T16:47:32.001 INFO:teuthology.orchestra.run.smithi044.stdout:mgr not available, waiting (1/15)... 2024-03-26T16:47:32.516 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Mar 26 16:47:32 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mgr-x[30858]: 2024-03-26T16:47:32.220+0000 7f97487cc200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-26T16:47:32.516 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Mar 26 16:47:32 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mgr-x[30858]: 2024-03-26T16:47:32.315+0000 7f97487cc200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-26T16:47:32.516 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Mar 26 16:47:32 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mgr-x[30858]: 2024-03-26T16:47:32.458+0000 7f97487cc200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-26T16:47:32.913 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Mar 26 16:47:32 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mgr-x[30858]: 2024-03-26T16:47:32.556+0000 7f97487cc200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-26T16:47:32.913 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Mar 26 16:47:32 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mgr-x[30858]: 2024-03-26T16:47:32.641+0000 7f97487cc200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-26T16:47:32.913 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Mar 26 16:47:32 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mgr-x[30858]: 2024-03-26T16:47:32.910+0000 7f97487cc200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-03-26T16:47:33.209 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Mar 26 16:47:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mgr-x[30858]: 2024-03-26T16:47:33.022+0000 7f97487cc200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-26T16:47:33.210 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Mar 26 16:47:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mgr-x[30858]: 2024-03-26T16:47:33.109+0000 7f97487cc200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-26T16:47:33.210 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Mar 26 16:47:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mgr-x[30858]: 2024-03-26T16:47:33.206+0000 7f97487cc200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-26T16:47:33.516 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Mar 26 16:47:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mgr-x[30858]: 2024-03-26T16:47:33.384+0000 7f97487cc200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-26T16:47:34.766 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:34 smithi044 ceph-mon[30624]: from='client.? 172.21.15.44:0/134684009' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2024-03-26T16:47:34.767 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Mar 26 16:47:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mgr-x[30858]: 2024-03-26T16:47:34.393+0000 7f97487cc200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-03-26T16:47:34.767 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Mar 26 16:47:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mgr-x[30858]: 2024-03-26T16:47:34.530+0000 7f97487cc200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-26T16:47:35.115 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout 2024-03-26T16:47:35.116 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout { 2024-03-26T16:47:35.116 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "fsid": "4394d798-eb90-11ee-95d0-87774f69a715", 2024-03-26T16:47:35.116 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "health": { 2024-03-26T16:47:35.116 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-03-26T16:47:35.116 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-03-26T16:47:35.116 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-03-26T16:47:35.116 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout }, 2024-03-26T16:47:35.116 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-03-26T16:47:35.116 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-03-26T16:47:35.116 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout 0 2024-03-26T16:47:35.116 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout ], 2024-03-26T16:47:35.116 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-03-26T16:47:35.117 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "a" 2024-03-26T16:47:35.117 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout ], 2024-03-26T16:47:35.117 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "quorum_age": 5, 2024-03-26T16:47:35.117 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "monmap": { 2024-03-26T16:47:35.117 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-26T16:47:35.117 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-03-26T16:47:35.117 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-03-26T16:47:35.117 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout }, 2024-03-26T16:47:35.117 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-03-26T16:47:35.117 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-26T16:47:35.117 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-03-26T16:47:35.117 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-03-26T16:47:35.117 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-03-26T16:47:35.121 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-03-26T16:47:35.121 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-03-26T16:47:35.121 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-03-26T16:47:35.121 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout }, 2024-03-26T16:47:35.121 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-03-26T16:47:35.121 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-03-26T16:47:35.121 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-03-26T16:47:35.122 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-03-26T16:47:35.122 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-03-26T16:47:35.122 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-03-26T16:47:35.122 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-03-26T16:47:35.122 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-03-26T16:47:35.122 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-03-26T16:47:35.122 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout }, 2024-03-26T16:47:35.122 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-03-26T16:47:35.122 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-26T16:47:35.122 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-03-26T16:47:35.122 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-03-26T16:47:35.122 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout }, 2024-03-26T16:47:35.122 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-03-26T16:47:35.122 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "available": false, 2024-03-26T16:47:35.122 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-03-26T16:47:35.123 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "modules": [ 2024-03-26T16:47:35.123 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "iostat", 2024-03-26T16:47:35.123 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "nfs", 2024-03-26T16:47:35.123 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "restful" 2024-03-26T16:47:35.123 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout ], 2024-03-26T16:47:35.123 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "services": {} 2024-03-26T16:47:35.123 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout }, 2024-03-26T16:47:35.123 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-03-26T16:47:35.123 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-26T16:47:35.123 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "modified": "2024-03-26T16:47:21.868432+0000", 2024-03-26T16:47:35.123 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "services": {} 2024-03-26T16:47:35.123 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout }, 2024-03-26T16:47:35.123 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-03-26T16:47:35.123 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout } 2024-03-26T16:47:35.124 INFO:teuthology.orchestra.run.smithi044.stdout:mgr not available, waiting (2/15)... 2024-03-26T16:47:35.164 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Mar 26 16:47:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mgr-x[30858]: 2024-03-26T16:47:34.869+0000 7f97487cc200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-26T16:47:35.164 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Mar 26 16:47:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mgr-x[30858]: 2024-03-26T16:47:34.961+0000 7f97487cc200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-26T16:47:35.164 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Mar 26 16:47:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mgr-x[30858]: 2024-03-26T16:47:35.161+0000 7f97487cc200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-26T16:47:35.516 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Mar 26 16:47:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mgr-x[30858]: 2024-03-26T16:47:35.350+0000 7f97487cc200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-26T16:47:35.905 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Mar 26 16:47:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mgr-x[30858]: 2024-03-26T16:47:35.640+0000 7f97487cc200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-26T16:47:35.905 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Mar 26 16:47:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mgr-x[30858]: 2024-03-26T16:47:35.901+0000 7f97487cc200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-26T16:47:36.266 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Mar 26 16:47:36 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mgr-x[30858]: 2024-03-26T16:47:36.143+0000 7f97487cc200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-26T16:47:37.240 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Mar 26 16:47:36 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mgr-x[30858]: 2024-03-26T16:47:36.969+0000 7f97487cc200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-26T16:47:37.766 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:37 smithi044 ceph-mon[30624]: from='client.? 172.21.15.44:0/3046707007' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2024-03-26T16:47:37.767 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Mar 26 16:47:37 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mgr-x[30858]: 2024-03-26T16:47:37.561+0000 7f97487cc200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-26T16:47:37.767 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Mar 26 16:47:37 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mgr-x[30858]: 2024-03-26T16:47:37.665+0000 7f97487cc200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-26T16:47:38.242 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Mar 26 16:47:37 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mgr-x[30858]: 2024-03-26T16:47:37.885+0000 7f97487cc200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-26T16:47:38.247 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout 2024-03-26T16:47:38.247 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout { 2024-03-26T16:47:38.247 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "fsid": "4394d798-eb90-11ee-95d0-87774f69a715", 2024-03-26T16:47:38.247 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "health": { 2024-03-26T16:47:38.247 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-03-26T16:47:38.248 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-03-26T16:47:38.248 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-03-26T16:47:38.248 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout }, 2024-03-26T16:47:38.248 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-03-26T16:47:38.248 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-03-26T16:47:38.248 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout 0 2024-03-26T16:47:38.248 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout ], 2024-03-26T16:47:38.248 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-03-26T16:47:38.248 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "a" 2024-03-26T16:47:38.248 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout ], 2024-03-26T16:47:38.248 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "quorum_age": 9, 2024-03-26T16:47:38.248 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "monmap": { 2024-03-26T16:47:38.248 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-26T16:47:38.248 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-03-26T16:47:38.248 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-03-26T16:47:38.248 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout }, 2024-03-26T16:47:38.249 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-03-26T16:47:38.249 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-26T16:47:38.249 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-03-26T16:47:38.249 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-03-26T16:47:38.252 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-03-26T16:47:38.253 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-03-26T16:47:38.253 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-03-26T16:47:38.253 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-03-26T16:47:38.253 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout }, 2024-03-26T16:47:38.253 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-03-26T16:47:38.253 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-03-26T16:47:38.253 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-03-26T16:47:38.253 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-03-26T16:47:38.253 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-03-26T16:47:38.253 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-03-26T16:47:38.253 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-03-26T16:47:38.254 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-03-26T16:47:38.254 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-03-26T16:47:38.254 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout }, 2024-03-26T16:47:38.254 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-03-26T16:47:38.254 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-26T16:47:38.254 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-03-26T16:47:38.254 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-03-26T16:47:38.254 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout }, 2024-03-26T16:47:38.254 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-03-26T16:47:38.254 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "available": false, 2024-03-26T16:47:38.254 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-03-26T16:47:38.254 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "modules": [ 2024-03-26T16:47:38.254 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "iostat", 2024-03-26T16:47:38.254 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "nfs", 2024-03-26T16:47:38.254 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "restful" 2024-03-26T16:47:38.255 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout ], 2024-03-26T16:47:38.255 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "services": {} 2024-03-26T16:47:38.255 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout }, 2024-03-26T16:47:38.255 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-03-26T16:47:38.255 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-26T16:47:38.255 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "modified": "2024-03-26T16:47:21.868432+0000", 2024-03-26T16:47:38.255 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "services": {} 2024-03-26T16:47:38.255 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout }, 2024-03-26T16:47:38.255 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-03-26T16:47:38.255 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout } 2024-03-26T16:47:38.255 INFO:teuthology.orchestra.run.smithi044.stdout:mgr not available, waiting (3/15)... 2024-03-26T16:47:39.017 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:38 smithi044 ceph-mon[30624]: Activating manager daemon x 2024-03-26T16:47:39.017 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:38 smithi044 ceph-mon[30624]: mgrmap e2: x(active, starting, since 0.00311455s) 2024-03-26T16:47:39.017 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:38 smithi044 ceph-mon[30624]: from='mgr.14100 172.21.15.44:0/2617364539' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-03-26T16:47:39.017 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:38 smithi044 ceph-mon[30624]: from='mgr.14100 172.21.15.44:0/2617364539' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-03-26T16:47:39.017 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:38 smithi044 ceph-mon[30624]: from='mgr.14100 172.21.15.44:0/2617364539' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-03-26T16:47:39.017 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:38 smithi044 ceph-mon[30624]: from='mgr.14100 172.21.15.44:0/2617364539' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-03-26T16:47:39.017 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:38 smithi044 ceph-mon[30624]: from='mgr.14100 172.21.15.44:0/2617364539' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-03-26T16:47:39.017 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:38 smithi044 ceph-mon[30624]: Manager daemon x is now available 2024-03-26T16:47:39.017 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:38 smithi044 ceph-mon[30624]: from='mgr.14100 172.21.15.44:0/2617364539' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-03-26T16:47:39.017 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:38 smithi044 ceph-mon[30624]: from='mgr.14100 172.21.15.44:0/2617364539' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-03-26T16:47:39.017 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:38 smithi044 ceph-mon[30624]: from='mgr.14100 172.21.15.44:0/2617364539' entity='mgr.x' 2024-03-26T16:47:39.018 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:38 smithi044 ceph-mon[30624]: from='mgr.14100 172.21.15.44:0/2617364539' entity='mgr.x' 2024-03-26T16:47:39.018 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:38 smithi044 ceph-mon[30624]: from='mgr.14100 172.21.15.44:0/2617364539' entity='mgr.x' 2024-03-26T16:47:40.266 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:39 smithi044 ceph-mon[30624]: mgrmap e3: x(active, since 1.00722s) 2024-03-26T16:47:41.714 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout 2024-03-26T16:47:41.714 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout { 2024-03-26T16:47:41.714 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "fsid": "4394d798-eb90-11ee-95d0-87774f69a715", 2024-03-26T16:47:41.714 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "health": { 2024-03-26T16:47:41.714 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-03-26T16:47:41.714 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-03-26T16:47:41.714 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-03-26T16:47:41.714 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout }, 2024-03-26T16:47:41.715 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-03-26T16:47:41.715 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-03-26T16:47:41.715 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout 0 2024-03-26T16:47:41.715 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout ], 2024-03-26T16:47:41.715 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-03-26T16:47:41.715 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "a" 2024-03-26T16:47:41.715 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout ], 2024-03-26T16:47:41.715 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "quorum_age": 12, 2024-03-26T16:47:41.715 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "monmap": { 2024-03-26T16:47:41.715 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-26T16:47:41.715 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-03-26T16:47:41.715 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-03-26T16:47:41.715 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout }, 2024-03-26T16:47:41.715 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-03-26T16:47:41.715 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-26T16:47:41.716 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-03-26T16:47:41.716 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-03-26T16:47:41.716 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-03-26T16:47:41.719 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-03-26T16:47:41.719 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-03-26T16:47:41.719 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-03-26T16:47:41.720 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout }, 2024-03-26T16:47:41.720 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-03-26T16:47:41.720 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-03-26T16:47:41.720 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-03-26T16:47:41.720 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-03-26T16:47:41.720 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-03-26T16:47:41.720 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-03-26T16:47:41.720 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-03-26T16:47:41.720 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-03-26T16:47:41.720 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-03-26T16:47:41.720 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout }, 2024-03-26T16:47:41.720 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-03-26T16:47:41.720 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-26T16:47:41.720 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-03-26T16:47:41.720 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-03-26T16:47:41.721 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout }, 2024-03-26T16:47:41.721 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-03-26T16:47:41.721 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "available": true, 2024-03-26T16:47:41.721 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-03-26T16:47:41.721 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "modules": [ 2024-03-26T16:47:41.721 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "iostat", 2024-03-26T16:47:41.721 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "nfs", 2024-03-26T16:47:41.721 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "restful" 2024-03-26T16:47:41.721 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout ], 2024-03-26T16:47:41.721 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "services": {} 2024-03-26T16:47:41.721 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout }, 2024-03-26T16:47:41.721 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-03-26T16:47:41.721 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-26T16:47:41.721 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "modified": "2024-03-26T16:47:21.868432+0000", 2024-03-26T16:47:41.722 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "services": {} 2024-03-26T16:47:41.722 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout }, 2024-03-26T16:47:41.722 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-03-26T16:47:41.722 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout } 2024-03-26T16:47:41.722 INFO:teuthology.orchestra.run.smithi044.stdout:mgr is available 2024-03-26T16:47:42.266 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:41 smithi044 ceph-mon[30624]: mgrmap e4: x(active, since 3s) 2024-03-26T16:47:42.266 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:41 smithi044 ceph-mon[30624]: from='client.? 172.21.15.44:0/549796555' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2024-03-26T16:47:42.927 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout 2024-03-26T16:47:42.927 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout [global] 2024-03-26T16:47:42.928 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout fsid = 4394d798-eb90-11ee-95d0-87774f69a715 2024-03-26T16:47:42.928 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-03-26T16:47:42.928 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-03-26T16:47:42.928 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-03-26T16:47:42.928 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-03-26T16:47:42.928 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout 2024-03-26T16:47:42.928 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout [mgr] 2024-03-26T16:47:42.928 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-03-26T16:47:42.928 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout 2024-03-26T16:47:42.928 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout [osd] 2024-03-26T16:47:42.928 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-03-26T16:47:42.928 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-03-26T16:47:42.928 INFO:teuthology.orchestra.run.smithi044.stdout:Enabling cephadm module... 2024-03-26T16:47:43.157 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:42 smithi044 ceph-mon[30624]: from='client.? 172.21.15.44:0/2568391951' entity='client.admin' cmd={"prefix": "config assimilate-conf"} : dispatch 2024-03-26T16:47:44.212 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:43 smithi044 ceph-mon[30624]: from='client.? 172.21.15.44:0/3700951947' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "cephadm"} : dispatch 2024-03-26T16:47:44.213 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Mar 26 16:47:43 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mgr-x[30858]: ignoring --setuser ceph since I am not root 2024-03-26T16:47:44.213 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Mar 26 16:47:43 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mgr-x[30858]: ignoring --setgroup ceph since I am not root 2024-03-26T16:47:44.722 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Mar 26 16:47:44 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mgr-x[30858]: 2024-03-26T16:47:44.474+0000 7f4190ccb200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-26T16:47:44.722 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Mar 26 16:47:44 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mgr-x[30858]: 2024-03-26T16:47:44.579+0000 7f4190ccb200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-26T16:47:45.188 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:44 smithi044 ceph-mon[30624]: from='client.? 172.21.15.44:0/3700951947' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-03-26T16:47:45.189 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:44 smithi044 ceph-mon[30624]: mgrmap e5: x(active, since 6s) 2024-03-26T16:47:45.478 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Mar 26 16:47:45 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mgr-x[30858]: 2024-03-26T16:47:45.250+0000 7f4190ccb200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-26T16:47:45.478 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Mar 26 16:47:45 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mgr-x[30858]: 2024-03-26T16:47:45.346+0000 7f4190ccb200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-26T16:47:45.698 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout { 2024-03-26T16:47:45.699 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-03-26T16:47:45.699 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "available": true, 2024-03-26T16:47:45.699 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-03-26T16:47:45.699 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-03-26T16:47:45.699 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout } 2024-03-26T16:47:45.699 INFO:teuthology.orchestra.run.smithi044.stdout:Waiting for the mgr to restart... 2024-03-26T16:47:45.699 INFO:teuthology.orchestra.run.smithi044.stdout:Waiting for mgr epoch 5... 2024-03-26T16:47:45.766 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Mar 26 16:47:45 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mgr-x[30858]: 2024-03-26T16:47:45.491+0000 7f4190ccb200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-26T16:47:45.767 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Mar 26 16:47:45 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mgr-x[30858]: 2024-03-26T16:47:45.589+0000 7f4190ccb200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-26T16:47:45.767 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Mar 26 16:47:45 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mgr-x[30858]: 2024-03-26T16:47:45.674+0000 7f4190ccb200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-26T16:47:46.115 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:45 smithi044 ceph-mon[30624]: from='client.? 172.21.15.44:0/2610581225' entity='client.admin' cmd={"prefix": "mgr stat"} : dispatch 2024-03-26T16:47:46.115 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Mar 26 16:47:45 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mgr-x[30858]: 2024-03-26T16:47:45.950+0000 7f4190ccb200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-03-26T16:47:46.115 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Mar 26 16:47:46 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mgr-x[30858]: 2024-03-26T16:47:46.063+0000 7f4190ccb200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-26T16:47:46.431 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Mar 26 16:47:46 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mgr-x[30858]: 2024-03-26T16:47:46.153+0000 7f4190ccb200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-26T16:47:46.431 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Mar 26 16:47:46 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mgr-x[30858]: 2024-03-26T16:47:46.250+0000 7f4190ccb200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-26T16:47:46.766 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Mar 26 16:47:46 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mgr-x[30858]: 2024-03-26T16:47:46.428+0000 7f4190ccb200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-26T16:47:47.766 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Mar 26 16:47:47 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mgr-x[30858]: 2024-03-26T16:47:47.411+0000 7f4190ccb200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-03-26T16:47:47.766 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Mar 26 16:47:47 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mgr-x[30858]: 2024-03-26T16:47:47.544+0000 7f4190ccb200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-26T16:47:48.175 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Mar 26 16:47:47 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mgr-x[30858]: 2024-03-26T16:47:47.881+0000 7f4190ccb200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-26T16:47:48.175 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Mar 26 16:47:47 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mgr-x[30858]: 2024-03-26T16:47:47.972+0000 7f4190ccb200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-26T16:47:48.175 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Mar 26 16:47:48 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mgr-x[30858]: 2024-03-26T16:47:48.172+0000 7f4190ccb200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-26T16:47:48.516 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Mar 26 16:47:48 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mgr-x[30858]: 2024-03-26T16:47:48.362+0000 7f4190ccb200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-26T16:47:48.916 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Mar 26 16:47:48 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mgr-x[30858]: 2024-03-26T16:47:48.653+0000 7f4190ccb200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-26T16:47:48.916 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Mar 26 16:47:48 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mgr-x[30858]: 2024-03-26T16:47:48.913+0000 7f4190ccb200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-26T16:47:49.266 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Mar 26 16:47:49 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mgr-x[30858]: 2024-03-26T16:47:49.156+0000 7f4190ccb200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-26T16:47:50.266 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Mar 26 16:47:49 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mgr-x[30858]: 2024-03-26T16:47:49.980+0000 7f4190ccb200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-26T16:47:50.882 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Mar 26 16:47:50 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mgr-x[30858]: 2024-03-26T16:47:50.559+0000 7f4190ccb200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-26T16:47:50.882 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Mar 26 16:47:50 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mgr-x[30858]: 2024-03-26T16:47:50.659+0000 7f4190ccb200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-26T16:47:50.882 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Mar 26 16:47:50 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mgr-x[30858]: 2024-03-26T16:47:50.879+0000 7f4190ccb200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-26T16:47:51.266 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:50 smithi044 ceph-mon[30624]: Active manager daemon x restarted 2024-03-26T16:47:51.267 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:50 smithi044 ceph-mon[30624]: Activating manager daemon x 2024-03-26T16:47:51.267 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:50 smithi044 ceph-mon[30624]: osdmap e2: 0 total, 0 up, 0 in 2024-03-26T16:47:51.267 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:50 smithi044 ceph-mon[30624]: mgrmap e6: x(active, starting, since 0.00312166s) 2024-03-26T16:47:51.267 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:50 smithi044 ceph-mon[30624]: from='mgr.14120 172.21.15.44:0/3062365629' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-03-26T16:47:51.267 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:50 smithi044 ceph-mon[30624]: from='mgr.14120 172.21.15.44:0/3062365629' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-03-26T16:47:51.267 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:50 smithi044 ceph-mon[30624]: from='mgr.14120 172.21.15.44:0/3062365629' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-03-26T16:47:51.267 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:50 smithi044 ceph-mon[30624]: from='mgr.14120 172.21.15.44:0/3062365629' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-03-26T16:47:51.267 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:50 smithi044 ceph-mon[30624]: from='mgr.14120 172.21.15.44:0/3062365629' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-03-26T16:47:51.267 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:50 smithi044 ceph-mon[30624]: Manager daemon x is now available 2024-03-26T16:47:51.267 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:50 smithi044 ceph-mon[30624]: from='mgr.14120 172.21.15.44:0/3062365629' entity='mgr.x' 2024-03-26T16:47:51.267 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:50 smithi044 ceph-mon[30624]: from='mgr.14120 172.21.15.44:0/3062365629' entity='mgr.x' 2024-03-26T16:47:51.267 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:50 smithi044 ceph-mon[30624]: from='mgr.14120 172.21.15.44:0/3062365629' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-26T16:47:52.218 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:51 smithi044 ceph-mon[30624]: Found migration_current of "None". Setting to last migration. 2024-03-26T16:47:52.218 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:51 smithi044 ceph-mon[30624]: from='mgr.14120 172.21.15.44:0/3062365629' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-26T16:47:52.218 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:51 smithi044 ceph-mon[30624]: from='mgr.14120 172.21.15.44:0/3062365629' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-03-26T16:47:52.218 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:51 smithi044 ceph-mon[30624]: from='mgr.14120 172.21.15.44:0/3062365629' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-03-26T16:47:52.219 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:51 smithi044 ceph-mon[30624]: mgrmap e7: x(active, since 1.00526s) 2024-03-26T16:47:52.421 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout { 2024-03-26T16:47:52.421 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-03-26T16:47:52.421 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "initialized": true 2024-03-26T16:47:52.421 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout } 2024-03-26T16:47:52.421 INFO:teuthology.orchestra.run.smithi044.stdout:mgr epoch 5 is available 2024-03-26T16:47:52.421 INFO:teuthology.orchestra.run.smithi044.stdout:Setting orchestrator backend to cephadm... 2024-03-26T16:47:53.102 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:52 smithi044 ceph-mon[30624]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-03-26T16:47:53.103 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:52 smithi044 ceph-mon[30624]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-03-26T16:47:53.103 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:52 smithi044 ceph-mon[30624]: from='mgr.14120 172.21.15.44:0/3062365629' entity='mgr.x' 2024-03-26T16:47:53.103 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:52 smithi044 ceph-mon[30624]: from='mgr.14120 172.21.15.44:0/3062365629' entity='mgr.x' 2024-03-26T16:47:54.257 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:53 smithi044 ceph-mon[30624]: [26/Mar/2024:16:47:52] ENGINE Bus STARTING 2024-03-26T16:47:54.258 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:53 smithi044 ceph-mon[30624]: [26/Mar/2024:16:47:52] ENGINE Serving on http://172.21.15.44:8765 2024-03-26T16:47:54.258 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:53 smithi044 ceph-mon[30624]: from='mgr.14120 172.21.15.44:0/3062365629' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-26T16:47:54.258 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:53 smithi044 ceph-mon[30624]: from='mgr.14120 172.21.15.44:0/3062365629' entity='mgr.x' 2024-03-26T16:47:54.258 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:53 smithi044 ceph-mon[30624]: from='mgr.14120 172.21.15.44:0/3062365629' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-26T16:47:54.258 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:53 smithi044 ceph-mon[30624]: mgrmap e8: x(active, since 2s) 2024-03-26T16:47:54.810 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout value unchanged 2024-03-26T16:47:54.810 INFO:teuthology.orchestra.run.smithi044.stdout:Generating ssh key... 2024-03-26T16:47:55.066 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:54 smithi044 ceph-mon[30624]: [26/Mar/2024:16:47:53] ENGINE Serving on https://172.21.15.44:7150 2024-03-26T16:47:55.067 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:54 smithi044 ceph-mon[30624]: [26/Mar/2024:16:47:53] ENGINE Bus STARTED 2024-03-26T16:47:55.067 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:54 smithi044 ceph-mon[30624]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-03-26T16:47:56.267 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:55 smithi044 ceph-mon[30624]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-03-26T16:47:56.267 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Mar 26 16:47:56 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mgr-x[30858]: Generating public/private rsa key pair. 2024-03-26T16:47:56.267 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Mar 26 16:47:56 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mgr-x[30858]: Your identification has been saved in /tmp/tmpzyxca2bh/key. 2024-03-26T16:47:56.267 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Mar 26 16:47:56 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mgr-x[30858]: Your public key has been saved in /tmp/tmpzyxca2bh/key.pub. 2024-03-26T16:47:56.267 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Mar 26 16:47:56 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mgr-x[30858]: The key fingerprint is: 2024-03-26T16:47:56.267 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Mar 26 16:47:56 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mgr-x[30858]: SHA256:lvT6tpt0S5pWnNw67jP9TO1zi2QumRBxpM8PZVDk6Ls ceph-4394d798-eb90-11ee-95d0-87774f69a715 2024-03-26T16:47:56.267 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Mar 26 16:47:56 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mgr-x[30858]: The key's randomart image is: 2024-03-26T16:47:56.267 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Mar 26 16:47:56 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mgr-x[30858]: +---[RSA 3072]----+ 2024-03-26T16:47:56.267 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Mar 26 16:47:56 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mgr-x[30858]: | .ooo | 2024-03-26T16:47:56.268 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Mar 26 16:47:56 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mgr-x[30858]: | ...+ | 2024-03-26T16:47:56.268 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Mar 26 16:47:56 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mgr-x[30858]: | ..o. + | 2024-03-26T16:47:56.268 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Mar 26 16:47:56 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mgr-x[30858]: | . ++ o | 2024-03-26T16:47:56.268 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Mar 26 16:47:56 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mgr-x[30858]: | S oB o | 2024-03-26T16:47:56.268 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Mar 26 16:47:56 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mgr-x[30858]: | . o O . .| 2024-03-26T16:47:56.268 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Mar 26 16:47:56 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mgr-x[30858]: | . oo=* o| 2024-03-26T16:47:56.268 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Mar 26 16:47:56 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mgr-x[30858]: | ooXX.o=.| 2024-03-26T16:47:56.268 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Mar 26 16:47:56 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mgr-x[30858]: | oBE=* oB| 2024-03-26T16:47:56.268 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Mar 26 16:47:56 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mgr-x[30858]: +----[SHA256]-----+ 2024-03-26T16:47:57.182 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:56 smithi044 ceph-mon[30624]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-03-26T16:47:57.182 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:56 smithi044 ceph-mon[30624]: Generating ssh key... 2024-03-26T16:47:57.182 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:56 smithi044 ceph-mon[30624]: from='mgr.14120 172.21.15.44:0/3062365629' entity='mgr.x' 2024-03-26T16:47:57.182 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:56 smithi044 ceph-mon[30624]: from='mgr.14120 172.21.15.44:0/3062365629' entity='mgr.x' 2024-03-26T16:47:57.715 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC8WB797JJeMAwPcuW7N8XkPI6XkqMtanDOwJ2uM1o0zsvrRRwenKJ1qL3+ynLQMTmPjQeoBwyjGJ7PinuSYFFgwfjiGn0zgghl2XOQ0Ey7EEmqgNCMvtFgBTAmNOSNgZRlV/YPFYNKgnix0Y36O3pUjuBBi5wK0/NhQrkzv0eXl4z1tOyYKI3FDTpaUKaFyNX/OcVTdqkHcKtEq7XqW0h59/sYu1EgKkxW25hQ80orjz85e8SJWa7H+7JjT2MY/XsC5NTILhPo5eB7d1afWIiJPGP/RX7YPLBBy9QNpDdrHOzp7J+HdGjXBhxRYD6Um65smGhiI+0WDnDmafUEdYi3Rrm418K2MwmXaGyvzT2T3fCMds9kfIIFMGvL6FulBLraM43O6T4BgaTrRhugqMbSdgRzKiUi1VCTPHvSp3HPjELvgGp55s9sSF4UFEzpDTMWubs/Fyrv7RLSWXfO2NF2qV5ifZq8uonvZM8rBVJO92SEdAEYXDsay1zxYjjIjHE= ceph-4394d798-eb90-11ee-95d0-87774f69a715 2024-03-26T16:47:57.716 INFO:teuthology.orchestra.run.smithi044.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-03-26T16:47:57.716 INFO:teuthology.orchestra.run.smithi044.stdout:Adding key to root@localhost authorized_keys... 2024-03-26T16:47:57.716 INFO:teuthology.orchestra.run.smithi044.stdout:Adding host smithi044... 2024-03-26T16:47:58.266 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:58 smithi044 ceph-mon[30624]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-03-26T16:47:59.263 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:47:59 smithi044 ceph-mon[30624]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi044", "addr": "172.21.15.44", "target": ["mon-mgr", ""]}]: dispatch 2024-03-26T16:48:00.266 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:48:00 smithi044 ceph-mon[30624]: Deploying cephadm binary to smithi044 2024-03-26T16:48:03.306 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout Added host 'smithi044' with addr '172.21.15.44' 2024-03-26T16:48:03.306 INFO:teuthology.orchestra.run.smithi044.stdout:Deploying unmanaged mon service... 2024-03-26T16:48:04.016 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:48:03 smithi044 ceph-mon[30624]: from='mgr.14120 172.21.15.44:0/3062365629' entity='mgr.x' 2024-03-26T16:48:04.016 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:48:03 smithi044 ceph-mon[30624]: Added host smithi044 2024-03-26T16:48:04.016 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:48:03 smithi044 ceph-mon[30624]: from='mgr.14120 172.21.15.44:0/3062365629' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-26T16:48:05.187 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-03-26T16:48:05.187 INFO:teuthology.orchestra.run.smithi044.stdout:Deploying unmanaged mgr service... 2024-03-26T16:48:05.266 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:48:05 smithi044 ceph-mon[30624]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-03-26T16:48:05.266 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:48:05 smithi044 ceph-mon[30624]: Saving service mon spec with placement count:5 2024-03-26T16:48:05.267 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:48:05 smithi044 ceph-mon[30624]: from='mgr.14120 172.21.15.44:0/3062365629' entity='mgr.x' 2024-03-26T16:48:06.504 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-03-26T16:48:07.221 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:48:06 smithi044 ceph-mon[30624]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-03-26T16:48:07.221 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:48:06 smithi044 ceph-mon[30624]: Saving service mgr spec with placement count:2 2024-03-26T16:48:07.221 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:48:06 smithi044 ceph-mon[30624]: from='mgr.14120 172.21.15.44:0/3062365629' entity='mgr.x' 2024-03-26T16:48:07.221 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:48:06 smithi044 ceph-mon[30624]: from='mgr.14120 172.21.15.44:0/3062365629' entity='mgr.x' 2024-03-26T16:48:07.221 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:48:06 smithi044 ceph-mon[30624]: from='mgr.14120 172.21.15.44:0/3062365629' entity='mgr.x' 2024-03-26T16:48:08.322 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:48:08 smithi044 ceph-mon[30624]: from='client.? 172.21.15.44:0/716589055' entity='client.admin' 2024-03-26T16:48:08.322 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:48:08 smithi044 ceph-mon[30624]: from='mgr.14120 172.21.15.44:0/3062365629' entity='mgr.x' 2024-03-26T16:48:09.470 INFO:teuthology.orchestra.run.smithi044.stdout:Enabling the dashboard module... 2024-03-26T16:48:10.266 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:48:09 smithi044 ceph-mon[30624]: from='client.? 172.21.15.44:0/2040323279' entity='client.admin' 2024-03-26T16:48:10.266 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:48:09 smithi044 ceph-mon[30624]: from='mgr.14120 172.21.15.44:0/3062365629' entity='mgr.x' 2024-03-26T16:48:11.266 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:48:10 smithi044 ceph-mon[30624]: from='client.? 172.21.15.44:0/3540334598' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "dashboard"} : dispatch 2024-03-26T16:48:11.266 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:48:10 smithi044 ceph-mon[30624]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-26T16:48:11.267 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Mar 26 16:48:11 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mgr-x[30858]: ignoring --setuser ceph since I am not root 2024-03-26T16:48:11.267 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Mar 26 16:48:11 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mgr-x[30858]: ignoring --setgroup ceph since I am not root 2024-03-26T16:48:11.715 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Mar 26 16:48:11 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mgr-x[30858]: 2024-03-26T16:48:11.577+0000 7f404c2e3200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-26T16:48:11.715 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Mar 26 16:48:11 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mgr-x[30858]: 2024-03-26T16:48:11.673+0000 7f404c2e3200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-26T16:48:12.266 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:48:11 smithi044 ceph-mon[30624]: from='client.? 172.21.15.44:0/3540334598' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-03-26T16:48:12.266 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:48:11 smithi044 ceph-mon[30624]: mgrmap e9: x(active, since 20s) 2024-03-26T16:48:12.696 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Mar 26 16:48:12 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mgr-x[30858]: 2024-03-26T16:48:12.349+0000 7f404c2e3200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-26T16:48:12.696 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Mar 26 16:48:12 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mgr-x[30858]: 2024-03-26T16:48:12.445+0000 7f404c2e3200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-26T16:48:12.696 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Mar 26 16:48:12 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mgr-x[30858]: 2024-03-26T16:48:12.592+0000 7f404c2e3200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-26T16:48:12.696 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Mar 26 16:48:12 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mgr-x[30858]: 2024-03-26T16:48:12.694+0000 7f404c2e3200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-26T16:48:12.965 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Mar 26 16:48:12 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mgr-x[30858]: 2024-03-26T16:48:12.780+0000 7f404c2e3200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-26T16:48:12.968 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout { 2024-03-26T16:48:12.969 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-03-26T16:48:12.969 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "available": true, 2024-03-26T16:48:12.969 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-03-26T16:48:12.969 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-03-26T16:48:12.969 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout } 2024-03-26T16:48:12.969 INFO:teuthology.orchestra.run.smithi044.stdout:Waiting for the mgr to restart... 2024-03-26T16:48:12.969 INFO:teuthology.orchestra.run.smithi044.stdout:Waiting for mgr epoch 9... 2024-03-26T16:48:13.259 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:48:12 smithi044 ceph-mon[30624]: from='client.? 172.21.15.44:0/3084368115' entity='client.admin' cmd={"prefix": "mgr stat"} : dispatch 2024-03-26T16:48:13.259 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Mar 26 16:48:13 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mgr-x[30858]: 2024-03-26T16:48:13.052+0000 7f404c2e3200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-03-26T16:48:13.259 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Mar 26 16:48:13 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mgr-x[30858]: 2024-03-26T16:48:13.167+0000 7f404c2e3200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-26T16:48:13.260 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Mar 26 16:48:13 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mgr-x[30858]: 2024-03-26T16:48:13.257+0000 7f404c2e3200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-26T16:48:13.516 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Mar 26 16:48:13 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mgr-x[30858]: 2024-03-26T16:48:13.357+0000 7f404c2e3200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-26T16:48:14.016 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Mar 26 16:48:13 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mgr-x[30858]: 2024-03-26T16:48:13.537+0000 7f404c2e3200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-26T16:48:14.990 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Mar 26 16:48:14 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mgr-x[30858]: 2024-03-26T16:48:14.518+0000 7f404c2e3200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-03-26T16:48:14.990 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Mar 26 16:48:14 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mgr-x[30858]: 2024-03-26T16:48:14.651+0000 7f404c2e3200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-26T16:48:14.990 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Mar 26 16:48:14 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mgr-x[30858]: 2024-03-26T16:48:14.988+0000 7f404c2e3200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-26T16:48:15.266 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Mar 26 16:48:15 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mgr-x[30858]: 2024-03-26T16:48:15.079+0000 7f404c2e3200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-26T16:48:15.763 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Mar 26 16:48:15 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mgr-x[30858]: 2024-03-26T16:48:15.280+0000 7f404c2e3200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-26T16:48:15.763 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Mar 26 16:48:15 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mgr-x[30858]: 2024-03-26T16:48:15.469+0000 7f404c2e3200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-26T16:48:16.016 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Mar 26 16:48:15 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mgr-x[30858]: 2024-03-26T16:48:15.761+0000 7f404c2e3200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-26T16:48:16.516 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Mar 26 16:48:16 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mgr-x[30858]: 2024-03-26T16:48:16.021+0000 7f404c2e3200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-26T16:48:16.516 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Mar 26 16:48:16 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mgr-x[30858]: 2024-03-26T16:48:16.264+0000 7f404c2e3200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-26T16:48:17.516 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Mar 26 16:48:17 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mgr-x[30858]: 2024-03-26T16:48:17.089+0000 7f404c2e3200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-26T16:48:17.990 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Mar 26 16:48:17 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mgr-x[30858]: 2024-03-26T16:48:17.667+0000 7f404c2e3200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-26T16:48:17.991 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Mar 26 16:48:17 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mgr-x[30858]: 2024-03-26T16:48:17.767+0000 7f404c2e3200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-26T16:48:17.991 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Mar 26 16:48:17 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mgr-x[30858]: 2024-03-26T16:48:17.988+0000 7f404c2e3200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-26T16:48:18.267 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:48:18 smithi044 ceph-mon[30624]: Active manager daemon x restarted 2024-03-26T16:48:18.267 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:48:18 smithi044 ceph-mon[30624]: Activating manager daemon x 2024-03-26T16:48:18.267 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:48:18 smithi044 ceph-mon[30624]: osdmap e3: 0 total, 0 up, 0 in 2024-03-26T16:48:18.267 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:48:18 smithi044 ceph-mon[30624]: mgrmap e10: x(active, starting, since 0.00306103s) 2024-03-26T16:48:18.267 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:48:18 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-03-26T16:48:18.267 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:48:18 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-03-26T16:48:18.267 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:48:18 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-03-26T16:48:18.267 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:48:18 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-03-26T16:48:18.267 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:48:18 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-03-26T16:48:18.267 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:48:18 smithi044 ceph-mon[30624]: Manager daemon x is now available 2024-03-26T16:48:18.267 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:48:18 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-26T16:48:19.266 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:48:19 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-03-26T16:48:19.266 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:48:19 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-03-26T16:48:19.267 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:48:19 smithi044 ceph-mon[30624]: mgrmap e11: x(active, since 1.00792s) 2024-03-26T16:48:19.593 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout { 2024-03-26T16:48:19.593 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-03-26T16:48:19.593 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "initialized": true 2024-03-26T16:48:19.593 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout } 2024-03-26T16:48:19.593 INFO:teuthology.orchestra.run.smithi044.stdout:mgr epoch 9 is available 2024-03-26T16:48:19.593 INFO:teuthology.orchestra.run.smithi044.stdout:Generating a dashboard self-signed certificate... 2024-03-26T16:48:20.266 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:48:20 smithi044 ceph-mon[30624]: [26/Mar/2024:16:48:18] ENGINE Bus STARTING 2024-03-26T16:48:20.266 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:48:20 smithi044 ceph-mon[30624]: [26/Mar/2024:16:48:18] ENGINE Serving on https://172.21.15.44:7150 2024-03-26T16:48:20.266 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:48:20 smithi044 ceph-mon[30624]: [26/Mar/2024:16:48:19] ENGINE Serving on http://172.21.15.44:8765 2024-03-26T16:48:20.266 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:48:20 smithi044 ceph-mon[30624]: [26/Mar/2024:16:48:19] ENGINE Bus STARTED 2024-03-26T16:48:20.267 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:48:20 smithi044 ceph-mon[30624]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-03-26T16:48:20.267 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:48:20 smithi044 ceph-mon[30624]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-03-26T16:48:20.842 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-03-26T16:48:20.842 INFO:teuthology.orchestra.run.smithi044.stdout:Creating initial admin user... 2024-03-26T16:48:21.159 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:48:21 smithi044 ceph-mon[30624]: mgrmap e12: x(active, since 2s) 2024-03-26T16:48:21.159 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:48:21 smithi044 ceph-mon[30624]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-03-26T16:48:21.159 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:48:21 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:48:21.159 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:48:21 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:48:21.159 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:48:21 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:48:22.466 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$U6ozHpCK1gaeuFfHHmb1wu47HzcPpatJBbyxrDy6QJenn2u9L1Nqu", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1711471701, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-03-26T16:48:22.466 INFO:teuthology.orchestra.run.smithi044.stdout:Fetching dashboard port number... 2024-03-26T16:48:23.061 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:48:22 smithi044 ceph-mon[30624]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-03-26T16:48:23.061 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:48:22 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:48:23.061 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:48:22 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:48:24.016 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:48:23 smithi044 ceph-mon[30624]: from='client.? 172.21.15.44:0/4074572051' entity='client.admin' cmd={"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} : dispatch 2024-03-26T16:48:24.354 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout 8443 2024-03-26T16:48:24.364 INFO:teuthology.orchestra.run.smithi044.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-03-26T16:48:24.364 INFO:teuthology.orchestra.run.smithi044.stdout:systemctl: stdout disabled 2024-03-26T16:48:24.371 INFO:teuthology.orchestra.run.smithi044.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-03-26T16:48:24.371 INFO:teuthology.orchestra.run.smithi044.stdout:systemctl: stdout inactive 2024-03-26T16:48:24.371 INFO:teuthology.orchestra.run.smithi044.stdout:firewalld.service is not enabled 2024-03-26T16:48:24.371 INFO:teuthology.orchestra.run.smithi044.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-03-26T16:48:24.373 INFO:teuthology.orchestra.run.smithi044.stdout:Ceph Dashboard is now available at: 2024-03-26T16:48:24.373 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-26T16:48:24.373 INFO:teuthology.orchestra.run.smithi044.stdout: URL: https://smithi044.front.sepia.ceph.com:8443/ 2024-03-26T16:48:24.373 INFO:teuthology.orchestra.run.smithi044.stdout: User: admin 2024-03-26T16:48:24.373 INFO:teuthology.orchestra.run.smithi044.stdout: Password: m48ksu4d5m 2024-03-26T16:48:24.373 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-26T16:48:24.374 INFO:teuthology.orchestra.run.smithi044.stdout:Saving cluster configuration to /var/lib/ceph/4394d798-eb90-11ee-95d0-87774f69a715/config directory 2024-03-26T16:48:24.374 INFO:teuthology.orchestra.run.smithi044.stdout:Enabling autotune for osd_memory_target 2024-03-26T16:48:25.901 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:48:25 smithi044 ceph-mon[30624]: mgrmap e13: x(active, since 6s) 2024-03-26T16:48:26.824 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-03-26T16:48:26.824 INFO:teuthology.orchestra.run.smithi044.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-03-26T16:48:26.824 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-26T16:48:26.824 INFO:teuthology.orchestra.run.smithi044.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 4394d798-eb90-11ee-95d0-87774f69a715 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-03-26T16:48:26.824 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-26T16:48:26.824 INFO:teuthology.orchestra.run.smithi044.stdout:Or, if you are only running a single cluster on this host: 2024-03-26T16:48:26.824 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-26T16:48:26.825 INFO:teuthology.orchestra.run.smithi044.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-03-26T16:48:26.825 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-26T16:48:26.825 INFO:teuthology.orchestra.run.smithi044.stdout:Please consider enabling telemetry to help improve Ceph: 2024-03-26T16:48:26.825 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-26T16:48:26.825 INFO:teuthology.orchestra.run.smithi044.stdout: ceph telemetry on 2024-03-26T16:48:26.825 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-26T16:48:26.825 INFO:teuthology.orchestra.run.smithi044.stdout:For more information see: 2024-03-26T16:48:26.825 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-26T16:48:26.825 INFO:teuthology.orchestra.run.smithi044.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-03-26T16:48:26.825 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-26T16:48:26.825 INFO:teuthology.orchestra.run.smithi044.stdout:Bootstrap complete. 2024-03-26T16:48:26.866 INFO:tasks.cephadm:Fetching config... 2024-03-26T16:48:26.867 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-03-26T16:48:26.867 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-03-26T16:48:26.883 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-03-26T16:48:26.883 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-03-26T16:48:26.883 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-03-26T16:48:26.940 INFO:tasks.cephadm:Fetching mon keyring... 2024-03-26T16:48:26.940 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-03-26T16:48:26.940 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd if=/var/lib/ceph/4394d798-eb90-11ee-95d0-87774f69a715/mon.a/keyring of=/dev/stdout 2024-03-26T16:48:27.008 INFO:tasks.cephadm:Fetching pub ssh key... 2024-03-26T16:48:27.008 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-03-26T16:48:27.008 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-03-26T16:48:27.062 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-03-26T16:48:27.062 DEBUG:teuthology.orchestra.run.smithi044:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC8WB797JJeMAwPcuW7N8XkPI6XkqMtanDOwJ2uM1o0zsvrRRwenKJ1qL3+ynLQMTmPjQeoBwyjGJ7PinuSYFFgwfjiGn0zgghl2XOQ0Ey7EEmqgNCMvtFgBTAmNOSNgZRlV/YPFYNKgnix0Y36O3pUjuBBi5wK0/NhQrkzv0eXl4z1tOyYKI3FDTpaUKaFyNX/OcVTdqkHcKtEq7XqW0h59/sYu1EgKkxW25hQ80orjz85e8SJWa7H+7JjT2MY/XsC5NTILhPo5eB7d1afWIiJPGP/RX7YPLBBy9QNpDdrHOzp7J+HdGjXBhxRYD6Um65smGhiI+0WDnDmafUEdYi3Rrm418K2MwmXaGyvzT2T3fCMds9kfIIFMGvL6FulBLraM43O6T4BgaTrRhugqMbSdgRzKiUi1VCTPHvSp3HPjELvgGp55s9sSF4UFEzpDTMWubs/Fyrv7RLSWXfO2NF2qV5ifZq8uonvZM8rBVJO92SEdAEYXDsay1zxYjjIjHE= ceph-4394d798-eb90-11ee-95d0-87774f69a715' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-03-26T16:48:27.155 INFO:teuthology.orchestra.run.smithi044.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC8WB797JJeMAwPcuW7N8XkPI6XkqMtanDOwJ2uM1o0zsvrRRwenKJ1qL3+ynLQMTmPjQeoBwyjGJ7PinuSYFFgwfjiGn0zgghl2XOQ0Ey7EEmqgNCMvtFgBTAmNOSNgZRlV/YPFYNKgnix0Y36O3pUjuBBi5wK0/NhQrkzv0eXl4z1tOyYKI3FDTpaUKaFyNX/OcVTdqkHcKtEq7XqW0h59/sYu1EgKkxW25hQ80orjz85e8SJWa7H+7JjT2MY/XsC5NTILhPo5eB7d1afWIiJPGP/RX7YPLBBy9QNpDdrHOzp7J+HdGjXBhxRYD6Um65smGhiI+0WDnDmafUEdYi3Rrm418K2MwmXaGyvzT2T3fCMds9kfIIFMGvL6FulBLraM43O6T4BgaTrRhugqMbSdgRzKiUi1VCTPHvSp3HPjELvgGp55s9sSF4UFEzpDTMWubs/Fyrv7RLSWXfO2NF2qV5ifZq8uonvZM8rBVJO92SEdAEYXDsay1zxYjjIjHE= ceph-4394d798-eb90-11ee-95d0-87774f69a715 2024-03-26T16:48:27.169 DEBUG:teuthology.orchestra.run.smithi064:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC8WB797JJeMAwPcuW7N8XkPI6XkqMtanDOwJ2uM1o0zsvrRRwenKJ1qL3+ynLQMTmPjQeoBwyjGJ7PinuSYFFgwfjiGn0zgghl2XOQ0Ey7EEmqgNCMvtFgBTAmNOSNgZRlV/YPFYNKgnix0Y36O3pUjuBBi5wK0/NhQrkzv0eXl4z1tOyYKI3FDTpaUKaFyNX/OcVTdqkHcKtEq7XqW0h59/sYu1EgKkxW25hQ80orjz85e8SJWa7H+7JjT2MY/XsC5NTILhPo5eB7d1afWIiJPGP/RX7YPLBBy9QNpDdrHOzp7J+HdGjXBhxRYD6Um65smGhiI+0WDnDmafUEdYi3Rrm418K2MwmXaGyvzT2T3fCMds9kfIIFMGvL6FulBLraM43O6T4BgaTrRhugqMbSdgRzKiUi1VCTPHvSp3HPjELvgGp55s9sSF4UFEzpDTMWubs/Fyrv7RLSWXfO2NF2qV5ifZq8uonvZM8rBVJO92SEdAEYXDsay1zxYjjIjHE= ceph-4394d798-eb90-11ee-95d0-87774f69a715' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-03-26T16:48:27.215 INFO:teuthology.orchestra.run.smithi064.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC8WB797JJeMAwPcuW7N8XkPI6XkqMtanDOwJ2uM1o0zsvrRRwenKJ1qL3+ynLQMTmPjQeoBwyjGJ7PinuSYFFgwfjiGn0zgghl2XOQ0Ey7EEmqgNCMvtFgBTAmNOSNgZRlV/YPFYNKgnix0Y36O3pUjuBBi5wK0/NhQrkzv0eXl4z1tOyYKI3FDTpaUKaFyNX/OcVTdqkHcKtEq7XqW0h59/sYu1EgKkxW25hQ80orjz85e8SJWa7H+7JjT2MY/XsC5NTILhPo5eB7d1afWIiJPGP/RX7YPLBBy9QNpDdrHOzp7J+HdGjXBhxRYD6Um65smGhiI+0WDnDmafUEdYi3Rrm418K2MwmXaGyvzT2T3fCMds9kfIIFMGvL6FulBLraM43O6T4BgaTrRhugqMbSdgRzKiUi1VCTPHvSp3HPjELvgGp55s9sSF4UFEzpDTMWubs/Fyrv7RLSWXfO2NF2qV5ifZq8uonvZM8rBVJO92SEdAEYXDsay1zxYjjIjHE= ceph-4394d798-eb90-11ee-95d0-87774f69a715 2024-03-26T16:48:27.230 DEBUG:teuthology.orchestra.run.smithi149:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC8WB797JJeMAwPcuW7N8XkPI6XkqMtanDOwJ2uM1o0zsvrRRwenKJ1qL3+ynLQMTmPjQeoBwyjGJ7PinuSYFFgwfjiGn0zgghl2XOQ0Ey7EEmqgNCMvtFgBTAmNOSNgZRlV/YPFYNKgnix0Y36O3pUjuBBi5wK0/NhQrkzv0eXl4z1tOyYKI3FDTpaUKaFyNX/OcVTdqkHcKtEq7XqW0h59/sYu1EgKkxW25hQ80orjz85e8SJWa7H+7JjT2MY/XsC5NTILhPo5eB7d1afWIiJPGP/RX7YPLBBy9QNpDdrHOzp7J+HdGjXBhxRYD6Um65smGhiI+0WDnDmafUEdYi3Rrm418K2MwmXaGyvzT2T3fCMds9kfIIFMGvL6FulBLraM43O6T4BgaTrRhugqMbSdgRzKiUi1VCTPHvSp3HPjELvgGp55s9sSF4UFEzpDTMWubs/Fyrv7RLSWXfO2NF2qV5ifZq8uonvZM8rBVJO92SEdAEYXDsay1zxYjjIjHE= ceph-4394d798-eb90-11ee-95d0-87774f69a715' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-03-26T16:48:27.275 INFO:teuthology.orchestra.run.smithi149.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC8WB797JJeMAwPcuW7N8XkPI6XkqMtanDOwJ2uM1o0zsvrRRwenKJ1qL3+ynLQMTmPjQeoBwyjGJ7PinuSYFFgwfjiGn0zgghl2XOQ0Ey7EEmqgNCMvtFgBTAmNOSNgZRlV/YPFYNKgnix0Y36O3pUjuBBi5wK0/NhQrkzv0eXl4z1tOyYKI3FDTpaUKaFyNX/OcVTdqkHcKtEq7XqW0h59/sYu1EgKkxW25hQ80orjz85e8SJWa7H+7JjT2MY/XsC5NTILhPo5eB7d1afWIiJPGP/RX7YPLBBy9QNpDdrHOzp7J+HdGjXBhxRYD6Um65smGhiI+0WDnDmafUEdYi3Rrm418K2MwmXaGyvzT2T3fCMds9kfIIFMGvL6FulBLraM43O6T4BgaTrRhugqMbSdgRzKiUi1VCTPHvSp3HPjELvgGp55s9sSF4UFEzpDTMWubs/Fyrv7RLSWXfO2NF2qV5ifZq8uonvZM8rBVJO92SEdAEYXDsay1zxYjjIjHE= ceph-4394d798-eb90-11ee-95d0-87774f69a715 2024-03-26T16:48:27.290 DEBUG:teuthology.orchestra.run.smithi157:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC8WB797JJeMAwPcuW7N8XkPI6XkqMtanDOwJ2uM1o0zsvrRRwenKJ1qL3+ynLQMTmPjQeoBwyjGJ7PinuSYFFgwfjiGn0zgghl2XOQ0Ey7EEmqgNCMvtFgBTAmNOSNgZRlV/YPFYNKgnix0Y36O3pUjuBBi5wK0/NhQrkzv0eXl4z1tOyYKI3FDTpaUKaFyNX/OcVTdqkHcKtEq7XqW0h59/sYu1EgKkxW25hQ80orjz85e8SJWa7H+7JjT2MY/XsC5NTILhPo5eB7d1afWIiJPGP/RX7YPLBBy9QNpDdrHOzp7J+HdGjXBhxRYD6Um65smGhiI+0WDnDmafUEdYi3Rrm418K2MwmXaGyvzT2T3fCMds9kfIIFMGvL6FulBLraM43O6T4BgaTrRhugqMbSdgRzKiUi1VCTPHvSp3HPjELvgGp55s9sSF4UFEzpDTMWubs/Fyrv7RLSWXfO2NF2qV5ifZq8uonvZM8rBVJO92SEdAEYXDsay1zxYjjIjHE= ceph-4394d798-eb90-11ee-95d0-87774f69a715' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-03-26T16:48:27.340 INFO:teuthology.orchestra.run.smithi157.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC8WB797JJeMAwPcuW7N8XkPI6XkqMtanDOwJ2uM1o0zsvrRRwenKJ1qL3+ynLQMTmPjQeoBwyjGJ7PinuSYFFgwfjiGn0zgghl2XOQ0Ey7EEmqgNCMvtFgBTAmNOSNgZRlV/YPFYNKgnix0Y36O3pUjuBBi5wK0/NhQrkzv0eXl4z1tOyYKI3FDTpaUKaFyNX/OcVTdqkHcKtEq7XqW0h59/sYu1EgKkxW25hQ80orjz85e8SJWa7H+7JjT2MY/XsC5NTILhPo5eB7d1afWIiJPGP/RX7YPLBBy9QNpDdrHOzp7J+HdGjXBhxRYD6Um65smGhiI+0WDnDmafUEdYi3Rrm418K2MwmXaGyvzT2T3fCMds9kfIIFMGvL6FulBLraM43O6T4BgaTrRhugqMbSdgRzKiUi1VCTPHvSp3HPjELvgGp55s9sSF4UFEzpDTMWubs/Fyrv7RLSWXfO2NF2qV5ifZq8uonvZM8rBVJO92SEdAEYXDsay1zxYjjIjHE= ceph-4394d798-eb90-11ee-95d0-87774f69a715 2024-03-26T16:48:27.356 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bf9505fb569e9b95a78f9700ed8c4bd20508ef55 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4394d798-eb90-11ee-95d0-87774f69a715 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-03-26T16:48:27.380 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:48:27 smithi044 ceph-mon[30624]: from='client.? 172.21.15.44:0/604347589' entity='client.admin' 2024-03-26T16:48:27.593 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/4394d798-eb90-11ee-95d0-87774f69a715/mon.a/config 2024-03-26T16:48:31.168 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-03-26T16:48:31.169 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bf9505fb569e9b95a78f9700ed8c4bd20508ef55 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4394d798-eb90-11ee-95d0-87774f69a715 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-03-26T16:48:31.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:48:31 smithi044 ceph-mon[30624]: from='client.? 172.21.15.44:0/3972560603' entity='client.admin' 2024-03-26T16:48:31.683 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/4394d798-eb90-11ee-95d0-87774f69a715/mon.a/config 2024-03-26T16:48:32.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:48:32 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:48:32.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:48:32 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:48:32.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:48:32 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi044", "name": "osd_memory_target"} : dispatch 2024-03-26T16:48:32.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:48:32 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:48:32.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:48:32 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-26T16:48:32.741 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:48:32 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:48:34.202 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi064 2024-03-26T16:48:34.202 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-03-26T16:48:34.202 DEBUG:teuthology.orchestra.run.smithi064:> dd of=/etc/ceph/ceph.conf 2024-03-26T16:48:34.220 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-03-26T16:48:34.220 DEBUG:teuthology.orchestra.run.smithi064:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-03-26T16:48:34.277 INFO:tasks.cephadm:Adding host smithi064 to orchestrator... 2024-03-26T16:48:34.278 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bf9505fb569e9b95a78f9700ed8c4bd20508ef55 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4394d798-eb90-11ee-95d0-87774f69a715 -- ceph orch host add smithi064 2024-03-26T16:48:34.515 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/4394d798-eb90-11ee-95d0-87774f69a715/mon.a/config 2024-03-26T16:48:34.766 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:48:34 smithi044 ceph-mon[30624]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-03-26T16:48:34.766 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:48:34 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:48:34.767 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:48:34 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-26T16:48:34.767 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:48:34 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T16:48:34.767 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:48:34 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-26T16:48:34.767 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:48:34 smithi044 ceph-mon[30624]: Updating smithi044:/etc/ceph/ceph.conf 2024-03-26T16:48:34.767 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:48:34 smithi044 ceph-mon[30624]: Updating smithi044:/var/lib/ceph/4394d798-eb90-11ee-95d0-87774f69a715/config/ceph.conf 2024-03-26T16:48:34.767 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:48:34 smithi044 ceph-mon[30624]: Updating smithi044:/etc/ceph/ceph.client.admin.keyring 2024-03-26T16:48:34.767 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:48:34 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:48:34.767 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:48:34 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:48:34.767 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:48:34 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:48:35.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:48:35 smithi044 ceph-mon[30624]: Updating smithi044:/var/lib/ceph/4394d798-eb90-11ee-95d0-87774f69a715/config/ceph.client.admin.keyring 2024-03-26T16:48:37.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:48:37 smithi044 ceph-mon[30624]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi064", "target": ["mon-mgr", ""]}]: dispatch 2024-03-26T16:48:37.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:48:37 smithi044 ceph-mon[30624]: Deploying cephadm binary to smithi064 2024-03-26T16:48:38.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:48:38 smithi044 ceph-mon[30624]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-26T16:48:40.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:48:40 smithi044 ceph-mon[30624]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-26T16:48:40.685 INFO:teuthology.orchestra.run.smithi044.stdout:Added host 'smithi064' with addr '172.21.15.64' 2024-03-26T16:48:41.362 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bf9505fb569e9b95a78f9700ed8c4bd20508ef55 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4394d798-eb90-11ee-95d0-87774f69a715 -- ceph orch host ls --format=json 2024-03-26T16:48:41.607 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/4394d798-eb90-11ee-95d0-87774f69a715/mon.a/config 2024-03-26T16:48:42.014 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:48:41 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:48:42.015 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:48:41 smithi044 ceph-mon[30624]: Added host smithi064 2024-03-26T16:48:42.015 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:48:41 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-26T16:48:42.015 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:48:41 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:48:42.874 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:48:42 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:48:42.875 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:48:42 smithi044 ceph-mon[30624]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-26T16:48:43.321 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-26T16:48:43.321 INFO:teuthology.orchestra.run.smithi044.stdout:[{"addr": "172.21.15.44", "hostname": "smithi044", "labels": [], "status": ""}, {"addr": "172.21.15.64", "hostname": "smithi064", "labels": [], "status": ""}] 2024-03-26T16:48:43.986 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi149 2024-03-26T16:48:43.986 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-03-26T16:48:43.986 DEBUG:teuthology.orchestra.run.smithi149:> dd of=/etc/ceph/ceph.conf 2024-03-26T16:48:44.004 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-03-26T16:48:44.004 DEBUG:teuthology.orchestra.run.smithi149:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-03-26T16:48:44.061 INFO:tasks.cephadm:Adding host smithi149 to orchestrator... 2024-03-26T16:48:44.061 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bf9505fb569e9b95a78f9700ed8c4bd20508ef55 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4394d798-eb90-11ee-95d0-87774f69a715 -- ceph orch host add smithi149 2024-03-26T16:48:44.302 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/4394d798-eb90-11ee-95d0-87774f69a715/mon.a/config 2024-03-26T16:48:44.703 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:48:44 smithi044 ceph-mon[30624]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-26T16:48:44.703 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:48:44 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:48:44.703 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:48:44 smithi044 ceph-mon[30624]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-26T16:48:46.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:48:46 smithi044 ceph-mon[30624]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi149", "target": ["mon-mgr", ""]}]: dispatch 2024-03-26T16:48:46.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:48:46 smithi044 ceph-mon[30624]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-26T16:48:48.016 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:48:47 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:48:48.016 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:48:47 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:48:48.016 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:48:47 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:48:48.017 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:48:47 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:48:48.017 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:48:47 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi064", "name": "osd_memory_target"} : dispatch 2024-03-26T16:48:48.017 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:48:47 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T16:48:48.017 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:48:47 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-26T16:48:48.017 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:48:47 smithi044 ceph-mon[30624]: Updating smithi064:/etc/ceph/ceph.conf 2024-03-26T16:48:48.017 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:48:47 smithi044 ceph-mon[30624]: Deploying cephadm binary to smithi149 2024-03-26T16:48:48.017 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:48:47 smithi044 ceph-mon[30624]: Updating smithi064:/var/lib/ceph/4394d798-eb90-11ee-95d0-87774f69a715/config/ceph.conf 2024-03-26T16:48:49.016 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:48:48 smithi044 ceph-mon[30624]: Updating smithi064:/etc/ceph/ceph.client.admin.keyring 2024-03-26T16:48:49.016 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:48:48 smithi044 ceph-mon[30624]: Updating smithi064:/var/lib/ceph/4394d798-eb90-11ee-95d0-87774f69a715/config/ceph.client.admin.keyring 2024-03-26T16:48:49.016 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:48:48 smithi044 ceph-mon[30624]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-26T16:48:50.436 INFO:teuthology.orchestra.run.smithi044.stdout:Added host 'smithi149' with addr '172.21.15.149' 2024-03-26T16:48:51.016 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:48:50 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:48:51.016 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:48:50 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:48:51.016 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:48:50 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:48:51.017 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:48:50 smithi044 ceph-mon[30624]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-26T16:48:51.017 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:48:50 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:48:51.017 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:48:50 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-26T16:48:51.072 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bf9505fb569e9b95a78f9700ed8c4bd20508ef55 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4394d798-eb90-11ee-95d0-87774f69a715 -- ceph orch host ls --format=json 2024-03-26T16:48:51.314 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/4394d798-eb90-11ee-95d0-87774f69a715/mon.a/config 2024-03-26T16:48:52.266 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:48:51 smithi044 ceph-mon[30624]: Added host smithi149 2024-03-26T16:48:52.266 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:48:51 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:48:52.266 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:48:51 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:48:52.958 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-26T16:48:52.958 INFO:teuthology.orchestra.run.smithi044.stdout:[{"addr": "172.21.15.44", "hostname": "smithi044", "labels": [], "status": ""}, {"addr": "172.21.15.64", "hostname": "smithi064", "labels": [], "status": ""}, {"addr": "172.21.15.149", "hostname": "smithi149", "labels": [], "status": ""}] 2024-03-26T16:48:53.266 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:48:52 smithi044 ceph-mon[30624]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-26T16:48:53.697 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi157 2024-03-26T16:48:53.697 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-03-26T16:48:53.697 DEBUG:teuthology.orchestra.run.smithi157:> dd of=/etc/ceph/ceph.conf 2024-03-26T16:48:53.717 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-03-26T16:48:53.717 DEBUG:teuthology.orchestra.run.smithi157:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-03-26T16:48:53.774 INFO:tasks.cephadm:Adding host smithi157 to orchestrator... 2024-03-26T16:48:53.775 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bf9505fb569e9b95a78f9700ed8c4bd20508ef55 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4394d798-eb90-11ee-95d0-87774f69a715 -- ceph orch host add smithi157 2024-03-26T16:48:54.020 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/4394d798-eb90-11ee-95d0-87774f69a715/mon.a/config 2024-03-26T16:48:54.250 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:48:53 smithi044 ceph-mon[30624]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-26T16:48:54.250 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:48:53 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:48:55.221 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:48:54 smithi044 ceph-mon[30624]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-26T16:48:56.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:48:56 smithi044 ceph-mon[30624]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi157", "target": ["mon-mgr", ""]}]: dispatch 2024-03-26T16:48:56.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:48:56 smithi044 ceph-mon[30624]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-26T16:48:57.766 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:48:57 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:48:57.766 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:48:57 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:48:57.766 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:48:57 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:48:57.767 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:48:57 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:48:57.767 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:48:57 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi149", "name": "osd_memory_target"} : dispatch 2024-03-26T16:48:57.767 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:48:57 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T16:48:57.767 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:48:57 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-26T16:48:57.767 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:48:57 smithi044 ceph-mon[30624]: Updating smithi149:/etc/ceph/ceph.conf 2024-03-26T16:48:57.767 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:48:57 smithi044 ceph-mon[30624]: Deploying cephadm binary to smithi157 2024-03-26T16:48:57.767 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:48:57 smithi044 ceph-mon[30624]: Updating smithi149:/var/lib/ceph/4394d798-eb90-11ee-95d0-87774f69a715/config/ceph.conf 2024-03-26T16:48:57.767 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:48:57 smithi044 ceph-mon[30624]: Updating smithi149:/etc/ceph/ceph.client.admin.keyring 2024-03-26T16:48:58.667 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:48:58 smithi044 ceph-mon[30624]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-26T16:49:00.171 INFO:teuthology.orchestra.run.smithi044.stdout:Added host 'smithi157' with addr '172.21.15.157' 2024-03-26T16:49:00.741 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bf9505fb569e9b95a78f9700ed8c4bd20508ef55 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4394d798-eb90-11ee-95d0-87774f69a715 -- ceph orch host ls --format=json 2024-03-26T16:49:00.979 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/4394d798-eb90-11ee-95d0-87774f69a715/mon.a/config 2024-03-26T16:49:01.016 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:00 smithi044 ceph-mon[30624]: Updating smithi149:/var/lib/ceph/4394d798-eb90-11ee-95d0-87774f69a715/config/ceph.client.admin.keyring 2024-03-26T16:49:01.016 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:00 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:49:01.016 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:00 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:49:01.016 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:00 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:49:01.016 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:00 smithi044 ceph-mon[30624]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-26T16:49:01.016 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:00 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:49:01.017 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:00 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-26T16:49:01.017 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:00 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:49:02.016 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:01 smithi044 ceph-mon[30624]: Added host smithi157 2024-03-26T16:49:02.016 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:01 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:49:02.655 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-26T16:49:02.656 INFO:teuthology.orchestra.run.smithi044.stdout:[{"addr": "172.21.15.44", "hostname": "smithi044", "labels": [], "status": ""}, {"addr": "172.21.15.64", "hostname": "smithi064", "labels": [], "status": ""}, {"addr": "172.21.15.149", "hostname": "smithi149", "labels": [], "status": ""}, {"addr": "172.21.15.157", "hostname": "smithi157", "labels": [], "status": ""}] 2024-03-26T16:49:03.016 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:02 smithi044 ceph-mon[30624]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-26T16:49:03.374 INFO:tasks.cephadm:Setting crush tunables to default 2024-03-26T16:49:03.375 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bf9505fb569e9b95a78f9700ed8c4bd20508ef55 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4394d798-eb90-11ee-95d0-87774f69a715 -- ceph osd crush tunables default 2024-03-26T16:49:03.618 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/4394d798-eb90-11ee-95d0-87774f69a715/mon.a/config 2024-03-26T16:49:04.266 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:04 smithi044 ceph-mon[30624]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-26T16:49:04.266 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:04 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:49:05.266 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:05 smithi044 ceph-mon[30624]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-26T16:49:06.049 INFO:teuthology.orchestra.run.smithi044.stderr:adjusted tunables profile to default 2024-03-26T16:49:06.379 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:06 smithi044 ceph-mon[30624]: from='client.? 172.21.15.44:0/3179033752' entity='client.admin' cmd={"prefix": "osd crush tunables", "profile": "default"} : dispatch 2024-03-26T16:49:06.716 INFO:tasks.cephadm:Adding mon.a on smithi044 2024-03-26T16:49:06.716 INFO:tasks.cephadm:Adding mon.b on smithi064 2024-03-26T16:49:06.716 INFO:tasks.cephadm:Adding mon.c on smithi149 2024-03-26T16:49:06.716 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bf9505fb569e9b95a78f9700ed8c4bd20508ef55 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4394d798-eb90-11ee-95d0-87774f69a715 -- ceph orch apply mon '3;smithi044:172.21.15.44=a;smithi064:172.21.15.64=b;smithi149:172.21.15.149=c' 2024-03-26T16:49:06.956 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/4394d798-eb90-11ee-95d0-87774f69a715/config/ceph.conf 2024-03-26T16:49:07.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:07 smithi044 ceph-mon[30624]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-26T16:49:07.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:07 smithi044 ceph-mon[30624]: from='client.? 172.21.15.44:0/3179033752' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-03-26T16:49:07.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:07 smithi044 ceph-mon[30624]: osdmap e4: 0 total, 0 up, 0 in 2024-03-26T16:49:07.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:07 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:49:07.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:07 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:49:07.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:07 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:49:07.517 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:07 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:49:07.517 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:07 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi157", "name": "osd_memory_target"} : dispatch 2024-03-26T16:49:07.517 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:07 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T16:49:07.517 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:07 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-26T16:49:07.517 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:07 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:49:07.517 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:07 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:49:07.517 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:07 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:49:08.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:08 smithi044 ceph-mon[30624]: Updating smithi157:/etc/ceph/ceph.conf 2024-03-26T16:49:08.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:08 smithi044 ceph-mon[30624]: Updating smithi157:/var/lib/ceph/4394d798-eb90-11ee-95d0-87774f69a715/config/ceph.conf 2024-03-26T16:49:08.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:08 smithi044 ceph-mon[30624]: Updating smithi157:/etc/ceph/ceph.client.admin.keyring 2024-03-26T16:49:08.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:08 smithi044 ceph-mon[30624]: Updating smithi157:/var/lib/ceph/4394d798-eb90-11ee-95d0-87774f69a715/config/ceph.client.admin.keyring 2024-03-26T16:49:08.682 INFO:teuthology.orchestra.run.smithi157.stdout:Scheduled mon update... 2024-03-26T16:49:09.211 DEBUG:teuthology.orchestra.run.smithi064:mon.b> sudo journalctl -f -n 0 -u ceph-4394d798-eb90-11ee-95d0-87774f69a715@mon.b.service 2024-03-26T16:49:09.214 DEBUG:teuthology.orchestra.run.smithi149:mon.c> sudo journalctl -f -n 0 -u ceph-4394d798-eb90-11ee-95d0-87774f69a715@mon.c.service 2024-03-26T16:49:09.216 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-03-26T16:49:09.216 DEBUG:teuthology.orchestra.run.smithi149:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bf9505fb569e9b95a78f9700ed8c4bd20508ef55 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4394d798-eb90-11ee-95d0-87774f69a715 -- ceph mon dump -f json 2024-03-26T16:49:09.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:09 smithi044 ceph-mon[30624]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-26T16:49:09.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:09 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:49:09.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:09 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-26T16:49:09.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:09 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T16:49:09.517 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:09 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-26T16:49:09.517 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:09 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:49:09.517 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:09 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-03-26T16:49:09.517 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:09 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T16:49:09.938 INFO:teuthology.orchestra.run.smithi149.stderr:Inferring config /var/lib/ceph/4394d798-eb90-11ee-95d0-87774f69a715/config/ceph.conf 2024-03-26T16:49:10.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:10 smithi044 ceph-mon[30624]: from='client.14192 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi044:172.21.15.44=a;smithi064:172.21.15.64=b;smithi149:172.21.15.149=c", "target": ["mon-mgr", ""]}]: dispatch 2024-03-26T16:49:10.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:10 smithi044 ceph-mon[30624]: Saving service mon spec with placement smithi044:172.21.15.44=a;smithi064:172.21.15.64=b;smithi149:172.21.15.149=c;count:3 2024-03-26T16:49:10.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:10 smithi044 ceph-mon[30624]: Deploying daemon mon.c on smithi149 2024-03-26T16:49:11.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:11 smithi044 ceph-mon[30624]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-26T16:49:12.354 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-03-26T16:49:12.354 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":1,"fsid":"4394d798-eb90-11ee-95d0-87774f69a715","modified":"2024-03-26T16:47:15.492869Z","created":"2024-03-26T16:47:15.492869Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:3300","nonce":0},{"type":"v1","addr":"172.21.15.44:6789","nonce":0}]},"addr":"172.21.15.44:6789/0","public_addr":"172.21.15.44:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-03-26T16:49:12.356 INFO:teuthology.orchestra.run.smithi149.stderr:dumped monmap epoch 1 2024-03-26T16:49:13.425 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:13 smithi044 ceph-mon[30624]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-26T16:49:13.425 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:13 smithi044 ceph-mon[30624]: from='client.? 172.21.15.149:0/1012955610' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-03-26T16:49:13.904 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-03-26T16:49:13.905 DEBUG:teuthology.orchestra.run.smithi149:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bf9505fb569e9b95a78f9700ed8c4bd20508ef55 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4394d798-eb90-11ee-95d0-87774f69a715 -- ceph mon dump -f json 2024-03-26T16:49:14.299 INFO:teuthology.orchestra.run.smithi149.stderr:Inferring config /var/lib/ceph/4394d798-eb90-11ee-95d0-87774f69a715/mon.c/config 2024-03-26T16:49:14.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:14 smithi149 systemd[1]: Starting Ceph mon.c for 4394d798-eb90-11ee-95d0-87774f69a715... 2024-03-26T16:49:15.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:15 smithi044 ceph-mon[30624]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-26T16:49:15.897 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:15 smithi149 podman[34634]: 2024-03-26 16:49:15.604989997 +0000 UTC m=+0.018511102 image pull 5795ddf102746261652aa1cd1f517ace4dcfb8739ebbf229aeb81830d793ada0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:01ae7457193b3f46a870db683661dbc281d60ce54f0968f4de09bc4e5ad0a734 2024-03-26T16:49:16.116 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-03-26T16:49:16.116 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":1,"fsid":"4394d798-eb90-11ee-95d0-87774f69a715","modified":"2024-03-26T16:47:15.492869Z","created":"2024-03-26T16:47:15.492869Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:3300","nonce":0},{"type":"v1","addr":"172.21.15.44:6789","nonce":0}]},"addr":"172.21.15.44:6789/0","public_addr":"172.21.15.44:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-03-26T16:49:16.118 INFO:teuthology.orchestra.run.smithi149.stderr:dumped monmap epoch 1 2024-03-26T16:49:16.218 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:15 smithi149 podman[34634]: 2024-03-26 16:49:15.931181753 +0000 UTC m=+0.344702853 container create b3ca6d321ad12af1f8bcf05a6f2e49657f2b7d2f528f5ada141a03de8d7dbbad (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:01ae7457193b3f46a870db683661dbc281d60ce54f0968f4de09bc4e5ad0a734, name=ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=ceph-nvmeof-mon-bf9505f, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240319, io.buildah.version=1.33.5, ceph=True, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0) 2024-03-26T16:49:16.219 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 podman[34634]: 2024-03-26 16:49:16.116727589 +0000 UTC m=+0.530248689 container init b3ca6d321ad12af1f8bcf05a6f2e49657f2b7d2f528f5ada141a03de8d7dbbad (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:01ae7457193b3f46a870db683661dbc281d60ce54f0968f4de09bc4e5ad0a734, name=ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, RELEASE=ceph-nvmeof-mon-bf9505f, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240319, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-26T16:49:16.219 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 podman[34634]: 2024-03-26 16:49:16.119872098 +0000 UTC m=+0.533393198 container start b3ca6d321ad12af1f8bcf05a6f2e49657f2b7d2f528f5ada141a03de8d7dbbad (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:01ae7457193b3f46a870db683661dbc281d60ce54f0968f4de09bc4e5ad0a734, name=ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240319, org.label-schema.license=GPLv2, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=ceph-nvmeof-mon-bf9505f, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-26T16:49:16.219 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: set uid:gid to 167:167 (ceph:ceph) 2024-03-26T16:49:16.219 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: ceph version 19.0.0-2382-gbf9505fb (bf9505fb569e9b95a78f9700ed8c4bd20508ef55) squid (dev), process ceph-mon, pid 2 2024-03-26T16:49:16.219 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: pidfile_write: ignore empty --pid-file 2024-03-26T16:49:16.219 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: load: jerasure load: lrc 2024-03-26T16:49:16.219 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: RocksDB version: 7.9.2 2024-03-26T16:49:16.219 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: Git sha 0 2024-03-26T16:49:16.219 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: Compile date 2024-03-24 17:12:44 2024-03-26T16:49:16.219 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: DB SUMMARY 2024-03-26T16:49:16.219 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: DB Session ID: 7OJM6PMYK12SNWFKPT9M 2024-03-26T16:49:16.220 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: CURRENT file: CURRENT 2024-03-26T16:49:16.220 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: IDENTITY file: IDENTITY 2024-03-26T16:49:16.220 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-03-26T16:49:16.220 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 0, files: 2024-03-26T16:49:16.220 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000004.log size: 511 ; 2024-03-26T16:49:16.220 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: Options.error_if_exists: 0 2024-03-26T16:49:16.220 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: Options.create_if_missing: 0 2024-03-26T16:49:16.220 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: Options.paranoid_checks: 1 2024-03-26T16:49:16.220 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: Options.flush_verify_memtable_count: 1 2024-03-26T16:49:16.220 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-03-26T16:49:16.220 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-03-26T16:49:16.220 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: Options.env: 0x562e6c124060 2024-03-26T16:49:16.220 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: Options.fs: PosixFileSystem 2024-03-26T16:49:16.221 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: Options.info_log: 0x562e6d221b20 2024-03-26T16:49:16.221 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: Options.max_file_opening_threads: 16 2024-03-26T16:49:16.221 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: Options.statistics: (nil) 2024-03-26T16:49:16.221 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: Options.use_fsync: 0 2024-03-26T16:49:16.221 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: Options.max_log_file_size: 0 2024-03-26T16:49:16.221 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-03-26T16:49:16.221 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: Options.log_file_time_to_roll: 0 2024-03-26T16:49:16.221 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: Options.keep_log_file_num: 1000 2024-03-26T16:49:16.221 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: Options.recycle_log_file_num: 0 2024-03-26T16:49:16.221 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: Options.allow_fallocate: 1 2024-03-26T16:49:16.221 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: Options.allow_mmap_reads: 0 2024-03-26T16:49:16.221 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: Options.allow_mmap_writes: 0 2024-03-26T16:49:16.221 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: Options.use_direct_reads: 0 2024-03-26T16:49:16.222 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-03-26T16:49:16.222 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: Options.create_missing_column_families: 0 2024-03-26T16:49:16.222 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: Options.db_log_dir: 2024-03-26T16:49:16.222 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: Options.wal_dir: 2024-03-26T16:49:16.222 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: Options.table_cache_numshardbits: 6 2024-03-26T16:49:16.222 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: Options.WAL_ttl_seconds: 0 2024-03-26T16:49:16.222 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: Options.WAL_size_limit_MB: 0 2024-03-26T16:49:16.222 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-03-26T16:49:16.222 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-03-26T16:49:16.222 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: Options.is_fd_close_on_exec: 1 2024-03-26T16:49:16.222 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: Options.advise_random_on_open: 1 2024-03-26T16:49:16.222 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: Options.db_write_buffer_size: 0 2024-03-26T16:49:16.222 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: Options.write_buffer_manager: 0x562e6d1f21e0 2024-03-26T16:49:16.222 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-03-26T16:49:16.222 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-03-26T16:49:16.223 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: Options.use_adaptive_mutex: 0 2024-03-26T16:49:16.223 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: Options.rate_limiter: (nil) 2024-03-26T16:49:16.223 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-03-26T16:49:16.223 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: Options.wal_recovery_mode: 2 2024-03-26T16:49:16.223 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: Options.enable_thread_tracking: 0 2024-03-26T16:49:16.225 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: Options.enable_pipelined_write: 0 2024-03-26T16:49:16.225 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: Options.unordered_write: 0 2024-03-26T16:49:16.225 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-03-26T16:49:16.225 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-03-26T16:49:16.225 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-03-26T16:49:16.225 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-03-26T16:49:16.225 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: Options.row_cache: None 2024-03-26T16:49:16.225 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: Options.wal_filter: None 2024-03-26T16:49:16.225 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-03-26T16:49:16.225 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: Options.allow_ingest_behind: 0 2024-03-26T16:49:16.226 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: Options.two_write_queues: 0 2024-03-26T16:49:16.226 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: Options.manual_wal_flush: 0 2024-03-26T16:49:16.226 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: Options.wal_compression: 0 2024-03-26T16:49:16.226 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: Options.atomic_flush: 0 2024-03-26T16:49:16.226 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-03-26T16:49:16.226 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: Options.persist_stats_to_disk: 0 2024-03-26T16:49:16.226 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: Options.write_dbid_to_manifest: 0 2024-03-26T16:49:16.226 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: Options.log_readahead_size: 0 2024-03-26T16:49:16.226 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-03-26T16:49:16.226 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: Options.best_efforts_recovery: 0 2024-03-26T16:49:16.226 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-03-26T16:49:16.226 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-03-26T16:49:16.226 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: Options.allow_data_in_errors: 0 2024-03-26T16:49:16.226 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: Options.db_host_id: __hostname__ 2024-03-26T16:49:16.227 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: Options.enforce_single_del_contracts: true 2024-03-26T16:49:16.227 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: Options.max_background_jobs: 2 2024-03-26T16:49:16.227 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: Options.max_background_compactions: -1 2024-03-26T16:49:16.227 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: Options.max_subcompactions: 1 2024-03-26T16:49:16.227 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-03-26T16:49:16.227 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-03-26T16:49:16.227 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: Options.delayed_write_rate : 16777216 2024-03-26T16:49:16.227 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: Options.max_total_wal_size: 0 2024-03-26T16:49:16.227 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-03-26T16:49:16.227 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: Options.stats_dump_period_sec: 600 2024-03-26T16:49:16.227 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: Options.stats_persist_period_sec: 600 2024-03-26T16:49:16.227 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-03-26T16:49:16.227 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: Options.max_open_files: -1 2024-03-26T16:49:16.228 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: Options.bytes_per_sync: 0 2024-03-26T16:49:16.228 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: Options.wal_bytes_per_sync: 0 2024-03-26T16:49:16.228 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: Options.strict_bytes_per_sync: 0 2024-03-26T16:49:16.228 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: Options.compaction_readahead_size: 0 2024-03-26T16:49:16.228 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: Options.max_background_flushes: -1 2024-03-26T16:49:16.228 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: Compression algorithms supported: 2024-03-26T16:49:16.228 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-03-26T16:49:16.228 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: kZSTD supported: 0 2024-03-26T16:49:16.228 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: kXpressCompression supported: 0 2024-03-26T16:49:16.228 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: kLZ4HCCompression supported: 1 2024-03-26T16:49:16.228 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: kZlibCompression supported: 1 2024-03-26T16:49:16.228 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: kSnappyCompression supported: 1 2024-03-26T16:49:16.228 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: kLZ4Compression supported: 1 2024-03-26T16:49:16.229 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: kBZip2Compression supported: 0 2024-03-26T16:49:16.229 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: Fast CRC32 supported: Supported on x86 2024-03-26T16:49:16.229 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: DMutex implementation: pthread_mutex_t 2024-03-26T16:49:16.229 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 2024-03-26T16:49:16.229 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-03-26T16:49:16.229 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-03-26T16:49:16.229 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: Options.merge_operator: 2024-03-26T16:49:16.229 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: Options.compaction_filter: None 2024-03-26T16:49:16.229 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: Options.compaction_filter_factory: None 2024-03-26T16:49:16.229 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: Options.sst_partitioner_factory: None 2024-03-26T16:49:16.229 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: Options.memtable_factory: SkipListFactory 2024-03-26T16:49:16.229 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: Options.table_factory: BlockBasedTable 2024-03-26T16:49:16.229 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x562e6d221c40) 2024-03-26T16:49:16.229 INFO:journalctl@ceph.mon.c.smithi149.stdout: cache_index_and_filter_blocks: 1 2024-03-26T16:49:16.230 INFO:journalctl@ceph.mon.c.smithi149.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-03-26T16:49:16.230 INFO:journalctl@ceph.mon.c.smithi149.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-03-26T16:49:16.230 INFO:journalctl@ceph.mon.c.smithi149.stdout: pin_top_level_index_and_filter: 1 2024-03-26T16:49:16.230 INFO:journalctl@ceph.mon.c.smithi149.stdout: index_type: 0 2024-03-26T16:49:16.230 INFO:journalctl@ceph.mon.c.smithi149.stdout: data_block_index_type: 0 2024-03-26T16:49:16.230 INFO:journalctl@ceph.mon.c.smithi149.stdout: index_shortening: 1 2024-03-26T16:49:16.230 INFO:journalctl@ceph.mon.c.smithi149.stdout: data_block_hash_table_util_ratio: 0.750000 2024-03-26T16:49:16.230 INFO:journalctl@ceph.mon.c.smithi149.stdout: checksum: 4 2024-03-26T16:49:16.230 INFO:journalctl@ceph.mon.c.smithi149.stdout: no_block_cache: 0 2024-03-26T16:49:16.230 INFO:journalctl@ceph.mon.c.smithi149.stdout: block_cache: 0x562e6d225090 2024-03-26T16:49:16.230 INFO:journalctl@ceph.mon.c.smithi149.stdout: block_cache_name: BinnedLRUCache 2024-03-26T16:49:16.230 INFO:journalctl@ceph.mon.c.smithi149.stdout: block_cache_options: 2024-03-26T16:49:16.230 INFO:journalctl@ceph.mon.c.smithi149.stdout: capacity : 536870912 2024-03-26T16:49:16.230 INFO:journalctl@ceph.mon.c.smithi149.stdout: num_shard_bits : 4 2024-03-26T16:49:16.230 INFO:journalctl@ceph.mon.c.smithi149.stdout: strict_capacity_limit : 0 2024-03-26T16:49:16.231 INFO:journalctl@ceph.mon.c.smithi149.stdout: high_pri_pool_ratio: 0.000 2024-03-26T16:49:16.231 INFO:journalctl@ceph.mon.c.smithi149.stdout: block_cache_compressed: (nil) 2024-03-26T16:49:16.231 INFO:journalctl@ceph.mon.c.smithi149.stdout: persistent_cache: (nil) 2024-03-26T16:49:16.231 INFO:journalctl@ceph.mon.c.smithi149.stdout: block_size: 4096 2024-03-26T16:49:16.231 INFO:journalctl@ceph.mon.c.smithi149.stdout: block_size_deviation: 10 2024-03-26T16:49:16.231 INFO:journalctl@ceph.mon.c.smithi149.stdout: block_restart_interval: 16 2024-03-26T16:49:16.231 INFO:journalctl@ceph.mon.c.smithi149.stdout: index_block_restart_interval: 1 2024-03-26T16:49:16.231 INFO:journalctl@ceph.mon.c.smithi149.stdout: metadata_block_size: 4096 2024-03-26T16:49:16.231 INFO:journalctl@ceph.mon.c.smithi149.stdout: partition_filters: 0 2024-03-26T16:49:16.231 INFO:journalctl@ceph.mon.c.smithi149.stdout: use_delta_encoding: 1 2024-03-26T16:49:16.231 INFO:journalctl@ceph.mon.c.smithi149.stdout: filter_policy: bloomfilter 2024-03-26T16:49:16.231 INFO:journalctl@ceph.mon.c.smithi149.stdout: whole_key_filtering: 1 2024-03-26T16:49:16.231 INFO:journalctl@ceph.mon.c.smithi149.stdout: verify_compression: 0 2024-03-26T16:49:16.231 INFO:journalctl@ceph.mon.c.smithi149.stdout: read_amp_bytes_per_bit: 0 2024-03-26T16:49:16.231 INFO:journalctl@ceph.mon.c.smithi149.stdout: format_version: 5 2024-03-26T16:49:16.232 INFO:journalctl@ceph.mon.c.smithi149.stdout: enable_index_compression: 1 2024-03-26T16:49:16.232 INFO:journalctl@ceph.mon.c.smithi149.stdout: block_align: 0 2024-03-26T16:49:16.232 INFO:journalctl@ceph.mon.c.smithi149.stdout: max_auto_readahead_size: 262144 2024-03-26T16:49:16.232 INFO:journalctl@ceph.mon.c.smithi149.stdout: prepopulate_block_cache: 0 2024-03-26T16:49:16.232 INFO:journalctl@ceph.mon.c.smithi149.stdout: initial_auto_readahead_size: 8192 2024-03-26T16:49:16.232 INFO:journalctl@ceph.mon.c.smithi149.stdout: num_file_reads_for_auto_readahead: 2 2024-03-26T16:49:16.232 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: Options.write_buffer_size: 33554432 2024-03-26T16:49:16.232 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: Options.max_write_buffer_number: 2 2024-03-26T16:49:16.232 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: Options.compression: NoCompression 2024-03-26T16:49:16.232 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: Options.bottommost_compression: Disabled 2024-03-26T16:49:16.232 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: Options.prefix_extractor: nullptr 2024-03-26T16:49:16.232 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-03-26T16:49:16.232 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: Options.num_levels: 7 2024-03-26T16:49:16.233 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-03-26T16:49:16.233 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-03-26T16:49:16.233 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-03-26T16:49:16.233 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-03-26T16:49:16.233 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-03-26T16:49:16.233 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-03-26T16:49:16.233 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-03-26T16:49:16.233 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-03-26T16:49:16.233 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-03-26T16:49:16.233 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-03-26T16:49:16.233 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-03-26T16:49:16.233 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-03-26T16:49:16.233 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: Options.compression_opts.window_bits: -14 2024-03-26T16:49:16.233 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: Options.compression_opts.level: 32767 2024-03-26T16:49:16.234 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: Options.compression_opts.strategy: 0 2024-03-26T16:49:16.234 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-03-26T16:49:16.234 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-03-26T16:49:16.234 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-03-26T16:49:16.234 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-03-26T16:49:16.234 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: Options.compression_opts.enabled: false 2024-03-26T16:49:16.234 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-03-26T16:49:16.234 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-03-26T16:49:16.234 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-03-26T16:49:16.234 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-03-26T16:49:16.234 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: Options.target_file_size_base: 67108864 2024-03-26T16:49:16.234 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: Options.target_file_size_multiplier: 1 2024-03-26T16:49:16.234 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-03-26T16:49:16.235 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-03-26T16:49:16.235 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-03-26T16:49:16.235 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-03-26T16:49:16.235 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-03-26T16:49:16.235 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-03-26T16:49:16.235 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-03-26T16:49:16.235 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-03-26T16:49:16.235 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-03-26T16:49:16.235 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-03-26T16:49:16.235 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-03-26T16:49:16.235 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-03-26T16:49:16.235 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-03-26T16:49:16.235 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: Options.arena_block_size: 1048576 2024-03-26T16:49:16.235 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-03-26T16:49:16.235 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-03-26T16:49:16.236 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: Options.disable_auto_compactions: 0 2024-03-26T16:49:16.236 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-03-26T16:49:16.236 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-03-26T16:49:16.236 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-03-26T16:49:16.236 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-03-26T16:49:16.236 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-03-26T16:49:16.236 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-03-26T16:49:16.236 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-03-26T16:49:16.236 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-03-26T16:49:16.236 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-03-26T16:49:16.236 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-03-26T16:49:16.236 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: Options.table_properties_collectors: 2024-03-26T16:49:16.236 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: Options.inplace_update_support: 0 2024-03-26T16:49:16.236 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: Options.inplace_update_num_locks: 10000 2024-03-26T16:49:16.237 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-03-26T16:49:16.237 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-03-26T16:49:16.237 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: Options.memtable_huge_page_size: 0 2024-03-26T16:49:16.237 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: Options.bloom_locality: 0 2024-03-26T16:49:16.237 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: Options.max_successive_merges: 0 2024-03-26T16:49:16.237 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: Options.optimize_filters_for_hits: 0 2024-03-26T16:49:16.237 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: Options.paranoid_file_checks: 0 2024-03-26T16:49:16.237 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: Options.force_consistency_checks: 1 2024-03-26T16:49:16.237 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: Options.report_bg_io_stats: 0 2024-03-26T16:49:16.237 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: Options.ttl: 2592000 2024-03-26T16:49:16.237 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: Options.periodic_compaction_seconds: 0 2024-03-26T16:49:16.237 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-03-26T16:49:16.237 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-03-26T16:49:16.237 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: Options.enable_blob_files: false 2024-03-26T16:49:16.238 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: Options.min_blob_size: 0 2024-03-26T16:49:16.238 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: Options.blob_file_size: 268435456 2024-03-26T16:49:16.238 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: Options.blob_compression_type: NoCompression 2024-03-26T16:49:16.238 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: Options.enable_blob_garbage_collection: false 2024-03-26T16:49:16.238 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-03-26T16:49:16.238 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-03-26T16:49:16.238 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-03-26T16:49:16.238 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: Options.blob_file_starting_level: 0 2024-03-26T16:49:16.238 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-03-26T16:49:16.238 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-03-26T16:49:16.238 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-03-26T16:49:16.238 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 911db8f0-2064-4097-ac3f-030c21641b60 2024-03-26T16:49:16.238 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: EVENT_LOG_v1 {"time_micros": 1711471756152220, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-03-26T16:49:16.238 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-03-26T16:49:16.239 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: EVENT_LOG_v1 {"time_micros": 1711471756152780, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1622, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1711471756, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "911db8f0-2064-4097-ac3f-030c21641b60", "db_session_id": "7OJM6PMYK12SNWFKPT9M", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-03-26T16:49:16.239 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: EVENT_LOG_v1 {"time_micros": 1711471756152883, "job": 1, "event": "recovery_finished"} 2024-03-26T16:49:16.239 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-03-26T16:49:16.239 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-c/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-03-26T16:49:16.239 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x562e6d314000 2024-03-26T16:49:16.239 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: DB pointer 0x562e6d2fe000 2024-03-26T16:49:16.239 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-03-26T16:49:16.239 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-03-26T16:49:16.239 INFO:journalctl@ceph.mon.c.smithi149.stdout: ** DB Stats ** 2024-03-26T16:49:16.239 INFO:journalctl@ceph.mon.c.smithi149.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-03-26T16:49:16.239 INFO:journalctl@ceph.mon.c.smithi149.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-03-26T16:49:16.239 INFO:journalctl@ceph.mon.c.smithi149.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-03-26T16:49:16.239 INFO:journalctl@ceph.mon.c.smithi149.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-03-26T16:49:16.239 INFO:journalctl@ceph.mon.c.smithi149.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-03-26T16:49:16.240 INFO:journalctl@ceph.mon.c.smithi149.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-03-26T16:49:16.240 INFO:journalctl@ceph.mon.c.smithi149.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-03-26T16:49:16.240 INFO:journalctl@ceph.mon.c.smithi149.stdout: 2024-03-26T16:49:16.240 INFO:journalctl@ceph.mon.c.smithi149.stdout: ** Compaction Stats [default] ** 2024-03-26T16:49:16.240 INFO:journalctl@ceph.mon.c.smithi149.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-03-26T16:49:16.240 INFO:journalctl@ceph.mon.c.smithi149.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-03-26T16:49:16.240 INFO:journalctl@ceph.mon.c.smithi149.stdout: L0 1/0 1.58 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-03-26T16:49:16.240 INFO:journalctl@ceph.mon.c.smithi149.stdout: Sum 1/0 1.58 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-03-26T16:49:16.240 INFO:journalctl@ceph.mon.c.smithi149.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-03-26T16:49:16.240 INFO:journalctl@ceph.mon.c.smithi149.stdout: 2024-03-26T16:49:16.240 INFO:journalctl@ceph.mon.c.smithi149.stdout: ** Compaction Stats [default] ** 2024-03-26T16:49:16.240 INFO:journalctl@ceph.mon.c.smithi149.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-03-26T16:49:16.240 INFO:journalctl@ceph.mon.c.smithi149.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-03-26T16:49:16.240 INFO:journalctl@ceph.mon.c.smithi149.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 2.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-03-26T16:49:16.240 INFO:journalctl@ceph.mon.c.smithi149.stdout: 2024-03-26T16:49:16.241 INFO:journalctl@ceph.mon.c.smithi149.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-03-26T16:49:16.241 INFO:journalctl@ceph.mon.c.smithi149.stdout: 2024-03-26T16:49:16.241 INFO:journalctl@ceph.mon.c.smithi149.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-03-26T16:49:16.241 INFO:journalctl@ceph.mon.c.smithi149.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-03-26T16:49:16.241 INFO:journalctl@ceph.mon.c.smithi149.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-03-26T16:49:16.241 INFO:journalctl@ceph.mon.c.smithi149.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-03-26T16:49:16.241 INFO:journalctl@ceph.mon.c.smithi149.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-03-26T16:49:16.241 INFO:journalctl@ceph.mon.c.smithi149.stdout: AddFile(Keys): cumulative 0, interval 0 2024-03-26T16:49:16.241 INFO:journalctl@ceph.mon.c.smithi149.stdout: Cumulative compaction: 0.00 GB write, 0.51 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-03-26T16:49:16.241 INFO:journalctl@ceph.mon.c.smithi149.stdout: Interval compaction: 0.00 GB write, 0.51 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-03-26T16:49:16.241 INFO:journalctl@ceph.mon.c.smithi149.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-03-26T16:49:16.241 INFO:journalctl@ceph.mon.c.smithi149.stdout: Block cache BinnedLRUCache@0x562e6d225090#2 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-03-26T16:49:16.241 INFO:journalctl@ceph.mon.c.smithi149.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-03-26T16:49:16.241 INFO:journalctl@ceph.mon.c.smithi149.stdout: 2024-03-26T16:49:16.242 INFO:journalctl@ceph.mon.c.smithi149.stdout: ** File Read Latency Histogram By Level [default] ** 2024-03-26T16:49:16.242 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: mon.c does not exist in monmap, will attempt to join an existing cluster 2024-03-26T16:49:16.242 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: using public_addr v2:172.21.15.149:0/0 -> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] 2024-03-26T16:49:16.242 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: starting mon.c rank -1 at public addrs [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] at bind addrs [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon_data /var/lib/ceph/mon/ceph-c fsid 4394d798-eb90-11ee-95d0-87774f69a715 2024-03-26T16:49:16.242 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: mon.c@-1(???) e0 preinit fsid 4394d798-eb90-11ee-95d0-87774f69a715 2024-03-26T16:49:16.242 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: mon.c@-1(synchronizing).mds e1 new map 2024-03-26T16:49:16.242 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: mon.c@-1(synchronizing).mds e1 print_map 2024-03-26T16:49:16.242 INFO:journalctl@ceph.mon.c.smithi149.stdout: e1 2024-03-26T16:49:16.242 INFO:journalctl@ceph.mon.c.smithi149.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-03-26T16:49:16.242 INFO:journalctl@ceph.mon.c.smithi149.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-03-26T16:49:16.242 INFO:journalctl@ceph.mon.c.smithi149.stdout: legacy client fscid: -1 2024-03-26T16:49:16.242 INFO:journalctl@ceph.mon.c.smithi149.stdout: 2024-03-26T16:49:16.242 INFO:journalctl@ceph.mon.c.smithi149.stdout: No filesystems configured 2024-03-26T16:49:16.242 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-03-26T16:49:16.243 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-03-26T16:49:16.243 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-03-26T16:49:16.243 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-03-26T16:49:16.243 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-03-26T16:49:16.243 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-03-26T16:49:16.243 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: mon.c@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-03-26T16:49:16.243 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-03-26T16:49:16.243 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-03-26T16:49:16.243 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-03-26T16:49:16.243 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:49:16.243 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-26T16:49:16.243 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-26T16:49:16.243 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:49:16.243 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-26T16:49:16.244 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi149", "target": ["mon-mgr", ""]}]: dispatch 2024-03-26T16:49:16.244 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-26T16:49:16.244 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:49:16.244 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:49:16.244 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:49:16.244 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:49:16.244 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi064", "name": "osd_memory_target"} : dispatch 2024-03-26T16:49:16.244 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T16:49:16.244 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-26T16:49:16.244 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: Updating smithi064:/etc/ceph/ceph.conf 2024-03-26T16:49:16.244 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: Deploying cephadm binary to smithi149 2024-03-26T16:49:16.244 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: Updating smithi064:/var/lib/ceph/4394d798-eb90-11ee-95d0-87774f69a715/config/ceph.conf 2024-03-26T16:49:16.244 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: Updating smithi064:/etc/ceph/ceph.client.admin.keyring 2024-03-26T16:49:16.244 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: Updating smithi064:/var/lib/ceph/4394d798-eb90-11ee-95d0-87774f69a715/config/ceph.client.admin.keyring 2024-03-26T16:49:16.245 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-26T16:49:16.245 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:49:16.245 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:49:16.245 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:49:16.245 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-26T16:49:16.245 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:49:16.245 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-26T16:49:16.245 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: Added host smithi149 2024-03-26T16:49:16.245 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:49:16.245 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:49:16.245 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-26T16:49:16.245 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-26T16:49:16.245 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:49:16.245 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-26T16:49:16.246 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi157", "target": ["mon-mgr", ""]}]: dispatch 2024-03-26T16:49:16.246 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-26T16:49:16.246 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:49:16.246 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:49:16.246 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:49:16.246 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:49:16.246 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi149", "name": "osd_memory_target"} : dispatch 2024-03-26T16:49:16.246 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T16:49:16.246 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-26T16:49:16.246 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: Updating smithi149:/etc/ceph/ceph.conf 2024-03-26T16:49:16.246 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: Deploying cephadm binary to smithi157 2024-03-26T16:49:16.246 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: Updating smithi149:/var/lib/ceph/4394d798-eb90-11ee-95d0-87774f69a715/config/ceph.conf 2024-03-26T16:49:16.246 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: Updating smithi149:/etc/ceph/ceph.client.admin.keyring 2024-03-26T16:49:16.246 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-26T16:49:16.247 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: Updating smithi149:/var/lib/ceph/4394d798-eb90-11ee-95d0-87774f69a715/config/ceph.client.admin.keyring 2024-03-26T16:49:16.247 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:49:16.247 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:49:16.247 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:49:16.247 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-26T16:49:16.247 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:49:16.247 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-26T16:49:16.247 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:49:16.247 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: Added host smithi157 2024-03-26T16:49:16.247 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:49:16.247 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-26T16:49:16.247 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-26T16:49:16.247 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:49:16.247 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-26T16:49:16.247 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: from='client.? 172.21.15.44:0/3179033752' entity='client.admin' cmd={"prefix": "osd crush tunables", "profile": "default"} : dispatch 2024-03-26T16:49:16.248 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-26T16:49:16.248 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: from='client.? 172.21.15.44:0/3179033752' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-03-26T16:49:16.248 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: osdmap e4: 0 total, 0 up, 0 in 2024-03-26T16:49:16.248 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:49:16.248 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:49:16.248 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:49:16.248 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:49:16.248 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi157", "name": "osd_memory_target"} : dispatch 2024-03-26T16:49:16.248 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T16:49:16.248 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-26T16:49:16.248 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:49:16.248 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:49:16.248 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:49:16.248 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: Updating smithi157:/etc/ceph/ceph.conf 2024-03-26T16:49:16.248 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: Updating smithi157:/var/lib/ceph/4394d798-eb90-11ee-95d0-87774f69a715/config/ceph.conf 2024-03-26T16:49:16.249 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: Updating smithi157:/etc/ceph/ceph.client.admin.keyring 2024-03-26T16:49:16.249 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: Updating smithi157:/var/lib/ceph/4394d798-eb90-11ee-95d0-87774f69a715/config/ceph.client.admin.keyring 2024-03-26T16:49:16.249 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-26T16:49:16.249 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:49:16.249 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-26T16:49:16.249 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T16:49:16.249 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-26T16:49:16.249 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:49:16.249 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-03-26T16:49:16.249 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T16:49:16.249 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: from='client.14192 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi044:172.21.15.44=a;smithi064:172.21.15.64=b;smithi149:172.21.15.149=c", "target": ["mon-mgr", ""]}]: dispatch 2024-03-26T16:49:16.249 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: Saving service mon spec with placement smithi044:172.21.15.44=a;smithi064:172.21.15.64=b;smithi149:172.21.15.149=c;count:3 2024-03-26T16:49:16.249 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: Deploying daemon mon.c on smithi149 2024-03-26T16:49:16.249 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-26T16:49:16.249 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-26T16:49:16.250 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: from='client.? 172.21.15.149:0/1012955610' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-03-26T16:49:16.250 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-26T16:49:16.250 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 ceph-mon[34678]: mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-03-26T16:49:16.250 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 bash[34634]: b3ca6d321ad12af1f8bcf05a6f2e49657f2b7d2f528f5ada141a03de8d7dbbad 2024-03-26T16:49:16.250 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:16 smithi149 systemd[1]: Started Ceph mon.c for 4394d798-eb90-11ee-95d0-87774f69a715. 2024-03-26T16:49:17.715 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-03-26T16:49:17.715 DEBUG:teuthology.orchestra.run.smithi149:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bf9505fb569e9b95a78f9700ed8c4bd20508ef55 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4394d798-eb90-11ee-95d0-87774f69a715 -- ceph mon dump -f json 2024-03-26T16:49:17.958 INFO:teuthology.orchestra.run.smithi149.stderr:Inferring config /var/lib/ceph/4394d798-eb90-11ee-95d0-87774f69a715/mon.c/config 2024-03-26T16:49:21.648 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:21 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-03-26T16:49:21.648 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:21 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-03-26T16:49:21.648 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:21 smithi149 ceph-mon[34678]: mon.a calling monitor election 2024-03-26T16:49:21.648 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:21 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-03-26T16:49:21.648 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:21 smithi149 ceph-mon[34678]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-26T16:49:21.648 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:21 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-03-26T16:49:21.648 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:21 smithi149 ceph-mon[34678]: mon.c calling monitor election 2024-03-26T16:49:21.648 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:21 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-03-26T16:49:21.648 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:21 smithi149 ceph-mon[34678]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-26T16:49:21.648 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:21 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-03-26T16:49:21.648 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:21 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-03-26T16:49:21.648 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:21 smithi149 ceph-mon[34678]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-03-26T16:49:21.649 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:21 smithi149 ceph-mon[34678]: monmap epoch 2 2024-03-26T16:49:21.649 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:21 smithi149 ceph-mon[34678]: fsid 4394d798-eb90-11ee-95d0-87774f69a715 2024-03-26T16:49:21.649 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:21 smithi149 ceph-mon[34678]: last_changed 2024-03-26T16:49:16.176966+0000 2024-03-26T16:49:21.649 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:21 smithi149 ceph-mon[34678]: created 2024-03-26T16:47:15.492869+0000 2024-03-26T16:49:21.649 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:21 smithi149 ceph-mon[34678]: min_mon_release 19 (squid) 2024-03-26T16:49:21.649 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:21 smithi149 ceph-mon[34678]: election_strategy: 1 2024-03-26T16:49:21.649 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:21 smithi149 ceph-mon[34678]: 0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-03-26T16:49:21.649 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:21 smithi149 ceph-mon[34678]: 1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.c 2024-03-26T16:49:21.649 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:21 smithi149 ceph-mon[34678]: fsmap 2024-03-26T16:49:21.649 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:21 smithi149 ceph-mon[34678]: osdmap e4: 0 total, 0 up, 0 in 2024-03-26T16:49:21.649 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:21 smithi149 ceph-mon[34678]: mgrmap e13: x(active, since 63s) 2024-03-26T16:49:21.649 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:21 smithi149 ceph-mon[34678]: overall HEALTH_OK 2024-03-26T16:49:21.649 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:21 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:49:21.649 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:21 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:49:21.766 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:21 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-03-26T16:49:21.766 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:21 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-03-26T16:49:21.766 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:21 smithi044 ceph-mon[30624]: mon.a calling monitor election 2024-03-26T16:49:21.767 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:21 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-03-26T16:49:21.767 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:21 smithi044 ceph-mon[30624]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-26T16:49:21.767 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:21 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-03-26T16:49:21.767 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:21 smithi044 ceph-mon[30624]: mon.c calling monitor election 2024-03-26T16:49:21.767 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:21 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-03-26T16:49:21.767 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:21 smithi044 ceph-mon[30624]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-26T16:49:21.767 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:21 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-03-26T16:49:21.767 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:21 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-03-26T16:49:21.767 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:21 smithi044 ceph-mon[30624]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-03-26T16:49:21.767 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:21 smithi044 ceph-mon[30624]: monmap epoch 2 2024-03-26T16:49:21.767 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:21 smithi044 ceph-mon[30624]: fsid 4394d798-eb90-11ee-95d0-87774f69a715 2024-03-26T16:49:21.767 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:21 smithi044 ceph-mon[30624]: last_changed 2024-03-26T16:49:16.176966+0000 2024-03-26T16:49:21.767 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:21 smithi044 ceph-mon[30624]: created 2024-03-26T16:47:15.492869+0000 2024-03-26T16:49:21.767 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:21 smithi044 ceph-mon[30624]: min_mon_release 19 (squid) 2024-03-26T16:49:21.768 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:21 smithi044 ceph-mon[30624]: election_strategy: 1 2024-03-26T16:49:21.768 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:21 smithi044 ceph-mon[30624]: 0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-03-26T16:49:21.768 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:21 smithi044 ceph-mon[30624]: 1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.c 2024-03-26T16:49:21.768 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:21 smithi044 ceph-mon[30624]: fsmap 2024-03-26T16:49:21.768 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:21 smithi044 ceph-mon[30624]: osdmap e4: 0 total, 0 up, 0 in 2024-03-26T16:49:21.768 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:21 smithi044 ceph-mon[30624]: mgrmap e13: x(active, since 63s) 2024-03-26T16:49:21.768 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:21 smithi044 ceph-mon[30624]: overall HEALTH_OK 2024-03-26T16:49:21.768 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:21 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:49:21.768 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:21 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:49:22.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:22 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:49:22.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:22 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-03-26T16:49:22.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:22 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T16:49:22.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:22 smithi149 ceph-mon[34678]: Deploying daemon mon.b on smithi064 2024-03-26T16:49:22.398 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:22 smithi149 ceph-mon[34678]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-26T16:49:22.398 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:22 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-03-26T16:49:22.697 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-03-26T16:49:22.697 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":2,"fsid":"4394d798-eb90-11ee-95d0-87774f69a715","modified":"2024-03-26T16:49:16.176966Z","created":"2024-03-26T16:47:15.492869Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:3300","nonce":0},{"type":"v1","addr":"172.21.15.44:6789","nonce":0}]},"addr":"172.21.15.44:6789/0","public_addr":"172.21.15.44:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:3300","nonce":0},{"type":"v1","addr":"172.21.15.149:6789","nonce":0}]},"addr":"172.21.15.149:6789/0","public_addr":"172.21.15.149:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-03-26T16:49:22.699 INFO:teuthology.orchestra.run.smithi149.stderr:dumped monmap epoch 2 2024-03-26T16:49:22.766 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:22 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:49:22.766 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:22 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-03-26T16:49:22.766 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:22 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T16:49:22.766 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:22 smithi044 ceph-mon[30624]: Deploying daemon mon.b on smithi064 2024-03-26T16:49:22.767 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:22 smithi044 ceph-mon[30624]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-26T16:49:22.767 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:22 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-03-26T16:49:23.647 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:23 smithi149 ceph-mon[34678]: from='client.? 172.21.15.149:0/1099796185' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-03-26T16:49:23.766 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:23 smithi044 ceph-mon[30624]: from='client.? 172.21.15.149:0/1099796185' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-03-26T16:49:24.244 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-03-26T16:49:24.245 DEBUG:teuthology.orchestra.run.smithi149:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bf9505fb569e9b95a78f9700ed8c4bd20508ef55 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4394d798-eb90-11ee-95d0-87774f69a715 -- ceph mon dump -f json 2024-03-26T16:49:24.489 INFO:teuthology.orchestra.run.smithi149.stderr:Inferring config /var/lib/ceph/4394d798-eb90-11ee-95d0-87774f69a715/mon.c/config 2024-03-26T16:49:24.612 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:24 smithi149 ceph-mon[34678]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-26T16:49:24.766 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:24 smithi044 ceph-mon[30624]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-26T16:49:25.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:49:25 smithi064 systemd[1]: Started Ceph mon.b for 4394d798-eb90-11ee-95d0-87774f69a715. 2024-03-26T16:49:30.648 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:30 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-03-26T16:49:30.648 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:30 smithi149 ceph-mon[34678]: mon.c calling monitor election 2024-03-26T16:49:30.648 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:30 smithi149 ceph-mon[34678]: mon.a calling monitor election 2024-03-26T16:49:30.648 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:30 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-03-26T16:49:30.648 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:30 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-03-26T16:49:30.648 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:30 smithi149 ceph-mon[34678]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-26T16:49:30.648 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:30 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-03-26T16:49:30.649 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:30 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-03-26T16:49:30.649 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:30 smithi149 ceph-mon[34678]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-26T16:49:30.649 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:30 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-03-26T16:49:30.649 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:30 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-03-26T16:49:30.649 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:30 smithi149 ceph-mon[34678]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-26T16:49:30.649 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:30 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-03-26T16:49:30.649 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:30 smithi149 ceph-mon[34678]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-03-26T16:49:30.649 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:30 smithi149 ceph-mon[34678]: monmap epoch 3 2024-03-26T16:49:30.649 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:30 smithi149 ceph-mon[34678]: fsid 4394d798-eb90-11ee-95d0-87774f69a715 2024-03-26T16:49:30.649 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:30 smithi149 ceph-mon[34678]: last_changed 2024-03-26T16:49:25.253622+0000 2024-03-26T16:49:30.649 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:30 smithi149 ceph-mon[34678]: created 2024-03-26T16:47:15.492869+0000 2024-03-26T16:49:30.649 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:30 smithi149 ceph-mon[34678]: min_mon_release 19 (squid) 2024-03-26T16:49:30.649 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:30 smithi149 ceph-mon[34678]: election_strategy: 1 2024-03-26T16:49:30.649 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:30 smithi149 ceph-mon[34678]: 0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-03-26T16:49:30.650 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:30 smithi149 ceph-mon[34678]: 1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.c 2024-03-26T16:49:30.650 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:30 smithi149 ceph-mon[34678]: 2: [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] mon.b 2024-03-26T16:49:30.650 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:30 smithi149 ceph-mon[34678]: fsmap 2024-03-26T16:49:30.650 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:30 smithi149 ceph-mon[34678]: osdmap e4: 0 total, 0 up, 0 in 2024-03-26T16:49:30.650 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:30 smithi149 ceph-mon[34678]: mgrmap e13: x(active, since 72s) 2024-03-26T16:49:30.650 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:30 smithi149 ceph-mon[34678]: Health check failed: 1/3 mons down, quorum a,c (MON_DOWN) 2024-03-26T16:49:30.650 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:30 smithi149 ceph-mon[34678]: Health detail: HEALTH_WARN 1/3 mons down, quorum a,c 2024-03-26T16:49:30.650 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:30 smithi149 ceph-mon[34678]: [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2024-03-26T16:49:30.650 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:30 smithi149 ceph-mon[34678]: mon.b (rank 2) addr [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] is down (out of quorum) 2024-03-26T16:49:30.650 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:30 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:49:30.650 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:30 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:49:30.650 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:30 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:49:30.650 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:30 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:49:30.767 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:30 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-03-26T16:49:30.767 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:30 smithi044 ceph-mon[30624]: mon.c calling monitor election 2024-03-26T16:49:30.767 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:30 smithi044 ceph-mon[30624]: mon.a calling monitor election 2024-03-26T16:49:30.767 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:30 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-03-26T16:49:30.767 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:30 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-03-26T16:49:30.767 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:30 smithi044 ceph-mon[30624]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-26T16:49:30.767 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:30 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-03-26T16:49:30.767 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:30 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-03-26T16:49:30.767 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:30 smithi044 ceph-mon[30624]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-26T16:49:30.768 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:30 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-03-26T16:49:30.768 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:30 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-03-26T16:49:30.768 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:30 smithi044 ceph-mon[30624]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-26T16:49:30.768 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:30 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-03-26T16:49:30.768 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:30 smithi044 ceph-mon[30624]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-03-26T16:49:30.768 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:30 smithi044 ceph-mon[30624]: monmap epoch 3 2024-03-26T16:49:30.768 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:30 smithi044 ceph-mon[30624]: fsid 4394d798-eb90-11ee-95d0-87774f69a715 2024-03-26T16:49:30.768 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:30 smithi044 ceph-mon[30624]: last_changed 2024-03-26T16:49:25.253622+0000 2024-03-26T16:49:30.768 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:30 smithi044 ceph-mon[30624]: created 2024-03-26T16:47:15.492869+0000 2024-03-26T16:49:30.768 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:30 smithi044 ceph-mon[30624]: min_mon_release 19 (squid) 2024-03-26T16:49:30.768 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:30 smithi044 ceph-mon[30624]: election_strategy: 1 2024-03-26T16:49:30.768 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:30 smithi044 ceph-mon[30624]: 0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-03-26T16:49:30.769 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:30 smithi044 ceph-mon[30624]: 1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.c 2024-03-26T16:49:30.769 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:30 smithi044 ceph-mon[30624]: 2: [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] mon.b 2024-03-26T16:49:30.769 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:30 smithi044 ceph-mon[30624]: fsmap 2024-03-26T16:49:30.769 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:30 smithi044 ceph-mon[30624]: osdmap e4: 0 total, 0 up, 0 in 2024-03-26T16:49:30.769 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:30 smithi044 ceph-mon[30624]: mgrmap e13: x(active, since 72s) 2024-03-26T16:49:30.769 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:30 smithi044 ceph-mon[30624]: Health check failed: 1/3 mons down, quorum a,c (MON_DOWN) 2024-03-26T16:49:30.769 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:30 smithi044 ceph-mon[30624]: Health detail: HEALTH_WARN 1/3 mons down, quorum a,c 2024-03-26T16:49:30.769 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:30 smithi044 ceph-mon[30624]: [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2024-03-26T16:49:30.769 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:30 smithi044 ceph-mon[30624]: mon.b (rank 2) addr [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] is down (out of quorum) 2024-03-26T16:49:30.769 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:30 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:49:30.769 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:30 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:49:30.769 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:30 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:49:30.769 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:30 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:49:31.408 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:31 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-26T16:49:31.408 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:31 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-03-26T16:49:31.647 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:31 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-26T16:49:31.647 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:31 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-03-26T16:49:32.142 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-03-26T16:49:32.143 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":3,"fsid":"4394d798-eb90-11ee-95d0-87774f69a715","modified":"2024-03-26T16:49:25.253622Z","created":"2024-03-26T16:47:15.492869Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:3300","nonce":0},{"type":"v1","addr":"172.21.15.44:6789","nonce":0}]},"addr":"172.21.15.44:6789/0","public_addr":"172.21.15.44:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:3300","nonce":0},{"type":"v1","addr":"172.21.15.149:6789","nonce":0}]},"addr":"172.21.15.149:6789/0","public_addr":"172.21.15.149:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:3300","nonce":0},{"type":"v1","addr":"172.21.15.64:6789","nonce":0}]},"addr":"172.21.15.64:6789/0","public_addr":"172.21.15.64:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-03-26T16:49:32.145 INFO:teuthology.orchestra.run.smithi149.stderr:dumped monmap epoch 3 2024-03-26T16:49:32.557 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:49:32 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-03-26T16:49:32.557 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:49:32 smithi064 ceph-mon[34420]: mon.c calling monitor election 2024-03-26T16:49:32.557 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:49:32 smithi064 ceph-mon[34420]: mon.a calling monitor election 2024-03-26T16:49:32.557 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:49:32 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-03-26T16:49:32.557 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:49:32 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-03-26T16:49:32.557 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:49:32 smithi064 ceph-mon[34420]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-26T16:49:32.558 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:49:32 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-03-26T16:49:32.558 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:49:32 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-03-26T16:49:32.558 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:49:32 smithi064 ceph-mon[34420]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-26T16:49:32.558 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:49:32 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-03-26T16:49:32.558 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:49:32 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-03-26T16:49:32.558 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:49:32 smithi064 ceph-mon[34420]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-26T16:49:32.558 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:49:32 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-03-26T16:49:32.558 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:49:32 smithi064 ceph-mon[34420]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-03-26T16:49:32.558 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:49:32 smithi064 ceph-mon[34420]: monmap epoch 3 2024-03-26T16:49:32.558 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:49:32 smithi064 ceph-mon[34420]: fsid 4394d798-eb90-11ee-95d0-87774f69a715 2024-03-26T16:49:32.558 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:49:32 smithi064 ceph-mon[34420]: last_changed 2024-03-26T16:49:25.253622+0000 2024-03-26T16:49:32.558 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:49:32 smithi064 ceph-mon[34420]: created 2024-03-26T16:47:15.492869+0000 2024-03-26T16:49:32.558 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:49:32 smithi064 ceph-mon[34420]: min_mon_release 19 (squid) 2024-03-26T16:49:32.558 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:49:32 smithi064 ceph-mon[34420]: election_strategy: 1 2024-03-26T16:49:32.558 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:49:32 smithi064 ceph-mon[34420]: 0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-03-26T16:49:32.558 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:49:32 smithi064 ceph-mon[34420]: 1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.c 2024-03-26T16:49:32.559 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:49:32 smithi064 ceph-mon[34420]: 2: [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] mon.b 2024-03-26T16:49:32.559 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:49:32 smithi064 ceph-mon[34420]: fsmap 2024-03-26T16:49:32.559 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:49:32 smithi064 ceph-mon[34420]: osdmap e4: 0 total, 0 up, 0 in 2024-03-26T16:49:32.559 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:49:32 smithi064 ceph-mon[34420]: mgrmap e13: x(active, since 72s) 2024-03-26T16:49:32.559 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:49:32 smithi064 ceph-mon[34420]: Health check failed: 1/3 mons down, quorum a,c (MON_DOWN) 2024-03-26T16:49:32.559 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:49:32 smithi064 ceph-mon[34420]: Health detail: HEALTH_WARN 1/3 mons down, quorum a,c 2024-03-26T16:49:32.559 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:49:32 smithi064 ceph-mon[34420]: [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2024-03-26T16:49:32.559 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:49:32 smithi064 ceph-mon[34420]: mon.b (rank 2) addr [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] is down (out of quorum) 2024-03-26T16:49:32.559 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:49:32 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:49:32.559 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:49:32 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:49:32.559 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:49:32 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:49:32.559 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:49:32 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:49:32.559 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:49:32 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-26T16:49:32.559 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:49:32 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-03-26T16:49:32.807 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-03-26T16:49:32.808 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bf9505fb569e9b95a78f9700ed8c4bd20508ef55 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4394d798-eb90-11ee-95d0-87774f69a715 -- ceph config generate-minimal-conf 2024-03-26T16:49:33.051 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/4394d798-eb90-11ee-95d0-87774f69a715/mon.a/config 2024-03-26T16:49:33.147 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:32 smithi149 ceph-mon[34678]: mon.b calling monitor election 2024-03-26T16:49:33.147 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:32 smithi149 ceph-mon[34678]: mon.b calling monitor election 2024-03-26T16:49:33.147 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:32 smithi149 ceph-mon[34678]: mon.c calling monitor election 2024-03-26T16:49:33.147 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:32 smithi149 ceph-mon[34678]: mon.a calling monitor election 2024-03-26T16:49:33.147 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:32 smithi149 ceph-mon[34678]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-03-26T16:49:33.147 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:32 smithi149 ceph-mon[34678]: monmap epoch 3 2024-03-26T16:49:33.147 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:32 smithi149 ceph-mon[34678]: fsid 4394d798-eb90-11ee-95d0-87774f69a715 2024-03-26T16:49:33.147 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:32 smithi149 ceph-mon[34678]: last_changed 2024-03-26T16:49:25.253622+0000 2024-03-26T16:49:33.148 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:32 smithi149 ceph-mon[34678]: created 2024-03-26T16:47:15.492869+0000 2024-03-26T16:49:33.148 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:32 smithi149 ceph-mon[34678]: min_mon_release 19 (squid) 2024-03-26T16:49:33.148 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:32 smithi149 ceph-mon[34678]: election_strategy: 1 2024-03-26T16:49:33.148 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:32 smithi149 ceph-mon[34678]: 0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-03-26T16:49:33.148 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:32 smithi149 ceph-mon[34678]: 1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.c 2024-03-26T16:49:33.148 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:32 smithi149 ceph-mon[34678]: 2: [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] mon.b 2024-03-26T16:49:33.148 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:32 smithi149 ceph-mon[34678]: fsmap 2024-03-26T16:49:33.148 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:32 smithi149 ceph-mon[34678]: osdmap e4: 0 total, 0 up, 0 in 2024-03-26T16:49:33.148 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:32 smithi149 ceph-mon[34678]: mgrmap e13: x(active, since 74s) 2024-03-26T16:49:33.148 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:32 smithi149 ceph-mon[34678]: Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2024-03-26T16:49:33.148 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:32 smithi149 ceph-mon[34678]: Cluster is now healthy 2024-03-26T16:49:33.148 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:32 smithi149 ceph-mon[34678]: overall HEALTH_OK 2024-03-26T16:49:33.148 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:32 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:49:33.148 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:32 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:49:33.148 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:32 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:49:33.149 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:32 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:49:33.149 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:32 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:49:33.149 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:32 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:49:33.149 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:32 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:49:33.149 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:32 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:49:33.149 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:32 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:49:33.149 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:32 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:49:33.149 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:32 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:49:33.149 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:32 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:49:33.149 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:32 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:49:33.149 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:32 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-03-26T16:49:33.149 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:32 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-03-26T16:49:33.149 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:32 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T16:49:33.164 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:32 smithi044 ceph-mon[30624]: mon.b calling monitor election 2024-03-26T16:49:33.164 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:32 smithi044 ceph-mon[30624]: mon.b calling monitor election 2024-03-26T16:49:33.164 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:32 smithi044 ceph-mon[30624]: mon.c calling monitor election 2024-03-26T16:49:33.164 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:32 smithi044 ceph-mon[30624]: mon.a calling monitor election 2024-03-26T16:49:33.164 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:32 smithi044 ceph-mon[30624]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-03-26T16:49:33.164 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:32 smithi044 ceph-mon[30624]: monmap epoch 3 2024-03-26T16:49:33.164 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:32 smithi044 ceph-mon[30624]: fsid 4394d798-eb90-11ee-95d0-87774f69a715 2024-03-26T16:49:33.165 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:32 smithi044 ceph-mon[30624]: last_changed 2024-03-26T16:49:25.253622+0000 2024-03-26T16:49:33.165 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:32 smithi044 ceph-mon[30624]: created 2024-03-26T16:47:15.492869+0000 2024-03-26T16:49:33.165 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:32 smithi044 ceph-mon[30624]: min_mon_release 19 (squid) 2024-03-26T16:49:33.165 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:32 smithi044 ceph-mon[30624]: election_strategy: 1 2024-03-26T16:49:33.165 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:32 smithi044 ceph-mon[30624]: 0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-03-26T16:49:33.165 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:32 smithi044 ceph-mon[30624]: 1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.c 2024-03-26T16:49:33.165 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:32 smithi044 ceph-mon[30624]: 2: [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] mon.b 2024-03-26T16:49:33.165 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:32 smithi044 ceph-mon[30624]: fsmap 2024-03-26T16:49:33.165 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:32 smithi044 ceph-mon[30624]: osdmap e4: 0 total, 0 up, 0 in 2024-03-26T16:49:33.165 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:32 smithi044 ceph-mon[30624]: mgrmap e13: x(active, since 74s) 2024-03-26T16:49:33.165 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:32 smithi044 ceph-mon[30624]: Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2024-03-26T16:49:33.165 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:32 smithi044 ceph-mon[30624]: Cluster is now healthy 2024-03-26T16:49:33.165 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:32 smithi044 ceph-mon[30624]: overall HEALTH_OK 2024-03-26T16:49:33.165 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:32 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:49:33.165 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:32 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:49:33.166 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:32 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:49:33.166 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:32 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:49:33.166 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:32 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:49:33.166 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:32 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:49:33.166 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:32 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:49:33.166 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:32 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:49:33.166 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:32 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:49:33.166 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:32 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:49:33.166 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:32 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:49:33.166 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:32 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:49:33.166 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:32 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:49:33.166 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:32 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-03-26T16:49:33.166 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:32 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-03-26T16:49:33.167 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:32 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T16:49:33.307 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:49:32 smithi064 ceph-mon[34420]: mon.b calling monitor election 2024-03-26T16:49:33.307 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:49:32 smithi064 ceph-mon[34420]: mon.b calling monitor election 2024-03-26T16:49:33.307 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:49:32 smithi064 ceph-mon[34420]: mon.c calling monitor election 2024-03-26T16:49:33.307 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:49:32 smithi064 ceph-mon[34420]: mon.a calling monitor election 2024-03-26T16:49:33.308 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:49:32 smithi064 ceph-mon[34420]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-03-26T16:49:33.308 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:49:32 smithi064 ceph-mon[34420]: monmap epoch 3 2024-03-26T16:49:33.308 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:49:32 smithi064 ceph-mon[34420]: fsid 4394d798-eb90-11ee-95d0-87774f69a715 2024-03-26T16:49:33.308 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:49:32 smithi064 ceph-mon[34420]: last_changed 2024-03-26T16:49:25.253622+0000 2024-03-26T16:49:33.308 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:49:32 smithi064 ceph-mon[34420]: created 2024-03-26T16:47:15.492869+0000 2024-03-26T16:49:33.308 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:49:32 smithi064 ceph-mon[34420]: min_mon_release 19 (squid) 2024-03-26T16:49:33.308 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:49:32 smithi064 ceph-mon[34420]: election_strategy: 1 2024-03-26T16:49:33.308 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:49:32 smithi064 ceph-mon[34420]: 0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-03-26T16:49:33.308 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:49:32 smithi064 ceph-mon[34420]: 1: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.c 2024-03-26T16:49:33.308 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:49:32 smithi064 ceph-mon[34420]: 2: [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] mon.b 2024-03-26T16:49:33.308 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:49:32 smithi064 ceph-mon[34420]: fsmap 2024-03-26T16:49:33.308 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:49:32 smithi064 ceph-mon[34420]: osdmap e4: 0 total, 0 up, 0 in 2024-03-26T16:49:33.309 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:49:32 smithi064 ceph-mon[34420]: mgrmap e13: x(active, since 74s) 2024-03-26T16:49:33.309 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:49:32 smithi064 ceph-mon[34420]: Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2024-03-26T16:49:33.309 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:49:32 smithi064 ceph-mon[34420]: Cluster is now healthy 2024-03-26T16:49:33.309 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:49:32 smithi064 ceph-mon[34420]: overall HEALTH_OK 2024-03-26T16:49:33.309 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:49:32 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:49:33.309 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:49:32 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:49:33.309 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:49:32 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:49:33.309 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:49:32 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:49:33.309 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:49:32 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:49:33.309 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:49:32 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:49:33.309 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:49:32 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:49:33.309 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:49:32 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:49:33.309 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:49:32 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:49:33.309 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:49:32 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:49:33.310 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:49:32 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:49:33.310 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:49:32 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:49:33.310 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:49:32 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:49:33.310 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:49:32 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-03-26T16:49:33.310 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:49:32 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-03-26T16:49:33.310 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:49:32 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T16:49:34.147 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:33 smithi149 ceph-mon[34678]: Updating smithi149:/var/lib/ceph/4394d798-eb90-11ee-95d0-87774f69a715/config/ceph.conf 2024-03-26T16:49:34.147 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:33 smithi149 ceph-mon[34678]: Updating smithi064:/var/lib/ceph/4394d798-eb90-11ee-95d0-87774f69a715/config/ceph.conf 2024-03-26T16:49:34.147 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:33 smithi149 ceph-mon[34678]: Updating smithi044:/var/lib/ceph/4394d798-eb90-11ee-95d0-87774f69a715/config/ceph.conf 2024-03-26T16:49:34.147 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:33 smithi149 ceph-mon[34678]: Updating smithi157:/var/lib/ceph/4394d798-eb90-11ee-95d0-87774f69a715/config/ceph.conf 2024-03-26T16:49:34.147 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:33 smithi149 ceph-mon[34678]: Reconfiguring mon.a (unknown last config time)... 2024-03-26T16:49:34.147 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:33 smithi149 ceph-mon[34678]: Reconfiguring daemon mon.a on smithi044 2024-03-26T16:49:34.147 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:33 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:49:34.147 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:33 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-03-26T16:49:34.266 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:33 smithi044 ceph-mon[30624]: Updating smithi149:/var/lib/ceph/4394d798-eb90-11ee-95d0-87774f69a715/config/ceph.conf 2024-03-26T16:49:34.266 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:33 smithi044 ceph-mon[30624]: Updating smithi064:/var/lib/ceph/4394d798-eb90-11ee-95d0-87774f69a715/config/ceph.conf 2024-03-26T16:49:34.266 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:33 smithi044 ceph-mon[30624]: Updating smithi044:/var/lib/ceph/4394d798-eb90-11ee-95d0-87774f69a715/config/ceph.conf 2024-03-26T16:49:34.266 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:33 smithi044 ceph-mon[30624]: Updating smithi157:/var/lib/ceph/4394d798-eb90-11ee-95d0-87774f69a715/config/ceph.conf 2024-03-26T16:49:34.266 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:33 smithi044 ceph-mon[30624]: Reconfiguring mon.a (unknown last config time)... 2024-03-26T16:49:34.266 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:33 smithi044 ceph-mon[30624]: Reconfiguring daemon mon.a on smithi044 2024-03-26T16:49:34.266 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:33 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:49:34.266 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:33 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-03-26T16:49:34.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:49:33 smithi064 ceph-mon[34420]: Updating smithi149:/var/lib/ceph/4394d798-eb90-11ee-95d0-87774f69a715/config/ceph.conf 2024-03-26T16:49:34.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:49:33 smithi064 ceph-mon[34420]: Updating smithi064:/var/lib/ceph/4394d798-eb90-11ee-95d0-87774f69a715/config/ceph.conf 2024-03-26T16:49:34.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:49:33 smithi064 ceph-mon[34420]: Updating smithi044:/var/lib/ceph/4394d798-eb90-11ee-95d0-87774f69a715/config/ceph.conf 2024-03-26T16:49:34.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:49:33 smithi064 ceph-mon[34420]: Updating smithi157:/var/lib/ceph/4394d798-eb90-11ee-95d0-87774f69a715/config/ceph.conf 2024-03-26T16:49:34.307 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:49:33 smithi064 ceph-mon[34420]: Reconfiguring mon.a (unknown last config time)... 2024-03-26T16:49:34.307 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:49:33 smithi064 ceph-mon[34420]: Reconfiguring daemon mon.a on smithi044 2024-03-26T16:49:34.307 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:49:33 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:49:34.307 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:49:33 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-03-26T16:49:35.016 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:34 smithi044 ceph-mon[30624]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-26T16:49:35.147 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:34 smithi149 ceph-mon[34678]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-26T16:49:35.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:49:34 smithi064 ceph-mon[34420]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-26T16:49:35.777 INFO:teuthology.orchestra.run.smithi044.stdout:# minimal ceph.conf for 4394d798-eb90-11ee-95d0-87774f69a715 2024-03-26T16:49:35.777 INFO:teuthology.orchestra.run.smithi044.stdout:[global] 2024-03-26T16:49:35.777 INFO:teuthology.orchestra.run.smithi044.stdout: fsid = 4394d798-eb90-11ee-95d0-87774f69a715 2024-03-26T16:49:35.777 INFO:teuthology.orchestra.run.smithi044.stdout: mon_host = [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] 2024-03-26T16:49:36.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:49:36 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:49:36.307 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:49:36 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:49:36.307 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:49:36 smithi064 ceph-mon[34420]: Reconfiguring mon.b (monmap changed)... 2024-03-26T16:49:36.307 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:49:36 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-03-26T16:49:36.307 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:49:36 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-03-26T16:49:36.307 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:49:36 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T16:49:36.307 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:49:36 smithi064 ceph-mon[34420]: Reconfiguring daemon mon.b on smithi064 2024-03-26T16:49:36.307 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:49:36 smithi064 ceph-mon[34420]: from='client.? 172.21.15.44:0/427351728' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T16:49:36.307 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:49:36 smithi064 ceph-mon[34420]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-26T16:49:36.381 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:36 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:49:36.382 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:36 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:49:36.382 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:36 smithi044 ceph-mon[30624]: Reconfiguring mon.b (monmap changed)... 2024-03-26T16:49:36.382 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:36 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-03-26T16:49:36.382 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:36 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-03-26T16:49:36.382 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:36 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T16:49:36.382 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:36 smithi044 ceph-mon[30624]: Reconfiguring daemon mon.b on smithi064 2024-03-26T16:49:36.382 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:36 smithi044 ceph-mon[30624]: from='client.? 172.21.15.44:0/427351728' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T16:49:36.382 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:36 smithi044 ceph-mon[30624]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-26T16:49:36.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:36 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:49:36.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:36 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:49:36.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:36 smithi149 ceph-mon[34678]: Reconfiguring mon.b (monmap changed)... 2024-03-26T16:49:36.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:36 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-03-26T16:49:36.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:36 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-03-26T16:49:36.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:36 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T16:49:36.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:36 smithi149 ceph-mon[34678]: Reconfiguring daemon mon.b on smithi064 2024-03-26T16:49:36.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:36 smithi149 ceph-mon[34678]: from='client.? 172.21.15.44:0/427351728' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T16:49:36.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:36 smithi149 ceph-mon[34678]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-26T16:49:36.409 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-03-26T16:49:36.409 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-03-26T16:49:36.409 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd of=/etc/ceph/ceph.conf 2024-03-26T16:49:36.441 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-03-26T16:49:36.441 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-03-26T16:49:36.509 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-03-26T16:49:36.509 DEBUG:teuthology.orchestra.run.smithi064:> sudo dd of=/etc/ceph/ceph.conf 2024-03-26T16:49:36.544 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-03-26T16:49:36.544 DEBUG:teuthology.orchestra.run.smithi064:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-03-26T16:49:36.615 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-03-26T16:49:36.615 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd of=/etc/ceph/ceph.conf 2024-03-26T16:49:36.649 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-03-26T16:49:36.650 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-03-26T16:49:36.720 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-03-26T16:49:36.721 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd of=/etc/ceph/ceph.conf 2024-03-26T16:49:36.755 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-03-26T16:49:36.755 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-03-26T16:49:36.827 INFO:tasks.cephadm:Adding mgr.x on smithi044 2024-03-26T16:49:36.827 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bf9505fb569e9b95a78f9700ed8c4bd20508ef55 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4394d798-eb90-11ee-95d0-87774f69a715 -- ceph orch apply mgr '1;smithi044=x' 2024-03-26T16:49:37.110 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/4394d798-eb90-11ee-95d0-87774f69a715/config/ceph.conf 2024-03-26T16:49:37.897 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:37 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:49:37.897 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:37 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:49:37.897 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:37 smithi149 ceph-mon[34678]: Reconfiguring mon.c (monmap changed)... 2024-03-26T16:49:37.897 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:37 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-03-26T16:49:37.897 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:37 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-03-26T16:49:37.897 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:37 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T16:49:37.897 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:37 smithi149 ceph-mon[34678]: Reconfiguring daemon mon.c on smithi149 2024-03-26T16:49:38.016 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:37 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:49:38.016 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:37 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:49:38.016 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:37 smithi044 ceph-mon[30624]: Reconfiguring mon.c (monmap changed)... 2024-03-26T16:49:38.017 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:37 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-03-26T16:49:38.017 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:37 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-03-26T16:49:38.017 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:37 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T16:49:38.017 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:37 smithi044 ceph-mon[30624]: Reconfiguring daemon mon.c on smithi149 2024-03-26T16:49:38.056 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:49:37 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:49:38.056 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:49:37 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:49:38.056 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:49:37 smithi064 ceph-mon[34420]: Reconfiguring mon.c (monmap changed)... 2024-03-26T16:49:38.056 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:49:37 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-03-26T16:49:38.057 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:49:37 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-03-26T16:49:38.057 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:49:37 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T16:49:38.057 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:49:37 smithi064 ceph-mon[34420]: Reconfiguring daemon mon.c on smithi149 2024-03-26T16:49:38.703 INFO:teuthology.orchestra.run.smithi157.stdout:Scheduled mgr update... 2024-03-26T16:49:39.016 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:38 smithi044 ceph-mon[30624]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-26T16:49:39.016 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:38 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:49:39.016 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:38 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:49:39.016 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:38 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-26T16:49:39.016 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:38 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T16:49:39.016 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:38 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-26T16:49:39.016 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:38 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:49:39.016 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:38 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:49:39.056 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:49:38 smithi064 ceph-mon[34420]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-26T16:49:39.056 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:49:38 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:49:39.056 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:49:38 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:49:39.057 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:49:38 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-26T16:49:39.057 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:49:38 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T16:49:39.057 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:49:38 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-26T16:49:39.057 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:49:38 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:49:39.057 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:49:38 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:49:39.147 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:38 smithi149 ceph-mon[34678]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-26T16:49:39.147 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:38 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:49:39.147 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:38 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:49:39.147 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:38 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-26T16:49:39.147 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:38 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T16:49:39.147 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:38 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-26T16:49:39.147 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:38 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:49:39.147 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:38 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:49:39.288 INFO:tasks.cephadm:Deploying OSDs... 2024-03-26T16:49:39.288 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-03-26T16:49:39.288 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/scratch_devs of=/dev/stdout 2024-03-26T16:49:39.303 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-03-26T16:49:39.303 DEBUG:teuthology.orchestra.run.smithi044:> stat /dev/vg_nvme/lv_1 2024-03-26T16:49:39.358 INFO:teuthology.orchestra.run.smithi044.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-03-26T16:49:39.358 INFO:teuthology.orchestra.run.smithi044.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-26T16:49:39.358 INFO:teuthology.orchestra.run.smithi044.stdout:Device: 5h/5d Inode: 974 Links: 1 2024-03-26T16:49:39.358 INFO:teuthology.orchestra.run.smithi044.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-26T16:49:39.358 INFO:teuthology.orchestra.run.smithi044.stdout:Context: system_u:object_r:device_t:s0 2024-03-26T16:49:39.358 INFO:teuthology.orchestra.run.smithi044.stdout:Access: 2024-03-26 16:48:30.108855829 +0000 2024-03-26T16:49:39.358 INFO:teuthology.orchestra.run.smithi044.stdout:Modify: 2024-03-26 16:45:26.738757488 +0000 2024-03-26T16:49:39.358 INFO:teuthology.orchestra.run.smithi044.stdout:Change: 2024-03-26 16:45:26.738757488 +0000 2024-03-26T16:49:39.358 INFO:teuthology.orchestra.run.smithi044.stdout: Birth: 2024-03-26 16:45:26.738757488 +0000 2024-03-26T16:49:39.359 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-03-26T16:49:39.425 INFO:teuthology.orchestra.run.smithi044.stderr:1+0 records in 2024-03-26T16:49:39.425 INFO:teuthology.orchestra.run.smithi044.stderr:1+0 records out 2024-03-26T16:49:39.425 INFO:teuthology.orchestra.run.smithi044.stderr:512 bytes copied, 0.000255056 s, 2.0 MB/s 2024-03-26T16:49:39.427 DEBUG:teuthology.orchestra.run.smithi044:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-03-26T16:49:39.482 DEBUG:teuthology.orchestra.run.smithi044:> stat /dev/vg_nvme/lv_2 2024-03-26T16:49:39.536 INFO:teuthology.orchestra.run.smithi044.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-03-26T16:49:39.537 INFO:teuthology.orchestra.run.smithi044.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-26T16:49:39.537 INFO:teuthology.orchestra.run.smithi044.stdout:Device: 5h/5d Inode: 976 Links: 1 2024-03-26T16:49:39.537 INFO:teuthology.orchestra.run.smithi044.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-26T16:49:39.537 INFO:teuthology.orchestra.run.smithi044.stdout:Context: system_u:object_r:device_t:s0 2024-03-26T16:49:39.537 INFO:teuthology.orchestra.run.smithi044.stdout:Access: 2024-03-26 16:48:30.142855291 +0000 2024-03-26T16:49:39.537 INFO:teuthology.orchestra.run.smithi044.stdout:Modify: 2024-03-26 16:45:26.738757488 +0000 2024-03-26T16:49:39.537 INFO:teuthology.orchestra.run.smithi044.stdout:Change: 2024-03-26 16:45:26.738757488 +0000 2024-03-26T16:49:39.537 INFO:teuthology.orchestra.run.smithi044.stdout: Birth: 2024-03-26 16:45:26.738757488 +0000 2024-03-26T16:49:39.537 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-03-26T16:49:39.601 INFO:teuthology.orchestra.run.smithi044.stderr:1+0 records in 2024-03-26T16:49:39.602 INFO:teuthology.orchestra.run.smithi044.stderr:1+0 records out 2024-03-26T16:49:39.602 INFO:teuthology.orchestra.run.smithi044.stderr:512 bytes copied, 0.000189258 s, 2.7 MB/s 2024-03-26T16:49:39.603 DEBUG:teuthology.orchestra.run.smithi044:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-03-26T16:49:39.658 DEBUG:teuthology.orchestra.run.smithi044:> stat /dev/vg_nvme/lv_3 2024-03-26T16:49:39.713 INFO:teuthology.orchestra.run.smithi044.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-03-26T16:49:39.714 INFO:teuthology.orchestra.run.smithi044.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-26T16:49:39.714 INFO:teuthology.orchestra.run.smithi044.stdout:Device: 5h/5d Inode: 982 Links: 1 2024-03-26T16:49:39.714 INFO:teuthology.orchestra.run.smithi044.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-26T16:49:39.714 INFO:teuthology.orchestra.run.smithi044.stdout:Context: system_u:object_r:device_t:s0 2024-03-26T16:49:39.714 INFO:teuthology.orchestra.run.smithi044.stdout:Access: 2024-03-26 16:48:30.171854832 +0000 2024-03-26T16:49:39.714 INFO:teuthology.orchestra.run.smithi044.stdout:Modify: 2024-03-26 16:45:26.739757472 +0000 2024-03-26T16:49:39.714 INFO:teuthology.orchestra.run.smithi044.stdout:Change: 2024-03-26 16:45:26.739757472 +0000 2024-03-26T16:49:39.714 INFO:teuthology.orchestra.run.smithi044.stdout: Birth: 2024-03-26 16:45:26.739757472 +0000 2024-03-26T16:49:39.714 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-03-26T16:49:39.779 INFO:teuthology.orchestra.run.smithi044.stderr:1+0 records in 2024-03-26T16:49:39.779 INFO:teuthology.orchestra.run.smithi044.stderr:1+0 records out 2024-03-26T16:49:39.779 INFO:teuthology.orchestra.run.smithi044.stderr:512 bytes copied, 0.000182663 s, 2.8 MB/s 2024-03-26T16:49:39.780 DEBUG:teuthology.orchestra.run.smithi044:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-03-26T16:49:39.837 DEBUG:teuthology.orchestra.run.smithi044:> stat /dev/vg_nvme/lv_4 2024-03-26T16:49:39.892 INFO:teuthology.orchestra.run.smithi044.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-03-26T16:49:39.892 INFO:teuthology.orchestra.run.smithi044.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-26T16:49:39.892 INFO:teuthology.orchestra.run.smithi044.stdout:Device: 5h/5d Inode: 967 Links: 1 2024-03-26T16:49:39.892 INFO:teuthology.orchestra.run.smithi044.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-26T16:49:39.892 INFO:teuthology.orchestra.run.smithi044.stdout:Context: system_u:object_r:device_t:s0 2024-03-26T16:49:39.892 INFO:teuthology.orchestra.run.smithi044.stdout:Access: 2024-03-26 16:48:30.202854341 +0000 2024-03-26T16:49:39.892 INFO:teuthology.orchestra.run.smithi044.stdout:Modify: 2024-03-26 16:45:26.737757504 +0000 2024-03-26T16:49:39.892 INFO:teuthology.orchestra.run.smithi044.stdout:Change: 2024-03-26 16:45:26.737757504 +0000 2024-03-26T16:49:39.893 INFO:teuthology.orchestra.run.smithi044.stdout: Birth: 2024-03-26 16:45:26.737757504 +0000 2024-03-26T16:49:39.893 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-03-26T16:49:39.955 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:39 smithi044 ceph-mon[30624]: from='client.24109 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "1;smithi044=x", "target": ["mon-mgr", ""]}]: dispatch 2024-03-26T16:49:39.955 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:39 smithi044 ceph-mon[30624]: Saving service mgr spec with placement smithi044=x;count:1 2024-03-26T16:49:39.955 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:39 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-26T16:49:39.955 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:39 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T16:49:39.956 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:39 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-26T16:49:39.956 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:39 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:49:39.956 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:39 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:49:39.956 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:39 smithi044 ceph-mon[30624]: Reconfiguring mgr.x (unknown last config time)... 2024-03-26T16:49:39.956 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:39 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-03-26T16:49:39.956 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:39 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-03-26T16:49:39.956 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:39 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T16:49:39.956 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:39 smithi044 ceph-mon[30624]: Reconfiguring daemon mgr.x on smithi044 2024-03-26T16:49:39.957 INFO:teuthology.orchestra.run.smithi044.stderr:1+0 records in 2024-03-26T16:49:39.957 INFO:teuthology.orchestra.run.smithi044.stderr:1+0 records out 2024-03-26T16:49:39.958 INFO:teuthology.orchestra.run.smithi044.stderr:512 bytes copied, 0.00018149 s, 2.8 MB/s 2024-03-26T16:49:39.959 DEBUG:teuthology.orchestra.run.smithi044:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-03-26T16:49:40.016 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-03-26T16:49:40.016 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/scratch_devs of=/dev/stdout 2024-03-26T16:49:40.032 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-03-26T16:49:40.033 DEBUG:teuthology.orchestra.run.smithi064:> stat /dev/vg_nvme/lv_1 2024-03-26T16:49:40.056 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:49:39 smithi064 ceph-mon[34420]: from='client.24109 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "1;smithi044=x", "target": ["mon-mgr", ""]}]: dispatch 2024-03-26T16:49:40.056 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:49:39 smithi064 ceph-mon[34420]: Saving service mgr spec with placement smithi044=x;count:1 2024-03-26T16:49:40.056 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:49:39 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-26T16:49:40.056 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:49:39 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T16:49:40.057 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:49:39 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-26T16:49:40.057 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:49:39 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:49:40.057 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:49:39 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:49:40.057 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:49:39 smithi064 ceph-mon[34420]: Reconfiguring mgr.x (unknown last config time)... 2024-03-26T16:49:40.057 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:49:39 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-03-26T16:49:40.057 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:49:39 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-03-26T16:49:40.057 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:49:39 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T16:49:40.057 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:49:39 smithi064 ceph-mon[34420]: Reconfiguring daemon mgr.x on smithi044 2024-03-26T16:49:40.072 INFO:teuthology.orchestra.run.smithi064.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-03-26T16:49:40.072 INFO:teuthology.orchestra.run.smithi064.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-26T16:49:40.072 INFO:teuthology.orchestra.run.smithi064.stdout:Device: 5h/5d Inode: 984 Links: 1 2024-03-26T16:49:40.072 INFO:teuthology.orchestra.run.smithi064.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-26T16:49:40.072 INFO:teuthology.orchestra.run.smithi064.stdout:Context: system_u:object_r:device_t:s0 2024-03-26T16:49:40.072 INFO:teuthology.orchestra.run.smithi064.stdout:Access: 2024-03-26 16:49:24.579509954 +0000 2024-03-26T16:49:40.072 INFO:teuthology.orchestra.run.smithi064.stdout:Modify: 2024-03-26 16:45:29.911122627 +0000 2024-03-26T16:49:40.072 INFO:teuthology.orchestra.run.smithi064.stdout:Change: 2024-03-26 16:45:29.911122627 +0000 2024-03-26T16:49:40.072 INFO:teuthology.orchestra.run.smithi064.stdout: Birth: 2024-03-26 16:45:29.911122627 +0000 2024-03-26T16:49:40.073 DEBUG:teuthology.orchestra.run.smithi064:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-03-26T16:49:40.138 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-03-26T16:49:40.138 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-03-26T16:49:40.138 INFO:teuthology.orchestra.run.smithi064.stderr:512 bytes copied, 0.000263116 s, 1.9 MB/s 2024-03-26T16:49:40.139 DEBUG:teuthology.orchestra.run.smithi064:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-03-26T16:49:40.147 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:39 smithi149 ceph-mon[34678]: from='client.24109 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "1;smithi044=x", "target": ["mon-mgr", ""]}]: dispatch 2024-03-26T16:49:40.147 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:39 smithi149 ceph-mon[34678]: Saving service mgr spec with placement smithi044=x;count:1 2024-03-26T16:49:40.147 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:39 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-26T16:49:40.147 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:39 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T16:49:40.147 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:39 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-26T16:49:40.147 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:39 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:49:40.147 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:39 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:49:40.147 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:39 smithi149 ceph-mon[34678]: Reconfiguring mgr.x (unknown last config time)... 2024-03-26T16:49:40.148 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:39 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-03-26T16:49:40.148 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:39 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-03-26T16:49:40.148 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:39 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T16:49:40.148 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:39 smithi149 ceph-mon[34678]: Reconfiguring daemon mgr.x on smithi044 2024-03-26T16:49:40.195 DEBUG:teuthology.orchestra.run.smithi064:> stat /dev/vg_nvme/lv_2 2024-03-26T16:49:40.251 INFO:teuthology.orchestra.run.smithi064.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-03-26T16:49:40.251 INFO:teuthology.orchestra.run.smithi064.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-26T16:49:40.251 INFO:teuthology.orchestra.run.smithi064.stdout:Device: 5h/5d Inode: 973 Links: 1 2024-03-26T16:49:40.251 INFO:teuthology.orchestra.run.smithi064.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-26T16:49:40.251 INFO:teuthology.orchestra.run.smithi064.stdout:Context: system_u:object_r:device_t:s0 2024-03-26T16:49:40.251 INFO:teuthology.orchestra.run.smithi064.stdout:Access: 2024-03-26 16:49:24.579509954 +0000 2024-03-26T16:49:40.251 INFO:teuthology.orchestra.run.smithi064.stdout:Modify: 2024-03-26 16:45:29.910122646 +0000 2024-03-26T16:49:40.251 INFO:teuthology.orchestra.run.smithi064.stdout:Change: 2024-03-26 16:45:29.910122646 +0000 2024-03-26T16:49:40.251 INFO:teuthology.orchestra.run.smithi064.stdout: Birth: 2024-03-26 16:45:29.910122646 +0000 2024-03-26T16:49:40.251 DEBUG:teuthology.orchestra.run.smithi064:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-03-26T16:49:40.317 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-03-26T16:49:40.317 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-03-26T16:49:40.317 INFO:teuthology.orchestra.run.smithi064.stderr:512 bytes copied, 0.000175215 s, 2.9 MB/s 2024-03-26T16:49:40.318 DEBUG:teuthology.orchestra.run.smithi064:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-03-26T16:49:40.373 DEBUG:teuthology.orchestra.run.smithi064:> stat /dev/vg_nvme/lv_3 2024-03-26T16:49:40.429 INFO:teuthology.orchestra.run.smithi064.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-03-26T16:49:40.430 INFO:teuthology.orchestra.run.smithi064.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-26T16:49:40.430 INFO:teuthology.orchestra.run.smithi064.stdout:Device: 5h/5d Inode: 974 Links: 1 2024-03-26T16:49:40.430 INFO:teuthology.orchestra.run.smithi064.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-26T16:49:40.430 INFO:teuthology.orchestra.run.smithi064.stdout:Context: system_u:object_r:device_t:s0 2024-03-26T16:49:40.430 INFO:teuthology.orchestra.run.smithi064.stdout:Access: 2024-03-26 16:49:24.580509934 +0000 2024-03-26T16:49:40.430 INFO:teuthology.orchestra.run.smithi064.stdout:Modify: 2024-03-26 16:45:29.910122646 +0000 2024-03-26T16:49:40.430 INFO:teuthology.orchestra.run.smithi064.stdout:Change: 2024-03-26 16:45:29.910122646 +0000 2024-03-26T16:49:40.430 INFO:teuthology.orchestra.run.smithi064.stdout: Birth: 2024-03-26 16:45:29.910122646 +0000 2024-03-26T16:49:40.430 DEBUG:teuthology.orchestra.run.smithi064:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-03-26T16:49:40.497 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-03-26T16:49:40.497 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-03-26T16:49:40.497 INFO:teuthology.orchestra.run.smithi064.stderr:512 bytes copied, 0.000196552 s, 2.6 MB/s 2024-03-26T16:49:40.498 DEBUG:teuthology.orchestra.run.smithi064:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-03-26T16:49:40.553 DEBUG:teuthology.orchestra.run.smithi064:> stat /dev/vg_nvme/lv_4 2024-03-26T16:49:40.610 INFO:teuthology.orchestra.run.smithi064.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-03-26T16:49:40.610 INFO:teuthology.orchestra.run.smithi064.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-26T16:49:40.610 INFO:teuthology.orchestra.run.smithi064.stdout:Device: 5h/5d Inode: 980 Links: 1 2024-03-26T16:49:40.610 INFO:teuthology.orchestra.run.smithi064.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-26T16:49:40.610 INFO:teuthology.orchestra.run.smithi064.stdout:Context: system_u:object_r:device_t:s0 2024-03-26T16:49:40.610 INFO:teuthology.orchestra.run.smithi064.stdout:Access: 2024-03-26 16:49:24.580509934 +0000 2024-03-26T16:49:40.611 INFO:teuthology.orchestra.run.smithi064.stdout:Modify: 2024-03-26 16:45:29.911122627 +0000 2024-03-26T16:49:40.611 INFO:teuthology.orchestra.run.smithi064.stdout:Change: 2024-03-26 16:45:29.911122627 +0000 2024-03-26T16:49:40.611 INFO:teuthology.orchestra.run.smithi064.stdout: Birth: 2024-03-26 16:45:29.911122627 +0000 2024-03-26T16:49:40.611 DEBUG:teuthology.orchestra.run.smithi064:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-03-26T16:49:40.676 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2024-03-26T16:49:40.676 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2024-03-26T16:49:40.676 INFO:teuthology.orchestra.run.smithi064.stderr:512 bytes copied, 0.000166341 s, 3.1 MB/s 2024-03-26T16:49:40.677 DEBUG:teuthology.orchestra.run.smithi064:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-03-26T16:49:40.738 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-03-26T16:49:40.739 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/scratch_devs of=/dev/stdout 2024-03-26T16:49:40.756 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-03-26T16:49:40.756 DEBUG:teuthology.orchestra.run.smithi149:> stat /dev/vg_nvme/lv_1 2024-03-26T16:49:40.766 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:40 smithi044 ceph-mon[30624]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-26T16:49:40.766 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:40 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:49:40.766 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:40 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:49:40.812 INFO:teuthology.orchestra.run.smithi149.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-03-26T16:49:40.812 INFO:teuthology.orchestra.run.smithi149.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-26T16:49:40.812 INFO:teuthology.orchestra.run.smithi149.stdout:Device: 5h/5d Inode: 973 Links: 1 2024-03-26T16:49:40.812 INFO:teuthology.orchestra.run.smithi149.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-26T16:49:40.812 INFO:teuthology.orchestra.run.smithi149.stdout:Context: system_u:object_r:device_t:s0 2024-03-26T16:49:40.812 INFO:teuthology.orchestra.run.smithi149.stdout:Access: 2024-03-26 16:49:14.220590754 +0000 2024-03-26T16:49:40.813 INFO:teuthology.orchestra.run.smithi149.stdout:Modify: 2024-03-26 16:43:21.382594690 +0000 2024-03-26T16:49:40.813 INFO:teuthology.orchestra.run.smithi149.stdout:Change: 2024-03-26 16:43:21.382594690 +0000 2024-03-26T16:49:40.813 INFO:teuthology.orchestra.run.smithi149.stdout: Birth: 2024-03-26 16:43:21.382594690 +0000 2024-03-26T16:49:40.813 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-03-26T16:49:40.880 INFO:teuthology.orchestra.run.smithi149.stderr:1+0 records in 2024-03-26T16:49:40.880 INFO:teuthology.orchestra.run.smithi149.stderr:1+0 records out 2024-03-26T16:49:40.880 INFO:teuthology.orchestra.run.smithi149.stderr:512 bytes copied, 0.00021531 s, 2.4 MB/s 2024-03-26T16:49:40.881 DEBUG:teuthology.orchestra.run.smithi149:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-03-26T16:49:40.937 DEBUG:teuthology.orchestra.run.smithi149:> stat /dev/vg_nvme/lv_2 2024-03-26T16:49:40.992 INFO:teuthology.orchestra.run.smithi149.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-03-26T16:49:40.992 INFO:teuthology.orchestra.run.smithi149.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-26T16:49:40.992 INFO:teuthology.orchestra.run.smithi149.stdout:Device: 5h/5d Inode: 982 Links: 1 2024-03-26T16:49:40.992 INFO:teuthology.orchestra.run.smithi149.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-26T16:49:40.993 INFO:teuthology.orchestra.run.smithi149.stdout:Context: system_u:object_r:device_t:s0 2024-03-26T16:49:40.993 INFO:teuthology.orchestra.run.smithi149.stdout:Access: 2024-03-26 16:49:14.221590734 +0000 2024-03-26T16:49:40.993 INFO:teuthology.orchestra.run.smithi149.stdout:Modify: 2024-03-26 16:43:21.385594631 +0000 2024-03-26T16:49:40.993 INFO:teuthology.orchestra.run.smithi149.stdout:Change: 2024-03-26 16:43:21.385594631 +0000 2024-03-26T16:49:40.993 INFO:teuthology.orchestra.run.smithi149.stdout: Birth: 2024-03-26 16:43:21.385594631 +0000 2024-03-26T16:49:40.993 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-03-26T16:49:41.056 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:49:40 smithi064 ceph-mon[34420]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-26T16:49:41.056 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:49:40 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:49:41.056 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:49:40 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:49:41.056 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:40 smithi149 ceph-mon[34678]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-26T16:49:41.057 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:40 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:49:41.057 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:40 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:49:41.060 INFO:teuthology.orchestra.run.smithi149.stderr:1+0 records in 2024-03-26T16:49:41.060 INFO:teuthology.orchestra.run.smithi149.stderr:1+0 records out 2024-03-26T16:49:41.060 INFO:teuthology.orchestra.run.smithi149.stderr:512 bytes copied, 0.000217767 s, 2.4 MB/s 2024-03-26T16:49:41.060 DEBUG:teuthology.orchestra.run.smithi149:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-03-26T16:49:41.117 DEBUG:teuthology.orchestra.run.smithi149:> stat /dev/vg_nvme/lv_3 2024-03-26T16:49:41.171 INFO:teuthology.orchestra.run.smithi149.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-03-26T16:49:41.171 INFO:teuthology.orchestra.run.smithi149.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-26T16:49:41.172 INFO:teuthology.orchestra.run.smithi149.stdout:Device: 5h/5d Inode: 963 Links: 1 2024-03-26T16:49:41.172 INFO:teuthology.orchestra.run.smithi149.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-26T16:49:41.172 INFO:teuthology.orchestra.run.smithi149.stdout:Context: system_u:object_r:device_t:s0 2024-03-26T16:49:41.172 INFO:teuthology.orchestra.run.smithi149.stdout:Access: 2024-03-26 16:49:14.221590734 +0000 2024-03-26T16:49:41.172 INFO:teuthology.orchestra.run.smithi149.stdout:Modify: 2024-03-26 16:43:21.382594690 +0000 2024-03-26T16:49:41.172 INFO:teuthology.orchestra.run.smithi149.stdout:Change: 2024-03-26 16:43:21.382594690 +0000 2024-03-26T16:49:41.172 INFO:teuthology.orchestra.run.smithi149.stdout: Birth: 2024-03-26 16:43:21.382594690 +0000 2024-03-26T16:49:41.172 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-03-26T16:49:41.237 INFO:teuthology.orchestra.run.smithi149.stderr:1+0 records in 2024-03-26T16:49:41.237 INFO:teuthology.orchestra.run.smithi149.stderr:1+0 records out 2024-03-26T16:49:41.237 INFO:teuthology.orchestra.run.smithi149.stderr:512 bytes copied, 0.000195729 s, 2.6 MB/s 2024-03-26T16:49:41.239 DEBUG:teuthology.orchestra.run.smithi149:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-03-26T16:49:41.294 DEBUG:teuthology.orchestra.run.smithi149:> stat /dev/vg_nvme/lv_4 2024-03-26T16:49:41.348 INFO:teuthology.orchestra.run.smithi149.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-03-26T16:49:41.348 INFO:teuthology.orchestra.run.smithi149.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-26T16:49:41.349 INFO:teuthology.orchestra.run.smithi149.stdout:Device: 5h/5d Inode: 961 Links: 1 2024-03-26T16:49:41.349 INFO:teuthology.orchestra.run.smithi149.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-26T16:49:41.349 INFO:teuthology.orchestra.run.smithi149.stdout:Context: system_u:object_r:device_t:s0 2024-03-26T16:49:41.349 INFO:teuthology.orchestra.run.smithi149.stdout:Access: 2024-03-26 16:49:14.221590734 +0000 2024-03-26T16:49:41.349 INFO:teuthology.orchestra.run.smithi149.stdout:Modify: 2024-03-26 16:43:21.382594690 +0000 2024-03-26T16:49:41.349 INFO:teuthology.orchestra.run.smithi149.stdout:Change: 2024-03-26 16:43:21.382594690 +0000 2024-03-26T16:49:41.349 INFO:teuthology.orchestra.run.smithi149.stdout: Birth: 2024-03-26 16:43:21.382594690 +0000 2024-03-26T16:49:41.349 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-03-26T16:49:41.414 INFO:teuthology.orchestra.run.smithi149.stderr:1+0 records in 2024-03-26T16:49:41.414 INFO:teuthology.orchestra.run.smithi149.stderr:1+0 records out 2024-03-26T16:49:41.414 INFO:teuthology.orchestra.run.smithi149.stderr:512 bytes copied, 0.000214231 s, 2.4 MB/s 2024-03-26T16:49:41.415 DEBUG:teuthology.orchestra.run.smithi149:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-03-26T16:49:41.471 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-03-26T16:49:41.471 DEBUG:teuthology.orchestra.run.smithi157:> dd if=/scratch_devs of=/dev/stdout 2024-03-26T16:49:41.491 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-03-26T16:49:41.491 DEBUG:teuthology.orchestra.run.smithi157:> stat /dev/vg_nvme/lv_1 2024-03-26T16:49:41.548 INFO:teuthology.orchestra.run.smithi157.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-03-26T16:49:41.548 INFO:teuthology.orchestra.run.smithi157.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-26T16:49:41.548 INFO:teuthology.orchestra.run.smithi157.stdout:Device: 5h/5d Inode: 975 Links: 1 2024-03-26T16:49:41.549 INFO:teuthology.orchestra.run.smithi157.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-26T16:49:41.549 INFO:teuthology.orchestra.run.smithi157.stdout:Context: system_u:object_r:device_t:s0 2024-03-26T16:49:41.549 INFO:teuthology.orchestra.run.smithi157.stdout:Access: 2024-03-26 16:49:05.231746315 +0000 2024-03-26T16:49:41.549 INFO:teuthology.orchestra.run.smithi157.stdout:Modify: 2024-03-26 16:43:30.670686714 +0000 2024-03-26T16:49:41.549 INFO:teuthology.orchestra.run.smithi157.stdout:Change: 2024-03-26 16:43:30.670686714 +0000 2024-03-26T16:49:41.549 INFO:teuthology.orchestra.run.smithi157.stdout: Birth: 2024-03-26 16:43:30.670686714 +0000 2024-03-26T16:49:41.549 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-03-26T16:49:41.620 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records in 2024-03-26T16:49:41.620 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records out 2024-03-26T16:49:41.620 INFO:teuthology.orchestra.run.smithi157.stderr:512 bytes copied, 0.000120076 s, 4.3 MB/s 2024-03-26T16:49:41.621 DEBUG:teuthology.orchestra.run.smithi157:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-03-26T16:49:41.681 DEBUG:teuthology.orchestra.run.smithi157:> stat /dev/vg_nvme/lv_2 2024-03-26T16:49:41.739 INFO:teuthology.orchestra.run.smithi157.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-03-26T16:49:41.739 INFO:teuthology.orchestra.run.smithi157.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-26T16:49:41.739 INFO:teuthology.orchestra.run.smithi157.stdout:Device: 5h/5d Inode: 965 Links: 1 2024-03-26T16:49:41.739 INFO:teuthology.orchestra.run.smithi157.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-26T16:49:41.739 INFO:teuthology.orchestra.run.smithi157.stdout:Context: system_u:object_r:device_t:s0 2024-03-26T16:49:41.740 INFO:teuthology.orchestra.run.smithi157.stdout:Access: 2024-03-26 16:49:05.261745776 +0000 2024-03-26T16:49:41.740 INFO:teuthology.orchestra.run.smithi157.stdout:Modify: 2024-03-26 16:43:30.670686714 +0000 2024-03-26T16:49:41.740 INFO:teuthology.orchestra.run.smithi157.stdout:Change: 2024-03-26 16:43:30.670686714 +0000 2024-03-26T16:49:41.740 INFO:teuthology.orchestra.run.smithi157.stdout: Birth: 2024-03-26 16:43:30.670686714 +0000 2024-03-26T16:49:41.740 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-03-26T16:49:41.808 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records in 2024-03-26T16:49:41.809 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records out 2024-03-26T16:49:41.809 INFO:teuthology.orchestra.run.smithi157.stderr:512 bytes copied, 0.000119397 s, 4.3 MB/s 2024-03-26T16:49:41.811 DEBUG:teuthology.orchestra.run.smithi157:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-03-26T16:49:41.869 DEBUG:teuthology.orchestra.run.smithi157:> stat /dev/vg_nvme/lv_3 2024-03-26T16:49:41.925 INFO:teuthology.orchestra.run.smithi157.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-03-26T16:49:41.925 INFO:teuthology.orchestra.run.smithi157.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-26T16:49:41.925 INFO:teuthology.orchestra.run.smithi157.stdout:Device: 5h/5d Inode: 984 Links: 1 2024-03-26T16:49:41.925 INFO:teuthology.orchestra.run.smithi157.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-26T16:49:41.925 INFO:teuthology.orchestra.run.smithi157.stdout:Context: system_u:object_r:device_t:s0 2024-03-26T16:49:41.925 INFO:teuthology.orchestra.run.smithi157.stdout:Access: 2024-03-26 16:49:05.290745255 +0000 2024-03-26T16:49:41.925 INFO:teuthology.orchestra.run.smithi157.stdout:Modify: 2024-03-26 16:43:30.672686679 +0000 2024-03-26T16:49:41.926 INFO:teuthology.orchestra.run.smithi157.stdout:Change: 2024-03-26 16:43:30.672686679 +0000 2024-03-26T16:49:41.926 INFO:teuthology.orchestra.run.smithi157.stdout: Birth: 2024-03-26 16:43:30.672686679 +0000 2024-03-26T16:49:41.926 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-03-26T16:49:41.993 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records in 2024-03-26T16:49:41.993 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records out 2024-03-26T16:49:41.993 INFO:teuthology.orchestra.run.smithi157.stderr:512 bytes copied, 0.000102899 s, 5.0 MB/s 2024-03-26T16:49:41.994 DEBUG:teuthology.orchestra.run.smithi157:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-03-26T16:49:42.052 DEBUG:teuthology.orchestra.run.smithi157:> stat /dev/vg_nvme/lv_4 2024-03-26T16:49:42.107 INFO:teuthology.orchestra.run.smithi157.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-03-26T16:49:42.107 INFO:teuthology.orchestra.run.smithi157.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-26T16:49:42.107 INFO:teuthology.orchestra.run.smithi157.stdout:Device: 5h/5d Inode: 971 Links: 1 2024-03-26T16:49:42.108 INFO:teuthology.orchestra.run.smithi157.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-26T16:49:42.108 INFO:teuthology.orchestra.run.smithi157.stdout:Context: system_u:object_r:device_t:s0 2024-03-26T16:49:42.108 INFO:teuthology.orchestra.run.smithi157.stdout:Access: 2024-03-26 16:49:05.319744734 +0000 2024-03-26T16:49:42.108 INFO:teuthology.orchestra.run.smithi157.stdout:Modify: 2024-03-26 16:43:30.670686714 +0000 2024-03-26T16:49:42.108 INFO:teuthology.orchestra.run.smithi157.stdout:Change: 2024-03-26 16:43:30.670686714 +0000 2024-03-26T16:49:42.108 INFO:teuthology.orchestra.run.smithi157.stdout: Birth: 2024-03-26 16:43:30.670686714 +0000 2024-03-26T16:49:42.108 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-03-26T16:49:42.174 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records in 2024-03-26T16:49:42.175 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records out 2024-03-26T16:49:42.175 INFO:teuthology.orchestra.run.smithi157.stderr:512 bytes copied, 8.4704e-05 s, 6.0 MB/s 2024-03-26T16:49:42.176 DEBUG:teuthology.orchestra.run.smithi157:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-03-26T16:49:42.234 INFO:tasks.cephadm:Deploying osd.0 on smithi044 with /dev/vg_nvme/lv_4... 2024-03-26T16:49:42.234 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bf9505fb569e9b95a78f9700ed8c4bd20508ef55 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4394d798-eb90-11ee-95d0-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-03-26T16:49:42.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:42 smithi149 ceph-mon[34678]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-26T16:49:42.480 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/4394d798-eb90-11ee-95d0-87774f69a715/mon.a/config 2024-03-26T16:49:42.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:42 smithi044 ceph-mon[30624]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-26T16:49:42.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:49:42 smithi064 ceph-mon[34420]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-26T16:49:44.348 INFO:teuthology.orchestra.run.smithi044.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-03-26T16:49:44.348 INFO:teuthology.orchestra.run.smithi044.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-03-26T16:49:44.348 INFO:teuthology.orchestra.run.smithi044.stderr: stderr: 10+0 records in 2024-03-26T16:49:44.348 INFO:teuthology.orchestra.run.smithi044.stderr:10+0 records out 2024-03-26T16:49:44.349 INFO:teuthology.orchestra.run.smithi044.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0111225 s, 943 MB/s 2024-03-26T16:49:44.349 INFO:teuthology.orchestra.run.smithi044.stderr:--> Zapping successful for: 2024-03-26T16:49:44.372 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:44 smithi044 ceph-mon[30624]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-26T16:49:44.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:44 smithi149 ceph-mon[34678]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-26T16:49:44.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:49:44 smithi064 ceph-mon[34420]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-26T16:49:44.952 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bf9505fb569e9b95a78f9700ed8c4bd20508ef55 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4394d798-eb90-11ee-95d0-87774f69a715 -- ceph orch daemon add osd smithi044:vg_nvme/lv_4 2024-03-26T16:49:45.190 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/4394d798-eb90-11ee-95d0-87774f69a715/mon.a/config 2024-03-26T16:49:46.389 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:46 smithi044 ceph-mon[30624]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-26T16:49:46.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:46 smithi149 ceph-mon[34678]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-26T16:49:46.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:49:46 smithi064 ceph-mon[34420]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-26T16:49:47.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:47 smithi149 ceph-mon[34678]: from='client.14223 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi044:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-03-26T16:49:47.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:47 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-03-26T16:49:47.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:47 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-03-26T16:49:47.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:47 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T16:49:47.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:47 smithi044 ceph-mon[30624]: from='client.14223 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi044:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-03-26T16:49:47.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:47 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-03-26T16:49:47.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:47 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-03-26T16:49:47.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:47 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T16:49:47.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:49:47 smithi064 ceph-mon[34420]: from='client.14223 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi044:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-03-26T16:49:47.557 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:49:47 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-03-26T16:49:47.557 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:49:47 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-03-26T16:49:47.557 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:49:47 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T16:49:48.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:48 smithi149 ceph-mon[34678]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-26T16:49:48.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:48 smithi044 ceph-mon[30624]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-26T16:49:48.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:49:48 smithi064 ceph-mon[34420]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-26T16:49:50.016 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:49 smithi044 ceph-mon[30624]: from='client.? 172.21.15.44:0/3210270326' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "89074398-09bf-48a6-bb1c-4952b3ee8da4"} : dispatch 2024-03-26T16:49:50.016 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:49 smithi044 ceph-mon[30624]: from='client.? 172.21.15.44:0/3210270326' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "89074398-09bf-48a6-bb1c-4952b3ee8da4"}]': finished 2024-03-26T16:49:50.017 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:49 smithi044 ceph-mon[30624]: osdmap e5: 1 total, 0 up, 1 in 2024-03-26T16:49:50.017 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:49 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-03-26T16:49:50.056 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:49:49 smithi064 ceph-mon[34420]: from='client.? 172.21.15.44:0/3210270326' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "89074398-09bf-48a6-bb1c-4952b3ee8da4"} : dispatch 2024-03-26T16:49:50.056 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:49:49 smithi064 ceph-mon[34420]: from='client.? 172.21.15.44:0/3210270326' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "89074398-09bf-48a6-bb1c-4952b3ee8da4"}]': finished 2024-03-26T16:49:50.056 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:49:49 smithi064 ceph-mon[34420]: osdmap e5: 1 total, 0 up, 1 in 2024-03-26T16:49:50.057 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:49:49 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-03-26T16:49:50.147 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:49 smithi149 ceph-mon[34678]: from='client.? 172.21.15.44:0/3210270326' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "89074398-09bf-48a6-bb1c-4952b3ee8da4"} : dispatch 2024-03-26T16:49:50.147 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:49 smithi149 ceph-mon[34678]: from='client.? 172.21.15.44:0/3210270326' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "89074398-09bf-48a6-bb1c-4952b3ee8da4"}]': finished 2024-03-26T16:49:50.147 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:49 smithi149 ceph-mon[34678]: osdmap e5: 1 total, 0 up, 1 in 2024-03-26T16:49:50.147 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:49 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-03-26T16:49:51.057 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:49:50 smithi064 ceph-mon[34420]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-26T16:49:51.057 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:49:50 smithi064 ceph-mon[34420]: from='client.? 172.21.15.44:0/2456816261' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-03-26T16:49:51.147 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:50 smithi149 ceph-mon[34678]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-26T16:49:51.147 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:50 smithi149 ceph-mon[34678]: from='client.? 172.21.15.44:0/2456816261' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-03-26T16:49:51.266 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:50 smithi044 ceph-mon[30624]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-26T16:49:51.266 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:50 smithi044 ceph-mon[30624]: from='client.? 172.21.15.44:0/2456816261' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-03-26T16:49:52.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:52 smithi149 ceph-mon[34678]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-26T16:49:52.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:52 smithi044 ceph-mon[30624]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-26T16:49:52.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:49:52 smithi064 ceph-mon[34420]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-26T16:49:54.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:54 smithi149 ceph-mon[34678]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-26T16:49:54.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:54 smithi044 ceph-mon[30624]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-26T16:49:54.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:49:54 smithi064 ceph-mon[34420]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-26T16:49:56.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:56 smithi149 ceph-mon[34678]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-26T16:49:56.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:56 smithi044 ceph-mon[30624]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-26T16:49:56.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:49:56 smithi064 ceph-mon[34420]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-26T16:49:57.395 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:57 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-03-26T16:49:57.395 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:57 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T16:49:57.395 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:57 smithi044 ceph-mon[30624]: Deploying daemon osd.0 on smithi044 2024-03-26T16:49:57.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:57 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-03-26T16:49:57.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:57 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T16:49:57.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:57 smithi149 ceph-mon[34678]: Deploying daemon osd.0 on smithi044 2024-03-26T16:49:57.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:49:57 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-03-26T16:49:57.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:49:57 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T16:49:57.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:49:57 smithi064 ceph-mon[34420]: Deploying daemon osd.0 on smithi044 2024-03-26T16:49:58.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:49:58 smithi149 ceph-mon[34678]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-26T16:49:58.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:49:58 smithi044 ceph-mon[30624]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-26T16:49:58.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:49:58 smithi064 ceph-mon[34420]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-26T16:50:00.266 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:00 smithi044 ceph-mon[30624]: overall HEALTH_OK 2024-03-26T16:50:00.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:00 smithi064 ceph-mon[34420]: overall HEALTH_OK 2024-03-26T16:50:00.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:00 smithi149 ceph-mon[34678]: overall HEALTH_OK 2024-03-26T16:50:01.208 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:01 smithi044 ceph-mon[30624]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-26T16:50:01.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:01 smithi064 ceph-mon[34420]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-26T16:50:01.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:01 smithi149 ceph-mon[34678]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-26T16:50:02.766 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:02 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:50:02.766 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:02 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:50:02.766 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:02 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-26T16:50:02.766 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:02 smithi044 ceph-mon[30624]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-26T16:50:02.806 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:02 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:50:02.806 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:02 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:50:02.807 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:02 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-26T16:50:02.807 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:02 smithi064 ceph-mon[34420]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-26T16:50:02.897 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:02 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:50:02.897 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:02 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:50:02.897 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:02 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-26T16:50:02.897 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:02 smithi149 ceph-mon[34678]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-26T16:50:04.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:04 smithi149 ceph-mon[34678]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-26T16:50:04.478 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:04 smithi044 ceph-mon[30624]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-26T16:50:04.528 INFO:teuthology.orchestra.run.smithi044.stdout:Created osd(s) 0 on host 'smithi044' 2024-03-26T16:50:04.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:04 smithi064 ceph-mon[34420]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-26T16:50:05.503 DEBUG:teuthology.orchestra.run.smithi044:osd.0> sudo journalctl -f -n 0 -u ceph-4394d798-eb90-11ee-95d0-87774f69a715@osd.0.service 2024-03-26T16:50:05.505 INFO:tasks.cephadm:Deploying osd.1 on smithi044 with /dev/vg_nvme/lv_3... 2024-03-26T16:50:05.505 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bf9505fb569e9b95a78f9700ed8c4bd20508ef55 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4394d798-eb90-11ee-95d0-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-03-26T16:50:05.766 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:05 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:50:05.766 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:05 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:50:05.766 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:05 smithi044 ceph-mon[30624]: from='osd.0 [v2:172.21.15.44:6802/2121774261,v1:172.21.15.44:6803/2121774261]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-03-26T16:50:05.766 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:05 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:50:05.766 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:05 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:50:05.806 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:05 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:50:05.806 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:05 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:50:05.807 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:05 smithi064 ceph-mon[34420]: from='osd.0 [v2:172.21.15.44:6802/2121774261,v1:172.21.15.44:6803/2121774261]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-03-26T16:50:05.807 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:05 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:50:05.807 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:05 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:50:05.897 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:05 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:50:05.897 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:05 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:50:05.897 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:05 smithi149 ceph-mon[34678]: from='osd.0 [v2:172.21.15.44:6802/2121774261,v1:172.21.15.44:6803/2121774261]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-03-26T16:50:05.897 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:05 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:50:05.897 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:05 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:50:06.702 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:06 smithi044 ceph-mon[30624]: from='osd.0 [v2:172.21.15.44:6802/2121774261,v1:172.21.15.44:6803/2121774261]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-03-26T16:50:06.702 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:06 smithi044 ceph-mon[30624]: osdmap e6: 1 total, 0 up, 1 in 2024-03-26T16:50:06.702 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:06 smithi044 ceph-mon[30624]: from='osd.0 [v2:172.21.15.44:6802/2121774261,v1:172.21.15.44:6803/2121774261]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi044", "root=default"]} : dispatch 2024-03-26T16:50:06.703 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:06 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-03-26T16:50:06.703 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:06 smithi044 ceph-mon[30624]: pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-26T16:50:06.806 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:06 smithi064 ceph-mon[34420]: from='osd.0 [v2:172.21.15.44:6802/2121774261,v1:172.21.15.44:6803/2121774261]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-03-26T16:50:06.806 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:06 smithi064 ceph-mon[34420]: osdmap e6: 1 total, 0 up, 1 in 2024-03-26T16:50:06.806 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:06 smithi064 ceph-mon[34420]: from='osd.0 [v2:172.21.15.44:6802/2121774261,v1:172.21.15.44:6803/2121774261]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi044", "root=default"]} : dispatch 2024-03-26T16:50:06.806 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:06 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-03-26T16:50:06.807 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:06 smithi064 ceph-mon[34420]: pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-26T16:50:06.897 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:06 smithi149 ceph-mon[34678]: from='osd.0 [v2:172.21.15.44:6802/2121774261,v1:172.21.15.44:6803/2121774261]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-03-26T16:50:06.897 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:06 smithi149 ceph-mon[34678]: osdmap e6: 1 total, 0 up, 1 in 2024-03-26T16:50:06.897 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:06 smithi149 ceph-mon[34678]: from='osd.0 [v2:172.21.15.44:6802/2121774261,v1:172.21.15.44:6803/2121774261]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi044", "root=default"]} : dispatch 2024-03-26T16:50:06.897 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:06 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-03-26T16:50:06.897 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:06 smithi149 ceph-mon[34678]: pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-26T16:50:06.987 INFO:journalctl@ceph.osd.0.smithi044.stdout:Mar 26 16:50:06 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-0[45343]: 2024-03-26T16:50:06.941+0000 7ffa34a38700 -1 osd.0 0 waiting for initial osdmap 2024-03-26T16:50:06.987 INFO:journalctl@ceph.osd.0.smithi044.stdout:Mar 26 16:50:06 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-0[45343]: 2024-03-26T16:50:06.944+0000 7ffa2c823700 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-26T16:50:07.209 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/4394d798-eb90-11ee-95d0-87774f69a715/mon.a/config 2024-03-26T16:50:07.797 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:07 smithi044 ceph-mon[30624]: from='osd.0 [v2:172.21.15.44:6802/2121774261,v1:172.21.15.44:6803/2121774261]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi044", "root=default"]}]': finished 2024-03-26T16:50:07.797 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:07 smithi044 ceph-mon[30624]: osdmap e7: 1 total, 0 up, 1 in 2024-03-26T16:50:07.797 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:07 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-03-26T16:50:07.797 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:07 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-03-26T16:50:07.797 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:07 smithi044 ceph-mon[30624]: from='osd.0 [v2:172.21.15.44:6802/2121774261,v1:172.21.15.44:6803/2121774261]' entity='osd.0' 2024-03-26T16:50:07.797 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:07 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-03-26T16:50:07.806 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:07 smithi064 ceph-mon[34420]: from='osd.0 [v2:172.21.15.44:6802/2121774261,v1:172.21.15.44:6803/2121774261]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi044", "root=default"]}]': finished 2024-03-26T16:50:07.806 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:07 smithi064 ceph-mon[34420]: osdmap e7: 1 total, 0 up, 1 in 2024-03-26T16:50:07.806 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:07 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-03-26T16:50:07.806 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:07 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-03-26T16:50:07.806 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:07 smithi064 ceph-mon[34420]: from='osd.0 [v2:172.21.15.44:6802/2121774261,v1:172.21.15.44:6803/2121774261]' entity='osd.0' 2024-03-26T16:50:07.807 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:07 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-03-26T16:50:07.897 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:07 smithi149 ceph-mon[34678]: from='osd.0 [v2:172.21.15.44:6802/2121774261,v1:172.21.15.44:6803/2121774261]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi044", "root=default"]}]': finished 2024-03-26T16:50:07.897 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:07 smithi149 ceph-mon[34678]: osdmap e7: 1 total, 0 up, 1 in 2024-03-26T16:50:07.897 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:07 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-03-26T16:50:07.897 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:07 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-03-26T16:50:07.897 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:07 smithi149 ceph-mon[34678]: from='osd.0 [v2:172.21.15.44:6802/2121774261,v1:172.21.15.44:6803/2121774261]' entity='osd.0' 2024-03-26T16:50:07.897 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:07 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-03-26T16:50:08.637 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:08 smithi044 ceph-mon[30624]: purged_snaps scrub starts 2024-03-26T16:50:08.637 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:08 smithi044 ceph-mon[30624]: purged_snaps scrub ok 2024-03-26T16:50:08.637 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:08 smithi044 ceph-mon[30624]: osd.0 [v2:172.21.15.44:6802/2121774261,v1:172.21.15.44:6803/2121774261] boot 2024-03-26T16:50:08.637 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:08 smithi044 ceph-mon[30624]: osdmap e8: 1 total, 1 up, 1 in 2024-03-26T16:50:08.637 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:08 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-03-26T16:50:08.637 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:08 smithi044 ceph-mon[30624]: pgmap v53: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-26T16:50:08.806 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:08 smithi064 ceph-mon[34420]: purged_snaps scrub starts 2024-03-26T16:50:08.806 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:08 smithi064 ceph-mon[34420]: purged_snaps scrub ok 2024-03-26T16:50:08.807 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:08 smithi064 ceph-mon[34420]: osd.0 [v2:172.21.15.44:6802/2121774261,v1:172.21.15.44:6803/2121774261] boot 2024-03-26T16:50:08.807 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:08 smithi064 ceph-mon[34420]: osdmap e8: 1 total, 1 up, 1 in 2024-03-26T16:50:08.807 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:08 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-03-26T16:50:08.807 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:08 smithi064 ceph-mon[34420]: pgmap v53: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-26T16:50:08.897 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:08 smithi149 ceph-mon[34678]: purged_snaps scrub starts 2024-03-26T16:50:08.897 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:08 smithi149 ceph-mon[34678]: purged_snaps scrub ok 2024-03-26T16:50:08.897 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:08 smithi149 ceph-mon[34678]: osd.0 [v2:172.21.15.44:6802/2121774261,v1:172.21.15.44:6803/2121774261] boot 2024-03-26T16:50:08.897 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:08 smithi149 ceph-mon[34678]: osdmap e8: 1 total, 1 up, 1 in 2024-03-26T16:50:08.897 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:08 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-03-26T16:50:08.897 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:08 smithi149 ceph-mon[34678]: pgmap v53: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-26T16:50:09.826 INFO:teuthology.orchestra.run.smithi044.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-03-26T16:50:09.826 INFO:teuthology.orchestra.run.smithi044.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-03-26T16:50:09.826 INFO:teuthology.orchestra.run.smithi044.stderr: stderr: 10+0 records in 2024-03-26T16:50:09.826 INFO:teuthology.orchestra.run.smithi044.stderr:10+0 records out 2024-03-26T16:50:09.826 INFO:teuthology.orchestra.run.smithi044.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0140607 s, 746 MB/s 2024-03-26T16:50:09.826 INFO:teuthology.orchestra.run.smithi044.stderr:--> Zapping successful for: 2024-03-26T16:50:10.161 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:10 smithi044 ceph-mon[30624]: Detected new or changed devices on smithi044 2024-03-26T16:50:10.161 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:10 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:50:10.161 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:10 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:50:10.161 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:10 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-03-26T16:50:10.161 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:10 smithi044 ceph-mon[30624]: Adjusting osd_memory_target on smithi044 to 17093M 2024-03-26T16:50:10.162 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:10 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:50:10.162 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:10 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T16:50:10.162 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:10 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-26T16:50:10.162 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:10 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:50:10.162 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:10 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-26T16:50:10.162 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:10 smithi044 ceph-mon[30624]: osdmap e9: 1 total, 1 up, 1 in 2024-03-26T16:50:10.162 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:10 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T16:50:10.162 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:10 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-26T16:50:10.162 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:10 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:50:10.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:10 smithi064 ceph-mon[34420]: Detected new or changed devices on smithi044 2024-03-26T16:50:10.307 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:10 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:50:10.307 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:10 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:50:10.307 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:10 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-03-26T16:50:10.307 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:10 smithi064 ceph-mon[34420]: Adjusting osd_memory_target on smithi044 to 17093M 2024-03-26T16:50:10.307 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:10 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:50:10.307 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:10 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T16:50:10.307 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:10 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-26T16:50:10.307 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:10 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:50:10.307 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:10 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-26T16:50:10.307 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:10 smithi064 ceph-mon[34420]: osdmap e9: 1 total, 1 up, 1 in 2024-03-26T16:50:10.307 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:10 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T16:50:10.307 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:10 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-26T16:50:10.307 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:10 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:50:10.398 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:10 smithi149 ceph-mon[34678]: Detected new or changed devices on smithi044 2024-03-26T16:50:10.398 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:10 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:50:10.398 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:10 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:50:10.398 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:10 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-03-26T16:50:10.398 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:10 smithi149 ceph-mon[34678]: Adjusting osd_memory_target on smithi044 to 17093M 2024-03-26T16:50:10.398 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:10 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:50:10.398 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:10 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T16:50:10.398 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:10 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-26T16:50:10.398 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:10 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:50:10.398 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:10 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-26T16:50:10.399 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:10 smithi149 ceph-mon[34678]: osdmap e9: 1 total, 1 up, 1 in 2024-03-26T16:50:10.399 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:10 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T16:50:10.399 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:10 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-26T16:50:10.399 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:10 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:50:10.498 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bf9505fb569e9b95a78f9700ed8c4bd20508ef55 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4394d798-eb90-11ee-95d0-87774f69a715 -- ceph orch daemon add osd smithi044:vg_nvme/lv_3 2024-03-26T16:50:10.737 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/4394d798-eb90-11ee-95d0-87774f69a715/mon.a/config 2024-03-26T16:50:11.165 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:11 smithi044 ceph-mon[30624]: pgmap v55: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-26T16:50:11.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:11 smithi064 ceph-mon[34420]: pgmap v55: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-26T16:50:11.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:11 smithi149 ceph-mon[34678]: pgmap v55: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-26T16:50:13.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:13 smithi064 ceph-mon[34420]: pgmap v56: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-26T16:50:13.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:13 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-03-26T16:50:13.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:13 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-03-26T16:50:13.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:13 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T16:50:13.390 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:13 smithi044 ceph-mon[30624]: pgmap v56: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-26T16:50:13.390 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:13 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-03-26T16:50:13.391 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:13 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-03-26T16:50:13.391 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:13 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T16:50:13.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:13 smithi149 ceph-mon[34678]: pgmap v56: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-26T16:50:13.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:13 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-03-26T16:50:13.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:13 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-03-26T16:50:13.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:13 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T16:50:14.266 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:14 smithi044 ceph-mon[30624]: from='client.14250 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi044:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-03-26T16:50:14.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:14 smithi064 ceph-mon[34420]: from='client.14250 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi044:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-03-26T16:50:14.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:14 smithi149 ceph-mon[34678]: from='client.14250 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi044:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-03-26T16:50:15.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:15 smithi064 ceph-mon[34420]: pgmap v57: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-26T16:50:15.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:15 smithi149 ceph-mon[34678]: pgmap v57: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-26T16:50:15.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:15 smithi044 ceph-mon[30624]: pgmap v57: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-26T16:50:16.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:16 smithi064 ceph-mon[34420]: from='client.? 172.21.15.44:0/1361668663' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "1526e135-9bdd-489d-aed8-d8a17f5362f4"} : dispatch 2024-03-26T16:50:16.307 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:16 smithi064 ceph-mon[34420]: from='client.? 172.21.15.44:0/1361668663' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1526e135-9bdd-489d-aed8-d8a17f5362f4"}]': finished 2024-03-26T16:50:16.307 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:16 smithi064 ceph-mon[34420]: osdmap e10: 2 total, 1 up, 2 in 2024-03-26T16:50:16.307 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:16 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-03-26T16:50:16.307 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:16 smithi064 ceph-mon[34420]: from='client.? 172.21.15.44:0/2522210389' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-03-26T16:50:16.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:16 smithi149 ceph-mon[34678]: from='client.? 172.21.15.44:0/1361668663' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "1526e135-9bdd-489d-aed8-d8a17f5362f4"} : dispatch 2024-03-26T16:50:16.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:16 smithi149 ceph-mon[34678]: from='client.? 172.21.15.44:0/1361668663' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1526e135-9bdd-489d-aed8-d8a17f5362f4"}]': finished 2024-03-26T16:50:16.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:16 smithi149 ceph-mon[34678]: osdmap e10: 2 total, 1 up, 2 in 2024-03-26T16:50:16.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:16 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-03-26T16:50:16.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:16 smithi149 ceph-mon[34678]: from='client.? 172.21.15.44:0/2522210389' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-03-26T16:50:16.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:16 smithi044 ceph-mon[30624]: from='client.? 172.21.15.44:0/1361668663' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "1526e135-9bdd-489d-aed8-d8a17f5362f4"} : dispatch 2024-03-26T16:50:16.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:16 smithi044 ceph-mon[30624]: from='client.? 172.21.15.44:0/1361668663' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1526e135-9bdd-489d-aed8-d8a17f5362f4"}]': finished 2024-03-26T16:50:16.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:16 smithi044 ceph-mon[30624]: osdmap e10: 2 total, 1 up, 2 in 2024-03-26T16:50:16.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:16 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-03-26T16:50:16.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:16 smithi044 ceph-mon[30624]: from='client.? 172.21.15.44:0/2522210389' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-03-26T16:50:17.307 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:17 smithi064 ceph-mon[34420]: pgmap v59: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-26T16:50:17.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:17 smithi149 ceph-mon[34678]: pgmap v59: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-26T16:50:17.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:17 smithi044 ceph-mon[30624]: pgmap v59: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-26T16:50:19.266 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:19 smithi044 ceph-mon[30624]: pgmap v60: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-26T16:50:19.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:19 smithi064 ceph-mon[34420]: pgmap v60: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-26T16:50:19.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:19 smithi149 ceph-mon[34678]: pgmap v60: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-26T16:50:21.266 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:21 smithi044 ceph-mon[30624]: pgmap v61: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-26T16:50:21.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:21 smithi064 ceph-mon[34420]: pgmap v61: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-26T16:50:21.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:21 smithi149 ceph-mon[34678]: pgmap v61: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-26T16:50:22.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:22 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-03-26T16:50:22.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:22 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T16:50:22.314 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:22 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-03-26T16:50:22.314 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:22 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T16:50:22.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:22 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-03-26T16:50:22.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:22 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T16:50:23.180 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:23 smithi044 ceph-mon[30624]: Deploying daemon osd.1 on smithi044 2024-03-26T16:50:23.180 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:23 smithi044 ceph-mon[30624]: pgmap v62: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-26T16:50:23.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:23 smithi064 ceph-mon[34420]: Deploying daemon osd.1 on smithi044 2024-03-26T16:50:23.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:23 smithi064 ceph-mon[34420]: pgmap v62: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-26T16:50:23.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:23 smithi149 ceph-mon[34678]: Deploying daemon osd.1 on smithi044 2024-03-26T16:50:23.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:23 smithi149 ceph-mon[34678]: pgmap v62: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-26T16:50:25.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:25 smithi064 ceph-mon[34420]: pgmap v63: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-26T16:50:25.383 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:25 smithi044 ceph-mon[30624]: pgmap v63: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-26T16:50:25.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:25 smithi149 ceph-mon[34678]: pgmap v63: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-26T16:50:27.394 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:27 smithi044 ceph-mon[30624]: pgmap v64: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-26T16:50:27.394 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:27 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:50:27.394 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:27 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-26T16:50:27.395 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:27 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:50:27.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:27 smithi149 ceph-mon[34678]: pgmap v64: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-26T16:50:27.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:27 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:50:27.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:27 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-26T16:50:27.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:27 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:50:27.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:27 smithi064 ceph-mon[34420]: pgmap v64: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-26T16:50:27.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:27 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:50:27.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:27 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-26T16:50:27.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:27 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:50:29.266 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:29 smithi044 ceph-mon[30624]: pgmap v65: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-26T16:50:29.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:29 smithi149 ceph-mon[34678]: pgmap v65: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-26T16:50:29.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:29 smithi064 ceph-mon[34420]: pgmap v65: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-26T16:50:30.746 INFO:teuthology.orchestra.run.smithi044.stdout:Created osd(s) 1 on host 'smithi044' 2024-03-26T16:50:31.266 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:30 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:50:31.266 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:30 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:50:31.266 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:30 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T16:50:31.266 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:30 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-26T16:50:31.266 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:30 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:50:31.266 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:30 smithi044 ceph-mon[30624]: pgmap v66: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-26T16:50:31.266 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:30 smithi044 ceph-mon[30624]: from='osd.1 [v2:172.21.15.44:6810/3203140205,v1:172.21.15.44:6811/3203140205]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-03-26T16:50:31.266 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:30 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:50:31.266 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:30 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:50:31.267 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:30 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-26T16:50:31.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:30 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:50:31.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:30 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:50:31.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:30 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T16:50:31.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:30 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-26T16:50:31.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:30 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:50:31.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:30 smithi064 ceph-mon[34420]: pgmap v66: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-26T16:50:31.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:30 smithi064 ceph-mon[34420]: from='osd.1 [v2:172.21.15.44:6810/3203140205,v1:172.21.15.44:6811/3203140205]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-03-26T16:50:31.307 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:30 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:50:31.307 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:30 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:50:31.307 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:30 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-26T16:50:31.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:30 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:50:31.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:30 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:50:31.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:30 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T16:50:31.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:30 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-26T16:50:31.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:30 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:50:31.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:30 smithi149 ceph-mon[34678]: pgmap v66: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-26T16:50:31.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:30 smithi149 ceph-mon[34678]: from='osd.1 [v2:172.21.15.44:6810/3203140205,v1:172.21.15.44:6811/3203140205]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-03-26T16:50:31.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:30 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:50:31.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:30 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:50:31.398 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:30 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-26T16:50:31.420 DEBUG:teuthology.orchestra.run.smithi044:osd.1> sudo journalctl -f -n 0 -u ceph-4394d798-eb90-11ee-95d0-87774f69a715@osd.1.service 2024-03-26T16:50:31.422 INFO:tasks.cephadm:Deploying osd.2 on smithi064 with /dev/vg_nvme/lv_4... 2024-03-26T16:50:31.422 DEBUG:teuthology.orchestra.run.smithi064:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bf9505fb569e9b95a78f9700ed8c4bd20508ef55 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4394d798-eb90-11ee-95d0-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-03-26T16:50:31.672 INFO:teuthology.orchestra.run.smithi064.stderr:Inferring config /var/lib/ceph/4394d798-eb90-11ee-95d0-87774f69a715/mon.b/config 2024-03-26T16:50:32.024 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:31 smithi064 ceph-mon[34420]: from='osd.1 [v2:172.21.15.44:6810/3203140205,v1:172.21.15.44:6811/3203140205]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-03-26T16:50:32.024 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:31 smithi064 ceph-mon[34420]: osdmap e11: 2 total, 1 up, 2 in 2024-03-26T16:50:32.024 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:31 smithi064 ceph-mon[34420]: from='osd.1 [v2:172.21.15.44:6810/3203140205,v1:172.21.15.44:6811/3203140205]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi044", "root=default"]} : dispatch 2024-03-26T16:50:32.024 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:31 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-03-26T16:50:32.266 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:31 smithi044 ceph-mon[30624]: from='osd.1 [v2:172.21.15.44:6810/3203140205,v1:172.21.15.44:6811/3203140205]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-03-26T16:50:32.266 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:31 smithi044 ceph-mon[30624]: osdmap e11: 2 total, 1 up, 2 in 2024-03-26T16:50:32.266 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:31 smithi044 ceph-mon[30624]: from='osd.1 [v2:172.21.15.44:6810/3203140205,v1:172.21.15.44:6811/3203140205]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi044", "root=default"]} : dispatch 2024-03-26T16:50:32.266 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:31 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-03-26T16:50:32.267 INFO:journalctl@ceph.osd.1.smithi044.stdout:Mar 26 16:50:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-1[50862]: 2024-03-26T16:50:31.981+0000 7f2365eee700 -1 osd.1 0 waiting for initial osdmap 2024-03-26T16:50:32.267 INFO:journalctl@ceph.osd.1.smithi044.stdout:Mar 26 16:50:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-1[50862]: 2024-03-26T16:50:31.985+0000 7f2361ce1700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-26T16:50:32.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:31 smithi149 ceph-mon[34678]: from='osd.1 [v2:172.21.15.44:6810/3203140205,v1:172.21.15.44:6811/3203140205]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-03-26T16:50:32.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:31 smithi149 ceph-mon[34678]: osdmap e11: 2 total, 1 up, 2 in 2024-03-26T16:50:32.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:31 smithi149 ceph-mon[34678]: from='osd.1 [v2:172.21.15.44:6810/3203140205,v1:172.21.15.44:6811/3203140205]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi044", "root=default"]} : dispatch 2024-03-26T16:50:32.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:31 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-03-26T16:50:33.056 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:32 smithi064 ceph-mon[34420]: from='osd.1 [v2:172.21.15.44:6810/3203140205,v1:172.21.15.44:6811/3203140205]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi044", "root=default"]}]': finished 2024-03-26T16:50:33.056 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:32 smithi064 ceph-mon[34420]: osdmap e12: 2 total, 1 up, 2 in 2024-03-26T16:50:33.056 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:32 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-03-26T16:50:33.056 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:32 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-03-26T16:50:33.057 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:32 smithi064 ceph-mon[34420]: pgmap v69: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-26T16:50:33.266 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:32 smithi044 ceph-mon[30624]: from='osd.1 [v2:172.21.15.44:6810/3203140205,v1:172.21.15.44:6811/3203140205]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi044", "root=default"]}]': finished 2024-03-26T16:50:33.266 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:32 smithi044 ceph-mon[30624]: osdmap e12: 2 total, 1 up, 2 in 2024-03-26T16:50:33.267 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:32 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-03-26T16:50:33.267 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:32 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-03-26T16:50:33.267 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:32 smithi044 ceph-mon[30624]: pgmap v69: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-26T16:50:33.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:32 smithi149 ceph-mon[34678]: from='osd.1 [v2:172.21.15.44:6810/3203140205,v1:172.21.15.44:6811/3203140205]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi044", "root=default"]}]': finished 2024-03-26T16:50:33.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:32 smithi149 ceph-mon[34678]: osdmap e12: 2 total, 1 up, 2 in 2024-03-26T16:50:33.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:32 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-03-26T16:50:33.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:32 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-03-26T16:50:33.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:32 smithi149 ceph-mon[34678]: pgmap v69: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-03-26T16:50:33.428 INFO:teuthology.orchestra.run.smithi064.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-03-26T16:50:33.428 INFO:teuthology.orchestra.run.smithi064.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-03-26T16:50:33.428 INFO:teuthology.orchestra.run.smithi064.stderr: stderr: 10+0 records in 2024-03-26T16:50:33.428 INFO:teuthology.orchestra.run.smithi064.stderr:10+0 records out 2024-03-26T16:50:33.428 INFO:teuthology.orchestra.run.smithi064.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0115667 s, 907 MB/s 2024-03-26T16:50:33.428 INFO:teuthology.orchestra.run.smithi064.stderr:--> Zapping successful for: 2024-03-26T16:50:34.005 DEBUG:teuthology.orchestra.run.smithi064:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bf9505fb569e9b95a78f9700ed8c4bd20508ef55 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4394d798-eb90-11ee-95d0-87774f69a715 -- ceph orch daemon add osd smithi064:vg_nvme/lv_4 2024-03-26T16:50:34.132 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:33 smithi044 ceph-mon[30624]: purged_snaps scrub starts 2024-03-26T16:50:34.133 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:33 smithi044 ceph-mon[30624]: purged_snaps scrub ok 2024-03-26T16:50:34.133 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:33 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-03-26T16:50:34.133 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:33 smithi044 ceph-mon[30624]: osd.1 [v2:172.21.15.44:6810/3203140205,v1:172.21.15.44:6811/3203140205] boot 2024-03-26T16:50:34.133 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:33 smithi044 ceph-mon[30624]: osdmap e13: 2 total, 2 up, 2 in 2024-03-26T16:50:34.133 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:33 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-03-26T16:50:34.246 INFO:teuthology.orchestra.run.smithi064.stderr:Inferring config /var/lib/ceph/4394d798-eb90-11ee-95d0-87774f69a715/mon.b/config 2024-03-26T16:50:34.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:33 smithi064 ceph-mon[34420]: purged_snaps scrub starts 2024-03-26T16:50:34.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:33 smithi064 ceph-mon[34420]: purged_snaps scrub ok 2024-03-26T16:50:34.307 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:33 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-03-26T16:50:34.307 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:33 smithi064 ceph-mon[34420]: osd.1 [v2:172.21.15.44:6810/3203140205,v1:172.21.15.44:6811/3203140205] boot 2024-03-26T16:50:34.307 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:33 smithi064 ceph-mon[34420]: osdmap e13: 2 total, 2 up, 2 in 2024-03-26T16:50:34.307 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:33 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-03-26T16:50:34.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:33 smithi149 ceph-mon[34678]: purged_snaps scrub starts 2024-03-26T16:50:34.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:33 smithi149 ceph-mon[34678]: purged_snaps scrub ok 2024-03-26T16:50:34.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:33 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-03-26T16:50:34.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:33 smithi149 ceph-mon[34678]: osd.1 [v2:172.21.15.44:6810/3203140205,v1:172.21.15.44:6811/3203140205] boot 2024-03-26T16:50:34.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:33 smithi149 ceph-mon[34678]: osdmap e13: 2 total, 2 up, 2 in 2024-03-26T16:50:34.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:33 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-03-26T16:50:35.266 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:34 smithi044 ceph-mon[30624]: osdmap e14: 2 total, 2 up, 2 in 2024-03-26T16:50:35.266 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:34 smithi044 ceph-mon[30624]: pgmap v72: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-26T16:50:35.266 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:34 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:50:35.266 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:34 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:50:35.266 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:34 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-03-26T16:50:35.266 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:34 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-03-26T16:50:35.267 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:34 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:50:35.267 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:34 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T16:50:35.267 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:34 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-26T16:50:35.267 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:34 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:50:35.272 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:34 smithi064 ceph-mon[34420]: osdmap e14: 2 total, 2 up, 2 in 2024-03-26T16:50:35.272 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:35 smithi064 ceph-mon[34420]: pgmap v72: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-26T16:50:35.272 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:35 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:50:35.273 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:35 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:50:35.273 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:35 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-03-26T16:50:35.273 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:35 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-03-26T16:50:35.273 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:35 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:50:35.273 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:35 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T16:50:35.273 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:35 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-26T16:50:35.273 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:35 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:50:35.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:35 smithi149 ceph-mon[34678]: osdmap e14: 2 total, 2 up, 2 in 2024-03-26T16:50:35.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:35 smithi149 ceph-mon[34678]: pgmap v72: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-26T16:50:35.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:35 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:50:35.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:35 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:50:35.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:35 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-03-26T16:50:35.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:35 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-03-26T16:50:35.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:35 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:50:35.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:35 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T16:50:35.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:35 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-26T16:50:35.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:35 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:50:36.266 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:36 smithi044 ceph-mon[30624]: Detected new or changed devices on smithi044 2024-03-26T16:50:36.266 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:36 smithi044 ceph-mon[30624]: Adjusting osd_memory_target on smithi044 to 8546M 2024-03-26T16:50:36.266 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:36 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-03-26T16:50:36.266 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:36 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-03-26T16:50:36.266 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:36 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T16:50:36.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:36 smithi064 ceph-mon[34420]: Detected new or changed devices on smithi044 2024-03-26T16:50:36.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:36 smithi064 ceph-mon[34420]: Adjusting osd_memory_target on smithi044 to 8546M 2024-03-26T16:50:36.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:36 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-03-26T16:50:36.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:36 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-03-26T16:50:36.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:36 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T16:50:36.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:36 smithi149 ceph-mon[34678]: Detected new or changed devices on smithi044 2024-03-26T16:50:36.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:36 smithi149 ceph-mon[34678]: Adjusting osd_memory_target on smithi044 to 8546M 2024-03-26T16:50:36.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:36 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-03-26T16:50:36.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:36 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-03-26T16:50:36.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:36 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T16:50:37.197 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:37 smithi064 ceph-mon[34420]: from='client.24149 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi064:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-03-26T16:50:37.197 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:37 smithi064 ceph-mon[34420]: pgmap v73: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-26T16:50:37.266 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:37 smithi044 ceph-mon[30624]: from='client.24149 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi064:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-03-26T16:50:37.266 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:37 smithi044 ceph-mon[30624]: pgmap v73: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-26T16:50:37.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:37 smithi149 ceph-mon[34678]: from='client.24149 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi064:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-03-26T16:50:37.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:37 smithi149 ceph-mon[34678]: pgmap v73: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-26T16:50:38.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:38 smithi149 ceph-mon[34678]: pgmap v74: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-26T16:50:38.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:38 smithi044 ceph-mon[30624]: pgmap v74: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-26T16:50:38.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:38 smithi064 ceph-mon[34420]: pgmap v74: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-26T16:50:39.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:39 smithi149 ceph-mon[34678]: from='client.? 172.21.15.64:0/350999802' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "c3dc5acf-f6fc-41c0-b9cb-975ae5995ad4"} : dispatch 2024-03-26T16:50:39.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:39 smithi149 ceph-mon[34678]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "c3dc5acf-f6fc-41c0-b9cb-975ae5995ad4"} : dispatch 2024-03-26T16:50:39.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:39 smithi149 ceph-mon[34678]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c3dc5acf-f6fc-41c0-b9cb-975ae5995ad4"}]': finished 2024-03-26T16:50:39.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:39 smithi149 ceph-mon[34678]: osdmap e15: 3 total, 2 up, 3 in 2024-03-26T16:50:39.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:39 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-03-26T16:50:39.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:39 smithi044 ceph-mon[30624]: from='client.? 172.21.15.64:0/350999802' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "c3dc5acf-f6fc-41c0-b9cb-975ae5995ad4"} : dispatch 2024-03-26T16:50:39.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:39 smithi044 ceph-mon[30624]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "c3dc5acf-f6fc-41c0-b9cb-975ae5995ad4"} : dispatch 2024-03-26T16:50:39.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:39 smithi044 ceph-mon[30624]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c3dc5acf-f6fc-41c0-b9cb-975ae5995ad4"}]': finished 2024-03-26T16:50:39.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:39 smithi044 ceph-mon[30624]: osdmap e15: 3 total, 2 up, 3 in 2024-03-26T16:50:39.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:39 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-03-26T16:50:39.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:39 smithi064 ceph-mon[34420]: from='client.? 172.21.15.64:0/350999802' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "c3dc5acf-f6fc-41c0-b9cb-975ae5995ad4"} : dispatch 2024-03-26T16:50:39.557 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:39 smithi064 ceph-mon[34420]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "c3dc5acf-f6fc-41c0-b9cb-975ae5995ad4"} : dispatch 2024-03-26T16:50:39.557 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:39 smithi064 ceph-mon[34420]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c3dc5acf-f6fc-41c0-b9cb-975ae5995ad4"}]': finished 2024-03-26T16:50:39.557 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:39 smithi064 ceph-mon[34420]: osdmap e15: 3 total, 2 up, 3 in 2024-03-26T16:50:39.557 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:39 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-03-26T16:50:40.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:40 smithi149 ceph-mon[34678]: from='client.? 172.21.15.64:0/1480038223' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-03-26T16:50:40.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:40 smithi149 ceph-mon[34678]: pgmap v76: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-26T16:50:40.457 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:40 smithi064 ceph-mon[34420]: from='client.? 172.21.15.64:0/1480038223' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-03-26T16:50:40.458 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:40 smithi064 ceph-mon[34420]: pgmap v76: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-26T16:50:40.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:40 smithi044 ceph-mon[30624]: from='client.? 172.21.15.64:0/1480038223' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-03-26T16:50:40.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:40 smithi044 ceph-mon[30624]: pgmap v76: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-26T16:50:42.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:42 smithi064 ceph-mon[34420]: pgmap v77: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-26T16:50:42.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:42 smithi149 ceph-mon[34678]: pgmap v77: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-26T16:50:42.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:42 smithi044 ceph-mon[30624]: pgmap v77: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-26T16:50:44.171 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:44 smithi064 ceph-mon[34420]: pgmap v78: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-26T16:50:44.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:44 smithi149 ceph-mon[34678]: pgmap v78: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-26T16:50:44.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:44 smithi044 ceph-mon[30624]: pgmap v78: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-26T16:50:45.388 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:45 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-03-26T16:50:45.388 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:45 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T16:50:45.388 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:45 smithi064 ceph-mon[34420]: Deploying daemon osd.2 on smithi064 2024-03-26T16:50:45.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:45 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-03-26T16:50:45.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:45 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T16:50:45.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:45 smithi149 ceph-mon[34678]: Deploying daemon osd.2 on smithi064 2024-03-26T16:50:45.519 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:45 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-03-26T16:50:45.519 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:45 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T16:50:45.519 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:45 smithi044 ceph-mon[30624]: Deploying daemon osd.2 on smithi064 2024-03-26T16:50:46.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:46 smithi064 ceph-mon[34420]: pgmap v79: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-26T16:50:46.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:46 smithi149 ceph-mon[34678]: pgmap v79: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-26T16:50:46.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:46 smithi044 ceph-mon[30624]: pgmap v79: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-26T16:50:48.386 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:48 smithi064 ceph-mon[34420]: pgmap v80: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-26T16:50:48.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:48 smithi149 ceph-mon[34678]: pgmap v80: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-26T16:50:48.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:48 smithi044 ceph-mon[30624]: pgmap v80: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-26T16:50:51.147 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:50 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:50:51.147 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:50 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:50:51.147 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:50 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-26T16:50:51.147 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:50 smithi149 ceph-mon[34678]: pgmap v81: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-26T16:50:51.153 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:50 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:50:51.153 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:50 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:50:51.153 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:50 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-26T16:50:51.153 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:50 smithi064 ceph-mon[34420]: pgmap v81: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-26T16:50:51.266 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:50 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:50:51.266 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:50 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:50:51.266 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:50 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-26T16:50:51.266 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:50 smithi044 ceph-mon[30624]: pgmap v81: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-26T16:50:52.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:52 smithi064 ceph-mon[34420]: pgmap v82: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-26T16:50:52.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:52 smithi149 ceph-mon[34678]: pgmap v82: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-26T16:50:52.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:52 smithi044 ceph-mon[30624]: pgmap v82: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-26T16:50:52.977 INFO:teuthology.orchestra.run.smithi064.stdout:Created osd(s) 2 on host 'smithi064' 2024-03-26T16:50:53.570 DEBUG:teuthology.orchestra.run.smithi064:osd.2> sudo journalctl -f -n 0 -u ceph-4394d798-eb90-11ee-95d0-87774f69a715@osd.2.service 2024-03-26T16:50:53.572 INFO:tasks.cephadm:Deploying osd.3 on smithi064 with /dev/vg_nvme/lv_3... 2024-03-26T16:50:53.573 DEBUG:teuthology.orchestra.run.smithi064:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bf9505fb569e9b95a78f9700ed8c4bd20508ef55 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4394d798-eb90-11ee-95d0-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-03-26T16:50:53.806 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:53 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:50:53.806 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:53 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:50:53.806 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:53 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T16:50:53.807 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:53 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-26T16:50:53.807 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:53 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:50:53.807 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:53 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:50:53.807 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:53 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-26T16:50:53.807 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:53 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:50:53.807 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:53 smithi064 ceph-mon[34420]: from='osd.2 [v2:172.21.15.64:6800/1712901412,v1:172.21.15.64:6801/1712901412]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-03-26T16:50:53.807 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:53 smithi064 ceph-mon[34420]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-03-26T16:50:53.897 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:53 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:50:53.897 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:53 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:50:53.897 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:53 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T16:50:53.897 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:53 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-26T16:50:53.897 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:53 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:50:53.897 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:53 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:50:53.898 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:53 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-26T16:50:53.898 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:53 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:50:53.898 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:53 smithi149 ceph-mon[34678]: from='osd.2 [v2:172.21.15.64:6800/1712901412,v1:172.21.15.64:6801/1712901412]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-03-26T16:50:53.898 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:53 smithi149 ceph-mon[34678]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-03-26T16:50:54.016 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:53 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:50:54.016 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:53 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:50:54.016 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:53 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T16:50:54.016 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:53 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-26T16:50:54.016 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:53 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:50:54.016 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:53 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:50:54.017 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:53 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-26T16:50:54.017 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:53 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:50:54.017 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:53 smithi044 ceph-mon[30624]: from='osd.2 [v2:172.21.15.64:6800/1712901412,v1:172.21.15.64:6801/1712901412]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-03-26T16:50:54.017 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:53 smithi044 ceph-mon[30624]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-03-26T16:50:55.022 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:54 smithi064 ceph-mon[34420]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-03-26T16:50:55.022 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:54 smithi064 ceph-mon[34420]: osdmap e16: 3 total, 2 up, 3 in 2024-03-26T16:50:55.022 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:54 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-03-26T16:50:55.022 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:54 smithi064 ceph-mon[34420]: from='osd.2 [v2:172.21.15.64:6800/1712901412,v1:172.21.15.64:6801/1712901412]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi064", "root=default"]} : dispatch 2024-03-26T16:50:55.022 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:54 smithi064 ceph-mon[34420]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi064", "root=default"]} : dispatch 2024-03-26T16:50:55.022 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:54 smithi064 ceph-mon[34420]: pgmap v84: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-26T16:50:55.022 INFO:journalctl@ceph.osd.2.smithi064.stdout:Mar 26 16:50:54 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-2[38089]: 2024-03-26T16:50:54.964+0000 7f54a2eed700 -1 osd.2 0 waiting for initial osdmap 2024-03-26T16:50:55.023 INFO:journalctl@ceph.osd.2.smithi064.stdout:Mar 26 16:50:54 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-2[38089]: 2024-03-26T16:50:54.969+0000 7f549ece0700 -1 osd.2 17 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-26T16:50:55.109 INFO:teuthology.orchestra.run.smithi064.stderr:Inferring config /var/lib/ceph/4394d798-eb90-11ee-95d0-87774f69a715/mon.b/config 2024-03-26T16:50:55.266 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:54 smithi044 ceph-mon[30624]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-03-26T16:50:55.266 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:54 smithi044 ceph-mon[30624]: osdmap e16: 3 total, 2 up, 3 in 2024-03-26T16:50:55.266 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:54 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-03-26T16:50:55.266 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:54 smithi044 ceph-mon[30624]: from='osd.2 [v2:172.21.15.64:6800/1712901412,v1:172.21.15.64:6801/1712901412]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi064", "root=default"]} : dispatch 2024-03-26T16:50:55.266 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:54 smithi044 ceph-mon[30624]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi064", "root=default"]} : dispatch 2024-03-26T16:50:55.266 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:54 smithi044 ceph-mon[30624]: pgmap v84: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-26T16:50:55.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:54 smithi149 ceph-mon[34678]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-03-26T16:50:55.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:54 smithi149 ceph-mon[34678]: osdmap e16: 3 total, 2 up, 3 in 2024-03-26T16:50:55.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:54 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-03-26T16:50:55.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:54 smithi149 ceph-mon[34678]: from='osd.2 [v2:172.21.15.64:6800/1712901412,v1:172.21.15.64:6801/1712901412]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi064", "root=default"]} : dispatch 2024-03-26T16:50:55.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:54 smithi149 ceph-mon[34678]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi064", "root=default"]} : dispatch 2024-03-26T16:50:55.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:54 smithi149 ceph-mon[34678]: pgmap v84: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-26T16:50:56.266 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:55 smithi044 ceph-mon[30624]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi064", "root=default"]}]': finished 2024-03-26T16:50:56.266 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:55 smithi044 ceph-mon[30624]: osdmap e17: 3 total, 2 up, 3 in 2024-03-26T16:50:56.266 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:55 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-03-26T16:50:56.266 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:55 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-03-26T16:50:56.279 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:55 smithi064 ceph-mon[34420]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi064", "root=default"]}]': finished 2024-03-26T16:50:56.279 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:55 smithi064 ceph-mon[34420]: osdmap e17: 3 total, 2 up, 3 in 2024-03-26T16:50:56.279 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:55 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-03-26T16:50:56.279 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:55 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-03-26T16:50:56.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:55 smithi149 ceph-mon[34678]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi064", "root=default"]}]': finished 2024-03-26T16:50:56.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:55 smithi149 ceph-mon[34678]: osdmap e17: 3 total, 2 up, 3 in 2024-03-26T16:50:56.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:55 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-03-26T16:50:56.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:55 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-03-26T16:50:57.266 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:56 smithi044 ceph-mon[30624]: purged_snaps scrub starts 2024-03-26T16:50:57.266 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:56 smithi044 ceph-mon[30624]: purged_snaps scrub ok 2024-03-26T16:50:57.266 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:56 smithi044 ceph-mon[30624]: osd.2 [v2:172.21.15.64:6800/1712901412,v1:172.21.15.64:6801/1712901412] boot 2024-03-26T16:50:57.266 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:56 smithi044 ceph-mon[30624]: osdmap e18: 3 total, 3 up, 3 in 2024-03-26T16:50:57.266 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:56 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-03-26T16:50:57.266 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:56 smithi044 ceph-mon[30624]: pgmap v87: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-26T16:50:57.267 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:56 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2024-03-26T16:50:57.267 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:56 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:50:57.267 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:56 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:50:57.267 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:56 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-03-26T16:50:57.267 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:56 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:50:57.267 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:56 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T16:50:57.267 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:56 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-26T16:50:57.267 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:56 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:50:57.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:56 smithi064 ceph-mon[34420]: purged_snaps scrub starts 2024-03-26T16:50:57.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:56 smithi064 ceph-mon[34420]: purged_snaps scrub ok 2024-03-26T16:50:57.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:56 smithi064 ceph-mon[34420]: osd.2 [v2:172.21.15.64:6800/1712901412,v1:172.21.15.64:6801/1712901412] boot 2024-03-26T16:50:57.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:56 smithi064 ceph-mon[34420]: osdmap e18: 3 total, 3 up, 3 in 2024-03-26T16:50:57.307 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:56 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-03-26T16:50:57.307 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:56 smithi064 ceph-mon[34420]: pgmap v87: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-26T16:50:57.307 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:56 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2024-03-26T16:50:57.307 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:56 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:50:57.307 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:56 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:50:57.307 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:56 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-03-26T16:50:57.307 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:56 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:50:57.307 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:56 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T16:50:57.307 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:56 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-26T16:50:57.307 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:56 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:50:57.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:56 smithi149 ceph-mon[34678]: purged_snaps scrub starts 2024-03-26T16:50:57.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:56 smithi149 ceph-mon[34678]: purged_snaps scrub ok 2024-03-26T16:50:57.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:56 smithi149 ceph-mon[34678]: osd.2 [v2:172.21.15.64:6800/1712901412,v1:172.21.15.64:6801/1712901412] boot 2024-03-26T16:50:57.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:56 smithi149 ceph-mon[34678]: osdmap e18: 3 total, 3 up, 3 in 2024-03-26T16:50:57.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:56 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-03-26T16:50:57.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:56 smithi149 ceph-mon[34678]: pgmap v87: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-03-26T16:50:57.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:56 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2024-03-26T16:50:57.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:56 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:50:57.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:56 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:50:57.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:56 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-03-26T16:50:57.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:56 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:50:57.398 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:56 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T16:50:57.398 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:56 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-26T16:50:57.398 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:56 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:50:57.493 INFO:teuthology.orchestra.run.smithi064.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-03-26T16:50:57.493 INFO:teuthology.orchestra.run.smithi064.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-03-26T16:50:57.493 INFO:teuthology.orchestra.run.smithi064.stderr: stderr: 10+0 records in 2024-03-26T16:50:57.494 INFO:teuthology.orchestra.run.smithi064.stderr:10+0 records out 2024-03-26T16:50:57.494 INFO:teuthology.orchestra.run.smithi064.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0123564 s, 849 MB/s 2024-03-26T16:50:57.494 INFO:teuthology.orchestra.run.smithi064.stderr:--> Zapping successful for: 2024-03-26T16:50:58.056 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:57 smithi064 ceph-mon[34420]: Detected new or changed devices on smithi064 2024-03-26T16:50:58.056 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:57 smithi064 ceph-mon[34420]: Adjusting osd_memory_target on smithi064 to 21184M 2024-03-26T16:50:58.056 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:57 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-03-26T16:50:58.056 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:57 smithi064 ceph-mon[34420]: osdmap e19: 3 total, 3 up, 3 in 2024-03-26T16:50:58.056 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:57 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2024-03-26T16:50:58.158 DEBUG:teuthology.orchestra.run.smithi064:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bf9505fb569e9b95a78f9700ed8c4bd20508ef55 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4394d798-eb90-11ee-95d0-87774f69a715 -- ceph orch daemon add osd smithi064:vg_nvme/lv_3 2024-03-26T16:50:58.261 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:57 smithi044 ceph-mon[30624]: Detected new or changed devices on smithi064 2024-03-26T16:50:58.261 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:57 smithi044 ceph-mon[30624]: Adjusting osd_memory_target on smithi064 to 21184M 2024-03-26T16:50:58.261 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:57 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-03-26T16:50:58.261 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:57 smithi044 ceph-mon[30624]: osdmap e19: 3 total, 3 up, 3 in 2024-03-26T16:50:58.261 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:57 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2024-03-26T16:50:58.388 INFO:journalctl@ceph.osd.2.smithi064.stdout:Mar 26 16:50:58 smithi064 sudo[41547]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-03-26T16:50:58.388 INFO:journalctl@ceph.osd.2.smithi064.stdout:Mar 26 16:50:58 smithi064 sudo[41547]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-03-26T16:50:58.388 INFO:journalctl@ceph.osd.2.smithi064.stdout:Mar 26 16:50:58 smithi064 sudo[41547]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-03-26T16:50:58.388 INFO:journalctl@ceph.osd.2.smithi064.stdout:Mar 26 16:50:58 smithi064 sudo[41547]: pam_unix(sudo:session): session closed for user root 2024-03-26T16:50:58.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:57 smithi149 ceph-mon[34678]: Detected new or changed devices on smithi064 2024-03-26T16:50:58.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:57 smithi149 ceph-mon[34678]: Adjusting osd_memory_target on smithi064 to 21184M 2024-03-26T16:50:58.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:57 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-03-26T16:50:58.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:57 smithi149 ceph-mon[34678]: osdmap e19: 3 total, 3 up, 3 in 2024-03-26T16:50:58.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:57 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2024-03-26T16:50:58.414 INFO:teuthology.orchestra.run.smithi064.stderr:Inferring config /var/lib/ceph/4394d798-eb90-11ee-95d0-87774f69a715/mon.b/config 2024-03-26T16:50:58.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:58 smithi044 sudo[54349]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-03-26T16:50:58.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:58 smithi044 sudo[54349]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-03-26T16:50:58.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:58 smithi044 sudo[54349]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-03-26T16:50:58.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:58 smithi044 sudo[54349]: pam_unix(sudo:session): session closed for user root 2024-03-26T16:50:58.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:58 smithi044 sudo[54352]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-03-26T16:50:58.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:58 smithi044 sudo[54352]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-03-26T16:50:58.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:58 smithi044 sudo[54352]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-03-26T16:50:58.517 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:58 smithi044 sudo[54352]: pam_unix(sudo:session): session closed for user root 2024-03-26T16:50:58.517 INFO:journalctl@ceph.osd.0.smithi044.stdout:Mar 26 16:50:58 smithi044 sudo[54337]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-03-26T16:50:58.517 INFO:journalctl@ceph.osd.0.smithi044.stdout:Mar 26 16:50:58 smithi044 sudo[54337]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-03-26T16:50:58.517 INFO:journalctl@ceph.osd.0.smithi044.stdout:Mar 26 16:50:58 smithi044 sudo[54337]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-03-26T16:50:58.517 INFO:journalctl@ceph.osd.0.smithi044.stdout:Mar 26 16:50:58 smithi044 sudo[54337]: pam_unix(sudo:session): session closed for user root 2024-03-26T16:50:58.517 INFO:journalctl@ceph.osd.0.smithi044.stdout:Mar 26 16:50:58 smithi044 sudo[54340]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-03-26T16:50:58.517 INFO:journalctl@ceph.osd.0.smithi044.stdout:Mar 26 16:50:58 smithi044 sudo[54340]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-03-26T16:50:58.517 INFO:journalctl@ceph.osd.0.smithi044.stdout:Mar 26 16:50:58 smithi044 sudo[54340]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-03-26T16:50:58.517 INFO:journalctl@ceph.osd.0.smithi044.stdout:Mar 26 16:50:58 smithi044 sudo[54340]: pam_unix(sudo:session): session closed for user root 2024-03-26T16:50:58.517 INFO:journalctl@ceph.osd.1.smithi044.stdout:Mar 26 16:50:58 smithi044 sudo[54343]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-03-26T16:50:58.517 INFO:journalctl@ceph.osd.1.smithi044.stdout:Mar 26 16:50:58 smithi044 sudo[54343]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-03-26T16:50:58.518 INFO:journalctl@ceph.osd.1.smithi044.stdout:Mar 26 16:50:58 smithi044 sudo[54343]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-03-26T16:50:58.518 INFO:journalctl@ceph.osd.1.smithi044.stdout:Mar 26 16:50:58 smithi044 sudo[54343]: pam_unix(sudo:session): session closed for user root 2024-03-26T16:50:58.518 INFO:journalctl@ceph.osd.1.smithi044.stdout:Mar 26 16:50:58 smithi044 sudo[54346]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-03-26T16:50:58.518 INFO:journalctl@ceph.osd.1.smithi044.stdout:Mar 26 16:50:58 smithi044 sudo[54346]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-03-26T16:50:58.518 INFO:journalctl@ceph.osd.1.smithi044.stdout:Mar 26 16:50:58 smithi044 sudo[54346]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-03-26T16:50:58.518 INFO:journalctl@ceph.osd.1.smithi044.stdout:Mar 26 16:50:58 smithi044 sudo[54346]: pam_unix(sudo:session): session closed for user root 2024-03-26T16:50:58.643 INFO:journalctl@ceph.osd.2.smithi064.stdout:Mar 26 16:50:58 smithi064 sudo[41564]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-03-26T16:50:58.643 INFO:journalctl@ceph.osd.2.smithi064.stdout:Mar 26 16:50:58 smithi064 sudo[41564]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-03-26T16:50:58.643 INFO:journalctl@ceph.osd.2.smithi064.stdout:Mar 26 16:50:58 smithi064 sudo[41564]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-03-26T16:50:58.643 INFO:journalctl@ceph.osd.2.smithi064.stdout:Mar 26 16:50:58 smithi064 sudo[41564]: pam_unix(sudo:session): session closed for user root 2024-03-26T16:50:58.644 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:58 smithi064 sudo[41595]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-03-26T16:50:58.644 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:58 smithi064 sudo[41595]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-03-26T16:50:58.644 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:58 smithi064 sudo[41595]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-03-26T16:50:58.644 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:58 smithi064 sudo[41595]: pam_unix(sudo:session): session closed for user root 2024-03-26T16:50:58.644 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:58 smithi064 sudo[41598]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-03-26T16:50:58.644 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:58 smithi064 sudo[41598]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-03-26T16:50:58.644 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:58 smithi064 sudo[41598]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-03-26T16:50:58.644 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:58 smithi064 sudo[41598]: pam_unix(sudo:session): session closed for user root 2024-03-26T16:50:58.897 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:58 smithi149 sudo[36470]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-03-26T16:50:58.897 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:58 smithi149 sudo[36470]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-03-26T16:50:58.897 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:58 smithi149 sudo[36470]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-03-26T16:50:58.897 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:58 smithi149 sudo[36470]: pam_unix(sudo:session): session closed for user root 2024-03-26T16:50:58.897 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:58 smithi149 sudo[36473]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-03-26T16:50:58.897 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:58 smithi149 sudo[36473]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-03-26T16:50:58.897 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:58 smithi149 sudo[36473]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-03-26T16:50:58.897 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:58 smithi149 sudo[36473]: pam_unix(sudo:session): session closed for user root 2024-03-26T16:50:59.266 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:58 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-03-26T16:50:59.266 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:58 smithi044 ceph-mon[30624]: osdmap e20: 3 total, 3 up, 3 in 2024-03-26T16:50:59.266 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:58 smithi044 ceph-mon[30624]: pgmap v90: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-03-26T16:50:59.266 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:58 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:50:59.266 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:58 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:50:59.266 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:58 smithi044 ceph-mon[30624]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-03-26T16:50:59.267 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:58 smithi044 ceph-mon[30624]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-03-26T16:50:59.267 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:58 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-03-26T16:50:59.267 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:58 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-03-26T16:50:59.267 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:58 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-03-26T16:50:59.267 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:58 smithi044 ceph-mon[30624]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-03-26T16:50:59.267 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:58 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-03-26T16:50:59.267 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:58 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-03-26T16:50:59.267 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:58 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-03-26T16:50:59.267 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:58 smithi044 ceph-mon[30624]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-03-26T16:50:59.267 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:58 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:50:59.267 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:58 smithi044 ceph-mon[30624]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-03-26T16:50:59.267 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:58 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-03-26T16:50:59.267 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:58 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-03-26T16:50:59.267 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:58 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-03-26T16:50:59.268 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:58 smithi044 ceph-mon[30624]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-03-26T16:50:59.295 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:58 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-03-26T16:50:59.295 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:58 smithi064 ceph-mon[34420]: osdmap e20: 3 total, 3 up, 3 in 2024-03-26T16:50:59.295 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:58 smithi064 ceph-mon[34420]: pgmap v90: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-03-26T16:50:59.296 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:58 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:50:59.296 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:58 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:50:59.296 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:58 smithi064 ceph-mon[34420]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-03-26T16:50:59.296 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:58 smithi064 ceph-mon[34420]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-03-26T16:50:59.296 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:58 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-03-26T16:50:59.296 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:58 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-03-26T16:50:59.296 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:58 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-03-26T16:50:59.296 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:58 smithi064 ceph-mon[34420]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-03-26T16:50:59.296 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:58 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-03-26T16:50:59.296 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:58 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-03-26T16:50:59.296 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:58 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-03-26T16:50:59.296 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:58 smithi064 ceph-mon[34420]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-03-26T16:50:59.296 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:58 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:50:59.297 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:58 smithi064 ceph-mon[34420]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-03-26T16:50:59.297 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:58 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-03-26T16:50:59.297 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:58 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-03-26T16:50:59.297 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:58 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-03-26T16:50:59.297 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:58 smithi064 ceph-mon[34420]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-03-26T16:50:59.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:58 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-03-26T16:50:59.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:58 smithi149 ceph-mon[34678]: osdmap e20: 3 total, 3 up, 3 in 2024-03-26T16:50:59.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:58 smithi149 ceph-mon[34678]: pgmap v90: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-03-26T16:50:59.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:58 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:50:59.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:58 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:50:59.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:58 smithi149 ceph-mon[34678]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-03-26T16:50:59.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:58 smithi149 ceph-mon[34678]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-03-26T16:50:59.398 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:58 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-03-26T16:50:59.398 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:58 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-03-26T16:50:59.398 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:58 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-03-26T16:50:59.398 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:58 smithi149 ceph-mon[34678]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-03-26T16:50:59.398 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:58 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-03-26T16:50:59.398 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:58 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-03-26T16:50:59.398 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:58 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-03-26T16:50:59.398 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:58 smithi149 ceph-mon[34678]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-03-26T16:50:59.398 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:58 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:50:59.398 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:58 smithi149 ceph-mon[34678]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-03-26T16:50:59.398 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:58 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-03-26T16:50:59.398 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:58 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-03-26T16:50:59.398 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:58 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-03-26T16:50:59.398 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:58 smithi149 ceph-mon[34678]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-03-26T16:51:00.266 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:59 smithi044 ceph-mon[30624]: osdmap e21: 3 total, 3 up, 3 in 2024-03-26T16:51:00.266 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:50:59 smithi044 ceph-mon[30624]: mgrmap e14: x(active, since 2m) 2024-03-26T16:51:00.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:59 smithi064 ceph-mon[34420]: osdmap e21: 3 total, 3 up, 3 in 2024-03-26T16:51:00.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:50:59 smithi064 ceph-mon[34420]: mgrmap e14: x(active, since 2m) 2024-03-26T16:51:00.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:59 smithi149 ceph-mon[34678]: osdmap e21: 3 total, 3 up, 3 in 2024-03-26T16:51:00.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:50:59 smithi149 ceph-mon[34678]: mgrmap e14: x(active, since 2m) 2024-03-26T16:51:01.212 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:51:00 smithi064 ceph-mon[34420]: from='client.24185 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi064:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-03-26T16:51:01.212 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:51:00 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-03-26T16:51:01.212 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:51:00 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-03-26T16:51:01.213 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:51:00 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T16:51:01.213 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:51:00 smithi064 ceph-mon[34420]: pgmap v92: 1 pgs: 1 unknown; 0 B data, 85 MiB used, 268 GiB / 268 GiB avail 2024-03-26T16:51:01.266 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:51:00 smithi044 ceph-mon[30624]: from='client.24185 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi064:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-03-26T16:51:01.266 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:51:00 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-03-26T16:51:01.266 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:51:00 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-03-26T16:51:01.267 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:51:00 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T16:51:01.267 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:51:00 smithi044 ceph-mon[30624]: pgmap v92: 1 pgs: 1 unknown; 0 B data, 85 MiB used, 268 GiB / 268 GiB avail 2024-03-26T16:51:01.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:51:00 smithi149 ceph-mon[34678]: from='client.24185 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi064:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-03-26T16:51:01.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:51:00 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-03-26T16:51:01.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:51:00 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-03-26T16:51:01.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:51:00 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T16:51:01.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:51:00 smithi149 ceph-mon[34678]: pgmap v92: 1 pgs: 1 unknown; 0 B data, 85 MiB used, 268 GiB / 268 GiB avail 2024-03-26T16:51:02.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:51:02 smithi149 ceph-mon[34678]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-03-26T16:51:02.417 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:51:02 smithi044 ceph-mon[30624]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-03-26T16:51:02.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:51:02 smithi064 ceph-mon[34420]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-03-26T16:51:03.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:51:03 smithi149 ceph-mon[34678]: from='client.? 172.21.15.64:0/1351022846' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "635e55a9-5ed3-43aa-bb66-c324f142be3d"} : dispatch 2024-03-26T16:51:03.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:51:03 smithi149 ceph-mon[34678]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "635e55a9-5ed3-43aa-bb66-c324f142be3d"} : dispatch 2024-03-26T16:51:03.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:51:03 smithi149 ceph-mon[34678]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "635e55a9-5ed3-43aa-bb66-c324f142be3d"}]': finished 2024-03-26T16:51:03.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:51:03 smithi149 ceph-mon[34678]: osdmap e22: 4 total, 3 up, 4 in 2024-03-26T16:51:03.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:51:03 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-03-26T16:51:03.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:51:03 smithi044 ceph-mon[30624]: from='client.? 172.21.15.64:0/1351022846' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "635e55a9-5ed3-43aa-bb66-c324f142be3d"} : dispatch 2024-03-26T16:51:03.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:51:03 smithi044 ceph-mon[30624]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "635e55a9-5ed3-43aa-bb66-c324f142be3d"} : dispatch 2024-03-26T16:51:03.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:51:03 smithi044 ceph-mon[30624]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "635e55a9-5ed3-43aa-bb66-c324f142be3d"}]': finished 2024-03-26T16:51:03.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:51:03 smithi044 ceph-mon[30624]: osdmap e22: 4 total, 3 up, 4 in 2024-03-26T16:51:03.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:51:03 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-03-26T16:51:03.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:51:03 smithi064 ceph-mon[34420]: from='client.? 172.21.15.64:0/1351022846' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "635e55a9-5ed3-43aa-bb66-c324f142be3d"} : dispatch 2024-03-26T16:51:03.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:51:03 smithi064 ceph-mon[34420]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "635e55a9-5ed3-43aa-bb66-c324f142be3d"} : dispatch 2024-03-26T16:51:03.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:51:03 smithi064 ceph-mon[34420]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "635e55a9-5ed3-43aa-bb66-c324f142be3d"}]': finished 2024-03-26T16:51:03.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:51:03 smithi064 ceph-mon[34420]: osdmap e22: 4 total, 3 up, 4 in 2024-03-26T16:51:03.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:51:03 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-03-26T16:51:04.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:51:04 smithi149 ceph-mon[34678]: from='client.? 172.21.15.64:0/897660854' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-03-26T16:51:04.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:51:04 smithi149 ceph-mon[34678]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-03-26T16:51:04.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:51:04 smithi044 ceph-mon[30624]: from='client.? 172.21.15.64:0/897660854' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-03-26T16:51:04.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:51:04 smithi044 ceph-mon[30624]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-03-26T16:51:04.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:51:04 smithi064 ceph-mon[34420]: from='client.? 172.21.15.64:0/897660854' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-03-26T16:51:04.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:51:04 smithi064 ceph-mon[34420]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-03-26T16:51:06.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:51:06 smithi149 ceph-mon[34678]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-03-26T16:51:06.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:51:06 smithi044 ceph-mon[30624]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-03-26T16:51:06.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:51:06 smithi064 ceph-mon[34420]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-03-26T16:51:08.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:51:08 smithi064 ceph-mon[34420]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-03-26T16:51:08.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:51:08 smithi149 ceph-mon[34678]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-03-26T16:51:08.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:51:08 smithi044 ceph-mon[30624]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-03-26T16:51:09.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:51:09 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-03-26T16:51:09.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:51:09 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T16:51:09.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:51:09 smithi149 ceph-mon[34678]: Deploying daemon osd.3 on smithi064 2024-03-26T16:51:09.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:51:09 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-03-26T16:51:09.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:51:09 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T16:51:09.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:51:09 smithi044 ceph-mon[30624]: Deploying daemon osd.3 on smithi064 2024-03-26T16:51:09.543 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:51:09 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-03-26T16:51:09.543 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:51:09 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T16:51:09.543 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:51:09 smithi064 ceph-mon[34420]: Deploying daemon osd.3 on smithi064 2024-03-26T16:51:10.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:51:10 smithi149 ceph-mon[34678]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-03-26T16:51:10.406 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:51:10 smithi064 ceph-mon[34420]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-03-26T16:51:10.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:51:10 smithi044 ceph-mon[30624]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-03-26T16:51:12.266 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:51:12 smithi044 ceph-mon[30624]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-03-26T16:51:12.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:51:12 smithi064 ceph-mon[34420]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-03-26T16:51:12.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:51:12 smithi149 ceph-mon[34678]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-03-26T16:51:15.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:51:15 smithi064 ceph-mon[34420]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-03-26T16:51:15.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:51:15 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:51:15.307 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:51:15 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:51:15.307 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:51:15 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-26T16:51:15.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:51:15 smithi149 ceph-mon[34678]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-03-26T16:51:15.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:51:15 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:51:15.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:51:15 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:51:15.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:51:15 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-26T16:51:15.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:51:15 smithi044 ceph-mon[30624]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-03-26T16:51:15.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:51:15 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:51:15.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:51:15 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:51:15.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:51:15 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-26T16:51:17.298 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:51:17 smithi064 ceph-mon[34420]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-03-26T16:51:17.298 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:51:17 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:51:17.298 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:51:17 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:51:17.298 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:51:17 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T16:51:17.298 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:51:17 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-26T16:51:17.298 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:51:17 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:51:17.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:51:17 smithi149 ceph-mon[34678]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-03-26T16:51:17.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:51:17 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:51:17.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:51:17 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:51:17.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:51:17 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T16:51:17.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:51:17 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-26T16:51:17.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:51:17 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:51:17.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:51:17 smithi044 ceph-mon[30624]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-03-26T16:51:17.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:51:17 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:51:17.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:51:17 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:51:17.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:51:17 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T16:51:17.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:51:17 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-26T16:51:17.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:51:17 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:51:17.659 INFO:teuthology.orchestra.run.smithi064.stdout:Created osd(s) 3 on host 'smithi064' 2024-03-26T16:51:18.160 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:51:18 smithi064 ceph-mon[34420]: from='osd.3 [v2:172.21.15.64:6808/3087353302,v1:172.21.15.64:6809/3087353302]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-03-26T16:51:18.160 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:51:18 smithi064 ceph-mon[34420]: from='osd.3 ' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-03-26T16:51:18.160 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:51:18 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:51:18.160 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:51:18 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:51:18.160 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:51:18 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-26T16:51:18.184 DEBUG:teuthology.orchestra.run.smithi064:osd.3> sudo journalctl -f -n 0 -u ceph-4394d798-eb90-11ee-95d0-87774f69a715@osd.3.service 2024-03-26T16:51:18.186 INFO:tasks.cephadm:Deploying osd.4 on smithi064 with /dev/vg_nvme/lv_2... 2024-03-26T16:51:18.186 DEBUG:teuthology.orchestra.run.smithi064:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bf9505fb569e9b95a78f9700ed8c4bd20508ef55 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4394d798-eb90-11ee-95d0-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-03-26T16:51:18.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:51:18 smithi149 ceph-mon[34678]: from='osd.3 [v2:172.21.15.64:6808/3087353302,v1:172.21.15.64:6809/3087353302]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-03-26T16:51:18.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:51:18 smithi149 ceph-mon[34678]: from='osd.3 ' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-03-26T16:51:18.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:51:18 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:51:18.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:51:18 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:51:18.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:51:18 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-26T16:51:18.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:51:18 smithi044 ceph-mon[30624]: from='osd.3 [v2:172.21.15.64:6808/3087353302,v1:172.21.15.64:6809/3087353302]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-03-26T16:51:18.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:51:18 smithi044 ceph-mon[30624]: from='osd.3 ' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-03-26T16:51:18.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:51:18 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:51:18.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:51:18 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:51:18.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:51:18 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-26T16:51:19.021 INFO:teuthology.orchestra.run.smithi064.stderr:Inferring config /var/lib/ceph/4394d798-eb90-11ee-95d0-87774f69a715/mon.b/config 2024-03-26T16:51:19.350 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:51:19 smithi064 ceph-mon[34420]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-03-26T16:51:19.350 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:51:19 smithi064 ceph-mon[34420]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-03-26T16:51:19.350 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:51:19 smithi064 ceph-mon[34420]: from='osd.3 [v2:172.21.15.64:6808/3087353302,v1:172.21.15.64:6809/3087353302]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi064", "root=default"]} : dispatch 2024-03-26T16:51:19.350 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:51:19 smithi064 ceph-mon[34420]: osdmap e23: 4 total, 3 up, 4 in 2024-03-26T16:51:19.350 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:51:19 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-03-26T16:51:19.350 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:51:19 smithi064 ceph-mon[34420]: from='osd.3 ' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi064", "root=default"]} : dispatch 2024-03-26T16:51:19.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:51:19 smithi149 ceph-mon[34678]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-03-26T16:51:19.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:51:19 smithi149 ceph-mon[34678]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-03-26T16:51:19.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:51:19 smithi149 ceph-mon[34678]: from='osd.3 [v2:172.21.15.64:6808/3087353302,v1:172.21.15.64:6809/3087353302]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi064", "root=default"]} : dispatch 2024-03-26T16:51:19.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:51:19 smithi149 ceph-mon[34678]: osdmap e23: 4 total, 3 up, 4 in 2024-03-26T16:51:19.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:51:19 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-03-26T16:51:19.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:51:19 smithi149 ceph-mon[34678]: from='osd.3 ' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi064", "root=default"]} : dispatch 2024-03-26T16:51:19.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:51:19 smithi044 ceph-mon[30624]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-03-26T16:51:19.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:51:19 smithi044 ceph-mon[30624]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-03-26T16:51:19.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:51:19 smithi044 ceph-mon[30624]: from='osd.3 [v2:172.21.15.64:6808/3087353302,v1:172.21.15.64:6809/3087353302]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi064", "root=default"]} : dispatch 2024-03-26T16:51:19.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:51:19 smithi044 ceph-mon[30624]: osdmap e23: 4 total, 3 up, 4 in 2024-03-26T16:51:19.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:51:19 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-03-26T16:51:19.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:51:19 smithi044 ceph-mon[30624]: from='osd.3 ' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi064", "root=default"]} : dispatch 2024-03-26T16:51:19.607 INFO:journalctl@ceph.osd.3.smithi064.stdout:Mar 26 16:51:19 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-3[43541]: 2024-03-26T16:51:19.507+0000 7f1866350700 -1 osd.3 0 waiting for initial osdmap 2024-03-26T16:51:19.608 INFO:journalctl@ceph.osd.3.smithi064.stdout:Mar 26 16:51:19 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-3[43541]: 2024-03-26T16:51:19.510+0000 7f185e13b700 -1 osd.3 24 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-26T16:51:20.366 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:51:20 smithi064 ceph-mon[34420]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi064", "root=default"]}]': finished 2024-03-26T16:51:20.367 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:51:20 smithi064 ceph-mon[34420]: osdmap e24: 4 total, 3 up, 4 in 2024-03-26T16:51:20.367 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:51:20 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-03-26T16:51:20.367 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:51:20 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-03-26T16:51:20.367 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:51:20 smithi064 ceph-mon[34420]: from='osd.3 ' entity='osd.3' 2024-03-26T16:51:20.367 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:51:20 smithi064 ceph-mon[34420]: osd.3 [v2:172.21.15.64:6808/3087353302,v1:172.21.15.64:6809/3087353302] boot 2024-03-26T16:51:20.367 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:51:20 smithi064 ceph-mon[34420]: osdmap e25: 4 total, 4 up, 4 in 2024-03-26T16:51:20.367 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:51:20 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-03-26T16:51:20.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:51:20 smithi149 ceph-mon[34678]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi064", "root=default"]}]': finished 2024-03-26T16:51:20.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:51:20 smithi149 ceph-mon[34678]: osdmap e24: 4 total, 3 up, 4 in 2024-03-26T16:51:20.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:51:20 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-03-26T16:51:20.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:51:20 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-03-26T16:51:20.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:51:20 smithi149 ceph-mon[34678]: from='osd.3 ' entity='osd.3' 2024-03-26T16:51:20.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:51:20 smithi149 ceph-mon[34678]: osd.3 [v2:172.21.15.64:6808/3087353302,v1:172.21.15.64:6809/3087353302] boot 2024-03-26T16:51:20.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:51:20 smithi149 ceph-mon[34678]: osdmap e25: 4 total, 4 up, 4 in 2024-03-26T16:51:20.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:51:20 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-03-26T16:51:20.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:51:20 smithi044 ceph-mon[30624]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi064", "root=default"]}]': finished 2024-03-26T16:51:20.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:51:20 smithi044 ceph-mon[30624]: osdmap e24: 4 total, 3 up, 4 in 2024-03-26T16:51:20.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:51:20 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-03-26T16:51:20.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:51:20 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-03-26T16:51:20.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:51:20 smithi044 ceph-mon[30624]: from='osd.3 ' entity='osd.3' 2024-03-26T16:51:20.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:51:20 smithi044 ceph-mon[30624]: osd.3 [v2:172.21.15.64:6808/3087353302,v1:172.21.15.64:6809/3087353302] boot 2024-03-26T16:51:20.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:51:20 smithi044 ceph-mon[30624]: osdmap e25: 4 total, 4 up, 4 in 2024-03-26T16:51:20.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:51:20 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-03-26T16:51:21.134 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:51:21 smithi064 ceph-mon[34420]: purged_snaps scrub starts 2024-03-26T16:51:21.134 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:51:21 smithi064 ceph-mon[34420]: purged_snaps scrub ok 2024-03-26T16:51:21.134 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:51:21 smithi064 ceph-mon[34420]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-03-26T16:51:21.134 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:51:21 smithi064 ceph-mon[34420]: osdmap e26: 4 total, 4 up, 4 in 2024-03-26T16:51:21.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:51:21 smithi149 ceph-mon[34678]: purged_snaps scrub starts 2024-03-26T16:51:21.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:51:21 smithi149 ceph-mon[34678]: purged_snaps scrub ok 2024-03-26T16:51:21.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:51:21 smithi149 ceph-mon[34678]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-03-26T16:51:21.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:51:21 smithi149 ceph-mon[34678]: osdmap e26: 4 total, 4 up, 4 in 2024-03-26T16:51:21.446 INFO:teuthology.orchestra.run.smithi064.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-03-26T16:51:21.446 INFO:teuthology.orchestra.run.smithi064.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-03-26T16:51:21.446 INFO:teuthology.orchestra.run.smithi064.stderr: stderr: 10+0 records in 2024-03-26T16:51:21.446 INFO:teuthology.orchestra.run.smithi064.stderr:10+0 records out 2024-03-26T16:51:21.446 INFO:teuthology.orchestra.run.smithi064.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0121339 s, 864 MB/s 2024-03-26T16:51:21.447 INFO:teuthology.orchestra.run.smithi064.stderr:--> Zapping successful for: 2024-03-26T16:51:21.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:51:21 smithi044 ceph-mon[30624]: purged_snaps scrub starts 2024-03-26T16:51:21.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:51:21 smithi044 ceph-mon[30624]: purged_snaps scrub ok 2024-03-26T16:51:21.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:51:21 smithi044 ceph-mon[30624]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-03-26T16:51:21.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:51:21 smithi044 ceph-mon[30624]: osdmap e26: 4 total, 4 up, 4 in 2024-03-26T16:51:22.731 DEBUG:teuthology.orchestra.run.smithi064:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bf9505fb569e9b95a78f9700ed8c4bd20508ef55 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4394d798-eb90-11ee-95d0-87774f69a715 -- ceph orch daemon add osd smithi064:vg_nvme/lv_2 2024-03-26T16:51:22.970 INFO:teuthology.orchestra.run.smithi064.stderr:Inferring config /var/lib/ceph/4394d798-eb90-11ee-95d0-87774f69a715/mon.b/config 2024-03-26T16:51:23.384 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:51:23 smithi064 ceph-mon[34420]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 357 GiB / 358 GiB avail 2024-03-26T16:51:23.384 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:51:23 smithi064 ceph-mon[34420]: osdmap e27: 4 total, 4 up, 4 in 2024-03-26T16:51:23.384 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:51:23 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:51:23.385 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:51:23 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:51:23.385 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:51:23 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-03-26T16:51:23.385 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:51:23 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-03-26T16:51:23.385 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:51:23 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:51:23.385 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:51:23 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T16:51:23.385 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:51:23 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-26T16:51:23.385 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:51:23 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:51:23.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:51:23 smithi149 ceph-mon[34678]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 357 GiB / 358 GiB avail 2024-03-26T16:51:23.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:51:23 smithi149 ceph-mon[34678]: osdmap e27: 4 total, 4 up, 4 in 2024-03-26T16:51:23.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:51:23 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:51:23.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:51:23 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:51:23.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:51:23 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-03-26T16:51:23.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:51:23 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-03-26T16:51:23.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:51:23 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:51:23.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:51:23 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T16:51:23.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:51:23 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-26T16:51:23.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:51:23 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:51:23.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:51:23 smithi044 ceph-mon[30624]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 357 GiB / 358 GiB avail 2024-03-26T16:51:23.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:51:23 smithi044 ceph-mon[30624]: osdmap e27: 4 total, 4 up, 4 in 2024-03-26T16:51:23.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:51:23 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:51:23.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:51:23 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:51:23.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:51:23 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-03-26T16:51:23.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:51:23 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-03-26T16:51:23.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:51:23 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:51:23.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:51:23 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T16:51:23.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:51:23 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-26T16:51:23.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:51:23 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:51:24.300 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:51:24 smithi064 ceph-mon[34420]: Detected new or changed devices on smithi064 2024-03-26T16:51:24.300 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:51:24 smithi064 ceph-mon[34420]: Adjusting osd_memory_target on smithi064 to 10592M 2024-03-26T16:51:24.301 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:51:24 smithi064 ceph-mon[34420]: osdmap e28: 4 total, 4 up, 4 in 2024-03-26T16:51:24.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:51:24 smithi149 ceph-mon[34678]: Detected new or changed devices on smithi064 2024-03-26T16:51:24.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:51:24 smithi149 ceph-mon[34678]: Adjusting osd_memory_target on smithi064 to 10592M 2024-03-26T16:51:24.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:51:24 smithi149 ceph-mon[34678]: osdmap e28: 4 total, 4 up, 4 in 2024-03-26T16:51:24.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:51:24 smithi044 ceph-mon[30624]: Detected new or changed devices on smithi064 2024-03-26T16:51:24.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:51:24 smithi044 ceph-mon[30624]: Adjusting osd_memory_target on smithi064 to 10592M 2024-03-26T16:51:24.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:51:24 smithi044 ceph-mon[30624]: osdmap e28: 4 total, 4 up, 4 in 2024-03-26T16:51:25.391 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:51:25 smithi064 ceph-mon[34420]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 357 GiB / 358 GiB avail 2024-03-26T16:51:25.391 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:51:25 smithi064 ceph-mon[34420]: osdmap e29: 4 total, 4 up, 4 in 2024-03-26T16:51:25.391 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:51:25 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-03-26T16:51:25.391 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:51:25 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-03-26T16:51:25.391 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:51:25 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T16:51:25.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:51:25 smithi149 ceph-mon[34678]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 357 GiB / 358 GiB avail 2024-03-26T16:51:25.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:51:25 smithi149 ceph-mon[34678]: osdmap e29: 4 total, 4 up, 4 in 2024-03-26T16:51:25.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:51:25 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-03-26T16:51:25.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:51:25 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-03-26T16:51:25.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:51:25 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T16:51:25.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:51:25 smithi044 ceph-mon[30624]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 357 GiB / 358 GiB avail 2024-03-26T16:51:25.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:51:25 smithi044 ceph-mon[30624]: osdmap e29: 4 total, 4 up, 4 in 2024-03-26T16:51:25.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:51:25 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-03-26T16:51:25.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:51:25 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-03-26T16:51:25.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:51:25 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T16:51:26.394 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:51:26 smithi064 ceph-mon[34420]: from='client.24212 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi064:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-03-26T16:51:26.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:51:26 smithi149 ceph-mon[34678]: from='client.24212 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi064:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-03-26T16:51:26.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:51:26 smithi044 ceph-mon[30624]: from='client.24212 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi064:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-03-26T16:51:27.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:51:27 smithi149 ceph-mon[34678]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 113 MiB used, 357 GiB / 358 GiB avail; 116 KiB/s, 0 objects/s recovering 2024-03-26T16:51:27.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:51:27 smithi044 ceph-mon[30624]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 113 MiB used, 357 GiB / 358 GiB avail; 116 KiB/s, 0 objects/s recovering 2024-03-26T16:51:27.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:51:27 smithi064 ceph-mon[34420]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 113 MiB used, 357 GiB / 358 GiB avail; 116 KiB/s, 0 objects/s recovering 2024-03-26T16:51:28.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:51:28 smithi149 ceph-mon[34678]: from='client.? 172.21.15.64:0/3974445690' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "8e3eecc3-6735-4c31-8884-48235f3aa539"} : dispatch 2024-03-26T16:51:28.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:51:28 smithi149 ceph-mon[34678]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "8e3eecc3-6735-4c31-8884-48235f3aa539"} : dispatch 2024-03-26T16:51:28.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:51:28 smithi149 ceph-mon[34678]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8e3eecc3-6735-4c31-8884-48235f3aa539"}]': finished 2024-03-26T16:51:28.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:51:28 smithi149 ceph-mon[34678]: osdmap e30: 5 total, 4 up, 5 in 2024-03-26T16:51:28.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:51:28 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-03-26T16:51:28.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:51:28 smithi149 ceph-mon[34678]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 113 MiB used, 357 GiB / 358 GiB avail; 97 KiB/s, 0 objects/s recovering 2024-03-26T16:51:28.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:51:28 smithi149 ceph-mon[34678]: from='client.? 172.21.15.64:0/2007578826' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-03-26T16:51:28.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:51:28 smithi044 ceph-mon[30624]: from='client.? 172.21.15.64:0/3974445690' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "8e3eecc3-6735-4c31-8884-48235f3aa539"} : dispatch 2024-03-26T16:51:28.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:51:28 smithi044 ceph-mon[30624]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "8e3eecc3-6735-4c31-8884-48235f3aa539"} : dispatch 2024-03-26T16:51:28.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:51:28 smithi044 ceph-mon[30624]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8e3eecc3-6735-4c31-8884-48235f3aa539"}]': finished 2024-03-26T16:51:28.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:51:28 smithi044 ceph-mon[30624]: osdmap e30: 5 total, 4 up, 5 in 2024-03-26T16:51:28.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:51:28 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-03-26T16:51:28.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:51:28 smithi044 ceph-mon[30624]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 113 MiB used, 357 GiB / 358 GiB avail; 97 KiB/s, 0 objects/s recovering 2024-03-26T16:51:28.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:51:28 smithi044 ceph-mon[30624]: from='client.? 172.21.15.64:0/2007578826' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-03-26T16:51:28.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:51:28 smithi064 ceph-mon[34420]: from='client.? 172.21.15.64:0/3974445690' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "8e3eecc3-6735-4c31-8884-48235f3aa539"} : dispatch 2024-03-26T16:51:28.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:51:28 smithi064 ceph-mon[34420]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "8e3eecc3-6735-4c31-8884-48235f3aa539"} : dispatch 2024-03-26T16:51:28.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:51:28 smithi064 ceph-mon[34420]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8e3eecc3-6735-4c31-8884-48235f3aa539"}]': finished 2024-03-26T16:51:28.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:51:28 smithi064 ceph-mon[34420]: osdmap e30: 5 total, 4 up, 5 in 2024-03-26T16:51:28.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:51:28 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-03-26T16:51:28.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:51:28 smithi064 ceph-mon[34420]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 113 MiB used, 357 GiB / 358 GiB avail; 97 KiB/s, 0 objects/s recovering 2024-03-26T16:51:28.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:51:28 smithi064 ceph-mon[34420]: from='client.? 172.21.15.64:0/2007578826' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-03-26T16:51:30.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:51:30 smithi149 ceph-mon[34678]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 83 KiB/s, 0 objects/s recovering 2024-03-26T16:51:30.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:51:30 smithi044 ceph-mon[30624]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 83 KiB/s, 0 objects/s recovering 2024-03-26T16:51:30.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:51:30 smithi064 ceph-mon[34420]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 83 KiB/s, 0 objects/s recovering 2024-03-26T16:51:32.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:51:32 smithi149 ceph-mon[34678]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-03-26T16:51:32.460 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:51:32 smithi064 ceph-mon[34420]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-03-26T16:51:32.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:51:32 smithi044 ceph-mon[30624]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-03-26T16:51:34.056 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:51:33 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-03-26T16:51:34.056 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:51:33 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T16:51:34.146 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:51:33 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-03-26T16:51:34.147 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:51:33 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T16:51:34.266 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:51:33 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-03-26T16:51:34.266 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:51:33 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T16:51:34.948 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:51:34 smithi064 ceph-mon[34420]: Deploying daemon osd.4 on smithi064 2024-03-26T16:51:34.948 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:51:34 smithi064 ceph-mon[34420]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-03-26T16:51:35.146 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:51:34 smithi149 ceph-mon[34678]: Deploying daemon osd.4 on smithi064 2024-03-26T16:51:35.147 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:51:34 smithi149 ceph-mon[34678]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-03-26T16:51:35.266 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:51:34 smithi044 ceph-mon[30624]: Deploying daemon osd.4 on smithi064 2024-03-26T16:51:35.266 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:51:34 smithi044 ceph-mon[30624]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-03-26T16:51:36.388 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:51:36 smithi064 ceph-mon[34420]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-03-26T16:51:36.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:51:36 smithi149 ceph-mon[34678]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-03-26T16:51:36.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:51:36 smithi044 ceph-mon[30624]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-03-26T16:51:38.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:51:38 smithi149 ceph-mon[34678]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-03-26T16:51:38.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:51:38 smithi044 ceph-mon[30624]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-03-26T16:51:38.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:51:38 smithi064 ceph-mon[34420]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-03-26T16:51:40.097 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:51:39 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:51:40.097 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:51:39 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:51:40.097 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:51:39 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-26T16:51:40.198 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:51:39 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:51:40.199 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:51:39 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:51:40.199 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:51:39 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-26T16:51:40.266 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:51:39 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:51:40.266 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:51:39 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:51:40.266 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:51:39 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-26T16:51:41.056 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:51:40 smithi064 ceph-mon[34420]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-03-26T16:51:41.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:51:40 smithi044 ceph-mon[30624]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-03-26T16:51:41.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:51:40 smithi149 ceph-mon[34678]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-03-26T16:51:42.357 INFO:teuthology.orchestra.run.smithi064.stdout:Created osd(s) 4 on host 'smithi064' 2024-03-26T16:51:42.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:51:42 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:51:42.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:51:42 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:51:42.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:51:42 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T16:51:42.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:51:42 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-26T16:51:42.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:51:42 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:51:42.557 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:51:42 smithi064 ceph-mon[34420]: from='osd.4 [v2:172.21.15.64:6816/3738404540,v1:172.21.15.64:6817/3738404540]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-03-26T16:51:42.557 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:51:42 smithi064 ceph-mon[34420]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-03-26T16:51:42.557 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:51:42 smithi064 ceph-mon[34420]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-03-26T16:51:42.557 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:51:42 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:51:42.557 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:51:42 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:51:42.557 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:51:42 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-26T16:51:42.766 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:51:42 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:51:42.766 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:51:42 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:51:42.766 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:51:42 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T16:51:42.769 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:51:42 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-26T16:51:42.769 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:51:42 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:51:42.769 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:51:42 smithi044 ceph-mon[30624]: from='osd.4 [v2:172.21.15.64:6816/3738404540,v1:172.21.15.64:6817/3738404540]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-03-26T16:51:42.769 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:51:42 smithi044 ceph-mon[30624]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-03-26T16:51:42.769 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:51:42 smithi044 ceph-mon[30624]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-03-26T16:51:42.769 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:51:42 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:51:42.769 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:51:42 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:51:42.770 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:51:42 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-26T16:51:42.897 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:51:42 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:51:42.897 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:51:42 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:51:42.897 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:51:42 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T16:51:42.897 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:51:42 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-26T16:51:42.897 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:51:42 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:51:42.897 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:51:42 smithi149 ceph-mon[34678]: from='osd.4 [v2:172.21.15.64:6816/3738404540,v1:172.21.15.64:6817/3738404540]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-03-26T16:51:42.897 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:51:42 smithi149 ceph-mon[34678]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-03-26T16:51:42.897 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:51:42 smithi149 ceph-mon[34678]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-03-26T16:51:42.897 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:51:42 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:51:42.897 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:51:42 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:51:42.897 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:51:42 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-26T16:51:43.002 DEBUG:teuthology.orchestra.run.smithi064:osd.4> sudo journalctl -f -n 0 -u ceph-4394d798-eb90-11ee-95d0-87774f69a715@osd.4.service 2024-03-26T16:51:43.004 INFO:tasks.cephadm:Deploying osd.5 on smithi149 with /dev/vg_nvme/lv_4... 2024-03-26T16:51:43.005 DEBUG:teuthology.orchestra.run.smithi149:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bf9505fb569e9b95a78f9700ed8c4bd20508ef55 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4394d798-eb90-11ee-95d0-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-03-26T16:51:43.246 INFO:teuthology.orchestra.run.smithi149.stderr:Inferring config /var/lib/ceph/4394d798-eb90-11ee-95d0-87774f69a715/mon.c/config 2024-03-26T16:51:43.647 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:51:43 smithi149 ceph-mon[34678]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-03-26T16:51:43.647 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:51:43 smithi149 ceph-mon[34678]: osdmap e31: 5 total, 4 up, 5 in 2024-03-26T16:51:43.647 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:51:43 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-03-26T16:51:43.647 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:51:43 smithi149 ceph-mon[34678]: from='osd.4 [v2:172.21.15.64:6816/3738404540,v1:172.21.15.64:6817/3738404540]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi064", "root=default"]} : dispatch 2024-03-26T16:51:43.647 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:51:43 smithi149 ceph-mon[34678]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi064", "root=default"]} : dispatch 2024-03-26T16:51:43.806 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:51:43 smithi064 ceph-mon[34420]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-03-26T16:51:43.806 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:51:43 smithi064 ceph-mon[34420]: osdmap e31: 5 total, 4 up, 5 in 2024-03-26T16:51:43.806 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:51:43 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-03-26T16:51:43.806 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:51:43 smithi064 ceph-mon[34420]: from='osd.4 [v2:172.21.15.64:6816/3738404540,v1:172.21.15.64:6817/3738404540]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi064", "root=default"]} : dispatch 2024-03-26T16:51:43.806 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:51:43 smithi064 ceph-mon[34420]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi064", "root=default"]} : dispatch 2024-03-26T16:51:43.807 INFO:journalctl@ceph.osd.4.smithi064.stdout:Mar 26 16:51:43 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-4[49575]: 2024-03-26T16:51:43.526+0000 7fdcea791700 -1 osd.4 0 waiting for initial osdmap 2024-03-26T16:51:43.807 INFO:journalctl@ceph.osd.4.smithi064.stdout:Mar 26 16:51:43 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-4[49575]: 2024-03-26T16:51:43.529+0000 7fdce6584700 -1 osd.4 32 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-26T16:51:44.016 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:51:43 smithi044 ceph-mon[30624]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-03-26T16:51:44.016 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:51:43 smithi044 ceph-mon[30624]: osdmap e31: 5 total, 4 up, 5 in 2024-03-26T16:51:44.016 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:51:43 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-03-26T16:51:44.016 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:51:43 smithi044 ceph-mon[30624]: from='osd.4 [v2:172.21.15.64:6816/3738404540,v1:172.21.15.64:6817/3738404540]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi064", "root=default"]} : dispatch 2024-03-26T16:51:44.016 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:51:43 smithi044 ceph-mon[30624]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi064", "root=default"]} : dispatch 2024-03-26T16:51:44.645 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:51:44 smithi149 ceph-mon[34678]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi064", "root=default"]}]': finished 2024-03-26T16:51:44.645 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:51:44 smithi149 ceph-mon[34678]: osdmap e32: 5 total, 4 up, 5 in 2024-03-26T16:51:44.645 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:51:44 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-03-26T16:51:44.645 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:51:44 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-03-26T16:51:44.645 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:51:44 smithi149 ceph-mon[34678]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-03-26T16:51:44.645 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:51:44 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-03-26T16:51:44.806 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:51:44 smithi064 ceph-mon[34420]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi064", "root=default"]}]': finished 2024-03-26T16:51:44.806 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:51:44 smithi064 ceph-mon[34420]: osdmap e32: 5 total, 4 up, 5 in 2024-03-26T16:51:44.806 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:51:44 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-03-26T16:51:44.806 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:51:44 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-03-26T16:51:44.806 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:51:44 smithi064 ceph-mon[34420]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-03-26T16:51:44.807 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:51:44 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-03-26T16:51:45.017 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:51:44 smithi044 ceph-mon[30624]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi064", "root=default"]}]': finished 2024-03-26T16:51:45.017 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:51:44 smithi044 ceph-mon[30624]: osdmap e32: 5 total, 4 up, 5 in 2024-03-26T16:51:45.018 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:51:44 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-03-26T16:51:45.018 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:51:44 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-03-26T16:51:45.018 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:51:44 smithi044 ceph-mon[30624]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-03-26T16:51:45.018 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:51:44 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-03-26T16:51:45.098 INFO:teuthology.orchestra.run.smithi149.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-03-26T16:51:45.098 INFO:teuthology.orchestra.run.smithi149.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-03-26T16:51:45.098 INFO:teuthology.orchestra.run.smithi149.stderr: stderr: 10+0 records in 2024-03-26T16:51:45.098 INFO:teuthology.orchestra.run.smithi149.stderr:10+0 records out 2024-03-26T16:51:45.098 INFO:teuthology.orchestra.run.smithi149.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0113435 s, 924 MB/s 2024-03-26T16:51:45.098 INFO:teuthology.orchestra.run.smithi149.stderr:--> Zapping successful for: 2024-03-26T16:51:45.783 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:51:45 smithi064 ceph-mon[34420]: purged_snaps scrub starts 2024-03-26T16:51:45.783 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:51:45 smithi064 ceph-mon[34420]: purged_snaps scrub ok 2024-03-26T16:51:45.783 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:51:45 smithi064 ceph-mon[34420]: osd.4 [v2:172.21.15.64:6816/3738404540,v1:172.21.15.64:6817/3738404540] boot 2024-03-26T16:51:45.783 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:51:45 smithi064 ceph-mon[34420]: osdmap e33: 5 total, 5 up, 5 in 2024-03-26T16:51:45.783 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:51:45 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-03-26T16:51:45.815 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:51:45 smithi149 ceph-mon[34678]: purged_snaps scrub starts 2024-03-26T16:51:45.816 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:51:45 smithi149 ceph-mon[34678]: purged_snaps scrub ok 2024-03-26T16:51:45.816 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:51:45 smithi149 ceph-mon[34678]: osd.4 [v2:172.21.15.64:6816/3738404540,v1:172.21.15.64:6817/3738404540] boot 2024-03-26T16:51:45.816 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:51:45 smithi149 ceph-mon[34678]: osdmap e33: 5 total, 5 up, 5 in 2024-03-26T16:51:45.816 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:51:45 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-03-26T16:51:45.846 DEBUG:teuthology.orchestra.run.smithi149:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bf9505fb569e9b95a78f9700ed8c4bd20508ef55 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4394d798-eb90-11ee-95d0-87774f69a715 -- ceph orch daemon add osd smithi149:vg_nvme/lv_4 2024-03-26T16:51:46.016 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:51:45 smithi044 ceph-mon[30624]: purged_snaps scrub starts 2024-03-26T16:51:46.016 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:51:45 smithi044 ceph-mon[30624]: purged_snaps scrub ok 2024-03-26T16:51:46.016 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:51:45 smithi044 ceph-mon[30624]: osd.4 [v2:172.21.15.64:6816/3738404540,v1:172.21.15.64:6817/3738404540] boot 2024-03-26T16:51:46.016 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:51:45 smithi044 ceph-mon[30624]: osdmap e33: 5 total, 5 up, 5 in 2024-03-26T16:51:46.016 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:51:45 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-03-26T16:51:46.090 INFO:teuthology.orchestra.run.smithi149.stderr:Inferring config /var/lib/ceph/4394d798-eb90-11ee-95d0-87774f69a715/mon.c/config 2024-03-26T16:51:46.806 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:51:46 smithi064 ceph-mon[34420]: osdmap e34: 5 total, 5 up, 5 in 2024-03-26T16:51:46.806 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:51:46 smithi064 ceph-mon[34420]: Detected new or changed devices on smithi064 2024-03-26T16:51:46.806 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:51:46 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:51:46.807 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:51:46 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:51:46.807 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:51:46 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-03-26T16:51:46.807 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:51:46 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-03-26T16:51:46.807 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:51:46 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-03-26T16:51:46.807 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:51:46 smithi064 ceph-mon[34420]: Adjusting osd_memory_target on smithi064 to 7061M 2024-03-26T16:51:46.807 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:51:46 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:51:46.807 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:51:46 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T16:51:46.807 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:51:46 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-26T16:51:46.807 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:51:46 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:51:46.807 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:51:46 smithi064 ceph-mon[34420]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-03-26T16:51:46.821 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:51:46 smithi149 ceph-mon[34678]: osdmap e34: 5 total, 5 up, 5 in 2024-03-26T16:51:46.821 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:51:46 smithi149 ceph-mon[34678]: Detected new or changed devices on smithi064 2024-03-26T16:51:46.821 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:51:46 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:51:46.821 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:51:46 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:51:46.821 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:51:46 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-03-26T16:51:46.821 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:51:46 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-03-26T16:51:46.822 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:51:46 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-03-26T16:51:46.822 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:51:46 smithi149 ceph-mon[34678]: Adjusting osd_memory_target on smithi064 to 7061M 2024-03-26T16:51:46.822 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:51:46 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:51:46.822 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:51:46 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T16:51:46.822 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:51:46 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-26T16:51:46.822 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:51:46 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:51:46.822 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:51:46 smithi149 ceph-mon[34678]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-03-26T16:51:47.016 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:51:46 smithi044 ceph-mon[30624]: osdmap e34: 5 total, 5 up, 5 in 2024-03-26T16:51:47.016 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:51:46 smithi044 ceph-mon[30624]: Detected new or changed devices on smithi064 2024-03-26T16:51:47.016 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:51:46 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:51:47.016 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:51:46 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:51:47.016 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:51:46 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-03-26T16:51:47.016 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:51:46 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-03-26T16:51:47.016 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:51:46 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-03-26T16:51:47.016 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:51:46 smithi044 ceph-mon[30624]: Adjusting osd_memory_target on smithi064 to 7061M 2024-03-26T16:51:47.016 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:51:46 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:51:47.017 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:51:46 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T16:51:47.017 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:51:46 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-26T16:51:47.017 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:51:46 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:51:47.017 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:51:46 smithi044 ceph-mon[30624]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-03-26T16:51:48.146 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:51:47 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-03-26T16:51:48.146 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:51:47 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-03-26T16:51:48.147 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:51:47 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T16:51:48.266 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:51:47 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-03-26T16:51:48.266 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:51:47 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-03-26T16:51:48.266 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:51:47 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T16:51:48.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:51:47 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-03-26T16:51:48.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:51:47 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-03-26T16:51:48.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:51:47 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T16:51:48.897 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:51:48 smithi149 ceph-mon[34678]: from='client.24196 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi149:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-03-26T16:51:48.897 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:51:48 smithi149 ceph-mon[34678]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-03-26T16:51:49.266 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:51:48 smithi044 ceph-mon[30624]: from='client.24196 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi149:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-03-26T16:51:49.266 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:51:48 smithi044 ceph-mon[30624]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-03-26T16:51:49.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:51:48 smithi064 ceph-mon[34420]: from='client.24196 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi149:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-03-26T16:51:49.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:51:48 smithi064 ceph-mon[34420]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-03-26T16:51:50.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:51:50 smithi149 ceph-mon[34678]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-03-26T16:51:50.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:51:50 smithi044 ceph-mon[30624]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-03-26T16:51:50.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:51:50 smithi064 ceph-mon[34420]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-03-26T16:51:51.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:51:51 smithi149 ceph-mon[34678]: from='client.? 172.21.15.149:0/3396716634' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "5eb3453c-e95d-4876-8c76-d323da294fd7"} : dispatch 2024-03-26T16:51:51.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:51:51 smithi149 ceph-mon[34678]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "5eb3453c-e95d-4876-8c76-d323da294fd7"} : dispatch 2024-03-26T16:51:51.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:51:51 smithi149 ceph-mon[34678]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5eb3453c-e95d-4876-8c76-d323da294fd7"}]': finished 2024-03-26T16:51:51.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:51:51 smithi149 ceph-mon[34678]: osdmap e35: 6 total, 5 up, 6 in 2024-03-26T16:51:51.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:51:51 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-03-26T16:51:51.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:51:51 smithi149 ceph-mon[34678]: from='client.? 172.21.15.149:0/3986111386' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-03-26T16:51:51.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:51:51 smithi044 ceph-mon[30624]: from='client.? 172.21.15.149:0/3396716634' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "5eb3453c-e95d-4876-8c76-d323da294fd7"} : dispatch 2024-03-26T16:51:51.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:51:51 smithi044 ceph-mon[30624]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "5eb3453c-e95d-4876-8c76-d323da294fd7"} : dispatch 2024-03-26T16:51:51.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:51:51 smithi044 ceph-mon[30624]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5eb3453c-e95d-4876-8c76-d323da294fd7"}]': finished 2024-03-26T16:51:51.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:51:51 smithi044 ceph-mon[30624]: osdmap e35: 6 total, 5 up, 6 in 2024-03-26T16:51:51.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:51:51 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-03-26T16:51:51.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:51:51 smithi044 ceph-mon[30624]: from='client.? 172.21.15.149:0/3986111386' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-03-26T16:51:51.516 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:51:51 smithi064 ceph-mon[34420]: from='client.? 172.21.15.149:0/3396716634' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "5eb3453c-e95d-4876-8c76-d323da294fd7"} : dispatch 2024-03-26T16:51:51.516 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:51:51 smithi064 ceph-mon[34420]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "5eb3453c-e95d-4876-8c76-d323da294fd7"} : dispatch 2024-03-26T16:51:51.516 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:51:51 smithi064 ceph-mon[34420]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5eb3453c-e95d-4876-8c76-d323da294fd7"}]': finished 2024-03-26T16:51:51.517 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:51:51 smithi064 ceph-mon[34420]: osdmap e35: 6 total, 5 up, 6 in 2024-03-26T16:51:51.517 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:51:51 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-03-26T16:51:51.517 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:51:51 smithi064 ceph-mon[34420]: from='client.? 172.21.15.149:0/3986111386' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-03-26T16:51:52.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:51:52 smithi149 ceph-mon[34678]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-03-26T16:51:52.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:51:52 smithi044 ceph-mon[30624]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-03-26T16:51:52.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:51:52 smithi064 ceph-mon[34420]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-03-26T16:51:54.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:51:54 smithi149 ceph-mon[34678]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-03-26T16:51:54.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:51:54 smithi044 ceph-mon[30624]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-03-26T16:51:54.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:51:54 smithi064 ceph-mon[34420]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-03-26T16:51:56.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:51:56 smithi149 ceph-mon[34678]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-03-26T16:51:56.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:51:56 smithi044 ceph-mon[30624]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-03-26T16:51:56.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:51:56 smithi064 ceph-mon[34420]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-03-26T16:51:57.388 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:51:57 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-03-26T16:51:57.388 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:51:57 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T16:51:57.388 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:51:57 smithi149 ceph-mon[34678]: Deploying daemon osd.5 on smithi149 2024-03-26T16:51:57.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:51:57 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-03-26T16:51:57.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:51:57 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T16:51:57.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:51:57 smithi044 ceph-mon[30624]: Deploying daemon osd.5 on smithi149 2024-03-26T16:51:57.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:51:57 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-03-26T16:51:57.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:51:57 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T16:51:57.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:51:57 smithi064 ceph-mon[34420]: Deploying daemon osd.5 on smithi149 2024-03-26T16:51:58.328 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:51:58 smithi149 ceph-mon[34678]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-03-26T16:51:58.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:51:58 smithi044 ceph-mon[30624]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-03-26T16:51:58.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:51:58 smithi064 ceph-mon[34420]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-03-26T16:52:00.387 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:52:00 smithi149 ceph-mon[34678]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-03-26T16:52:00.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:52:00 smithi044 ceph-mon[30624]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-03-26T16:52:00.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:52:00 smithi064 ceph-mon[34420]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-03-26T16:52:02.766 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:52:02 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:52:02.766 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:52:02 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:52:02.766 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:52:02 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-26T16:52:02.766 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:52:02 smithi044 ceph-mon[30624]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-03-26T16:52:02.790 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:52:02 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:52:02.790 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:52:02 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:52:02.790 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:52:02 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-26T16:52:02.790 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:52:02 smithi149 ceph-mon[34678]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-03-26T16:52:02.806 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:52:02 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:52:02.806 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:52:02 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:52:02.806 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:52:02 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-26T16:52:02.806 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:52:02 smithi064 ceph-mon[34420]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-03-26T16:52:04.897 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:52:04 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:52:04.897 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:52:04 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:52:04.897 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:52:04 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T16:52:04.897 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:52:04 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-26T16:52:04.897 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:52:04 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:52:04.897 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:52:04 smithi149 ceph-mon[34678]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-03-26T16:52:04.897 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:52:04 smithi149 ceph-mon[34678]: from='osd.5 [v2:172.21.15.149:6800/2605923055,v1:172.21.15.149:6801/2605923055]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-03-26T16:52:04.898 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:52:04 smithi149 ceph-mon[34678]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-03-26T16:52:04.966 INFO:teuthology.orchestra.run.smithi149.stdout:Created osd(s) 5 on host 'smithi149' 2024-03-26T16:52:05.016 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:52:04 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:52:05.016 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:52:04 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:52:05.016 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:52:04 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T16:52:05.016 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:52:04 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-26T16:52:05.016 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:52:04 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:52:05.016 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:52:04 smithi044 ceph-mon[30624]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-03-26T16:52:05.016 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:52:04 smithi044 ceph-mon[30624]: from='osd.5 [v2:172.21.15.149:6800/2605923055,v1:172.21.15.149:6801/2605923055]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-03-26T16:52:05.016 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:52:04 smithi044 ceph-mon[30624]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-03-26T16:52:05.056 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:52:04 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:52:05.056 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:52:04 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:52:05.056 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:52:04 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T16:52:05.056 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:52:04 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-26T16:52:05.056 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:52:04 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:52:05.056 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:52:04 smithi064 ceph-mon[34420]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-03-26T16:52:05.057 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:52:04 smithi064 ceph-mon[34420]: from='osd.5 [v2:172.21.15.149:6800/2605923055,v1:172.21.15.149:6801/2605923055]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-03-26T16:52:05.057 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:52:04 smithi064 ceph-mon[34420]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-03-26T16:52:05.563 DEBUG:teuthology.orchestra.run.smithi149:osd.5> sudo journalctl -f -n 0 -u ceph-4394d798-eb90-11ee-95d0-87774f69a715@osd.5.service 2024-03-26T16:52:05.566 INFO:tasks.cephadm:Deploying osd.6 on smithi149 with /dev/vg_nvme/lv_3... 2024-03-26T16:52:05.566 DEBUG:teuthology.orchestra.run.smithi149:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bf9505fb569e9b95a78f9700ed8c4bd20508ef55 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4394d798-eb90-11ee-95d0-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-03-26T16:52:05.873 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:52:05 smithi149 ceph-mon[34678]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-03-26T16:52:05.873 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:52:05 smithi149 ceph-mon[34678]: osdmap e36: 6 total, 5 up, 6 in 2024-03-26T16:52:05.873 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:52:05 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-03-26T16:52:05.873 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:52:05 smithi149 ceph-mon[34678]: from='osd.5 [v2:172.21.15.149:6800/2605923055,v1:172.21.15.149:6801/2605923055]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi149", "root=default"]} : dispatch 2024-03-26T16:52:05.873 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:52:05 smithi149 ceph-mon[34678]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi149", "root=default"]} : dispatch 2024-03-26T16:52:05.873 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:52:05 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:52:05.873 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:52:05 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:52:05.873 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:52:05 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-26T16:52:05.874 INFO:journalctl@ceph.osd.5.smithi149.stdout:Mar 26 16:52:05 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-5[38953]: 2024-03-26T16:52:05.743+0000 7fdfb1975700 -1 osd.5 0 waiting for initial osdmap 2024-03-26T16:52:05.874 INFO:journalctl@ceph.osd.5.smithi149.stdout:Mar 26 16:52:05 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-5[38953]: 2024-03-26T16:52:05.747+0000 7fdfad768700 -1 osd.5 37 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-26T16:52:06.016 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:52:05 smithi044 ceph-mon[30624]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-03-26T16:52:06.016 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:52:05 smithi044 ceph-mon[30624]: osdmap e36: 6 total, 5 up, 6 in 2024-03-26T16:52:06.016 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:52:05 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-03-26T16:52:06.016 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:52:05 smithi044 ceph-mon[30624]: from='osd.5 [v2:172.21.15.149:6800/2605923055,v1:172.21.15.149:6801/2605923055]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi149", "root=default"]} : dispatch 2024-03-26T16:52:06.016 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:52:05 smithi044 ceph-mon[30624]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi149", "root=default"]} : dispatch 2024-03-26T16:52:06.016 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:52:05 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:52:06.016 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:52:05 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:52:06.016 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:52:05 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-26T16:52:06.056 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:52:05 smithi064 ceph-mon[34420]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-03-26T16:52:06.056 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:52:05 smithi064 ceph-mon[34420]: osdmap e36: 6 total, 5 up, 6 in 2024-03-26T16:52:06.056 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:52:05 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-03-26T16:52:06.056 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:52:05 smithi064 ceph-mon[34420]: from='osd.5 [v2:172.21.15.149:6800/2605923055,v1:172.21.15.149:6801/2605923055]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi149", "root=default"]} : dispatch 2024-03-26T16:52:06.056 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:52:05 smithi064 ceph-mon[34420]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi149", "root=default"]} : dispatch 2024-03-26T16:52:06.057 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:52:05 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:52:06.057 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:52:05 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:52:06.057 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:52:05 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-26T16:52:07.015 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:52:06 smithi044 ceph-mon[30624]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi149", "root=default"]}]': finished 2024-03-26T16:52:07.016 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:52:06 smithi044 ceph-mon[30624]: osdmap e37: 6 total, 5 up, 6 in 2024-03-26T16:52:07.016 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:52:06 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-03-26T16:52:07.016 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:52:06 smithi044 ceph-mon[30624]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-03-26T16:52:07.016 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:52:06 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-03-26T16:52:07.056 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:52:06 smithi064 ceph-mon[34420]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi149", "root=default"]}]': finished 2024-03-26T16:52:07.056 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:52:06 smithi064 ceph-mon[34420]: osdmap e37: 6 total, 5 up, 6 in 2024-03-26T16:52:07.056 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:52:06 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-03-26T16:52:07.056 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:52:06 smithi064 ceph-mon[34420]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-03-26T16:52:07.056 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:52:06 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-03-26T16:52:07.071 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:52:06 smithi149 ceph-mon[34678]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi149", "root=default"]}]': finished 2024-03-26T16:52:07.071 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:52:06 smithi149 ceph-mon[34678]: osdmap e37: 6 total, 5 up, 6 in 2024-03-26T16:52:07.071 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:52:06 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-03-26T16:52:07.072 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:52:06 smithi149 ceph-mon[34678]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-03-26T16:52:07.072 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:52:06 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-03-26T16:52:07.165 INFO:teuthology.orchestra.run.smithi149.stderr:Inferring config /var/lib/ceph/4394d798-eb90-11ee-95d0-87774f69a715/mon.c/config 2024-03-26T16:52:08.015 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:52:07 smithi044 ceph-mon[30624]: purged_snaps scrub starts 2024-03-26T16:52:08.016 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:52:07 smithi044 ceph-mon[30624]: purged_snaps scrub ok 2024-03-26T16:52:08.016 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:52:07 smithi044 ceph-mon[30624]: osd.5 [v2:172.21.15.149:6800/2605923055,v1:172.21.15.149:6801/2605923055] boot 2024-03-26T16:52:08.016 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:52:07 smithi044 ceph-mon[30624]: osdmap e38: 6 total, 6 up, 6 in 2024-03-26T16:52:08.016 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:52:07 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-03-26T16:52:08.056 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:52:07 smithi064 ceph-mon[34420]: purged_snaps scrub starts 2024-03-26T16:52:08.056 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:52:07 smithi064 ceph-mon[34420]: purged_snaps scrub ok 2024-03-26T16:52:08.056 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:52:07 smithi064 ceph-mon[34420]: osd.5 [v2:172.21.15.149:6800/2605923055,v1:172.21.15.149:6801/2605923055] boot 2024-03-26T16:52:08.056 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:52:07 smithi064 ceph-mon[34420]: osdmap e38: 6 total, 6 up, 6 in 2024-03-26T16:52:08.056 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:52:07 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-03-26T16:52:08.146 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:52:07 smithi149 ceph-mon[34678]: purged_snaps scrub starts 2024-03-26T16:52:08.147 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:52:07 smithi149 ceph-mon[34678]: purged_snaps scrub ok 2024-03-26T16:52:08.147 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:52:07 smithi149 ceph-mon[34678]: osd.5 [v2:172.21.15.149:6800/2605923055,v1:172.21.15.149:6801/2605923055] boot 2024-03-26T16:52:08.147 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:52:07 smithi149 ceph-mon[34678]: osdmap e38: 6 total, 6 up, 6 in 2024-03-26T16:52:08.147 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:52:07 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-03-26T16:52:09.015 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:52:08 smithi044 ceph-mon[30624]: osdmap e39: 6 total, 6 up, 6 in 2024-03-26T16:52:09.016 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:52:08 smithi044 ceph-mon[30624]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail 2024-03-26T16:52:09.016 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:52:08 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:52:09.016 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:52:08 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:52:09.016 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:52:08 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-03-26T16:52:09.016 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:52:08 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:52:09.016 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:52:08 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T16:52:09.016 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:52:08 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-26T16:52:09.016 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:52:08 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:52:09.017 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:52:08 smithi149 ceph-mon[34678]: osdmap e39: 6 total, 6 up, 6 in 2024-03-26T16:52:09.018 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:52:08 smithi149 ceph-mon[34678]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail 2024-03-26T16:52:09.018 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:52:08 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:52:09.018 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:52:08 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:52:09.018 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:52:08 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-03-26T16:52:09.018 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:52:08 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:52:09.018 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:52:08 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T16:52:09.018 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:52:08 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-26T16:52:09.018 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:52:08 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:52:09.056 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:52:08 smithi064 ceph-mon[34420]: osdmap e39: 6 total, 6 up, 6 in 2024-03-26T16:52:09.056 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:52:08 smithi064 ceph-mon[34420]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail 2024-03-26T16:52:09.056 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:52:08 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:52:09.056 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:52:08 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:52:09.056 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:52:08 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-03-26T16:52:09.056 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:52:08 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:52:09.056 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:52:08 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T16:52:09.056 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:52:08 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-26T16:52:09.057 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:52:08 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:52:09.541 INFO:teuthology.orchestra.run.smithi149.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-03-26T16:52:09.542 INFO:teuthology.orchestra.run.smithi149.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-03-26T16:52:09.542 INFO:teuthology.orchestra.run.smithi149.stderr: stderr: 10+0 records in 2024-03-26T16:52:09.542 INFO:teuthology.orchestra.run.smithi149.stderr:10+0 records out 2024-03-26T16:52:09.542 INFO:teuthology.orchestra.run.smithi149.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.013516 s, 776 MB/s 2024-03-26T16:52:09.542 INFO:teuthology.orchestra.run.smithi149.stderr:--> Zapping successful for: 2024-03-26T16:52:09.855 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:52:09 smithi149 ceph-mon[34678]: Detected new or changed devices on smithi149 2024-03-26T16:52:09.855 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:52:09 smithi149 ceph-mon[34678]: Adjusting osd_memory_target on smithi149 to 9912M 2024-03-26T16:52:09.855 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:52:09 smithi149 ceph-mon[34678]: osdmap e40: 6 total, 6 up, 6 in 2024-03-26T16:52:10.015 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:52:09 smithi044 ceph-mon[30624]: Detected new or changed devices on smithi149 2024-03-26T16:52:10.016 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:52:09 smithi044 ceph-mon[30624]: Adjusting osd_memory_target on smithi149 to 9912M 2024-03-26T16:52:10.016 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:52:09 smithi044 ceph-mon[30624]: osdmap e40: 6 total, 6 up, 6 in 2024-03-26T16:52:10.056 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:52:09 smithi064 ceph-mon[34420]: Detected new or changed devices on smithi149 2024-03-26T16:52:10.056 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:52:09 smithi064 ceph-mon[34420]: Adjusting osd_memory_target on smithi149 to 9912M 2024-03-26T16:52:10.056 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:52:09 smithi064 ceph-mon[34420]: osdmap e40: 6 total, 6 up, 6 in 2024-03-26T16:52:10.157 DEBUG:teuthology.orchestra.run.smithi149:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bf9505fb569e9b95a78f9700ed8c4bd20508ef55 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4394d798-eb90-11ee-95d0-87774f69a715 -- ceph orch daemon add osd smithi149:vg_nvme/lv_3 2024-03-26T16:52:10.393 INFO:teuthology.orchestra.run.smithi149.stderr:Inferring config /var/lib/ceph/4394d798-eb90-11ee-95d0-87774f69a715/mon.c/config 2024-03-26T16:52:11.045 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:52:10 smithi149 ceph-mon[34678]: osdmap e41: 6 total, 6 up, 6 in 2024-03-26T16:52:11.045 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:52:10 smithi149 ceph-mon[34678]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail 2024-03-26T16:52:11.056 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:52:10 smithi064 ceph-mon[34420]: osdmap e41: 6 total, 6 up, 6 in 2024-03-26T16:52:11.056 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:52:10 smithi064 ceph-mon[34420]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail 2024-03-26T16:52:11.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:52:10 smithi044 ceph-mon[30624]: osdmap e41: 6 total, 6 up, 6 in 2024-03-26T16:52:11.266 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:52:10 smithi044 ceph-mon[30624]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail 2024-03-26T16:52:11.859 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:52:11 smithi149 ceph-mon[34678]: osdmap e42: 6 total, 6 up, 6 in 2024-03-26T16:52:12.056 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:52:11 smithi064 ceph-mon[34420]: osdmap e42: 6 total, 6 up, 6 in 2024-03-26T16:52:12.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:52:11 smithi044 ceph-mon[30624]: osdmap e42: 6 total, 6 up, 6 in 2024-03-26T16:52:12.952 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:52:12 smithi149 ceph-mon[34678]: from='client.24223 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi149:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-03-26T16:52:12.952 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:52:12 smithi149 ceph-mon[34678]: pgmap v149: 1 pgs: 1 peering; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail; 134 KiB/s, 0 objects/s recovering 2024-03-26T16:52:12.952 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:52:12 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-03-26T16:52:12.952 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:52:12 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-03-26T16:52:12.952 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:52:12 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T16:52:13.056 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:52:12 smithi064 ceph-mon[34420]: from='client.24223 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi149:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-03-26T16:52:13.056 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:52:12 smithi064 ceph-mon[34420]: pgmap v149: 1 pgs: 1 peering; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail; 134 KiB/s, 0 objects/s recovering 2024-03-26T16:52:13.056 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:52:12 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-03-26T16:52:13.056 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:52:12 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-03-26T16:52:13.056 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:52:12 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T16:52:13.266 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:52:12 smithi044 ceph-mon[30624]: from='client.24223 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi149:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-03-26T16:52:13.266 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:52:12 smithi044 ceph-mon[30624]: pgmap v149: 1 pgs: 1 peering; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail; 134 KiB/s, 0 objects/s recovering 2024-03-26T16:52:13.266 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:52:12 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-03-26T16:52:13.266 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:52:12 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-03-26T16:52:13.266 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:52:12 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T16:52:14.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:52:14 smithi149 ceph-mon[34678]: pgmap v150: 1 pgs: 1 peering; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-03-26T16:52:14.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:52:14 smithi044 ceph-mon[30624]: pgmap v150: 1 pgs: 1 peering; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-03-26T16:52:14.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:52:14 smithi064 ceph-mon[34420]: pgmap v150: 1 pgs: 1 peering; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-03-26T16:52:15.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:52:15 smithi149 ceph-mon[34678]: from='client.? 172.21.15.149:0/2024533008' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "812e8cbf-eb38-480a-bbb8-a12dd5c6dc36"} : dispatch 2024-03-26T16:52:15.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:52:15 smithi149 ceph-mon[34678]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "812e8cbf-eb38-480a-bbb8-a12dd5c6dc36"} : dispatch 2024-03-26T16:52:15.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:52:15 smithi149 ceph-mon[34678]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "812e8cbf-eb38-480a-bbb8-a12dd5c6dc36"}]': finished 2024-03-26T16:52:15.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:52:15 smithi149 ceph-mon[34678]: osdmap e43: 7 total, 6 up, 7 in 2024-03-26T16:52:15.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:52:15 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-03-26T16:52:15.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:52:15 smithi044 ceph-mon[30624]: from='client.? 172.21.15.149:0/2024533008' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "812e8cbf-eb38-480a-bbb8-a12dd5c6dc36"} : dispatch 2024-03-26T16:52:15.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:52:15 smithi044 ceph-mon[30624]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "812e8cbf-eb38-480a-bbb8-a12dd5c6dc36"} : dispatch 2024-03-26T16:52:15.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:52:15 smithi044 ceph-mon[30624]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "812e8cbf-eb38-480a-bbb8-a12dd5c6dc36"}]': finished 2024-03-26T16:52:15.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:52:15 smithi044 ceph-mon[30624]: osdmap e43: 7 total, 6 up, 7 in 2024-03-26T16:52:15.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:52:15 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-03-26T16:52:15.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:52:15 smithi064 ceph-mon[34420]: from='client.? 172.21.15.149:0/2024533008' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "812e8cbf-eb38-480a-bbb8-a12dd5c6dc36"} : dispatch 2024-03-26T16:52:15.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:52:15 smithi064 ceph-mon[34420]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "812e8cbf-eb38-480a-bbb8-a12dd5c6dc36"} : dispatch 2024-03-26T16:52:15.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:52:15 smithi064 ceph-mon[34420]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "812e8cbf-eb38-480a-bbb8-a12dd5c6dc36"}]': finished 2024-03-26T16:52:15.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:52:15 smithi064 ceph-mon[34420]: osdmap e43: 7 total, 6 up, 7 in 2024-03-26T16:52:15.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:52:15 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-03-26T16:52:16.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:52:16 smithi044 ceph-mon[30624]: from='client.? 172.21.15.149:0/2009339202' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-03-26T16:52:16.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:52:16 smithi044 ceph-mon[30624]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail; 92 KiB/s, 0 objects/s recovering 2024-03-26T16:52:16.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:52:16 smithi064 ceph-mon[34420]: from='client.? 172.21.15.149:0/2009339202' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-03-26T16:52:16.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:52:16 smithi064 ceph-mon[34420]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail; 92 KiB/s, 0 objects/s recovering 2024-03-26T16:52:16.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:52:16 smithi149 ceph-mon[34678]: from='client.? 172.21.15.149:0/2009339202' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-03-26T16:52:16.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:52:16 smithi149 ceph-mon[34678]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail; 92 KiB/s, 0 objects/s recovering 2024-03-26T16:52:18.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:52:18 smithi149 ceph-mon[34678]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-03-26T16:52:18.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:52:18 smithi044 ceph-mon[30624]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-03-26T16:52:18.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:52:18 smithi064 ceph-mon[34420]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-03-26T16:52:20.312 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:52:20 smithi149 ceph-mon[34678]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail 2024-03-26T16:52:20.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:52:20 smithi044 ceph-mon[30624]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail 2024-03-26T16:52:20.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:52:20 smithi064 ceph-mon[34420]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail 2024-03-26T16:52:21.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:52:21 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2024-03-26T16:52:21.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:52:21 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T16:52:21.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:52:21 smithi149 ceph-mon[34678]: Deploying daemon osd.6 on smithi149 2024-03-26T16:52:21.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:52:21 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2024-03-26T16:52:21.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:52:21 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T16:52:21.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:52:21 smithi044 ceph-mon[30624]: Deploying daemon osd.6 on smithi149 2024-03-26T16:52:21.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:52:21 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2024-03-26T16:52:21.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:52:21 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T16:52:21.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:52:21 smithi064 ceph-mon[34420]: Deploying daemon osd.6 on smithi149 2024-03-26T16:52:22.341 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:52:22 smithi149 ceph-mon[34678]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail 2024-03-26T16:52:22.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:52:22 smithi044 ceph-mon[30624]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail 2024-03-26T16:52:22.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:52:22 smithi064 ceph-mon[34420]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail 2024-03-26T16:52:24.201 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:52:24 smithi149 ceph-mon[34678]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail 2024-03-26T16:52:24.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:52:24 smithi044 ceph-mon[30624]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail 2024-03-26T16:52:24.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:52:24 smithi064 ceph-mon[34420]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail 2024-03-26T16:52:26.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:52:26 smithi149 ceph-mon[34678]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail 2024-03-26T16:52:26.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:52:26 smithi044 ceph-mon[30624]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail 2024-03-26T16:52:26.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:52:26 smithi064 ceph-mon[34420]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail 2024-03-26T16:52:27.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:52:27 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:52:27.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:52:27 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:52:27.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:52:27 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-26T16:52:27.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:52:27 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:52:27.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:52:27 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:52:27.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:52:27 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-26T16:52:27.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:52:27 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:52:27.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:52:27 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:52:27.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:52:27 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-26T16:52:28.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:52:28 smithi149 ceph-mon[34678]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail 2024-03-26T16:52:28.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:52:28 smithi044 ceph-mon[30624]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail 2024-03-26T16:52:28.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:52:28 smithi064 ceph-mon[34420]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail 2024-03-26T16:52:29.260 INFO:teuthology.orchestra.run.smithi149.stdout:Created osd(s) 6 on host 'smithi149' 2024-03-26T16:52:30.083 DEBUG:teuthology.orchestra.run.smithi149:osd.6> sudo journalctl -f -n 0 -u ceph-4394d798-eb90-11ee-95d0-87774f69a715@osd.6.service 2024-03-26T16:52:30.086 INFO:tasks.cephadm:Deploying osd.7 on smithi149 with /dev/vg_nvme/lv_2... 2024-03-26T16:52:30.086 DEBUG:teuthology.orchestra.run.smithi149:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bf9505fb569e9b95a78f9700ed8c4bd20508ef55 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4394d798-eb90-11ee-95d0-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-03-26T16:52:30.380 INFO:teuthology.orchestra.run.smithi149.stderr:Inferring config /var/lib/ceph/4394d798-eb90-11ee-95d0-87774f69a715/mon.c/config 2024-03-26T16:52:30.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:52:30 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:52:30.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:52:30 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:52:30.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:52:30 smithi149 ceph-mon[34678]: from='osd.6 [v2:172.21.15.149:6808/3213182086,v1:172.21.15.149:6809/3213182086]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-03-26T16:52:30.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:52:30 smithi149 ceph-mon[34678]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail 2024-03-26T16:52:30.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:52:30 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:52:30.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:52:30 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:52:30.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:52:30 smithi044 ceph-mon[30624]: from='osd.6 [v2:172.21.15.149:6808/3213182086,v1:172.21.15.149:6809/3213182086]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-03-26T16:52:30.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:52:30 smithi044 ceph-mon[30624]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail 2024-03-26T16:52:30.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:52:30 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:52:30.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:52:30 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:52:30.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:52:30 smithi064 ceph-mon[34420]: from='osd.6 [v2:172.21.15.149:6808/3213182086,v1:172.21.15.149:6809/3213182086]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-03-26T16:52:30.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:52:30 smithi064 ceph-mon[34420]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail 2024-03-26T16:52:31.369 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:52:31 smithi149 ceph-mon[34678]: from='osd.6 [v2:172.21.15.149:6808/3213182086,v1:172.21.15.149:6809/3213182086]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-03-26T16:52:31.369 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:52:31 smithi149 ceph-mon[34678]: osdmap e44: 7 total, 6 up, 7 in 2024-03-26T16:52:31.370 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:52:31 smithi149 ceph-mon[34678]: from='osd.6 [v2:172.21.15.149:6808/3213182086,v1:172.21.15.149:6809/3213182086]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi149", "root=default"]} : dispatch 2024-03-26T16:52:31.370 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:52:31 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-03-26T16:52:31.370 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:52:31 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:52:31.370 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:52:31 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:52:31.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:52:31 smithi064 ceph-mon[34420]: from='osd.6 [v2:172.21.15.149:6808/3213182086,v1:172.21.15.149:6809/3213182086]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-03-26T16:52:31.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:52:31 smithi064 ceph-mon[34420]: osdmap e44: 7 total, 6 up, 7 in 2024-03-26T16:52:31.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:52:31 smithi064 ceph-mon[34420]: from='osd.6 [v2:172.21.15.149:6808/3213182086,v1:172.21.15.149:6809/3213182086]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi149", "root=default"]} : dispatch 2024-03-26T16:52:31.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:52:31 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-03-26T16:52:31.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:52:31 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:52:31.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:52:31 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:52:31.766 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:52:31 smithi044 ceph-mon[30624]: from='osd.6 [v2:172.21.15.149:6808/3213182086,v1:172.21.15.149:6809/3213182086]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-03-26T16:52:31.766 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:52:31 smithi044 ceph-mon[30624]: osdmap e44: 7 total, 6 up, 7 in 2024-03-26T16:52:31.766 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:52:31 smithi044 ceph-mon[30624]: from='osd.6 [v2:172.21.15.149:6808/3213182086,v1:172.21.15.149:6809/3213182086]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi149", "root=default"]} : dispatch 2024-03-26T16:52:31.766 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:52:31 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-03-26T16:52:31.767 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:52:31 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:52:31.767 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:52:31 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:52:31.897 INFO:journalctl@ceph.osd.6.smithi149.stdout:Mar 26 16:52:31 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-6[44855]: 2024-03-26T16:52:31.713+0000 7ffbc84c9700 -1 osd.6 0 waiting for initial osdmap 2024-03-26T16:52:31.897 INFO:journalctl@ceph.osd.6.smithi149.stdout:Mar 26 16:52:31 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-6[44855]: 2024-03-26T16:52:31.721+0000 7ffbc02b4700 -1 osd.6 45 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-26T16:52:32.206 INFO:teuthology.orchestra.run.smithi149.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-03-26T16:52:32.207 INFO:teuthology.orchestra.run.smithi149.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-03-26T16:52:32.207 INFO:teuthology.orchestra.run.smithi149.stderr: stderr: 10+0 records in 2024-03-26T16:52:32.207 INFO:teuthology.orchestra.run.smithi149.stderr:10+0 records out 2024-03-26T16:52:32.207 INFO:teuthology.orchestra.run.smithi149.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0125023 s, 839 MB/s 2024-03-26T16:52:32.207 INFO:teuthology.orchestra.run.smithi149.stderr:--> Zapping successful for: 2024-03-26T16:52:32.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:52:32 smithi064 ceph-mon[34420]: from='osd.6 [v2:172.21.15.149:6808/3213182086,v1:172.21.15.149:6809/3213182086]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi149", "root=default"]}]': finished 2024-03-26T16:52:32.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:52:32 smithi064 ceph-mon[34420]: osdmap e45: 7 total, 6 up, 7 in 2024-03-26T16:52:32.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:52:32 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-03-26T16:52:32.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:52:32 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-03-26T16:52:32.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:52:32 smithi064 ceph-mon[34420]: from='osd.6 [v2:172.21.15.149:6808/3213182086,v1:172.21.15.149:6809/3213182086]' entity='osd.6' 2024-03-26T16:52:32.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:52:32 smithi064 ceph-mon[34420]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail 2024-03-26T16:52:32.557 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:52:32 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-03-26T16:52:32.647 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:52:32 smithi149 ceph-mon[34678]: from='osd.6 [v2:172.21.15.149:6808/3213182086,v1:172.21.15.149:6809/3213182086]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi149", "root=default"]}]': finished 2024-03-26T16:52:32.647 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:52:32 smithi149 ceph-mon[34678]: osdmap e45: 7 total, 6 up, 7 in 2024-03-26T16:52:32.647 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:52:32 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-03-26T16:52:32.647 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:52:32 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-03-26T16:52:32.647 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:52:32 smithi149 ceph-mon[34678]: from='osd.6 [v2:172.21.15.149:6808/3213182086,v1:172.21.15.149:6809/3213182086]' entity='osd.6' 2024-03-26T16:52:32.647 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:52:32 smithi149 ceph-mon[34678]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail 2024-03-26T16:52:32.647 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:52:32 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-03-26T16:52:32.766 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:52:32 smithi044 ceph-mon[30624]: from='osd.6 [v2:172.21.15.149:6808/3213182086,v1:172.21.15.149:6809/3213182086]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi149", "root=default"]}]': finished 2024-03-26T16:52:32.766 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:52:32 smithi044 ceph-mon[30624]: osdmap e45: 7 total, 6 up, 7 in 2024-03-26T16:52:32.766 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:52:32 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-03-26T16:52:32.766 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:52:32 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-03-26T16:52:32.766 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:52:32 smithi044 ceph-mon[30624]: from='osd.6 [v2:172.21.15.149:6808/3213182086,v1:172.21.15.149:6809/3213182086]' entity='osd.6' 2024-03-26T16:52:32.766 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:52:32 smithi044 ceph-mon[30624]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail 2024-03-26T16:52:32.766 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:52:32 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-03-26T16:52:32.955 DEBUG:teuthology.orchestra.run.smithi149:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bf9505fb569e9b95a78f9700ed8c4bd20508ef55 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4394d798-eb90-11ee-95d0-87774f69a715 -- ceph orch daemon add osd smithi149:vg_nvme/lv_2 2024-03-26T16:52:33.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:52:33 smithi064 ceph-mon[34420]: purged_snaps scrub starts 2024-03-26T16:52:33.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:52:33 smithi064 ceph-mon[34420]: purged_snaps scrub ok 2024-03-26T16:52:33.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:52:33 smithi064 ceph-mon[34420]: osd.6 [v2:172.21.15.149:6808/3213182086,v1:172.21.15.149:6809/3213182086] boot 2024-03-26T16:52:33.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:52:33 smithi064 ceph-mon[34420]: osdmap e46: 7 total, 7 up, 7 in 2024-03-26T16:52:33.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:52:33 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-03-26T16:52:33.623 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:52:33 smithi149 ceph-mon[34678]: purged_snaps scrub starts 2024-03-26T16:52:33.623 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:52:33 smithi149 ceph-mon[34678]: purged_snaps scrub ok 2024-03-26T16:52:33.623 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:52:33 smithi149 ceph-mon[34678]: osd.6 [v2:172.21.15.149:6808/3213182086,v1:172.21.15.149:6809/3213182086] boot 2024-03-26T16:52:33.623 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:52:33 smithi149 ceph-mon[34678]: osdmap e46: 7 total, 7 up, 7 in 2024-03-26T16:52:33.623 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:52:33 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-03-26T16:52:33.766 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:52:33 smithi044 ceph-mon[30624]: purged_snaps scrub starts 2024-03-26T16:52:33.766 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:52:33 smithi044 ceph-mon[30624]: purged_snaps scrub ok 2024-03-26T16:52:33.766 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:52:33 smithi044 ceph-mon[30624]: osd.6 [v2:172.21.15.149:6808/3213182086,v1:172.21.15.149:6809/3213182086] boot 2024-03-26T16:52:33.766 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:52:33 smithi044 ceph-mon[30624]: osdmap e46: 7 total, 7 up, 7 in 2024-03-26T16:52:33.766 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:52:33 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-03-26T16:52:34.172 INFO:teuthology.orchestra.run.smithi149.stderr:Inferring config /var/lib/ceph/4394d798-eb90-11ee-95d0-87774f69a715/mon.c/config 2024-03-26T16:52:34.821 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:52:34 smithi149 ceph-mon[34678]: osdmap e47: 7 total, 7 up, 7 in 2024-03-26T16:52:34.822 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:52:34 smithi149 ceph-mon[34678]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 626 GiB / 626 GiB avail 2024-03-26T16:52:35.016 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:52:34 smithi044 ceph-mon[30624]: osdmap e47: 7 total, 7 up, 7 in 2024-03-26T16:52:35.016 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:52:34 smithi044 ceph-mon[30624]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 626 GiB / 626 GiB avail 2024-03-26T16:52:35.056 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:52:34 smithi064 ceph-mon[34420]: osdmap e47: 7 total, 7 up, 7 in 2024-03-26T16:52:35.056 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:52:34 smithi064 ceph-mon[34420]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 626 GiB / 626 GiB avail 2024-03-26T16:52:36.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:52:36 smithi149 ceph-mon[34678]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 626 GiB / 626 GiB avail 2024-03-26T16:52:36.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:52:36 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-03-26T16:52:36.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:52:36 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-03-26T16:52:36.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:52:36 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T16:52:36.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:52:36 smithi044 ceph-mon[30624]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 626 GiB / 626 GiB avail 2024-03-26T16:52:36.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:52:36 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-03-26T16:52:36.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:52:36 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-03-26T16:52:36.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:52:36 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T16:52:36.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:52:36 smithi064 ceph-mon[34420]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 626 GiB / 626 GiB avail 2024-03-26T16:52:36.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:52:36 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-03-26T16:52:36.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:52:36 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-03-26T16:52:36.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:52:36 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T16:52:37.337 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:52:37 smithi149 ceph-mon[34678]: from='client.24250 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi149:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-03-26T16:52:37.337 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:52:37 smithi149 ceph-mon[34678]: Detected new or changed devices on smithi149 2024-03-26T16:52:37.337 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:52:37 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:52:37.337 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:52:37 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:52:37.337 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:52:37 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-03-26T16:52:37.337 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:52:37 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-03-26T16:52:37.338 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:52:37 smithi149 ceph-mon[34678]: Adjusting osd_memory_target on smithi149 to 4956M 2024-03-26T16:52:37.338 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:52:37 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:52:37.338 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:52:37 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T16:52:37.338 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:52:37 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-26T16:52:37.338 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:52:37 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:52:37.338 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:52:37 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-26T16:52:37.338 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:52:37 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T16:52:37.338 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:52:37 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-26T16:52:37.338 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:52:37 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:52:37.766 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:52:37 smithi044 ceph-mon[30624]: from='client.24250 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi149:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-03-26T16:52:37.766 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:52:37 smithi044 ceph-mon[30624]: Detected new or changed devices on smithi149 2024-03-26T16:52:37.766 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:52:37 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:52:37.766 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:52:37 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:52:37.766 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:52:37 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-03-26T16:52:37.766 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:52:37 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-03-26T16:52:37.766 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:52:37 smithi044 ceph-mon[30624]: Adjusting osd_memory_target on smithi149 to 4956M 2024-03-26T16:52:37.766 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:52:37 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:52:37.767 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:52:37 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T16:52:37.767 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:52:37 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-26T16:52:37.767 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:52:37 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:52:37.767 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:52:37 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-26T16:52:37.767 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:52:37 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T16:52:37.767 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:52:37 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-26T16:52:37.767 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:52:37 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:52:37.806 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:52:37 smithi064 ceph-mon[34420]: from='client.24250 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi149:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-03-26T16:52:37.806 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:52:37 smithi064 ceph-mon[34420]: Detected new or changed devices on smithi149 2024-03-26T16:52:37.806 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:52:37 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:52:37.806 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:52:37 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:52:37.806 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:52:37 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-03-26T16:52:37.806 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:52:37 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-03-26T16:52:37.807 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:52:37 smithi064 ceph-mon[34420]: Adjusting osd_memory_target on smithi149 to 4956M 2024-03-26T16:52:37.807 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:52:37 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:52:37.807 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:52:37 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T16:52:37.807 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:52:37 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-26T16:52:37.807 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:52:37 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:52:37.807 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:52:37 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-26T16:52:37.807 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:52:37 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T16:52:37.807 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:52:37 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-26T16:52:37.807 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:52:37 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:52:38.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:52:38 smithi149 ceph-mon[34678]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 626 GiB / 626 GiB avail 2024-03-26T16:52:38.765 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:52:38 smithi044 ceph-mon[30624]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 626 GiB / 626 GiB avail 2024-03-26T16:52:38.806 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:52:38 smithi064 ceph-mon[34420]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 626 GiB / 626 GiB avail 2024-03-26T16:52:39.647 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:52:39 smithi149 ceph-mon[34678]: from='client.? 172.21.15.149:0/34742872' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "8cef311e-cb4b-486f-8b5e-e22613da5e3e"} : dispatch 2024-03-26T16:52:39.647 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:52:39 smithi149 ceph-mon[34678]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "8cef311e-cb4b-486f-8b5e-e22613da5e3e"} : dispatch 2024-03-26T16:52:39.647 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:52:39 smithi149 ceph-mon[34678]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8cef311e-cb4b-486f-8b5e-e22613da5e3e"}]': finished 2024-03-26T16:52:39.647 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:52:39 smithi149 ceph-mon[34678]: osdmap e48: 8 total, 7 up, 8 in 2024-03-26T16:52:39.647 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:52:39 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-03-26T16:52:39.765 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:52:39 smithi044 ceph-mon[30624]: from='client.? 172.21.15.149:0/34742872' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "8cef311e-cb4b-486f-8b5e-e22613da5e3e"} : dispatch 2024-03-26T16:52:39.766 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:52:39 smithi044 ceph-mon[30624]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "8cef311e-cb4b-486f-8b5e-e22613da5e3e"} : dispatch 2024-03-26T16:52:39.766 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:52:39 smithi044 ceph-mon[30624]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8cef311e-cb4b-486f-8b5e-e22613da5e3e"}]': finished 2024-03-26T16:52:39.766 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:52:39 smithi044 ceph-mon[30624]: osdmap e48: 8 total, 7 up, 8 in 2024-03-26T16:52:39.766 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:52:39 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-03-26T16:52:39.806 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:52:39 smithi064 ceph-mon[34420]: from='client.? 172.21.15.149:0/34742872' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "8cef311e-cb4b-486f-8b5e-e22613da5e3e"} : dispatch 2024-03-26T16:52:39.806 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:52:39 smithi064 ceph-mon[34420]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "8cef311e-cb4b-486f-8b5e-e22613da5e3e"} : dispatch 2024-03-26T16:52:39.806 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:52:39 smithi064 ceph-mon[34420]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8cef311e-cb4b-486f-8b5e-e22613da5e3e"}]': finished 2024-03-26T16:52:39.806 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:52:39 smithi064 ceph-mon[34420]: osdmap e48: 8 total, 7 up, 8 in 2024-03-26T16:52:39.806 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:52:39 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-03-26T16:52:40.647 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:52:40 smithi149 ceph-mon[34678]: from='client.? 172.21.15.149:0/3887313675' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-03-26T16:52:40.647 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:52:40 smithi149 ceph-mon[34678]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 626 GiB / 626 GiB avail 2024-03-26T16:52:40.707 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:52:40 smithi064 ceph-mon[34420]: from='client.? 172.21.15.149:0/3887313675' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-03-26T16:52:40.707 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:52:40 smithi064 ceph-mon[34420]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 626 GiB / 626 GiB avail 2024-03-26T16:52:40.765 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:52:40 smithi044 ceph-mon[30624]: from='client.? 172.21.15.149:0/3887313675' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-03-26T16:52:40.766 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:52:40 smithi044 ceph-mon[30624]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 626 GiB / 626 GiB avail 2024-03-26T16:52:42.288 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:52:42 smithi149 ceph-mon[34678]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 626 GiB / 626 GiB avail 2024-03-26T16:52:42.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:52:42 smithi044 ceph-mon[30624]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 626 GiB / 626 GiB avail 2024-03-26T16:52:42.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:52:42 smithi064 ceph-mon[34420]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 626 GiB / 626 GiB avail 2024-03-26T16:52:44.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:52:44 smithi149 ceph-mon[34678]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 626 GiB / 626 GiB avail 2024-03-26T16:52:44.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:52:44 smithi044 ceph-mon[30624]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 626 GiB / 626 GiB avail 2024-03-26T16:52:44.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:52:44 smithi064 ceph-mon[34420]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 626 GiB / 626 GiB avail 2024-03-26T16:52:45.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:52:45 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2024-03-26T16:52:45.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:52:45 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T16:52:45.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:52:45 smithi149 ceph-mon[34678]: Deploying daemon osd.7 on smithi149 2024-03-26T16:52:45.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:52:45 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2024-03-26T16:52:45.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:52:45 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T16:52:45.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:52:45 smithi044 ceph-mon[30624]: Deploying daemon osd.7 on smithi149 2024-03-26T16:52:45.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:52:45 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2024-03-26T16:52:45.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:52:45 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T16:52:45.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:52:45 smithi064 ceph-mon[34420]: Deploying daemon osd.7 on smithi149 2024-03-26T16:52:46.390 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:52:46 smithi149 ceph-mon[34678]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 626 GiB / 626 GiB avail 2024-03-26T16:52:46.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:52:46 smithi044 ceph-mon[30624]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 626 GiB / 626 GiB avail 2024-03-26T16:52:46.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:52:46 smithi064 ceph-mon[34420]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 626 GiB / 626 GiB avail 2024-03-26T16:52:48.410 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:52:48 smithi149 ceph-mon[34678]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 626 GiB / 626 GiB avail 2024-03-26T16:52:48.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:52:48 smithi044 ceph-mon[30624]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 626 GiB / 626 GiB avail 2024-03-26T16:52:48.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:52:48 smithi064 ceph-mon[34420]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 626 GiB / 626 GiB avail 2024-03-26T16:52:50.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:52:50 smithi044 ceph-mon[30624]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 626 GiB / 626 GiB avail 2024-03-26T16:52:50.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:52:50 smithi064 ceph-mon[34420]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 626 GiB / 626 GiB avail 2024-03-26T16:52:50.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:52:50 smithi149 ceph-mon[34678]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 626 GiB / 626 GiB avail 2024-03-26T16:52:51.765 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:52:51 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:52:51.766 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:52:51 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:52:51.766 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:52:51 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-26T16:52:51.806 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:52:51 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:52:51.806 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:52:51 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:52:51.806 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:52:51 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-26T16:52:51.896 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:52:51 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:52:51.896 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:52:51 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:52:51.896 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:52:51 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-26T16:52:52.765 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:52:52 smithi044 ceph-mon[30624]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 626 GiB / 626 GiB avail 2024-03-26T16:52:52.805 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:52:52 smithi064 ceph-mon[34420]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 626 GiB / 626 GiB avail 2024-03-26T16:52:52.873 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:52:52 smithi149 ceph-mon[34678]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 626 GiB / 626 GiB avail 2024-03-26T16:52:54.142 INFO:teuthology.orchestra.run.smithi149.stdout:Created osd(s) 7 on host 'smithi149' 2024-03-26T16:52:54.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:52:54 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:52:54.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:52:54 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:52:54.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:52:54 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T16:52:54.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:52:54 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-26T16:52:54.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:52:54 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:52:54.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:52:54 smithi149 ceph-mon[34678]: from='osd.7 [v2:172.21.15.149:6816/2237384325,v1:172.21.15.149:6817/2237384325]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-03-26T16:52:54.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:52:54 smithi149 ceph-mon[34678]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-03-26T16:52:54.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:52:54 smithi149 ceph-mon[34678]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 626 GiB / 626 GiB avail 2024-03-26T16:52:54.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:52:54 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:52:54.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:52:54 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:52:54.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:52:54 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-26T16:52:54.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:52:54 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:52:54.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:52:54 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:52:54.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:52:54 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T16:52:54.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:52:54 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-26T16:52:54.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:52:54 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:52:54.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:52:54 smithi044 ceph-mon[30624]: from='osd.7 [v2:172.21.15.149:6816/2237384325,v1:172.21.15.149:6817/2237384325]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-03-26T16:52:54.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:52:54 smithi044 ceph-mon[30624]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-03-26T16:52:54.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:52:54 smithi044 ceph-mon[30624]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 626 GiB / 626 GiB avail 2024-03-26T16:52:54.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:52:54 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:52:54.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:52:54 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:52:54.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:52:54 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-26T16:52:54.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:52:54 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:52:54.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:52:54 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:52:54.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:52:54 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T16:52:54.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:52:54 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-26T16:52:54.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:52:54 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:52:54.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:52:54 smithi064 ceph-mon[34420]: from='osd.7 [v2:172.21.15.149:6816/2237384325,v1:172.21.15.149:6817/2237384325]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-03-26T16:52:54.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:52:54 smithi064 ceph-mon[34420]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-03-26T16:52:54.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:52:54 smithi064 ceph-mon[34420]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 626 GiB / 626 GiB avail 2024-03-26T16:52:54.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:52:54 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:52:54.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:52:54 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:52:54.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:52:54 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-26T16:52:54.756 DEBUG:teuthology.orchestra.run.smithi149:osd.7> sudo journalctl -f -n 0 -u ceph-4394d798-eb90-11ee-95d0-87774f69a715@osd.7.service 2024-03-26T16:52:54.759 INFO:tasks.cephadm:Waiting for 8 OSDs to come up... 2024-03-26T16:52:54.759 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bf9505fb569e9b95a78f9700ed8c4bd20508ef55 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4394d798-eb90-11ee-95d0-87774f69a715 -- ceph osd stat -f json 2024-03-26T16:52:55.014 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/4394d798-eb90-11ee-95d0-87774f69a715/mon.a/config 2024-03-26T16:52:55.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:52:55 smithi149 ceph-mon[34678]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-03-26T16:52:55.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:52:55 smithi149 ceph-mon[34678]: from='osd.7 [v2:172.21.15.149:6816/2237384325,v1:172.21.15.149:6817/2237384325]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi149", "root=default"]} : dispatch 2024-03-26T16:52:55.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:52:55 smithi149 ceph-mon[34678]: osdmap e49: 8 total, 7 up, 8 in 2024-03-26T16:52:55.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:52:55 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-03-26T16:52:55.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:52:55 smithi149 ceph-mon[34678]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi149", "root=default"]} : dispatch 2024-03-26T16:52:55.397 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 26 16:52:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-7[50917]: 2024-03-26T16:52:55.273+0000 7f68c6c37700 -1 osd.7 0 waiting for initial osdmap 2024-03-26T16:52:55.397 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 26 16:52:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-7[50917]: 2024-03-26T16:52:55.280+0000 7f68c2a2a700 -1 osd.7 50 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-26T16:52:55.438 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:52:55 smithi044 ceph-mon[30624]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-03-26T16:52:55.438 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:52:55 smithi044 ceph-mon[30624]: from='osd.7 [v2:172.21.15.149:6816/2237384325,v1:172.21.15.149:6817/2237384325]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi149", "root=default"]} : dispatch 2024-03-26T16:52:55.438 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:52:55 smithi044 ceph-mon[30624]: osdmap e49: 8 total, 7 up, 8 in 2024-03-26T16:52:55.438 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:52:55 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-03-26T16:52:55.438 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:52:55 smithi044 ceph-mon[30624]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi149", "root=default"]} : dispatch 2024-03-26T16:52:55.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:52:55 smithi064 ceph-mon[34420]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-03-26T16:52:55.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:52:55 smithi064 ceph-mon[34420]: from='osd.7 [v2:172.21.15.149:6816/2237384325,v1:172.21.15.149:6817/2237384325]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi149", "root=default"]} : dispatch 2024-03-26T16:52:55.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:52:55 smithi064 ceph-mon[34420]: osdmap e49: 8 total, 7 up, 8 in 2024-03-26T16:52:55.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:52:55 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-03-26T16:52:55.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:52:55 smithi064 ceph-mon[34420]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi149", "root=default"]} : dispatch 2024-03-26T16:52:56.500 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:52:56 smithi044 ceph-mon[30624]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi149", "root=default"]}]': finished 2024-03-26T16:52:56.500 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:52:56 smithi044 ceph-mon[30624]: osdmap e50: 8 total, 7 up, 8 in 2024-03-26T16:52:56.500 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:52:56 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-03-26T16:52:56.500 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:52:56 smithi044 ceph-mon[30624]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 194 MiB used, 626 GiB / 626 GiB avail 2024-03-26T16:52:56.500 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:52:56 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-03-26T16:52:56.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:52:56 smithi064 ceph-mon[34420]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi149", "root=default"]}]': finished 2024-03-26T16:52:56.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:52:56 smithi064 ceph-mon[34420]: osdmap e50: 8 total, 7 up, 8 in 2024-03-26T16:52:56.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:52:56 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-03-26T16:52:56.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:52:56 smithi064 ceph-mon[34420]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 194 MiB used, 626 GiB / 626 GiB avail 2024-03-26T16:52:56.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:52:56 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-03-26T16:52:56.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:52:56 smithi149 ceph-mon[34678]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi149", "root=default"]}]': finished 2024-03-26T16:52:56.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:52:56 smithi149 ceph-mon[34678]: osdmap e50: 8 total, 7 up, 8 in 2024-03-26T16:52:56.647 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:52:56 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-03-26T16:52:56.647 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:52:56 smithi149 ceph-mon[34678]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 194 MiB used, 626 GiB / 626 GiB avail 2024-03-26T16:52:56.647 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:52:56 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-03-26T16:52:57.102 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-26T16:52:57.389 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:52:57 smithi044 ceph-mon[30624]: purged_snaps scrub starts 2024-03-26T16:52:57.389 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:52:57 smithi044 ceph-mon[30624]: purged_snaps scrub ok 2024-03-26T16:52:57.390 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:52:57 smithi044 ceph-mon[30624]: osd.7 [v2:172.21.15.149:6816/2237384325,v1:172.21.15.149:6817/2237384325] boot 2024-03-26T16:52:57.390 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:52:57 smithi044 ceph-mon[30624]: osdmap e51: 8 total, 8 up, 8 in 2024-03-26T16:52:57.390 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:52:57 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-03-26T16:52:57.390 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:52:57 smithi044 ceph-mon[30624]: from='client.? 172.21.15.44:0/970552918' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-03-26T16:52:57.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:52:57 smithi064 ceph-mon[34420]: purged_snaps scrub starts 2024-03-26T16:52:57.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:52:57 smithi064 ceph-mon[34420]: purged_snaps scrub ok 2024-03-26T16:52:57.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:52:57 smithi064 ceph-mon[34420]: osd.7 [v2:172.21.15.149:6816/2237384325,v1:172.21.15.149:6817/2237384325] boot 2024-03-26T16:52:57.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:52:57 smithi064 ceph-mon[34420]: osdmap e51: 8 total, 8 up, 8 in 2024-03-26T16:52:57.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:52:57 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-03-26T16:52:57.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:52:57 smithi064 ceph-mon[34420]: from='client.? 172.21.15.44:0/970552918' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-03-26T16:52:57.585 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:52:57 smithi149 ceph-mon[34678]: purged_snaps scrub starts 2024-03-26T16:52:57.585 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:52:57 smithi149 ceph-mon[34678]: purged_snaps scrub ok 2024-03-26T16:52:57.585 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:52:57 smithi149 ceph-mon[34678]: osd.7 [v2:172.21.15.149:6816/2237384325,v1:172.21.15.149:6817/2237384325] boot 2024-03-26T16:52:57.585 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:52:57 smithi149 ceph-mon[34678]: osdmap e51: 8 total, 8 up, 8 in 2024-03-26T16:52:57.585 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:52:57 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-03-26T16:52:57.585 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:52:57 smithi149 ceph-mon[34678]: from='client.? 172.21.15.44:0/970552918' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-03-26T16:52:57.950 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":51,"num_osds":8,"num_up_osds":8,"osd_up_since":1711471976,"num_in_osds":8,"osd_in_since":1711471958,"num_remapped_pgs":0} 2024-03-26T16:52:57.950 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bf9505fb569e9b95a78f9700ed8c4bd20508ef55 shell --fsid 4394d798-eb90-11ee-95d0-87774f69a715 -- ceph osd dump --format=json 2024-03-26T16:52:58.194 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/4394d798-eb90-11ee-95d0-87774f69a715/mon.a/config 2024-03-26T16:52:58.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:52:58 smithi064 ceph-mon[34420]: osdmap e52: 8 total, 8 up, 8 in 2024-03-26T16:52:58.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:52:58 smithi064 ceph-mon[34420]: Detected new or changed devices on smithi149 2024-03-26T16:52:58.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:52:58 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:52:58.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:52:58 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:52:58.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:52:58 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-03-26T16:52:58.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:52:58 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-03-26T16:52:58.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:52:58 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-03-26T16:52:58.557 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:52:58 smithi064 ceph-mon[34420]: Adjusting osd_memory_target on smithi149 to 3304M 2024-03-26T16:52:58.557 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:52:58 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:52:58.557 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:52:58 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T16:52:58.557 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:52:58 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-26T16:52:58.557 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:52:58 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:52:58.557 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:52:58 smithi064 ceph-mon[34420]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 220 MiB used, 715 GiB / 715 GiB avail 2024-03-26T16:52:58.584 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:52:58 smithi044 ceph-mon[30624]: osdmap e52: 8 total, 8 up, 8 in 2024-03-26T16:52:58.585 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:52:58 smithi044 ceph-mon[30624]: Detected new or changed devices on smithi149 2024-03-26T16:52:58.585 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:52:58 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:52:58.585 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:52:58 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:52:58.585 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:52:58 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-03-26T16:52:58.585 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:52:58 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-03-26T16:52:58.585 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:52:58 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-03-26T16:52:58.585 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:52:58 smithi044 ceph-mon[30624]: Adjusting osd_memory_target on smithi149 to 3304M 2024-03-26T16:52:58.585 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:52:58 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:52:58.585 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:52:58 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T16:52:58.585 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:52:58 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-26T16:52:58.585 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:52:58 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:52:58.585 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:52:58 smithi044 ceph-mon[30624]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 220 MiB used, 715 GiB / 715 GiB avail 2024-03-26T16:52:58.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:52:58 smithi149 ceph-mon[34678]: osdmap e52: 8 total, 8 up, 8 in 2024-03-26T16:52:58.647 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:52:58 smithi149 ceph-mon[34678]: Detected new or changed devices on smithi149 2024-03-26T16:52:58.647 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:52:58 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:52:58.647 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:52:58 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:52:58.647 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:52:58 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-03-26T16:52:58.647 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:52:58 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-03-26T16:52:58.647 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:52:58 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-03-26T16:52:58.647 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:52:58 smithi149 ceph-mon[34678]: Adjusting osd_memory_target on smithi149 to 3304M 2024-03-26T16:52:58.647 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:52:58 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:52:58.647 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:52:58 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T16:52:58.647 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:52:58 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-26T16:52:58.647 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:52:58 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:52:58.647 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:52:58 smithi149 ceph-mon[34678]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 220 MiB used, 715 GiB / 715 GiB avail 2024-03-26T16:53:00.273 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-26T16:53:00.273 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":52,"fsid":"4394d798-eb90-11ee-95d0-87774f69a715","created":"2024-03-26T16:47:21.867879+0000","modified":"2024-03-26T16:52:57.283141+0000","last_up_change":"2024-03-26T16:52:56.277385+0000","last_in_change":"2024-03-26T16:52:38.769811+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-26T16:50:56.104612+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":7.8899998664855957,"score_stable":7.8899998664855957,"optimal_score":0.37999999523162842,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"89074398-09bf-48a6-bb1c-4952b3ee8da4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":2121774261},{"type":"v1","addr":"172.21.15.44:6803","nonce":2121774261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":2121774261},{"type":"v1","addr":"172.21.15.44:6805","nonce":2121774261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":2121774261},{"type":"v1","addr":"172.21.15.44:6809","nonce":2121774261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":2121774261},{"type":"v1","addr":"172.21.15.44:6807","nonce":2121774261}]},"public_addr":"172.21.15.44:6803/2121774261","cluster_addr":"172.21.15.44:6805/2121774261","heartbeat_back_addr":"172.21.15.44:6809/2121774261","heartbeat_front_addr":"172.21.15.44:6807/2121774261","state":["exists","up"]},{"osd":1,"uuid":"1526e135-9bdd-489d-aed8-d8a17f5362f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":3203140205},{"type":"v1","addr":"172.21.15.44:6811","nonce":3203140205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":3203140205},{"type":"v1","addr":"172.21.15.44:6813","nonce":3203140205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":3203140205},{"type":"v1","addr":"172.21.15.44:6817","nonce":3203140205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":3203140205},{"type":"v1","addr":"172.21.15.44:6815","nonce":3203140205}]},"public_addr":"172.21.15.44:6811/3203140205","cluster_addr":"172.21.15.44:6813/3203140205","heartbeat_back_addr":"172.21.15.44:6817/3203140205","heartbeat_front_addr":"172.21.15.44:6815/3203140205","state":["exists","up"]},{"osd":2,"uuid":"c3dc5acf-f6fc-41c0-b9cb-975ae5995ad4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":1712901412},{"type":"v1","addr":"172.21.15.64:6801","nonce":1712901412}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":1712901412},{"type":"v1","addr":"172.21.15.64:6803","nonce":1712901412}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":1712901412},{"type":"v1","addr":"172.21.15.64:6807","nonce":1712901412}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":1712901412},{"type":"v1","addr":"172.21.15.64:6805","nonce":1712901412}]},"public_addr":"172.21.15.64:6801/1712901412","cluster_addr":"172.21.15.64:6803/1712901412","heartbeat_back_addr":"172.21.15.64:6807/1712901412","heartbeat_front_addr":"172.21.15.64:6805/1712901412","state":["exists","up"]},{"osd":3,"uuid":"635e55a9-5ed3-43aa-bb66-c324f142be3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":3087353302},{"type":"v1","addr":"172.21.15.64:6809","nonce":3087353302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":3087353302},{"type":"v1","addr":"172.21.15.64:6811","nonce":3087353302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6814","nonce":3087353302},{"type":"v1","addr":"172.21.15.64:6815","nonce":3087353302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":3087353302},{"type":"v1","addr":"172.21.15.64:6813","nonce":3087353302}]},"public_addr":"172.21.15.64:6809/3087353302","cluster_addr":"172.21.15.64:6811/3087353302","heartbeat_back_addr":"172.21.15.64:6815/3087353302","heartbeat_front_addr":"172.21.15.64:6813/3087353302","state":["exists","up"]},{"osd":4,"uuid":"8e3eecc3-6735-4c31-8884-48235f3aa539","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":3738404540},{"type":"v1","addr":"172.21.15.64:6817","nonce":3738404540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":3738404540},{"type":"v1","addr":"172.21.15.64:6819","nonce":3738404540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":3738404540},{"type":"v1","addr":"172.21.15.64:6823","nonce":3738404540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":3738404540},{"type":"v1","addr":"172.21.15.64:6821","nonce":3738404540}]},"public_addr":"172.21.15.64:6817/3738404540","cluster_addr":"172.21.15.64:6819/3738404540","heartbeat_back_addr":"172.21.15.64:6823/3738404540","heartbeat_front_addr":"172.21.15.64:6821/3738404540","state":["exists","up"]},{"osd":5,"uuid":"5eb3453c-e95d-4876-8c76-d323da294fd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":2605923055},{"type":"v1","addr":"172.21.15.149:6801","nonce":2605923055}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":2605923055},{"type":"v1","addr":"172.21.15.149:6803","nonce":2605923055}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":2605923055},{"type":"v1","addr":"172.21.15.149:6807","nonce":2605923055}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":2605923055},{"type":"v1","addr":"172.21.15.149:6805","nonce":2605923055}]},"public_addr":"172.21.15.149:6801/2605923055","cluster_addr":"172.21.15.149:6803/2605923055","heartbeat_back_addr":"172.21.15.149:6807/2605923055","heartbeat_front_addr":"172.21.15.149:6805/2605923055","state":["exists","up"]},{"osd":6,"uuid":"812e8cbf-eb38-480a-bbb8-a12dd5c6dc36","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":3213182086},{"type":"v1","addr":"172.21.15.149:6809","nonce":3213182086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":3213182086},{"type":"v1","addr":"172.21.15.149:6811","nonce":3213182086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":3213182086},{"type":"v1","addr":"172.21.15.149:6815","nonce":3213182086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":3213182086},{"type":"v1","addr":"172.21.15.149:6813","nonce":3213182086}]},"public_addr":"172.21.15.149:6809/3213182086","cluster_addr":"172.21.15.149:6811/3213182086","heartbeat_back_addr":"172.21.15.149:6815/3213182086","heartbeat_front_addr":"172.21.15.149:6813/3213182086","state":["exists","up"]},{"osd":7,"uuid":"8cef311e-cb4b-486f-8b5e-e22613da5e3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":2237384325},{"type":"v1","addr":"172.21.15.149:6817","nonce":2237384325}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":2237384325},{"type":"v1","addr":"172.21.15.149:6819","nonce":2237384325}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":2237384325},{"type":"v1","addr":"172.21.15.149:6823","nonce":2237384325}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":2237384325},{"type":"v1","addr":"172.21.15.149:6821","nonce":2237384325}]},"public_addr":"172.21.15.149:6817/2237384325","cluster_addr":"172.21.15.149:6819/2237384325","heartbeat_back_addr":"172.21.15.149:6823/2237384325","heartbeat_front_addr":"172.21.15.149:6821/2237384325","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T16:50:05.592342+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T16:50:31.124432+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T16:50:53.951401+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T16:51:18.216988+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T16:51:43.054973+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T16:52:05.599855+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T16:52:30.303787+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T16:52:54.546961+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.44:0/3521776848":"2024-03-27T16:48:18.002290+0000","172.21.15.44:6801/2593231197":"2024-03-27T16:48:18.002290+0000","172.21.15.44:6800/3363630642":"2024-03-27T16:47:50.893281+0000","172.21.15.44:0/2302104871":"2024-03-27T16:47:50.893281+0000","172.21.15.44:0/1783950696":"2024-03-27T16:47:50.893281+0000","172.21.15.44:6801/3363630642":"2024-03-27T16:47:50.893281+0000","172.21.15.44:0/306072462":"2024-03-27T16:48:18.002290+0000","172.21.15.44:0/710097223":"2024-03-27T16:47:50.893281+0000","172.21.15.44:0/101712324":"2024-03-27T16:48:18.002290+0000","172.21.15.44:6800/2593231197":"2024-03-27T16:48:18.002290+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-26T16:53:00.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:53:00 smithi044 ceph-mon[30624]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 221 MiB used, 715 GiB / 715 GiB avail 2024-03-26T16:53:00.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:53:00 smithi064 ceph-mon[34420]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 221 MiB used, 715 GiB / 715 GiB avail 2024-03-26T16:53:00.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:53:00 smithi149 ceph-mon[34678]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 221 MiB used, 715 GiB / 715 GiB avail 2024-03-26T16:53:00.871 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-26T16:50:56.104612+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 7.889999866485596, 'score_stable': 7.889999866485596, 'optimal_score': 0.3799999952316284, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-26T16:53:00.871 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bf9505fb569e9b95a78f9700ed8c4bd20508ef55 shell --fsid 4394d798-eb90-11ee-95d0-87774f69a715 -- ceph osd pool get .mgr pg_num 2024-03-26T16:53:01.110 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/4394d798-eb90-11ee-95d0-87774f69a715/mon.a/config 2024-03-26T16:53:01.456 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:53:01 smithi044 ceph-mon[30624]: from='client.? 172.21.15.44:0/1425020789' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-03-26T16:53:01.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:53:01 smithi064 ceph-mon[34420]: from='client.? 172.21.15.44:0/1425020789' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-03-26T16:53:01.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:53:01 smithi149 ceph-mon[34678]: from='client.? 172.21.15.44:0/1425020789' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-03-26T16:53:02.445 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:53:02 smithi044 ceph-mon[30624]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 221 MiB used, 715 GiB / 715 GiB avail 2024-03-26T16:53:02.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:53:02 smithi064 ceph-mon[34420]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 221 MiB used, 715 GiB / 715 GiB avail 2024-03-26T16:53:02.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:53:02 smithi149 ceph-mon[34678]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 221 MiB used, 715 GiB / 715 GiB avail 2024-03-26T16:53:02.846 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 1 2024-03-26T16:53:03.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:53:03 smithi044 ceph-mon[30624]: from='client.? 172.21.15.44:0/4290218325' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-03-26T16:53:03.546 INFO:tasks.cephadm:Setting up client nodes... 2024-03-26T16:53:03.547 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bf9505fb569e9b95a78f9700ed8c4bd20508ef55 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4394d798-eb90-11ee-95d0-87774f69a715 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-03-26T16:53:03.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:53:03 smithi064 ceph-mon[34420]: from='client.? 172.21.15.44:0/4290218325' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-03-26T16:53:03.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:53:03 smithi149 ceph-mon[34678]: from='client.? 172.21.15.44:0/4290218325' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-03-26T16:53:03.789 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/4394d798-eb90-11ee-95d0-87774f69a715/mon.a/config 2024-03-26T16:53:04.210 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:53:04 smithi044 ceph-mon[30624]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 221 MiB used, 715 GiB / 715 GiB avail 2024-03-26T16:53:04.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:53:04 smithi064 ceph-mon[34420]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 221 MiB used, 715 GiB / 715 GiB avail 2024-03-26T16:53:04.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:53:04 smithi149 ceph-mon[34678]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 221 MiB used, 715 GiB / 715 GiB avail 2024-03-26T16:53:05.767 INFO:teuthology.orchestra.run.smithi044.stdout:[client.0] 2024-03-26T16:53:05.768 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQBx/QJmXi6iLRAAfo7V0MNfIzco4uPGrz1+pA== 2024-03-26T16:53:06.090 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:53:05 smithi044 ceph-mon[30624]: from='client.? 172.21.15.44:0/2629288081' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-03-26T16:53:06.090 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:53:05 smithi044 ceph-mon[30624]: from='client.? 172.21.15.44:0/2629288081' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-03-26T16:53:06.146 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:53:05 smithi149 ceph-mon[34678]: from='client.? 172.21.15.44:0/2629288081' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-03-26T16:53:06.146 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:53:05 smithi149 ceph-mon[34678]: from='client.? 172.21.15.44:0/2629288081' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-03-26T16:53:06.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:53:05 smithi064 ceph-mon[34420]: from='client.? 172.21.15.44:0/2629288081' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-03-26T16:53:06.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:53:05 smithi064 ceph-mon[34420]: from='client.? 172.21.15.44:0/2629288081' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-03-26T16:53:06.483 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-03-26T16:53:06.483 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-03-26T16:53:06.483 DEBUG:teuthology.orchestra.run.smithi044:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-03-26T16:53:06.528 DEBUG:teuthology.orchestra.run.smithi064:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bf9505fb569e9b95a78f9700ed8c4bd20508ef55 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4394d798-eb90-11ee-95d0-87774f69a715 -- ceph auth get-or-create client.1 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-03-26T16:53:06.778 INFO:teuthology.orchestra.run.smithi064.stderr:Inferring config /var/lib/ceph/4394d798-eb90-11ee-95d0-87774f69a715/mon.b/config 2024-03-26T16:53:07.140 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:53:06 smithi064 ceph-mon[34420]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 221 MiB used, 715 GiB / 715 GiB avail 2024-03-26T16:53:07.146 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:53:06 smithi149 ceph-mon[34678]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 221 MiB used, 715 GiB / 715 GiB avail 2024-03-26T16:53:07.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:53:06 smithi044 ceph-mon[30624]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 221 MiB used, 715 GiB / 715 GiB avail 2024-03-26T16:53:08.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:53:08 smithi044 ceph-mon[30624]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 221 MiB used, 715 GiB / 715 GiB avail 2024-03-26T16:53:08.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:53:08 smithi064 ceph-mon[34420]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 221 MiB used, 715 GiB / 715 GiB avail 2024-03-26T16:53:08.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:53:08 smithi149 ceph-mon[34678]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 221 MiB used, 715 GiB / 715 GiB avail 2024-03-26T16:53:08.648 INFO:teuthology.orchestra.run.smithi064.stdout:[client.1] 2024-03-26T16:53:08.648 INFO:teuthology.orchestra.run.smithi064.stdout: key = AQB0/QJmYX9JJhAAQ88qllsNkc2KShu3VcFj1w== 2024-03-26T16:53:09.216 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:53:09 smithi064 ceph-mon[34420]: from='client.? 172.21.15.64:0/779876254' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-03-26T16:53:09.216 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:53:09 smithi064 ceph-mon[34420]: from='client.? ' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-03-26T16:53:09.216 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:53:09 smithi064 ceph-mon[34420]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-03-26T16:53:09.245 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-03-26T16:53:09.245 DEBUG:teuthology.orchestra.run.smithi064:> sudo dd of=/etc/ceph/ceph.client.1.keyring 2024-03-26T16:53:09.245 DEBUG:teuthology.orchestra.run.smithi064:> sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-03-26T16:53:09.290 DEBUG:teuthology.orchestra.run.smithi149:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bf9505fb569e9b95a78f9700ed8c4bd20508ef55 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4394d798-eb90-11ee-95d0-87774f69a715 -- ceph auth get-or-create client.2 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-03-26T16:53:09.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:53:09 smithi044 ceph-mon[30624]: from='client.? 172.21.15.64:0/779876254' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-03-26T16:53:09.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:53:09 smithi044 ceph-mon[30624]: from='client.? ' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-03-26T16:53:09.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:53:09 smithi044 ceph-mon[30624]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-03-26T16:53:09.538 INFO:teuthology.orchestra.run.smithi149.stderr:Inferring config /var/lib/ceph/4394d798-eb90-11ee-95d0-87774f69a715/mon.c/config 2024-03-26T16:53:09.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:53:09 smithi149 ceph-mon[34678]: from='client.? 172.21.15.64:0/779876254' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-03-26T16:53:09.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:53:09 smithi149 ceph-mon[34678]: from='client.? ' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-03-26T16:53:09.647 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:53:09 smithi149 ceph-mon[34678]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-03-26T16:53:10.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:53:10 smithi149 ceph-mon[34678]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 221 MiB used, 715 GiB / 715 GiB avail 2024-03-26T16:53:10.470 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:53:10 smithi064 ceph-mon[34420]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 221 MiB used, 715 GiB / 715 GiB avail 2024-03-26T16:53:10.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:53:10 smithi044 ceph-mon[30624]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 221 MiB used, 715 GiB / 715 GiB avail 2024-03-26T16:53:11.365 INFO:teuthology.orchestra.run.smithi149.stdout:[client.2] 2024-03-26T16:53:11.371 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQB3/QJmAa98FRAABEGPUjDYuDzTmhtDATinPw== 2024-03-26T16:53:11.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:53:11 smithi149 ceph-mon[34678]: from='client.? 172.21.15.149:0/3824897483' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.2", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-03-26T16:53:11.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:53:11 smithi149 ceph-mon[34678]: from='client.? ' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.2", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-03-26T16:53:11.647 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:53:11 smithi149 ceph-mon[34678]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.2", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-03-26T16:53:11.765 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:53:11 smithi044 ceph-mon[30624]: from='client.? 172.21.15.149:0/3824897483' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.2", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-03-26T16:53:11.766 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:53:11 smithi044 ceph-mon[30624]: from='client.? ' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.2", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-03-26T16:53:11.766 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:53:11 smithi044 ceph-mon[30624]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.2", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-03-26T16:53:11.806 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:53:11 smithi064 ceph-mon[34420]: from='client.? 172.21.15.149:0/3824897483' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.2", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-03-26T16:53:11.806 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:53:11 smithi064 ceph-mon[34420]: from='client.? ' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.2", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-03-26T16:53:11.806 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:53:11 smithi064 ceph-mon[34420]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.2", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-03-26T16:53:11.973 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-03-26T16:53:11.974 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd of=/etc/ceph/ceph.client.2.keyring 2024-03-26T16:53:11.974 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-03-26T16:53:12.017 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bf9505fb569e9b95a78f9700ed8c4bd20508ef55 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4394d798-eb90-11ee-95d0-87774f69a715 -- ceph auth get-or-create client.3 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-03-26T16:53:12.254 INFO:teuthology.orchestra.run.smithi157.stderr:Inferring config /var/lib/ceph/4394d798-eb90-11ee-95d0-87774f69a715/config/ceph.conf 2024-03-26T16:53:12.765 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:53:12 smithi044 ceph-mon[30624]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 221 MiB used, 715 GiB / 715 GiB avail 2024-03-26T16:53:12.806 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:53:12 smithi064 ceph-mon[34420]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 221 MiB used, 715 GiB / 715 GiB avail 2024-03-26T16:53:12.896 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:53:12 smithi149 ceph-mon[34678]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 221 MiB used, 715 GiB / 715 GiB avail 2024-03-26T16:53:14.075 INFO:teuthology.orchestra.run.smithi157.stdout:[client.3] 2024-03-26T16:53:14.076 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQB6/QJmDjw1BBAAmP8lEsVOc8Rtx3OSldTsKg== 2024-03-26T16:53:14.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:53:14 smithi149 ceph-mon[34678]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 221 MiB used, 715 GiB / 715 GiB avail 2024-03-26T16:53:14.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:53:14 smithi149 ceph-mon[34678]: from='client.? 172.21.15.157:0/809218956' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.3", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-03-26T16:53:14.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:53:14 smithi149 ceph-mon[34678]: from='client.? ' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.3", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-03-26T16:53:14.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:53:14 smithi149 ceph-mon[34678]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.3", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-03-26T16:53:14.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:53:14 smithi044 ceph-mon[30624]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 221 MiB used, 715 GiB / 715 GiB avail 2024-03-26T16:53:14.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:53:14 smithi044 ceph-mon[30624]: from='client.? 172.21.15.157:0/809218956' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.3", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-03-26T16:53:14.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:53:14 smithi044 ceph-mon[30624]: from='client.? ' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.3", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-03-26T16:53:14.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:53:14 smithi044 ceph-mon[30624]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.3", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-03-26T16:53:14.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:53:14 smithi064 ceph-mon[34420]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 221 MiB used, 715 GiB / 715 GiB avail 2024-03-26T16:53:14.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:53:14 smithi064 ceph-mon[34420]: from='client.? 172.21.15.157:0/809218956' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.3", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-03-26T16:53:14.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:53:14 smithi064 ceph-mon[34420]: from='client.? ' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.3", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-03-26T16:53:14.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:53:14 smithi064 ceph-mon[34420]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.3", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-03-26T16:53:14.656 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-03-26T16:53:14.656 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd of=/etc/ceph/ceph.client.3.keyring 2024-03-26T16:53:14.656 DEBUG:teuthology.orchestra.run.smithi157:> sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-03-26T16:53:14.723 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-03-26T16:53:14.723 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-03-26T16:53:14.724 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bf9505fb569e9b95a78f9700ed8c4bd20508ef55 shell --fsid 4394d798-eb90-11ee-95d0-87774f69a715 -- ceph mgr dump --format=json 2024-03-26T16:53:14.972 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/4394d798-eb90-11ee-95d0-87774f69a715/mon.a/config 2024-03-26T16:53:16.403 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:53:16 smithi044 ceph-mon[30624]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 221 MiB used, 715 GiB / 715 GiB avail 2024-03-26T16:53:16.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:53:16 smithi064 ceph-mon[34420]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 221 MiB used, 715 GiB / 715 GiB avail 2024-03-26T16:53:16.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:53:16 smithi149 ceph-mon[34678]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 221 MiB used, 715 GiB / 715 GiB avail 2024-03-26T16:53:16.915 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-26T16:53:17.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:53:17 smithi044 ceph-mon[30624]: from='client.? 172.21.15.44:0/3879584972' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2024-03-26T16:53:17.549 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":14,"flags":0,"active_gid":14152,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":482556308},{"type":"v1","addr":"172.21.15.44:6801","nonce":482556308}]},"active_addr":"172.21.15.44:6801/482556308","active_change":"2024-03-26T16:48:18.002405+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.44:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.44:0","nonce":3314214294}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.44:0","nonce":992935086}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.44:0","nonce":1810412850}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.44:0","nonce":2193020573}]}]} 2024-03-26T16:53:17.551 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-03-26T16:53:17.552 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-03-26T16:53:17.552 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bf9505fb569e9b95a78f9700ed8c4bd20508ef55 shell --fsid 4394d798-eb90-11ee-95d0-87774f69a715 -- ceph osd dump --format=json 2024-03-26T16:53:17.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:53:17 smithi064 ceph-mon[34420]: from='client.? 172.21.15.44:0/3879584972' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2024-03-26T16:53:17.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:53:17 smithi149 ceph-mon[34678]: from='client.? 172.21.15.44:0/3879584972' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2024-03-26T16:53:17.789 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/4394d798-eb90-11ee-95d0-87774f69a715/mon.a/config 2024-03-26T16:53:18.208 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:53:18 smithi044 ceph-mon[30624]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 221 MiB used, 715 GiB / 715 GiB avail 2024-03-26T16:53:18.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:53:18 smithi064 ceph-mon[34420]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 221 MiB used, 715 GiB / 715 GiB avail 2024-03-26T16:53:18.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:53:18 smithi149 ceph-mon[34678]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 221 MiB used, 715 GiB / 715 GiB avail 2024-03-26T16:53:19.452 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-26T16:53:19.452 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":52,"fsid":"4394d798-eb90-11ee-95d0-87774f69a715","created":"2024-03-26T16:47:21.867879+0000","modified":"2024-03-26T16:52:57.283141+0000","last_up_change":"2024-03-26T16:52:56.277385+0000","last_in_change":"2024-03-26T16:52:38.769811+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-26T16:50:56.104612+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":7.8899998664855957,"score_stable":7.8899998664855957,"optimal_score":0.37999999523162842,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"89074398-09bf-48a6-bb1c-4952b3ee8da4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":2121774261},{"type":"v1","addr":"172.21.15.44:6803","nonce":2121774261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":2121774261},{"type":"v1","addr":"172.21.15.44:6805","nonce":2121774261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":2121774261},{"type":"v1","addr":"172.21.15.44:6809","nonce":2121774261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":2121774261},{"type":"v1","addr":"172.21.15.44:6807","nonce":2121774261}]},"public_addr":"172.21.15.44:6803/2121774261","cluster_addr":"172.21.15.44:6805/2121774261","heartbeat_back_addr":"172.21.15.44:6809/2121774261","heartbeat_front_addr":"172.21.15.44:6807/2121774261","state":["exists","up"]},{"osd":1,"uuid":"1526e135-9bdd-489d-aed8-d8a17f5362f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":3203140205},{"type":"v1","addr":"172.21.15.44:6811","nonce":3203140205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":3203140205},{"type":"v1","addr":"172.21.15.44:6813","nonce":3203140205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":3203140205},{"type":"v1","addr":"172.21.15.44:6817","nonce":3203140205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":3203140205},{"type":"v1","addr":"172.21.15.44:6815","nonce":3203140205}]},"public_addr":"172.21.15.44:6811/3203140205","cluster_addr":"172.21.15.44:6813/3203140205","heartbeat_back_addr":"172.21.15.44:6817/3203140205","heartbeat_front_addr":"172.21.15.44:6815/3203140205","state":["exists","up"]},{"osd":2,"uuid":"c3dc5acf-f6fc-41c0-b9cb-975ae5995ad4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":1712901412},{"type":"v1","addr":"172.21.15.64:6801","nonce":1712901412}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":1712901412},{"type":"v1","addr":"172.21.15.64:6803","nonce":1712901412}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":1712901412},{"type":"v1","addr":"172.21.15.64:6807","nonce":1712901412}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":1712901412},{"type":"v1","addr":"172.21.15.64:6805","nonce":1712901412}]},"public_addr":"172.21.15.64:6801/1712901412","cluster_addr":"172.21.15.64:6803/1712901412","heartbeat_back_addr":"172.21.15.64:6807/1712901412","heartbeat_front_addr":"172.21.15.64:6805/1712901412","state":["exists","up"]},{"osd":3,"uuid":"635e55a9-5ed3-43aa-bb66-c324f142be3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":3087353302},{"type":"v1","addr":"172.21.15.64:6809","nonce":3087353302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":3087353302},{"type":"v1","addr":"172.21.15.64:6811","nonce":3087353302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6814","nonce":3087353302},{"type":"v1","addr":"172.21.15.64:6815","nonce":3087353302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":3087353302},{"type":"v1","addr":"172.21.15.64:6813","nonce":3087353302}]},"public_addr":"172.21.15.64:6809/3087353302","cluster_addr":"172.21.15.64:6811/3087353302","heartbeat_back_addr":"172.21.15.64:6815/3087353302","heartbeat_front_addr":"172.21.15.64:6813/3087353302","state":["exists","up"]},{"osd":4,"uuid":"8e3eecc3-6735-4c31-8884-48235f3aa539","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":3738404540},{"type":"v1","addr":"172.21.15.64:6817","nonce":3738404540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":3738404540},{"type":"v1","addr":"172.21.15.64:6819","nonce":3738404540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":3738404540},{"type":"v1","addr":"172.21.15.64:6823","nonce":3738404540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":3738404540},{"type":"v1","addr":"172.21.15.64:6821","nonce":3738404540}]},"public_addr":"172.21.15.64:6817/3738404540","cluster_addr":"172.21.15.64:6819/3738404540","heartbeat_back_addr":"172.21.15.64:6823/3738404540","heartbeat_front_addr":"172.21.15.64:6821/3738404540","state":["exists","up"]},{"osd":5,"uuid":"5eb3453c-e95d-4876-8c76-d323da294fd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":2605923055},{"type":"v1","addr":"172.21.15.149:6801","nonce":2605923055}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":2605923055},{"type":"v1","addr":"172.21.15.149:6803","nonce":2605923055}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":2605923055},{"type":"v1","addr":"172.21.15.149:6807","nonce":2605923055}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":2605923055},{"type":"v1","addr":"172.21.15.149:6805","nonce":2605923055}]},"public_addr":"172.21.15.149:6801/2605923055","cluster_addr":"172.21.15.149:6803/2605923055","heartbeat_back_addr":"172.21.15.149:6807/2605923055","heartbeat_front_addr":"172.21.15.149:6805/2605923055","state":["exists","up"]},{"osd":6,"uuid":"812e8cbf-eb38-480a-bbb8-a12dd5c6dc36","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":3213182086},{"type":"v1","addr":"172.21.15.149:6809","nonce":3213182086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":3213182086},{"type":"v1","addr":"172.21.15.149:6811","nonce":3213182086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":3213182086},{"type":"v1","addr":"172.21.15.149:6815","nonce":3213182086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":3213182086},{"type":"v1","addr":"172.21.15.149:6813","nonce":3213182086}]},"public_addr":"172.21.15.149:6809/3213182086","cluster_addr":"172.21.15.149:6811/3213182086","heartbeat_back_addr":"172.21.15.149:6815/3213182086","heartbeat_front_addr":"172.21.15.149:6813/3213182086","state":["exists","up"]},{"osd":7,"uuid":"8cef311e-cb4b-486f-8b5e-e22613da5e3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":2237384325},{"type":"v1","addr":"172.21.15.149:6817","nonce":2237384325}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":2237384325},{"type":"v1","addr":"172.21.15.149:6819","nonce":2237384325}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":2237384325},{"type":"v1","addr":"172.21.15.149:6823","nonce":2237384325}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":2237384325},{"type":"v1","addr":"172.21.15.149:6821","nonce":2237384325}]},"public_addr":"172.21.15.149:6817/2237384325","cluster_addr":"172.21.15.149:6819/2237384325","heartbeat_back_addr":"172.21.15.149:6823/2237384325","heartbeat_front_addr":"172.21.15.149:6821/2237384325","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T16:50:05.592342+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T16:50:31.124432+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T16:50:53.951401+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T16:51:18.216988+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T16:51:43.054973+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T16:52:05.599855+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T16:52:30.303787+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T16:52:54.546961+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.44:0/3521776848":"2024-03-27T16:48:18.002290+0000","172.21.15.44:6801/2593231197":"2024-03-27T16:48:18.002290+0000","172.21.15.44:6800/3363630642":"2024-03-27T16:47:50.893281+0000","172.21.15.44:0/2302104871":"2024-03-27T16:47:50.893281+0000","172.21.15.44:0/1783950696":"2024-03-27T16:47:50.893281+0000","172.21.15.44:6801/3363630642":"2024-03-27T16:47:50.893281+0000","172.21.15.44:0/306072462":"2024-03-27T16:48:18.002290+0000","172.21.15.44:0/710097223":"2024-03-27T16:47:50.893281+0000","172.21.15.44:0/101712324":"2024-03-27T16:48:18.002290+0000","172.21.15.44:6800/2593231197":"2024-03-27T16:48:18.002290+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-26T16:53:19.751 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:53:19 smithi044 ceph-mon[30624]: from='client.? 172.21.15.44:0/2438401018' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-03-26T16:53:19.806 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:53:19 smithi064 ceph-mon[34420]: from='client.? 172.21.15.44:0/2438401018' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-03-26T16:53:19.896 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:53:19 smithi149 ceph-mon[34678]: from='client.? 172.21.15.44:0/2438401018' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-03-26T16:53:20.133 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-03-26T16:53:20.133 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bf9505fb569e9b95a78f9700ed8c4bd20508ef55 shell --fsid 4394d798-eb90-11ee-95d0-87774f69a715 -- ceph osd dump --format=json 2024-03-26T16:53:20.376 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/4394d798-eb90-11ee-95d0-87774f69a715/mon.a/config 2024-03-26T16:53:20.765 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:53:20 smithi044 ceph-mon[30624]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 221 MiB used, 715 GiB / 715 GiB avail 2024-03-26T16:53:20.806 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:53:20 smithi064 ceph-mon[34420]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 221 MiB used, 715 GiB / 715 GiB avail 2024-03-26T16:53:20.896 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:53:20 smithi149 ceph-mon[34678]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 221 MiB used, 715 GiB / 715 GiB avail 2024-03-26T16:53:22.257 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-26T16:53:22.257 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":52,"fsid":"4394d798-eb90-11ee-95d0-87774f69a715","created":"2024-03-26T16:47:21.867879+0000","modified":"2024-03-26T16:52:57.283141+0000","last_up_change":"2024-03-26T16:52:56.277385+0000","last_in_change":"2024-03-26T16:52:38.769811+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-26T16:50:56.104612+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":7.8899998664855957,"score_stable":7.8899998664855957,"optimal_score":0.37999999523162842,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"89074398-09bf-48a6-bb1c-4952b3ee8da4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":2121774261},{"type":"v1","addr":"172.21.15.44:6803","nonce":2121774261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":2121774261},{"type":"v1","addr":"172.21.15.44:6805","nonce":2121774261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":2121774261},{"type":"v1","addr":"172.21.15.44:6809","nonce":2121774261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":2121774261},{"type":"v1","addr":"172.21.15.44:6807","nonce":2121774261}]},"public_addr":"172.21.15.44:6803/2121774261","cluster_addr":"172.21.15.44:6805/2121774261","heartbeat_back_addr":"172.21.15.44:6809/2121774261","heartbeat_front_addr":"172.21.15.44:6807/2121774261","state":["exists","up"]},{"osd":1,"uuid":"1526e135-9bdd-489d-aed8-d8a17f5362f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":3203140205},{"type":"v1","addr":"172.21.15.44:6811","nonce":3203140205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":3203140205},{"type":"v1","addr":"172.21.15.44:6813","nonce":3203140205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":3203140205},{"type":"v1","addr":"172.21.15.44:6817","nonce":3203140205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":3203140205},{"type":"v1","addr":"172.21.15.44:6815","nonce":3203140205}]},"public_addr":"172.21.15.44:6811/3203140205","cluster_addr":"172.21.15.44:6813/3203140205","heartbeat_back_addr":"172.21.15.44:6817/3203140205","heartbeat_front_addr":"172.21.15.44:6815/3203140205","state":["exists","up"]},{"osd":2,"uuid":"c3dc5acf-f6fc-41c0-b9cb-975ae5995ad4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":1712901412},{"type":"v1","addr":"172.21.15.64:6801","nonce":1712901412}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":1712901412},{"type":"v1","addr":"172.21.15.64:6803","nonce":1712901412}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":1712901412},{"type":"v1","addr":"172.21.15.64:6807","nonce":1712901412}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":1712901412},{"type":"v1","addr":"172.21.15.64:6805","nonce":1712901412}]},"public_addr":"172.21.15.64:6801/1712901412","cluster_addr":"172.21.15.64:6803/1712901412","heartbeat_back_addr":"172.21.15.64:6807/1712901412","heartbeat_front_addr":"172.21.15.64:6805/1712901412","state":["exists","up"]},{"osd":3,"uuid":"635e55a9-5ed3-43aa-bb66-c324f142be3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":3087353302},{"type":"v1","addr":"172.21.15.64:6809","nonce":3087353302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":3087353302},{"type":"v1","addr":"172.21.15.64:6811","nonce":3087353302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6814","nonce":3087353302},{"type":"v1","addr":"172.21.15.64:6815","nonce":3087353302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":3087353302},{"type":"v1","addr":"172.21.15.64:6813","nonce":3087353302}]},"public_addr":"172.21.15.64:6809/3087353302","cluster_addr":"172.21.15.64:6811/3087353302","heartbeat_back_addr":"172.21.15.64:6815/3087353302","heartbeat_front_addr":"172.21.15.64:6813/3087353302","state":["exists","up"]},{"osd":4,"uuid":"8e3eecc3-6735-4c31-8884-48235f3aa539","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":3738404540},{"type":"v1","addr":"172.21.15.64:6817","nonce":3738404540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":3738404540},{"type":"v1","addr":"172.21.15.64:6819","nonce":3738404540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":3738404540},{"type":"v1","addr":"172.21.15.64:6823","nonce":3738404540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":3738404540},{"type":"v1","addr":"172.21.15.64:6821","nonce":3738404540}]},"public_addr":"172.21.15.64:6817/3738404540","cluster_addr":"172.21.15.64:6819/3738404540","heartbeat_back_addr":"172.21.15.64:6823/3738404540","heartbeat_front_addr":"172.21.15.64:6821/3738404540","state":["exists","up"]},{"osd":5,"uuid":"5eb3453c-e95d-4876-8c76-d323da294fd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":2605923055},{"type":"v1","addr":"172.21.15.149:6801","nonce":2605923055}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":2605923055},{"type":"v1","addr":"172.21.15.149:6803","nonce":2605923055}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":2605923055},{"type":"v1","addr":"172.21.15.149:6807","nonce":2605923055}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":2605923055},{"type":"v1","addr":"172.21.15.149:6805","nonce":2605923055}]},"public_addr":"172.21.15.149:6801/2605923055","cluster_addr":"172.21.15.149:6803/2605923055","heartbeat_back_addr":"172.21.15.149:6807/2605923055","heartbeat_front_addr":"172.21.15.149:6805/2605923055","state":["exists","up"]},{"osd":6,"uuid":"812e8cbf-eb38-480a-bbb8-a12dd5c6dc36","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":3213182086},{"type":"v1","addr":"172.21.15.149:6809","nonce":3213182086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":3213182086},{"type":"v1","addr":"172.21.15.149:6811","nonce":3213182086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":3213182086},{"type":"v1","addr":"172.21.15.149:6815","nonce":3213182086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":3213182086},{"type":"v1","addr":"172.21.15.149:6813","nonce":3213182086}]},"public_addr":"172.21.15.149:6809/3213182086","cluster_addr":"172.21.15.149:6811/3213182086","heartbeat_back_addr":"172.21.15.149:6815/3213182086","heartbeat_front_addr":"172.21.15.149:6813/3213182086","state":["exists","up"]},{"osd":7,"uuid":"8cef311e-cb4b-486f-8b5e-e22613da5e3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":2237384325},{"type":"v1","addr":"172.21.15.149:6817","nonce":2237384325}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":2237384325},{"type":"v1","addr":"172.21.15.149:6819","nonce":2237384325}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":2237384325},{"type":"v1","addr":"172.21.15.149:6823","nonce":2237384325}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":2237384325},{"type":"v1","addr":"172.21.15.149:6821","nonce":2237384325}]},"public_addr":"172.21.15.149:6817/2237384325","cluster_addr":"172.21.15.149:6819/2237384325","heartbeat_back_addr":"172.21.15.149:6823/2237384325","heartbeat_front_addr":"172.21.15.149:6821/2237384325","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T16:50:05.592342+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T16:50:31.124432+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T16:50:53.951401+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T16:51:18.216988+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T16:51:43.054973+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T16:52:05.599855+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T16:52:30.303787+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-26T16:52:54.546961+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.44:0/3521776848":"2024-03-27T16:48:18.002290+0000","172.21.15.44:6801/2593231197":"2024-03-27T16:48:18.002290+0000","172.21.15.44:6800/3363630642":"2024-03-27T16:47:50.893281+0000","172.21.15.44:0/2302104871":"2024-03-27T16:47:50.893281+0000","172.21.15.44:0/1783950696":"2024-03-27T16:47:50.893281+0000","172.21.15.44:6801/3363630642":"2024-03-27T16:47:50.893281+0000","172.21.15.44:0/306072462":"2024-03-27T16:48:18.002290+0000","172.21.15.44:0/710097223":"2024-03-27T16:47:50.893281+0000","172.21.15.44:0/101712324":"2024-03-27T16:48:18.002290+0000","172.21.15.44:6800/2593231197":"2024-03-27T16:48:18.002290+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-26T16:53:22.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:53:22 smithi149 ceph-mon[34678]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 221 MiB used, 715 GiB / 715 GiB avail 2024-03-26T16:53:22.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:53:22 smithi044 ceph-mon[30624]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 221 MiB used, 715 GiB / 715 GiB avail 2024-03-26T16:53:22.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:53:22 smithi064 ceph-mon[34420]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 221 MiB used, 715 GiB / 715 GiB avail 2024-03-26T16:53:22.883 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bf9505fb569e9b95a78f9700ed8c4bd20508ef55 shell --fsid 4394d798-eb90-11ee-95d0-87774f69a715 -- ceph tell osd.0 flush_pg_stats 2024-03-26T16:53:22.883 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bf9505fb569e9b95a78f9700ed8c4bd20508ef55 shell --fsid 4394d798-eb90-11ee-95d0-87774f69a715 -- ceph tell osd.1 flush_pg_stats 2024-03-26T16:53:22.884 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bf9505fb569e9b95a78f9700ed8c4bd20508ef55 shell --fsid 4394d798-eb90-11ee-95d0-87774f69a715 -- ceph tell osd.2 flush_pg_stats 2024-03-26T16:53:22.884 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bf9505fb569e9b95a78f9700ed8c4bd20508ef55 shell --fsid 4394d798-eb90-11ee-95d0-87774f69a715 -- ceph tell osd.3 flush_pg_stats 2024-03-26T16:53:22.885 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bf9505fb569e9b95a78f9700ed8c4bd20508ef55 shell --fsid 4394d798-eb90-11ee-95d0-87774f69a715 -- ceph tell osd.4 flush_pg_stats 2024-03-26T16:53:22.885 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bf9505fb569e9b95a78f9700ed8c4bd20508ef55 shell --fsid 4394d798-eb90-11ee-95d0-87774f69a715 -- ceph tell osd.5 flush_pg_stats 2024-03-26T16:53:22.885 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bf9505fb569e9b95a78f9700ed8c4bd20508ef55 shell --fsid 4394d798-eb90-11ee-95d0-87774f69a715 -- ceph tell osd.6 flush_pg_stats 2024-03-26T16:53:22.886 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bf9505fb569e9b95a78f9700ed8c4bd20508ef55 shell --fsid 4394d798-eb90-11ee-95d0-87774f69a715 -- ceph tell osd.7 flush_pg_stats 2024-03-26T16:53:23.156 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:53:23 smithi044 ceph-mon[30624]: from='client.? 172.21.15.44:0/4222837812' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-03-26T16:53:23.363 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/4394d798-eb90-11ee-95d0-87774f69a715/mon.a/config 2024-03-26T16:53:23.363 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/4394d798-eb90-11ee-95d0-87774f69a715/mon.a/config 2024-03-26T16:53:23.363 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/4394d798-eb90-11ee-95d0-87774f69a715/mon.a/config 2024-03-26T16:53:23.367 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/4394d798-eb90-11ee-95d0-87774f69a715/mon.a/config 2024-03-26T16:53:23.422 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/4394d798-eb90-11ee-95d0-87774f69a715/mon.a/config 2024-03-26T16:53:23.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:53:23 smithi064 ceph-mon[34420]: from='client.? 172.21.15.44:0/4222837812' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-03-26T16:53:23.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:53:23 smithi149 ceph-mon[34678]: from='client.? 172.21.15.44:0/4222837812' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-03-26T16:53:24.413 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:53:24 smithi044 ceph-mon[30624]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 221 MiB used, 715 GiB / 715 GiB avail 2024-03-26T16:53:24.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:53:24 smithi064 ceph-mon[34420]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 221 MiB used, 715 GiB / 715 GiB avail 2024-03-26T16:53:24.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:53:24 smithi149 ceph-mon[34678]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 221 MiB used, 715 GiB / 715 GiB avail 2024-03-26T16:53:26.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:53:26 smithi044 ceph-mon[30624]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 221 MiB used, 715 GiB / 715 GiB avail 2024-03-26T16:53:26.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:53:26 smithi064 ceph-mon[34420]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 221 MiB used, 715 GiB / 715 GiB avail 2024-03-26T16:53:26.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:53:26 smithi149 ceph-mon[34678]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 221 MiB used, 715 GiB / 715 GiB avail 2024-03-26T16:53:27.857 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/4394d798-eb90-11ee-95d0-87774f69a715/mon.a/config 2024-03-26T16:53:27.857 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/4394d798-eb90-11ee-95d0-87774f69a715/mon.a/config 2024-03-26T16:53:27.857 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/4394d798-eb90-11ee-95d0-87774f69a715/mon.a/config 2024-03-26T16:53:28.450 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:53:28 smithi044 ceph-mon[30624]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 221 MiB used, 715 GiB / 715 GiB avail 2024-03-26T16:53:28.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:53:28 smithi064 ceph-mon[34420]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 221 MiB used, 715 GiB / 715 GiB avail 2024-03-26T16:53:28.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:53:28 smithi149 ceph-mon[34678]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 221 MiB used, 715 GiB / 715 GiB avail 2024-03-26T16:53:30.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:53:30 smithi044 ceph-mon[30624]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 221 MiB used, 715 GiB / 715 GiB avail 2024-03-26T16:53:30.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:53:30 smithi064 ceph-mon[34420]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 221 MiB used, 715 GiB / 715 GiB avail 2024-03-26T16:53:30.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:53:30 smithi149 ceph-mon[34678]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 221 MiB used, 715 GiB / 715 GiB avail 2024-03-26T16:53:32.016 INFO:teuthology.orchestra.run.smithi044.stdout:163208757268 2024-03-26T16:53:32.017 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bf9505fb569e9b95a78f9700ed8c4bd20508ef55 shell --fsid 4394d798-eb90-11ee-95d0-87774f69a715 -- ceph osd last-stat-seq osd.5 2024-03-26T16:53:32.236 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:53:32 smithi044 ceph-mon[30624]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 221 MiB used, 715 GiB / 715 GiB avail 2024-03-26T16:53:32.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:53:32 smithi064 ceph-mon[34420]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 221 MiB used, 715 GiB / 715 GiB avail 2024-03-26T16:53:32.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:53:32 smithi149 ceph-mon[34678]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 221 MiB used, 715 GiB / 715 GiB avail 2024-03-26T16:53:32.915 INFO:teuthology.orchestra.run.smithi044.stdout:219043332106 2024-03-26T16:53:32.915 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bf9505fb569e9b95a78f9700ed8c4bd20508ef55 shell --fsid 4394d798-eb90-11ee-95d0-87774f69a715 -- ceph osd last-stat-seq osd.7 2024-03-26T16:53:34.213 INFO:teuthology.orchestra.run.smithi044.stdout:34359738412 2024-03-26T16:53:34.213 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bf9505fb569e9b95a78f9700ed8c4bd20508ef55 shell --fsid 4394d798-eb90-11ee-95d0-87774f69a715 -- ceph osd last-stat-seq osd.0 2024-03-26T16:53:34.431 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:53:34 smithi044 ceph-mon[30624]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 221 MiB used, 715 GiB / 715 GiB avail 2024-03-26T16:53:34.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:53:34 smithi064 ceph-mon[34420]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 221 MiB used, 715 GiB / 715 GiB avail 2024-03-26T16:53:34.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:53:34 smithi149 ceph-mon[34678]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 221 MiB used, 715 GiB / 715 GiB avail 2024-03-26T16:53:36.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:53:36 smithi044 ceph-mon[30624]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 221 MiB used, 715 GiB / 715 GiB avail 2024-03-26T16:53:36.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:53:36 smithi064 ceph-mon[34420]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 221 MiB used, 715 GiB / 715 GiB avail 2024-03-26T16:53:36.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:53:36 smithi149 ceph-mon[34678]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 221 MiB used, 715 GiB / 715 GiB avail 2024-03-26T16:53:37.220 INFO:teuthology.orchestra.run.smithi044.stdout:197568495632 2024-03-26T16:53:37.220 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bf9505fb569e9b95a78f9700ed8c4bd20508ef55 shell --fsid 4394d798-eb90-11ee-95d0-87774f69a715 -- ceph osd last-stat-seq osd.6 2024-03-26T16:53:37.896 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/4394d798-eb90-11ee-95d0-87774f69a715/mon.a/config 2024-03-26T16:53:37.896 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/4394d798-eb90-11ee-95d0-87774f69a715/mon.a/config 2024-03-26T16:53:38.318 INFO:teuthology.orchestra.run.smithi044.stdout:107374182430 2024-03-26T16:53:38.318 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bf9505fb569e9b95a78f9700ed8c4bd20508ef55 shell --fsid 4394d798-eb90-11ee-95d0-87774f69a715 -- ceph osd last-stat-seq osd.3 2024-03-26T16:53:38.432 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:53:38 smithi044 ceph-mon[30624]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 221 MiB used, 715 GiB / 715 GiB avail 2024-03-26T16:53:38.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:53:38 smithi064 ceph-mon[34420]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 221 MiB used, 715 GiB / 715 GiB avail 2024-03-26T16:53:38.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:53:38 smithi149 ceph-mon[34678]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 221 MiB used, 715 GiB / 715 GiB avail 2024-03-26T16:53:39.139 INFO:teuthology.orchestra.run.smithi044.stdout:77309411363 2024-03-26T16:53:39.139 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bf9505fb569e9b95a78f9700ed8c4bd20508ef55 shell --fsid 4394d798-eb90-11ee-95d0-87774f69a715 -- ceph osd last-stat-seq osd.2 2024-03-26T16:53:40.432 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:53:40 smithi044 ceph-mon[30624]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 221 MiB used, 715 GiB / 715 GiB avail 2024-03-26T16:53:40.448 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:53:40 smithi149 ceph-mon[34678]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 221 MiB used, 715 GiB / 715 GiB avail 2024-03-26T16:53:40.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:53:40 smithi064 ceph-mon[34420]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 221 MiB used, 715 GiB / 715 GiB avail 2024-03-26T16:53:41.993 INFO:teuthology.orchestra.run.smithi044.stdout:141733920794 2024-03-26T16:53:41.994 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bf9505fb569e9b95a78f9700ed8c4bd20508ef55 shell --fsid 4394d798-eb90-11ee-95d0-87774f69a715 -- ceph osd last-stat-seq osd.4 2024-03-26T16:53:42.002 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/4394d798-eb90-11ee-95d0-87774f69a715/mon.a/config 2024-03-26T16:53:42.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:53:42 smithi044 ceph-mon[30624]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 221 MiB used, 715 GiB / 715 GiB avail 2024-03-26T16:53:42.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:53:42 smithi064 ceph-mon[34420]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 221 MiB used, 715 GiB / 715 GiB avail 2024-03-26T16:53:42.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:53:42 smithi149 ceph-mon[34678]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 221 MiB used, 715 GiB / 715 GiB avail 2024-03-26T16:53:43.188 INFO:teuthology.orchestra.run.smithi044.stdout:55834574889 2024-03-26T16:53:43.188 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bf9505fb569e9b95a78f9700ed8c4bd20508ef55 shell --fsid 4394d798-eb90-11ee-95d0-87774f69a715 -- ceph osd last-stat-seq osd.1 2024-03-26T16:53:43.212 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/4394d798-eb90-11ee-95d0-87774f69a715/mon.a/config 2024-03-26T16:53:43.212 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/4394d798-eb90-11ee-95d0-87774f69a715/mon.a/config 2024-03-26T16:53:43.215 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/4394d798-eb90-11ee-95d0-87774f69a715/mon.a/config 2024-03-26T16:53:44.306 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:53:44 smithi044 ceph-mon[30624]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 221 MiB used, 715 GiB / 715 GiB avail 2024-03-26T16:53:44.543 INFO:teuthology.orchestra.run.smithi044.stdout:163208757271 2024-03-26T16:53:44.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:53:44 smithi064 ceph-mon[34420]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 221 MiB used, 715 GiB / 715 GiB avail 2024-03-26T16:53:44.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:53:44 smithi149 ceph-mon[34678]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 221 MiB used, 715 GiB / 715 GiB avail 2024-03-26T16:53:45.365 INFO:teuthology.orchestra.run.smithi044.stdout:219043332109 2024-03-26T16:53:45.366 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:53:45 smithi044 ceph-mon[30624]: from='client.? 172.21.15.44:0/813917639' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2024-03-26T16:53:45.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:53:45 smithi064 ceph-mon[34420]: from='client.? 172.21.15.44:0/813917639' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2024-03-26T16:53:45.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:53:45 smithi149 ceph-mon[34678]: from='client.? 172.21.15.44:0/813917639' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2024-03-26T16:53:46.105 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/4394d798-eb90-11ee-95d0-87774f69a715/mon.a/config 2024-03-26T16:53:46.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:53:46 smithi044 ceph-mon[30624]: from='client.? 172.21.15.44:0/99392843' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2024-03-26T16:53:46.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:53:46 smithi044 ceph-mon[30624]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 221 MiB used, 715 GiB / 715 GiB avail 2024-03-26T16:53:46.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:53:46 smithi064 ceph-mon[34420]: from='client.? 172.21.15.44:0/99392843' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2024-03-26T16:53:46.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:53:46 smithi064 ceph-mon[34420]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 221 MiB used, 715 GiB / 715 GiB avail 2024-03-26T16:53:46.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:53:46 smithi149 ceph-mon[34678]: from='client.? 172.21.15.44:0/99392843' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2024-03-26T16:53:46.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:53:46 smithi149 ceph-mon[34678]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 221 MiB used, 715 GiB / 715 GiB avail 2024-03-26T16:53:47.194 INFO:tasks.cephadm.ceph_manager.ceph:need seq 163208757268 got 163208757271 for osd.5 2024-03-26T16:53:47.194 DEBUG:teuthology.parallel:result is None 2024-03-26T16:53:48.056 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/4394d798-eb90-11ee-95d0-87774f69a715/mon.a/config 2024-03-26T16:53:48.455 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:53:48 smithi044 ceph-mon[30624]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 221 MiB used, 715 GiB / 715 GiB avail 2024-03-26T16:53:48.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:53:48 smithi064 ceph-mon[34420]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 221 MiB used, 715 GiB / 715 GiB avail 2024-03-26T16:53:48.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:53:48 smithi149 ceph-mon[34678]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 221 MiB used, 715 GiB / 715 GiB avail 2024-03-26T16:53:49.758 INFO:teuthology.orchestra.run.smithi044.stdout:77309411365 2024-03-26T16:53:49.763 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:53:49 smithi044 ceph-mon[30624]: from='client.? 172.21.15.44:0/1921066931' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2024-03-26T16:53:49.869 INFO:teuthology.orchestra.run.smithi044.stdout:34359738415 2024-03-26T16:53:49.896 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:53:49 smithi149 ceph-mon[34678]: from='client.? 172.21.15.44:0/1921066931' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2024-03-26T16:53:50.055 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:53:49 smithi064 ceph-mon[34420]: from='client.? 172.21.15.44:0/1921066931' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2024-03-26T16:53:50.641 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411363 got 77309411365 for osd.2 2024-03-26T16:53:50.641 DEBUG:teuthology.parallel:result is None 2024-03-26T16:53:50.896 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:53:50 smithi149 ceph-mon[34678]: from='client.? 172.21.15.44:0/494896154' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2024-03-26T16:53:50.897 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:53:50 smithi149 ceph-mon[34678]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 221 MiB used, 715 GiB / 715 GiB avail 2024-03-26T16:53:51.015 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:53:50 smithi044 ceph-mon[30624]: from='client.? 172.21.15.44:0/494896154' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2024-03-26T16:53:51.016 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:53:50 smithi044 ceph-mon[30624]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 221 MiB used, 715 GiB / 715 GiB avail 2024-03-26T16:53:51.055 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:53:50 smithi064 ceph-mon[34420]: from='client.? 172.21.15.44:0/494896154' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2024-03-26T16:53:51.056 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:53:50 smithi064 ceph-mon[34420]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 221 MiB used, 715 GiB / 715 GiB avail 2024-03-26T16:53:51.438 INFO:teuthology.orchestra.run.smithi044.stdout:197568495635 2024-03-26T16:53:51.712 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:53:51 smithi044 ceph-mon[30624]: from='client.? 172.21.15.44:0/2458473796' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2024-03-26T16:53:51.896 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:53:51 smithi149 ceph-mon[34678]: from='client.? 172.21.15.44:0/2458473796' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2024-03-26T16:53:52.056 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:53:51 smithi064 ceph-mon[34420]: from='client.? 172.21.15.44:0/2458473796' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2024-03-26T16:53:52.331 INFO:tasks.cephadm.ceph_manager.ceph:need seq 219043332106 got 219043332109 for osd.7 2024-03-26T16:53:52.331 DEBUG:teuthology.parallel:result is None 2024-03-26T16:53:52.896 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:53:52 smithi149 ceph-mon[34678]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 221 MiB used, 715 GiB / 715 GiB avail 2024-03-26T16:53:53.015 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:53:52 smithi044 ceph-mon[30624]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 221 MiB used, 715 GiB / 715 GiB avail 2024-03-26T16:53:53.056 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:53:52 smithi064 ceph-mon[34420]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 221 MiB used, 715 GiB / 715 GiB avail 2024-03-26T16:53:53.143 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738412 got 34359738415 for osd.0 2024-03-26T16:53:53.143 DEBUG:teuthology.parallel:result is None 2024-03-26T16:53:53.927 INFO:teuthology.orchestra.run.smithi044.stdout:107374182433 2024-03-26T16:53:54.266 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:53:53 smithi044 ceph-mon[30624]: from='client.? 172.21.15.44:0/897126927' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2024-03-26T16:53:54.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:53:53 smithi064 ceph-mon[34420]: from='client.? 172.21.15.44:0/897126927' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2024-03-26T16:53:54.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:53:53 smithi149 ceph-mon[34678]: from='client.? 172.21.15.44:0/897126927' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2024-03-26T16:53:54.414 INFO:tasks.cephadm.ceph_manager.ceph:need seq 197568495632 got 197568495635 for osd.6 2024-03-26T16:53:54.414 DEBUG:teuthology.parallel:result is None 2024-03-26T16:53:55.266 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:53:54 smithi044 ceph-mon[30624]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 221 MiB used, 715 GiB / 715 GiB avail 2024-03-26T16:53:55.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:53:54 smithi064 ceph-mon[34420]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 221 MiB used, 715 GiB / 715 GiB avail 2024-03-26T16:53:55.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:53:54 smithi149 ceph-mon[34678]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 221 MiB used, 715 GiB / 715 GiB avail 2024-03-26T16:53:55.929 INFO:tasks.cephadm.ceph_manager.ceph:need seq 107374182430 got 107374182433 for osd.3 2024-03-26T16:53:55.929 DEBUG:teuthology.parallel:result is None 2024-03-26T16:53:56.450 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:53:56 smithi044 ceph-mon[30624]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 221 MiB used, 715 GiB / 715 GiB avail 2024-03-26T16:53:56.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:53:56 smithi064 ceph-mon[34420]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 221 MiB used, 715 GiB / 715 GiB avail 2024-03-26T16:53:56.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:53:56 smithi149 ceph-mon[34678]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 221 MiB used, 715 GiB / 715 GiB avail 2024-03-26T16:53:56.868 INFO:teuthology.orchestra.run.smithi044.stdout:141733920798 2024-03-26T16:53:57.052 INFO:teuthology.orchestra.run.smithi044.stdout:55834574892 2024-03-26T16:53:57.400 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:53:57 smithi044 ceph-mon[30624]: from='client.? 172.21.15.44:0/4189862890' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2024-03-26T16:53:57.400 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:53:57 smithi044 ceph-mon[30624]: from='client.? 172.21.15.44:0/3273143527' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2024-03-26T16:53:57.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:53:57 smithi064 ceph-mon[34420]: from='client.? 172.21.15.44:0/4189862890' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2024-03-26T16:53:57.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:53:57 smithi064 ceph-mon[34420]: from='client.? 172.21.15.44:0/3273143527' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2024-03-26T16:53:57.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:53:57 smithi149 ceph-mon[34678]: from='client.? 172.21.15.44:0/4189862890' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2024-03-26T16:53:57.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:53:57 smithi149 ceph-mon[34678]: from='client.? 172.21.15.44:0/3273143527' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2024-03-26T16:53:57.693 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574889 got 55834574892 for osd.1 2024-03-26T16:53:57.693 DEBUG:teuthology.parallel:result is None 2024-03-26T16:53:58.150 INFO:tasks.cephadm.ceph_manager.ceph:need seq 141733920794 got 141733920798 for osd.4 2024-03-26T16:53:58.150 DEBUG:teuthology.parallel:result is None 2024-03-26T16:53:58.150 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-03-26T16:53:58.150 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bf9505fb569e9b95a78f9700ed8c4bd20508ef55 shell --fsid 4394d798-eb90-11ee-95d0-87774f69a715 -- ceph pg dump --format=json 2024-03-26T16:53:58.401 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/4394d798-eb90-11ee-95d0-87774f69a715/mon.a/config 2024-03-26T16:53:58.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:53:58 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-26T16:53:58.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:53:58 smithi044 ceph-mon[30624]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 221 MiB used, 715 GiB / 715 GiB avail 2024-03-26T16:53:58.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:53:58 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-26T16:53:58.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:53:58 smithi064 ceph-mon[34420]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 221 MiB used, 715 GiB / 715 GiB avail 2024-03-26T16:53:58.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:53:58 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-26T16:53:58.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:53:58 smithi149 ceph-mon[34678]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 221 MiB used, 715 GiB / 715 GiB avail 2024-03-26T16:53:59.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:53:59 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T16:53:59.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:53:59 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-26T16:53:59.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:53:59 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:53:59.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:53:59 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T16:53:59.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:53:59 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-26T16:53:59.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:53:59 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:53:59.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:53:59 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T16:53:59.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:53:59 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-26T16:53:59.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:53:59 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:54:00.248 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-26T16:54:00.250 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2024-03-26T16:54:00.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:54:00 smithi044 ceph-mon[30624]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 221 MiB used, 715 GiB / 715 GiB avail 2024-03-26T16:54:00.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:54:00 smithi064 ceph-mon[34420]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 221 MiB used, 715 GiB / 715 GiB avail 2024-03-26T16:54:00.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:54:00 smithi149 ceph-mon[34678]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 221 MiB used, 715 GiB / 715 GiB avail 2024-03-26T16:54:00.968 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":213,"stamp":"2024-03-26T16:54:00.065190+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":3,"kb":749961216,"kb_used":225980,"kb_used_data":5644,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":749735236,"statfs":{"total":767960285184,"available":767728881664,"internally_reserved":0,"allocated":5779456,"data_stored":3397720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":225496624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002432"},"pg_stats":[{"pgid":"1.0","version":"20'137","reported_seq":256,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-03-26T16:52:58.782870+0000","last_change":"2024-03-26T16:52:10.773552+0000","last_active":"2024-03-26T16:52:58.782870+0000","last_peered":"2024-03-26T16:52:58.782870+0000","last_clean":"2024-03-26T16:52:58.782870+0000","last_became_active":"2024-03-26T16:52:10.773056+0000","last_became_peered":"2024-03-26T16:52:10.773056+0000","last_unstale":"2024-03-26T16:52:58.782870+0000","last_undegraded":"2024-03-26T16:52:58.782870+0000","last_fullsized":"2024-03-26T16:52:58.782870+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T16:50:56.970123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T16:50:56.970123+0000","last_clean_scrub_stamp":"2024-03-26T16:50:56.970123+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T23:35:39.742386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,2],"acting":[3,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2969600,"data_stored":2951840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":5}],"osd_stats":[{"osd":7,"up_from":51,"seq":219043332112,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27508,"kb_used_data":488,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717644,"statfs":{"total":95995035648,"available":95966867456,"internally_reserved":0,"allocated":499712,"data_stored":203327,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":46,"seq":197568495637,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27512,"kb_used_data":488,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717640,"statfs":{"total":95995035648,"available":95966863360,"internally_reserved":0,"allocated":499712,"data_stored":203327,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574893,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27512,"kb_used_data":488,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717640,"statfs":{"total":95995035648,"available":95966863360,"internally_reserved":0,"allocated":499712,"data_stored":203327,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738418,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":31672,"kb_used_data":488,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713480,"statfs":{"total":95995035648,"available":95962603520,"internally_reserved":0,"allocated":499712,"data_stored":203327,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411367,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28088,"kb_used_data":1068,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717064,"statfs":{"total":95995035648,"available":95966273536,"internally_reserved":0,"allocated":1093632,"data_stored":793695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182434,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28088,"kb_used_data":1068,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717064,"statfs":{"total":95995035648,"available":95966273536,"internally_reserved":0,"allocated":1093632,"data_stored":793695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920798,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27508,"kb_used_data":488,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717644,"statfs":{"total":95995035648,"available":95966867456,"internally_reserved":0,"allocated":499712,"data_stored":203327,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757274,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28092,"kb_used_data":1068,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717060,"statfs":{"total":95995035648,"available":95966269440,"internally_reserved":0,"allocated":1093632,"data_stored":793695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-26T16:54:00.969 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bf9505fb569e9b95a78f9700ed8c4bd20508ef55 shell --fsid 4394d798-eb90-11ee-95d0-87774f69a715 -- ceph pg dump --format=json 2024-03-26T16:54:01.213 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/4394d798-eb90-11ee-95d0-87774f69a715/mon.a/config 2024-03-26T16:54:01.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:54:01 smithi044 ceph-mon[30624]: from='client.14532 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-26T16:54:01.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:54:01 smithi064 ceph-mon[34420]: from='client.14532 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-26T16:54:01.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:54:01 smithi149 ceph-mon[34678]: from='client.14532 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-26T16:54:02.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:54:02 smithi044 ceph-mon[30624]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 221 MiB used, 715 GiB / 715 GiB avail 2024-03-26T16:54:02.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:54:02 smithi064 ceph-mon[34420]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 221 MiB used, 715 GiB / 715 GiB avail 2024-03-26T16:54:02.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:54:02 smithi149 ceph-mon[34678]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 221 MiB used, 715 GiB / 715 GiB avail 2024-03-26T16:54:03.126 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-26T16:54:03.128 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2024-03-26T16:54:03.875 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":214,"stamp":"2024-03-26T16:54:02.065506+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":3,"kb":749961216,"kb_used":225980,"kb_used_data":5644,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":749735236,"statfs":{"total":767960285184,"available":767728881664,"internally_reserved":0,"allocated":5779456,"data_stored":3397720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":225496624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002331"},"pg_stats":[{"pgid":"1.0","version":"20'137","reported_seq":256,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-03-26T16:52:58.782870+0000","last_change":"2024-03-26T16:52:10.773552+0000","last_active":"2024-03-26T16:52:58.782870+0000","last_peered":"2024-03-26T16:52:58.782870+0000","last_clean":"2024-03-26T16:52:58.782870+0000","last_became_active":"2024-03-26T16:52:10.773056+0000","last_became_peered":"2024-03-26T16:52:10.773056+0000","last_unstale":"2024-03-26T16:52:58.782870+0000","last_undegraded":"2024-03-26T16:52:58.782870+0000","last_fullsized":"2024-03-26T16:52:58.782870+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-26T16:50:56.970123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-26T16:50:56.970123+0000","last_clean_scrub_stamp":"2024-03-26T16:50:56.970123+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-27T23:35:39.742386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,2],"acting":[3,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2969600,"data_stored":2951840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":5}],"osd_stats":[{"osd":7,"up_from":51,"seq":219043332112,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27508,"kb_used_data":488,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717644,"statfs":{"total":95995035648,"available":95966867456,"internally_reserved":0,"allocated":499712,"data_stored":203327,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":46,"seq":197568495637,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27512,"kb_used_data":488,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717640,"statfs":{"total":95995035648,"available":95966863360,"internally_reserved":0,"allocated":499712,"data_stored":203327,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574893,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27512,"kb_used_data":488,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717640,"statfs":{"total":95995035648,"available":95966863360,"internally_reserved":0,"allocated":499712,"data_stored":203327,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738418,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":31672,"kb_used_data":488,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713480,"statfs":{"total":95995035648,"available":95962603520,"internally_reserved":0,"allocated":499712,"data_stored":203327,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411368,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28088,"kb_used_data":1068,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717064,"statfs":{"total":95995035648,"available":95966273536,"internally_reserved":0,"allocated":1093632,"data_stored":793695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182435,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28088,"kb_used_data":1068,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717064,"statfs":{"total":95995035648,"available":95966273536,"internally_reserved":0,"allocated":1093632,"data_stored":793695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920799,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27508,"kb_used_data":488,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717644,"statfs":{"total":95995035648,"available":95966867456,"internally_reserved":0,"allocated":499712,"data_stored":203327,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757274,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28092,"kb_used_data":1068,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717060,"statfs":{"total":95995035648,"available":95966269440,"internally_reserved":0,"allocated":1093632,"data_stored":793695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-26T16:54:03.875 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-03-26T16:54:03.875 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-03-26T16:54:03.875 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-03-26T16:54:03.876 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bf9505fb569e9b95a78f9700ed8c4bd20508ef55 shell --fsid 4394d798-eb90-11ee-95d0-87774f69a715 -- ceph health --format=json 2024-03-26T16:54:04.114 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/4394d798-eb90-11ee-95d0-87774f69a715/mon.a/config 2024-03-26T16:54:04.412 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:54:04 smithi044 ceph-mon[30624]: from='client.14538 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-26T16:54:04.412 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:54:04 smithi044 ceph-mon[30624]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 221 MiB used, 715 GiB / 715 GiB avail 2024-03-26T16:54:04.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:54:04 smithi064 ceph-mon[34420]: from='client.14538 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-26T16:54:04.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:54:04 smithi064 ceph-mon[34420]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 221 MiB used, 715 GiB / 715 GiB avail 2024-03-26T16:54:04.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:54:04 smithi149 ceph-mon[34678]: from='client.14538 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-26T16:54:04.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:54:04 smithi149 ceph-mon[34678]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 221 MiB used, 715 GiB / 715 GiB avail 2024-03-26T16:54:05.995 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-26T16:54:05.996 INFO:teuthology.orchestra.run.smithi044.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-03-26T16:54:06.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:54:06 smithi044 ceph-mon[30624]: from='client.? 172.21.15.44:0/1798425354' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-03-26T16:54:06.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:54:06 smithi064 ceph-mon[34420]: from='client.? 172.21.15.44:0/1798425354' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-03-26T16:54:06.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:54:06 smithi149 ceph-mon[34678]: from='client.? 172.21.15.44:0/1798425354' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-03-26T16:54:06.711 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-03-26T16:54:06.711 INFO:tasks.cephadm:Setup complete, yielding 2024-03-26T16:54:06.712 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-03-26T16:54:06.721 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi044.front.sepia.ceph.com 2024-03-26T16:54:06.722 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bf9505fb569e9b95a78f9700ed8c4bd20508ef55 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4394d798-eb90-11ee-95d0-87774f69a715 -- bash -c 'ceph orch status' 2024-03-26T16:54:06.966 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/4394d798-eb90-11ee-95d0-87774f69a715/mon.a/config 2024-03-26T16:54:07.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:54:07 smithi064 ceph-mon[34420]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 221 MiB used, 715 GiB / 715 GiB avail 2024-03-26T16:54:07.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:54:07 smithi149 ceph-mon[34678]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 221 MiB used, 715 GiB / 715 GiB avail 2024-03-26T16:54:07.397 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:54:07 smithi044 ceph-mon[30624]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 221 MiB used, 715 GiB / 715 GiB avail 2024-03-26T16:54:08.385 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:54:08 smithi044 ceph-mon[30624]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 221 MiB used, 715 GiB / 715 GiB avail 2024-03-26T16:54:08.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:54:08 smithi064 ceph-mon[34420]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 221 MiB used, 715 GiB / 715 GiB avail 2024-03-26T16:54:08.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:54:08 smithi149 ceph-mon[34678]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 221 MiB used, 715 GiB / 715 GiB avail 2024-03-26T16:54:08.862 INFO:teuthology.orchestra.run.smithi044.stdout:Backend: cephadm 2024-03-26T16:54:08.862 INFO:teuthology.orchestra.run.smithi044.stdout:Available: Yes 2024-03-26T16:54:08.863 INFO:teuthology.orchestra.run.smithi044.stdout:Paused: No 2024-03-26T16:54:09.448 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:54:09 smithi044 ceph-mon[30624]: from='client.14550 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-26T16:54:09.477 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bf9505fb569e9b95a78f9700ed8c4bd20508ef55 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4394d798-eb90-11ee-95d0-87774f69a715 -- bash -c 'ceph orch ps' 2024-03-26T16:54:09.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:54:09 smithi064 ceph-mon[34420]: from='client.14550 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-26T16:54:09.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:54:09 smithi149 ceph-mon[34678]: from='client.14550 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-26T16:54:09.715 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/4394d798-eb90-11ee-95d0-87774f69a715/mon.a/config 2024-03-26T16:54:10.457 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:54:10 smithi064 ceph-mon[34420]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 221 MiB used, 715 GiB / 715 GiB avail 2024-03-26T16:54:10.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:54:10 smithi044 ceph-mon[30624]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 221 MiB used, 715 GiB / 715 GiB avail 2024-03-26T16:54:10.547 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:54:10 smithi149 ceph-mon[34678]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 221 MiB used, 715 GiB / 715 GiB avail 2024-03-26T16:54:11.539 INFO:teuthology.orchestra.run.smithi044.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-26T16:54:11.540 INFO:teuthology.orchestra.run.smithi044.stdout:mgr.x smithi044 *:9283,8765 running (6m) 3m ago 6m 494M - 19.0.0-2382-gbf9505fb 5795ddf10274 f79a52394b04 2024-03-26T16:54:11.540 INFO:teuthology.orchestra.run.smithi044.stdout:mon.a smithi044 running (6m) 3m ago 6m 38.5M 2048M 19.0.0-2382-gbf9505fb 5795ddf10274 c1736fb67232 2024-03-26T16:54:11.540 INFO:teuthology.orchestra.run.smithi044.stdout:mon.b smithi064 running (4m) 2m ago 4m 35.3M 2048M 19.0.0-2382-gbf9505fb 5795ddf10274 615ecaad5c11 2024-03-26T16:54:11.540 INFO:teuthology.orchestra.run.smithi044.stdout:mon.c smithi149 running (4m) 78s ago 4m 39.3M 2048M 19.0.0-2382-gbf9505fb 5795ddf10274 b3ca6d321ad1 2024-03-26T16:54:11.540 INFO:teuthology.orchestra.run.smithi044.stdout:osd.0 smithi044 running (4m) 3m ago 4m 33.7M 8546M 19.0.0-2382-gbf9505fb 5795ddf10274 e723e35691bc 2024-03-26T16:54:11.540 INFO:teuthology.orchestra.run.smithi044.stdout:osd.1 smithi044 running (3m) 3m ago 3m 12.2M 8546M 19.0.0-2382-gbf9505fb 5795ddf10274 d584602f1030 2024-03-26T16:54:11.540 INFO:teuthology.orchestra.run.smithi044.stdout:osd.2 smithi064 running (3m) 2m ago 3m 35.6M 7061M 19.0.0-2382-gbf9505fb 5795ddf10274 7c60314918e5 2024-03-26T16:54:11.540 INFO:teuthology.orchestra.run.smithi044.stdout:osd.3 smithi064 running (2m) 2m ago 2m 39.8M 7061M 19.0.0-2382-gbf9505fb 5795ddf10274 b7da0fdb38e5 2024-03-26T16:54:11.540 INFO:teuthology.orchestra.run.smithi044.stdout:osd.4 smithi064 running (2m) 2m ago 2m 15.1M 7061M 19.0.0-2382-gbf9505fb 5795ddf10274 55660b3b2db2 2024-03-26T16:54:11.541 INFO:teuthology.orchestra.run.smithi044.stdout:osd.5 smithi149 running (2m) 78s ago 2m 35.2M 3304M 19.0.0-2382-gbf9505fb 5795ddf10274 f609cac03816 2024-03-26T16:54:11.541 INFO:teuthology.orchestra.run.smithi044.stdout:osd.6 smithi149 running (105s) 78s ago 105s 36.8M 3304M 19.0.0-2382-gbf9505fb 5795ddf10274 78e32de97157 2024-03-26T16:54:11.541 INFO:teuthology.orchestra.run.smithi044.stdout:osd.7 smithi149 running (81s) 78s ago 81s 14.9M 3304M 19.0.0-2382-gbf9505fb 5795ddf10274 423971a0fd4e 2024-03-26T16:54:12.115 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bf9505fb569e9b95a78f9700ed8c4bd20508ef55 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4394d798-eb90-11ee-95d0-87774f69a715 -- bash -c 'ceph orch host ls' 2024-03-26T16:54:12.357 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/4394d798-eb90-11ee-95d0-87774f69a715/mon.a/config 2024-03-26T16:54:12.473 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:54:12 smithi044 ceph-mon[30624]: from='client.14556 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-26T16:54:12.473 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:54:12 smithi044 ceph-mon[30624]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 221 MiB used, 715 GiB / 715 GiB avail 2024-03-26T16:54:12.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:54:12 smithi064 ceph-mon[34420]: from='client.14556 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-26T16:54:12.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:54:12 smithi064 ceph-mon[34420]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 221 MiB used, 715 GiB / 715 GiB avail 2024-03-26T16:54:12.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:54:12 smithi149 ceph-mon[34678]: from='client.14556 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-26T16:54:12.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:54:12 smithi149 ceph-mon[34678]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 221 MiB used, 715 GiB / 715 GiB avail 2024-03-26T16:54:14.133 INFO:teuthology.orchestra.run.smithi044.stdout:HOST ADDR LABELS STATUS 2024-03-26T16:54:14.133 INFO:teuthology.orchestra.run.smithi044.stdout:smithi044 172.21.15.44 2024-03-26T16:54:14.133 INFO:teuthology.orchestra.run.smithi044.stdout:smithi064 172.21.15.64 2024-03-26T16:54:14.133 INFO:teuthology.orchestra.run.smithi044.stdout:smithi149 172.21.15.149 2024-03-26T16:54:14.133 INFO:teuthology.orchestra.run.smithi044.stdout:smithi157 172.21.15.157 2024-03-26T16:54:14.133 INFO:teuthology.orchestra.run.smithi044.stdout:4 hosts in cluster 2024-03-26T16:54:14.489 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:54:14 smithi044 ceph-mon[30624]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 221 MiB used, 715 GiB / 715 GiB avail 2024-03-26T16:54:14.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:54:14 smithi064 ceph-mon[34420]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 221 MiB used, 715 GiB / 715 GiB avail 2024-03-26T16:54:14.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:54:14 smithi149 ceph-mon[34678]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 221 MiB used, 715 GiB / 715 GiB avail 2024-03-26T16:54:14.793 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bf9505fb569e9b95a78f9700ed8c4bd20508ef55 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4394d798-eb90-11ee-95d0-87774f69a715 -- bash -c 'ceph orch device ls' 2024-03-26T16:54:15.033 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/4394d798-eb90-11ee-95d0-87774f69a715/mon.a/config 2024-03-26T16:54:15.476 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:54:15 smithi044 ceph-mon[30624]: from='client.14562 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-03-26T16:54:15.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:54:15 smithi064 ceph-mon[34420]: from='client.14562 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-03-26T16:54:15.649 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:54:15 smithi149 ceph-mon[34678]: from='client.14562 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-03-26T16:54:16.427 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:54:16 smithi044 ceph-mon[30624]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 221 MiB used, 715 GiB / 715 GiB avail 2024-03-26T16:54:16.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:54:16 smithi064 ceph-mon[34420]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 221 MiB used, 715 GiB / 715 GiB avail 2024-03-26T16:54:16.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:54:16 smithi149 ceph-mon[34678]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 221 MiB used, 715 GiB / 715 GiB avail 2024-03-26T16:54:16.920 INFO:teuthology.orchestra.run.smithi044.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-03-26T16:54:16.920 INFO:teuthology.orchestra.run.smithi044.stdout:smithi044 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT5331001K400BGN 372G No 3m ago Has a FileSystem, LVM detected 2024-03-26T16:54:16.920 INFO:teuthology.orchestra.run.smithi044.stdout:smithi064 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT534400C2400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-03-26T16:54:16.920 INFO:teuthology.orchestra.run.smithi044.stdout:smithi149 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT623300CK400BGN 372G No 79s ago Has a FileSystem, LVM detected 2024-03-26T16:54:16.920 INFO:teuthology.orchestra.run.smithi044.stdout:smithi157 /dev/nvme0n1 ssd INTEL_SSDPED1D480GA_PHMB7476002V480DGN 447G No 5m ago Has a FileSystem, LVM detected 2024-03-26T16:54:17.227 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:54:17 smithi044 ceph-mon[30624]: from='client.14568 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-03-26T16:54:17.550 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bf9505fb569e9b95a78f9700ed8c4bd20508ef55 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4394d798-eb90-11ee-95d0-87774f69a715 -- bash -c 'ceph osd lspools' 2024-03-26T16:54:17.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:54:17 smithi064 ceph-mon[34420]: from='client.14568 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-03-26T16:54:17.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:54:17 smithi149 ceph-mon[34678]: from='client.14568 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-03-26T16:54:17.790 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/4394d798-eb90-11ee-95d0-87774f69a715/mon.a/config 2024-03-26T16:54:18.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:54:18 smithi044 ceph-mon[30624]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 221 MiB used, 715 GiB / 715 GiB avail 2024-03-26T16:54:18.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:54:18 smithi064 ceph-mon[34420]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 221 MiB used, 715 GiB / 715 GiB avail 2024-03-26T16:54:18.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:54:18 smithi149 ceph-mon[34678]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 221 MiB used, 715 GiB / 715 GiB avail 2024-03-26T16:54:19.574 INFO:teuthology.orchestra.run.smithi044.stdout:1 .mgr 2024-03-26T16:54:19.896 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:54:19 smithi149 ceph-mon[34678]: from='client.? 172.21.15.44:0/1076841119' entity='client.admin' cmd={"prefix": "osd lspools"} : dispatch 2024-03-26T16:54:20.015 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:54:19 smithi044 ceph-mon[30624]: from='client.? 172.21.15.44:0/1076841119' entity='client.admin' cmd={"prefix": "osd lspools"} : dispatch 2024-03-26T16:54:20.055 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:54:19 smithi064 ceph-mon[34420]: from='client.? 172.21.15.44:0/1076841119' entity='client.admin' cmd={"prefix": "osd lspools"} : dispatch 2024-03-26T16:54:20.188 INFO:teuthology.run_tasks:Running task nvmeof... 2024-03-26T16:54:20.229 INFO:tasks.nvmeof:[nvmeof]: deploying nvmeof gateway... 2024-03-26T16:54:20.229 INFO:tasks.nvmeof:Adding ceph.nvmeof.nvmeof.a on smithi044 2024-03-26T16:54:20.229 INFO:tasks.nvmeof:Adding ceph.nvmeof.nvmeof.b on smithi064 2024-03-26T16:54:20.229 INFO:tasks.nvmeof:Adding ceph.nvmeof.nvmeof.c on smithi149 2024-03-26T16:54:20.229 INFO:tasks.nvmeof:[nvmeof]: ceph config set mgr mgr/cephadm/container_image_nvmeof quay.io/ceph/nvmeof:1.1.0 2024-03-26T16:54:20.229 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bf9505fb569e9b95a78f9700ed8c4bd20508ef55 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4394d798-eb90-11ee-95d0-87774f69a715 -- ceph config set mgr mgr/cephadm/container_image_nvmeof quay.io/barakda1/nvmeof:qe_ceph_devel_21e59b2 2024-03-26T16:54:20.473 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/4394d798-eb90-11ee-95d0-87774f69a715/mon.a/config 2024-03-26T16:54:20.896 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:54:20 smithi149 ceph-mon[34678]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 221 MiB used, 715 GiB / 715 GiB avail 2024-03-26T16:54:20.903 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:54:20 smithi044 ceph-mon[30624]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 221 MiB used, 715 GiB / 715 GiB avail 2024-03-26T16:54:21.056 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:54:20 smithi064 ceph-mon[34420]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 221 MiB used, 715 GiB / 715 GiB avail 2024-03-26T16:54:22.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:54:22 smithi044 ceph-mon[30624]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 221 MiB used, 715 GiB / 715 GiB avail 2024-03-26T16:54:22.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:54:22 smithi064 ceph-mon[34420]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 221 MiB used, 715 GiB / 715 GiB avail 2024-03-26T16:54:22.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:54:22 smithi149 ceph-mon[34678]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 221 MiB used, 715 GiB / 715 GiB avail 2024-03-26T16:54:22.888 INFO:tasks.nvmeof:[nvmeof]: ceph osd pool create mypool 2024-03-26T16:54:22.888 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bf9505fb569e9b95a78f9700ed8c4bd20508ef55 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4394d798-eb90-11ee-95d0-87774f69a715 -- ceph osd pool create mypool 2024-03-26T16:54:23.126 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/4394d798-eb90-11ee-95d0-87774f69a715/mon.a/config 2024-03-26T16:54:23.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:54:23 smithi044 ceph-mon[30624]: from='client.? 172.21.15.44:0/2361843627' entity='client.admin' 2024-03-26T16:54:23.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:54:23 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-26T16:54:23.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:54:23 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T16:54:23.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:54:23 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-26T16:54:23.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:54:23 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:54:23.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:54:23 smithi064 ceph-mon[34420]: from='client.? 172.21.15.44:0/2361843627' entity='client.admin' 2024-03-26T16:54:23.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:54:23 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-26T16:54:23.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:54:23 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T16:54:23.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:54:23 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-26T16:54:23.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:54:23 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:54:23.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:54:23 smithi149 ceph-mon[34678]: from='client.? 172.21.15.44:0/2361843627' entity='client.admin' 2024-03-26T16:54:23.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:54:23 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-26T16:54:23.647 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:54:23 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T16:54:23.647 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:54:23 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-26T16:54:23.647 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:54:23 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:54:24.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:54:24 smithi044 ceph-mon[30624]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 221 MiB used, 715 GiB / 715 GiB avail 2024-03-26T16:54:24.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:54:24 smithi064 ceph-mon[34420]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 221 MiB used, 715 GiB / 715 GiB avail 2024-03-26T16:54:24.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:54:24 smithi149 ceph-mon[34678]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 221 MiB used, 715 GiB / 715 GiB avail 2024-03-26T16:54:25.310 INFO:teuthology.orchestra.run.smithi044.stderr:pool 'mypool' created 2024-03-26T16:54:25.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:54:25 smithi064 ceph-mon[34420]: from='client.? 172.21.15.44:0/2959199940' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "mypool"} : dispatch 2024-03-26T16:54:25.627 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:54:25 smithi044 ceph-mon[30624]: from='client.? 172.21.15.44:0/2959199940' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "mypool"} : dispatch 2024-03-26T16:54:25.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:54:25 smithi149 ceph-mon[34678]: from='client.? 172.21.15.44:0/2959199940' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "mypool"} : dispatch 2024-03-26T16:54:25.937 INFO:tasks.nvmeof:[nvmeof]: rbd pool init mypool 2024-03-26T16:54:25.938 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bf9505fb569e9b95a78f9700ed8c4bd20508ef55 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4394d798-eb90-11ee-95d0-87774f69a715 -- rbd pool init mypool 2024-03-26T16:54:26.182 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/4394d798-eb90-11ee-95d0-87774f69a715/mon.a/config 2024-03-26T16:54:26.631 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:54:26 smithi044 ceph-mon[30624]: from='client.? 172.21.15.44:0/2959199940' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "mypool"}]': finished 2024-03-26T16:54:26.631 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:54:26 smithi044 ceph-mon[30624]: osdmap e53: 8 total, 8 up, 8 in 2024-03-26T16:54:26.631 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:54:26 smithi044 ceph-mon[30624]: pgmap v227: 33 pgs: 3 creating+peering, 1 active+clean, 29 unknown; 577 KiB data, 221 MiB used, 715 GiB / 715 GiB avail 2024-03-26T16:54:26.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:54:26 smithi149 ceph-mon[34678]: from='client.? 172.21.15.44:0/2959199940' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "mypool"}]': finished 2024-03-26T16:54:26.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:54:26 smithi149 ceph-mon[34678]: osdmap e53: 8 total, 8 up, 8 in 2024-03-26T16:54:26.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:54:26 smithi149 ceph-mon[34678]: pgmap v227: 33 pgs: 3 creating+peering, 1 active+clean, 29 unknown; 577 KiB data, 221 MiB used, 715 GiB / 715 GiB avail 2024-03-26T16:54:26.806 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:54:26 smithi064 ceph-mon[34420]: from='client.? 172.21.15.44:0/2959199940' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "mypool"}]': finished 2024-03-26T16:54:26.806 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:54:26 smithi064 ceph-mon[34420]: osdmap e53: 8 total, 8 up, 8 in 2024-03-26T16:54:26.806 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:54:26 smithi064 ceph-mon[34420]: pgmap v227: 33 pgs: 3 creating+peering, 1 active+clean, 29 unknown; 577 KiB data, 221 MiB used, 715 GiB / 715 GiB avail 2024-03-26T16:54:27.451 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:54:27 smithi044 ceph-mon[30624]: osdmap e54: 8 total, 8 up, 8 in 2024-03-26T16:54:27.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:54:27 smithi149 ceph-mon[34678]: osdmap e54: 8 total, 8 up, 8 in 2024-03-26T16:54:27.806 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:54:27 smithi064 ceph-mon[34420]: osdmap e54: 8 total, 8 up, 8 in 2024-03-26T16:54:28.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:54:28 smithi149 ceph-mon[34678]: osdmap e55: 8 total, 8 up, 8 in 2024-03-26T16:54:28.647 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:54:28 smithi149 ceph-mon[34678]: from='client.? 172.21.15.44:0/2714332565' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "mypool","app": "rbd"} : dispatch 2024-03-26T16:54:28.647 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:54:28 smithi149 ceph-mon[34678]: pgmap v230: 33 pgs: 3 creating+peering, 15 active+clean, 15 unknown; 577 KiB data, 221 MiB used, 715 GiB / 715 GiB avail 2024-03-26T16:54:28.765 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:54:28 smithi044 ceph-mon[30624]: osdmap e55: 8 total, 8 up, 8 in 2024-03-26T16:54:28.766 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:54:28 smithi044 ceph-mon[30624]: from='client.? 172.21.15.44:0/2714332565' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "mypool","app": "rbd"} : dispatch 2024-03-26T16:54:28.766 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:54:28 smithi044 ceph-mon[30624]: pgmap v230: 33 pgs: 3 creating+peering, 15 active+clean, 15 unknown; 577 KiB data, 221 MiB used, 715 GiB / 715 GiB avail 2024-03-26T16:54:28.805 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:54:28 smithi064 ceph-mon[34420]: osdmap e55: 8 total, 8 up, 8 in 2024-03-26T16:54:28.806 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:54:28 smithi064 ceph-mon[34420]: from='client.? 172.21.15.44:0/2714332565' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "mypool","app": "rbd"} : dispatch 2024-03-26T16:54:28.806 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:54:28 smithi064 ceph-mon[34420]: pgmap v230: 33 pgs: 3 creating+peering, 15 active+clean, 15 unknown; 577 KiB data, 221 MiB used, 715 GiB / 715 GiB avail 2024-03-26T16:54:29.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:54:29 smithi149 ceph-mon[34678]: from='client.? 172.21.15.44:0/2714332565' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "mypool","app": "rbd"}]': finished 2024-03-26T16:54:29.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:54:29 smithi149 ceph-mon[34678]: osdmap e56: 8 total, 8 up, 8 in 2024-03-26T16:54:29.765 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:54:29 smithi044 ceph-mon[30624]: from='client.? 172.21.15.44:0/2714332565' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "mypool","app": "rbd"}]': finished 2024-03-26T16:54:29.765 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:54:29 smithi044 ceph-mon[30624]: osdmap e56: 8 total, 8 up, 8 in 2024-03-26T16:54:29.805 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:54:29 smithi064 ceph-mon[34420]: from='client.? 172.21.15.44:0/2714332565' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "mypool","app": "rbd"}]': finished 2024-03-26T16:54:29.806 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:54:29 smithi064 ceph-mon[34420]: osdmap e56: 8 total, 8 up, 8 in 2024-03-26T16:54:30.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:54:30 smithi149 ceph-mon[34678]: osdmap e57: 8 total, 8 up, 8 in 2024-03-26T16:54:30.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:54:30 smithi149 ceph-mon[34678]: pgmap v233: 33 pgs: 3 creating+peering, 25 active+clean, 5 unknown; 577 KiB data, 221 MiB used, 715 GiB / 715 GiB avail 2024-03-26T16:54:30.657 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:54:30 smithi044 ceph-mon[30624]: osdmap e57: 8 total, 8 up, 8 in 2024-03-26T16:54:30.657 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:54:30 smithi044 ceph-mon[30624]: pgmap v233: 33 pgs: 3 creating+peering, 25 active+clean, 5 unknown; 577 KiB data, 221 MiB used, 715 GiB / 715 GiB avail 2024-03-26T16:54:30.806 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:54:30 smithi064 ceph-mon[34420]: osdmap e57: 8 total, 8 up, 8 in 2024-03-26T16:54:30.806 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:54:30 smithi064 ceph-mon[34420]: pgmap v233: 33 pgs: 3 creating+peering, 25 active+clean, 5 unknown; 577 KiB data, 221 MiB used, 715 GiB / 715 GiB avail 2024-03-26T16:54:30.942 INFO:tasks.nvmeof:[nvmeof]: ceph orch apply nvmeof mypool 2024-03-26T16:54:30.942 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bf9505fb569e9b95a78f9700ed8c4bd20508ef55 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4394d798-eb90-11ee-95d0-87774f69a715 -- ceph orch apply nvmeof mypool --placement '3;smithi044=nvmeof.a;smithi064=nvmeof.b;smithi149=nvmeof.c' 2024-03-26T16:54:31.186 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/4394d798-eb90-11ee-95d0-87774f69a715/mon.a/config 2024-03-26T16:54:31.577 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:54:31 smithi044 ceph-mon[30624]: osdmap e58: 8 total, 8 up, 8 in 2024-03-26T16:54:31.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:54:31 smithi149 ceph-mon[34678]: osdmap e58: 8 total, 8 up, 8 in 2024-03-26T16:54:31.806 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:54:31 smithi064 ceph-mon[34420]: osdmap e58: 8 total, 8 up, 8 in 2024-03-26T16:54:32.604 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:54:32 smithi044 ceph-mon[30624]: pgmap v235: 33 pgs: 33 active+clean; 577 KiB data, 221 MiB used, 715 GiB / 715 GiB avail; 215 B/s wr, 0 op/s 2024-03-26T16:54:32.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:54:32 smithi149 ceph-mon[34678]: pgmap v235: 33 pgs: 33 active+clean; 577 KiB data, 221 MiB used, 715 GiB / 715 GiB avail; 215 B/s wr, 0 op/s 2024-03-26T16:54:32.806 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:54:32 smithi064 ceph-mon[34420]: pgmap v235: 33 pgs: 33 active+clean; 577 KiB data, 221 MiB used, 715 GiB / 715 GiB avail; 215 B/s wr, 0 op/s 2024-03-26T16:54:33.058 INFO:teuthology.orchestra.run.smithi044.stdout:Scheduled nvmeof.mypool update... 2024-03-26T16:54:33.807 INFO:tasks.nvmeof:[nvmeof]: creating 20 images 2024-03-26T16:54:33.807 INFO:tasks.nvmeof:[nvmeof]: rbd create mypool/myimage1 --size 8192 2024-03-26T16:54:33.807 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bf9505fb569e9b95a78f9700ed8c4bd20508ef55 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4394d798-eb90-11ee-95d0-87774f69a715 -- rbd create mypool/myimage1 --size 8192 2024-03-26T16:54:34.047 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/4394d798-eb90-11ee-95d0-87774f69a715/mon.a/config 2024-03-26T16:54:34.382 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:54:34 smithi044 ceph-mon[30624]: from='client.14598 -' entity='client.admin' cmd=[{"prefix": "orch apply nvmeof", "pool": "mypool", "placement": "3;smithi044=nvmeof.a;smithi064=nvmeof.b;smithi149=nvmeof.c", "target": ["mon-mgr", ""]}]: dispatch 2024-03-26T16:54:34.383 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:54:34 smithi044 ceph-mon[30624]: Saving service nvmeof.mypool spec with placement smithi044=nvmeof.a;smithi064=nvmeof.b;smithi149=nvmeof.c;count:3 2024-03-26T16:54:34.383 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:54:34 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:54:34.383 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:54:34 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-26T16:54:34.383 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:54:34 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T16:54:34.383 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:54:34 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-26T16:54:34.383 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:54:34 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:54:34.383 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:54:34 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "client.nvmeof.nvmeof.c", "caps": ["mon", "profile rbd", "osd", "allow all tag rbd *=*"]} : dispatch 2024-03-26T16:54:34.383 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:54:34 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "client.nvmeof.nvmeof.c", "caps": ["mon", "profile rbd", "osd", "allow all tag rbd *=*"]}]': finished 2024-03-26T16:54:34.383 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:54:34 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T16:54:34.383 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:54:34 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "nvme-gw create", "id": "client.nvmeof.nvmeof.c", "group": "", "pool": "mypool"} : dispatch 2024-03-26T16:54:34.383 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:54:34 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd='[{"prefix": "nvme-gw create", "id": "client.nvmeof.nvmeof.c", "group": "", "pool": "mypool"}]': finished 2024-03-26T16:54:34.384 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:54:34 smithi044 ceph-mon[30624]: Deploying daemon nvmeof.nvmeof.c on smithi149 2024-03-26T16:54:34.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:54:34 smithi149 ceph-mon[34678]: from='client.14598 -' entity='client.admin' cmd=[{"prefix": "orch apply nvmeof", "pool": "mypool", "placement": "3;smithi044=nvmeof.a;smithi064=nvmeof.b;smithi149=nvmeof.c", "target": ["mon-mgr", ""]}]: dispatch 2024-03-26T16:54:34.398 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:54:34 smithi149 ceph-mon[34678]: Saving service nvmeof.mypool spec with placement smithi044=nvmeof.a;smithi064=nvmeof.b;smithi149=nvmeof.c;count:3 2024-03-26T16:54:34.398 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:54:34 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:54:34.398 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:54:34 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-26T16:54:34.398 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:54:34 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T16:54:34.398 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:54:34 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-26T16:54:34.398 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:54:34 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:54:34.398 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:54:34 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "client.nvmeof.nvmeof.c", "caps": ["mon", "profile rbd", "osd", "allow all tag rbd *=*"]} : dispatch 2024-03-26T16:54:34.398 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:54:34 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "client.nvmeof.nvmeof.c", "caps": ["mon", "profile rbd", "osd", "allow all tag rbd *=*"]}]': finished 2024-03-26T16:54:34.398 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:54:34 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T16:54:34.398 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:54:34 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "nvme-gw create", "id": "client.nvmeof.nvmeof.c", "group": "", "pool": "mypool"} : dispatch 2024-03-26T16:54:34.398 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:54:34 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd='[{"prefix": "nvme-gw create", "id": "client.nvmeof.nvmeof.c", "group": "", "pool": "mypool"}]': finished 2024-03-26T16:54:34.398 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:54:34 smithi149 ceph-mon[34678]: Deploying daemon nvmeof.nvmeof.c on smithi149 2024-03-26T16:54:34.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:54:34 smithi064 ceph-mon[34420]: from='client.14598 -' entity='client.admin' cmd=[{"prefix": "orch apply nvmeof", "pool": "mypool", "placement": "3;smithi044=nvmeof.a;smithi064=nvmeof.b;smithi149=nvmeof.c", "target": ["mon-mgr", ""]}]: dispatch 2024-03-26T16:54:34.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:54:34 smithi064 ceph-mon[34420]: Saving service nvmeof.mypool spec with placement smithi044=nvmeof.a;smithi064=nvmeof.b;smithi149=nvmeof.c;count:3 2024-03-26T16:54:34.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:54:34 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:54:34.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:54:34 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-26T16:54:34.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:54:34 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T16:54:34.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:54:34 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-26T16:54:34.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:54:34 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:54:34.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:54:34 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "client.nvmeof.nvmeof.c", "caps": ["mon", "profile rbd", "osd", "allow all tag rbd *=*"]} : dispatch 2024-03-26T16:54:34.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:54:34 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "client.nvmeof.nvmeof.c", "caps": ["mon", "profile rbd", "osd", "allow all tag rbd *=*"]}]': finished 2024-03-26T16:54:34.557 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:54:34 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T16:54:34.557 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:54:34 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "nvme-gw create", "id": "client.nvmeof.nvmeof.c", "group": "", "pool": "mypool"} : dispatch 2024-03-26T16:54:34.557 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:54:34 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd='[{"prefix": "nvme-gw create", "id": "client.nvmeof.nvmeof.c", "group": "", "pool": "mypool"}]': finished 2024-03-26T16:54:34.557 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:54:34 smithi064 ceph-mon[34420]: Deploying daemon nvmeof.nvmeof.c on smithi149 2024-03-26T16:54:35.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:54:35 smithi149 ceph-mon[34678]: pgmap v236: 33 pgs: 33 active+clean; 577 KiB data, 221 MiB used, 715 GiB / 715 GiB avail; 170 B/s wr, 0 op/s 2024-03-26T16:54:35.433 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:54:35 smithi044 ceph-mon[30624]: pgmap v236: 33 pgs: 33 active+clean; 577 KiB data, 221 MiB used, 715 GiB / 715 GiB avail; 170 B/s wr, 0 op/s 2024-03-26T16:54:35.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:54:35 smithi064 ceph-mon[34420]: pgmap v236: 33 pgs: 33 active+clean; 577 KiB data, 221 MiB used, 715 GiB / 715 GiB avail; 170 B/s wr, 0 op/s 2024-03-26T16:54:36.451 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:54:36 smithi044 ceph-mon[30624]: pgmap v237: 33 pgs: 33 active+clean; 577 KiB data, 221 MiB used, 715 GiB / 715 GiB avail; 264 B/s wr, 0 op/s 2024-03-26T16:54:36.485 INFO:tasks.nvmeof:[nvmeof]: rbd create mypool/myimage2 --size 8192 2024-03-26T16:54:36.485 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bf9505fb569e9b95a78f9700ed8c4bd20508ef55 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4394d798-eb90-11ee-95d0-87774f69a715 -- rbd create mypool/myimage2 --size 8192 2024-03-26T16:54:36.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:54:36 smithi064 ceph-mon[34420]: pgmap v237: 33 pgs: 33 active+clean; 577 KiB data, 221 MiB used, 715 GiB / 715 GiB avail; 264 B/s wr, 0 op/s 2024-03-26T16:54:36.635 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:54:36 smithi149 ceph-mon[34678]: pgmap v237: 33 pgs: 33 active+clean; 577 KiB data, 221 MiB used, 715 GiB / 715 GiB avail; 264 B/s wr, 0 op/s 2024-03-26T16:54:36.733 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/4394d798-eb90-11ee-95d0-87774f69a715/mon.a/config 2024-03-26T16:54:38.209 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:54:38 smithi044 ceph-mon[30624]: pgmap v238: 33 pgs: 33 active+clean; 577 KiB data, 221 MiB used, 715 GiB / 715 GiB avail; 234 B/s rd, 351 B/s wr, 0 op/s 2024-03-26T16:54:38.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:54:38 smithi064 ceph-mon[34420]: pgmap v238: 33 pgs: 33 active+clean; 577 KiB data, 221 MiB used, 715 GiB / 715 GiB avail; 234 B/s rd, 351 B/s wr, 0 op/s 2024-03-26T16:54:38.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:54:38 smithi149 ceph-mon[34678]: pgmap v238: 33 pgs: 33 active+clean; 577 KiB data, 221 MiB used, 715 GiB / 715 GiB avail; 234 B/s rd, 351 B/s wr, 0 op/s 2024-03-26T16:54:38.793 INFO:tasks.nvmeof:[nvmeof]: rbd create mypool/myimage3 --size 8192 2024-03-26T16:54:38.793 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bf9505fb569e9b95a78f9700ed8c4bd20508ef55 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4394d798-eb90-11ee-95d0-87774f69a715 -- rbd create mypool/myimage3 --size 8192 2024-03-26T16:54:39.030 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/4394d798-eb90-11ee-95d0-87774f69a715/mon.a/config 2024-03-26T16:54:39.765 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:54:39 smithi044 ceph-mon[30624]: osdmap e59: 8 total, 8 up, 8 in 2024-03-26T16:54:39.805 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:54:39 smithi064 ceph-mon[34420]: osdmap e59: 8 total, 8 up, 8 in 2024-03-26T16:54:39.896 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:54:39 smithi149 ceph-mon[34678]: osdmap e59: 8 total, 8 up, 8 in 2024-03-26T16:54:40.765 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:54:40 smithi044 ceph-mon[30624]: pgmap v240: 33 pgs: 33 active+clean; 578 KiB data, 221 MiB used, 715 GiB / 715 GiB avail; 315 B/s rd, 525 B/s wr, 1 op/s 2024-03-26T16:54:40.797 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:54:40 smithi149 ceph-mon[34678]: pgmap v240: 33 pgs: 33 active+clean; 578 KiB data, 221 MiB used, 715 GiB / 715 GiB avail; 315 B/s rd, 525 B/s wr, 1 op/s 2024-03-26T16:54:40.805 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:54:40 smithi064 ceph-mon[34420]: pgmap v240: 33 pgs: 33 active+clean; 578 KiB data, 221 MiB used, 715 GiB / 715 GiB avail; 315 B/s rd, 525 B/s wr, 1 op/s 2024-03-26T16:54:41.296 INFO:tasks.nvmeof:[nvmeof]: rbd create mypool/myimage4 --size 8192 2024-03-26T16:54:41.296 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bf9505fb569e9b95a78f9700ed8c4bd20508ef55 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4394d798-eb90-11ee-95d0-87774f69a715 -- rbd create mypool/myimage4 --size 8192 2024-03-26T16:54:41.541 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/4394d798-eb90-11ee-95d0-87774f69a715/mon.a/config 2024-03-26T16:54:42.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:54:42 smithi044 ceph-mon[30624]: pgmap v241: 33 pgs: 33 active+clean; 578 KiB data, 221 MiB used, 715 GiB / 715 GiB avail; 819 B/s rd, 716 B/s wr, 1 op/s 2024-03-26T16:54:42.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:54:42 smithi149 ceph-mon[34678]: pgmap v241: 33 pgs: 33 active+clean; 578 KiB data, 221 MiB used, 715 GiB / 715 GiB avail; 819 B/s rd, 716 B/s wr, 1 op/s 2024-03-26T16:54:42.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:54:42 smithi064 ceph-mon[34420]: pgmap v241: 33 pgs: 33 active+clean; 578 KiB data, 221 MiB used, 715 GiB / 715 GiB avail; 819 B/s rd, 716 B/s wr, 1 op/s 2024-03-26T16:54:43.652 INFO:tasks.nvmeof:[nvmeof]: rbd create mypool/myimage5 --size 8192 2024-03-26T16:54:43.652 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bf9505fb569e9b95a78f9700ed8c4bd20508ef55 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4394d798-eb90-11ee-95d0-87774f69a715 -- rbd create mypool/myimage5 --size 8192 2024-03-26T16:54:43.890 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/4394d798-eb90-11ee-95d0-87774f69a715/mon.a/config 2024-03-26T16:54:44.262 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:54:44 smithi044 ceph-mon[30624]: pgmap v242: 33 pgs: 33 active+clean; 579 KiB data, 221 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1.5 KiB/s wr, 3 op/s 2024-03-26T16:54:44.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:54:44 smithi064 ceph-mon[34420]: pgmap v242: 33 pgs: 33 active+clean; 579 KiB data, 221 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1.5 KiB/s wr, 3 op/s 2024-03-26T16:54:44.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:54:44 smithi149 ceph-mon[34678]: pgmap v242: 33 pgs: 33 active+clean; 579 KiB data, 221 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1.5 KiB/s wr, 3 op/s 2024-03-26T16:54:46.289 INFO:tasks.nvmeof:[nvmeof]: rbd create mypool/myimage6 --size 8192 2024-03-26T16:54:46.289 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bf9505fb569e9b95a78f9700ed8c4bd20508ef55 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4394d798-eb90-11ee-95d0-87774f69a715 -- rbd create mypool/myimage6 --size 8192 2024-03-26T16:54:46.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:54:46 smithi044 ceph-mon[30624]: pgmap v243: 33 pgs: 33 active+clean; 579 KiB data, 221 MiB used, 715 GiB / 715 GiB avail; 1.8 KiB/s rd, 1.5 KiB/s wr, 4 op/s 2024-03-26T16:54:46.535 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/4394d798-eb90-11ee-95d0-87774f69a715/mon.a/config 2024-03-26T16:54:46.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:54:46 smithi064 ceph-mon[34420]: pgmap v243: 33 pgs: 33 active+clean; 579 KiB data, 221 MiB used, 715 GiB / 715 GiB avail; 1.8 KiB/s rd, 1.5 KiB/s wr, 4 op/s 2024-03-26T16:54:46.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:54:46 smithi149 ceph-mon[34678]: pgmap v243: 33 pgs: 33 active+clean; 579 KiB data, 221 MiB used, 715 GiB / 715 GiB avail; 1.8 KiB/s rd, 1.5 KiB/s wr, 4 op/s 2024-03-26T16:54:48.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:54:48 smithi044 ceph-mon[30624]: pgmap v244: 33 pgs: 33 active+clean; 579 KiB data, 221 MiB used, 715 GiB / 715 GiB avail; 2.1 KiB/s rd, 1.8 KiB/s wr, 5 op/s 2024-03-26T16:54:48.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:54:48 smithi064 ceph-mon[34420]: pgmap v244: 33 pgs: 33 active+clean; 579 KiB data, 221 MiB used, 715 GiB / 715 GiB avail; 2.1 KiB/s rd, 1.8 KiB/s wr, 5 op/s 2024-03-26T16:54:48.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:54:48 smithi149 ceph-mon[34678]: pgmap v244: 33 pgs: 33 active+clean; 579 KiB data, 221 MiB used, 715 GiB / 715 GiB avail; 2.1 KiB/s rd, 1.8 KiB/s wr, 5 op/s 2024-03-26T16:54:48.744 INFO:tasks.nvmeof:[nvmeof]: rbd create mypool/myimage7 --size 8192 2024-03-26T16:54:48.745 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bf9505fb569e9b95a78f9700ed8c4bd20508ef55 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4394d798-eb90-11ee-95d0-87774f69a715 -- rbd create mypool/myimage7 --size 8192 2024-03-26T16:54:48.988 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/4394d798-eb90-11ee-95d0-87774f69a715/mon.a/config 2024-03-26T16:54:50.428 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:54:50 smithi149 ceph-mon[34678]: pgmap v245: 33 pgs: 33 active+clean; 580 KiB data, 221 MiB used, 715 GiB / 715 GiB avail; 1.8 KiB/s rd, 1.7 KiB/s wr, 4 op/s 2024-03-26T16:54:50.440 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:54:50 smithi044 ceph-mon[30624]: pgmap v245: 33 pgs: 33 active+clean; 580 KiB data, 221 MiB used, 715 GiB / 715 GiB avail; 1.8 KiB/s rd, 1.7 KiB/s wr, 4 op/s 2024-03-26T16:54:50.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:54:50 smithi064 ceph-mon[34420]: pgmap v245: 33 pgs: 33 active+clean; 580 KiB data, 221 MiB used, 715 GiB / 715 GiB avail; 1.8 KiB/s rd, 1.7 KiB/s wr, 4 op/s 2024-03-26T16:54:51.192 INFO:tasks.nvmeof:[nvmeof]: rbd create mypool/myimage8 --size 8192 2024-03-26T16:54:51.192 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bf9505fb569e9b95a78f9700ed8c4bd20508ef55 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4394d798-eb90-11ee-95d0-87774f69a715 -- rbd create mypool/myimage8 --size 8192 2024-03-26T16:54:51.432 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/4394d798-eb90-11ee-95d0-87774f69a715/mon.a/config 2024-03-26T16:54:51.893 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:54:51 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:54:51.893 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:54:51 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:54:51.893 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:54:51 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:54:51.893 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:54:51 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "client.nvmeof.nvmeof.b", "caps": ["mon", "profile rbd", "osd", "allow all tag rbd *=*"]} : dispatch 2024-03-26T16:54:51.894 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:54:51 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "client.nvmeof.nvmeof.b", "caps": ["mon", "profile rbd", "osd", "allow all tag rbd *=*"]}]': finished 2024-03-26T16:54:51.894 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:54:51 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T16:54:51.894 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:54:51 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "nvme-gw create", "id": "client.nvmeof.nvmeof.b", "group": "", "pool": "mypool"} : dispatch 2024-03-26T16:54:51.894 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:54:51 smithi044 ceph-mon[30624]: from='client.? 172.21.15.149:0/2363732355' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"mon versions"} : dispatch 2024-03-26T16:54:51.896 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:54:51 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:54:51.896 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:54:51 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:54:51.896 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:54:51 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:54:51.897 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:54:51 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "client.nvmeof.nvmeof.b", "caps": ["mon", "profile rbd", "osd", "allow all tag rbd *=*"]} : dispatch 2024-03-26T16:54:51.897 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:54:51 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "client.nvmeof.nvmeof.b", "caps": ["mon", "profile rbd", "osd", "allow all tag rbd *=*"]}]': finished 2024-03-26T16:54:51.897 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:54:51 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T16:54:51.897 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:54:51 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "nvme-gw create", "id": "client.nvmeof.nvmeof.b", "group": "", "pool": "mypool"} : dispatch 2024-03-26T16:54:51.897 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:54:51 smithi149 ceph-mon[34678]: from='client.? 172.21.15.149:0/2363732355' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"mon versions"} : dispatch 2024-03-26T16:54:52.055 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:54:51 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:54:52.056 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:54:51 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:54:52.056 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:54:51 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:54:52.056 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:54:51 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "client.nvmeof.nvmeof.b", "caps": ["mon", "profile rbd", "osd", "allow all tag rbd *=*"]} : dispatch 2024-03-26T16:54:52.056 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:54:51 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "client.nvmeof.nvmeof.b", "caps": ["mon", "profile rbd", "osd", "allow all tag rbd *=*"]}]': finished 2024-03-26T16:54:52.056 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:54:51 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T16:54:52.056 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:54:51 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "nvme-gw create", "id": "client.nvmeof.nvmeof.b", "group": "", "pool": "mypool"} : dispatch 2024-03-26T16:54:52.056 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:54:51 smithi064 ceph-mon[34420]: from='client.? 172.21.15.149:0/2363732355' entity='client.nvmeof.nvmeof.c' cmd={"prefix":"mon versions"} : dispatch 2024-03-26T16:54:52.822 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:54:52 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd='[{"prefix": "nvme-gw create", "id": "client.nvmeof.nvmeof.b", "group": "", "pool": "mypool"}]': finished 2024-03-26T16:54:52.822 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:54:52 smithi149 ceph-mon[34678]: Deploying daemon nvmeof.nvmeof.b on smithi064 2024-03-26T16:54:52.822 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:54:52 smithi149 ceph-mon[34678]: pgmap v246: 33 pgs: 33 active+clean; 580 KiB data, 221 MiB used, 715 GiB / 715 GiB avail; 2.1 KiB/s rd, 1.6 KiB/s wr, 4 op/s 2024-03-26T16:54:52.883 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:54:52 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd='[{"prefix": "nvme-gw create", "id": "client.nvmeof.nvmeof.b", "group": "", "pool": "mypool"}]': finished 2024-03-26T16:54:52.883 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:54:52 smithi044 ceph-mon[30624]: Deploying daemon nvmeof.nvmeof.b on smithi064 2024-03-26T16:54:52.883 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:54:52 smithi044 ceph-mon[30624]: pgmap v246: 33 pgs: 33 active+clean; 580 KiB data, 221 MiB used, 715 GiB / 715 GiB avail; 2.1 KiB/s rd, 1.6 KiB/s wr, 4 op/s 2024-03-26T16:54:53.056 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:54:52 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd='[{"prefix": "nvme-gw create", "id": "client.nvmeof.nvmeof.b", "group": "", "pool": "mypool"}]': finished 2024-03-26T16:54:53.056 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:54:52 smithi064 ceph-mon[34420]: Deploying daemon nvmeof.nvmeof.b on smithi064 2024-03-26T16:54:53.056 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:54:52 smithi064 ceph-mon[34420]: pgmap v246: 33 pgs: 33 active+clean; 580 KiB data, 221 MiB used, 715 GiB / 715 GiB avail; 2.1 KiB/s rd, 1.6 KiB/s wr, 4 op/s 2024-03-26T16:54:53.669 INFO:tasks.nvmeof:[nvmeof]: rbd create mypool/myimage9 --size 8192 2024-03-26T16:54:53.669 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bf9505fb569e9b95a78f9700ed8c4bd20508ef55 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4394d798-eb90-11ee-95d0-87774f69a715 -- rbd create mypool/myimage9 --size 8192 2024-03-26T16:54:53.911 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/4394d798-eb90-11ee-95d0-87774f69a715/mon.a/config 2024-03-26T16:54:54.339 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:54:54 smithi044 ceph-mon[30624]: pgmap v247: 33 pgs: 33 active+clean; 580 KiB data, 221 MiB used, 715 GiB / 715 GiB avail; 2.6 KiB/s rd, 1.9 KiB/s wr, 5 op/s 2024-03-26T16:54:54.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:54:54 smithi064 ceph-mon[34420]: pgmap v247: 33 pgs: 33 active+clean; 580 KiB data, 221 MiB used, 715 GiB / 715 GiB avail; 2.6 KiB/s rd, 1.9 KiB/s wr, 5 op/s 2024-03-26T16:54:54.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:54:54 smithi149 ceph-mon[34678]: pgmap v247: 33 pgs: 33 active+clean; 580 KiB data, 221 MiB used, 715 GiB / 715 GiB avail; 2.6 KiB/s rd, 1.9 KiB/s wr, 5 op/s 2024-03-26T16:54:56.208 INFO:tasks.nvmeof:[nvmeof]: rbd create mypool/myimage10 --size 8192 2024-03-26T16:54:56.208 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bf9505fb569e9b95a78f9700ed8c4bd20508ef55 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4394d798-eb90-11ee-95d0-87774f69a715 -- rbd create mypool/myimage10 --size 8192 2024-03-26T16:54:56.434 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:54:56 smithi064 ceph-mon[34420]: pgmap v248: 33 pgs: 33 active+clean; 580 KiB data, 221 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 1.4 KiB/s wr, 4 op/s 2024-03-26T16:54:56.453 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/4394d798-eb90-11ee-95d0-87774f69a715/mon.a/config 2024-03-26T16:54:56.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:54:56 smithi044 ceph-mon[30624]: pgmap v248: 33 pgs: 33 active+clean; 580 KiB data, 221 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 1.4 KiB/s wr, 4 op/s 2024-03-26T16:54:56.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:54:56 smithi149 ceph-mon[34678]: pgmap v248: 33 pgs: 33 active+clean; 580 KiB data, 221 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 1.4 KiB/s wr, 4 op/s 2024-03-26T16:54:58.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:54:58 smithi044 ceph-mon[30624]: pgmap v249: 33 pgs: 33 active+clean; 581 KiB data, 221 MiB used, 715 GiB / 715 GiB avail; 2.6 KiB/s rd, 1.7 KiB/s wr, 5 op/s 2024-03-26T16:54:58.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:54:58 smithi064 ceph-mon[34420]: pgmap v249: 33 pgs: 33 active+clean; 581 KiB data, 221 MiB used, 715 GiB / 715 GiB avail; 2.6 KiB/s rd, 1.7 KiB/s wr, 5 op/s 2024-03-26T16:54:58.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:54:58 smithi149 ceph-mon[34678]: pgmap v249: 33 pgs: 33 active+clean; 581 KiB data, 221 MiB used, 715 GiB / 715 GiB avail; 2.6 KiB/s rd, 1.7 KiB/s wr, 5 op/s 2024-03-26T16:54:58.802 INFO:tasks.nvmeof:[nvmeof]: rbd create mypool/myimage11 --size 8192 2024-03-26T16:54:58.803 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bf9505fb569e9b95a78f9700ed8c4bd20508ef55 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4394d798-eb90-11ee-95d0-87774f69a715 -- rbd create mypool/myimage11 --size 8192 2024-03-26T16:54:59.044 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/4394d798-eb90-11ee-95d0-87774f69a715/mon.a/config 2024-03-26T16:55:00.381 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:55:00 smithi044 ceph-mon[30624]: pgmap v250: 33 pgs: 33 active+clean; 582 KiB data, 222 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 1.6 KiB/s wr, 5 op/s 2024-03-26T16:55:00.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:55:00 smithi064 ceph-mon[34420]: pgmap v250: 33 pgs: 33 active+clean; 582 KiB data, 222 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 1.6 KiB/s wr, 5 op/s 2024-03-26T16:55:00.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:55:00 smithi149 ceph-mon[34678]: pgmap v250: 33 pgs: 33 active+clean; 582 KiB data, 222 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 1.6 KiB/s wr, 5 op/s 2024-03-26T16:55:01.259 INFO:tasks.nvmeof:[nvmeof]: rbd create mypool/myimage12 --size 8192 2024-03-26T16:55:01.260 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bf9505fb569e9b95a78f9700ed8c4bd20508ef55 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4394d798-eb90-11ee-95d0-87774f69a715 -- rbd create mypool/myimage12 --size 8192 2024-03-26T16:55:01.512 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/4394d798-eb90-11ee-95d0-87774f69a715/mon.a/config 2024-03-26T16:55:02.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:55:02 smithi044 ceph-mon[30624]: pgmap v251: 33 pgs: 33 active+clean; 582 KiB data, 222 MiB used, 715 GiB / 715 GiB avail; 2.8 KiB/s rd, 1.5 KiB/s wr, 5 op/s 2024-03-26T16:55:02.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:55:02 smithi064 ceph-mon[34420]: pgmap v251: 33 pgs: 33 active+clean; 582 KiB data, 222 MiB used, 715 GiB / 715 GiB avail; 2.8 KiB/s rd, 1.5 KiB/s wr, 5 op/s 2024-03-26T16:55:02.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:55:02 smithi149 ceph-mon[34678]: pgmap v251: 33 pgs: 33 active+clean; 582 KiB data, 222 MiB used, 715 GiB / 715 GiB avail; 2.8 KiB/s rd, 1.5 KiB/s wr, 5 op/s 2024-03-26T16:55:03.784 INFO:tasks.nvmeof:[nvmeof]: rbd create mypool/myimage13 --size 8192 2024-03-26T16:55:03.785 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bf9505fb569e9b95a78f9700ed8c4bd20508ef55 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4394d798-eb90-11ee-95d0-87774f69a715 -- rbd create mypool/myimage13 --size 8192 2024-03-26T16:55:04.025 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/4394d798-eb90-11ee-95d0-87774f69a715/mon.a/config 2024-03-26T16:55:04.765 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:55:04 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:55:04.765 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:55:04 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:55:04.766 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:55:04 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:55:04.766 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:55:04 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "client.nvmeof.nvmeof.a", "caps": ["mon", "profile rbd", "osd", "allow all tag rbd *=*"]} : dispatch 2024-03-26T16:55:04.766 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:55:04 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "client.nvmeof.nvmeof.a", "caps": ["mon", "profile rbd", "osd", "allow all tag rbd *=*"]}]': finished 2024-03-26T16:55:04.766 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:55:04 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T16:55:04.766 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:55:04 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "nvme-gw create", "id": "client.nvmeof.nvmeof.a", "group": "", "pool": "mypool"} : dispatch 2024-03-26T16:55:04.766 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:55:04 smithi044 ceph-mon[30624]: pgmap v252: 33 pgs: 33 active+clean; 583 KiB data, 222 MiB used, 715 GiB / 715 GiB avail; 3.4 KiB/s rd, 1.9 KiB/s wr, 6 op/s 2024-03-26T16:55:04.766 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:55:04 smithi044 ceph-mon[30624]: from='client.? 172.21.15.64:0/2784228733' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"mon versions"} : dispatch 2024-03-26T16:55:04.871 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:55:04 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:55:04.871 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:55:04 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:55:04.871 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:55:04 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:55:04.871 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:55:04 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "client.nvmeof.nvmeof.a", "caps": ["mon", "profile rbd", "osd", "allow all tag rbd *=*"]} : dispatch 2024-03-26T16:55:04.872 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:55:04 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "client.nvmeof.nvmeof.a", "caps": ["mon", "profile rbd", "osd", "allow all tag rbd *=*"]}]': finished 2024-03-26T16:55:04.872 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:55:04 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T16:55:04.872 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:55:04 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "nvme-gw create", "id": "client.nvmeof.nvmeof.a", "group": "", "pool": "mypool"} : dispatch 2024-03-26T16:55:04.872 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:55:04 smithi149 ceph-mon[34678]: pgmap v252: 33 pgs: 33 active+clean; 583 KiB data, 222 MiB used, 715 GiB / 715 GiB avail; 3.4 KiB/s rd, 1.9 KiB/s wr, 6 op/s 2024-03-26T16:55:04.872 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:55:04 smithi149 ceph-mon[34678]: from='client.? 172.21.15.64:0/2784228733' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"mon versions"} : dispatch 2024-03-26T16:55:05.056 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:55:04 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:55:05.056 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:55:04 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:55:05.056 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:55:04 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:55:05.056 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:55:04 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "client.nvmeof.nvmeof.a", "caps": ["mon", "profile rbd", "osd", "allow all tag rbd *=*"]} : dispatch 2024-03-26T16:55:05.056 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:55:04 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "client.nvmeof.nvmeof.a", "caps": ["mon", "profile rbd", "osd", "allow all tag rbd *=*"]}]': finished 2024-03-26T16:55:05.056 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:55:04 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T16:55:05.056 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:55:04 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "nvme-gw create", "id": "client.nvmeof.nvmeof.a", "group": "", "pool": "mypool"} : dispatch 2024-03-26T16:55:05.056 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:55:04 smithi064 ceph-mon[34420]: pgmap v252: 33 pgs: 33 active+clean; 583 KiB data, 222 MiB used, 715 GiB / 715 GiB avail; 3.4 KiB/s rd, 1.9 KiB/s wr, 6 op/s 2024-03-26T16:55:05.056 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:55:04 smithi064 ceph-mon[34420]: from='client.? 172.21.15.64:0/2784228733' entity='client.nvmeof.nvmeof.b' cmd={"prefix":"mon versions"} : dispatch 2024-03-26T16:55:05.675 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:55:05 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd='[{"prefix": "nvme-gw create", "id": "client.nvmeof.nvmeof.a", "group": "", "pool": "mypool"}]': finished 2024-03-26T16:55:05.675 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:55:05 smithi044 ceph-mon[30624]: Deploying daemon nvmeof.nvmeof.a on smithi044 2024-03-26T16:55:06.055 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:55:05 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd='[{"prefix": "nvme-gw create", "id": "client.nvmeof.nvmeof.a", "group": "", "pool": "mypool"}]': finished 2024-03-26T16:55:06.055 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:55:05 smithi064 ceph-mon[34420]: Deploying daemon nvmeof.nvmeof.a on smithi044 2024-03-26T16:55:06.146 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:55:05 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd='[{"prefix": "nvme-gw create", "id": "client.nvmeof.nvmeof.a", "group": "", "pool": "mypool"}]': finished 2024-03-26T16:55:06.146 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:55:05 smithi149 ceph-mon[34678]: Deploying daemon nvmeof.nvmeof.a on smithi044 2024-03-26T16:55:06.552 INFO:tasks.nvmeof:[nvmeof]: rbd create mypool/myimage14 --size 8192 2024-03-26T16:55:06.552 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bf9505fb569e9b95a78f9700ed8c4bd20508ef55 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4394d798-eb90-11ee-95d0-87774f69a715 -- rbd create mypool/myimage14 --size 8192 2024-03-26T16:55:06.807 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:55:06 smithi044 ceph-mon[30624]: pgmap v253: 33 pgs: 33 active+clean; 583 KiB data, 222 MiB used, 715 GiB / 715 GiB avail; 2.9 KiB/s rd, 1.5 KiB/s wr, 5 op/s 2024-03-26T16:55:06.824 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/4394d798-eb90-11ee-95d0-87774f69a715/mon.a/config 2024-03-26T16:55:07.055 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:55:06 smithi064 ceph-mon[34420]: pgmap v253: 33 pgs: 33 active+clean; 583 KiB data, 222 MiB used, 715 GiB / 715 GiB avail; 2.9 KiB/s rd, 1.5 KiB/s wr, 5 op/s 2024-03-26T16:55:07.146 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:55:06 smithi149 ceph-mon[34678]: pgmap v253: 33 pgs: 33 active+clean; 583 KiB data, 222 MiB used, 715 GiB / 715 GiB avail; 2.9 KiB/s rd, 1.5 KiB/s wr, 5 op/s 2024-03-26T16:55:08.244 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:55:08 smithi044 ceph-mon[30624]: pgmap v254: 33 pgs: 33 active+clean; 583 KiB data, 222 MiB used, 715 GiB / 715 GiB avail; 2.8 KiB/s rd, 1.6 KiB/s wr, 5 op/s 2024-03-26T16:55:08.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:55:08 smithi064 ceph-mon[34420]: pgmap v254: 33 pgs: 33 active+clean; 583 KiB data, 222 MiB used, 715 GiB / 715 GiB avail; 2.8 KiB/s rd, 1.6 KiB/s wr, 5 op/s 2024-03-26T16:55:08.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:55:08 smithi149 ceph-mon[34678]: pgmap v254: 33 pgs: 33 active+clean; 583 KiB data, 222 MiB used, 715 GiB / 715 GiB avail; 2.8 KiB/s rd, 1.6 KiB/s wr, 5 op/s 2024-03-26T16:55:09.452 INFO:tasks.nvmeof:[nvmeof]: rbd create mypool/myimage15 --size 8192 2024-03-26T16:55:09.452 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bf9505fb569e9b95a78f9700ed8c4bd20508ef55 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4394d798-eb90-11ee-95d0-87774f69a715 -- rbd create mypool/myimage15 --size 8192 2024-03-26T16:55:09.736 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/4394d798-eb90-11ee-95d0-87774f69a715/mon.a/config 2024-03-26T16:55:10.426 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:55:10 smithi044 ceph-mon[30624]: pgmap v255: 33 pgs: 33 active+clean; 583 KiB data, 222 MiB used, 715 GiB / 715 GiB avail; 3.2 KiB/s rd, 1.2 KiB/s wr, 5 op/s 2024-03-26T16:55:10.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:55:10 smithi064 ceph-mon[34420]: pgmap v255: 33 pgs: 33 active+clean; 583 KiB data, 222 MiB used, 715 GiB / 715 GiB avail; 3.2 KiB/s rd, 1.2 KiB/s wr, 5 op/s 2024-03-26T16:55:10.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:55:10 smithi149 ceph-mon[34678]: pgmap v255: 33 pgs: 33 active+clean; 583 KiB data, 222 MiB used, 715 GiB / 715 GiB avail; 3.2 KiB/s rd, 1.2 KiB/s wr, 5 op/s 2024-03-26T16:55:12.339 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:55:12 smithi044 ceph-mon[30624]: pgmap v256: 33 pgs: 33 active+clean; 584 KiB data, 222 MiB used, 715 GiB / 715 GiB avail; 3.2 KiB/s rd, 1.2 KiB/s wr, 5 op/s 2024-03-26T16:55:12.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:55:12 smithi064 ceph-mon[34420]: pgmap v256: 33 pgs: 33 active+clean; 584 KiB data, 222 MiB used, 715 GiB / 715 GiB avail; 3.2 KiB/s rd, 1.2 KiB/s wr, 5 op/s 2024-03-26T16:55:12.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:55:12 smithi149 ceph-mon[34678]: pgmap v256: 33 pgs: 33 active+clean; 584 KiB data, 222 MiB used, 715 GiB / 715 GiB avail; 3.2 KiB/s rd, 1.2 KiB/s wr, 5 op/s 2024-03-26T16:55:14.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:55:14 smithi044 ceph-mon[30624]: pgmap v257: 33 pgs: 33 active+clean; 584 KiB data, 222 MiB used, 715 GiB / 715 GiB avail; 3.8 KiB/s rd, 1.7 KiB/s wr, 6 op/s 2024-03-26T16:55:14.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:55:14 smithi064 ceph-mon[34420]: pgmap v257: 33 pgs: 33 active+clean; 584 KiB data, 222 MiB used, 715 GiB / 715 GiB avail; 3.8 KiB/s rd, 1.7 KiB/s wr, 6 op/s 2024-03-26T16:55:14.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:55:14 smithi149 ceph-mon[34678]: pgmap v257: 33 pgs: 33 active+clean; 584 KiB data, 222 MiB used, 715 GiB / 715 GiB avail; 3.8 KiB/s rd, 1.7 KiB/s wr, 6 op/s 2024-03-26T16:55:16.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:55:16 smithi044 ceph-mon[30624]: pgmap v258: 33 pgs: 33 active+clean; 584 KiB data, 222 MiB used, 715 GiB / 715 GiB avail; 3.0 KiB/s rd, 1.1 KiB/s wr, 4 op/s 2024-03-26T16:55:16.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:55:16 smithi064 ceph-mon[34420]: pgmap v258: 33 pgs: 33 active+clean; 584 KiB data, 222 MiB used, 715 GiB / 715 GiB avail; 3.0 KiB/s rd, 1.1 KiB/s wr, 4 op/s 2024-03-26T16:55:16.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:55:16 smithi149 ceph-mon[34678]: pgmap v258: 33 pgs: 33 active+clean; 584 KiB data, 222 MiB used, 715 GiB / 715 GiB avail; 3.0 KiB/s rd, 1.1 KiB/s wr, 4 op/s 2024-03-26T16:55:17.347 INFO:tasks.nvmeof:[nvmeof]: rbd create mypool/myimage16 --size 8192 2024-03-26T16:55:17.347 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bf9505fb569e9b95a78f9700ed8c4bd20508ef55 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4394d798-eb90-11ee-95d0-87774f69a715 -- rbd create mypool/myimage16 --size 8192 2024-03-26T16:55:18.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:55:18 smithi044 ceph-mon[30624]: pgmap v259: 33 pgs: 33 active+clean; 585 KiB data, 222 MiB used, 715 GiB / 715 GiB avail; 2.7 KiB/s rd, 1.2 KiB/s wr, 4 op/s 2024-03-26T16:55:18.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:55:18 smithi064 ceph-mon[34420]: pgmap v259: 33 pgs: 33 active+clean; 585 KiB data, 222 MiB used, 715 GiB / 715 GiB avail; 2.7 KiB/s rd, 1.2 KiB/s wr, 4 op/s 2024-03-26T16:55:18.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:55:18 smithi149 ceph-mon[34678]: pgmap v259: 33 pgs: 33 active+clean; 585 KiB data, 222 MiB used, 715 GiB / 715 GiB avail; 2.7 KiB/s rd, 1.2 KiB/s wr, 4 op/s 2024-03-26T16:55:19.288 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/4394d798-eb90-11ee-95d0-87774f69a715/mon.a/config 2024-03-26T16:55:20.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:55:20 smithi044 ceph-mon[30624]: pgmap v260: 33 pgs: 33 active+clean; 585 KiB data, 222 MiB used, 715 GiB / 715 GiB avail; 3.1 KiB/s rd, 938 B/s wr, 4 op/s 2024-03-26T16:55:20.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:55:20 smithi064 ceph-mon[34420]: pgmap v260: 33 pgs: 33 active+clean; 585 KiB data, 222 MiB used, 715 GiB / 715 GiB avail; 3.1 KiB/s rd, 938 B/s wr, 4 op/s 2024-03-26T16:55:20.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:55:20 smithi149 ceph-mon[34678]: pgmap v260: 33 pgs: 33 active+clean; 585 KiB data, 222 MiB used, 715 GiB / 715 GiB avail; 3.1 KiB/s rd, 938 B/s wr, 4 op/s 2024-03-26T16:55:22.016 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:55:21 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:55:22.016 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:55:21 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:55:22.016 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:55:21 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:55:22.016 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:55:21 smithi044 ceph-mon[30624]: Checking pool "mypool" exists for service nvmeof.mypool 2024-03-26T16:55:22.016 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:55:21 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:55:22.016 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:55:21 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-26T16:55:22.016 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:55:21 smithi044 ceph-mon[30624]: from='client.? 172.21.15.44:0/2430495979' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"mon versions"} : dispatch 2024-03-26T16:55:22.055 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:55:21 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:55:22.056 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:55:21 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:55:22.056 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:55:21 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:55:22.056 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:55:21 smithi064 ceph-mon[34420]: Checking pool "mypool" exists for service nvmeof.mypool 2024-03-26T16:55:22.056 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:55:21 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:55:22.056 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:55:21 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-26T16:55:22.056 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:55:21 smithi064 ceph-mon[34420]: from='client.? 172.21.15.44:0/2430495979' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"mon versions"} : dispatch 2024-03-26T16:55:22.146 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:55:21 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:55:22.146 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:55:21 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:55:22.146 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:55:21 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:55:22.147 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:55:21 smithi149 ceph-mon[34678]: Checking pool "mypool" exists for service nvmeof.mypool 2024-03-26T16:55:22.147 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:55:21 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:55:22.147 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:55:21 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-26T16:55:22.147 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:55:21 smithi149 ceph-mon[34678]: from='client.? 172.21.15.44:0/2430495979' entity='client.nvmeof.nvmeof.a' cmd={"prefix":"mon versions"} : dispatch 2024-03-26T16:55:22.514 INFO:tasks.nvmeof:[nvmeof]: rbd create mypool/myimage17 --size 8192 2024-03-26T16:55:22.514 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bf9505fb569e9b95a78f9700ed8c4bd20508ef55 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4394d798-eb90-11ee-95d0-87774f69a715 -- rbd create mypool/myimage17 --size 8192 2024-03-26T16:55:23.056 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:55:22 smithi064 ceph-mon[34420]: pgmap v261: 33 pgs: 33 active+clean; 585 KiB data, 222 MiB used, 715 GiB / 715 GiB avail; 2.3 KiB/s rd, 938 B/s wr, 4 op/s 2024-03-26T16:55:23.056 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:55:22 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:55:23.056 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:55:22 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:55:23.056 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:55:22 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:55:23.056 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:55:22 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:55:23.146 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:55:22 smithi149 ceph-mon[34678]: pgmap v261: 33 pgs: 33 active+clean; 585 KiB data, 222 MiB used, 715 GiB / 715 GiB avail; 2.3 KiB/s rd, 938 B/s wr, 4 op/s 2024-03-26T16:55:23.146 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:55:22 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:55:23.146 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:55:22 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:55:23.146 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:55:22 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:55:23.146 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:55:22 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:55:23.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:55:22 smithi044 ceph-mon[30624]: pgmap v261: 33 pgs: 33 active+clean; 585 KiB data, 222 MiB used, 715 GiB / 715 GiB avail; 2.3 KiB/s rd, 938 B/s wr, 4 op/s 2024-03-26T16:55:23.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:55:22 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:55:23.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:55:22 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:55:23.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:55:22 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:55:23.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:55:22 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:55:23.266 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/4394d798-eb90-11ee-95d0-87774f69a715/mon.a/config 2024-03-26T16:55:24.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:55:24 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:55:24.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:55:24 smithi064 ceph-mon[34420]: mgrmap e15: x(active, since 7m) 2024-03-26T16:55:24.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:55:24 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:55:24.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:55:24 smithi149 ceph-mon[34678]: mgrmap e15: x(active, since 7m) 2024-03-26T16:55:24.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:55:24 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:55:24.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:55:24 smithi044 ceph-mon[30624]: mgrmap e15: x(active, since 7m) 2024-03-26T16:55:25.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:55:25 smithi044 ceph-mon[30624]: pgmap v262: 33 pgs: 33 active+clean; 585 KiB data, 222 MiB used, 715 GiB / 715 GiB avail; 3.4 KiB/s rd, 1023 B/s wr, 5 op/s 2024-03-26T16:55:25.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:55:25 smithi149 ceph-mon[34678]: pgmap v262: 33 pgs: 33 active+clean; 585 KiB data, 222 MiB used, 715 GiB / 715 GiB avail; 3.4 KiB/s rd, 1023 B/s wr, 5 op/s 2024-03-26T16:55:25.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:55:25 smithi064 ceph-mon[34420]: pgmap v262: 33 pgs: 33 active+clean; 585 KiB data, 222 MiB used, 715 GiB / 715 GiB avail; 3.4 KiB/s rd, 1023 B/s wr, 5 op/s 2024-03-26T16:55:25.806 INFO:tasks.nvmeof:[nvmeof]: rbd create mypool/myimage18 --size 8192 2024-03-26T16:55:25.807 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bf9505fb569e9b95a78f9700ed8c4bd20508ef55 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4394d798-eb90-11ee-95d0-87774f69a715 -- rbd create mypool/myimage18 --size 8192 2024-03-26T16:55:26.074 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/4394d798-eb90-11ee-95d0-87774f69a715/mon.a/config 2024-03-26T16:55:27.146 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:55:26 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:55:27.146 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:55:26 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:55:27.146 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:55:26 smithi149 ceph-mon[34678]: pgmap v263: 33 pgs: 33 active+clean; 585 KiB data, 222 MiB used, 715 GiB / 715 GiB avail; 2.8 KiB/s rd, 597 B/s wr, 3 op/s 2024-03-26T16:55:27.163 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:55:26 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:55:27.163 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:55:26 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:55:27.163 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:55:26 smithi044 ceph-mon[30624]: pgmap v263: 33 pgs: 33 active+clean; 585 KiB data, 222 MiB used, 715 GiB / 715 GiB avail; 2.8 KiB/s rd, 597 B/s wr, 3 op/s 2024-03-26T16:55:27.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:55:26 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:55:27.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:55:26 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:55:27.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:55:26 smithi064 ceph-mon[34420]: pgmap v263: 33 pgs: 33 active+clean; 585 KiB data, 222 MiB used, 715 GiB / 715 GiB avail; 2.8 KiB/s rd, 597 B/s wr, 3 op/s 2024-03-26T16:55:28.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:55:27 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T16:55:28.266 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:55:27 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-26T16:55:28.266 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:55:27 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:55:28.266 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:55:27 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "dashboard nvmeof-gateway-list"} : dispatch 2024-03-26T16:55:28.266 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:55:27 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:55:28.266 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:55:27 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "dashboard nvmeof-gateway-add", "name": "smithi044"} : dispatch 2024-03-26T16:55:28.266 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:55:27 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:55:28.266 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:55:27 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:55:28.266 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:55:27 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "dashboard nvmeof-gateway-add", "name": "smithi064"} : dispatch 2024-03-26T16:55:28.266 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:55:27 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:55:28.266 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:55:27 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:55:28.266 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:55:27 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "dashboard nvmeof-gateway-add", "name": "smithi149"} : dispatch 2024-03-26T16:55:28.266 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:55:27 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:55:28.266 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:55:27 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:55:28.266 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:55:27 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-26T16:55:28.267 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:55:27 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T16:55:28.267 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:55:27 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-26T16:55:28.267 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:55:27 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:55:28.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:55:27 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T16:55:28.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:55:27 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-26T16:55:28.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:55:27 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:55:28.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:55:27 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "dashboard nvmeof-gateway-list"} : dispatch 2024-03-26T16:55:28.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:55:27 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:55:28.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:55:27 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "dashboard nvmeof-gateway-add", "name": "smithi044"} : dispatch 2024-03-26T16:55:28.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:55:27 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:55:28.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:55:27 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:55:28.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:55:27 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "dashboard nvmeof-gateway-add", "name": "smithi064"} : dispatch 2024-03-26T16:55:28.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:55:27 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:55:28.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:55:27 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:55:28.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:55:27 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "dashboard nvmeof-gateway-add", "name": "smithi149"} : dispatch 2024-03-26T16:55:28.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:55:27 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:55:28.307 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:55:27 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:55:28.307 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:55:27 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-26T16:55:28.307 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:55:27 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T16:55:28.307 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:55:27 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-26T16:55:28.307 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:55:27 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:55:28.396 INFO:tasks.nvmeof:[nvmeof]: rbd create mypool/myimage19 --size 8192 2024-03-26T16:55:28.396 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bf9505fb569e9b95a78f9700ed8c4bd20508ef55 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4394d798-eb90-11ee-95d0-87774f69a715 -- rbd create mypool/myimage19 --size 8192 2024-03-26T16:55:28.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:55:27 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T16:55:28.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:55:27 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-26T16:55:28.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:55:27 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:55:28.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:55:27 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "dashboard nvmeof-gateway-list"} : dispatch 2024-03-26T16:55:28.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:55:27 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:55:28.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:55:27 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "dashboard nvmeof-gateway-add", "name": "smithi044"} : dispatch 2024-03-26T16:55:28.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:55:27 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:55:28.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:55:27 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:55:28.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:55:27 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "dashboard nvmeof-gateway-add", "name": "smithi064"} : dispatch 2024-03-26T16:55:28.398 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:55:27 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:55:28.398 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:55:27 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:55:28.398 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:55:27 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "dashboard nvmeof-gateway-add", "name": "smithi149"} : dispatch 2024-03-26T16:55:28.398 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:55:27 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:55:28.398 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:55:27 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:55:28.398 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:55:27 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-26T16:55:28.398 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:55:27 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T16:55:28.398 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:55:27 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-26T16:55:28.398 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:55:27 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:55:28.640 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/4394d798-eb90-11ee-95d0-87774f69a715/mon.a/config 2024-03-26T16:55:29.033 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:55:28 smithi044 ceph-mon[30624]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard nvmeof-gateway-list"}]: dispatch 2024-03-26T16:55:29.033 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:55:28 smithi044 ceph-mon[30624]: Adding NVMeoF gateway 172.21.15.44:5500 to Dashboard 2024-03-26T16:55:29.033 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:55:28 smithi044 ceph-mon[30624]: Adding NVMeoF gateway 172.21.15.64:5500 to Dashboard 2024-03-26T16:55:29.033 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:55:28 smithi044 ceph-mon[30624]: Adding NVMeoF gateway 172.21.15.149:5500 to Dashboard 2024-03-26T16:55:29.033 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:55:28 smithi044 ceph-mon[30624]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard nvmeof-gateway-add", "name": "smithi044"}]: dispatch 2024-03-26T16:55:29.033 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:55:28 smithi044 ceph-mon[30624]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard nvmeof-gateway-add", "name": "smithi064"}]: dispatch 2024-03-26T16:55:29.033 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:55:28 smithi044 ceph-mon[30624]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard nvmeof-gateway-add", "name": "smithi149"}]: dispatch 2024-03-26T16:55:29.033 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:55:28 smithi044 ceph-mon[30624]: pgmap v264: 33 pgs: 33 active+clean; 586 KiB data, 222 MiB used, 715 GiB / 715 GiB avail; 2.8 KiB/s rd, 853 B/s wr, 4 op/s 2024-03-26T16:55:29.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:55:28 smithi064 ceph-mon[34420]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard nvmeof-gateway-list"}]: dispatch 2024-03-26T16:55:29.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:55:28 smithi064 ceph-mon[34420]: Adding NVMeoF gateway 172.21.15.44:5500 to Dashboard 2024-03-26T16:55:29.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:55:28 smithi064 ceph-mon[34420]: Adding NVMeoF gateway 172.21.15.64:5500 to Dashboard 2024-03-26T16:55:29.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:55:28 smithi064 ceph-mon[34420]: Adding NVMeoF gateway 172.21.15.149:5500 to Dashboard 2024-03-26T16:55:29.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:55:28 smithi064 ceph-mon[34420]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard nvmeof-gateway-add", "name": "smithi044"}]: dispatch 2024-03-26T16:55:29.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:55:28 smithi064 ceph-mon[34420]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard nvmeof-gateway-add", "name": "smithi064"}]: dispatch 2024-03-26T16:55:29.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:55:28 smithi064 ceph-mon[34420]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard nvmeof-gateway-add", "name": "smithi149"}]: dispatch 2024-03-26T16:55:29.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:55:28 smithi064 ceph-mon[34420]: pgmap v264: 33 pgs: 33 active+clean; 586 KiB data, 222 MiB used, 715 GiB / 715 GiB avail; 2.8 KiB/s rd, 853 B/s wr, 4 op/s 2024-03-26T16:55:29.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:55:28 smithi149 ceph-mon[34678]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard nvmeof-gateway-list"}]: dispatch 2024-03-26T16:55:29.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:55:28 smithi149 ceph-mon[34678]: Adding NVMeoF gateway 172.21.15.44:5500 to Dashboard 2024-03-26T16:55:29.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:55:28 smithi149 ceph-mon[34678]: Adding NVMeoF gateway 172.21.15.64:5500 to Dashboard 2024-03-26T16:55:29.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:55:28 smithi149 ceph-mon[34678]: Adding NVMeoF gateway 172.21.15.149:5500 to Dashboard 2024-03-26T16:55:29.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:55:28 smithi149 ceph-mon[34678]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard nvmeof-gateway-add", "name": "smithi044"}]: dispatch 2024-03-26T16:55:29.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:55:28 smithi149 ceph-mon[34678]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard nvmeof-gateway-add", "name": "smithi064"}]: dispatch 2024-03-26T16:55:29.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:55:28 smithi149 ceph-mon[34678]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard nvmeof-gateway-add", "name": "smithi149"}]: dispatch 2024-03-26T16:55:29.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:55:28 smithi149 ceph-mon[34678]: pgmap v264: 33 pgs: 33 active+clean; 586 KiB data, 222 MiB used, 715 GiB / 715 GiB avail; 2.8 KiB/s rd, 853 B/s wr, 4 op/s 2024-03-26T16:55:30.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:55:30 smithi044 ceph-mon[30624]: pgmap v265: 33 pgs: 33 active+clean; 586 KiB data, 222 MiB used, 715 GiB / 715 GiB avail; 3.7 KiB/s rd, 853 B/s wr, 5 op/s 2024-03-26T16:55:30.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:55:30 smithi064 ceph-mon[34420]: pgmap v265: 33 pgs: 33 active+clean; 586 KiB data, 222 MiB used, 715 GiB / 715 GiB avail; 3.7 KiB/s rd, 853 B/s wr, 5 op/s 2024-03-26T16:55:30.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:55:30 smithi149 ceph-mon[34678]: pgmap v265: 33 pgs: 33 active+clean; 586 KiB data, 222 MiB used, 715 GiB / 715 GiB avail; 3.7 KiB/s rd, 853 B/s wr, 5 op/s 2024-03-26T16:55:30.927 INFO:tasks.nvmeof:[nvmeof]: rbd create mypool/myimage20 --size 8192 2024-03-26T16:55:30.928 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bf9505fb569e9b95a78f9700ed8c4bd20508ef55 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4394d798-eb90-11ee-95d0-87774f69a715 -- rbd create mypool/myimage20 --size 8192 2024-03-26T16:55:31.171 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/4394d798-eb90-11ee-95d0-87774f69a715/mon.a/config 2024-03-26T16:55:32.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:55:32 smithi044 ceph-mon[30624]: pgmap v266: 33 pgs: 33 active+clean; 586 KiB data, 222 MiB used, 715 GiB / 715 GiB avail; 3.5 KiB/s rd, 1023 B/s wr, 5 op/s 2024-03-26T16:55:32.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:55:32 smithi064 ceph-mon[34420]: pgmap v266: 33 pgs: 33 active+clean; 586 KiB data, 222 MiB used, 715 GiB / 715 GiB avail; 3.5 KiB/s rd, 1023 B/s wr, 5 op/s 2024-03-26T16:55:32.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:55:32 smithi149 ceph-mon[34678]: pgmap v266: 33 pgs: 33 active+clean; 586 KiB data, 222 MiB used, 715 GiB / 715 GiB avail; 3.5 KiB/s rd, 1023 B/s wr, 5 op/s 2024-03-26T16:55:33.435 INFO:tasks.nvmeof:[nvmeof]: rbd create mypool/myimage21 --size 8192 2024-03-26T16:55:33.436 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bf9505fb569e9b95a78f9700ed8c4bd20508ef55 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4394d798-eb90-11ee-95d0-87774f69a715 -- rbd create mypool/myimage21 --size 8192 2024-03-26T16:55:33.684 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/4394d798-eb90-11ee-95d0-87774f69a715/mon.a/config 2024-03-26T16:55:34.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:55:34 smithi044 ceph-mon[30624]: pgmap v267: 33 pgs: 33 active+clean; 588 KiB data, 222 MiB used, 715 GiB / 715 GiB avail; 4.8 KiB/s rd, 1.3 KiB/s wr, 7 op/s 2024-03-26T16:55:34.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:55:34 smithi064 ceph-mon[34420]: pgmap v267: 33 pgs: 33 active+clean; 588 KiB data, 222 MiB used, 715 GiB / 715 GiB avail; 4.8 KiB/s rd, 1.3 KiB/s wr, 7 op/s 2024-03-26T16:55:34.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:55:34 smithi149 ceph-mon[34678]: pgmap v267: 33 pgs: 33 active+clean; 588 KiB data, 222 MiB used, 715 GiB / 715 GiB avail; 4.8 KiB/s rd, 1.3 KiB/s wr, 7 op/s 2024-03-26T16:55:35.906 INFO:tasks.nvmeof:[nvmeof]: rbd create mypool/myimage22 --size 8192 2024-03-26T16:55:35.907 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bf9505fb569e9b95a78f9700ed8c4bd20508ef55 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4394d798-eb90-11ee-95d0-87774f69a715 -- rbd create mypool/myimage22 --size 8192 2024-03-26T16:55:36.155 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/4394d798-eb90-11ee-95d0-87774f69a715/mon.a/config 2024-03-26T16:55:36.475 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:55:36 smithi044 ceph-mon[30624]: pgmap v268: 33 pgs: 33 active+clean; 588 KiB data, 222 MiB used, 715 GiB / 715 GiB avail; 3.6 KiB/s rd, 1.1 KiB/s wr, 5 op/s 2024-03-26T16:55:36.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:55:36 smithi064 ceph-mon[34420]: pgmap v268: 33 pgs: 33 active+clean; 588 KiB data, 222 MiB used, 715 GiB / 715 GiB avail; 3.6 KiB/s rd, 1.1 KiB/s wr, 5 op/s 2024-03-26T16:55:36.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:55:36 smithi149 ceph-mon[34678]: pgmap v268: 33 pgs: 33 active+clean; 588 KiB data, 222 MiB used, 715 GiB / 715 GiB avail; 3.6 KiB/s rd, 1.1 KiB/s wr, 5 op/s 2024-03-26T16:55:38.303 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:55:38 smithi044 ceph-mon[30624]: pgmap v269: 33 pgs: 33 active+clean; 588 KiB data, 222 MiB used, 715 GiB / 715 GiB avail; 3.6 KiB/s rd, 1.5 KiB/s wr, 6 op/s 2024-03-26T16:55:38.330 INFO:tasks.nvmeof:[nvmeof]: rbd create mypool/myimage23 --size 8192 2024-03-26T16:55:38.330 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bf9505fb569e9b95a78f9700ed8c4bd20508ef55 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4394d798-eb90-11ee-95d0-87774f69a715 -- rbd create mypool/myimage23 --size 8192 2024-03-26T16:55:38.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:55:38 smithi064 ceph-mon[34420]: pgmap v269: 33 pgs: 33 active+clean; 588 KiB data, 222 MiB used, 715 GiB / 715 GiB avail; 3.6 KiB/s rd, 1.5 KiB/s wr, 6 op/s 2024-03-26T16:55:38.573 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/4394d798-eb90-11ee-95d0-87774f69a715/mon.a/config 2024-03-26T16:55:38.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:55:38 smithi149 ceph-mon[34678]: pgmap v269: 33 pgs: 33 active+clean; 588 KiB data, 222 MiB used, 715 GiB / 715 GiB avail; 3.6 KiB/s rd, 1.5 KiB/s wr, 6 op/s 2024-03-26T16:55:40.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:55:40 smithi064 ceph-mon[34420]: pgmap v270: 33 pgs: 33 active+clean; 588 KiB data, 222 MiB used, 715 GiB / 715 GiB avail; 4.4 KiB/s rd, 1.3 KiB/s wr, 6 op/s 2024-03-26T16:55:40.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:55:40 smithi044 ceph-mon[30624]: pgmap v270: 33 pgs: 33 active+clean; 588 KiB data, 222 MiB used, 715 GiB / 715 GiB avail; 4.4 KiB/s rd, 1.3 KiB/s wr, 6 op/s 2024-03-26T16:55:40.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:55:40 smithi149 ceph-mon[34678]: pgmap v270: 33 pgs: 33 active+clean; 588 KiB data, 222 MiB used, 715 GiB / 715 GiB avail; 4.4 KiB/s rd, 1.3 KiB/s wr, 6 op/s 2024-03-26T16:55:40.693 INFO:tasks.nvmeof:[nvmeof]: rbd create mypool/myimage24 --size 8192 2024-03-26T16:55:40.693 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bf9505fb569e9b95a78f9700ed8c4bd20508ef55 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4394d798-eb90-11ee-95d0-87774f69a715 -- rbd create mypool/myimage24 --size 8192 2024-03-26T16:55:40.933 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/4394d798-eb90-11ee-95d0-87774f69a715/mon.a/config 2024-03-26T16:55:42.250 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:55:42 smithi044 ceph-mon[30624]: pgmap v271: 33 pgs: 33 active+clean; 589 KiB data, 222 MiB used, 715 GiB / 715 GiB avail; 4.0 KiB/s rd, 1.4 KiB/s wr, 6 op/s 2024-03-26T16:55:42.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:55:42 smithi064 ceph-mon[34420]: pgmap v271: 33 pgs: 33 active+clean; 589 KiB data, 222 MiB used, 715 GiB / 715 GiB avail; 4.0 KiB/s rd, 1.4 KiB/s wr, 6 op/s 2024-03-26T16:55:42.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:55:42 smithi149 ceph-mon[34678]: pgmap v271: 33 pgs: 33 active+clean; 589 KiB data, 222 MiB used, 715 GiB / 715 GiB avail; 4.0 KiB/s rd, 1.4 KiB/s wr, 6 op/s 2024-03-26T16:55:43.072 INFO:tasks.nvmeof:[nvmeof]: rbd create mypool/myimage25 --size 8192 2024-03-26T16:55:43.073 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bf9505fb569e9b95a78f9700ed8c4bd20508ef55 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4394d798-eb90-11ee-95d0-87774f69a715 -- rbd create mypool/myimage25 --size 8192 2024-03-26T16:55:43.309 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/4394d798-eb90-11ee-95d0-87774f69a715/mon.a/config 2024-03-26T16:55:44.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:55:44 smithi064 ceph-mon[34420]: pgmap v272: 33 pgs: 33 active+clean; 590 KiB data, 222 MiB used, 715 GiB / 715 GiB avail; 5.1 KiB/s rd, 1.8 KiB/s wr, 8 op/s 2024-03-26T16:55:44.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:55:44 smithi044 ceph-mon[30624]: pgmap v272: 33 pgs: 33 active+clean; 590 KiB data, 222 MiB used, 715 GiB / 715 GiB avail; 5.1 KiB/s rd, 1.8 KiB/s wr, 8 op/s 2024-03-26T16:55:44.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:55:44 smithi149 ceph-mon[34678]: pgmap v272: 33 pgs: 33 active+clean; 590 KiB data, 222 MiB used, 715 GiB / 715 GiB avail; 5.1 KiB/s rd, 1.8 KiB/s wr, 8 op/s 2024-03-26T16:55:46.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:55:46 smithi064 ceph-mon[34420]: pgmap v273: 33 pgs: 33 active+clean; 590 KiB data, 222 MiB used, 715 GiB / 715 GiB avail; 3.9 KiB/s rd, 1.4 KiB/s wr, 6 op/s 2024-03-26T16:55:46.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:55:46 smithi044 ceph-mon[30624]: pgmap v273: 33 pgs: 33 active+clean; 590 KiB data, 222 MiB used, 715 GiB / 715 GiB avail; 3.9 KiB/s rd, 1.4 KiB/s wr, 6 op/s 2024-03-26T16:55:46.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:55:46 smithi149 ceph-mon[34678]: pgmap v273: 33 pgs: 33 active+clean; 590 KiB data, 222 MiB used, 715 GiB / 715 GiB avail; 3.9 KiB/s rd, 1.4 KiB/s wr, 6 op/s 2024-03-26T16:55:48.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:55:48 smithi064 ceph-mon[34420]: pgmap v274: 33 pgs: 33 active+clean; 590 KiB data, 222 MiB used, 715 GiB / 715 GiB avail; 3.9 KiB/s rd, 1.6 KiB/s wr, 6 op/s 2024-03-26T16:55:48.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:55:48 smithi044 ceph-mon[30624]: pgmap v274: 33 pgs: 33 active+clean; 590 KiB data, 222 MiB used, 715 GiB / 715 GiB avail; 3.9 KiB/s rd, 1.6 KiB/s wr, 6 op/s 2024-03-26T16:55:48.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:55:48 smithi149 ceph-mon[34678]: pgmap v274: 33 pgs: 33 active+clean; 590 KiB data, 222 MiB used, 715 GiB / 715 GiB avail; 3.9 KiB/s rd, 1.6 KiB/s wr, 6 op/s 2024-03-26T16:55:50.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:55:50 smithi064 ceph-mon[34420]: pgmap v275: 33 pgs: 33 active+clean; 590 KiB data, 222 MiB used, 715 GiB / 715 GiB avail; 4.5 KiB/s rd, 1.1 KiB/s wr, 6 op/s 2024-03-26T16:55:50.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:55:50 smithi044 ceph-mon[30624]: pgmap v275: 33 pgs: 33 active+clean; 590 KiB data, 222 MiB used, 715 GiB / 715 GiB avail; 4.5 KiB/s rd, 1.1 KiB/s wr, 6 op/s 2024-03-26T16:55:50.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:55:50 smithi149 ceph-mon[34678]: pgmap v275: 33 pgs: 33 active+clean; 590 KiB data, 222 MiB used, 715 GiB / 715 GiB avail; 4.5 KiB/s rd, 1.1 KiB/s wr, 6 op/s 2024-03-26T16:55:51.044 INFO:tasks.nvmeof:[nvmeof]: rbd create mypool/myimage26 --size 8192 2024-03-26T16:55:51.044 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bf9505fb569e9b95a78f9700ed8c4bd20508ef55 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4394d798-eb90-11ee-95d0-87774f69a715 -- rbd create mypool/myimage26 --size 8192 2024-03-26T16:55:51.290 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/4394d798-eb90-11ee-95d0-87774f69a715/mon.a/config 2024-03-26T16:55:52.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:55:52 smithi064 ceph-mon[34420]: pgmap v276: 33 pgs: 33 active+clean; 590 KiB data, 222 MiB used, 715 GiB / 715 GiB avail; 3.7 KiB/s rd, 1.2 KiB/s wr, 5 op/s 2024-03-26T16:55:52.467 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:55:52 smithi044 ceph-mon[30624]: pgmap v276: 33 pgs: 33 active+clean; 590 KiB data, 222 MiB used, 715 GiB / 715 GiB avail; 3.7 KiB/s rd, 1.2 KiB/s wr, 5 op/s 2024-03-26T16:55:52.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:55:52 smithi149 ceph-mon[34678]: pgmap v276: 33 pgs: 33 active+clean; 590 KiB data, 222 MiB used, 715 GiB / 715 GiB avail; 3.7 KiB/s rd, 1.2 KiB/s wr, 5 op/s 2024-03-26T16:55:53.534 INFO:tasks.nvmeof:[nvmeof]: rbd create mypool/myimage27 --size 8192 2024-03-26T16:55:53.534 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bf9505fb569e9b95a78f9700ed8c4bd20508ef55 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4394d798-eb90-11ee-95d0-87774f69a715 -- rbd create mypool/myimage27 --size 8192 2024-03-26T16:55:53.786 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/4394d798-eb90-11ee-95d0-87774f69a715/mon.a/config 2024-03-26T16:55:54.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:55:54 smithi064 ceph-mon[34420]: pgmap v277: 33 pgs: 33 active+clean; 590 KiB data, 222 MiB used, 715 GiB / 715 GiB avail; 4.3 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-03-26T16:55:54.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:55:54 smithi044 ceph-mon[30624]: pgmap v277: 33 pgs: 33 active+clean; 590 KiB data, 222 MiB used, 715 GiB / 715 GiB avail; 4.3 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-03-26T16:55:54.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:55:54 smithi149 ceph-mon[34678]: pgmap v277: 33 pgs: 33 active+clean; 590 KiB data, 222 MiB used, 715 GiB / 715 GiB avail; 4.3 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-03-26T16:55:56.130 INFO:tasks.nvmeof:[nvmeof]: rbd create mypool/myimage28 --size 8192 2024-03-26T16:55:56.131 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bf9505fb569e9b95a78f9700ed8c4bd20508ef55 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4394d798-eb90-11ee-95d0-87774f69a715 -- rbd create mypool/myimage28 --size 8192 2024-03-26T16:55:56.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:55:56 smithi064 ceph-mon[34420]: pgmap v278: 33 pgs: 33 active+clean; 590 KiB data, 222 MiB used, 715 GiB / 715 GiB avail; 3.1 KiB/s rd, 767 B/s wr, 4 op/s 2024-03-26T16:55:56.370 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/4394d798-eb90-11ee-95d0-87774f69a715/mon.a/config 2024-03-26T16:55:56.491 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:55:56 smithi044 ceph-mon[30624]: pgmap v278: 33 pgs: 33 active+clean; 590 KiB data, 222 MiB used, 715 GiB / 715 GiB avail; 3.1 KiB/s rd, 767 B/s wr, 4 op/s 2024-03-26T16:55:56.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:55:56 smithi149 ceph-mon[34678]: pgmap v278: 33 pgs: 33 active+clean; 590 KiB data, 222 MiB used, 715 GiB / 715 GiB avail; 3.1 KiB/s rd, 767 B/s wr, 4 op/s 2024-03-26T16:55:58.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:55:58 smithi064 ceph-mon[34420]: pgmap v279: 33 pgs: 33 active+clean; 591 KiB data, 222 MiB used, 715 GiB / 715 GiB avail; 3.2 KiB/s rd, 1.1 KiB/s wr, 5 op/s 2024-03-26T16:55:58.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:55:58 smithi044 ceph-mon[30624]: pgmap v279: 33 pgs: 33 active+clean; 591 KiB data, 222 MiB used, 715 GiB / 715 GiB avail; 3.2 KiB/s rd, 1.1 KiB/s wr, 5 op/s 2024-03-26T16:55:58.569 INFO:tasks.nvmeof:[nvmeof]: rbd create mypool/myimage29 --size 8192 2024-03-26T16:55:58.569 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bf9505fb569e9b95a78f9700ed8c4bd20508ef55 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4394d798-eb90-11ee-95d0-87774f69a715 -- rbd create mypool/myimage29 --size 8192 2024-03-26T16:55:58.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:55:58 smithi149 ceph-mon[34678]: pgmap v279: 33 pgs: 33 active+clean; 591 KiB data, 222 MiB used, 715 GiB / 715 GiB avail; 3.2 KiB/s rd, 1.1 KiB/s wr, 5 op/s 2024-03-26T16:55:58.811 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/4394d798-eb90-11ee-95d0-87774f69a715/mon.a/config 2024-03-26T16:56:00.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:56:00 smithi044 ceph-mon[30624]: pgmap v280: 33 pgs: 33 active+clean; 591 KiB data, 222 MiB used, 715 GiB / 715 GiB avail; 4.1 KiB/s rd, 938 B/s wr, 5 op/s 2024-03-26T16:56:00.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:56:00 smithi064 ceph-mon[34420]: pgmap v280: 33 pgs: 33 active+clean; 591 KiB data, 222 MiB used, 715 GiB / 715 GiB avail; 4.1 KiB/s rd, 938 B/s wr, 5 op/s 2024-03-26T16:56:00.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:56:00 smithi149 ceph-mon[34678]: pgmap v280: 33 pgs: 33 active+clean; 591 KiB data, 222 MiB used, 715 GiB / 715 GiB avail; 4.1 KiB/s rd, 938 B/s wr, 5 op/s 2024-03-26T16:56:00.893 INFO:tasks.nvmeof:[nvmeof]: rbd create mypool/myimage30 --size 8192 2024-03-26T16:56:00.893 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bf9505fb569e9b95a78f9700ed8c4bd20508ef55 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4394d798-eb90-11ee-95d0-87774f69a715 -- rbd create mypool/myimage30 --size 8192 2024-03-26T16:56:01.135 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/4394d798-eb90-11ee-95d0-87774f69a715/mon.a/config 2024-03-26T16:56:02.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:56:02 smithi064 ceph-mon[34420]: pgmap v281: 33 pgs: 33 active+clean; 591 KiB data, 222 MiB used, 715 GiB / 715 GiB avail; 3.4 KiB/s rd, 1.1 KiB/s wr, 5 op/s 2024-03-26T16:56:02.384 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:56:02 smithi044 ceph-mon[30624]: pgmap v281: 33 pgs: 33 active+clean; 591 KiB data, 222 MiB used, 715 GiB / 715 GiB avail; 3.4 KiB/s rd, 1.1 KiB/s wr, 5 op/s 2024-03-26T16:56:02.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:56:02 smithi149 ceph-mon[34678]: pgmap v281: 33 pgs: 33 active+clean; 591 KiB data, 222 MiB used, 715 GiB / 715 GiB avail; 3.4 KiB/s rd, 1.1 KiB/s wr, 5 op/s 2024-03-26T16:56:03.132 INFO:tasks.nvmeof:[nvmeof]: rbd create mypool/myimage31 --size 8192 2024-03-26T16:56:03.132 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bf9505fb569e9b95a78f9700ed8c4bd20508ef55 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4394d798-eb90-11ee-95d0-87774f69a715 -- rbd create mypool/myimage31 --size 8192 2024-03-26T16:56:03.374 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/4394d798-eb90-11ee-95d0-87774f69a715/mon.a/config 2024-03-26T16:56:04.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:56:04 smithi064 ceph-mon[34420]: pgmap v282: 33 pgs: 33 active+clean; 592 KiB data, 222 MiB used, 715 GiB / 715 GiB avail; 4.7 KiB/s rd, 1.5 KiB/s wr, 7 op/s 2024-03-26T16:56:04.454 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:56:04 smithi044 ceph-mon[30624]: pgmap v282: 33 pgs: 33 active+clean; 592 KiB data, 222 MiB used, 715 GiB / 715 GiB avail; 4.7 KiB/s rd, 1.5 KiB/s wr, 7 op/s 2024-03-26T16:56:04.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:56:04 smithi149 ceph-mon[34678]: pgmap v282: 33 pgs: 33 active+clean; 592 KiB data, 222 MiB used, 715 GiB / 715 GiB avail; 4.7 KiB/s rd, 1.5 KiB/s wr, 7 op/s 2024-03-26T16:56:05.535 INFO:tasks.nvmeof:[nvmeof]: rbd create mypool/myimage32 --size 8192 2024-03-26T16:56:05.535 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bf9505fb569e9b95a78f9700ed8c4bd20508ef55 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4394d798-eb90-11ee-95d0-87774f69a715 -- rbd create mypool/myimage32 --size 8192 2024-03-26T16:56:05.773 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/4394d798-eb90-11ee-95d0-87774f69a715/mon.a/config 2024-03-26T16:56:06.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:56:06 smithi064 ceph-mon[34420]: pgmap v283: 33 pgs: 33 active+clean; 592 KiB data, 222 MiB used, 715 GiB / 715 GiB avail; 4.0 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-03-26T16:56:06.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:56:06 smithi044 ceph-mon[30624]: pgmap v283: 33 pgs: 33 active+clean; 592 KiB data, 222 MiB used, 715 GiB / 715 GiB avail; 4.0 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-03-26T16:56:06.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:56:06 smithi149 ceph-mon[34678]: pgmap v283: 33 pgs: 33 active+clean; 592 KiB data, 222 MiB used, 715 GiB / 715 GiB avail; 4.0 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-03-26T16:56:07.891 INFO:tasks.nvmeof:[nvmeof]: rbd create mypool/myimage33 --size 8192 2024-03-26T16:56:07.891 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bf9505fb569e9b95a78f9700ed8c4bd20508ef55 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4394d798-eb90-11ee-95d0-87774f69a715 -- rbd create mypool/myimage33 --size 8192 2024-03-26T16:56:08.132 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/4394d798-eb90-11ee-95d0-87774f69a715/mon.a/config 2024-03-26T16:56:08.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:56:08 smithi064 ceph-mon[34420]: pgmap v284: 33 pgs: 33 active+clean; 594 KiB data, 222 MiB used, 715 GiB / 715 GiB avail; 4.2 KiB/s rd, 1.8 KiB/s wr, 7 op/s 2024-03-26T16:56:08.485 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:56:08 smithi044 ceph-mon[30624]: pgmap v284: 33 pgs: 33 active+clean; 594 KiB data, 222 MiB used, 715 GiB / 715 GiB avail; 4.2 KiB/s rd, 1.8 KiB/s wr, 7 op/s 2024-03-26T16:56:08.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:56:08 smithi149 ceph-mon[34678]: pgmap v284: 33 pgs: 33 active+clean; 594 KiB data, 222 MiB used, 715 GiB / 715 GiB avail; 4.2 KiB/s rd, 1.8 KiB/s wr, 7 op/s 2024-03-26T16:56:10.163 INFO:tasks.nvmeof:[nvmeof]: rbd create mypool/myimage34 --size 8192 2024-03-26T16:56:10.163 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bf9505fb569e9b95a78f9700ed8c4bd20508ef55 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4394d798-eb90-11ee-95d0-87774f69a715 -- rbd create mypool/myimage34 --size 8192 2024-03-26T16:56:10.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:56:10 smithi064 ceph-mon[34420]: pgmap v285: 33 pgs: 33 active+clean; 594 KiB data, 222 MiB used, 715 GiB / 715 GiB avail; 5.1 KiB/s rd, 1.7 KiB/s wr, 8 op/s 2024-03-26T16:56:10.409 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/4394d798-eb90-11ee-95d0-87774f69a715/mon.a/config 2024-03-26T16:56:10.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:56:10 smithi044 ceph-mon[30624]: pgmap v285: 33 pgs: 33 active+clean; 594 KiB data, 222 MiB used, 715 GiB / 715 GiB avail; 5.1 KiB/s rd, 1.7 KiB/s wr, 8 op/s 2024-03-26T16:56:10.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:56:10 smithi149 ceph-mon[34678]: pgmap v285: 33 pgs: 33 active+clean; 594 KiB data, 222 MiB used, 715 GiB / 715 GiB avail; 5.1 KiB/s rd, 1.7 KiB/s wr, 8 op/s 2024-03-26T16:56:12.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:56:12 smithi064 ceph-mon[34420]: pgmap v286: 33 pgs: 33 active+clean; 594 KiB data, 222 MiB used, 715 GiB / 715 GiB avail; 4.4 KiB/s rd, 1.8 KiB/s wr, 7 op/s 2024-03-26T16:56:12.459 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:56:12 smithi044 ceph-mon[30624]: pgmap v286: 33 pgs: 33 active+clean; 594 KiB data, 222 MiB used, 715 GiB / 715 GiB avail; 4.4 KiB/s rd, 1.8 KiB/s wr, 7 op/s 2024-03-26T16:56:12.483 INFO:tasks.nvmeof:[nvmeof]: rbd create mypool/myimage35 --size 8192 2024-03-26T16:56:12.483 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bf9505fb569e9b95a78f9700ed8c4bd20508ef55 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4394d798-eb90-11ee-95d0-87774f69a715 -- rbd create mypool/myimage35 --size 8192 2024-03-26T16:56:12.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:56:12 smithi149 ceph-mon[34678]: pgmap v286: 33 pgs: 33 active+clean; 594 KiB data, 222 MiB used, 715 GiB / 715 GiB avail; 4.4 KiB/s rd, 1.8 KiB/s wr, 7 op/s 2024-03-26T16:56:12.721 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/4394d798-eb90-11ee-95d0-87774f69a715/mon.a/config 2024-03-26T16:56:14.260 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:56:14 smithi044 ceph-mon[30624]: pgmap v287: 33 pgs: 33 active+clean; 595 KiB data, 222 MiB used, 715 GiB / 715 GiB avail; 5.5 KiB/s rd, 2.2 KiB/s wr, 9 op/s 2024-03-26T16:56:14.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:56:14 smithi064 ceph-mon[34420]: pgmap v287: 33 pgs: 33 active+clean; 595 KiB data, 222 MiB used, 715 GiB / 715 GiB avail; 5.5 KiB/s rd, 2.2 KiB/s wr, 9 op/s 2024-03-26T16:56:14.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:56:14 smithi149 ceph-mon[34678]: pgmap v287: 33 pgs: 33 active+clean; 595 KiB data, 222 MiB used, 715 GiB / 715 GiB avail; 5.5 KiB/s rd, 2.2 KiB/s wr, 9 op/s 2024-03-26T16:56:15.006 INFO:tasks.nvmeof:[nvmeof]: rbd create mypool/myimage36 --size 8192 2024-03-26T16:56:15.006 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bf9505fb569e9b95a78f9700ed8c4bd20508ef55 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4394d798-eb90-11ee-95d0-87774f69a715 -- rbd create mypool/myimage36 --size 8192 2024-03-26T16:56:15.249 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/4394d798-eb90-11ee-95d0-87774f69a715/mon.a/config 2024-03-26T16:56:16.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:56:16 smithi044 ceph-mon[30624]: pgmap v288: 33 pgs: 33 active+clean; 595 KiB data, 222 MiB used, 715 GiB / 715 GiB avail; 4.4 KiB/s rd, 1.7 KiB/s wr, 7 op/s 2024-03-26T16:56:16.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:56:16 smithi064 ceph-mon[34420]: pgmap v288: 33 pgs: 33 active+clean; 595 KiB data, 222 MiB used, 715 GiB / 715 GiB avail; 4.4 KiB/s rd, 1.7 KiB/s wr, 7 op/s 2024-03-26T16:56:16.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:56:16 smithi149 ceph-mon[34678]: pgmap v288: 33 pgs: 33 active+clean; 595 KiB data, 222 MiB used, 715 GiB / 715 GiB avail; 4.4 KiB/s rd, 1.7 KiB/s wr, 7 op/s 2024-03-26T16:56:17.294 INFO:tasks.nvmeof:[nvmeof]: rbd create mypool/myimage37 --size 8192 2024-03-26T16:56:17.294 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bf9505fb569e9b95a78f9700ed8c4bd20508ef55 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4394d798-eb90-11ee-95d0-87774f69a715 -- rbd create mypool/myimage37 --size 8192 2024-03-26T16:56:17.535 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/4394d798-eb90-11ee-95d0-87774f69a715/mon.a/config 2024-03-26T16:56:18.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:56:18 smithi044 ceph-mon[30624]: pgmap v289: 33 pgs: 33 active+clean; 596 KiB data, 222 MiB used, 715 GiB / 715 GiB avail; 4.3 KiB/s rd, 2.2 KiB/s wr, 8 op/s 2024-03-26T16:56:18.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:56:18 smithi064 ceph-mon[34420]: pgmap v289: 33 pgs: 33 active+clean; 596 KiB data, 222 MiB used, 715 GiB / 715 GiB avail; 4.3 KiB/s rd, 2.2 KiB/s wr, 8 op/s 2024-03-26T16:56:18.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:56:18 smithi149 ceph-mon[34678]: pgmap v289: 33 pgs: 33 active+clean; 596 KiB data, 222 MiB used, 715 GiB / 715 GiB avail; 4.3 KiB/s rd, 2.2 KiB/s wr, 8 op/s 2024-03-26T16:56:19.856 INFO:tasks.nvmeof:[nvmeof]: rbd create mypool/myimage38 --size 8192 2024-03-26T16:56:19.857 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bf9505fb569e9b95a78f9700ed8c4bd20508ef55 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4394d798-eb90-11ee-95d0-87774f69a715 -- rbd create mypool/myimage38 --size 8192 2024-03-26T16:56:20.099 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/4394d798-eb90-11ee-95d0-87774f69a715/mon.a/config 2024-03-26T16:56:20.459 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:56:20 smithi044 ceph-mon[30624]: pgmap v290: 33 pgs: 33 active+clean; 596 KiB data, 222 MiB used, 715 GiB / 715 GiB avail; 4.8 KiB/s rd, 1.6 KiB/s wr, 7 op/s 2024-03-26T16:56:20.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:56:20 smithi064 ceph-mon[34420]: pgmap v290: 33 pgs: 33 active+clean; 596 KiB data, 222 MiB used, 715 GiB / 715 GiB avail; 4.8 KiB/s rd, 1.6 KiB/s wr, 7 op/s 2024-03-26T16:56:20.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:56:20 smithi149 ceph-mon[34678]: pgmap v290: 33 pgs: 33 active+clean; 596 KiB data, 222 MiB used, 715 GiB / 715 GiB avail; 4.8 KiB/s rd, 1.6 KiB/s wr, 7 op/s 2024-03-26T16:56:22.112 INFO:tasks.nvmeof:[nvmeof]: rbd create mypool/myimage39 --size 8192 2024-03-26T16:56:22.112 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bf9505fb569e9b95a78f9700ed8c4bd20508ef55 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4394d798-eb90-11ee-95d0-87774f69a715 -- rbd create mypool/myimage39 --size 8192 2024-03-26T16:56:22.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:56:22 smithi044 ceph-mon[30624]: pgmap v291: 33 pgs: 33 active+clean; 597 KiB data, 222 MiB used, 715 GiB / 715 GiB avail; 4.0 KiB/s rd, 1.5 KiB/s wr, 6 op/s 2024-03-26T16:56:22.354 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/4394d798-eb90-11ee-95d0-87774f69a715/mon.a/config 2024-03-26T16:56:22.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:56:22 smithi064 ceph-mon[34420]: pgmap v291: 33 pgs: 33 active+clean; 597 KiB data, 222 MiB used, 715 GiB / 715 GiB avail; 4.0 KiB/s rd, 1.5 KiB/s wr, 6 op/s 2024-03-26T16:56:22.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:56:22 smithi149 ceph-mon[34678]: pgmap v291: 33 pgs: 33 active+clean; 597 KiB data, 222 MiB used, 715 GiB / 715 GiB avail; 4.0 KiB/s rd, 1.5 KiB/s wr, 6 op/s 2024-03-26T16:56:24.424 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:56:24 smithi044 ceph-mon[30624]: pgmap v292: 33 pgs: 33 active+clean; 598 KiB data, 222 MiB used, 715 GiB / 715 GiB avail; 5.2 KiB/s rd, 1.9 KiB/s wr, 8 op/s 2024-03-26T16:56:24.449 INFO:tasks.nvmeof:[nvmeof]: rbd create mypool/myimage40 --size 8192 2024-03-26T16:56:24.449 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bf9505fb569e9b95a78f9700ed8c4bd20508ef55 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4394d798-eb90-11ee-95d0-87774f69a715 -- rbd create mypool/myimage40 --size 8192 2024-03-26T16:56:24.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:56:24 smithi064 ceph-mon[34420]: pgmap v292: 33 pgs: 33 active+clean; 598 KiB data, 222 MiB used, 715 GiB / 715 GiB avail; 5.2 KiB/s rd, 1.9 KiB/s wr, 8 op/s 2024-03-26T16:56:24.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:56:24 smithi149 ceph-mon[34678]: pgmap v292: 33 pgs: 33 active+clean; 598 KiB data, 222 MiB used, 715 GiB / 715 GiB avail; 5.2 KiB/s rd, 1.9 KiB/s wr, 8 op/s 2024-03-26T16:56:24.690 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/4394d798-eb90-11ee-95d0-87774f69a715/mon.a/config 2024-03-26T16:56:26.503 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:56:26 smithi044 ceph-mon[30624]: pgmap v293: 33 pgs: 33 active+clean; 598 KiB data, 222 MiB used, 715 GiB / 715 GiB avail; 4.1 KiB/s rd, 1.5 KiB/s wr, 6 op/s 2024-03-26T16:56:26.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:56:26 smithi064 ceph-mon[34420]: pgmap v293: 33 pgs: 33 active+clean; 598 KiB data, 222 MiB used, 715 GiB / 715 GiB avail; 4.1 KiB/s rd, 1.5 KiB/s wr, 6 op/s 2024-03-26T16:56:26.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:56:26 smithi149 ceph-mon[34678]: pgmap v293: 33 pgs: 33 active+clean; 598 KiB data, 222 MiB used, 715 GiB / 715 GiB avail; 4.1 KiB/s rd, 1.5 KiB/s wr, 6 op/s 2024-03-26T16:56:26.963 INFO:tasks.nvmeof:[nvmeof]: rbd create mypool/myimage41 --size 8192 2024-03-26T16:56:26.963 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bf9505fb569e9b95a78f9700ed8c4bd20508ef55 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4394d798-eb90-11ee-95d0-87774f69a715 -- rbd create mypool/myimage41 --size 8192 2024-03-26T16:56:27.206 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/4394d798-eb90-11ee-95d0-87774f69a715/mon.a/config 2024-03-26T16:56:28.260 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:56:27 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-26T16:56:28.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:56:27 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-26T16:56:28.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:56:27 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-26T16:56:29.207 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:56:28 smithi149 ceph-mon[34678]: pgmap v294: 33 pgs: 33 active+clean; 598 KiB data, 222 MiB used, 715 GiB / 715 GiB avail; 4.2 KiB/s rd, 1.8 KiB/s wr, 7 op/s 2024-03-26T16:56:29.207 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:56:28 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T16:56:29.208 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:56:28 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-26T16:56:29.208 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:56:28 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:56:29.213 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:56:28 smithi044 ceph-mon[30624]: pgmap v294: 33 pgs: 33 active+clean; 598 KiB data, 222 MiB used, 715 GiB / 715 GiB avail; 4.2 KiB/s rd, 1.8 KiB/s wr, 7 op/s 2024-03-26T16:56:29.214 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:56:28 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T16:56:29.214 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:56:28 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-26T16:56:29.214 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:56:28 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:56:29.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:56:28 smithi064 ceph-mon[34420]: pgmap v294: 33 pgs: 33 active+clean; 598 KiB data, 222 MiB used, 715 GiB / 715 GiB avail; 4.2 KiB/s rd, 1.8 KiB/s wr, 7 op/s 2024-03-26T16:56:29.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:56:28 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T16:56:29.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:56:28 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-26T16:56:29.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:56:28 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:56:29.351 INFO:tasks.nvmeof:[nvmeof]: rbd create mypool/myimage42 --size 8192 2024-03-26T16:56:29.352 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bf9505fb569e9b95a78f9700ed8c4bd20508ef55 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4394d798-eb90-11ee-95d0-87774f69a715 -- rbd create mypool/myimage42 --size 8192 2024-03-26T16:56:29.594 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/4394d798-eb90-11ee-95d0-87774f69a715/mon.a/config 2024-03-26T16:56:30.356 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:56:30 smithi044 ceph-mon[30624]: pgmap v295: 33 pgs: 33 active+clean; 598 KiB data, 222 MiB used, 715 GiB / 715 GiB avail; 4.7 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-03-26T16:56:30.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:56:30 smithi064 ceph-mon[34420]: pgmap v295: 33 pgs: 33 active+clean; 598 KiB data, 222 MiB used, 715 GiB / 715 GiB avail; 4.7 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-03-26T16:56:30.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:56:30 smithi149 ceph-mon[34678]: pgmap v295: 33 pgs: 33 active+clean; 598 KiB data, 222 MiB used, 715 GiB / 715 GiB avail; 4.7 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-03-26T16:56:31.622 INFO:tasks.nvmeof:[nvmeof]: rbd create mypool/myimage43 --size 8192 2024-03-26T16:56:31.622 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bf9505fb569e9b95a78f9700ed8c4bd20508ef55 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4394d798-eb90-11ee-95d0-87774f69a715 -- rbd create mypool/myimage43 --size 8192 2024-03-26T16:56:31.886 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/4394d798-eb90-11ee-95d0-87774f69a715/mon.a/config 2024-03-26T16:56:32.458 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:56:32 smithi044 ceph-mon[30624]: pgmap v296: 33 pgs: 33 active+clean; 599 KiB data, 222 MiB used, 715 GiB / 715 GiB avail; 4.0 KiB/s rd, 1.4 KiB/s wr, 6 op/s 2024-03-26T16:56:32.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:56:32 smithi064 ceph-mon[34420]: pgmap v296: 33 pgs: 33 active+clean; 599 KiB data, 222 MiB used, 715 GiB / 715 GiB avail; 4.0 KiB/s rd, 1.4 KiB/s wr, 6 op/s 2024-03-26T16:56:32.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:56:32 smithi149 ceph-mon[34678]: pgmap v296: 33 pgs: 33 active+clean; 599 KiB data, 222 MiB used, 715 GiB / 715 GiB avail; 4.0 KiB/s rd, 1.4 KiB/s wr, 6 op/s 2024-03-26T16:56:33.943 INFO:tasks.nvmeof:[nvmeof]: rbd create mypool/myimage44 --size 8192 2024-03-26T16:56:33.944 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bf9505fb569e9b95a78f9700ed8c4bd20508ef55 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4394d798-eb90-11ee-95d0-87774f69a715 -- rbd create mypool/myimage44 --size 8192 2024-03-26T16:56:34.185 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/4394d798-eb90-11ee-95d0-87774f69a715/mon.a/config 2024-03-26T16:56:34.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:56:34 smithi044 ceph-mon[30624]: pgmap v297: 33 pgs: 33 active+clean; 600 KiB data, 222 MiB used, 715 GiB / 715 GiB avail; 5.2 KiB/s rd, 1.8 KiB/s wr, 8 op/s 2024-03-26T16:56:34.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:56:34 smithi064 ceph-mon[34420]: pgmap v297: 33 pgs: 33 active+clean; 600 KiB data, 222 MiB used, 715 GiB / 715 GiB avail; 5.2 KiB/s rd, 1.8 KiB/s wr, 8 op/s 2024-03-26T16:56:34.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:56:34 smithi149 ceph-mon[34678]: pgmap v297: 33 pgs: 33 active+clean; 600 KiB data, 222 MiB used, 715 GiB / 715 GiB avail; 5.2 KiB/s rd, 1.8 KiB/s wr, 8 op/s 2024-03-26T16:56:36.397 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:56:36 smithi044 ceph-mon[30624]: pgmap v298: 33 pgs: 33 active+clean; 600 KiB data, 222 MiB used, 715 GiB / 715 GiB avail; 4.0 KiB/s rd, 1.4 KiB/s wr, 6 op/s 2024-03-26T16:56:36.423 INFO:tasks.nvmeof:[nvmeof]: rbd create mypool/myimage45 --size 8192 2024-03-26T16:56:36.423 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bf9505fb569e9b95a78f9700ed8c4bd20508ef55 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4394d798-eb90-11ee-95d0-87774f69a715 -- rbd create mypool/myimage45 --size 8192 2024-03-26T16:56:36.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:56:36 smithi064 ceph-mon[34420]: pgmap v298: 33 pgs: 33 active+clean; 600 KiB data, 222 MiB used, 715 GiB / 715 GiB avail; 4.0 KiB/s rd, 1.4 KiB/s wr, 6 op/s 2024-03-26T16:56:36.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:56:36 smithi149 ceph-mon[34678]: pgmap v298: 33 pgs: 33 active+clean; 600 KiB data, 222 MiB used, 715 GiB / 715 GiB avail; 4.0 KiB/s rd, 1.4 KiB/s wr, 6 op/s 2024-03-26T16:56:36.660 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/4394d798-eb90-11ee-95d0-87774f69a715/mon.a/config 2024-03-26T16:56:38.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:56:38 smithi044 ceph-mon[30624]: pgmap v299: 33 pgs: 33 active+clean; 600 KiB data, 222 MiB used, 715 GiB / 715 GiB avail; 4.2 KiB/s rd, 1.7 KiB/s wr, 7 op/s 2024-03-26T16:56:38.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:56:38 smithi064 ceph-mon[34420]: pgmap v299: 33 pgs: 33 active+clean; 600 KiB data, 222 MiB used, 715 GiB / 715 GiB avail; 4.2 KiB/s rd, 1.7 KiB/s wr, 7 op/s 2024-03-26T16:56:38.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:56:38 smithi149 ceph-mon[34678]: pgmap v299: 33 pgs: 33 active+clean; 600 KiB data, 222 MiB used, 715 GiB / 715 GiB avail; 4.2 KiB/s rd, 1.7 KiB/s wr, 7 op/s 2024-03-26T16:56:38.745 INFO:tasks.nvmeof:[nvmeof]: rbd create mypool/myimage46 --size 8192 2024-03-26T16:56:38.745 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bf9505fb569e9b95a78f9700ed8c4bd20508ef55 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4394d798-eb90-11ee-95d0-87774f69a715 -- rbd create mypool/myimage46 --size 8192 2024-03-26T16:56:38.983 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/4394d798-eb90-11ee-95d0-87774f69a715/mon.a/config 2024-03-26T16:56:40.296 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:56:40 smithi044 ceph-mon[30624]: pgmap v300: 33 pgs: 33 active+clean; 600 KiB data, 222 MiB used, 715 GiB / 715 GiB avail; 4.7 KiB/s rd, 1.5 KiB/s wr, 7 op/s 2024-03-26T16:56:40.547 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:56:40 smithi149 ceph-mon[34678]: pgmap v300: 33 pgs: 33 active+clean; 600 KiB data, 222 MiB used, 715 GiB / 715 GiB avail; 4.7 KiB/s rd, 1.5 KiB/s wr, 7 op/s 2024-03-26T16:56:40.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:56:40 smithi064 ceph-mon[34420]: pgmap v300: 33 pgs: 33 active+clean; 600 KiB data, 222 MiB used, 715 GiB / 715 GiB avail; 4.7 KiB/s rd, 1.5 KiB/s wr, 7 op/s 2024-03-26T16:56:41.041 INFO:tasks.nvmeof:[nvmeof]: rbd create mypool/myimage47 --size 8192 2024-03-26T16:56:41.041 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bf9505fb569e9b95a78f9700ed8c4bd20508ef55 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4394d798-eb90-11ee-95d0-87774f69a715 -- rbd create mypool/myimage47 --size 8192 2024-03-26T16:56:41.292 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/4394d798-eb90-11ee-95d0-87774f69a715/mon.a/config 2024-03-26T16:56:42.371 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:56:42 smithi044 ceph-mon[30624]: pgmap v301: 33 pgs: 33 active+clean; 601 KiB data, 222 MiB used, 715 GiB / 715 GiB avail; 4.1 KiB/s rd, 1.7 KiB/s wr, 7 op/s 2024-03-26T16:56:42.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:56:42 smithi064 ceph-mon[34420]: pgmap v301: 33 pgs: 33 active+clean; 601 KiB data, 222 MiB used, 715 GiB / 715 GiB avail; 4.1 KiB/s rd, 1.7 KiB/s wr, 7 op/s 2024-03-26T16:56:42.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:56:42 smithi149 ceph-mon[34678]: pgmap v301: 33 pgs: 33 active+clean; 601 KiB data, 222 MiB used, 715 GiB / 715 GiB avail; 4.1 KiB/s rd, 1.7 KiB/s wr, 7 op/s 2024-03-26T16:56:43.640 INFO:tasks.nvmeof:[nvmeof]: rbd create mypool/myimage48 --size 8192 2024-03-26T16:56:43.640 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bf9505fb569e9b95a78f9700ed8c4bd20508ef55 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4394d798-eb90-11ee-95d0-87774f69a715 -- rbd create mypool/myimage48 --size 8192 2024-03-26T16:56:43.879 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/4394d798-eb90-11ee-95d0-87774f69a715/mon.a/config 2024-03-26T16:56:44.259 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:56:44 smithi044 ceph-mon[30624]: pgmap v302: 33 pgs: 33 active+clean; 602 KiB data, 222 MiB used, 715 GiB / 715 GiB avail; 5.2 KiB/s rd, 2.0 KiB/s wr, 8 op/s 2024-03-26T16:56:44.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:56:44 smithi064 ceph-mon[34420]: pgmap v302: 33 pgs: 33 active+clean; 602 KiB data, 222 MiB used, 715 GiB / 715 GiB avail; 5.2 KiB/s rd, 2.0 KiB/s wr, 8 op/s 2024-03-26T16:56:44.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:56:44 smithi149 ceph-mon[34678]: pgmap v302: 33 pgs: 33 active+clean; 602 KiB data, 222 MiB used, 715 GiB / 715 GiB avail; 5.2 KiB/s rd, 2.0 KiB/s wr, 8 op/s 2024-03-26T16:56:46.087 INFO:tasks.nvmeof:[nvmeof]: rbd create mypool/myimage49 --size 8192 2024-03-26T16:56:46.087 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bf9505fb569e9b95a78f9700ed8c4bd20508ef55 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4394d798-eb90-11ee-95d0-87774f69a715 -- rbd create mypool/myimage49 --size 8192 2024-03-26T16:56:46.327 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/4394d798-eb90-11ee-95d0-87774f69a715/mon.a/config 2024-03-26T16:56:46.449 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:56:46 smithi044 ceph-mon[30624]: pgmap v303: 33 pgs: 33 active+clean; 602 KiB data, 222 MiB used, 715 GiB / 715 GiB avail; 4.1 KiB/s rd, 1.6 KiB/s wr, 6 op/s 2024-03-26T16:56:46.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:56:46 smithi064 ceph-mon[34420]: pgmap v303: 33 pgs: 33 active+clean; 602 KiB data, 222 MiB used, 715 GiB / 715 GiB avail; 4.1 KiB/s rd, 1.6 KiB/s wr, 6 op/s 2024-03-26T16:56:46.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:56:46 smithi149 ceph-mon[34678]: pgmap v303: 33 pgs: 33 active+clean; 602 KiB data, 222 MiB used, 715 GiB / 715 GiB avail; 4.1 KiB/s rd, 1.6 KiB/s wr, 6 op/s 2024-03-26T16:56:48.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:56:48 smithi044 ceph-mon[30624]: pgmap v304: 33 pgs: 33 active+clean; 603 KiB data, 222 MiB used, 715 GiB / 715 GiB avail; 4.2 KiB/s rd, 1.9 KiB/s wr, 7 op/s 2024-03-26T16:56:48.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:56:48 smithi064 ceph-mon[34420]: pgmap v304: 33 pgs: 33 active+clean; 603 KiB data, 222 MiB used, 715 GiB / 715 GiB avail; 4.2 KiB/s rd, 1.9 KiB/s wr, 7 op/s 2024-03-26T16:56:48.642 INFO:tasks.nvmeof:[nvmeof]: rbd create mypool/myimage50 --size 8192 2024-03-26T16:56:48.643 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bf9505fb569e9b95a78f9700ed8c4bd20508ef55 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4394d798-eb90-11ee-95d0-87774f69a715 -- rbd create mypool/myimage50 --size 8192 2024-03-26T16:56:48.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:56:48 smithi149 ceph-mon[34678]: pgmap v304: 33 pgs: 33 active+clean; 603 KiB data, 222 MiB used, 715 GiB / 715 GiB avail; 4.2 KiB/s rd, 1.9 KiB/s wr, 7 op/s 2024-03-26T16:56:48.886 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/4394d798-eb90-11ee-95d0-87774f69a715/mon.a/config 2024-03-26T16:56:50.242 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:56:50 smithi044 ceph-mon[30624]: pgmap v305: 33 pgs: 33 active+clean; 603 KiB data, 222 MiB used, 715 GiB / 715 GiB avail; 4.7 KiB/s rd, 1.5 KiB/s wr, 7 op/s 2024-03-26T16:56:50.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:56:50 smithi064 ceph-mon[34420]: pgmap v305: 33 pgs: 33 active+clean; 603 KiB data, 222 MiB used, 715 GiB / 715 GiB avail; 4.7 KiB/s rd, 1.5 KiB/s wr, 7 op/s 2024-03-26T16:56:50.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:56:50 smithi149 ceph-mon[34678]: pgmap v305: 33 pgs: 33 active+clean; 603 KiB data, 222 MiB used, 715 GiB / 715 GiB avail; 4.7 KiB/s rd, 1.5 KiB/s wr, 7 op/s 2024-03-26T16:56:51.031 INFO:tasks.nvmeof:[nvmeof]: rbd create mypool/myimage51 --size 8192 2024-03-26T16:56:51.032 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bf9505fb569e9b95a78f9700ed8c4bd20508ef55 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4394d798-eb90-11ee-95d0-87774f69a715 -- rbd create mypool/myimage51 --size 8192 2024-03-26T16:56:51.270 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/4394d798-eb90-11ee-95d0-87774f69a715/mon.a/config 2024-03-26T16:56:52.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:56:52 smithi044 ceph-mon[30624]: pgmap v306: 33 pgs: 33 active+clean; 603 KiB data, 222 MiB used, 715 GiB / 715 GiB avail; 4.0 KiB/s rd, 1.5 KiB/s wr, 6 op/s 2024-03-26T16:56:52.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:56:52 smithi064 ceph-mon[34420]: pgmap v306: 33 pgs: 33 active+clean; 603 KiB data, 222 MiB used, 715 GiB / 715 GiB avail; 4.0 KiB/s rd, 1.5 KiB/s wr, 6 op/s 2024-03-26T16:56:52.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:56:52 smithi149 ceph-mon[34678]: pgmap v306: 33 pgs: 33 active+clean; 603 KiB data, 222 MiB used, 715 GiB / 715 GiB avail; 4.0 KiB/s rd, 1.5 KiB/s wr, 6 op/s 2024-03-26T16:56:53.543 INFO:tasks.nvmeof:[nvmeof]: rbd create mypool/myimage52 --size 8192 2024-03-26T16:56:53.544 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bf9505fb569e9b95a78f9700ed8c4bd20508ef55 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4394d798-eb90-11ee-95d0-87774f69a715 -- rbd create mypool/myimage52 --size 8192 2024-03-26T16:56:53.789 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/4394d798-eb90-11ee-95d0-87774f69a715/mon.a/config 2024-03-26T16:56:54.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:56:54 smithi044 ceph-mon[30624]: pgmap v307: 33 pgs: 33 active+clean; 605 KiB data, 222 MiB used, 715 GiB / 715 GiB avail; 5.0 KiB/s rd, 1.7 KiB/s wr, 7 op/s 2024-03-26T16:56:54.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:56:54 smithi064 ceph-mon[34420]: pgmap v307: 33 pgs: 33 active+clean; 605 KiB data, 222 MiB used, 715 GiB / 715 GiB avail; 5.0 KiB/s rd, 1.7 KiB/s wr, 7 op/s 2024-03-26T16:56:54.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:56:54 smithi149 ceph-mon[34678]: pgmap v307: 33 pgs: 33 active+clean; 605 KiB data, 222 MiB used, 715 GiB / 715 GiB avail; 5.0 KiB/s rd, 1.7 KiB/s wr, 7 op/s 2024-03-26T16:56:55.916 INFO:tasks.nvmeof:[nvmeof]: rbd create mypool/myimage53 --size 8192 2024-03-26T16:56:55.916 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bf9505fb569e9b95a78f9700ed8c4bd20508ef55 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4394d798-eb90-11ee-95d0-87774f69a715 -- rbd create mypool/myimage53 --size 8192 2024-03-26T16:56:56.157 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/4394d798-eb90-11ee-95d0-87774f69a715/mon.a/config 2024-03-26T16:56:56.485 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:56:56 smithi044 ceph-mon[30624]: pgmap v308: 33 pgs: 33 active+clean; 605 KiB data, 222 MiB used, 715 GiB / 715 GiB avail; 4.0 KiB/s rd, 1.4 KiB/s wr, 6 op/s 2024-03-26T16:56:56.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:56:56 smithi064 ceph-mon[34420]: pgmap v308: 33 pgs: 33 active+clean; 605 KiB data, 222 MiB used, 715 GiB / 715 GiB avail; 4.0 KiB/s rd, 1.4 KiB/s wr, 6 op/s 2024-03-26T16:56:56.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:56:56 smithi149 ceph-mon[34678]: pgmap v308: 33 pgs: 33 active+clean; 605 KiB data, 222 MiB used, 715 GiB / 715 GiB avail; 4.0 KiB/s rd, 1.4 KiB/s wr, 6 op/s 2024-03-26T16:56:58.247 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:56:58 smithi044 ceph-mon[30624]: pgmap v309: 33 pgs: 33 active+clean; 605 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 4.1 KiB/s rd, 1.7 KiB/s wr, 6 op/s 2024-03-26T16:56:58.271 INFO:tasks.nvmeof:[nvmeof]: rbd create mypool/myimage54 --size 8192 2024-03-26T16:56:58.272 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bf9505fb569e9b95a78f9700ed8c4bd20508ef55 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4394d798-eb90-11ee-95d0-87774f69a715 -- rbd create mypool/myimage54 --size 8192 2024-03-26T16:56:58.512 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/4394d798-eb90-11ee-95d0-87774f69a715/mon.a/config 2024-03-26T16:56:58.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:56:58 smithi064 ceph-mon[34420]: pgmap v309: 33 pgs: 33 active+clean; 605 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 4.1 KiB/s rd, 1.7 KiB/s wr, 6 op/s 2024-03-26T16:56:58.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:56:58 smithi149 ceph-mon[34678]: pgmap v309: 33 pgs: 33 active+clean; 605 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 4.1 KiB/s rd, 1.7 KiB/s wr, 6 op/s 2024-03-26T16:57:00.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:57:00 smithi044 ceph-mon[30624]: pgmap v310: 33 pgs: 33 active+clean; 605 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 4.7 KiB/s rd, 1.4 KiB/s wr, 7 op/s 2024-03-26T16:57:00.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:57:00 smithi064 ceph-mon[34420]: pgmap v310: 33 pgs: 33 active+clean; 605 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 4.7 KiB/s rd, 1.4 KiB/s wr, 7 op/s 2024-03-26T16:57:00.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:57:00 smithi149 ceph-mon[34678]: pgmap v310: 33 pgs: 33 active+clean; 605 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 4.7 KiB/s rd, 1.4 KiB/s wr, 7 op/s 2024-03-26T16:57:00.676 INFO:tasks.nvmeof:[nvmeof]: rbd create mypool/myimage55 --size 8192 2024-03-26T16:57:00.676 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bf9505fb569e9b95a78f9700ed8c4bd20508ef55 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4394d798-eb90-11ee-95d0-87774f69a715 -- rbd create mypool/myimage55 --size 8192 2024-03-26T16:57:00.919 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/4394d798-eb90-11ee-95d0-87774f69a715/mon.a/config 2024-03-26T16:57:02.334 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:57:02 smithi044 ceph-mon[30624]: pgmap v311: 33 pgs: 33 active+clean; 606 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 4.2 KiB/s rd, 1.5 KiB/s wr, 6 op/s 2024-03-26T16:57:02.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:57:02 smithi064 ceph-mon[34420]: pgmap v311: 33 pgs: 33 active+clean; 606 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 4.2 KiB/s rd, 1.5 KiB/s wr, 6 op/s 2024-03-26T16:57:02.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:57:02 smithi149 ceph-mon[34678]: pgmap v311: 33 pgs: 33 active+clean; 606 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 4.2 KiB/s rd, 1.5 KiB/s wr, 6 op/s 2024-03-26T16:57:03.000 INFO:tasks.nvmeof:[nvmeof]: rbd create mypool/myimage56 --size 8192 2024-03-26T16:57:03.000 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bf9505fb569e9b95a78f9700ed8c4bd20508ef55 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4394d798-eb90-11ee-95d0-87774f69a715 -- rbd create mypool/myimage56 --size 8192 2024-03-26T16:57:03.254 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/4394d798-eb90-11ee-95d0-87774f69a715/mon.a/config 2024-03-26T16:57:04.405 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:57:04 smithi044 ceph-mon[30624]: pgmap v312: 33 pgs: 33 active+clean; 607 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 5.3 KiB/s rd, 2.0 KiB/s wr, 8 op/s 2024-03-26T16:57:04.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:57:04 smithi064 ceph-mon[34420]: pgmap v312: 33 pgs: 33 active+clean; 607 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 5.3 KiB/s rd, 2.0 KiB/s wr, 8 op/s 2024-03-26T16:57:04.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:57:04 smithi149 ceph-mon[34678]: pgmap v312: 33 pgs: 33 active+clean; 607 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 5.3 KiB/s rd, 2.0 KiB/s wr, 8 op/s 2024-03-26T16:57:05.462 INFO:tasks.nvmeof:[nvmeof]: rbd create mypool/myimage57 --size 8192 2024-03-26T16:57:05.463 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bf9505fb569e9b95a78f9700ed8c4bd20508ef55 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4394d798-eb90-11ee-95d0-87774f69a715 -- rbd create mypool/myimage57 --size 8192 2024-03-26T16:57:05.704 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/4394d798-eb90-11ee-95d0-87774f69a715/mon.a/config 2024-03-26T16:57:06.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:57:06 smithi044 ceph-mon[30624]: pgmap v313: 33 pgs: 33 active+clean; 607 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 4.3 KiB/s rd, 1.5 KiB/s wr, 6 op/s 2024-03-26T16:57:06.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:57:06 smithi064 ceph-mon[34420]: pgmap v313: 33 pgs: 33 active+clean; 607 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 4.3 KiB/s rd, 1.5 KiB/s wr, 6 op/s 2024-03-26T16:57:06.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:57:06 smithi149 ceph-mon[34678]: pgmap v313: 33 pgs: 33 active+clean; 607 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 4.3 KiB/s rd, 1.5 KiB/s wr, 6 op/s 2024-03-26T16:57:07.799 INFO:tasks.nvmeof:[nvmeof]: rbd create mypool/myimage58 --size 8192 2024-03-26T16:57:07.799 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bf9505fb569e9b95a78f9700ed8c4bd20508ef55 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4394d798-eb90-11ee-95d0-87774f69a715 -- rbd create mypool/myimage58 --size 8192 2024-03-26T16:57:08.039 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/4394d798-eb90-11ee-95d0-87774f69a715/mon.a/config 2024-03-26T16:57:08.477 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:57:08 smithi044 ceph-mon[30624]: pgmap v314: 33 pgs: 33 active+clean; 607 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 4.5 KiB/s rd, 1.9 KiB/s wr, 7 op/s 2024-03-26T16:57:08.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:57:08 smithi064 ceph-mon[34420]: pgmap v314: 33 pgs: 33 active+clean; 607 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 4.5 KiB/s rd, 1.9 KiB/s wr, 7 op/s 2024-03-26T16:57:08.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:57:08 smithi149 ceph-mon[34678]: pgmap v314: 33 pgs: 33 active+clean; 607 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 4.5 KiB/s rd, 1.9 KiB/s wr, 7 op/s 2024-03-26T16:57:10.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:57:10 smithi044 ceph-mon[30624]: pgmap v315: 33 pgs: 33 active+clean; 608 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 5.1 KiB/s rd, 1.7 KiB/s wr, 7 op/s 2024-03-26T16:57:10.296 INFO:tasks.nvmeof:[nvmeof]: rbd create mypool/myimage59 --size 8192 2024-03-26T16:57:10.296 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bf9505fb569e9b95a78f9700ed8c4bd20508ef55 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4394d798-eb90-11ee-95d0-87774f69a715 -- rbd create mypool/myimage59 --size 8192 2024-03-26T16:57:10.546 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/4394d798-eb90-11ee-95d0-87774f69a715/mon.a/config 2024-03-26T16:57:10.547 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:57:10 smithi149 ceph-mon[34678]: pgmap v315: 33 pgs: 33 active+clean; 608 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 5.1 KiB/s rd, 1.7 KiB/s wr, 7 op/s 2024-03-26T16:57:10.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:57:10 smithi064 ceph-mon[34420]: pgmap v315: 33 pgs: 33 active+clean; 608 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 5.1 KiB/s rd, 1.7 KiB/s wr, 7 op/s 2024-03-26T16:57:12.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:57:12 smithi044 ceph-mon[30624]: pgmap v316: 33 pgs: 33 active+clean; 608 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 4.4 KiB/s rd, 1.7 KiB/s wr, 7 op/s 2024-03-26T16:57:12.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:57:12 smithi064 ceph-mon[34420]: pgmap v316: 33 pgs: 33 active+clean; 608 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 4.4 KiB/s rd, 1.7 KiB/s wr, 7 op/s 2024-03-26T16:57:12.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:57:12 smithi149 ceph-mon[34678]: pgmap v316: 33 pgs: 33 active+clean; 608 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 4.4 KiB/s rd, 1.7 KiB/s wr, 7 op/s 2024-03-26T16:57:12.809 INFO:tasks.nvmeof:[nvmeof]: rbd create mypool/myimage60 --size 8192 2024-03-26T16:57:12.809 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bf9505fb569e9b95a78f9700ed8c4bd20508ef55 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4394d798-eb90-11ee-95d0-87774f69a715 -- rbd create mypool/myimage60 --size 8192 2024-03-26T16:57:13.050 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/4394d798-eb90-11ee-95d0-87774f69a715/mon.a/config 2024-03-26T16:57:14.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:57:14 smithi064 ceph-mon[34420]: pgmap v317: 33 pgs: 33 active+clean; 609 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 5.3 KiB/s rd, 2.2 KiB/s wr, 9 op/s 2024-03-26T16:57:14.765 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:57:14 smithi044 ceph-mon[30624]: pgmap v317: 33 pgs: 33 active+clean; 609 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 5.3 KiB/s rd, 2.2 KiB/s wr, 9 op/s 2024-03-26T16:57:14.896 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:57:14 smithi149 ceph-mon[34678]: pgmap v317: 33 pgs: 33 active+clean; 609 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 5.3 KiB/s rd, 2.2 KiB/s wr, 9 op/s 2024-03-26T16:57:15.149 DEBUG:teuthology.orchestra.run.smithi044:nvmeof.nvmeof.a> sudo journalctl -f -n 0 -u ceph-4394d798-eb90-11ee-95d0-87774f69a715@nvmeof.nvmeof.a.service 2024-03-26T16:57:15.152 DEBUG:teuthology.orchestra.run.smithi064:nvmeof.nvmeof.b> sudo journalctl -f -n 0 -u ceph-4394d798-eb90-11ee-95d0-87774f69a715@nvmeof.nvmeof.b.service 2024-03-26T16:57:15.154 DEBUG:teuthology.orchestra.run.smithi149:nvmeof.nvmeof.c> sudo journalctl -f -n 0 -u ceph-4394d798-eb90-11ee-95d0-87774f69a715@nvmeof.nvmeof.c.service 2024-03-26T16:57:15.156 INFO:tasks.nvmeof:[nvmeof]: executed deploy_nvmeof successfully! 2024-03-26T16:57:15.156 INFO:tasks.nvmeof:[nvmeof]: running set_gateway_cfg... 2024-03-26T16:57:15.157 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-03-26T16:57:15.157 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd of=/etc/ceph/nvmeof.env 2024-03-26T16:57:15.219 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2024-03-26T16:57:15.219 DEBUG:teuthology.orchestra.run.smithi064:> sudo dd of=/etc/ceph/nvmeof.env 2024-03-26T16:57:15.246 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-03-26T16:57:15.246 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd of=/etc/ceph/nvmeof.env 2024-03-26T16:57:15.273 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-03-26T16:57:15.273 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd of=/etc/ceph/nvmeof.env 2024-03-26T16:57:15.306 INFO:tasks.nvmeof:[nvmeof]: executed set_gateway_cfg successfully! 2024-03-26T16:57:15.306 INFO:teuthology.run_tasks:Running task cephadm.wait_for_service... 2024-03-26T16:57:15.316 INFO:tasks.cephadm:Waiting for ceph service nvmeof.mypool to start (timeout 300)... 2024-03-26T16:57:15.316 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bf9505fb569e9b95a78f9700ed8c4bd20508ef55 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4394d798-eb90-11ee-95d0-87774f69a715 -- ceph orch ls -f json 2024-03-26T16:57:15.558 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/4394d798-eb90-11ee-95d0-87774f69a715/mon.a/config 2024-03-26T16:57:15.646 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:57:15 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:57:15] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:57:15.646 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:57:15 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:57:15] INFO grpc.py:2291: get_subsystems: [] 2024-03-26T16:57:15.678 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:57:15 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:57:15] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:57:15.678 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:57:15 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:57:15] INFO grpc.py:2291: get_subsystems: [] 2024-03-26T16:57:16.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:57:16 smithi044 ceph-mon[30624]: pgmap v318: 33 pgs: 33 active+clean; 609 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 4.2 KiB/s rd, 1.5 KiB/s wr, 6 op/s 2024-03-26T16:57:16.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:57:16 smithi064 ceph-mon[34420]: pgmap v318: 33 pgs: 33 active+clean; 609 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 4.2 KiB/s rd, 1.5 KiB/s wr, 6 op/s 2024-03-26T16:57:16.555 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:57:16 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:57:16] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:57:16.556 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:57:16 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:57:16] INFO grpc.py:2291: get_subsystems: [] 2024-03-26T16:57:16.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:57:16 smithi149 ceph-mon[34678]: pgmap v318: 33 pgs: 33 active+clean; 609 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 4.2 KiB/s rd, 1.5 KiB/s wr, 6 op/s 2024-03-26T16:57:17.445 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-26T16:57:17.445 INFO:teuthology.orchestra.run.smithi044.stdout:[{"events": ["2024-03-26T16:49:38.754970Z service:mgr [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi044=x"]}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2024-03-26T16:49:38.696050Z", "last_refresh": "2024-03-26T16:55:25.891215Z", "running": 1, "size": 1}}, {"events": ["2024-03-26T16:49:30.318518Z service:mon [INFO] \"service was created\""], "placement": {"count": 3, "hosts": ["smithi044:172.21.15.44=a", "smithi064:172.21.15.64=b", "smithi149:172.21.15.149=c"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2024-03-26T16:49:08.677274Z", "last_refresh": "2024-03-26T16:55:22.425144Z", "running": 3, "size": 3}}, {"events": ["2024-03-26T16:55:20.812715Z service:nvmeof.mypool [INFO] \"service was created\""], "placement": {"count": 3, "hosts": ["smithi044=nvmeof.a", "smithi064=nvmeof.b", "smithi149=nvmeof.c"]}, "service_id": "mypool", "service_name": "nvmeof.mypool", "service_type": "nvmeof", "spec": {"bdevs_per_cluster": 32, "client_cert": "./client.crt", "client_key": "./client.key", "conn_retries": 10, "discovery_port": 8009, "enable_prometheus_exporter": true, "log_directory": "/var/log/ceph/", "log_files_enabled": true, "log_files_rotation_enabled": true, "log_level": "INFO", "max_log_directory_backups": 10, "max_log_file_size_in_mb": 10, "max_log_files_count": 20, "monitor_timeout": 1.0, "omap_file_lock_duration": 60, "omap_file_lock_retries": 15, "omap_file_lock_retry_sleep_interval": 5, "omap_file_update_reloads": 10, "pool": "mypool", "port": 5500, "rpc_socket_dir": "/var/tmp/", "rpc_socket_name": "spdk.sock", "server_cert": "./server.crt", "server_key": "./server.key", "spdk_log_level": "WARNING", "spdk_path": "/usr/local/bin/nvmf_tgt", "spdk_timeout": 60.0, "state_update_interval_sec": 5, "state_update_notify": true, "tgt_path": "/usr/local/bin/nvmf_tgt", "transport_tcp_options": {"in_capsule_data_size": 8192, "max_io_qpairs_per_ctrlr": 7}, "transports": "tcp", "verbose_log_messages": true, "verify_nqns": true}, "status": {"created": "2024-03-26T16:54:33.053657Z", "last_refresh": "2024-03-26T16:55:22.425499Z", "ports": [5500, 4420, 8009], "running": 3, "size": 3}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "5795ddf102746261652aa1cd1f517ace4dcfb8739ebbf229aeb81830d793ada0", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:01ae7457193b3f46a870db683661dbc281d60ce54f0968f4de09bc4e5ad0a734", "last_refresh": "2024-03-26T16:55:22.425245Z", "running": 8, "size": 8}, "unmanaged": true}] 2024-03-26T16:57:17.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:57:17 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:57:17] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:57:17.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:57:17 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:57:17] INFO grpc.py:2291: get_subsystems: [] 2024-03-26T16:57:17.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:57:17 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:57:17] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:57:17.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:57:17 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:57:17] INFO grpc.py:2291: get_subsystems: [] 2024-03-26T16:57:18.030 INFO:tasks.cephadm:nvmeof.mypool has 3/3 2024-03-26T16:57:18.030 INFO:teuthology.run_tasks:Running task workunit... 2024-03-26T16:57:18.064 INFO:tasks.workunit:Pulling workunits from ref b4c4828f419f1247fc297e8069c1036b1d6151f2 2024-03-26T16:57:18.064 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-03-26T16:57:18.065 DEBUG:teuthology.orchestra.run.smithi157:> stat -- /home/ubuntu/cephtest/mnt.3 2024-03-26T16:57:18.082 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-26T16:57:18.083 INFO:teuthology.orchestra.run.smithi157.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.3': No such file or directory 2024-03-26T16:57:18.083 DEBUG:teuthology.orchestra.run.smithi157:> mkdir -- /home/ubuntu/cephtest/mnt.3 2024-03-26T16:57:18.140 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.3 2024-03-26T16:57:18.140 DEBUG:teuthology.orchestra.run.smithi157:> cd -- /home/ubuntu/cephtest/mnt.3 && mkdir -- client.3 2024-03-26T16:57:18.196 INFO:tasks.workunit:timeout=3h 2024-03-26T16:57:18.196 INFO:tasks.workunit:cleanup=True 2024-03-26T16:57:18.197 DEBUG:teuthology.orchestra.run.smithi157:> rm -rf /home/ubuntu/cephtest/clone.client.3 && git clone https://github.com/vallariag/ceph.git /home/ubuntu/cephtest/clone.client.3 && cd /home/ubuntu/cephtest/clone.client.3 && git checkout b4c4828f419f1247fc297e8069c1036b1d6151f2 2024-03-26T16:57:18.254 INFO:tasks.workunit.client.3.smithi157.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.3'... 2024-03-26T16:57:18.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:57:18 smithi044 ceph-mon[30624]: from='client.15048 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-26T16:57:18.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:57:18 smithi044 ceph-mon[30624]: pgmap v319: 33 pgs: 33 active+clean; 609 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 4.1 KiB/s rd, 1.7 KiB/s wr, 7 op/s 2024-03-26T16:57:18.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:57:18 smithi064 ceph-mon[34420]: from='client.15048 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-26T16:57:18.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:57:18 smithi064 ceph-mon[34420]: pgmap v319: 33 pgs: 33 active+clean; 609 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 4.1 KiB/s rd, 1.7 KiB/s wr, 7 op/s 2024-03-26T16:57:18.556 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:57:18 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:57:18] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:57:18.556 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:57:18 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:57:18] INFO grpc.py:2291: get_subsystems: [] 2024-03-26T16:57:18.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:57:18 smithi149 ceph-mon[34678]: from='client.15048 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-26T16:57:18.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:57:18 smithi149 ceph-mon[34678]: pgmap v319: 33 pgs: 33 active+clean; 609 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 4.1 KiB/s rd, 1.7 KiB/s wr, 7 op/s 2024-03-26T16:57:19.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:57:19 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:57:19] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:57:19.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:57:19 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:57:19] INFO grpc.py:2291: get_subsystems: [] 2024-03-26T16:57:19.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:57:19 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:57:19] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:57:19.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:57:19 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:57:19] INFO grpc.py:2291: get_subsystems: [] 2024-03-26T16:57:20.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:57:20 smithi044 ceph-mon[30624]: pgmap v320: 33 pgs: 33 active+clean; 609 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 4.4 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-03-26T16:57:20.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:57:20 smithi064 ceph-mon[34420]: pgmap v320: 33 pgs: 33 active+clean; 609 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 4.4 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-03-26T16:57:20.555 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:57:20 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:57:20] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:57:20.555 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:57:20 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:57:20] INFO grpc.py:2291: get_subsystems: [] 2024-03-26T16:57:20.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:57:20 smithi149 ceph-mon[34678]: pgmap v320: 33 pgs: 33 active+clean; 609 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 4.4 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-03-26T16:57:21.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:57:21 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:57:21] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:57:21.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:57:21 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:57:21] INFO grpc.py:2291: get_subsystems: [] 2024-03-26T16:57:21.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:57:21 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:57:21] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:57:21.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:57:21 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:57:21] INFO grpc.py:2291: get_subsystems: [] 2024-03-26T16:57:22.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:57:22 smithi044 ceph-mon[30624]: pgmap v321: 33 pgs: 33 active+clean; 609 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 3.4 KiB/s rd, 1.1 KiB/s wr, 5 op/s 2024-03-26T16:57:22.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:57:22 smithi064 ceph-mon[34420]: pgmap v321: 33 pgs: 33 active+clean; 609 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 3.4 KiB/s rd, 1.1 KiB/s wr, 5 op/s 2024-03-26T16:57:22.555 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:57:22 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:57:22] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:57:22.556 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:57:22 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:57:22] INFO grpc.py:2291: get_subsystems: [] 2024-03-26T16:57:22.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:57:22 smithi149 ceph-mon[34678]: pgmap v321: 33 pgs: 33 active+clean; 609 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 3.4 KiB/s rd, 1.1 KiB/s wr, 5 op/s 2024-03-26T16:57:23.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:57:23 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:57:23] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:57:23.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:57:23 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:57:23] INFO grpc.py:2291: get_subsystems: [] 2024-03-26T16:57:23.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:57:23 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:57:23] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:57:23.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:57:23 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:57:23] INFO grpc.py:2291: get_subsystems: [] 2024-03-26T16:57:24.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:57:24 smithi044 ceph-mon[30624]: pgmap v322: 33 pgs: 33 active+clean; 609 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 4.0 KiB/s rd, 853 B/s wr, 5 op/s 2024-03-26T16:57:24.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:57:24 smithi064 ceph-mon[34420]: pgmap v322: 33 pgs: 33 active+clean; 609 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 4.0 KiB/s rd, 853 B/s wr, 5 op/s 2024-03-26T16:57:24.555 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:57:24 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:57:24] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:57:24.556 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:57:24 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:57:24] INFO grpc.py:2291: get_subsystems: [] 2024-03-26T16:57:24.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:57:24 smithi149 ceph-mon[34678]: pgmap v322: 33 pgs: 33 active+clean; 609 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 4.0 KiB/s rd, 853 B/s wr, 5 op/s 2024-03-26T16:57:25.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:57:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:57:25] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:57:25.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:57:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:57:25] INFO grpc.py:2291: get_subsystems: [] 2024-03-26T16:57:25.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:57:25 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:57:25] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:57:25.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:57:25 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:57:25] INFO grpc.py:2291: get_subsystems: [] 2024-03-26T16:57:26.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:57:26 smithi044 ceph-mon[30624]: pgmap v323: 33 pgs: 33 active+clean; 609 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 2.6 KiB/s rd, 341 B/s wr, 3 op/s 2024-03-26T16:57:26.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:57:26 smithi064 ceph-mon[34420]: pgmap v323: 33 pgs: 33 active+clean; 609 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 2.6 KiB/s rd, 341 B/s wr, 3 op/s 2024-03-26T16:57:26.555 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:57:26 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:57:26] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:57:26.555 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:57:26 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:57:26] INFO grpc.py:2291: get_subsystems: [] 2024-03-26T16:57:26.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:57:26 smithi149 ceph-mon[34678]: pgmap v323: 33 pgs: 33 active+clean; 609 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 2.6 KiB/s rd, 341 B/s wr, 3 op/s 2024-03-26T16:57:27.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:57:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:57:27] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:57:27.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:57:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:57:27] INFO grpc.py:2291: get_subsystems: [] 2024-03-26T16:57:27.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:57:27 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:57:27] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:57:27.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:57:27 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:57:27] INFO grpc.py:2291: get_subsystems: [] 2024-03-26T16:57:28.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:57:28 smithi044 ceph-mon[30624]: pgmap v324: 33 pgs: 33 active+clean; 609 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 341 B/s wr, 2 op/s 2024-03-26T16:57:28.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:57:28 smithi064 ceph-mon[34420]: pgmap v324: 33 pgs: 33 active+clean; 609 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 341 B/s wr, 2 op/s 2024-03-26T16:57:28.555 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:57:28 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:57:28] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:57:28.556 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:57:28 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:57:28] INFO grpc.py:2291: get_subsystems: [] 2024-03-26T16:57:28.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:57:28 smithi149 ceph-mon[34678]: pgmap v324: 33 pgs: 33 active+clean; 609 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 341 B/s wr, 2 op/s 2024-03-26T16:57:29.448 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:57:29 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-26T16:57:29.453 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:57:29 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-26T16:57:29.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:57:29 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-26T16:57:29.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:57:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:57:29] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:57:29.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:57:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:57:29] INFO grpc.py:2291: get_subsystems: [] 2024-03-26T16:57:29.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:57:29 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:57:29] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:57:29.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:57:29 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:57:29] INFO grpc.py:2291: get_subsystems: [] 2024-03-26T16:57:30.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:57:30 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T16:57:30.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:57:30 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-26T16:57:30.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:57:30 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:57:30.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:57:30 smithi044 ceph-mon[30624]: pgmap v325: 33 pgs: 33 active+clean; 609 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 3.0 KiB/s rd, 85 B/s wr, 3 op/s 2024-03-26T16:57:30.555 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:57:30 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:57:30] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:57:30.555 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:57:30 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:57:30] INFO grpc.py:2291: get_subsystems: [] 2024-03-26T16:57:30.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:57:30 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T16:57:30.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:57:30 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-26T16:57:30.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:57:30 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:57:30.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:57:30 smithi064 ceph-mon[34420]: pgmap v325: 33 pgs: 33 active+clean; 609 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 3.0 KiB/s rd, 85 B/s wr, 3 op/s 2024-03-26T16:57:30.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:57:30 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T16:57:30.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:57:30 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-26T16:57:30.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:57:30 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:57:30.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:57:30 smithi149 ceph-mon[34678]: pgmap v325: 33 pgs: 33 active+clean; 609 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 3.0 KiB/s rd, 85 B/s wr, 3 op/s 2024-03-26T16:57:31.734 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:57:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:57:31] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:57:31.734 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:57:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:57:31] INFO grpc.py:2291: get_subsystems: [] 2024-03-26T16:57:31.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:57:31 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:57:31] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:57:31.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:57:31 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:57:31] INFO grpc.py:2291: get_subsystems: [] 2024-03-26T16:57:32.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:57:32 smithi044 ceph-mon[30624]: pgmap v326: 33 pgs: 33 active+clean; 609 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-03-26T16:57:32.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:57:32 smithi064 ceph-mon[34420]: pgmap v326: 33 pgs: 33 active+clean; 609 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-03-26T16:57:32.555 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:57:32 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:57:32] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:57:32.555 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:57:32 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:57:32] INFO grpc.py:2291: get_subsystems: [] 2024-03-26T16:57:32.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:57:32 smithi149 ceph-mon[34678]: pgmap v326: 33 pgs: 33 active+clean; 609 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-03-26T16:57:33.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:57:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:57:33] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:57:33.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:57:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:57:33] INFO grpc.py:2291: get_subsystems: [] 2024-03-26T16:57:33.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:57:33 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:57:33] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:57:33.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:57:33 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:57:33] INFO grpc.py:2291: get_subsystems: [] 2024-03-26T16:57:34.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:57:34 smithi044 ceph-mon[30624]: pgmap v327: 33 pgs: 33 active+clean; 609 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 3.0 KiB/s rd, 2 op/s 2024-03-26T16:57:34.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:57:34 smithi064 ceph-mon[34420]: pgmap v327: 33 pgs: 33 active+clean; 609 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 3.0 KiB/s rd, 2 op/s 2024-03-26T16:57:34.555 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:57:34 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:57:34] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:57:34.556 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:57:34 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:57:34] INFO grpc.py:2291: get_subsystems: [] 2024-03-26T16:57:34.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:57:34 smithi149 ceph-mon[34678]: pgmap v327: 33 pgs: 33 active+clean; 609 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 3.0 KiB/s rd, 2 op/s 2024-03-26T16:57:35.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:57:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:57:35] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:57:35.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:57:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:57:35] INFO grpc.py:2291: get_subsystems: [] 2024-03-26T16:57:35.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:57:35 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:57:35] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:57:35.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:57:35 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:57:35] INFO grpc.py:2291: get_subsystems: [] 2024-03-26T16:57:36.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:57:36 smithi044 ceph-mon[30624]: pgmap v328: 33 pgs: 33 active+clean; 609 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-03-26T16:57:36.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:57:36 smithi064 ceph-mon[34420]: pgmap v328: 33 pgs: 33 active+clean; 609 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-03-26T16:57:36.555 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:57:36 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:57:36] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:57:36.556 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:57:36 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:57:36] INFO grpc.py:2291: get_subsystems: [] 2024-03-26T16:57:36.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:57:36 smithi149 ceph-mon[34678]: pgmap v328: 33 pgs: 33 active+clean; 609 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-03-26T16:57:37.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:57:37 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:57:37] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:57:37.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:57:37 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:57:37] INFO grpc.py:2291: get_subsystems: [] 2024-03-26T16:57:37.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:57:37 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:57:37] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:57:37.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:57:37 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:57:37] INFO grpc.py:2291: get_subsystems: [] 2024-03-26T16:57:38.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:57:38 smithi044 ceph-mon[30624]: pgmap v329: 33 pgs: 33 active+clean; 609 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-03-26T16:57:38.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:57:38 smithi064 ceph-mon[34420]: pgmap v329: 33 pgs: 33 active+clean; 609 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-03-26T16:57:38.555 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:57:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:57:38] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:57:38.555 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:57:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:57:38] INFO grpc.py:2291: get_subsystems: [] 2024-03-26T16:57:38.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:57:38 smithi149 ceph-mon[34678]: pgmap v329: 33 pgs: 33 active+clean; 609 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-03-26T16:57:39.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:57:39 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:57:39] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:57:39.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:57:39 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:57:39] INFO grpc.py:2291: get_subsystems: [] 2024-03-26T16:57:39.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:57:39 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:57:39] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:57:39.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:57:39 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:57:39] INFO grpc.py:2291: get_subsystems: [] 2024-03-26T16:57:40.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:57:40 smithi044 ceph-mon[30624]: pgmap v330: 33 pgs: 33 active+clean; 609 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 3.0 KiB/s rd, 2 op/s 2024-03-26T16:57:40.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:57:40 smithi064 ceph-mon[34420]: pgmap v330: 33 pgs: 33 active+clean; 609 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 3.0 KiB/s rd, 2 op/s 2024-03-26T16:57:40.555 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:57:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:57:40] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:57:40.555 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:57:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:57:40] INFO grpc.py:2291: get_subsystems: [] 2024-03-26T16:57:40.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:57:40 smithi149 ceph-mon[34678]: pgmap v330: 33 pgs: 33 active+clean; 609 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 3.0 KiB/s rd, 2 op/s 2024-03-26T16:57:41.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:57:41 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:57:41] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:57:41.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:57:41 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:57:41] INFO grpc.py:2291: get_subsystems: [] 2024-03-26T16:57:41.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:57:41 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:57:41] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:57:41.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:57:41 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:57:41] INFO grpc.py:2291: get_subsystems: [] 2024-03-26T16:57:42.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:57:42 smithi044 ceph-mon[30624]: pgmap v331: 33 pgs: 33 active+clean; 609 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-03-26T16:57:42.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:57:42 smithi064 ceph-mon[34420]: pgmap v331: 33 pgs: 33 active+clean; 609 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-03-26T16:57:42.556 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:57:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:57:42] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:57:42.556 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:57:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:57:42] INFO grpc.py:2291: get_subsystems: [] 2024-03-26T16:57:42.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:57:42 smithi149 ceph-mon[34678]: pgmap v331: 33 pgs: 33 active+clean; 609 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-03-26T16:57:43.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:57:43 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:57:43] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:57:43.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:57:43 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:57:43] INFO grpc.py:2291: get_subsystems: [] 2024-03-26T16:57:43.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:57:43 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:57:43] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:57:43.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:57:43 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:57:43] INFO grpc.py:2291: get_subsystems: [] 2024-03-26T16:57:44.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:57:44 smithi044 ceph-mon[30624]: pgmap v332: 33 pgs: 33 active+clean; 609 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 3.0 KiB/s rd, 2 op/s 2024-03-26T16:57:44.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:57:44 smithi064 ceph-mon[34420]: pgmap v332: 33 pgs: 33 active+clean; 609 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 3.0 KiB/s rd, 2 op/s 2024-03-26T16:57:44.555 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:57:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:57:44] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:57:44.555 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:57:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:57:44] INFO grpc.py:2291: get_subsystems: [] 2024-03-26T16:57:44.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:57:44 smithi149 ceph-mon[34678]: pgmap v332: 33 pgs: 33 active+clean; 609 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 3.0 KiB/s rd, 2 op/s 2024-03-26T16:57:45.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:57:45 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:57:45] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:57:45.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:57:45 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:57:45] INFO grpc.py:2291: get_subsystems: [] 2024-03-26T16:57:46.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:57:45 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:57:45] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:57:46.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:57:45 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:57:45] INFO grpc.py:2291: get_subsystems: [] 2024-03-26T16:57:46.433 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:57:46 smithi064 ceph-mon[34420]: pgmap v333: 33 pgs: 33 active+clean; 609 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-03-26T16:57:46.434 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:57:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:57:46] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:57:46.434 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:57:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:57:46] INFO grpc.py:2291: get_subsystems: [] 2024-03-26T16:57:46.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:57:46 smithi044 ceph-mon[30624]: pgmap v333: 33 pgs: 33 active+clean; 609 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-03-26T16:57:46.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:57:46 smithi149 ceph-mon[34678]: pgmap v333: 33 pgs: 33 active+clean; 609 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-03-26T16:57:47.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:57:47 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:57:47] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:57:47.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:57:47 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:57:47] INFO grpc.py:2291: get_subsystems: [] 2024-03-26T16:57:48.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:57:47 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:57:47] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:57:48.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:57:47 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:57:47] INFO grpc.py:2291: get_subsystems: [] 2024-03-26T16:57:48.435 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:57:48 smithi064 ceph-mon[34420]: pgmap v334: 33 pgs: 33 active+clean; 609 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-03-26T16:57:48.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:57:48 smithi044 ceph-mon[30624]: pgmap v334: 33 pgs: 33 active+clean; 609 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-03-26T16:57:48.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:57:48 smithi149 ceph-mon[34678]: pgmap v334: 33 pgs: 33 active+clean; 609 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-03-26T16:57:48.805 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:57:48 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:57:48] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:57:48.805 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:57:48 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:57:48] INFO grpc.py:2291: get_subsystems: [] 2024-03-26T16:57:49.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:57:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:57:49] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:57:49.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:57:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:57:49] INFO grpc.py:2291: get_subsystems: [] 2024-03-26T16:57:50.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:57:49 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:57:49] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:57:50.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:57:49 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:57:49] INFO grpc.py:2291: get_subsystems: [] 2024-03-26T16:57:50.443 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:57:50 smithi064 ceph-mon[34420]: pgmap v335: 33 pgs: 33 active+clean; 609 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 3.0 KiB/s rd, 2 op/s 2024-03-26T16:57:50.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:57:50 smithi044 ceph-mon[30624]: pgmap v335: 33 pgs: 33 active+clean; 609 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 3.0 KiB/s rd, 2 op/s 2024-03-26T16:57:50.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:57:50 smithi149 ceph-mon[34678]: pgmap v335: 33 pgs: 33 active+clean; 609 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 3.0 KiB/s rd, 2 op/s 2024-03-26T16:57:50.805 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:57:50 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:57:50] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:57:50.805 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:57:50 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:57:50] INFO grpc.py:2291: get_subsystems: [] 2024-03-26T16:57:51.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:57:51 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:57:51] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:57:51.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:57:51 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:57:51] INFO grpc.py:2291: get_subsystems: [] 2024-03-26T16:57:52.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:57:51 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:57:51] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:57:52.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:57:51 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:57:51] INFO grpc.py:2291: get_subsystems: [] 2024-03-26T16:57:52.451 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:57:52 smithi064 ceph-mon[34420]: pgmap v336: 33 pgs: 33 active+clean; 609 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-03-26T16:57:52.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:57:52 smithi044 ceph-mon[30624]: pgmap v336: 33 pgs: 33 active+clean; 609 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-03-26T16:57:52.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:57:52 smithi149 ceph-mon[34678]: pgmap v336: 33 pgs: 33 active+clean; 609 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-03-26T16:57:52.805 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:57:52 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:57:52] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:57:52.805 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:57:52 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:57:52] INFO grpc.py:2291: get_subsystems: [] 2024-03-26T16:57:53.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:57:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:57:53] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:57:53.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:57:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:57:53] INFO grpc.py:2291: get_subsystems: [] 2024-03-26T16:57:54.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:57:53 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:57:53] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:57:54.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:57:53 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:57:53] INFO grpc.py:2291: get_subsystems: [] 2024-03-26T16:57:54.459 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:57:54 smithi064 ceph-mon[34420]: pgmap v337: 33 pgs: 33 active+clean; 609 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 3.0 KiB/s rd, 2 op/s 2024-03-26T16:57:54.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:57:54 smithi044 ceph-mon[30624]: pgmap v337: 33 pgs: 33 active+clean; 609 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 3.0 KiB/s rd, 2 op/s 2024-03-26T16:57:54.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:57:54 smithi149 ceph-mon[34678]: pgmap v337: 33 pgs: 33 active+clean; 609 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 3.0 KiB/s rd, 2 op/s 2024-03-26T16:57:54.805 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:57:54 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:57:54] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:57:54.805 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:57:54 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:57:54] INFO grpc.py:2291: get_subsystems: [] 2024-03-26T16:57:55.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:57:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:57:55] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:57:55.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:57:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:57:55] INFO grpc.py:2291: get_subsystems: [] 2024-03-26T16:57:56.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:57:55 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:57:55] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:57:56.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:57:55 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:57:55] INFO grpc.py:2291: get_subsystems: [] 2024-03-26T16:57:56.467 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:57:56 smithi064 ceph-mon[34420]: pgmap v338: 33 pgs: 33 active+clean; 609 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-03-26T16:57:56.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:57:56 smithi044 ceph-mon[30624]: pgmap v338: 33 pgs: 33 active+clean; 609 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-03-26T16:57:56.615 INFO:tasks.workunit.client.3.smithi157.stderr:Note: switching to 'b4c4828f419f1247fc297e8069c1036b1d6151f2'. 2024-03-26T16:57:56.615 INFO:tasks.workunit.client.3.smithi157.stderr: 2024-03-26T16:57:56.615 INFO:tasks.workunit.client.3.smithi157.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-03-26T16:57:56.615 INFO:tasks.workunit.client.3.smithi157.stderr:changes and commit them, and you can discard any commits you make in this 2024-03-26T16:57:56.615 INFO:tasks.workunit.client.3.smithi157.stderr:state without impacting any branches by switching back to a branch. 2024-03-26T16:57:56.615 INFO:tasks.workunit.client.3.smithi157.stderr: 2024-03-26T16:57:56.615 INFO:tasks.workunit.client.3.smithi157.stderr:If you want to create a new branch to retain commits you create, you may 2024-03-26T16:57:56.615 INFO:tasks.workunit.client.3.smithi157.stderr:do so (now or later) by using -c with the switch command. Example: 2024-03-26T16:57:56.616 INFO:tasks.workunit.client.3.smithi157.stderr: 2024-03-26T16:57:56.616 INFO:tasks.workunit.client.3.smithi157.stderr: git switch -c 2024-03-26T16:57:56.616 INFO:tasks.workunit.client.3.smithi157.stderr: 2024-03-26T16:57:56.616 INFO:tasks.workunit.client.3.smithi157.stderr:Or undo this operation with: 2024-03-26T16:57:56.616 INFO:tasks.workunit.client.3.smithi157.stderr: 2024-03-26T16:57:56.616 INFO:tasks.workunit.client.3.smithi157.stderr: git switch - 2024-03-26T16:57:56.616 INFO:tasks.workunit.client.3.smithi157.stderr: 2024-03-26T16:57:56.616 INFO:tasks.workunit.client.3.smithi157.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-03-26T16:57:56.616 INFO:tasks.workunit.client.3.smithi157.stderr: 2024-03-26T16:57:56.616 INFO:tasks.workunit.client.3.smithi157.stderr:HEAD is now at b4c4828f419 use latest build 2024-03-26T16:57:56.619 DEBUG:teuthology.orchestra.run.smithi157:> cd -- /home/ubuntu/cephtest/clone.client.3/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.3 2024-03-26T16:57:56.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:57:56 smithi149 ceph-mon[34678]: pgmap v338: 33 pgs: 33 active+clean; 609 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-03-26T16:57:56.679 INFO:tasks.workunit.client.3.smithi157.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-03-26T16:57:56.681 INFO:tasks.workunit.client.3.smithi157.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.3/qa/workunits/direct_io' 2024-03-26T16:57:56.681 INFO:tasks.workunit.client.3.smithi157.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-03-26T16:57:56.805 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:57:56 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:57:56] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:57:56.805 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:57:56 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:57:56] INFO grpc.py:2291: get_subsystems: [] 2024-03-26T16:57:57.470 INFO:tasks.workunit.client.3.smithi157.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-03-26T16:57:57.536 INFO:tasks.workunit.client.3.smithi157.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-03-26T16:57:57.578 INFO:tasks.workunit.client.3.smithi157.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.3/qa/workunits/direct_io' 2024-03-26T16:57:57.579 INFO:tasks.workunit.client.3.smithi157.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.3/qa/workunits/fs' 2024-03-26T16:57:57.579 INFO:tasks.workunit.client.3.smithi157.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-03-26T16:57:57.618 INFO:tasks.workunit.client.3.smithi157.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.3/qa/workunits/fs' 2024-03-26T16:57:57.621 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-03-26T16:57:57.621 DEBUG:teuthology.orchestra.run.smithi157:> dd if=/home/ubuntu/cephtest/workunits.list.client.3 of=/dev/stdout 2024-03-26T16:57:57.677 INFO:tasks.workunit:Running workunits matching rbd/nvmeof_setup_subsystem.sh on client.3... 2024-03-26T16:57:57.678 INFO:tasks.workunit:Running workunit rbd/nvmeof_setup_subsystem.sh... 2024-03-26T16:57:57.678 DEBUG:teuthology.orchestra.run.smithi157:workunit test rbd/nvmeof_setup_subsystem.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.3/client.3/tmp && cd -- /home/ubuntu/cephtest/mnt.3/client.3/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=b4c4828f419f1247fc297e8069c1036b1d6151f2 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="3" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.3 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.3 CEPH_MNT=/home/ubuntu/cephtest/mnt.3 RBD_IMAGE_PREFIX=myimage RBD_POOL=mypool timeout 3h /home/ubuntu/cephtest/clone.client.3/qa/workunits/rbd/nvmeof_setup_subsystem.sh 2024-03-26T16:57:57.734 INFO:tasks.workunit.client.3.smithi157.stderr:+ source /etc/ceph/nvmeof.env 2024-03-26T16:57:57.734 INFO:tasks.workunit.client.3.smithi157.stderr:++ NVMEOF_GATEWAY_IP_ADDRESSES=172.21.15.44,172.21.15.64,172.21.15.149 2024-03-26T16:57:57.734 INFO:tasks.workunit.client.3.smithi157.stderr:++ NVMEOF_GATEWAY_NAMES=smithi044,smithi064,smithi149 2024-03-26T16:57:57.734 INFO:tasks.workunit.client.3.smithi157.stderr:++ NVMEOF_DEFAULT_GATEWAY_IP_ADDRESS=172.21.15.44 2024-03-26T16:57:57.734 INFO:tasks.workunit.client.3.smithi157.stderr:++ NVMEOF_CLI_IMAGE=quay.io/barakda1/nvmeof-cli:qe_ceph_devel_21e59b2 2024-03-26T16:57:57.734 INFO:tasks.workunit.client.3.smithi157.stderr:++ NVMEOF_SUBSYSTEMS_PREFIX=nqn.2016-06.io.spdk:cnode 2024-03-26T16:57:57.734 INFO:tasks.workunit.client.3.smithi157.stderr:++ NVMEOF_SUBSYSTEMS_COUNT=3 2024-03-26T16:57:57.734 INFO:tasks.workunit.client.3.smithi157.stderr:++ NVMEOF_NAMESPACES_COUNT=20 2024-03-26T16:57:57.734 INFO:tasks.workunit.client.3.smithi157.stderr:++ NVMEOF_PORT=4420 2024-03-26T16:57:57.734 INFO:tasks.workunit.client.3.smithi157.stderr:++ NVMEOF_SRPORT=5500 2024-03-26T16:57:57.734 INFO:tasks.workunit.client.3.smithi157.stderr:+ RBD_POOL=mypool 2024-03-26T16:57:57.734 INFO:tasks.workunit.client.3.smithi157.stderr:+ RBD_IMAGE_PREFIX=myimage 2024-03-26T16:57:57.735 INFO:tasks.workunit.client.3.smithi157.stderr:++ hostname 2024-03-26T16:57:57.735 INFO:tasks.workunit.client.3.smithi157.stderr:+ HOSTNAME=smithi157 2024-03-26T16:57:57.735 INFO:tasks.workunit.client.3.smithi157.stderr:+ sudo podman images 2024-03-26T16:57:57.766 INFO:tasks.workunit.client.3.smithi157.stdout:REPOSITORY TAG IMAGE ID CREATED SIZE 2024-03-26T16:57:57.766 INFO:tasks.workunit.client.3.smithi157.stdout:quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph bf9505fb569e9b95a78f9700ed8c4bd20508ef55 5795ddf10274 46 hours ago 1.41 GB 2024-03-26T16:57:57.769 INFO:tasks.workunit.client.3.smithi157.stderr:+ sudo podman ps 2024-03-26T16:57:57.801 INFO:tasks.workunit.client.3.smithi157.stdout:CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES 2024-03-26T16:57:57.804 INFO:tasks.workunit.client.3.smithi157.stderr:+ sudo podman run -it quay.io/barakda1/nvmeof-cli:qe_ceph_devel_21e59b2 --server-address 172.21.15.44 --server-port 5500 --format json subsystem list 2024-03-26T16:57:57.835 INFO:tasks.workunit.client.3.smithi157.stderr:time="2024-03-26T16:57:57Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2024-03-26T16:57:57.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:57:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:57:57] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:57:57.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:57:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:57:57] INFO grpc.py:2291: get_subsystems: [] 2024-03-26T16:57:57.914 INFO:tasks.workunit.client.3.smithi157.stderr:Trying to pull quay.io/barakda1/nvmeof-cli:qe_ceph_devel_21e59b2... 2024-03-26T16:57:58.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:57:57 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:57:57] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:57:58.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:57:57 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:57:57] INFO grpc.py:2291: get_subsystems: [] 2024-03-26T16:57:58.475 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:57:58 smithi064 ceph-mon[34420]: pgmap v339: 33 pgs: 33 active+clean; 609 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-03-26T16:57:58.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:57:58 smithi044 ceph-mon[30624]: pgmap v339: 33 pgs: 33 active+clean; 609 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-03-26T16:57:58.609 INFO:tasks.workunit.client.3.smithi157.stderr:Getting image source signatures 2024-03-26T16:57:58.609 INFO:tasks.workunit.client.3.smithi157.stderr:Copying blob sha256:6e51536dedf90168a0bc9cb9af58369dec78911d3e6da454fa09b7c3a5a159ab 2024-03-26T16:57:58.609 INFO:tasks.workunit.client.3.smithi157.stderr:Copying blob sha256:99a7ec374c4d4af5f9b9ad281068affa7961aad432aba4efc963785a5a350f8d 2024-03-26T16:57:58.609 INFO:tasks.workunit.client.3.smithi157.stderr:Copying blob sha256:7862bfed9e662a4a24e108d6a0094eeba1718b16742ec4a88bfce38ff8766eec 2024-03-26T16:57:58.609 INFO:tasks.workunit.client.3.smithi157.stderr:Copying blob sha256:ef231e4d4ebac5d622ed6d6ef2ee615da2a6c2dd18e604263e85819ed290ec57 2024-03-26T16:57:58.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:57:58 smithi149 ceph-mon[34678]: pgmap v339: 33 pgs: 33 active+clean; 609 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-03-26T16:57:58.805 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:57:58 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:57:58] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:57:58.805 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:57:58 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:57:58] INFO grpc.py:2291: get_subsystems: [] 2024-03-26T16:57:59.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:57:59 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:57:59] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:57:59.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:57:59 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:57:59] INFO grpc.py:2291: get_subsystems: [] 2024-03-26T16:58:00.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:57:59 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:57:59] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:58:00.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:57:59 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:57:59] INFO grpc.py:2291: get_subsystems: [] 2024-03-26T16:58:00.283 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:58:00 smithi044 ceph-mon[30624]: pgmap v340: 33 pgs: 33 active+clean; 609 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 3.0 KiB/s rd, 2 op/s 2024-03-26T16:58:00.483 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:58:00 smithi064 ceph-mon[34420]: pgmap v340: 33 pgs: 33 active+clean; 609 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 3.0 KiB/s rd, 2 op/s 2024-03-26T16:58:00.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:58:00 smithi149 ceph-mon[34678]: pgmap v340: 33 pgs: 33 active+clean; 609 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 3.0 KiB/s rd, 2 op/s 2024-03-26T16:58:00.805 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:00 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:00] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:58:00.805 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:00 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:00] INFO grpc.py:2291: get_subsystems: [] 2024-03-26T16:58:01.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:01 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:01] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:58:01.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:01 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:01] INFO grpc.py:2291: get_subsystems: [] 2024-03-26T16:58:02.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:01 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:01] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:58:02.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:01 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:01] INFO grpc.py:2291: get_subsystems: [] 2024-03-26T16:58:02.491 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:58:02 smithi064 ceph-mon[34420]: pgmap v341: 33 pgs: 33 active+clean; 609 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-03-26T16:58:02.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:58:02 smithi044 ceph-mon[30624]: pgmap v341: 33 pgs: 33 active+clean; 609 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-03-26T16:58:02.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:58:02 smithi149 ceph-mon[34678]: pgmap v341: 33 pgs: 33 active+clean; 609 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-03-26T16:58:02.805 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:02 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:02] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:58:02.805 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:02 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:02] INFO grpc.py:2291: get_subsystems: [] 2024-03-26T16:58:03.040 INFO:tasks.workunit.client.3.smithi157.stderr:Copying config sha256:b55ba515364cb26f1c1dabb660016f13db8ce6bca2949a79522b66a343a285ec 2024-03-26T16:58:03.182 INFO:tasks.workunit.client.3.smithi157.stderr:Writing manifest to image destination 2024-03-26T16:58:03.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:03 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:03] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:58:03.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:03 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:03] INFO grpc.py:2291: get_subsystems: [] 2024-03-26T16:58:04.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:03 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:03] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:58:04.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:03 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:03] INFO grpc.py:2291: get_subsystems: [] 2024-03-26T16:58:04.499 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:58:04 smithi064 ceph-mon[34420]: pgmap v342: 33 pgs: 33 active+clean; 609 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 3.0 KiB/s rd, 2 op/s 2024-03-26T16:58:04.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:58:04 smithi044 ceph-mon[30624]: pgmap v342: 33 pgs: 33 active+clean; 609 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 3.0 KiB/s rd, 2 op/s 2024-03-26T16:58:04.581 INFO:tasks.workunit.client.3.smithi157.stdout:{ 2024-03-26T16:58:04.581 INFO:tasks.workunit.client.3.smithi157.stdout: "error_message": "Success", 2024-03-26T16:58:04.581 INFO:tasks.workunit.client.3.smithi157.stdout: "status": 0, 2024-03-26T16:58:04.581 INFO:tasks.workunit.client.3.smithi157.stdout: "subsystems": [] 2024-03-26T16:58:04.581 INFO:tasks.workunit.client.3.smithi157.stdout:} 2024-03-26T16:58:04.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:58:04 smithi149 ceph-mon[34678]: pgmap v342: 33 pgs: 33 active+clean; 609 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 3.0 KiB/s rd, 2 op/s 2024-03-26T16:58:04.805 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:04 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:04] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:58:04.805 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:04 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:04] INFO grpc.py:2291: get_subsystems: [] 2024-03-26T16:58:05.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:04 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:04] INFO grpc.py:2243: Received request to list the subsystem, context: 2024-03-26T16:58:05.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:04 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:04] INFO grpc.py:2251: list_subsystems: [] 2024-03-26T16:58:05.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:05 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:05] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:58:05.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:05 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:05] INFO grpc.py:2291: get_subsystems: [] 2024-03-26T16:58:06.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:05 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:05] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:58:06.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:05 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:05] INFO grpc.py:2291: get_subsystems: [] 2024-03-26T16:58:06.506 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:58:06 smithi064 ceph-mon[34420]: pgmap v343: 33 pgs: 33 active+clean; 609 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-03-26T16:58:06.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:58:06 smithi044 ceph-mon[30624]: pgmap v343: 33 pgs: 33 active+clean; 609 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-03-26T16:58:06.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:58:06 smithi149 ceph-mon[34678]: pgmap v343: 33 pgs: 33 active+clean; 609 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-03-26T16:58:06.805 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:06 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:06] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:58:06.805 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:06 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:06] INFO grpc.py:2291: get_subsystems: [] 2024-03-26T16:58:07.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:07 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:07] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:58:07.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:07 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:07] INFO grpc.py:2291: get_subsystems: [] 2024-03-26T16:58:08.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:07 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:07] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:58:08.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:07 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:07] INFO grpc.py:2291: get_subsystems: [] 2024-03-26T16:58:08.515 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:58:08 smithi064 ceph-mon[34420]: pgmap v344: 33 pgs: 33 active+clean; 609 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-03-26T16:58:08.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:58:08 smithi044 ceph-mon[30624]: pgmap v344: 33 pgs: 33 active+clean; 609 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-03-26T16:58:08.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:58:08 smithi149 ceph-mon[34678]: pgmap v344: 33 pgs: 33 active+clean; 609 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-03-26T16:58:08.805 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:08 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:08] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:58:08.805 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:08 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:08] INFO grpc.py:2291: get_subsystems: [] 2024-03-26T16:58:09.605 INFO:tasks.workunit.client.3.smithi157.stderr:+ IFS=, 2024-03-26T16:58:09.606 INFO:tasks.workunit.client.3.smithi157.stderr:+ read -ra gateway_ips 2024-03-26T16:58:09.606 INFO:tasks.workunit.client.3.smithi157.stderr:+ IFS=, 2024-03-26T16:58:09.606 INFO:tasks.workunit.client.3.smithi157.stderr:+ read -ra gateway_names 2024-03-26T16:58:09.606 INFO:tasks.workunit.client.3.smithi157.stderr:++ echo 172.21.15.44,172.21.15.64,172.21.15.149 2024-03-26T16:58:09.606 INFO:tasks.workunit.client.3.smithi157.stderr:++ tr -cd , 2024-03-26T16:58:09.606 INFO:tasks.workunit.client.3.smithi157.stderr:++ wc -c 2024-03-26T16:58:09.614 INFO:tasks.workunit.client.3.smithi157.stderr:+ gateways_count=3 2024-03-26T16:58:09.614 INFO:tasks.workunit.client.3.smithi157.stderr:+ list_subsystems 2024-03-26T16:58:09.614 INFO:tasks.workunit.client.3.smithi157.stderr:+ for i in "${!gateway_ips[@]}" 2024-03-26T16:58:09.614 INFO:tasks.workunit.client.3.smithi157.stderr:+ ip=172.21.15.44 2024-03-26T16:58:09.614 INFO:tasks.workunit.client.3.smithi157.stderr:+ sudo podman run -it quay.io/barakda1/nvmeof-cli:qe_ceph_devel_21e59b2 --server-address 172.21.15.44 --server-port 5500 --format json subsystem list 2024-03-26T16:58:09.709 INFO:tasks.workunit.client.3.smithi157.stderr:time="2024-03-26T16:58:09Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2024-03-26T16:58:09.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:09 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:09] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:58:09.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:09 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:09] INFO grpc.py:2291: get_subsystems: [] 2024-03-26T16:58:10.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:09 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:09] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:58:10.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:09 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:09] INFO grpc.py:2291: get_subsystems: [] 2024-03-26T16:58:10.429 INFO:tasks.workunit.client.3.smithi157.stdout:{ 2024-03-26T16:58:10.429 INFO:tasks.workunit.client.3.smithi157.stdout: "error_message": "Success", 2024-03-26T16:58:10.429 INFO:tasks.workunit.client.3.smithi157.stdout: "status": 0, 2024-03-26T16:58:10.429 INFO:tasks.workunit.client.3.smithi157.stdout: "subsystems": [] 2024-03-26T16:58:10.429 INFO:tasks.workunit.client.3.smithi157.stdout:} 2024-03-26T16:58:10.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:58:10 smithi044 ceph-mon[30624]: pgmap v345: 33 pgs: 33 active+clean; 609 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 3.0 KiB/s rd, 2 op/s 2024-03-26T16:58:10.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:10 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:10] INFO grpc.py:2243: Received request to list the subsystem, context: 2024-03-26T16:58:10.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:10 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:10] INFO grpc.py:2251: list_subsystems: [] 2024-03-26T16:58:10.522 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:58:10 smithi064 ceph-mon[34420]: pgmap v345: 33 pgs: 33 active+clean; 609 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 3.0 KiB/s rd, 2 op/s 2024-03-26T16:58:10.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:58:10 smithi149 ceph-mon[34678]: pgmap v345: 33 pgs: 33 active+clean; 609 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 3.0 KiB/s rd, 2 op/s 2024-03-26T16:58:10.805 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:10 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:10] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:58:10.806 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:10 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:10] INFO grpc.py:2291: get_subsystems: [] 2024-03-26T16:58:11.289 INFO:tasks.workunit.client.3.smithi157.stderr:+ for i in "${!gateway_ips[@]}" 2024-03-26T16:58:11.289 INFO:tasks.workunit.client.3.smithi157.stderr:+ ip=172.21.15.64 2024-03-26T16:58:11.289 INFO:tasks.workunit.client.3.smithi157.stderr:+ sudo podman run -it quay.io/barakda1/nvmeof-cli:qe_ceph_devel_21e59b2 --server-address 172.21.15.64 --server-port 5500 --format json subsystem list 2024-03-26T16:58:11.521 INFO:tasks.workunit.client.3.smithi157.stderr:time="2024-03-26T16:58:11Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2024-03-26T16:58:11.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:11 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:11] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:58:11.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:11 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:11] INFO grpc.py:2291: get_subsystems: [] 2024-03-26T16:58:12.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:11 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:11] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:58:12.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:11 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:11] INFO grpc.py:2291: get_subsystems: [] 2024-03-26T16:58:12.234 INFO:tasks.workunit.client.3.smithi157.stdout:{ 2024-03-26T16:58:12.234 INFO:tasks.workunit.client.3.smithi157.stdout: "error_message": "Success", 2024-03-26T16:58:12.234 INFO:tasks.workunit.client.3.smithi157.stdout: "status": 0, 2024-03-26T16:58:12.234 INFO:tasks.workunit.client.3.smithi157.stdout: "subsystems": [] 2024-03-26T16:58:12.235 INFO:tasks.workunit.client.3.smithi157.stdout:} 2024-03-26T16:58:12.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:58:12 smithi044 ceph-mon[30624]: pgmap v346: 33 pgs: 33 active+clean; 609 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-03-26T16:58:12.530 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:58:12 smithi064 ceph-mon[34420]: pgmap v346: 33 pgs: 33 active+clean; 609 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-03-26T16:58:12.530 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:12 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:12] INFO grpc.py:2243: Received request to list the subsystem, context: 2024-03-26T16:58:12.531 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:12 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:12] INFO grpc.py:2251: list_subsystems: [] 2024-03-26T16:58:12.531 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:12 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:12] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:58:12.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:58:12 smithi149 ceph-mon[34678]: pgmap v346: 33 pgs: 33 active+clean; 609 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-03-26T16:58:12.805 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:12 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:12] INFO grpc.py:2291: get_subsystems: [] 2024-03-26T16:58:13.173 INFO:tasks.workunit.client.3.smithi157.stderr:+ for i in "${!gateway_ips[@]}" 2024-03-26T16:58:13.173 INFO:tasks.workunit.client.3.smithi157.stderr:+ ip=172.21.15.149 2024-03-26T16:58:13.174 INFO:tasks.workunit.client.3.smithi157.stderr:+ sudo podman run -it quay.io/barakda1/nvmeof-cli:qe_ceph_devel_21e59b2 --server-address 172.21.15.149 --server-port 5500 --format json subsystem list 2024-03-26T16:58:13.256 INFO:tasks.workunit.client.3.smithi157.stderr:time="2024-03-26T16:58:13Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2024-03-26T16:58:13.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:13 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:13] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:58:13.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:13 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:13] INFO grpc.py:2291: get_subsystems: [] 2024-03-26T16:58:13.995 INFO:tasks.workunit.client.3.smithi157.stdout:{ 2024-03-26T16:58:13.995 INFO:tasks.workunit.client.3.smithi157.stdout: "error_message": "Success", 2024-03-26T16:58:13.995 INFO:tasks.workunit.client.3.smithi157.stdout: "status": 0, 2024-03-26T16:58:13.995 INFO:tasks.workunit.client.3.smithi157.stdout: "subsystems": [] 2024-03-26T16:58:13.995 INFO:tasks.workunit.client.3.smithi157.stdout:} 2024-03-26T16:58:14.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:13 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:13] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:58:14.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:13 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:13] INFO grpc.py:2291: get_subsystems: [] 2024-03-26T16:58:14.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:58:14 smithi149 ceph-mon[34678]: pgmap v347: 33 pgs: 33 active+clean; 609 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 3.0 KiB/s rd, 2 op/s 2024-03-26T16:58:14.396 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:13 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:13] INFO grpc.py:2243: Received request to list the subsystem, context: 2024-03-26T16:58:14.396 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:13 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:13] INFO grpc.py:2251: list_subsystems: [] 2024-03-26T16:58:14.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:58:14 smithi044 ceph-mon[30624]: pgmap v347: 33 pgs: 33 active+clean; 609 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 3.0 KiB/s rd, 2 op/s 2024-03-26T16:58:14.538 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:58:14 smithi064 ceph-mon[34420]: pgmap v347: 33 pgs: 33 active+clean; 609 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 3.0 KiB/s rd, 2 op/s 2024-03-26T16:58:14.805 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:14 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:14] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:58:14.805 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:14 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:14] INFO grpc.py:2291: get_subsystems: [] 2024-03-26T16:58:14.927 INFO:tasks.workunit.client.3.smithi157.stderr:++ seq 1 3 2024-03-26T16:58:14.937 INFO:tasks.workunit.client.3.smithi157.stderr:+ for i in $(seq 1 $NVMEOF_SUBSYSTEMS_COUNT) 2024-03-26T16:58:14.937 INFO:tasks.workunit.client.3.smithi157.stderr:+ subsystem_nqn=nqn.2016-06.io.spdk:cnode1 2024-03-26T16:58:14.937 INFO:tasks.workunit.client.3.smithi157.stderr:+ sudo podman run -it quay.io/barakda1/nvmeof-cli:qe_ceph_devel_21e59b2 --server-address 172.21.15.44 --server-port 5500 subsystem add --subsystem nqn.2016-06.io.spdk:cnode1 --enable-ha 2024-03-26T16:58:15.014 INFO:tasks.workunit.client.3.smithi157.stderr:time="2024-03-26T16:58:15Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2024-03-26T16:58:15.710 INFO:tasks.workunit.client.3.smithi157.stdout:Adding subsystem nqn.2016-06.io.spdk:cnode1: Successful 2024-03-26T16:58:15.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:15 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:15] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:58:15.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:15 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:15] INFO grpc.py:2291: get_subsystems: [] 2024-03-26T16:58:15.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:15 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:15] INFO grpc.py:465: Received request to create subsystem nqn.2016-06.io.spdk:cnode1, enable_ha: True, context: None 2024-03-26T16:58:15.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:15 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:15] INFO grpc.py:525: create_subsystem nqn.2016-06.io.spdk:cnode1: True 2024-03-26T16:58:16.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:15 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:15] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:58:16.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:15 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:15] INFO grpc.py:2291: get_subsystems: [] 2024-03-26T16:58:16.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:15 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:15] INFO grpc.py:465: Received request to create subsystem nqn.2016-06.io.spdk:cnode1, enable_ha: True, context: 2024-03-26T16:58:16.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:15 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:15] INFO grpc.py:494: No serial number specified for nqn.2016-06.io.spdk:cnode1, will use Ceph14383361503536 2024-03-26T16:58:16.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:15 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:15] INFO grpc.py:525: create_subsystem nqn.2016-06.io.spdk:cnode1: True 2024-03-26T16:58:16.055 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:15 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:15] INFO grpc.py:465: Received request to create subsystem nqn.2016-06.io.spdk:cnode1, enable_ha: True, context: None 2024-03-26T16:58:16.056 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:15 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:15] INFO grpc.py:525: create_subsystem nqn.2016-06.io.spdk:cnode1: True 2024-03-26T16:58:16.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:58:16 smithi044 ceph-mon[30624]: pgmap v348: 33 pgs: 33 active+clean; 609 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-03-26T16:58:16.547 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:58:16 smithi064 ceph-mon[34420]: pgmap v348: 33 pgs: 33 active+clean; 609 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-03-26T16:58:16.561 INFO:tasks.workunit.client.3.smithi157.stderr:+ for i in $(seq 1 $NVMEOF_SUBSYSTEMS_COUNT) 2024-03-26T16:58:16.561 INFO:tasks.workunit.client.3.smithi157.stderr:+ subsystem_nqn=nqn.2016-06.io.spdk:cnode2 2024-03-26T16:58:16.561 INFO:tasks.workunit.client.3.smithi157.stderr:+ sudo podman run -it quay.io/barakda1/nvmeof-cli:qe_ceph_devel_21e59b2 --server-address 172.21.15.44 --server-port 5500 subsystem add --subsystem nqn.2016-06.io.spdk:cnode2 --enable-ha 2024-03-26T16:58:16.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:58:16 smithi149 ceph-mon[34678]: pgmap v348: 33 pgs: 33 active+clean; 609 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-03-26T16:58:16.649 INFO:tasks.workunit.client.3.smithi157.stderr:time="2024-03-26T16:58:16Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2024-03-26T16:58:16.805 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:16 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:16] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:58:16.805 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:16 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:16] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}] 2024-03-26T16:58:17.409 INFO:tasks.workunit.client.3.smithi157.stdout:Adding subsystem nqn.2016-06.io.spdk:cnode2: Successful 2024-03-26T16:58:17.645 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:17 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:17] INFO grpc.py:465: Received request to create subsystem nqn.2016-06.io.spdk:cnode2, enable_ha: True, context: 2024-03-26T16:58:17.646 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:17 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:17] INFO grpc.py:494: No serial number specified for nqn.2016-06.io.spdk:cnode2, will use Ceph44698087180525 2024-03-26T16:58:17.646 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:17 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:17] INFO grpc.py:525: create_subsystem nqn.2016-06.io.spdk:cnode2: True 2024-03-26T16:58:17.646 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:17 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:17] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:58:17.805 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:17 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:17] INFO grpc.py:465: Received request to create subsystem nqn.2016-06.io.spdk:cnode2, enable_ha: True, context: None 2024-03-26T16:58:17.805 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:17 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:17] INFO grpc.py:525: create_subsystem nqn.2016-06.io.spdk:cnode2: True 2024-03-26T16:58:17.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:17 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:17] INFO grpc.py:465: Received request to create subsystem nqn.2016-06.io.spdk:cnode2, enable_ha: True, context: None 2024-03-26T16:58:17.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:17 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:17] INFO grpc.py:525: create_subsystem nqn.2016-06.io.spdk:cnode2: True 2024-03-26T16:58:17.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:17 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:17] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:58:17.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:17 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:17] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}] 2024-03-26T16:58:18.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:17 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:17] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}] 2024-03-26T16:58:18.272 INFO:tasks.workunit.client.3.smithi157.stderr:+ for i in $(seq 1 $NVMEOF_SUBSYSTEMS_COUNT) 2024-03-26T16:58:18.272 INFO:tasks.workunit.client.3.smithi157.stderr:+ subsystem_nqn=nqn.2016-06.io.spdk:cnode3 2024-03-26T16:58:18.272 INFO:tasks.workunit.client.3.smithi157.stderr:+ sudo podman run -it quay.io/barakda1/nvmeof-cli:qe_ceph_devel_21e59b2 --server-address 172.21.15.44 --server-port 5500 subsystem add --subsystem nqn.2016-06.io.spdk:cnode3 --enable-ha 2024-03-26T16:58:18.353 INFO:tasks.workunit.client.3.smithi157.stderr:time="2024-03-26T16:58:18Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2024-03-26T16:58:18.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:58:18 smithi044 ceph-mon[30624]: pgmap v349: 33 pgs: 33 active+clean; 609 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-03-26T16:58:18.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:58:18 smithi064 ceph-mon[34420]: pgmap v349: 33 pgs: 33 active+clean; 609 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-03-26T16:58:18.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:58:18 smithi149 ceph-mon[34678]: pgmap v349: 33 pgs: 33 active+clean; 609 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-03-26T16:58:18.807 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:18 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:18] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:58:18.807 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:18 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:18] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}] 2024-03-26T16:58:18.807 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:18 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:18] INFO grpc.py:770: Received request to set ana states [nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:18.807 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:18 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: states { 2024-03-26T16:58:18.807 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:18 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: grp_id: 1 2024-03-26T16:58:18.807 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:18 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: state: INACCESSIBLE 2024-03-26T16:58:18.807 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:18 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: } 2024-03-26T16:58:18.807 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:18 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: states { 2024-03-26T16:58:18.807 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:18 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: grp_id: 2 2024-03-26T16:58:18.807 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:18 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: state: OPTIMIZED 2024-03-26T16:58:18.808 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:18 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: } 2024-03-26T16:58:18.808 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:18 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: states { 2024-03-26T16:58:18.808 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:18 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: grp_id: 3 2024-03-26T16:58:18.808 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:18 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: state: INACCESSIBLE 2024-03-26T16:58:18.808 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:18 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: } 2024-03-26T16:58:18.808 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:18 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: states { 2024-03-26T16:58:18.808 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:18 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: grp_id: 4 2024-03-26T16:58:18.808 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:18 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: state: INACCESSIBLE 2024-03-26T16:58:18.808 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:18 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: } 2024-03-26T16:58:18.808 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:18 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: states { 2024-03-26T16:58:18.808 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:18 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: grp_id: 5 2024-03-26T16:58:18.808 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:18 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: state: INACCESSIBLE 2024-03-26T16:58:18.808 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:18 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: } 2024-03-26T16:58:18.808 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:18 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: states { 2024-03-26T16:58:18.809 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:18 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: grp_id: 6 2024-03-26T16:58:18.809 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:18 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: state: INACCESSIBLE 2024-03-26T16:58:18.809 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:18 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: } 2024-03-26T16:58:18.809 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:18 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: states { 2024-03-26T16:58:18.809 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:18 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: grp_id: 7 2024-03-26T16:58:18.809 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:18 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: state: INACCESSIBLE 2024-03-26T16:58:18.809 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:18 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: } 2024-03-26T16:58:18.809 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:18 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: states { 2024-03-26T16:58:18.809 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:18 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: grp_id: 8 2024-03-26T16:58:18.809 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:18 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: state: INACCESSIBLE 2024-03-26T16:58:18.809 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:18 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: } 2024-03-26T16:58:18.810 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:18 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: states { 2024-03-26T16:58:18.811 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:18 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: grp_id: 9 2024-03-26T16:58:18.811 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:18 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: state: INACCESSIBLE 2024-03-26T16:58:18.811 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:18 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: } 2024-03-26T16:58:18.811 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:18 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: states { 2024-03-26T16:58:18.811 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:18 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: grp_id: 10 2024-03-26T16:58:18.811 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:18 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: state: INACCESSIBLE 2024-03-26T16:58:18.811 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:18 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: } 2024-03-26T16:58:18.811 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:18 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: states { 2024-03-26T16:58:18.811 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:18 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: grp_id: 11 2024-03-26T16:58:18.811 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:18 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: state: INACCESSIBLE 2024-03-26T16:58:18.811 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:18 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: } 2024-03-26T16:58:18.811 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:18 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: states { 2024-03-26T16:58:18.812 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:18 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: grp_id: 12 2024-03-26T16:58:18.812 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:18 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: state: INACCESSIBLE 2024-03-26T16:58:18.812 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:18 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: } 2024-03-26T16:58:18.812 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:18 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: states { 2024-03-26T16:58:18.812 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:18 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: grp_id: 13 2024-03-26T16:58:18.812 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:18 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: state: INACCESSIBLE 2024-03-26T16:58:18.812 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:18 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: } 2024-03-26T16:58:18.812 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:18 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: states { 2024-03-26T16:58:18.812 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:18 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: grp_id: 14 2024-03-26T16:58:18.812 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:18 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: state: INACCESSIBLE 2024-03-26T16:58:18.812 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:18 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: } 2024-03-26T16:58:18.812 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:18 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: states { 2024-03-26T16:58:18.812 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:18 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: grp_id: 15 2024-03-26T16:58:18.812 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:18 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: state: INACCESSIBLE 2024-03-26T16:58:18.812 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:18 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: } 2024-03-26T16:58:18.813 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:18 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: states { 2024-03-26T16:58:18.813 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:18 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: grp_id: 16 2024-03-26T16:58:18.813 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:18 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: state: INACCESSIBLE 2024-03-26T16:58:18.813 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:18 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: } 2024-03-26T16:58:18.813 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:18 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: ] 2024-03-26T16:58:18.813 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:18 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:18] INFO grpc.py:1958: Subsystem nqn.2016-06.io.spdk:cnode1 enable_ha: True 2024-03-26T16:58:18.813 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:18 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:18] INFO grpc.py:782: Iterate over nqn='nqn.2016-06.io.spdk:cnode1' prefix='listener_nqn.2016-06.io.spdk:cnode1_smithi064_' listener_keys=[] 2024-03-26T16:58:19.017 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:18 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:18] INFO grpc.py:770: Received request to set ana states [nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:19.017 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:18 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: states { 2024-03-26T16:58:19.017 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:18 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: grp_id: 1 2024-03-26T16:58:19.017 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:18 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: state: INACCESSIBLE 2024-03-26T16:58:19.018 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:18 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: } 2024-03-26T16:58:19.018 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:18 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: states { 2024-03-26T16:58:19.018 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:18 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: grp_id: 2 2024-03-26T16:58:19.018 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:18 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: state: INACCESSIBLE 2024-03-26T16:58:19.018 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:18 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: } 2024-03-26T16:58:19.018 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:18 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: states { 2024-03-26T16:58:19.018 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:18 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: grp_id: 3 2024-03-26T16:58:19.019 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:18 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: state: OPTIMIZED 2024-03-26T16:58:19.019 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:18 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: } 2024-03-26T16:58:19.019 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:18 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: states { 2024-03-26T16:58:19.019 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:18 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: grp_id: 4 2024-03-26T16:58:19.019 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:18 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: state: INACCESSIBLE 2024-03-26T16:58:19.019 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:18 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: } 2024-03-26T16:58:19.019 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:18 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: states { 2024-03-26T16:58:19.020 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:18 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: grp_id: 5 2024-03-26T16:58:19.020 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:18 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: state: INACCESSIBLE 2024-03-26T16:58:19.020 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:18 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: } 2024-03-26T16:58:19.020 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:18 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: states { 2024-03-26T16:58:19.020 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:18 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: grp_id: 6 2024-03-26T16:58:19.020 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:18 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: state: INACCESSIBLE 2024-03-26T16:58:19.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:18 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: } 2024-03-26T16:58:19.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:18 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: states { 2024-03-26T16:58:19.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:18 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: grp_id: 7 2024-03-26T16:58:19.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:18 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: state: INACCESSIBLE 2024-03-26T16:58:19.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:18 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: } 2024-03-26T16:58:19.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:18 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: states { 2024-03-26T16:58:19.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:18 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: grp_id: 8 2024-03-26T16:58:19.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:18 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: state: INACCESSIBLE 2024-03-26T16:58:19.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:18 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: } 2024-03-26T16:58:19.022 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:18 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: states { 2024-03-26T16:58:19.022 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:18 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: grp_id: 9 2024-03-26T16:58:19.022 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:18 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: state: INACCESSIBLE 2024-03-26T16:58:19.022 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:18 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: } 2024-03-26T16:58:19.022 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:18 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: states { 2024-03-26T16:58:19.023 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:18 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: grp_id: 10 2024-03-26T16:58:19.023 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:18 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: state: INACCESSIBLE 2024-03-26T16:58:19.024 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:18 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: } 2024-03-26T16:58:19.024 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:18 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: states { 2024-03-26T16:58:19.024 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:18 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: grp_id: 11 2024-03-26T16:58:19.024 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:18 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: state: INACCESSIBLE 2024-03-26T16:58:19.024 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:18 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: } 2024-03-26T16:58:19.024 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:18 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: states { 2024-03-26T16:58:19.024 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:18 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: grp_id: 12 2024-03-26T16:58:19.024 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:18 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: state: INACCESSIBLE 2024-03-26T16:58:19.025 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:18 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: } 2024-03-26T16:58:19.025 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:18 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: states { 2024-03-26T16:58:19.025 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:18 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: grp_id: 13 2024-03-26T16:58:19.025 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:18 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: state: INACCESSIBLE 2024-03-26T16:58:19.025 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:18 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: } 2024-03-26T16:58:19.025 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:18 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: states { 2024-03-26T16:58:19.025 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:18 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: grp_id: 14 2024-03-26T16:58:19.025 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:18 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: state: INACCESSIBLE 2024-03-26T16:58:19.026 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:18 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: } 2024-03-26T16:58:19.026 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:18 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: states { 2024-03-26T16:58:19.026 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:18 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: grp_id: 15 2024-03-26T16:58:19.026 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:18 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: state: INACCESSIBLE 2024-03-26T16:58:19.026 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:18 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: } 2024-03-26T16:58:19.026 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:18 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: states { 2024-03-26T16:58:19.026 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:18 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: grp_id: 16 2024-03-26T16:58:19.026 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:18 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: state: INACCESSIBLE 2024-03-26T16:58:19.026 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:18 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: } 2024-03-26T16:58:19.027 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:18 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: , nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:19.027 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:18 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: states { 2024-03-26T16:58:19.027 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:18 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: grp_id: 1 2024-03-26T16:58:19.027 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:18 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: state: INACCESSIBLE 2024-03-26T16:58:19.027 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:18 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: } 2024-03-26T16:58:19.027 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:18 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: states { 2024-03-26T16:58:19.027 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:18 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: grp_id: 2 2024-03-26T16:58:19.028 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:18 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: state: INACCESSIBLE 2024-03-26T16:58:19.028 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:18 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: } 2024-03-26T16:58:19.028 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:18 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: states { 2024-03-26T16:58:19.028 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:18 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: grp_id: 3 2024-03-26T16:58:19.028 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:18 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: state: OPTIMIZED 2024-03-26T16:58:19.028 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:18 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: } 2024-03-26T16:58:19.028 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:18 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: states { 2024-03-26T16:58:19.028 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:18 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: grp_id: 4 2024-03-26T16:58:19.029 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:18 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: state: INACCESSIBLE 2024-03-26T16:58:19.029 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:18 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: } 2024-03-26T16:58:19.029 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:18 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: states { 2024-03-26T16:58:19.029 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:18 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: grp_id: 5 2024-03-26T16:58:19.029 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:18 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: state: INACCESSIBLE 2024-03-26T16:58:19.029 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:18 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: } 2024-03-26T16:58:19.029 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:18 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: states { 2024-03-26T16:58:19.029 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:18 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: grp_id: 6 2024-03-26T16:58:19.030 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:18 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: state: INACCESSIBLE 2024-03-26T16:58:19.030 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:18 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: } 2024-03-26T16:58:19.030 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:18 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: states { 2024-03-26T16:58:19.030 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:18 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: grp_id: 7 2024-03-26T16:58:19.030 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:18 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: state: INACCESSIBLE 2024-03-26T16:58:19.030 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:18 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: } 2024-03-26T16:58:19.030 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:18 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: states { 2024-03-26T16:58:19.030 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:18 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: grp_id: 8 2024-03-26T16:58:19.030 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:18 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: state: INACCESSIBLE 2024-03-26T16:58:19.031 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:18 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: } 2024-03-26T16:58:19.031 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:18 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: states { 2024-03-26T16:58:19.031 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:18 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: grp_id: 9 2024-03-26T16:58:19.031 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:18 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: state: INACCESSIBLE 2024-03-26T16:58:19.031 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:18 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: } 2024-03-26T16:58:19.031 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:18 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: states { 2024-03-26T16:58:19.031 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:18 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: grp_id: 10 2024-03-26T16:58:19.031 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:18 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: state: INACCESSIBLE 2024-03-26T16:58:19.031 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:18 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: } 2024-03-26T16:58:19.031 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:18 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: states { 2024-03-26T16:58:19.031 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:18 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: grp_id: 11 2024-03-26T16:58:19.031 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:18 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: state: INACCESSIBLE 2024-03-26T16:58:19.031 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:18 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: } 2024-03-26T16:58:19.032 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:18 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: states { 2024-03-26T16:58:19.032 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:18 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: grp_id: 12 2024-03-26T16:58:19.032 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:18 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: state: INACCESSIBLE 2024-03-26T16:58:19.032 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:18 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: } 2024-03-26T16:58:19.034 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:18 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: states { 2024-03-26T16:58:19.034 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:18 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: grp_id: 13 2024-03-26T16:58:19.034 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:18 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: state: INACCESSIBLE 2024-03-26T16:58:19.034 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:18 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: } 2024-03-26T16:58:19.034 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:18 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: states { 2024-03-26T16:58:19.034 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:18 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: grp_id: 14 2024-03-26T16:58:19.034 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:18 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: state: INACCESSIBLE 2024-03-26T16:58:19.034 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:18 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: } 2024-03-26T16:58:19.035 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:18 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: states { 2024-03-26T16:58:19.035 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:18 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: grp_id: 15 2024-03-26T16:58:19.035 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:18 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: state: INACCESSIBLE 2024-03-26T16:58:19.035 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:18 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: } 2024-03-26T16:58:19.035 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:18 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: states { 2024-03-26T16:58:19.035 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:18 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: grp_id: 16 2024-03-26T16:58:19.035 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:18 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: state: INACCESSIBLE 2024-03-26T16:58:19.035 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:18 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: } 2024-03-26T16:58:19.035 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:18 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: ] 2024-03-26T16:58:19.035 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:18 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:18] INFO grpc.py:1958: Subsystem nqn.2016-06.io.spdk:cnode1 enable_ha: True 2024-03-26T16:58:19.036 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:18 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:18] INFO grpc.py:782: Iterate over nqn='nqn.2016-06.io.spdk:cnode1' prefix='listener_nqn.2016-06.io.spdk:cnode1_smithi044_' listener_keys=[] 2024-03-26T16:58:19.036 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:18 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:18] INFO grpc.py:1958: Subsystem nqn.2016-06.io.spdk:cnode2 enable_ha: True 2024-03-26T16:58:19.036 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:18 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:18] INFO grpc.py:782: Iterate over nqn='nqn.2016-06.io.spdk:cnode2' prefix='listener_nqn.2016-06.io.spdk:cnode2_smithi044_' listener_keys=[] 2024-03-26T16:58:19.050 INFO:tasks.workunit.client.3.smithi157.stdout:Adding subsystem nqn.2016-06.io.spdk:cnode3: Successful 2024-03-26T16:58:19.305 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:19 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:19] INFO grpc.py:465: Received request to create subsystem nqn.2016-06.io.spdk:cnode3, enable_ha: True, context: None 2024-03-26T16:58:19.305 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:19 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:19] INFO grpc.py:525: create_subsystem nqn.2016-06.io.spdk:cnode3: True 2024-03-26T16:58:19.396 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:19 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:19] INFO grpc.py:465: Received request to create subsystem nqn.2016-06.io.spdk:cnode3, enable_ha: True, context: None 2024-03-26T16:58:19.396 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:19 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:19] INFO grpc.py:525: create_subsystem nqn.2016-06.io.spdk:cnode3: True 2024-03-26T16:58:19.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:19 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:19] INFO grpc.py:465: Received request to create subsystem nqn.2016-06.io.spdk:cnode3, enable_ha: True, context: 2024-03-26T16:58:19.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:19 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:19] INFO grpc.py:494: No serial number specified for nqn.2016-06.io.spdk:cnode3, will use Ceph20558982565741 2024-03-26T16:58:19.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:19 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:19] INFO grpc.py:525: create_subsystem nqn.2016-06.io.spdk:cnode3: True 2024-03-26T16:58:19.914 INFO:tasks.workunit.client.3.smithi157.stderr:+ list_subsystems 2024-03-26T16:58:19.915 INFO:tasks.workunit.client.3.smithi157.stderr:+ for i in "${!gateway_ips[@]}" 2024-03-26T16:58:19.915 INFO:tasks.workunit.client.3.smithi157.stderr:+ ip=172.21.15.44 2024-03-26T16:58:19.915 INFO:tasks.workunit.client.3.smithi157.stderr:+ sudo podman run -it quay.io/barakda1/nvmeof-cli:qe_ceph_devel_21e59b2 --server-address 172.21.15.44 --server-port 5500 --format json subsystem list 2024-03-26T16:58:19.993 INFO:tasks.workunit.client.3.smithi157.stderr:time="2024-03-26T16:58:19Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2024-03-26T16:58:20.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:19 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:19] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:58:20.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:19 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:19] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}] 2024-03-26T16:58:20.147 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:19 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:19] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:58:20.147 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:19 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:19] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}] 2024-03-26T16:58:20.147 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:19 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:19] INFO grpc.py:770: Received request to set ana states [nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:20.147 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:19 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: states { 2024-03-26T16:58:20.147 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:19 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: grp_id: 1 2024-03-26T16:58:20.147 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:19 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: state: OPTIMIZED 2024-03-26T16:58:20.148 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:19 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: } 2024-03-26T16:58:20.148 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:19 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: states { 2024-03-26T16:58:20.148 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:19 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: grp_id: 2 2024-03-26T16:58:20.148 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:19 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: state: INACCESSIBLE 2024-03-26T16:58:20.148 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:19 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: } 2024-03-26T16:58:20.148 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:19 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: states { 2024-03-26T16:58:20.148 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:19 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: grp_id: 3 2024-03-26T16:58:20.148 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:19 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: state: INACCESSIBLE 2024-03-26T16:58:20.148 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:19 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: } 2024-03-26T16:58:20.148 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:19 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: states { 2024-03-26T16:58:20.148 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:19 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: grp_id: 4 2024-03-26T16:58:20.148 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:19 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: state: INACCESSIBLE 2024-03-26T16:58:20.148 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:19 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: } 2024-03-26T16:58:20.148 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:19 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: states { 2024-03-26T16:58:20.149 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:19 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: grp_id: 5 2024-03-26T16:58:20.149 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:19 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: state: INACCESSIBLE 2024-03-26T16:58:20.149 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:19 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: } 2024-03-26T16:58:20.149 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:19 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: states { 2024-03-26T16:58:20.149 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:19 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: grp_id: 6 2024-03-26T16:58:20.149 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:19 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: state: INACCESSIBLE 2024-03-26T16:58:20.149 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:19 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: } 2024-03-26T16:58:20.149 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:19 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: states { 2024-03-26T16:58:20.149 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:19 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: grp_id: 7 2024-03-26T16:58:20.150 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:19 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: state: INACCESSIBLE 2024-03-26T16:58:20.150 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:19 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: } 2024-03-26T16:58:20.150 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:19 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: states { 2024-03-26T16:58:20.150 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:19 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: grp_id: 8 2024-03-26T16:58:20.150 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:19 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: state: INACCESSIBLE 2024-03-26T16:58:20.150 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:19 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: } 2024-03-26T16:58:20.150 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:19 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: states { 2024-03-26T16:58:20.150 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:19 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: grp_id: 9 2024-03-26T16:58:20.150 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:19 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: state: INACCESSIBLE 2024-03-26T16:58:20.150 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:19 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: } 2024-03-26T16:58:20.150 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:19 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: states { 2024-03-26T16:58:20.151 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:19 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: grp_id: 10 2024-03-26T16:58:20.151 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:19 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: state: INACCESSIBLE 2024-03-26T16:58:20.151 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:19 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: } 2024-03-26T16:58:20.151 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:19 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: states { 2024-03-26T16:58:20.151 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:19 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: grp_id: 11 2024-03-26T16:58:20.151 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:19 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: state: INACCESSIBLE 2024-03-26T16:58:20.151 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:19 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: } 2024-03-26T16:58:20.151 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:19 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: states { 2024-03-26T16:58:20.151 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:19 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: grp_id: 12 2024-03-26T16:58:20.151 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:19 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: state: INACCESSIBLE 2024-03-26T16:58:20.151 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:19 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: } 2024-03-26T16:58:20.151 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:19 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: states { 2024-03-26T16:58:20.151 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:19 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: grp_id: 13 2024-03-26T16:58:20.152 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:19 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: state: INACCESSIBLE 2024-03-26T16:58:20.152 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:19 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: } 2024-03-26T16:58:20.152 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:19 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: states { 2024-03-26T16:58:20.152 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:19 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: grp_id: 14 2024-03-26T16:58:20.152 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:19 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: state: INACCESSIBLE 2024-03-26T16:58:20.152 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:19 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: } 2024-03-26T16:58:20.152 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:19 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: states { 2024-03-26T16:58:20.152 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:19 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: grp_id: 15 2024-03-26T16:58:20.152 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:19 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: state: INACCESSIBLE 2024-03-26T16:58:20.152 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:19 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: } 2024-03-26T16:58:20.152 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:19 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: states { 2024-03-26T16:58:20.152 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:19 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: grp_id: 16 2024-03-26T16:58:20.152 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:19 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: state: INACCESSIBLE 2024-03-26T16:58:20.153 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:19 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: } 2024-03-26T16:58:20.153 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:19 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: , nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:20.153 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:19 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: states { 2024-03-26T16:58:20.153 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:19 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: grp_id: 1 2024-03-26T16:58:20.153 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:19 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: state: OPTIMIZED 2024-03-26T16:58:20.153 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:19 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: } 2024-03-26T16:58:20.153 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:19 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: states { 2024-03-26T16:58:20.153 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:19 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: grp_id: 2 2024-03-26T16:58:20.153 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:19 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: state: INACCESSIBLE 2024-03-26T16:58:20.153 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:19 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: } 2024-03-26T16:58:20.153 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:19 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: states { 2024-03-26T16:58:20.153 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:19 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: grp_id: 3 2024-03-26T16:58:20.153 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:19 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: state: INACCESSIBLE 2024-03-26T16:58:20.154 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:19 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: } 2024-03-26T16:58:20.154 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:19 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: states { 2024-03-26T16:58:20.154 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:19 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: grp_id: 4 2024-03-26T16:58:20.154 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:19 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: state: INACCESSIBLE 2024-03-26T16:58:20.154 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:19 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: } 2024-03-26T16:58:20.154 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:19 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: states { 2024-03-26T16:58:20.154 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:19 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: grp_id: 5 2024-03-26T16:58:20.154 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:19 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: state: INACCESSIBLE 2024-03-26T16:58:20.154 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:19 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: } 2024-03-26T16:58:20.154 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:19 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: states { 2024-03-26T16:58:20.154 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:19 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: grp_id: 6 2024-03-26T16:58:20.154 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:19 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: state: INACCESSIBLE 2024-03-26T16:58:20.154 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:19 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: } 2024-03-26T16:58:20.154 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:19 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: states { 2024-03-26T16:58:20.155 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:19 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: grp_id: 7 2024-03-26T16:58:20.155 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:19 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: state: INACCESSIBLE 2024-03-26T16:58:20.155 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:19 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: } 2024-03-26T16:58:20.155 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:19 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: states { 2024-03-26T16:58:20.155 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:19 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: grp_id: 8 2024-03-26T16:58:20.155 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:19 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: state: INACCESSIBLE 2024-03-26T16:58:20.155 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:19 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: } 2024-03-26T16:58:20.155 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:19 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: states { 2024-03-26T16:58:20.155 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:19 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: grp_id: 9 2024-03-26T16:58:20.155 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:19 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: state: INACCESSIBLE 2024-03-26T16:58:20.155 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:19 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: } 2024-03-26T16:58:20.155 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:19 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: states { 2024-03-26T16:58:20.155 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:19 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: grp_id: 10 2024-03-26T16:58:20.155 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:19 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: state: INACCESSIBLE 2024-03-26T16:58:20.156 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:19 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: } 2024-03-26T16:58:20.156 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:19 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: states { 2024-03-26T16:58:20.156 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:19 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: grp_id: 11 2024-03-26T16:58:20.156 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:19 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: state: INACCESSIBLE 2024-03-26T16:58:20.156 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:19 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: } 2024-03-26T16:58:20.156 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:19 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: states { 2024-03-26T16:58:20.156 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:19 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: grp_id: 12 2024-03-26T16:58:20.156 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:19 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: state: INACCESSIBLE 2024-03-26T16:58:20.156 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:19 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: } 2024-03-26T16:58:20.156 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:19 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: states { 2024-03-26T16:58:20.157 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:19 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: grp_id: 13 2024-03-26T16:58:20.157 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:19 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: state: INACCESSIBLE 2024-03-26T16:58:20.157 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:19 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: } 2024-03-26T16:58:20.157 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:19 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: states { 2024-03-26T16:58:20.157 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:19 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: grp_id: 14 2024-03-26T16:58:20.157 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:19 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: state: INACCESSIBLE 2024-03-26T16:58:20.157 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:19 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: } 2024-03-26T16:58:20.157 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:19 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: states { 2024-03-26T16:58:20.157 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:19 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: grp_id: 15 2024-03-26T16:58:20.157 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:19 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: state: INACCESSIBLE 2024-03-26T16:58:20.157 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:19 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: } 2024-03-26T16:58:20.157 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:19 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: states { 2024-03-26T16:58:20.157 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:19 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: grp_id: 16 2024-03-26T16:58:20.157 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:19 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: state: INACCESSIBLE 2024-03-26T16:58:20.158 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:19 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: } 2024-03-26T16:58:20.158 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:19 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: ] 2024-03-26T16:58:20.158 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:19 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:19] INFO grpc.py:1958: Subsystem nqn.2016-06.io.spdk:cnode1 enable_ha: True 2024-03-26T16:58:20.158 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:19 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:19] INFO grpc.py:782: Iterate over nqn='nqn.2016-06.io.spdk:cnode1' prefix='listener_nqn.2016-06.io.spdk:cnode1_smithi149_' listener_keys=[] 2024-03-26T16:58:20.158 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:19 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:19] INFO grpc.py:1958: Subsystem nqn.2016-06.io.spdk:cnode2 enable_ha: True 2024-03-26T16:58:20.158 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:19 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:19] INFO grpc.py:782: Iterate over nqn='nqn.2016-06.io.spdk:cnode2' prefix='listener_nqn.2016-06.io.spdk:cnode2_smithi149_' listener_keys=[] 2024-03-26T16:58:20.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:58:20 smithi044 ceph-mon[30624]: pgmap v350: 33 pgs: 33 active+clean; 609 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 4.7 KiB/s rd, 341 B/s wr, 5 op/s 2024-03-26T16:58:20.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:58:20 smithi064 ceph-mon[34420]: pgmap v350: 33 pgs: 33 active+clean; 609 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 4.7 KiB/s rd, 341 B/s wr, 5 op/s 2024-03-26T16:58:20.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:58:20 smithi149 ceph-mon[34678]: pgmap v350: 33 pgs: 33 active+clean; 609 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 4.7 KiB/s rd, 341 B/s wr, 5 op/s 2024-03-26T16:58:20.749 INFO:tasks.workunit.client.3.smithi157.stdout:{ 2024-03-26T16:58:20.749 INFO:tasks.workunit.client.3.smithi157.stdout: "error_message": "Success", 2024-03-26T16:58:20.749 INFO:tasks.workunit.client.3.smithi157.stdout: "subsystems": [ 2024-03-26T16:58:20.749 INFO:tasks.workunit.client.3.smithi157.stdout: { 2024-03-26T16:58:20.749 INFO:tasks.workunit.client.3.smithi157.stdout: "nqn": "nqn.2016-06.io.spdk:cnode1", 2024-03-26T16:58:20.750 INFO:tasks.workunit.client.3.smithi157.stdout: "enable_ha": true, 2024-03-26T16:58:20.750 INFO:tasks.workunit.client.3.smithi157.stdout: "serial_number": "Ceph14383361503536", 2024-03-26T16:58:20.750 INFO:tasks.workunit.client.3.smithi157.stdout: "model_number": "Ceph bdev Controller", 2024-03-26T16:58:20.750 INFO:tasks.workunit.client.3.smithi157.stdout: "min_cntlid": 4081, 2024-03-26T16:58:20.750 INFO:tasks.workunit.client.3.smithi157.stdout: "max_cntlid": 6120, 2024-03-26T16:58:20.750 INFO:tasks.workunit.client.3.smithi157.stdout: "subtype": "NVMe", 2024-03-26T16:58:20.750 INFO:tasks.workunit.client.3.smithi157.stdout: "max_namespaces": 256, 2024-03-26T16:58:20.750 INFO:tasks.workunit.client.3.smithi157.stdout: "namespace_count": 0 2024-03-26T16:58:20.750 INFO:tasks.workunit.client.3.smithi157.stdout: }, 2024-03-26T16:58:20.750 INFO:tasks.workunit.client.3.smithi157.stdout: { 2024-03-26T16:58:20.750 INFO:tasks.workunit.client.3.smithi157.stdout: "nqn": "nqn.2016-06.io.spdk:cnode2", 2024-03-26T16:58:20.750 INFO:tasks.workunit.client.3.smithi157.stdout: "enable_ha": true, 2024-03-26T16:58:20.750 INFO:tasks.workunit.client.3.smithi157.stdout: "serial_number": "Ceph44698087180525", 2024-03-26T16:58:20.750 INFO:tasks.workunit.client.3.smithi157.stdout: "model_number": "Ceph bdev Controller", 2024-03-26T16:58:20.751 INFO:tasks.workunit.client.3.smithi157.stdout: "min_cntlid": 4081, 2024-03-26T16:58:20.751 INFO:tasks.workunit.client.3.smithi157.stdout: "max_cntlid": 6120, 2024-03-26T16:58:20.751 INFO:tasks.workunit.client.3.smithi157.stdout: "subtype": "NVMe", 2024-03-26T16:58:20.751 INFO:tasks.workunit.client.3.smithi157.stdout: "max_namespaces": 256, 2024-03-26T16:58:20.751 INFO:tasks.workunit.client.3.smithi157.stdout: "namespace_count": 0 2024-03-26T16:58:20.751 INFO:tasks.workunit.client.3.smithi157.stdout: }, 2024-03-26T16:58:20.751 INFO:tasks.workunit.client.3.smithi157.stdout: { 2024-03-26T16:58:20.751 INFO:tasks.workunit.client.3.smithi157.stdout: "nqn": "nqn.2016-06.io.spdk:cnode3", 2024-03-26T16:58:20.751 INFO:tasks.workunit.client.3.smithi157.stdout: "enable_ha": true, 2024-03-26T16:58:20.751 INFO:tasks.workunit.client.3.smithi157.stdout: "serial_number": "Ceph20558982565741", 2024-03-26T16:58:20.751 INFO:tasks.workunit.client.3.smithi157.stdout: "model_number": "Ceph bdev Controller", 2024-03-26T16:58:20.751 INFO:tasks.workunit.client.3.smithi157.stdout: "min_cntlid": 4081, 2024-03-26T16:58:20.751 INFO:tasks.workunit.client.3.smithi157.stdout: "max_cntlid": 6120, 2024-03-26T16:58:20.751 INFO:tasks.workunit.client.3.smithi157.stdout: "subtype": "NVMe", 2024-03-26T16:58:20.751 INFO:tasks.workunit.client.3.smithi157.stdout: "max_namespaces": 256, 2024-03-26T16:58:20.752 INFO:tasks.workunit.client.3.smithi157.stdout: "namespace_count": 0 2024-03-26T16:58:20.752 INFO:tasks.workunit.client.3.smithi157.stdout: } 2024-03-26T16:58:20.752 INFO:tasks.workunit.client.3.smithi157.stdout: ], 2024-03-26T16:58:20.752 INFO:tasks.workunit.client.3.smithi157.stdout: "status": 0 2024-03-26T16:58:20.752 INFO:tasks.workunit.client.3.smithi157.stdout:} 2024-03-26T16:58:21.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:20 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:20] INFO grpc.py:2243: Received request to list the subsystem, context: 2024-03-26T16:58:21.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:20 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:20] INFO grpc.py:2251: list_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}] 2024-03-26T16:58:21.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:20 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:20] INFO grpc.py:1958: Subsystem nqn.2016-06.io.spdk:cnode1 enable_ha: True 2024-03-26T16:58:21.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:20 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:20] INFO grpc.py:1958: Subsystem nqn.2016-06.io.spdk:cnode2 enable_ha: True 2024-03-26T16:58:21.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:20 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:20] INFO grpc.py:1958: Subsystem nqn.2016-06.io.spdk:cnode3 enable_ha: True 2024-03-26T16:58:21.055 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:20 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:20] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:58:21.055 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:20 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:20] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}] 2024-03-26T16:58:21.608 INFO:tasks.workunit.client.3.smithi157.stderr:+ for i in "${!gateway_ips[@]}" 2024-03-26T16:58:21.608 INFO:tasks.workunit.client.3.smithi157.stderr:+ ip=172.21.15.64 2024-03-26T16:58:21.608 INFO:tasks.workunit.client.3.smithi157.stderr:+ sudo podman run -it quay.io/barakda1/nvmeof-cli:qe_ceph_devel_21e59b2 --server-address 172.21.15.64 --server-port 5500 --format json subsystem list 2024-03-26T16:58:21.690 INFO:tasks.workunit.client.3.smithi157.stderr:time="2024-03-26T16:58:21Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2024-03-26T16:58:22.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:21 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:21] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:58:22.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:21 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:21] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}] 2024-03-26T16:58:22.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:21 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:21] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:58:22.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:21 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:21] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}] 2024-03-26T16:58:22.379 INFO:tasks.workunit.client.3.smithi157.stdout:{ 2024-03-26T16:58:22.380 INFO:tasks.workunit.client.3.smithi157.stdout: "error_message": "Success", 2024-03-26T16:58:22.380 INFO:tasks.workunit.client.3.smithi157.stdout: "subsystems": [ 2024-03-26T16:58:22.380 INFO:tasks.workunit.client.3.smithi157.stdout: { 2024-03-26T16:58:22.380 INFO:tasks.workunit.client.3.smithi157.stdout: "nqn": "nqn.2016-06.io.spdk:cnode1", 2024-03-26T16:58:22.380 INFO:tasks.workunit.client.3.smithi157.stdout: "enable_ha": true, 2024-03-26T16:58:22.380 INFO:tasks.workunit.client.3.smithi157.stdout: "serial_number": "Ceph14383361503536", 2024-03-26T16:58:22.380 INFO:tasks.workunit.client.3.smithi157.stdout: "model_number": "Ceph bdev Controller", 2024-03-26T16:58:22.380 INFO:tasks.workunit.client.3.smithi157.stdout: "min_cntlid": 2041, 2024-03-26T16:58:22.380 INFO:tasks.workunit.client.3.smithi157.stdout: "max_cntlid": 4080, 2024-03-26T16:58:22.380 INFO:tasks.workunit.client.3.smithi157.stdout: "subtype": "NVMe", 2024-03-26T16:58:22.380 INFO:tasks.workunit.client.3.smithi157.stdout: "max_namespaces": 256, 2024-03-26T16:58:22.380 INFO:tasks.workunit.client.3.smithi157.stdout: "namespace_count": 0 2024-03-26T16:58:22.381 INFO:tasks.workunit.client.3.smithi157.stdout: }, 2024-03-26T16:58:22.381 INFO:tasks.workunit.client.3.smithi157.stdout: { 2024-03-26T16:58:22.381 INFO:tasks.workunit.client.3.smithi157.stdout: "nqn": "nqn.2016-06.io.spdk:cnode2", 2024-03-26T16:58:22.381 INFO:tasks.workunit.client.3.smithi157.stdout: "enable_ha": true, 2024-03-26T16:58:22.381 INFO:tasks.workunit.client.3.smithi157.stdout: "serial_number": "Ceph44698087180525", 2024-03-26T16:58:22.381 INFO:tasks.workunit.client.3.smithi157.stdout: "model_number": "Ceph bdev Controller", 2024-03-26T16:58:22.381 INFO:tasks.workunit.client.3.smithi157.stdout: "min_cntlid": 2041, 2024-03-26T16:58:22.381 INFO:tasks.workunit.client.3.smithi157.stdout: "max_cntlid": 4080, 2024-03-26T16:58:22.381 INFO:tasks.workunit.client.3.smithi157.stdout: "subtype": "NVMe", 2024-03-26T16:58:22.381 INFO:tasks.workunit.client.3.smithi157.stdout: "max_namespaces": 256, 2024-03-26T16:58:22.381 INFO:tasks.workunit.client.3.smithi157.stdout: "namespace_count": 0 2024-03-26T16:58:22.381 INFO:tasks.workunit.client.3.smithi157.stdout: }, 2024-03-26T16:58:22.382 INFO:tasks.workunit.client.3.smithi157.stdout: { 2024-03-26T16:58:22.382 INFO:tasks.workunit.client.3.smithi157.stdout: "nqn": "nqn.2016-06.io.spdk:cnode3", 2024-03-26T16:58:22.382 INFO:tasks.workunit.client.3.smithi157.stdout: "enable_ha": true, 2024-03-26T16:58:22.382 INFO:tasks.workunit.client.3.smithi157.stdout: "serial_number": "Ceph20558982565741", 2024-03-26T16:58:22.382 INFO:tasks.workunit.client.3.smithi157.stdout: "model_number": "Ceph bdev Controller", 2024-03-26T16:58:22.382 INFO:tasks.workunit.client.3.smithi157.stdout: "min_cntlid": 2041, 2024-03-26T16:58:22.382 INFO:tasks.workunit.client.3.smithi157.stdout: "max_cntlid": 4080, 2024-03-26T16:58:22.382 INFO:tasks.workunit.client.3.smithi157.stdout: "subtype": "NVMe", 2024-03-26T16:58:22.382 INFO:tasks.workunit.client.3.smithi157.stdout: "max_namespaces": 256, 2024-03-26T16:58:22.382 INFO:tasks.workunit.client.3.smithi157.stdout: "namespace_count": 0 2024-03-26T16:58:22.383 INFO:tasks.workunit.client.3.smithi157.stdout: } 2024-03-26T16:58:22.383 INFO:tasks.workunit.client.3.smithi157.stdout: ], 2024-03-26T16:58:22.383 INFO:tasks.workunit.client.3.smithi157.stdout: "status": 0 2024-03-26T16:58:22.383 INFO:tasks.workunit.client.3.smithi157.stdout:} 2024-03-26T16:58:22.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:58:22 smithi044 ceph-mon[30624]: pgmap v351: 33 pgs: 33 active+clean; 609 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 3.7 KiB/s rd, 341 B/s wr, 4 op/s 2024-03-26T16:58:22.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:58:22 smithi064 ceph-mon[34420]: pgmap v351: 33 pgs: 33 active+clean; 609 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 3.7 KiB/s rd, 341 B/s wr, 4 op/s 2024-03-26T16:58:22.556 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:22 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:22] INFO grpc.py:2243: Received request to list the subsystem, context: 2024-03-26T16:58:22.556 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:22 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:22] INFO grpc.py:2251: list_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}] 2024-03-26T16:58:22.556 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:22 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:22] INFO grpc.py:1958: Subsystem nqn.2016-06.io.spdk:cnode1 enable_ha: True 2024-03-26T16:58:22.556 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:22 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:22] INFO grpc.py:1958: Subsystem nqn.2016-06.io.spdk:cnode2 enable_ha: True 2024-03-26T16:58:22.556 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:22 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:22] INFO grpc.py:1958: Subsystem nqn.2016-06.io.spdk:cnode3 enable_ha: True 2024-03-26T16:58:22.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:58:22 smithi149 ceph-mon[34678]: pgmap v351: 33 pgs: 33 active+clean; 609 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 3.7 KiB/s rd, 341 B/s wr, 4 op/s 2024-03-26T16:58:23.055 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:22 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:22] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:58:23.055 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:22 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:22] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}] 2024-03-26T16:58:23.233 INFO:tasks.workunit.client.3.smithi157.stderr:+ for i in "${!gateway_ips[@]}" 2024-03-26T16:58:23.233 INFO:tasks.workunit.client.3.smithi157.stderr:+ ip=172.21.15.149 2024-03-26T16:58:23.233 INFO:tasks.workunit.client.3.smithi157.stderr:+ sudo podman run -it quay.io/barakda1/nvmeof-cli:qe_ceph_devel_21e59b2 --server-address 172.21.15.149 --server-port 5500 --format json subsystem list 2024-03-26T16:58:23.318 INFO:tasks.workunit.client.3.smithi157.stderr:time="2024-03-26T16:58:23Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2024-03-26T16:58:24.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:23 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:23] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:58:24.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:23 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:23] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}] 2024-03-26T16:58:24.057 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:23 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:23] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:58:24.057 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:23 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:23] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}] 2024-03-26T16:58:24.057 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:24 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:24] INFO grpc.py:2243: Received request to list the subsystem, context: 2024-03-26T16:58:24.064 INFO:tasks.workunit.client.3.smithi157.stdout:{ 2024-03-26T16:58:24.064 INFO:tasks.workunit.client.3.smithi157.stdout: "error_message": "Success", 2024-03-26T16:58:24.064 INFO:tasks.workunit.client.3.smithi157.stdout: "subsystems": [ 2024-03-26T16:58:24.064 INFO:tasks.workunit.client.3.smithi157.stdout: { 2024-03-26T16:58:24.064 INFO:tasks.workunit.client.3.smithi157.stdout: "nqn": "nqn.2016-06.io.spdk:cnode1", 2024-03-26T16:58:24.064 INFO:tasks.workunit.client.3.smithi157.stdout: "enable_ha": true, 2024-03-26T16:58:24.064 INFO:tasks.workunit.client.3.smithi157.stdout: "serial_number": "Ceph14383361503536", 2024-03-26T16:58:24.064 INFO:tasks.workunit.client.3.smithi157.stdout: "model_number": "Ceph bdev Controller", 2024-03-26T16:58:24.064 INFO:tasks.workunit.client.3.smithi157.stdout: "min_cntlid": 1, 2024-03-26T16:58:24.064 INFO:tasks.workunit.client.3.smithi157.stdout: "max_cntlid": 2040, 2024-03-26T16:58:24.065 INFO:tasks.workunit.client.3.smithi157.stdout: "subtype": "NVMe", 2024-03-26T16:58:24.065 INFO:tasks.workunit.client.3.smithi157.stdout: "max_namespaces": 256, 2024-03-26T16:58:24.065 INFO:tasks.workunit.client.3.smithi157.stdout: "namespace_count": 0 2024-03-26T16:58:24.065 INFO:tasks.workunit.client.3.smithi157.stdout: }, 2024-03-26T16:58:24.065 INFO:tasks.workunit.client.3.smithi157.stdout: { 2024-03-26T16:58:24.065 INFO:tasks.workunit.client.3.smithi157.stdout: "nqn": "nqn.2016-06.io.spdk:cnode2", 2024-03-26T16:58:24.065 INFO:tasks.workunit.client.3.smithi157.stdout: "enable_ha": true, 2024-03-26T16:58:24.065 INFO:tasks.workunit.client.3.smithi157.stdout: "serial_number": "Ceph44698087180525", 2024-03-26T16:58:24.065 INFO:tasks.workunit.client.3.smithi157.stdout: "model_number": "Ceph bdev Controller", 2024-03-26T16:58:24.065 INFO:tasks.workunit.client.3.smithi157.stdout: "min_cntlid": 1, 2024-03-26T16:58:24.065 INFO:tasks.workunit.client.3.smithi157.stdout: "max_cntlid": 2040, 2024-03-26T16:58:24.065 INFO:tasks.workunit.client.3.smithi157.stdout: "subtype": "NVMe", 2024-03-26T16:58:24.065 INFO:tasks.workunit.client.3.smithi157.stdout: "max_namespaces": 256, 2024-03-26T16:58:24.065 INFO:tasks.workunit.client.3.smithi157.stdout: "namespace_count": 0 2024-03-26T16:58:24.065 INFO:tasks.workunit.client.3.smithi157.stdout: }, 2024-03-26T16:58:24.065 INFO:tasks.workunit.client.3.smithi157.stdout: { 2024-03-26T16:58:24.066 INFO:tasks.workunit.client.3.smithi157.stdout: "nqn": "nqn.2016-06.io.spdk:cnode3", 2024-03-26T16:58:24.066 INFO:tasks.workunit.client.3.smithi157.stdout: "enable_ha": true, 2024-03-26T16:58:24.066 INFO:tasks.workunit.client.3.smithi157.stdout: "serial_number": "Ceph20558982565741", 2024-03-26T16:58:24.066 INFO:tasks.workunit.client.3.smithi157.stdout: "model_number": "Ceph bdev Controller", 2024-03-26T16:58:24.066 INFO:tasks.workunit.client.3.smithi157.stdout: "min_cntlid": 1, 2024-03-26T16:58:24.066 INFO:tasks.workunit.client.3.smithi157.stdout: "max_cntlid": 2040, 2024-03-26T16:58:24.066 INFO:tasks.workunit.client.3.smithi157.stdout: "subtype": "NVMe", 2024-03-26T16:58:24.066 INFO:tasks.workunit.client.3.smithi157.stdout: "max_namespaces": 256, 2024-03-26T16:58:24.066 INFO:tasks.workunit.client.3.smithi157.stdout: "namespace_count": 0 2024-03-26T16:58:24.066 INFO:tasks.workunit.client.3.smithi157.stdout: } 2024-03-26T16:58:24.066 INFO:tasks.workunit.client.3.smithi157.stdout: ], 2024-03-26T16:58:24.066 INFO:tasks.workunit.client.3.smithi157.stdout: "status": 0 2024-03-26T16:58:24.066 INFO:tasks.workunit.client.3.smithi157.stdout:} 2024-03-26T16:58:24.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:58:24 smithi149 ceph-mon[34678]: pgmap v352: 33 pgs: 33 active+clean; 609 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 5.0 KiB/s rd, 511 B/s wr, 6 op/s 2024-03-26T16:58:24.396 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:24 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:24] INFO grpc.py:2251: list_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}] 2024-03-26T16:58:24.396 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:24 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:24] INFO grpc.py:1958: Subsystem nqn.2016-06.io.spdk:cnode1 enable_ha: True 2024-03-26T16:58:24.396 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:24 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:24] INFO grpc.py:1958: Subsystem nqn.2016-06.io.spdk:cnode2 enable_ha: True 2024-03-26T16:58:24.396 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:24 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:24] INFO grpc.py:1958: Subsystem nqn.2016-06.io.spdk:cnode3 enable_ha: True 2024-03-26T16:58:24.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:58:24 smithi044 ceph-mon[30624]: pgmap v352: 33 pgs: 33 active+clean; 609 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 5.0 KiB/s rd, 511 B/s wr, 6 op/s 2024-03-26T16:58:24.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:58:24 smithi064 ceph-mon[34420]: pgmap v352: 33 pgs: 33 active+clean; 609 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 5.0 KiB/s rd, 511 B/s wr, 6 op/s 2024-03-26T16:58:24.929 INFO:tasks.workunit.client.3.smithi157.stderr:+ for i in "${!gateway_ips[@]}" 2024-03-26T16:58:24.929 INFO:tasks.workunit.client.3.smithi157.stderr:+ ip=172.21.15.44 2024-03-26T16:58:24.929 INFO:tasks.workunit.client.3.smithi157.stderr:+ name=smithi044 2024-03-26T16:58:24.929 INFO:tasks.workunit.client.3.smithi157.stderr:++ seq 1 3 2024-03-26T16:58:24.930 INFO:tasks.workunit.client.3.smithi157.stderr:+ for j in $(seq 1 $NVMEOF_SUBSYSTEMS_COUNT) 2024-03-26T16:58:24.930 INFO:tasks.workunit.client.3.smithi157.stderr:+ subsystem_nqn=nqn.2016-06.io.spdk:cnode1 2024-03-26T16:58:24.930 INFO:tasks.workunit.client.3.smithi157.stderr:+ echo 'Adding gateway listener with IP 172.21.15.44 and name smithi044' 2024-03-26T16:58:24.930 INFO:tasks.workunit.client.3.smithi157.stdout:Adding gateway listener with IP 172.21.15.44 and name smithi044 2024-03-26T16:58:24.930 INFO:tasks.workunit.client.3.smithi157.stderr:+ sudo podman run -it quay.io/barakda1/nvmeof-cli:qe_ceph_devel_21e59b2 --server-address 172.21.15.44 --server-port 5500 listener add --subsystem nqn.2016-06.io.spdk:cnode1 --host-name smithi044 --traddr 172.21.15.44 --trsvcid 4420 2024-03-26T16:58:25.021 INFO:tasks.workunit.client.3.smithi157.stderr:time="2024-03-26T16:58:25Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2024-03-26T16:58:25.055 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:24 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:24] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:58:25.055 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:24 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:24] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}] 2024-03-26T16:58:25.928 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:25] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:58:25.929 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:25] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}] 2024-03-26T16:58:25.929 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:25] INFO grpc.py:1992: Received request to create smithi044 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode1 at 172.21.15.44:4420, context: 2024-03-26T16:58:25.929 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [2024-03-26 16:58:25.748291] tcp.c: 850:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 172.21.15.44 port 4420 *** 2024-03-26T16:58:25.929 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:25] INFO grpc.py:2023: create_listener: True 2024-03-26T16:58:25.929 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:25] INFO grpc.py:1958: Subsystem nqn.2016-06.io.spdk:cnode1 enable_ha: True 2024-03-26T16:58:25.929 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:25] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 1 2024-03-26T16:58:25.929 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:25] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:25.929 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:25.929 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:25.929 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:25.929 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:25.930 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=1 2024-03-26T16:58:25.930 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:25] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:25.930 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:25] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 2 2024-03-26T16:58:25.930 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:25] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:25.930 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:25.930 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:25.931 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:25.931 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:25.931 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=2 2024-03-26T16:58:25.931 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:25] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:25.931 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:25] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : optimized for group : 3 2024-03-26T16:58:25.931 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:25] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:25.931 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:25.931 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:25.931 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:25.931 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:25.931 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='optimized' anagrpid=3 2024-03-26T16:58:25.931 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:25] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:25.931 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:25] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 4 2024-03-26T16:58:25.932 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:25] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:25.932 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:25.932 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:25.932 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:25.932 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:25.932 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=4 2024-03-26T16:58:25.932 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:25] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:25.932 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:25] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 5 2024-03-26T16:58:25.932 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:25] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:25.932 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:25.932 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:25.932 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:25.932 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:25.932 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=5 2024-03-26T16:58:25.933 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:25] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:25.933 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:25] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 6 2024-03-26T16:58:25.933 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:25] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:25.933 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:25.933 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:25.933 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:25.933 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:25.933 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=6 2024-03-26T16:58:25.933 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:25] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:25.933 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:25] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 7 2024-03-26T16:58:25.933 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:25] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:25.933 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:25.933 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:25.933 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:25.933 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:25.934 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=7 2024-03-26T16:58:25.934 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:25] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:25.934 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:25] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 8 2024-03-26T16:58:25.934 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:25] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:25.934 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:25.934 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:25.934 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:25.934 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:25.934 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=8 2024-03-26T16:58:25.934 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:25] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:25.934 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:25] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 9 2024-03-26T16:58:25.935 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:25] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:25.935 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:25.935 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:25.935 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:25.936 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:25.936 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=9 2024-03-26T16:58:25.936 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:25] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:25.936 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:25] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 10 2024-03-26T16:58:25.936 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:25] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:25.936 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:25.936 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:25.936 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:25.936 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:25.936 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=10 2024-03-26T16:58:25.936 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:25] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:25.936 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:25] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 11 2024-03-26T16:58:25.936 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:25] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:25.936 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:25.937 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:25.937 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:25.937 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:25.937 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=11 2024-03-26T16:58:25.937 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:25] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:25.937 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:25] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 12 2024-03-26T16:58:25.937 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:25] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:25.937 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:25.937 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:25.937 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:25.937 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:25.937 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=12 2024-03-26T16:58:25.937 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:25] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:25.937 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:25] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 13 2024-03-26T16:58:25.938 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:25] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:25.938 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:25.938 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:25.938 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:25.938 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:25.938 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=13 2024-03-26T16:58:25.938 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:25] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:25.938 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:25] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 14 2024-03-26T16:58:25.938 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:25] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:25.938 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:25.938 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:25.938 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:25.938 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:25.939 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=14 2024-03-26T16:58:25.939 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:25] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:25.939 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:25] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 15 2024-03-26T16:58:25.939 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:25] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:25.939 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:25.939 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:25.939 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:25.939 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:25.939 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=15 2024-03-26T16:58:25.939 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:25] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:25.939 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:25] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 16 2024-03-26T16:58:25.939 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:25] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:25.939 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:25.940 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:25.940 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:25.940 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:25.940 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=16 2024-03-26T16:58:25.940 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:25] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:25.940 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:25] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 17 2024-03-26T16:58:25.940 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:25] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:25.940 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:25.940 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:25.940 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:25.940 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:25.940 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=17 2024-03-26T16:58:25.940 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:25] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:25.941 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:25] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 18 2024-03-26T16:58:25.941 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:25] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:25.941 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:25.941 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:25.941 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:25.941 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:25.941 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=18 2024-03-26T16:58:25.941 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:25] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:25.941 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:25] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 19 2024-03-26T16:58:25.941 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:25] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:25.941 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:25.941 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:25.941 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:25.941 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:25.942 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=19 2024-03-26T16:58:25.942 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:25] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:25.942 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:25] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 20 2024-03-26T16:58:25.942 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:25] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:25.942 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:25.942 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:25.942 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:25.942 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:25.942 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=20 2024-03-26T16:58:25.942 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:25] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:25.942 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:25] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 21 2024-03-26T16:58:25.942 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:25] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:25.942 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:25.942 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:25.942 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:25.943 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:25.943 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=21 2024-03-26T16:58:25.943 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:25] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:25.943 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:25] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 22 2024-03-26T16:58:25.943 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:25] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:25.943 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:25.943 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:25.943 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:25.943 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:25.943 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=22 2024-03-26T16:58:25.943 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:25] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:25.943 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:25] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 23 2024-03-26T16:58:25.943 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:25] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:25.944 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:25.944 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:25.944 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:25.944 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:25.944 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=23 2024-03-26T16:58:26.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:25 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:25] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:58:26.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:25 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:25] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}] 2024-03-26T16:58:26.185 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:25] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:26.185 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:25] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 24 2024-03-26T16:58:26.185 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:25] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:26.185 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:26.185 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:26.186 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:26.186 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:26.186 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=24 2024-03-26T16:58:26.186 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:25] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:26.186 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:25] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 25 2024-03-26T16:58:26.186 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:25] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:26.186 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:26.186 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:26.186 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:26.186 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:26.186 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=25 2024-03-26T16:58:26.186 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:25] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:26.187 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:25] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 26 2024-03-26T16:58:26.187 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:25] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:26.187 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:26.187 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:26.187 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:26.187 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:26.187 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=26 2024-03-26T16:58:26.187 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:25] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:26.188 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:25] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 27 2024-03-26T16:58:26.188 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:25] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:26.188 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:26.188 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:26.188 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:26.188 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:26.188 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=27 2024-03-26T16:58:26.188 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:25] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:26.188 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:25] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 28 2024-03-26T16:58:26.188 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:25] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:26.188 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:26.188 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:26.189 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:26.189 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:26.189 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=28 2024-03-26T16:58:26.189 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:25] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:26.189 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:25] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 29 2024-03-26T16:58:26.189 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:25] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:26.189 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:26.189 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:26.189 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:26.189 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:26.189 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=29 2024-03-26T16:58:26.189 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:25] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:26.189 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:25] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 30 2024-03-26T16:58:26.189 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:25] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:26.189 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:26.190 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:26.190 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:26.190 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:26.190 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=30 2024-03-26T16:58:26.190 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:25] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:26.190 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:25] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 31 2024-03-26T16:58:26.190 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:25] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:26.190 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:26.190 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:26.190 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:26.190 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:26.190 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=31 2024-03-26T16:58:26.190 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:26.191 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 32 2024-03-26T16:58:26.191 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:26.191 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:26.191 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:26.191 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:26.191 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:26.191 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=32 2024-03-26T16:58:26.191 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:26.191 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 33 2024-03-26T16:58:26.191 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:26.191 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:26.191 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:26.191 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:26.192 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:26.192 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=33 2024-03-26T16:58:26.192 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:26.192 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 34 2024-03-26T16:58:26.193 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:26.193 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:26.193 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:26.193 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:26.193 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:26.193 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=34 2024-03-26T16:58:26.193 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:26.193 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 35 2024-03-26T16:58:26.193 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:26.193 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:26.193 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:26.193 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:26.193 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:26.193 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=35 2024-03-26T16:58:26.194 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:26.194 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 36 2024-03-26T16:58:26.194 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:26.194 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:26.194 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:26.194 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:26.194 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:26.194 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=36 2024-03-26T16:58:26.194 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:26.194 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 37 2024-03-26T16:58:26.194 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:26.194 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:26.194 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:26.195 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:26.195 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:26.195 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=37 2024-03-26T16:58:26.195 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:26.195 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 38 2024-03-26T16:58:26.195 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:26.195 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:26.195 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:26.195 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:26.195 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:26.195 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=38 2024-03-26T16:58:26.195 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:26.195 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 39 2024-03-26T16:58:26.195 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:26.196 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:26.196 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:26.196 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:26.196 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:26.196 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=39 2024-03-26T16:58:26.196 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:26.196 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 40 2024-03-26T16:58:26.196 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:26.196 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:26.196 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:26.196 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:26.196 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:26.196 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=40 2024-03-26T16:58:26.196 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:26.196 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 41 2024-03-26T16:58:26.197 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:26.197 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:26.197 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:26.197 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:26.197 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:26.197 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=41 2024-03-26T16:58:26.197 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:26.197 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 42 2024-03-26T16:58:26.197 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:26.197 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:26.197 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:26.197 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:26.197 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:26.197 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=42 2024-03-26T16:58:26.198 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:26.198 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 43 2024-03-26T16:58:26.198 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:26.198 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:26.198 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:26.198 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:26.198 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:26.198 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=43 2024-03-26T16:58:26.198 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:26.198 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 44 2024-03-26T16:58:26.198 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:26.198 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:26.198 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:26.199 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:26.199 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:26.199 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=44 2024-03-26T16:58:26.199 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:26.199 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 45 2024-03-26T16:58:26.199 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:26.199 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:26.199 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:26.199 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:26.199 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:26.199 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=45 2024-03-26T16:58:26.199 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:26.199 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 46 2024-03-26T16:58:26.199 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:26.200 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:26.200 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:26.200 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:26.200 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:26.200 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=46 2024-03-26T16:58:26.200 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:26.200 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 47 2024-03-26T16:58:26.200 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:26.200 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:26.200 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:26.200 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:26.200 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:26.200 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=47 2024-03-26T16:58:26.200 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:26.201 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 48 2024-03-26T16:58:26.201 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:26.201 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:26.201 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:26.201 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:26.201 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:26.201 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=48 2024-03-26T16:58:26.201 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:26.201 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 49 2024-03-26T16:58:26.201 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:26.201 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:26.201 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:26.201 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:26.201 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:26.201 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=49 2024-03-26T16:58:26.202 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:26.202 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 50 2024-03-26T16:58:26.202 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:26.202 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:26.202 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:26.203 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:26.203 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:26.203 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=50 2024-03-26T16:58:26.203 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:26.203 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 51 2024-03-26T16:58:26.203 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:26.203 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:26.203 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:26.203 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:26.203 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:26.203 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=51 2024-03-26T16:58:26.203 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:26.203 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 52 2024-03-26T16:58:26.204 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:26.204 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:26.204 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:26.204 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:26.204 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:26.204 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=52 2024-03-26T16:58:26.204 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:26.204 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 53 2024-03-26T16:58:26.204 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:26.204 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:26.204 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:26.204 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:26.204 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:26.204 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=53 2024-03-26T16:58:26.204 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:26.205 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 54 2024-03-26T16:58:26.205 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:26.205 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:26.205 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:26.205 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:26.205 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:26.205 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=54 2024-03-26T16:58:26.205 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:26.205 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 55 2024-03-26T16:58:26.205 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:26.205 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:26.205 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:26.205 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:26.205 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:26.206 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=55 2024-03-26T16:58:26.206 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:26.206 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 56 2024-03-26T16:58:26.206 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:26.206 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:26.206 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:26.206 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:26.206 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:26.206 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=56 2024-03-26T16:58:26.440 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-mon[30624]: pgmap v353: 33 pgs: 33 active+clean; 609 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 4.0 KiB/s rd, 511 B/s wr, 5 op/s 2024-03-26T16:58:26.441 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:26.441 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 57 2024-03-26T16:58:26.441 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:26.441 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:26.441 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:26.442 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:26.442 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:26.442 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=57 2024-03-26T16:58:26.442 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:26.442 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 58 2024-03-26T16:58:26.442 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:26.442 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:26.442 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:26.442 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:26.442 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:26.442 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=58 2024-03-26T16:58:26.442 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:26.442 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 59 2024-03-26T16:58:26.442 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:26.443 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:26.443 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:26.443 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:26.443 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:26.443 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=59 2024-03-26T16:58:26.443 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:26.443 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 60 2024-03-26T16:58:26.444 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:26.444 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:26.444 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:26.444 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:26.444 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:26.444 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=60 2024-03-26T16:58:26.444 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:26.444 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 61 2024-03-26T16:58:26.444 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:26.444 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:26.444 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:26.444 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:26.444 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:26.444 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=61 2024-03-26T16:58:26.445 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:26.445 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 62 2024-03-26T16:58:26.445 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:26.445 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:26.445 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:26.445 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:26.445 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:26.445 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=62 2024-03-26T16:58:26.445 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:26.445 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 63 2024-03-26T16:58:26.445 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:26.445 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:26.445 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:26.445 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:26.446 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:26.446 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=63 2024-03-26T16:58:26.446 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:26.446 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 64 2024-03-26T16:58:26.446 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:26.446 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:26.446 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:26.446 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:26.446 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:26.446 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=64 2024-03-26T16:58:26.446 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:26.446 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 65 2024-03-26T16:58:26.446 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:26.446 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:26.447 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:26.447 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:26.447 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:26.447 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=65 2024-03-26T16:58:26.447 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:26.447 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 66 2024-03-26T16:58:26.447 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:26.447 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:26.447 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:26.447 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:26.448 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:26.448 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=66 2024-03-26T16:58:26.448 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:26.448 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 67 2024-03-26T16:58:26.448 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:26.448 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:26.448 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:26.448 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:26.449 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:26.449 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=67 2024-03-26T16:58:26.449 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:26.449 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 68 2024-03-26T16:58:26.449 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:26.449 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:26.449 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:26.449 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:26.449 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:26.449 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=68 2024-03-26T16:58:26.449 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:26.449 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 69 2024-03-26T16:58:26.449 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:26.449 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:26.450 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:26.450 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:26.450 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:26.450 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=69 2024-03-26T16:58:26.450 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:26.450 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 70 2024-03-26T16:58:26.450 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:26.450 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:26.450 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:26.450 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:26.450 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:26.450 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=70 2024-03-26T16:58:26.450 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:26.450 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 71 2024-03-26T16:58:26.450 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:26.450 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:26.451 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:26.451 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:26.451 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:26.451 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=71 2024-03-26T16:58:26.451 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:26.451 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 72 2024-03-26T16:58:26.451 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:26.451 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:26.451 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:26.451 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:26.451 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:26.451 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=72 2024-03-26T16:58:26.451 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:26.451 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 73 2024-03-26T16:58:26.451 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:26.451 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:26.452 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:26.452 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:26.452 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:26.452 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=73 2024-03-26T16:58:26.452 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:26.452 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 74 2024-03-26T16:58:26.452 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:26.452 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:26.452 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:26.452 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:26.452 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:26.452 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=74 2024-03-26T16:58:26.452 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:26.452 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 75 2024-03-26T16:58:26.453 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:26.453 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:26.453 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:26.453 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:26.453 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:26.453 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=75 2024-03-26T16:58:26.453 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:26.453 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 76 2024-03-26T16:58:26.453 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:26.453 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:26.453 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:26.453 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:26.453 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:26.453 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=76 2024-03-26T16:58:26.453 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:26.454 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 77 2024-03-26T16:58:26.454 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:26.454 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:26.454 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:26.454 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:26.454 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:26.454 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=77 2024-03-26T16:58:26.454 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:26.454 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 78 2024-03-26T16:58:26.454 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:26.454 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:26.454 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:26.454 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:26.454 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:26.455 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=78 2024-03-26T16:58:26.455 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:26.455 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 79 2024-03-26T16:58:26.455 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:26.455 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:26.455 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:26.455 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:26.455 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:26.456 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=79 2024-03-26T16:58:26.456 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:26.456 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 80 2024-03-26T16:58:26.456 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:26.456 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:26.456 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:26.456 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:26.456 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:26.456 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=80 2024-03-26T16:58:26.456 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:26.456 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 81 2024-03-26T16:58:26.456 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:26.457 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:26.457 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:26.457 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:26.457 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:26.457 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=81 2024-03-26T16:58:26.457 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:26.457 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 82 2024-03-26T16:58:26.457 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:26.457 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:26.457 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:26.457 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:26.457 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:26.457 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=82 2024-03-26T16:58:26.457 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:26.457 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 83 2024-03-26T16:58:26.457 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:26.458 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:26.458 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:26.458 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:26.458 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:26.458 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=83 2024-03-26T16:58:26.458 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:26.458 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 84 2024-03-26T16:58:26.458 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:26.458 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:26.458 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:26.458 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:26.458 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:26.458 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=84 2024-03-26T16:58:26.458 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:26.459 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 85 2024-03-26T16:58:26.459 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:26.459 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:26.459 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:26.459 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:26.459 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:26.459 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=85 2024-03-26T16:58:26.459 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:26.459 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 86 2024-03-26T16:58:26.459 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:26.459 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:26.459 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:26.459 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:26.459 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:26.459 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=86 2024-03-26T16:58:26.460 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:26.460 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 87 2024-03-26T16:58:26.460 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:26.460 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:26.460 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:26.460 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:26.460 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:26.460 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=87 2024-03-26T16:58:26.460 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:26.460 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 88 2024-03-26T16:58:26.460 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:26.460 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:26.460 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:26.460 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:26.460 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:26.460 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=88 2024-03-26T16:58:26.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:58:26 smithi064 ceph-mon[34420]: pgmap v353: 33 pgs: 33 active+clean; 609 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 4.0 KiB/s rd, 511 B/s wr, 5 op/s 2024-03-26T16:58:26.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:58:26 smithi149 ceph-mon[34678]: pgmap v353: 33 pgs: 33 active+clean; 609 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 4.0 KiB/s rd, 511 B/s wr, 5 op/s 2024-03-26T16:58:26.696 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:26.697 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 89 2024-03-26T16:58:26.697 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:26.697 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:26.697 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:26.697 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:26.697 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:26.697 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=89 2024-03-26T16:58:26.697 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:26.697 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 90 2024-03-26T16:58:26.697 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:26.697 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:26.697 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:26.697 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:26.697 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:26.697 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=90 2024-03-26T16:58:26.698 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:26.698 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 91 2024-03-26T16:58:26.698 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:26.698 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:26.698 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:26.698 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:26.698 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:26.698 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=91 2024-03-26T16:58:26.698 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:26.699 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 92 2024-03-26T16:58:26.699 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:26.699 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:26.699 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:26.699 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:26.699 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:26.699 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=92 2024-03-26T16:58:26.699 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:26.699 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 93 2024-03-26T16:58:26.700 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:26.700 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:26.700 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:26.700 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:26.700 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:26.700 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=93 2024-03-26T16:58:26.700 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:26.700 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 94 2024-03-26T16:58:26.700 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:26.700 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:26.700 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:26.700 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:26.700 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:26.700 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=94 2024-03-26T16:58:26.700 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:26.701 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 95 2024-03-26T16:58:26.701 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:26.701 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:26.701 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:26.701 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:26.701 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:26.701 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=95 2024-03-26T16:58:26.701 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:26.701 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 96 2024-03-26T16:58:26.701 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:26.701 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:26.701 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:26.701 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:26.701 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:26.702 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=96 2024-03-26T16:58:26.702 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:26.702 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 97 2024-03-26T16:58:26.702 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:26.702 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:26.702 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:26.702 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:26.702 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:26.702 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=97 2024-03-26T16:58:26.702 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:26.702 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 98 2024-03-26T16:58:26.702 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:26.702 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:26.703 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:26.703 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:26.703 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:26.703 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=98 2024-03-26T16:58:26.703 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:26.703 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 99 2024-03-26T16:58:26.703 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:26.703 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:26.703 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:26.703 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:26.703 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:26.703 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=99 2024-03-26T16:58:26.703 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:26.704 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 100 2024-03-26T16:58:26.704 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:26.704 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:26.704 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:26.704 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:26.704 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:26.704 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=100 2024-03-26T16:58:26.704 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:26.704 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 101 2024-03-26T16:58:26.704 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:26.704 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:26.704 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:26.704 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:26.704 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:26.705 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=101 2024-03-26T16:58:26.705 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:26.705 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 102 2024-03-26T16:58:26.705 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:26.705 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:26.705 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:26.705 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:26.705 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:26.705 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=102 2024-03-26T16:58:26.705 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:26.705 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 103 2024-03-26T16:58:26.705 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:26.705 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:26.705 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:26.706 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:26.706 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:26.706 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=103 2024-03-26T16:58:26.706 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:26.706 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 104 2024-03-26T16:58:26.706 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:26.706 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:26.706 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:26.706 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:26.706 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:26.706 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=104 2024-03-26T16:58:26.707 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:26.707 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 105 2024-03-26T16:58:26.707 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:26.708 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:26.708 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:26.708 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:26.708 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:26.708 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=105 2024-03-26T16:58:26.708 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:26.708 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 106 2024-03-26T16:58:26.708 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:26.708 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:26.708 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:26.708 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:26.708 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:26.708 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=106 2024-03-26T16:58:26.709 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:26.709 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 107 2024-03-26T16:58:26.709 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:26.709 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:26.709 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:26.709 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:26.709 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:26.709 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=107 2024-03-26T16:58:26.709 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:26.709 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 108 2024-03-26T16:58:26.709 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:26.709 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:26.709 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:26.709 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:26.710 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:26.710 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=108 2024-03-26T16:58:26.710 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:26.710 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 109 2024-03-26T16:58:26.710 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:26.710 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:26.710 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:26.710 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:26.710 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:26.710 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=109 2024-03-26T16:58:26.710 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:26.710 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 110 2024-03-26T16:58:26.710 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:26.710 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:26.711 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:26.711 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:26.711 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:26.711 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=110 2024-03-26T16:58:26.711 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:26.711 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 111 2024-03-26T16:58:26.711 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:26.711 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:26.711 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:26.711 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:26.711 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:26.711 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=111 2024-03-26T16:58:26.711 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:26.711 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 112 2024-03-26T16:58:26.712 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:26.712 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:26.712 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:26.712 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:26.712 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:26.712 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=112 2024-03-26T16:58:26.712 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:26.712 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 113 2024-03-26T16:58:26.712 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:26.712 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:26.712 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:26.712 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:26.712 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:26.712 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=113 2024-03-26T16:58:26.713 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:26.713 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 114 2024-03-26T16:58:26.713 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:26.713 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:26.713 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:26.713 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:26.713 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:26.713 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=114 2024-03-26T16:58:26.713 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:26.713 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 115 2024-03-26T16:58:26.713 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:26.713 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:26.713 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:26.713 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:26.714 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:26.714 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=115 2024-03-26T16:58:26.714 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:26.714 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 116 2024-03-26T16:58:26.714 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:26.714 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:26.714 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:26.714 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:26.714 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:26.714 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=116 2024-03-26T16:58:26.714 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:26.714 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 117 2024-03-26T16:58:26.714 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:26.714 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:26.715 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:26.715 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:26.715 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:26.715 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=117 2024-03-26T16:58:26.715 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:26.715 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 118 2024-03-26T16:58:26.715 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:26.715 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:26.715 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:26.715 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:26.715 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:26.715 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=118 2024-03-26T16:58:26.715 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:26.715 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 119 2024-03-26T16:58:26.715 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:26.715 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:26.715 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:26.716 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:26.716 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:26.716 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=119 2024-03-26T16:58:26.953 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:26.953 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 120 2024-03-26T16:58:26.953 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:26.953 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:26.953 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:26.953 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:26.953 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:26.953 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=120 2024-03-26T16:58:26.953 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:26.953 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 121 2024-03-26T16:58:26.953 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:26.953 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:26.954 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:26.954 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:26.954 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:26.954 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=121 2024-03-26T16:58:26.954 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:26.954 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 122 2024-03-26T16:58:26.954 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:26.954 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:26.954 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:26.954 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:26.954 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:26.954 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=122 2024-03-26T16:58:26.954 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:26.955 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 123 2024-03-26T16:58:26.955 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:26.955 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:26.955 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:26.956 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:26.956 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:26.956 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=123 2024-03-26T16:58:26.956 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:26.956 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 124 2024-03-26T16:58:26.956 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:26.956 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:26.956 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:26.956 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:26.956 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:26.956 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=124 2024-03-26T16:58:26.956 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:26.956 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 125 2024-03-26T16:58:26.956 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:26.956 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:26.957 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:26.957 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:26.957 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:26.957 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=125 2024-03-26T16:58:26.957 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:26.957 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 126 2024-03-26T16:58:26.957 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:26.957 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:26.957 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:26.957 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:26.957 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:26.957 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=126 2024-03-26T16:58:26.957 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:26.957 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 127 2024-03-26T16:58:26.957 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:26.958 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:26.958 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:26.958 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:26.958 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:26.958 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=127 2024-03-26T16:58:26.958 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:26.958 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 128 2024-03-26T16:58:26.958 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:26.958 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:26.958 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:26.958 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:26.958 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:26.958 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=128 2024-03-26T16:58:26.958 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:26.958 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 129 2024-03-26T16:58:26.959 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:26.959 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:26.959 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:26.959 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:26.959 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:26.959 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=129 2024-03-26T16:58:26.959 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:26.959 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 130 2024-03-26T16:58:26.959 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:26.959 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:26.959 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:26.959 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:26.959 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:26.959 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=130 2024-03-26T16:58:26.959 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:26.960 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 131 2024-03-26T16:58:26.960 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:26.960 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:26.960 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:26.960 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:26.960 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:26.960 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=131 2024-03-26T16:58:26.960 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:26.960 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 132 2024-03-26T16:58:26.960 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:26.960 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:26.960 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:26.960 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:26.961 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:26.961 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=132 2024-03-26T16:58:26.961 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:26.961 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 133 2024-03-26T16:58:26.961 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:26.961 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:26.961 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:26.961 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:26.961 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:26.961 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=133 2024-03-26T16:58:26.961 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:26.961 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 134 2024-03-26T16:58:26.961 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:26.961 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:26.961 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:26.961 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:26.962 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:26.962 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=134 2024-03-26T16:58:26.962 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:26.962 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 135 2024-03-26T16:58:26.962 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:26.962 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:26.962 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:26.962 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:26.962 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:26.962 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=135 2024-03-26T16:58:26.962 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:26.962 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 136 2024-03-26T16:58:26.963 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:26.963 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:26.963 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:26.963 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:26.963 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:26.963 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=136 2024-03-26T16:58:26.963 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:26.963 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 137 2024-03-26T16:58:26.963 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:26.963 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:26.963 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:26.964 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:26.964 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:26.964 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=137 2024-03-26T16:58:26.964 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:26.964 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 138 2024-03-26T16:58:26.964 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:26.964 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:26.964 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:26.964 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:26.964 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:26.964 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=138 2024-03-26T16:58:26.964 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:26.964 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 139 2024-03-26T16:58:26.964 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:26.964 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:26.965 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:26.965 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:26.965 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:26.965 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=139 2024-03-26T16:58:26.966 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:26.966 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 140 2024-03-26T16:58:26.966 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:26.966 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:26.966 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:26.966 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:26.966 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:26.966 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=140 2024-03-26T16:58:26.966 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:26.966 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 141 2024-03-26T16:58:26.966 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:26.966 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:26.966 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:26.966 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:26.967 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:26.967 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=141 2024-03-26T16:58:26.967 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:26.967 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 142 2024-03-26T16:58:26.967 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:26.967 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:26.967 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:26.967 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:26.967 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:26.967 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=142 2024-03-26T16:58:26.967 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:26.967 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 143 2024-03-26T16:58:26.967 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:26.967 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:26.967 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:26.967 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:26.968 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:26.968 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=143 2024-03-26T16:58:26.968 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:26.968 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 144 2024-03-26T16:58:26.968 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:26.968 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:26.968 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:26.968 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:26.968 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:26.968 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=144 2024-03-26T16:58:26.968 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:26.968 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 145 2024-03-26T16:58:26.968 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:26.968 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:26.968 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:26.969 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:26.969 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:26.969 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=145 2024-03-26T16:58:26.969 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:26.969 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 146 2024-03-26T16:58:26.969 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:26.969 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:26.969 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:26.969 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:26.969 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:26.969 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=146 2024-03-26T16:58:26.969 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:26.969 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 147 2024-03-26T16:58:26.969 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:26.970 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:26.970 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:26.970 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:26.970 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:26.970 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=147 2024-03-26T16:58:26.970 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:26.970 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 148 2024-03-26T16:58:26.970 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:26.970 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:26.970 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:26.970 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:26.970 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:26.970 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=148 2024-03-26T16:58:26.970 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:26.971 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 149 2024-03-26T16:58:26.971 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:26.971 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:26.971 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:26.971 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:26.971 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:26.971 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=149 2024-03-26T16:58:26.971 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:26.971 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 150 2024-03-26T16:58:26.971 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:26.971 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:26.971 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:26.971 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:26.971 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:26.971 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=150 2024-03-26T16:58:26.972 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:26.972 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 151 2024-03-26T16:58:26.972 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:26.972 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:26.972 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:26.972 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:26.972 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:26.972 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=151 2024-03-26T16:58:27.055 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:26 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:26] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:58:27.055 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:26 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:26] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}] 2024-03-26T16:58:27.209 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:27.209 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 152 2024-03-26T16:58:27.209 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:27.209 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:27.209 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:27.209 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:27.209 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:27.209 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=152 2024-03-26T16:58:27.209 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:27.209 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 153 2024-03-26T16:58:27.209 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:27.210 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:27.210 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:27.210 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:27.210 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:27.210 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=153 2024-03-26T16:58:27.210 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:27.210 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 154 2024-03-26T16:58:27.210 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:27.210 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:27.210 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:27.210 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:27.210 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:27.210 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=154 2024-03-26T16:58:27.211 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:27.212 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 155 2024-03-26T16:58:27.212 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:27.212 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:27.212 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:27.212 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:27.212 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:27.212 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=155 2024-03-26T16:58:27.212 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:27.212 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 156 2024-03-26T16:58:27.212 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:26] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:27.212 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:27.212 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:27.212 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:27.213 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:27.213 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=156 2024-03-26T16:58:27.213 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:27.213 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 157 2024-03-26T16:58:27.213 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:27.213 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:27.213 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:27.213 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:27.213 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:27.213 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=157 2024-03-26T16:58:27.213 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:27.213 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 158 2024-03-26T16:58:27.213 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:27.213 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:27.214 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:27.214 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:27.214 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:27.214 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=158 2024-03-26T16:58:27.214 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:27.214 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 159 2024-03-26T16:58:27.214 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:27.214 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:27.214 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:27.214 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:27.214 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:27.214 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=159 2024-03-26T16:58:27.214 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:27.214 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 160 2024-03-26T16:58:27.214 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:27.215 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:27.215 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:27.215 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:27.215 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:27.215 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=160 2024-03-26T16:58:27.215 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:27.215 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 161 2024-03-26T16:58:27.215 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:27.215 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:27.215 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:27.215 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:27.215 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:27.215 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=161 2024-03-26T16:58:27.215 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:27.216 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 162 2024-03-26T16:58:27.216 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:27.216 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:27.216 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:27.216 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:27.216 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:27.216 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=162 2024-03-26T16:58:27.216 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:27.216 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 163 2024-03-26T16:58:27.216 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:27.216 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:27.216 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:27.216 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:27.216 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:27.216 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=163 2024-03-26T16:58:27.216 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:27.217 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 164 2024-03-26T16:58:27.217 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:27.217 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:27.217 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:27.217 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:27.217 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:27.217 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=164 2024-03-26T16:58:27.217 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:27.217 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 165 2024-03-26T16:58:27.217 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:27.217 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:27.217 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:27.217 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:27.217 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:27.217 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=165 2024-03-26T16:58:27.218 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:27.218 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 166 2024-03-26T16:58:27.218 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:27.218 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:27.218 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:27.218 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:27.218 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:27.218 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=166 2024-03-26T16:58:27.218 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:27.218 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 167 2024-03-26T16:58:27.218 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:27.218 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:27.218 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:27.218 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:27.218 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:27.219 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=167 2024-03-26T16:58:27.219 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:27.219 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 168 2024-03-26T16:58:27.219 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:27.219 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:27.219 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:27.219 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:27.219 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:27.219 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=168 2024-03-26T16:58:27.219 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:27.219 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 169 2024-03-26T16:58:27.219 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:27.219 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:27.219 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:27.220 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:27.220 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:27.220 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=169 2024-03-26T16:58:27.220 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:27.220 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 170 2024-03-26T16:58:27.220 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:27.220 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:27.220 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:27.220 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:27.220 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:27.220 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=170 2024-03-26T16:58:27.220 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:27.220 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 171 2024-03-26T16:58:27.220 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:27.220 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:27.221 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:27.221 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:27.221 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:27.221 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=171 2024-03-26T16:58:27.222 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:27.222 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 172 2024-03-26T16:58:27.222 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:27.222 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:27.222 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:27.222 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:27.222 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:27.222 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=172 2024-03-26T16:58:27.222 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:27.222 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 173 2024-03-26T16:58:27.222 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:27.222 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:27.222 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:27.223 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:27.223 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:27.223 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=173 2024-03-26T16:58:27.223 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:27.223 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 174 2024-03-26T16:58:27.223 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:27.223 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:27.223 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:27.223 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:27.223 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:27.223 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=174 2024-03-26T16:58:27.223 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:27.223 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 175 2024-03-26T16:58:27.223 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:27.224 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:27.224 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:27.224 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:27.224 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:27.224 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=175 2024-03-26T16:58:27.224 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:27.224 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 176 2024-03-26T16:58:27.224 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:27.224 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:27.224 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:27.224 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:27.224 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:27.224 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=176 2024-03-26T16:58:27.224 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:27.225 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 177 2024-03-26T16:58:27.225 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:27.225 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:27.225 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:27.225 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:27.225 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:27.225 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=177 2024-03-26T16:58:27.225 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:27.225 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 178 2024-03-26T16:58:27.225 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:27.225 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:27.225 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:27.225 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:27.225 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:27.225 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=178 2024-03-26T16:58:27.226 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:27.226 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 179 2024-03-26T16:58:27.226 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:27.226 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:27.226 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:27.226 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:27.226 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:27.226 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=179 2024-03-26T16:58:27.226 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:27.226 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 180 2024-03-26T16:58:27.226 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:27.226 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:27.226 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:27.226 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:27.227 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:27.227 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=180 2024-03-26T16:58:27.227 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:27.227 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 181 2024-03-26T16:58:27.227 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:27.227 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:27.227 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:27.227 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:27.227 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:27.227 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=181 2024-03-26T16:58:27.227 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:27.227 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 182 2024-03-26T16:58:27.227 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:27.227 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:27.227 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:27.228 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:27.228 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:27.228 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=182 2024-03-26T16:58:27.228 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:27.228 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 183 2024-03-26T16:58:27.228 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:27.228 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:27.228 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:27.228 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:27.228 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:27.228 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=183 2024-03-26T16:58:27.465 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:27.465 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 184 2024-03-26T16:58:27.465 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:27.465 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:27.465 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:27.465 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:27.465 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:27.465 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=184 2024-03-26T16:58:27.465 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:27.465 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 185 2024-03-26T16:58:27.465 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:27.465 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:27.466 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:27.466 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:27.466 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:27.466 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=185 2024-03-26T16:58:27.466 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:27.466 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 186 2024-03-26T16:58:27.466 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:27.466 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:27.466 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:27.466 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:27.466 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:27.466 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=186 2024-03-26T16:58:27.466 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:27.467 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 187 2024-03-26T16:58:27.467 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:27.467 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:27.467 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:27.468 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:27.468 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:27.468 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=187 2024-03-26T16:58:27.468 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:27.468 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 188 2024-03-26T16:58:27.468 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:27.468 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:27.468 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:27.468 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:27.468 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:27.468 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=188 2024-03-26T16:58:27.468 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:27.468 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 189 2024-03-26T16:58:27.469 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:27.469 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:27.469 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:27.469 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:27.469 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:27.469 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=189 2024-03-26T16:58:27.469 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:27.469 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 190 2024-03-26T16:58:27.469 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:27.469 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:27.469 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:27.469 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:27.469 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:27.469 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=190 2024-03-26T16:58:27.470 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:27.470 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 191 2024-03-26T16:58:27.470 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:27.470 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:27.470 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:27.470 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:27.470 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:27.470 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=191 2024-03-26T16:58:27.470 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:27.470 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 192 2024-03-26T16:58:27.470 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:27.470 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:27.470 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:27.470 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:27.471 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:27.471 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=192 2024-03-26T16:58:27.471 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:27.471 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 193 2024-03-26T16:58:27.471 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:27.471 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:27.471 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:27.471 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:27.471 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:27.471 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=193 2024-03-26T16:58:27.471 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:27.471 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 194 2024-03-26T16:58:27.471 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:27.471 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:27.472 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:27.472 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:27.472 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:27.472 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=194 2024-03-26T16:58:27.472 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:27.472 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 195 2024-03-26T16:58:27.472 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:27.472 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:27.472 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:27.472 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:27.472 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:27.472 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=195 2024-03-26T16:58:27.472 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:27.472 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 196 2024-03-26T16:58:27.473 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:27.473 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:27.473 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:27.473 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:27.473 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:27.473 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=196 2024-03-26T16:58:27.473 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:27.473 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 197 2024-03-26T16:58:27.473 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:27.473 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:27.473 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:27.473 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:27.473 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:27.473 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=197 2024-03-26T16:58:27.474 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:27.474 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 198 2024-03-26T16:58:27.474 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:27.474 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:27.474 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:27.474 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:27.474 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:27.474 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=198 2024-03-26T16:58:27.474 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:27.474 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 199 2024-03-26T16:58:27.474 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:27.474 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:27.474 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:27.474 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:27.475 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:27.475 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=199 2024-03-26T16:58:27.475 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:27.475 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 200 2024-03-26T16:58:27.475 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:27.476 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:27.476 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:27.476 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:27.476 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:27.476 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=200 2024-03-26T16:58:27.476 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:27.476 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 201 2024-03-26T16:58:27.476 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:27.476 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:27.476 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:27.476 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:27.476 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:27.476 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=201 2024-03-26T16:58:27.476 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:27.477 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 202 2024-03-26T16:58:27.477 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:27.477 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:27.477 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:27.477 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:27.477 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:27.477 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=202 2024-03-26T16:58:27.477 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:27.477 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 203 2024-03-26T16:58:27.477 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:27.477 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:27.477 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:27.477 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:27.477 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:27.477 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=203 2024-03-26T16:58:27.477 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:27.478 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 204 2024-03-26T16:58:27.478 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:27.478 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:27.478 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:27.478 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:27.478 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:27.478 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=204 2024-03-26T16:58:27.478 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:27.478 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 205 2024-03-26T16:58:27.478 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:27.478 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:27.478 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:27.478 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:27.478 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:27.479 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=205 2024-03-26T16:58:27.479 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:27.479 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 206 2024-03-26T16:58:27.479 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:27.479 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:27.479 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:27.479 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:27.479 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:27.479 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=206 2024-03-26T16:58:27.479 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:27.479 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 207 2024-03-26T16:58:27.479 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:27.479 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:27.479 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:27.479 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:27.479 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:27.480 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=207 2024-03-26T16:58:27.480 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:27.480 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 208 2024-03-26T16:58:27.480 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:27.480 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:27.480 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:27.480 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:27.480 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:27.480 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=208 2024-03-26T16:58:27.480 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:27.480 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 209 2024-03-26T16:58:27.480 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:27.480 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:27.480 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:27.480 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:27.481 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:27.481 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=209 2024-03-26T16:58:27.481 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:27.481 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 210 2024-03-26T16:58:27.481 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:27.481 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:27.481 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:27.481 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:27.481 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:27.481 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=210 2024-03-26T16:58:27.481 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:27.481 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 211 2024-03-26T16:58:27.481 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:27.481 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:27.482 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:27.482 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:27.482 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:27.482 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=211 2024-03-26T16:58:27.482 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:27.482 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 212 2024-03-26T16:58:27.482 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:27.482 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:27.482 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:27.482 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:27.482 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:27.482 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=212 2024-03-26T16:58:27.482 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:27.482 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 213 2024-03-26T16:58:27.483 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:27.483 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:27.483 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:27.483 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:27.483 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:27.483 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=213 2024-03-26T16:58:27.483 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:27.483 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 214 2024-03-26T16:58:27.483 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:27.483 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:27.483 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:27.483 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:27.483 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:27.483 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=214 2024-03-26T16:58:27.483 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:27.484 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 215 2024-03-26T16:58:27.484 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:27.484 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:27.484 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:27.484 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:27.484 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:27.484 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=215 2024-03-26T16:58:27.721 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:27.721 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 216 2024-03-26T16:58:27.721 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:27.721 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:27.721 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:27.721 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:27.721 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:27.721 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=216 2024-03-26T16:58:27.721 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:27.721 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 217 2024-03-26T16:58:27.721 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:27.722 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:27.722 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:27.722 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:27.722 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:27.722 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=217 2024-03-26T16:58:27.722 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:27.722 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 218 2024-03-26T16:58:27.722 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:27.722 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:27.722 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:27.722 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:27.722 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:27.722 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=218 2024-03-26T16:58:27.722 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:27.723 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 219 2024-03-26T16:58:27.723 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:27.723 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:27.724 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:27.724 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:27.724 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:27.724 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=219 2024-03-26T16:58:27.724 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:27.724 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 220 2024-03-26T16:58:27.724 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:27.724 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:27.724 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:27.724 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:27.724 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:27.724 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=220 2024-03-26T16:58:27.724 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:27.724 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 221 2024-03-26T16:58:27.724 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:27.725 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:27.725 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:27.725 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:27.725 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:27.725 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=221 2024-03-26T16:58:27.725 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:27.725 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 222 2024-03-26T16:58:27.725 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:27.725 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:27.725 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:27.725 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:27.725 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:27.725 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=222 2024-03-26T16:58:27.725 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:27.725 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 223 2024-03-26T16:58:27.726 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:27.726 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:27.726 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:27.726 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:27.726 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:27.726 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=223 2024-03-26T16:58:27.726 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:27.726 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 224 2024-03-26T16:58:27.726 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:27.726 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:27.726 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:27.726 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:27.726 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:27.726 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=224 2024-03-26T16:58:27.726 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:27.727 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 225 2024-03-26T16:58:27.727 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:27.727 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:27.727 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:27.727 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:27.727 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:27.727 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=225 2024-03-26T16:58:27.727 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:27.727 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 226 2024-03-26T16:58:27.727 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:27.727 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:27.727 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:27.727 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:27.727 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:27.727 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=226 2024-03-26T16:58:27.728 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:27.728 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 227 2024-03-26T16:58:27.728 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:27.728 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:27.728 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:27.728 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:27.728 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:27.728 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=227 2024-03-26T16:58:27.728 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:27.728 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 228 2024-03-26T16:58:27.728 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:27.728 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:27.728 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:27.729 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:27.729 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:27.729 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=228 2024-03-26T16:58:27.729 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:27.729 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 229 2024-03-26T16:58:27.729 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:27.729 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:27.729 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:27.729 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:27.729 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:27.729 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=229 2024-03-26T16:58:27.729 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:27.729 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 230 2024-03-26T16:58:27.729 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:27.730 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:27.730 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:27.730 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:27.730 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:27.730 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=230 2024-03-26T16:58:27.730 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:27.730 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 231 2024-03-26T16:58:27.730 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:27.730 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:27.730 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:27.730 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:27.730 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:27.730 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=231 2024-03-26T16:58:27.730 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:27.731 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 232 2024-03-26T16:58:27.731 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:27.731 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:27.732 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:27.732 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:27.732 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:27.732 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=232 2024-03-26T16:58:27.732 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:27.732 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 233 2024-03-26T16:58:27.732 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:27.732 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:27.732 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:27.732 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:27.732 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:27.732 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=233 2024-03-26T16:58:27.732 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:27.733 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 234 2024-03-26T16:58:27.733 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:27.733 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:27.733 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:27.733 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:27.733 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:27.733 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=234 2024-03-26T16:58:27.733 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:27.733 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 235 2024-03-26T16:58:27.733 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:27.733 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:27.733 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:27.733 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:27.733 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:27.734 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=235 2024-03-26T16:58:27.734 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:27.734 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 236 2024-03-26T16:58:27.734 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:27.734 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:27.734 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:27.734 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:27.734 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:27.734 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=236 2024-03-26T16:58:27.734 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:27.734 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 237 2024-03-26T16:58:27.734 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:27.734 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:27.734 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:27.734 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:27.735 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:27.735 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=237 2024-03-26T16:58:27.735 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:27.735 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 238 2024-03-26T16:58:27.735 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:27.735 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:27.735 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:27.735 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:27.735 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:27.735 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=238 2024-03-26T16:58:27.735 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:27.735 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 239 2024-03-26T16:58:27.735 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:27.735 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:27.735 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:27.736 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:27.736 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:27.736 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=239 2024-03-26T16:58:27.736 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:27.736 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 240 2024-03-26T16:58:27.736 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:27.736 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:27.736 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:27.736 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:27.736 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:27.736 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=240 2024-03-26T16:58:27.736 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:27.736 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 241 2024-03-26T16:58:27.736 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:27.737 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:27.737 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:27.737 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:27.737 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:27.737 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=241 2024-03-26T16:58:27.737 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:27.737 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 242 2024-03-26T16:58:27.737 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:27.737 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:27.737 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:27.737 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:27.737 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:27.737 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=242 2024-03-26T16:58:27.737 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:27.737 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 243 2024-03-26T16:58:27.738 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:27.738 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:27.738 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:27.738 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:27.738 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:27.738 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=243 2024-03-26T16:58:27.738 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:27.738 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 244 2024-03-26T16:58:27.738 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:27.738 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:27.738 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:27.738 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:27.738 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:27.738 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=244 2024-03-26T16:58:27.739 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:27.739 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 245 2024-03-26T16:58:27.739 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:27.739 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:27.739 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:27.739 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:27.739 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:27.739 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=245 2024-03-26T16:58:27.739 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:27.739 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 246 2024-03-26T16:58:27.739 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:27.739 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:27.739 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:27.739 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:27.739 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:27.740 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=246 2024-03-26T16:58:27.740 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:27.740 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 247 2024-03-26T16:58:27.740 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:27.740 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:27.740 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:27.740 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:27.740 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:27.740 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=247 2024-03-26T16:58:27.806 INFO:tasks.workunit.client.3.smithi157.stdout:Adding nqn.2016-06.io.spdk:cnode1 listener at 172.21.15.44:4420: Successful 2024-03-26T16:58:28.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:28.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 248 2024-03-26T16:58:28.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:28.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:28.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:28.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:28.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:28.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=248 2024-03-26T16:58:28.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:28.017 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 249 2024-03-26T16:58:28.017 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:28.017 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:28.017 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:28.017 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:28.017 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:28.017 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=249 2024-03-26T16:58:28.017 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:28.017 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 250 2024-03-26T16:58:28.017 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:28.017 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:28.017 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:28.017 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:28.017 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:28.017 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=250 2024-03-26T16:58:28.018 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:28.018 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 251 2024-03-26T16:58:28.018 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:28.018 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:28.018 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:28.018 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:28.018 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:28.019 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=251 2024-03-26T16:58:28.019 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:28.019 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 252 2024-03-26T16:58:28.019 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:28.019 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:28.019 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:28.019 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:28.019 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:28.019 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=252 2024-03-26T16:58:28.019 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:28.019 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 253 2024-03-26T16:58:28.019 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:28.019 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:28.019 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:28.020 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:28.020 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:28.020 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=253 2024-03-26T16:58:28.020 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:28.020 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 254 2024-03-26T16:58:28.020 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:28.020 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:28.020 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:28.020 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:28.020 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:28.020 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=254 2024-03-26T16:58:28.020 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:28.020 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 255 2024-03-26T16:58:28.020 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:28.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:28.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:28.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:28.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:28.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=255 2024-03-26T16:58:28.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:28.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 256 2024-03-26T16:58:28.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:28.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:28.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:28.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:28.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:28.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=256 2024-03-26T16:58:28.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:28.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:58:28.022 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:27] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}] 2024-03-26T16:58:28.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:27 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:27] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:58:28.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:27 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:27] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}] 2024-03-26T16:58:28.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:27 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:27] INFO grpc.py:1992: Received request to create smithi044 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode1 at 172.21.15.44:4420, context: None 2024-03-26T16:58:28.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:27 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:27] INFO grpc.py:2031: Listener not created as gateway's host name smithi149 differs from requested host smithi044 2024-03-26T16:58:28.184 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:27 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:27] INFO grpc.py:1992: Received request to create smithi044 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode1 at 172.21.15.44:4420, context: None 2024-03-26T16:58:28.184 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:27 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:27] INFO grpc.py:2031: Listener not created as gateway's host name smithi064 differs from requested host smithi044 2024-03-26T16:58:28.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:58:28 smithi044 ceph-mon[30624]: pgmap v354: 33 pgs: 33 active+clean; 609 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 4.0 KiB/s rd, 511 B/s wr, 5 op/s 2024-03-26T16:58:28.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:58:28 smithi064 ceph-mon[34420]: pgmap v354: 33 pgs: 33 active+clean; 609 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 4.0 KiB/s rd, 511 B/s wr, 5 op/s 2024-03-26T16:58:28.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:58:28 smithi149 ceph-mon[34678]: pgmap v354: 33 pgs: 33 active+clean; 609 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 4.0 KiB/s rd, 511 B/s wr, 5 op/s 2024-03-26T16:58:28.671 INFO:tasks.workunit.client.3.smithi157.stderr:+ for j in $(seq 1 $NVMEOF_SUBSYSTEMS_COUNT) 2024-03-26T16:58:28.671 INFO:tasks.workunit.client.3.smithi157.stderr:+ subsystem_nqn=nqn.2016-06.io.spdk:cnode2 2024-03-26T16:58:28.671 INFO:tasks.workunit.client.3.smithi157.stdout:Adding gateway listener with IP 172.21.15.44 and name smithi044 2024-03-26T16:58:28.672 INFO:tasks.workunit.client.3.smithi157.stderr:+ echo 'Adding gateway listener with IP 172.21.15.44 and name smithi044' 2024-03-26T16:58:28.672 INFO:tasks.workunit.client.3.smithi157.stderr:+ sudo podman run -it quay.io/barakda1/nvmeof-cli:qe_ceph_devel_21e59b2 --server-address 172.21.15.44 --server-port 5500 listener add --subsystem nqn.2016-06.io.spdk:cnode2 --host-name smithi044 --traddr 172.21.15.44 --trsvcid 4420 2024-03-26T16:58:28.752 INFO:tasks.workunit.client.3.smithi157.stderr:time="2024-03-26T16:58:28Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2024-03-26T16:58:29.055 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:28 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:28] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:58:29.056 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:28 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:28] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}] 2024-03-26T16:58:29.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-26T16:58:29.737 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:29] INFO grpc.py:1992: Received request to create smithi044 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode2 at 172.21.15.44:4420, context: 2024-03-26T16:58:29.737 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:29] INFO grpc.py:2023: create_listener: True 2024-03-26T16:58:29.737 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:29] INFO grpc.py:1958: Subsystem nqn.2016-06.io.spdk:cnode2 enable_ha: True 2024-03-26T16:58:29.737 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:29] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 1 2024-03-26T16:58:29.737 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:29] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:29.737 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:29.737 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:29.737 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:29.737 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:29.737 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=1 2024-03-26T16:58:29.737 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:29] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:29.737 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:29] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 2 2024-03-26T16:58:29.738 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:29] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:29.738 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:29.738 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:29.738 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:29.738 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:29.738 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=2 2024-03-26T16:58:29.738 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:29] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:29.738 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:29] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : optimized for group : 3 2024-03-26T16:58:29.738 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:29] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:29.738 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:29.738 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:29.738 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:29.738 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:29.740 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='optimized' anagrpid=3 2024-03-26T16:58:29.740 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:29] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:29.740 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:29] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 4 2024-03-26T16:58:29.740 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:29] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:29.740 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:29.740 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:29.740 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:29.740 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:29.740 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=4 2024-03-26T16:58:29.740 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:29] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:29.741 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:29] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 5 2024-03-26T16:58:29.741 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:29] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:29.741 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:29.741 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:29.741 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:29.741 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:29.741 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=5 2024-03-26T16:58:29.741 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:29] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:29.741 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:29] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 6 2024-03-26T16:58:29.741 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:29] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:29.741 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:29.741 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:29.741 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:29.742 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:29.742 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=6 2024-03-26T16:58:29.742 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:29] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:29.742 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:29] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 7 2024-03-26T16:58:29.742 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:29] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:29.742 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:29.742 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:29.742 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:29.743 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:29.743 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=7 2024-03-26T16:58:29.743 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:29] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:29.743 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:29] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 8 2024-03-26T16:58:29.743 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:29] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:29.744 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:29.744 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:29.744 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:29.744 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:29.744 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=8 2024-03-26T16:58:29.744 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:29] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:29.744 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:29] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 9 2024-03-26T16:58:29.745 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:29] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:29.745 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:29.745 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:29.745 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:29.745 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:29.745 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=9 2024-03-26T16:58:29.745 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:29] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:29.745 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:29] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 10 2024-03-26T16:58:29.745 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:29] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:29.745 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:29.745 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:29.746 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:29.746 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:29.746 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=10 2024-03-26T16:58:29.746 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:29] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:29.746 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:29] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 11 2024-03-26T16:58:29.746 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:29] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:29.746 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:29.746 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:29.746 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:29.746 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:29.746 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=11 2024-03-26T16:58:29.746 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:29] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:29.746 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:29] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 12 2024-03-26T16:58:29.746 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:29] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:29.747 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:29.747 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:29.747 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:29.747 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:29.747 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=12 2024-03-26T16:58:29.747 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:29] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:29.747 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:29] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 13 2024-03-26T16:58:29.747 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:29] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:29.747 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:29.747 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:29.747 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:29.747 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:29.747 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=13 2024-03-26T16:58:29.748 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:29] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:29.748 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:29] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 14 2024-03-26T16:58:29.748 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:29] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:29.748 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:29.748 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:29.748 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:29.748 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:29.748 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=14 2024-03-26T16:58:29.748 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:29] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:29.748 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:29] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 15 2024-03-26T16:58:29.748 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:29] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:29.748 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:29.748 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:29.749 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:29.749 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:29.749 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=15 2024-03-26T16:58:29.749 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:29] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:29.749 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:29] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 16 2024-03-26T16:58:29.749 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:29] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:29.749 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:29.749 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:29.749 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:29.749 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:29.749 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=16 2024-03-26T16:58:29.749 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:29] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:29.749 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:29] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 17 2024-03-26T16:58:29.749 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:29] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:29.749 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:29.750 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:29.750 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:29.750 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:29.750 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=17 2024-03-26T16:58:29.750 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:29] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:29.750 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:29] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 18 2024-03-26T16:58:29.750 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:29] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:29.750 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:29.750 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:29.750 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:29.750 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:29.750 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=18 2024-03-26T16:58:29.750 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:29] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:29.751 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:29] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 19 2024-03-26T16:58:29.751 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:29] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:29.751 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:29.751 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:29.751 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:29.751 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:29.751 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=19 2024-03-26T16:58:29.751 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:29] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:29.751 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:29] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 20 2024-03-26T16:58:29.751 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:29] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:29.751 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:29.751 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:29.751 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:29.751 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:29.751 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=20 2024-03-26T16:58:29.751 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:29] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:29.752 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:29] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 21 2024-03-26T16:58:29.752 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:29] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:29.752 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:29.752 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:29.752 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:29.752 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:29.752 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=21 2024-03-26T16:58:29.752 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:29] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:29.752 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:29] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 22 2024-03-26T16:58:29.752 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:29] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:29.752 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:29.752 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:29.752 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:29.752 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:29.752 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=22 2024-03-26T16:58:29.753 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:29] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:29.753 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:29] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 23 2024-03-26T16:58:29.753 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:29] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:29.753 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:29.753 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:29.754 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:29.754 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:29.754 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=23 2024-03-26T16:58:29.754 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:29] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:29.754 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:29] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 24 2024-03-26T16:58:29.754 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:29] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:29.754 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:29.754 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:29.754 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:29.754 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:29.754 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=24 2024-03-26T16:58:29.755 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:29] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:29.755 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:29] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 25 2024-03-26T16:58:29.755 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:29] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:29.755 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:29.755 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:29.755 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:29.755 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:29.755 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=25 2024-03-26T16:58:29.756 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:29] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:29.756 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:29] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 26 2024-03-26T16:58:29.756 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:29] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:29.756 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:29.756 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:29.756 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:29.756 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:29.756 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=26 2024-03-26T16:58:29.756 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:29] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:29.756 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:29] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 27 2024-03-26T16:58:29.756 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:29] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:29.756 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:29.756 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:29.756 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:29.757 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:29.757 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=27 2024-03-26T16:58:29.757 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:29] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:29.757 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:29] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 28 2024-03-26T16:58:29.757 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:29] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:29.757 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:29.757 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:29.757 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:29.757 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:29.757 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=28 2024-03-26T16:58:29.757 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:29] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:29.757 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:29] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 29 2024-03-26T16:58:29.757 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:29] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:29.757 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:29.758 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:29.758 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:29.758 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:29.758 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=29 2024-03-26T16:58:29.758 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:29] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:29.758 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:29] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 30 2024-03-26T16:58:29.758 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:29] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:29.758 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:29.758 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:29.758 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:29.758 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:29.758 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=30 2024-03-26T16:58:29.758 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:29] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:29.758 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:29] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 31 2024-03-26T16:58:29.759 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:29] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:29.759 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:29.759 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:29.759 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:29.759 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:29.759 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=31 2024-03-26T16:58:29.759 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:29] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:29.759 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:29] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 32 2024-03-26T16:58:29.759 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:29] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:29.759 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:29.759 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:29.759 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:29.759 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:29.759 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=32 2024-03-26T16:58:29.896 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:58:29 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-26T16:58:29.897 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:29 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:29] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:58:29.897 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:29 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:29] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}] 2024-03-26T16:58:29.993 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:29] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:29.993 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:29] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 33 2024-03-26T16:58:29.993 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:29] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:29.993 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:29.993 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:29.993 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:29.993 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:29.993 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=33 2024-03-26T16:58:29.993 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:29] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:29.993 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:29] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 34 2024-03-26T16:58:29.993 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:29] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:29.993 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:29.994 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:29.994 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:29.994 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:29.994 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=34 2024-03-26T16:58:29.994 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:29] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:29.994 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:29] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 35 2024-03-26T16:58:29.994 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:29] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:29.994 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:29.994 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:29.994 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:29.994 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:29.994 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=35 2024-03-26T16:58:29.994 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:29] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:29.995 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:29] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 36 2024-03-26T16:58:29.996 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:29] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:29.996 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:29.996 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:29.996 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:29.996 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:29.996 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=36 2024-03-26T16:58:29.996 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:29] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:29.996 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:29] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 37 2024-03-26T16:58:29.997 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:29] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:29.997 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:29.997 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:29.997 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:29.997 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:29.997 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=37 2024-03-26T16:58:29.997 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:29] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:29.997 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:29] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 38 2024-03-26T16:58:29.997 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:29] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:29.997 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:29.997 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:29.997 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:29.997 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:29.998 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=38 2024-03-26T16:58:29.998 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:29] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:29.998 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:29] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 39 2024-03-26T16:58:29.998 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:29] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:29.998 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:29.998 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:29.998 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:29.998 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:29.998 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=39 2024-03-26T16:58:29.998 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:29] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:29.998 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:29] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 40 2024-03-26T16:58:29.999 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:29] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:29.999 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:29.999 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:29.999 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:29.999 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:29.999 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=40 2024-03-26T16:58:29.999 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:29] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:29.999 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:29] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 41 2024-03-26T16:58:29.999 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:29] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:29.999 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:29.999 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:29.999 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:29.999 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:29.999 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=41 2024-03-26T16:58:30.000 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:29] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:30.000 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:29] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 42 2024-03-26T16:58:30.000 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:29] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:30.000 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:30.000 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:30.000 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:30.000 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:30.000 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=42 2024-03-26T16:58:30.000 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:29] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:30.000 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:29] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 43 2024-03-26T16:58:30.000 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:29] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:30.000 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:30.000 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:30.000 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:30.001 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:30.001 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=43 2024-03-26T16:58:30.001 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:29] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:30.001 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:29] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 44 2024-03-26T16:58:30.001 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:29] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:30.001 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:30.001 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:30.001 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:30.001 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:30.001 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=44 2024-03-26T16:58:30.001 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:29] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:30.001 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:29] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 45 2024-03-26T16:58:30.001 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:29] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:30.001 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:30.001 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:30.002 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:30.002 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:30.002 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=45 2024-03-26T16:58:30.002 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:29] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:30.002 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:29] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 46 2024-03-26T16:58:30.002 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:29] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:30.002 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:30.002 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:30.002 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:30.002 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:30.002 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=46 2024-03-26T16:58:30.002 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:29] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:30.002 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:29] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 47 2024-03-26T16:58:30.003 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:29] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:30.003 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:30.003 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:30.003 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:30.003 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:30.003 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=47 2024-03-26T16:58:30.003 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:29] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:30.003 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:29] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 48 2024-03-26T16:58:30.003 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:29] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:30.003 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:30.003 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:30.003 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:30.003 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:30.003 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=48 2024-03-26T16:58:30.003 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:29] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:30.004 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:29] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 49 2024-03-26T16:58:30.004 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:29] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:30.004 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:30.004 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:30.004 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:30.004 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:30.004 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=49 2024-03-26T16:58:30.004 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:29] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:30.004 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:29] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 50 2024-03-26T16:58:30.004 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:29] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:30.004 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:30.005 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:30.005 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:30.005 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:30.005 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=50 2024-03-26T16:58:30.005 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:29] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:30.005 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:29] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 51 2024-03-26T16:58:30.005 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:29] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:30.005 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:30.005 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:30.005 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:30.005 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:30.005 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=51 2024-03-26T16:58:30.005 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:29] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:30.005 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:29] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 52 2024-03-26T16:58:30.005 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:29] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:30.006 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:30.007 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:30.007 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:30.007 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:30.007 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=52 2024-03-26T16:58:30.007 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:29] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:30.007 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:29] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 53 2024-03-26T16:58:30.007 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:29] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:30.007 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:30.007 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:30.007 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:30.007 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:30.008 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=53 2024-03-26T16:58:30.008 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:29] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:30.008 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:29] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 54 2024-03-26T16:58:30.008 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:29] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:30.008 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:30.008 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:30.008 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:30.008 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:30.008 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=54 2024-03-26T16:58:30.008 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:29] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:30.008 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:29] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 55 2024-03-26T16:58:30.008 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:29] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:30.008 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:30.008 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:30.009 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:30.009 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:30.009 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=55 2024-03-26T16:58:30.009 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:29] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:30.009 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:29] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 56 2024-03-26T16:58:30.009 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:29] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:30.009 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:30.009 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:30.009 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:30.009 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:30.009 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=56 2024-03-26T16:58:30.009 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:29] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:30.009 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:29] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 57 2024-03-26T16:58:30.010 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:29] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:30.010 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:30.010 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:30.010 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:30.010 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:30.010 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=57 2024-03-26T16:58:30.010 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:29] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:30.010 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:29] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 58 2024-03-26T16:58:30.010 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:29] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:30.010 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:30.010 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:30.010 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:30.010 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:30.010 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=58 2024-03-26T16:58:30.011 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:29] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:30.011 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:29] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 59 2024-03-26T16:58:30.011 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:29] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:30.011 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:30.011 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:30.011 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:30.011 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:30.011 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=59 2024-03-26T16:58:30.011 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:29] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:30.011 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:29] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 60 2024-03-26T16:58:30.011 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:29] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:30.012 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:30.012 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:30.012 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:30.012 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:30.012 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=60 2024-03-26T16:58:30.012 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:29] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:30.013 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:29] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 61 2024-03-26T16:58:30.013 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:29] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:30.013 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:30.013 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:30.013 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:30.013 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:30.013 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=61 2024-03-26T16:58:30.013 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:29] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:30.013 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:29] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 62 2024-03-26T16:58:30.013 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:29] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:30.014 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:30.014 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:30.014 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:30.014 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:30.014 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=62 2024-03-26T16:58:30.014 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:29] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:30.014 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:29] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 63 2024-03-26T16:58:30.014 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:29] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:30.014 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:30.014 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:30.014 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:30.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:30.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=63 2024-03-26T16:58:30.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:29] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:30.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:29] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 64 2024-03-26T16:58:30.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:29] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:30.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:30.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:30.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:30.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:30.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=64 2024-03-26T16:58:30.055 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:58:29 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-26T16:58:30.249 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:30.249 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 65 2024-03-26T16:58:30.249 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:30.249 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:30.250 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:30.250 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:30.250 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:30.250 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=65 2024-03-26T16:58:30.250 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:30.250 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 66 2024-03-26T16:58:30.250 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:30.250 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:30.250 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:30.250 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:30.250 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:30.250 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=66 2024-03-26T16:58:30.250 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:30.251 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 67 2024-03-26T16:58:30.251 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:30.251 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:30.251 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:30.251 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:30.251 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:30.251 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=67 2024-03-26T16:58:30.251 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:30.252 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 68 2024-03-26T16:58:30.252 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:30.252 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:30.252 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:30.252 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:30.252 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:30.252 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=68 2024-03-26T16:58:30.252 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:30.252 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 69 2024-03-26T16:58:30.252 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:30.252 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:30.253 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:30.253 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:30.253 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:30.253 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=69 2024-03-26T16:58:30.253 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:30.253 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 70 2024-03-26T16:58:30.253 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:30.253 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:30.253 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:30.253 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:30.253 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:30.253 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=70 2024-03-26T16:58:30.253 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:30.253 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 71 2024-03-26T16:58:30.254 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:30.254 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:30.254 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:30.254 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:30.254 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:30.254 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=71 2024-03-26T16:58:30.254 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:30.254 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 72 2024-03-26T16:58:30.254 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:30.254 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:30.254 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:30.254 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:30.254 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:30.254 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=72 2024-03-26T16:58:30.255 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:30.255 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 73 2024-03-26T16:58:30.255 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:30.255 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:30.255 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:30.255 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:30.255 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:30.255 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=73 2024-03-26T16:58:30.255 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:30.255 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 74 2024-03-26T16:58:30.255 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:30.255 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:30.255 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:30.255 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:30.256 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:30.256 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=74 2024-03-26T16:58:30.256 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:30.256 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 75 2024-03-26T16:58:30.256 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:30.256 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:30.256 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:30.256 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:30.256 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:30.256 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=75 2024-03-26T16:58:30.256 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:30.256 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 76 2024-03-26T16:58:30.256 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:30.257 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:30.257 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:30.257 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:30.257 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:30.257 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=76 2024-03-26T16:58:30.257 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:30.257 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 77 2024-03-26T16:58:30.257 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:30.257 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:30.257 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:30.257 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:30.257 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:30.257 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=77 2024-03-26T16:58:30.259 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:30.259 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 78 2024-03-26T16:58:30.260 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:30.260 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:30.260 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:30.260 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:30.260 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:30.260 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=78 2024-03-26T16:58:30.260 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:30.261 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 79 2024-03-26T16:58:30.261 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:30.261 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:30.261 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:30.261 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:30.261 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:30.261 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=79 2024-03-26T16:58:30.261 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:30.261 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 80 2024-03-26T16:58:30.261 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:30.262 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:30.262 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:30.262 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:30.262 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:30.262 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=80 2024-03-26T16:58:30.262 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:30.262 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 81 2024-03-26T16:58:30.262 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:30.263 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:30.263 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:30.263 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:30.263 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:30.263 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=81 2024-03-26T16:58:30.263 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:30.263 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 82 2024-03-26T16:58:30.263 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:30.263 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:30.264 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:30.264 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:30.264 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:30.264 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=82 2024-03-26T16:58:30.264 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:30.264 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 83 2024-03-26T16:58:30.264 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:30.264 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:30.264 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:30.264 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:30.264 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:30.264 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=83 2024-03-26T16:58:30.264 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:30.264 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 84 2024-03-26T16:58:30.264 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:30.265 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:30.265 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:30.265 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:30.265 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:30.265 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=84 2024-03-26T16:58:30.265 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:30.265 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 85 2024-03-26T16:58:30.265 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:30.265 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:30.265 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:30.265 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:30.265 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:30.265 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=85 2024-03-26T16:58:30.265 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:30.266 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 86 2024-03-26T16:58:30.266 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:30.266 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:30.266 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:30.266 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:30.266 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:30.266 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=86 2024-03-26T16:58:30.266 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:30.266 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 87 2024-03-26T16:58:30.266 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:30.266 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:30.266 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:30.266 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:30.266 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:30.267 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=87 2024-03-26T16:58:30.267 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:30.267 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 88 2024-03-26T16:58:30.267 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:30.267 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:30.267 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:30.267 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:30.267 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:30.267 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=88 2024-03-26T16:58:30.267 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:30.267 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 89 2024-03-26T16:58:30.267 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:30.267 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:30.267 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:30.267 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:30.268 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:30.268 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=89 2024-03-26T16:58:30.268 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:30.268 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 90 2024-03-26T16:58:30.268 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:30.268 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:30.268 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:30.268 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:30.268 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:30.268 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=90 2024-03-26T16:58:30.268 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:30.268 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 91 2024-03-26T16:58:30.268 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:30.268 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:30.269 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:30.269 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:30.269 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:30.269 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=91 2024-03-26T16:58:30.269 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:30.269 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 92 2024-03-26T16:58:30.269 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:30.269 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:30.269 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:30.269 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:30.269 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:30.269 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=92 2024-03-26T16:58:30.269 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:30.269 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 93 2024-03-26T16:58:30.269 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:30.270 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:30.270 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:30.270 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:30.270 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:30.270 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=93 2024-03-26T16:58:30.270 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:30.270 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 94 2024-03-26T16:58:30.270 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:30.270 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:30.270 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:30.270 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:30.270 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:30.270 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=94 2024-03-26T16:58:30.270 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:30.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 95 2024-03-26T16:58:30.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:30.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:30.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:30.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:30.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:30.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=95 2024-03-26T16:58:30.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:30.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 96 2024-03-26T16:58:30.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:30.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:30.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:30.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:30.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:30.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=96 2024-03-26T16:58:30.505 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:30.505 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 97 2024-03-26T16:58:30.505 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:30.505 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:30.505 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:30.505 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:30.505 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:30.505 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=97 2024-03-26T16:58:30.505 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:30.506 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 98 2024-03-26T16:58:30.506 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:30.506 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:30.506 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:30.506 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:30.506 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:30.506 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=98 2024-03-26T16:58:30.506 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:30.506 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 99 2024-03-26T16:58:30.506 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:30.506 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:30.506 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:30.506 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:30.506 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:30.507 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=99 2024-03-26T16:58:30.507 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:30.508 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 100 2024-03-26T16:58:30.508 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:30.508 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:30.508 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:30.508 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:30.508 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:30.508 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=100 2024-03-26T16:58:30.508 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:30.508 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 101 2024-03-26T16:58:30.508 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:30.508 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:30.509 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:30.509 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:30.509 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:30.509 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=101 2024-03-26T16:58:30.509 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:30.509 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 102 2024-03-26T16:58:30.509 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:30.510 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:30.510 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:30.510 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:30.510 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:30.510 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=102 2024-03-26T16:58:30.510 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:30.510 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 103 2024-03-26T16:58:30.510 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:30.510 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:30.510 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:30.511 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:30.511 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:30.511 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=103 2024-03-26T16:58:30.511 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:30.511 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 104 2024-03-26T16:58:30.511 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:30.511 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:30.511 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:30.511 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:30.511 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:30.511 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=104 2024-03-26T16:58:30.511 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:30.511 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 105 2024-03-26T16:58:30.511 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:30.511 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:30.512 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:30.512 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:30.512 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:30.512 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=105 2024-03-26T16:58:30.512 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:30.512 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 106 2024-03-26T16:58:30.512 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:30.512 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:30.512 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:30.512 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:30.512 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:30.512 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=106 2024-03-26T16:58:30.512 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:30.512 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 107 2024-03-26T16:58:30.513 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:30.513 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:30.513 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:30.513 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:30.513 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:30.513 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=107 2024-03-26T16:58:30.513 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:30.513 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 108 2024-03-26T16:58:30.513 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:30.513 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:30.513 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:30.513 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:30.513 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:30.513 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=108 2024-03-26T16:58:30.513 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:30.514 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 109 2024-03-26T16:58:30.514 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:30.514 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:30.514 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:30.514 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:30.514 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:30.514 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=109 2024-03-26T16:58:30.514 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:30.514 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 110 2024-03-26T16:58:30.514 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:30.514 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:30.514 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:30.514 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:30.514 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:30.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=110 2024-03-26T16:58:30.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:30.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 111 2024-03-26T16:58:30.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:30.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:30.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:30.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:30.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:30.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=111 2024-03-26T16:58:30.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:30.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 112 2024-03-26T16:58:30.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:30.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:30.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:30.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:30.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:30.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=112 2024-03-26T16:58:30.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:30.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 113 2024-03-26T16:58:30.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:30.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:30.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:30.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:30.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:30.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=113 2024-03-26T16:58:30.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:30.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 114 2024-03-26T16:58:30.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:30.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:30.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:30.517 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:30.517 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:30.517 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=114 2024-03-26T16:58:30.517 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:30.517 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 115 2024-03-26T16:58:30.517 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:30.517 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:30.517 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:30.517 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:30.517 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:30.517 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=115 2024-03-26T16:58:30.517 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:30.517 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 116 2024-03-26T16:58:30.517 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:30.518 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:30.518 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:30.518 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:30.518 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:30.518 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=116 2024-03-26T16:58:30.518 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:30.518 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 117 2024-03-26T16:58:30.518 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:30.518 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:30.519 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:30.519 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:30.519 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:30.519 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=117 2024-03-26T16:58:30.519 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:30.519 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 118 2024-03-26T16:58:30.519 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:30.519 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:30.520 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:30.520 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:30.520 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:30.520 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=118 2024-03-26T16:58:30.520 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:30.520 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 119 2024-03-26T16:58:30.520 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:30.520 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:30.520 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:30.520 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:30.520 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:30.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=119 2024-03-26T16:58:30.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:30.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 120 2024-03-26T16:58:30.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:30.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:30.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:30.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:30.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:30.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=120 2024-03-26T16:58:30.522 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:30.522 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 121 2024-03-26T16:58:30.522 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:30.522 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:30.522 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:30.522 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:30.522 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:30.522 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=121 2024-03-26T16:58:30.522 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:30.522 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 122 2024-03-26T16:58:30.522 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:30.522 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:30.522 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:30.523 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:30.523 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:30.523 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=122 2024-03-26T16:58:30.523 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:30.523 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 123 2024-03-26T16:58:30.523 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:30.523 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:30.523 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:30.523 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:30.523 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:30.523 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=123 2024-03-26T16:58:30.523 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:30.523 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 124 2024-03-26T16:58:30.524 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:30.524 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:30.524 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:30.524 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:30.524 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:30.524 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=124 2024-03-26T16:58:30.524 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:30.524 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 125 2024-03-26T16:58:30.524 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:30.524 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:30.524 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:30.524 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:30.524 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:30.524 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=125 2024-03-26T16:58:30.525 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:30.525 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 126 2024-03-26T16:58:30.525 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:30.525 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:30.525 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:30.525 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:30.525 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:30.525 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=126 2024-03-26T16:58:30.525 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:30.525 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 127 2024-03-26T16:58:30.525 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:30.525 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:30.526 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:30.526 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:30.526 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:30.526 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=127 2024-03-26T16:58:30.760 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-mon[30624]: pgmap v355: 33 pgs: 33 active+clean; 609 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 6.2 KiB/s rd, 682 B/s wr, 7 op/s 2024-03-26T16:58:30.761 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:58:30.761 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:58:30.761 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:30.762 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 128 2024-03-26T16:58:30.762 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:30.762 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:30.762 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:30.762 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:30.762 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:30.763 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=128 2024-03-26T16:58:30.763 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:30.763 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 129 2024-03-26T16:58:30.763 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:30.763 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:30.763 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:30.764 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:30.764 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:30.764 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=129 2024-03-26T16:58:30.764 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:30.764 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 130 2024-03-26T16:58:30.764 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:30.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:30.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:30.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:30.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:30.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=130 2024-03-26T16:58:30.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:30.767 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 131 2024-03-26T16:58:30.768 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:30.768 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:30.768 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:30.768 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:30.768 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:30.768 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=131 2024-03-26T16:58:30.769 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:30.769 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 132 2024-03-26T16:58:30.769 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:30.769 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:30.769 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:30.769 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:30.770 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:30.770 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=132 2024-03-26T16:58:30.770 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:30.770 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 133 2024-03-26T16:58:30.770 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:30.770 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:30.770 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:30.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:30.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:30.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=133 2024-03-26T16:58:30.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:30.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 134 2024-03-26T16:58:30.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:30.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:30.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:30.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:30.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:30.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=134 2024-03-26T16:58:30.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:30.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 135 2024-03-26T16:58:30.773 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:30.773 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:30.773 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:30.773 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:30.773 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:30.774 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=135 2024-03-26T16:58:30.774 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:30.774 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 136 2024-03-26T16:58:30.774 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:30.774 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:30.774 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:30.775 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:30.775 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:30.775 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=136 2024-03-26T16:58:30.775 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:30.775 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 137 2024-03-26T16:58:30.775 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:30.775 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:30.776 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:30.776 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:30.776 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:30.776 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=137 2024-03-26T16:58:30.776 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:30.776 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 138 2024-03-26T16:58:30.777 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:30.777 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:30.777 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:30.777 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:30.777 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:30.777 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=138 2024-03-26T16:58:30.778 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:30.778 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 139 2024-03-26T16:58:30.778 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:30.778 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:30.778 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:30.778 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:30.779 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:30.779 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=139 2024-03-26T16:58:30.779 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:30.779 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 140 2024-03-26T16:58:30.779 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:30.779 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:30.780 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:30.780 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:30.780 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:30.780 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=140 2024-03-26T16:58:30.780 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:30.780 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 141 2024-03-26T16:58:30.780 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:30.781 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:30.781 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:30.781 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:30.781 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:30.781 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=141 2024-03-26T16:58:30.781 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:30.782 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 142 2024-03-26T16:58:30.782 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:30.782 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:30.782 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:30.782 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:30.782 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:30.782 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=142 2024-03-26T16:58:30.783 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:30.783 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 143 2024-03-26T16:58:30.783 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:30.783 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:30.783 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:30.784 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:30.784 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:30.784 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=143 2024-03-26T16:58:30.784 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:30.784 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 144 2024-03-26T16:58:30.784 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:30.785 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:30.785 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:30.785 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:30.785 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:30.785 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=144 2024-03-26T16:58:30.785 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:30.786 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 145 2024-03-26T16:58:30.786 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:30.786 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:30.786 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:30.786 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:30.786 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:30.787 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=145 2024-03-26T16:58:30.787 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:30.787 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 146 2024-03-26T16:58:30.787 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:30.787 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:30.787 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:30.787 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:30.788 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:30.788 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=146 2024-03-26T16:58:30.788 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:30.788 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 147 2024-03-26T16:58:30.788 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:30.788 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:30.788 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:30.789 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:30.789 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:30.789 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=147 2024-03-26T16:58:30.789 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:30.789 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 148 2024-03-26T16:58:30.789 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:30.790 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:30.790 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:30.790 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:30.790 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:30.790 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=148 2024-03-26T16:58:30.790 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:30.791 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 149 2024-03-26T16:58:30.791 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:30.791 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:30.791 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:30.791 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:30.791 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:30.792 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=149 2024-03-26T16:58:30.792 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:30.792 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 150 2024-03-26T16:58:30.792 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:30.792 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:30.792 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:30.792 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:30.793 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:30.794 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=150 2024-03-26T16:58:30.794 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:30.794 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 151 2024-03-26T16:58:30.795 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:30.795 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:30.795 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:30.795 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:30.795 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:30.795 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=151 2024-03-26T16:58:30.796 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:30.796 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 152 2024-03-26T16:58:30.796 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:30.796 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:30.796 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:30.796 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:30.796 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:30.797 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=152 2024-03-26T16:58:30.797 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:30.797 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 153 2024-03-26T16:58:30.797 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:30.797 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:30.797 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:30.798 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:30.798 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:30.798 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=153 2024-03-26T16:58:30.798 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:30.798 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 154 2024-03-26T16:58:30.798 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:30.799 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:30.799 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:30.799 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:30.799 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:30.799 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=154 2024-03-26T16:58:30.799 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:30.800 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 155 2024-03-26T16:58:30.800 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:30.800 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:30.800 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:30.800 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:30.800 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:30.801 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=155 2024-03-26T16:58:30.801 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:30.801 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 156 2024-03-26T16:58:30.801 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:30.801 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:30.801 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:30.802 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:30.802 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:30.802 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=156 2024-03-26T16:58:30.802 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:30.802 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 157 2024-03-26T16:58:30.802 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:30.803 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:30.803 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:30.803 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:30.803 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:30.803 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=157 2024-03-26T16:58:30.803 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:30.803 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 158 2024-03-26T16:58:30.804 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:30.804 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:30.804 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:30.804 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:30.804 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:30.804 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=158 2024-03-26T16:58:30.804 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:30.805 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 159 2024-03-26T16:58:30.805 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:30.805 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:30.805 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:30.805 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:30.805 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:30.805 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=159 2024-03-26T16:58:30.805 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:30.806 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 160 2024-03-26T16:58:30.806 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:30.806 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:30.806 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:30.806 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:30.806 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:30.806 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=160 2024-03-26T16:58:30.896 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:58:30 smithi149 ceph-mon[34678]: pgmap v355: 33 pgs: 33 active+clean; 609 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 6.2 KiB/s rd, 682 B/s wr, 7 op/s 2024-03-26T16:58:30.896 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:58:30 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:58:30.896 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:58:30 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:58:31.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:31.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 161 2024-03-26T16:58:31.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:31.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:31.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:31.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:31.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:31.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=161 2024-03-26T16:58:31.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:31.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 162 2024-03-26T16:58:31.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:31.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:31.017 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:31.017 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:31.017 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:31.017 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=162 2024-03-26T16:58:31.017 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:31.017 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 163 2024-03-26T16:58:31.017 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:31.017 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:31.017 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:31.017 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:31.017 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:31.017 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=163 2024-03-26T16:58:31.017 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:31.018 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 164 2024-03-26T16:58:31.018 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:31.018 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:31.018 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:31.018 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:31.018 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:31.018 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=164 2024-03-26T16:58:31.019 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:31.019 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 165 2024-03-26T16:58:31.019 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:31.019 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:31.019 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:31.019 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:31.019 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:31.019 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=165 2024-03-26T16:58:31.019 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:31.019 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 166 2024-03-26T16:58:31.019 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:31.019 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:31.019 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:31.019 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:31.020 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:31.020 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=166 2024-03-26T16:58:31.020 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:31.020 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 167 2024-03-26T16:58:31.020 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:31.020 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:31.020 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:31.020 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:31.020 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:31.020 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=167 2024-03-26T16:58:31.020 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:31.020 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 168 2024-03-26T16:58:31.020 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:31.020 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:31.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:31.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:31.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:31.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=168 2024-03-26T16:58:31.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:31.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 169 2024-03-26T16:58:31.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:31.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:31.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:31.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:31.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:31.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=169 2024-03-26T16:58:31.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:31.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 170 2024-03-26T16:58:31.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:31.022 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:31.022 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:31.022 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:31.022 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:31.022 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=170 2024-03-26T16:58:31.022 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:31.022 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 171 2024-03-26T16:58:31.022 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:31.022 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:31.022 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:31.022 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:31.022 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:31.022 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=171 2024-03-26T16:58:31.022 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:31.023 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 172 2024-03-26T16:58:31.023 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:31.023 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:31.023 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:31.023 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:31.023 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:31.023 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=172 2024-03-26T16:58:31.023 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:31.023 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 173 2024-03-26T16:58:31.023 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:31.023 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:31.023 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:31.023 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:31.023 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:31.023 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=173 2024-03-26T16:58:31.024 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:31.025 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 174 2024-03-26T16:58:31.025 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:31.025 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:31.025 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:31.025 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:31.025 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:31.025 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=174 2024-03-26T16:58:31.025 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:31.025 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 175 2024-03-26T16:58:31.025 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:31.025 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:31.025 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:31.025 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:31.025 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:31.026 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=175 2024-03-26T16:58:31.026 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:31.026 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 176 2024-03-26T16:58:31.026 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:31.026 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:31.026 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:31.026 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:31.026 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:31.026 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=176 2024-03-26T16:58:31.026 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:31.026 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 177 2024-03-26T16:58:31.026 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:31.026 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:31.026 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:31.027 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:31.027 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:31.027 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=177 2024-03-26T16:58:31.027 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:31.027 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 178 2024-03-26T16:58:31.027 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:31.027 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:31.027 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:31.027 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:31.027 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:31.027 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=178 2024-03-26T16:58:31.027 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:31.027 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 179 2024-03-26T16:58:31.027 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:31.028 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:31.028 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:31.028 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:31.028 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:31.028 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=179 2024-03-26T16:58:31.028 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:31.028 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 180 2024-03-26T16:58:31.028 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:31.028 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:31.028 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:31.028 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:31.028 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:31.028 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=180 2024-03-26T16:58:31.028 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:31.028 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 181 2024-03-26T16:58:31.029 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:31.029 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:31.029 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:31.029 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:31.029 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:31.029 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=181 2024-03-26T16:58:31.029 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:31.029 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 182 2024-03-26T16:58:31.029 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:31.029 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:31.029 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:31.029 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:31.029 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:31.030 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=182 2024-03-26T16:58:31.030 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:31.030 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 183 2024-03-26T16:58:31.030 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:31.030 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:31.030 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:31.030 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:31.030 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:31.030 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=183 2024-03-26T16:58:31.030 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:31.030 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 184 2024-03-26T16:58:31.030 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:31.030 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:31.030 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:31.030 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:31.031 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:31.031 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=184 2024-03-26T16:58:31.031 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:31.031 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 185 2024-03-26T16:58:31.031 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:31.031 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:31.031 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:31.031 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:31.031 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:31.031 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=185 2024-03-26T16:58:31.031 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:31.031 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 186 2024-03-26T16:58:31.031 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:31.031 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:31.032 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:31.032 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:31.032 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:31.032 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=186 2024-03-26T16:58:31.032 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:31.032 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 187 2024-03-26T16:58:31.032 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:31.032 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:31.032 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:31.032 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:31.032 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:31.032 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=187 2024-03-26T16:58:31.032 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:31.032 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 188 2024-03-26T16:58:31.032 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:30] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:31.033 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:31.033 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:31.033 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:31.033 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:31.033 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=188 2024-03-26T16:58:31.033 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:31.033 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 189 2024-03-26T16:58:31.033 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:31.033 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:31.033 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:31.033 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:31.033 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:31.033 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=189 2024-03-26T16:58:31.033 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:31.033 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 190 2024-03-26T16:58:31.034 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:31.034 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:31.034 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:31.034 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:31.034 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:31.034 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=190 2024-03-26T16:58:31.034 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:31.034 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 191 2024-03-26T16:58:31.034 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:31.034 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:31.034 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:31.034 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:31.034 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:31.034 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=191 2024-03-26T16:58:31.055 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:58:30 smithi064 ceph-mon[34420]: pgmap v355: 33 pgs: 33 active+clean; 609 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 6.2 KiB/s rd, 682 B/s wr, 7 op/s 2024-03-26T16:58:31.055 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:58:30 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:58:31.055 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:58:30 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:58:31.056 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:30 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:30] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:58:31.056 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:30 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:30] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}] 2024-03-26T16:58:31.273 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:31.273 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 192 2024-03-26T16:58:31.273 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:31.274 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:31.274 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:31.274 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:31.274 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:31.274 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=192 2024-03-26T16:58:31.274 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:31.274 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 193 2024-03-26T16:58:31.274 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:31.274 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:31.274 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:31.274 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:31.274 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:31.274 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=193 2024-03-26T16:58:31.275 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:31.275 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 194 2024-03-26T16:58:31.275 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:31.275 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:31.275 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:31.275 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:31.275 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:31.275 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=194 2024-03-26T16:58:31.275 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:31.276 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 195 2024-03-26T16:58:31.276 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:31.276 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:31.276 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:31.276 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:31.276 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:31.276 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=195 2024-03-26T16:58:31.276 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:31.276 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 196 2024-03-26T16:58:31.276 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:31.276 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:31.276 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:31.276 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:31.277 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:31.277 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=196 2024-03-26T16:58:31.277 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:31.277 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 197 2024-03-26T16:58:31.277 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:31.277 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:31.277 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:31.277 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:31.277 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:31.277 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=197 2024-03-26T16:58:31.277 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:31.277 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 198 2024-03-26T16:58:31.277 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:31.278 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:31.278 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:31.278 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:31.278 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:31.278 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=198 2024-03-26T16:58:31.278 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:31.278 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 199 2024-03-26T16:58:31.278 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:31.278 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:31.278 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:31.278 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:31.278 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:31.278 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=199 2024-03-26T16:58:31.279 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:31.279 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 200 2024-03-26T16:58:31.279 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:31.279 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:31.279 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:31.279 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:31.279 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:31.279 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=200 2024-03-26T16:58:31.279 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:31.279 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 201 2024-03-26T16:58:31.279 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:31.279 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:31.279 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:31.279 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:31.280 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:31.280 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=201 2024-03-26T16:58:31.281 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:31.281 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 202 2024-03-26T16:58:31.281 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:31.281 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:31.281 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:31.281 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:31.281 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:31.281 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=202 2024-03-26T16:58:31.281 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:31.281 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 203 2024-03-26T16:58:31.281 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:31.281 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:31.281 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:31.281 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:31.282 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:31.282 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=203 2024-03-26T16:58:31.282 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:31.282 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 204 2024-03-26T16:58:31.282 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:31.282 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:31.282 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:31.282 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:31.282 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:31.282 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=204 2024-03-26T16:58:31.282 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:31.282 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 205 2024-03-26T16:58:31.283 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:31.283 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:31.283 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:31.283 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:31.283 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:31.283 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=205 2024-03-26T16:58:31.283 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:31.283 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 206 2024-03-26T16:58:31.283 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:31.283 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:31.283 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:31.283 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:31.283 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:31.283 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=206 2024-03-26T16:58:31.284 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:31.284 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 207 2024-03-26T16:58:31.284 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:31.284 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:31.284 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:31.284 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:31.284 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:31.284 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=207 2024-03-26T16:58:31.284 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:31.284 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 208 2024-03-26T16:58:31.284 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:31.284 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:31.284 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:31.284 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:31.285 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:31.285 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=208 2024-03-26T16:58:31.285 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:31.285 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 209 2024-03-26T16:58:31.285 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:31.285 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:31.285 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:31.285 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:31.285 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:31.285 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=209 2024-03-26T16:58:31.285 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:31.285 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 210 2024-03-26T16:58:31.285 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:31.285 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:31.286 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:31.286 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:31.286 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:31.286 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=210 2024-03-26T16:58:31.286 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:31.286 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 211 2024-03-26T16:58:31.286 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:31.286 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:31.286 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:31.286 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:31.286 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:31.286 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=211 2024-03-26T16:58:31.286 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:31.286 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 212 2024-03-26T16:58:31.287 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:31.287 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:31.287 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:31.287 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:31.287 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:31.287 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=212 2024-03-26T16:58:31.287 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:31.287 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 213 2024-03-26T16:58:31.289 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:31.289 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:31.289 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:31.289 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:31.290 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:31.290 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=213 2024-03-26T16:58:31.290 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:31.290 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 214 2024-03-26T16:58:31.290 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:31.290 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:31.290 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:31.290 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:31.290 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:31.290 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=214 2024-03-26T16:58:31.290 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:31.290 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 215 2024-03-26T16:58:31.290 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:31.291 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:31.291 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:31.291 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:31.291 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:31.291 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=215 2024-03-26T16:58:31.291 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:31.291 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 216 2024-03-26T16:58:31.291 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:31.291 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:31.291 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:31.291 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:31.291 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:31.291 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=216 2024-03-26T16:58:31.291 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:31.292 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 217 2024-03-26T16:58:31.292 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:31.292 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:31.292 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:31.292 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:31.292 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:31.292 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=217 2024-03-26T16:58:31.292 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:31.293 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 218 2024-03-26T16:58:31.293 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:31.293 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:31.293 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:31.293 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:31.293 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:31.293 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=218 2024-03-26T16:58:31.293 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:31.293 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 219 2024-03-26T16:58:31.293 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:31.294 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:31.294 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:31.294 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:31.294 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:31.294 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=219 2024-03-26T16:58:31.294 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:31.295 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 220 2024-03-26T16:58:31.295 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:31.295 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:31.295 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:31.295 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:31.295 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:31.296 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=220 2024-03-26T16:58:31.296 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:31.296 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 221 2024-03-26T16:58:31.296 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:31.296 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:31.296 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:31.297 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:31.297 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:31.297 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=221 2024-03-26T16:58:31.297 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:31.297 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 222 2024-03-26T16:58:31.298 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:31.298 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:31.298 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:31.298 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:31.298 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:31.298 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=222 2024-03-26T16:58:31.299 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:31.299 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 223 2024-03-26T16:58:31.299 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:31.299 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:31.299 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:31.299 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:31.300 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:31.300 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=223 2024-03-26T16:58:31.300 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:31.300 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 224 2024-03-26T16:58:31.300 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:31.300 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:31.300 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:31.301 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:31.301 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:31.301 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=224 2024-03-26T16:58:31.529 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:31.529 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 225 2024-03-26T16:58:31.529 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:31.529 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:31.529 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:31.529 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:31.529 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:31.529 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=225 2024-03-26T16:58:31.529 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:31.530 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 226 2024-03-26T16:58:31.530 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:31.530 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:31.530 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:31.530 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:31.530 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:31.530 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=226 2024-03-26T16:58:31.530 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:31.530 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 227 2024-03-26T16:58:31.530 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:31.530 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:31.530 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:31.530 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:31.530 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:31.531 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=227 2024-03-26T16:58:31.531 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:31.532 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 228 2024-03-26T16:58:31.532 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:31.532 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:31.532 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:31.532 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:31.532 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:31.532 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=228 2024-03-26T16:58:31.532 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:31.532 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 229 2024-03-26T16:58:31.533 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:31.533 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:31.533 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:31.533 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:31.533 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:31.533 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=229 2024-03-26T16:58:31.533 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:31.533 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 230 2024-03-26T16:58:31.533 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:31.533 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:31.533 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:31.533 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:31.534 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:31.534 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=230 2024-03-26T16:58:31.534 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:31.534 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 231 2024-03-26T16:58:31.534 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:31.534 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:31.534 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:31.534 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:31.534 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:31.534 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=231 2024-03-26T16:58:31.535 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:31.535 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 232 2024-03-26T16:58:31.535 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:31.535 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:31.535 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:31.535 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:31.535 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:31.535 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=232 2024-03-26T16:58:31.535 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:31.535 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 233 2024-03-26T16:58:31.535 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:31.535 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:31.535 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:31.535 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:31.536 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:31.536 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=233 2024-03-26T16:58:31.536 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:31.536 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 234 2024-03-26T16:58:31.536 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:31.536 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:31.536 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:31.536 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:31.536 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:31.536 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=234 2024-03-26T16:58:31.536 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:31.536 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 235 2024-03-26T16:58:31.536 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:31.536 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:31.537 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:31.537 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:31.537 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:31.537 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=235 2024-03-26T16:58:31.537 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:31.537 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 236 2024-03-26T16:58:31.537 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:31.537 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:31.537 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:31.537 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:31.537 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:31.537 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=236 2024-03-26T16:58:31.537 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:31.537 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 237 2024-03-26T16:58:31.537 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:31.538 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:31.538 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:31.538 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:31.538 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:31.538 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=237 2024-03-26T16:58:31.538 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:31.538 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 238 2024-03-26T16:58:31.538 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:31.538 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:31.538 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:31.538 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:31.538 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:31.538 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=238 2024-03-26T16:58:31.538 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:31.539 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 239 2024-03-26T16:58:31.539 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:31.539 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:31.539 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:31.539 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:31.539 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:31.539 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=239 2024-03-26T16:58:31.539 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:31.539 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 240 2024-03-26T16:58:31.539 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:31.539 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:31.539 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:31.539 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:31.539 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:31.539 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=240 2024-03-26T16:58:31.540 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:31.540 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 241 2024-03-26T16:58:31.540 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:31.540 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:31.540 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:31.540 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:31.540 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:31.540 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=241 2024-03-26T16:58:31.540 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:31.540 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 242 2024-03-26T16:58:31.540 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:31.540 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:31.540 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:31.540 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:31.541 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:31.541 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=242 2024-03-26T16:58:31.541 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:31.541 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 243 2024-03-26T16:58:31.541 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:31.541 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:31.541 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:31.541 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:31.541 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:31.541 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=243 2024-03-26T16:58:31.541 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:31.541 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 244 2024-03-26T16:58:31.541 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:31.541 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:31.542 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:31.542 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:31.542 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:31.542 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=244 2024-03-26T16:58:31.542 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:31.542 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 245 2024-03-26T16:58:31.542 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:31.542 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:31.542 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:31.542 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:31.542 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:31.542 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=245 2024-03-26T16:58:31.542 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:31.542 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 246 2024-03-26T16:58:31.543 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:31.543 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:31.543 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:31.543 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:31.543 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:31.543 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=246 2024-03-26T16:58:31.543 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:31.543 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 247 2024-03-26T16:58:31.543 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:31.543 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:31.543 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:31.543 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:31.543 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:31.544 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=247 2024-03-26T16:58:31.544 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:31.544 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 248 2024-03-26T16:58:31.544 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:31.544 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:31.544 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:31.545 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:31.545 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:31.545 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=248 2024-03-26T16:58:31.545 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:31.545 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 249 2024-03-26T16:58:31.545 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:31.545 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:31.545 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:31.545 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:31.545 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:31.545 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=249 2024-03-26T16:58:31.545 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:31.545 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 250 2024-03-26T16:58:31.545 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:31.545 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:31.546 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:31.546 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:31.546 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:31.546 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=250 2024-03-26T16:58:31.546 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:31.546 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 251 2024-03-26T16:58:31.546 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:31.546 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:31.546 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:31.546 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:31.546 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:31.546 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=251 2024-03-26T16:58:31.546 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:31.546 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 252 2024-03-26T16:58:31.547 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:31.547 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:31.547 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:31.547 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:31.547 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:31.547 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=252 2024-03-26T16:58:31.547 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:31.547 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 253 2024-03-26T16:58:31.547 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:31.547 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:31.547 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:31.547 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:31.547 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:31.547 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=253 2024-03-26T16:58:31.547 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:31.547 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 254 2024-03-26T16:58:31.548 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:31.548 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:31.548 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:31.548 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:31.548 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:31.548 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=254 2024-03-26T16:58:31.548 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:31.548 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 255 2024-03-26T16:58:31.548 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:31.548 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:31.548 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:31.548 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:31.548 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:31.549 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=255 2024-03-26T16:58:31.551 INFO:tasks.workunit.client.3.smithi157.stdout:Adding nqn.2016-06.io.spdk:cnode2 listener at 172.21.15.44:4420: Successful 2024-03-26T16:58:31.805 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:58:31 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T16:58:31.805 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:58:31 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-26T16:58:31.805 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:58:31 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:58:31.806 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:31 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:31] INFO grpc.py:1992: Received request to create smithi044 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode2 at 172.21.15.44:4420, context: None 2024-03-26T16:58:31.806 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:31 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:31] INFO grpc.py:2031: Listener not created as gateway's host name smithi064 differs from requested host smithi044 2024-03-26T16:58:31.896 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:58:31 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T16:58:31.896 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:58:31 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-26T16:58:31.897 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:58:31 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:58:31.897 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:31 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:31] INFO grpc.py:1992: Received request to create smithi044 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode2 at 172.21.15.44:4420, context: None 2024-03-26T16:58:31.897 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:31 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:31] INFO grpc.py:2031: Listener not created as gateway's host name smithi149 differs from requested host smithi044 2024-03-26T16:58:31.897 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:31 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:31] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:58:31.897 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:31 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:31] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}] 2024-03-26T16:58:32.015 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T16:58:32.015 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-26T16:58:32.015 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:58:32.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:32.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 256 2024-03-26T16:58:32.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:32.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:32.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:32.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:32.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:32.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=256 2024-03-26T16:58:32.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:32.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:58:32.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:31] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}] 2024-03-26T16:58:32.406 INFO:tasks.workunit.client.3.smithi157.stderr:+ for j in $(seq 1 $NVMEOF_SUBSYSTEMS_COUNT) 2024-03-26T16:58:32.406 INFO:tasks.workunit.client.3.smithi157.stdout:Adding gateway listener with IP 172.21.15.44 and name smithi044 2024-03-26T16:58:32.406 INFO:tasks.workunit.client.3.smithi157.stderr:+ subsystem_nqn=nqn.2016-06.io.spdk:cnode3 2024-03-26T16:58:32.406 INFO:tasks.workunit.client.3.smithi157.stderr:+ echo 'Adding gateway listener with IP 172.21.15.44 and name smithi044' 2024-03-26T16:58:32.407 INFO:tasks.workunit.client.3.smithi157.stderr:+ sudo podman run -it quay.io/barakda1/nvmeof-cli:qe_ceph_devel_21e59b2 --server-address 172.21.15.44 --server-port 5500 listener add --subsystem nqn.2016-06.io.spdk:cnode3 --host-name smithi044 --traddr 172.21.15.44 --trsvcid 4420 2024-03-26T16:58:32.488 INFO:tasks.workunit.client.3.smithi157.stderr:time="2024-03-26T16:58:32Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2024-03-26T16:58:32.896 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:58:32 smithi149 ceph-mon[34678]: pgmap v356: 33 pgs: 33 active+clean; 609 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 3.5 KiB/s rd, 341 B/s wr, 4 op/s 2024-03-26T16:58:33.015 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:58:32 smithi044 ceph-mon[30624]: pgmap v356: 33 pgs: 33 active+clean; 609 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 3.5 KiB/s rd, 341 B/s wr, 4 op/s 2024-03-26T16:58:33.055 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:58:32 smithi064 ceph-mon[34420]: pgmap v356: 33 pgs: 33 active+clean; 609 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 3.5 KiB/s rd, 341 B/s wr, 4 op/s 2024-03-26T16:58:33.056 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:32 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:32] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:58:33.056 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:32 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:32] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}] 2024-03-26T16:58:33.481 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:33] INFO grpc.py:1992: Received request to create smithi044 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode3 at 172.21.15.44:4420, context: 2024-03-26T16:58:33.481 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:33] INFO grpc.py:2023: create_listener: True 2024-03-26T16:58:33.481 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:33] INFO grpc.py:1958: Subsystem nqn.2016-06.io.spdk:cnode3 enable_ha: True 2024-03-26T16:58:33.481 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:33] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:33.481 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:33.481 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:33.481 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:33.481 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:33.481 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=1 2024-03-26T16:58:33.481 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:33] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:33.482 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:33] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:33.482 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:33.482 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:33.482 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:33.482 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:33.482 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=2 2024-03-26T16:58:33.482 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:33] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:33.482 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:33] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:33.482 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:33.482 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:33.482 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:33.482 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:33.482 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=3 2024-03-26T16:58:33.482 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:33] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:33.482 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:33] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:33.483 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:33.483 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:33.484 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:33.484 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:33.484 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=4 2024-03-26T16:58:33.484 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:33] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:33.484 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:33] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:33.484 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:33.484 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:33.484 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:33.484 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:33.484 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=5 2024-03-26T16:58:33.484 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:33] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:33.484 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:33] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:33.484 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:33.484 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:33.485 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:33.485 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:33.485 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=6 2024-03-26T16:58:33.485 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:33] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:33.485 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:33] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:33.485 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:33.485 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:33.485 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:33.485 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:33.485 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=7 2024-03-26T16:58:33.485 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:33] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:33.485 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:33] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:33.486 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:33.486 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:33.486 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:33.486 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:33.486 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=8 2024-03-26T16:58:33.486 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:33] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:33.486 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:33] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:33.486 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:33.486 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:33.486 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:33.486 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:33.486 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=9 2024-03-26T16:58:33.486 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:33] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:33.487 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:33] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:33.487 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:33.487 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:33.487 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:33.487 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:33.487 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=10 2024-03-26T16:58:33.487 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:33] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:33.487 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:33] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:33.487 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:33.487 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:33.487 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:33.487 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:33.487 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=11 2024-03-26T16:58:33.487 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:33] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:33.488 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:33] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:33.488 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:33.488 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:33.488 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:33.488 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:33.488 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=12 2024-03-26T16:58:33.488 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:33] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:33.488 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:33] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:33.488 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:33.488 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:33.488 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:33.488 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:33.488 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=13 2024-03-26T16:58:33.488 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:33] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:33.489 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:33] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:33.489 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:33.489 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:33.489 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:33.489 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:33.489 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=14 2024-03-26T16:58:33.489 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:33] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:33.489 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:33] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:33.489 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:33.489 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:33.489 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:33.489 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:33.489 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=15 2024-03-26T16:58:33.490 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:33] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:33.490 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:33] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:33.490 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:33.490 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:33.490 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:33.490 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:33.490 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=16 2024-03-26T16:58:33.490 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:33] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:33.490 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:33] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:33.490 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:33.490 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:33.490 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:33.490 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:33.491 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=17 2024-03-26T16:58:33.491 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:33] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:33.491 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:33] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:33.491 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:33.491 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:33.491 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:33.491 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:33.491 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=18 2024-03-26T16:58:33.491 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:33] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:33.491 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:33] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:33.491 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:33.491 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:33.491 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:33.491 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:33.491 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=19 2024-03-26T16:58:33.492 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:33] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:33.492 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:33] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:33.492 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:33.492 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:33.492 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:33.492 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:33.492 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=20 2024-03-26T16:58:33.492 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:33] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:33.492 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:33] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:33.492 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:33.492 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:33.492 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:33.492 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:33.492 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=21 2024-03-26T16:58:33.493 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:33] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:33.493 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:33] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:33.493 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:33.493 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:33.493 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:33.493 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:33.493 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=22 2024-03-26T16:58:33.493 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:33] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:33.493 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:33] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:33.493 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:33.493 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:33.493 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:33.493 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:33.493 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=23 2024-03-26T16:58:33.494 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:33] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:33.494 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:33] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:33.494 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:33.494 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:33.494 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:33.494 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:33.494 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=24 2024-03-26T16:58:33.494 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:33] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:33.495 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:33] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:33.495 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:33.495 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:33.495 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:33.495 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:33.495 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=25 2024-03-26T16:58:33.495 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:33] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:33.495 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:33] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:33.495 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:33.495 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:33.495 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:33.495 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:33.495 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=26 2024-03-26T16:58:33.495 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:33] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:33.496 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:33] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:33.496 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:33.496 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:33.496 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:33.496 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:33.496 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=27 2024-03-26T16:58:33.496 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:33] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:33.496 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:33] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:33.496 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:33.496 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:33.496 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:33.496 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:33.496 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=28 2024-03-26T16:58:33.496 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:33] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:33.496 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:33] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:33.497 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:33.497 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:33.497 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:33.497 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:33.497 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=29 2024-03-26T16:58:33.497 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:33] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:33.497 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:33] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:33.497 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:33.497 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:33.497 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:33.497 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:33.497 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=30 2024-03-26T16:58:33.497 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:33] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:33.497 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:33] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:33.498 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:33.498 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:33.498 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:33.498 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:33.498 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=31 2024-03-26T16:58:33.498 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:33] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:33.498 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:33] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:33.498 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:33.498 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:33.498 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:33.498 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:33.498 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=32 2024-03-26T16:58:33.738 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:33] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:33.738 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:33] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:33.739 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:33.739 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:33.739 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:33.739 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:33.739 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=33 2024-03-26T16:58:33.739 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:33] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:33.739 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:33] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:33.739 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:33.739 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:33.739 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:33.739 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:33.739 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=34 2024-03-26T16:58:33.739 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:33] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:33.740 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:33] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:33.740 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:33.740 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:33.740 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:33.740 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:33.740 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=35 2024-03-26T16:58:33.740 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:33] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:33.740 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:33] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:33.740 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:33.740 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:33.740 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:33.740 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:33.740 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=36 2024-03-26T16:58:33.740 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:33] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:33.741 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:33] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:33.741 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:33.741 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:33.741 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:33.741 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:33.741 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=37 2024-03-26T16:58:33.741 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:33] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:33.741 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:33] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:33.741 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:33.741 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:33.741 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:33.741 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:33.741 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=38 2024-03-26T16:58:33.741 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:33] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:33.742 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:33] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:33.742 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:33.742 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:33.742 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:33.742 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:33.742 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=39 2024-03-26T16:58:33.742 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:33] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:33.742 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:33] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:33.742 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:33.742 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:33.742 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:33.742 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:33.742 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=40 2024-03-26T16:58:33.742 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:33] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:33.743 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:33] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:33.743 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:33.743 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:33.743 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:33.743 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:33.743 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=41 2024-03-26T16:58:33.743 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:33] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:33.743 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:33] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:33.743 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:33.744 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:33.744 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:33.744 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:33.744 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=42 2024-03-26T16:58:33.744 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:33] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:33.744 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:33] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:33.744 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:33.744 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:33.744 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:33.744 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:33.744 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=43 2024-03-26T16:58:33.744 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:33] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:33.745 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:33] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:33.745 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:33.745 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:33.745 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:33.745 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:33.745 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=44 2024-03-26T16:58:33.745 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:33] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:33.745 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:33] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:33.745 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:33.745 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:33.745 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:33.745 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:33.745 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=45 2024-03-26T16:58:33.745 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:33] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:33.746 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:33] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:33.746 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:33.746 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:33.746 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:33.746 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:33.746 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=46 2024-03-26T16:58:33.746 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:33] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:33.746 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:33] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:33.746 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:33.746 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:33.746 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:33.746 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:33.746 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=47 2024-03-26T16:58:33.746 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:33] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:33.746 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:33] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:33.747 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:33.747 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:33.747 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:33.747 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:33.747 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=48 2024-03-26T16:58:33.747 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:33] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:33.748 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:33] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:33.748 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:33.748 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:33.748 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:33.748 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:33.748 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=49 2024-03-26T16:58:33.748 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:33] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:33.748 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:33] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:33.748 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:33.749 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:33.749 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:33.749 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:33.749 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=50 2024-03-26T16:58:33.749 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:33] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:33.749 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:33] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:33.749 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:33.749 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:33.749 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:33.749 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:33.749 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=51 2024-03-26T16:58:33.749 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:33] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:33.749 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:33] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:33.749 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:33.750 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:33.750 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:33.750 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:33.750 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=52 2024-03-26T16:58:33.750 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:33] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:33.750 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:33] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:33.750 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:33.750 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:33.750 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:33.750 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:33.750 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=53 2024-03-26T16:58:33.750 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:33] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:33.750 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:33] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:33.751 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:33.751 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:33.751 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:33.751 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:33.751 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=54 2024-03-26T16:58:33.751 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:33] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:33.751 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:33] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:33.751 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:33.751 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:33.751 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:33.751 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:33.751 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=55 2024-03-26T16:58:33.751 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:33] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:33.751 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:33] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:33.752 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:33.752 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:33.752 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:33.752 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:33.752 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=56 2024-03-26T16:58:33.752 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:33] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:33.752 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:33] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:33.752 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:33.752 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:33.752 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:33.752 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:33.752 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=57 2024-03-26T16:58:33.752 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:33] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:33.752 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:33] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:33.753 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:33.753 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:33.753 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:33.753 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:33.753 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=58 2024-03-26T16:58:33.753 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:33] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:33.753 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:33] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:33.753 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:33.753 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:33.753 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:33.753 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:33.753 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=59 2024-03-26T16:58:33.753 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:33] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:33.753 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:33] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:33.754 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:33.754 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:33.754 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:33.754 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:33.754 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=60 2024-03-26T16:58:33.754 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:33] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:33.754 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:33] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:33.754 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:33.754 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:33.754 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:33.754 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:33.754 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=61 2024-03-26T16:58:33.754 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:33] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:33.755 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:33] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:33.755 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:33.755 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:33.755 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:33.755 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:33.755 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=62 2024-03-26T16:58:33.755 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:33] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:33.755 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:33] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:33.755 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:33.755 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:33.755 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:33.755 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:33.755 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=63 2024-03-26T16:58:33.755 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:33] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:33.755 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:33] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:33.756 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:33.756 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:33.756 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:33.756 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:33.756 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=64 2024-03-26T16:58:34.001 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:33] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:34.001 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:33] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:34.001 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:34.002 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:34.002 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:34.002 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:34.002 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=65 2024-03-26T16:58:34.002 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:33] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:34.002 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:33] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:34.002 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:34.002 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:34.002 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:34.002 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:34.002 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=66 2024-03-26T16:58:34.002 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:33] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:34.003 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:33] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:34.003 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:34.003 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:34.003 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:34.003 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:34.003 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=67 2024-03-26T16:58:34.003 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:33] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:34.003 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:33] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:34.003 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:34.003 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:34.003 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:34.003 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:34.004 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=68 2024-03-26T16:58:34.004 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:33] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:34.004 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:33] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:34.004 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:34.004 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:34.004 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:34.004 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:34.004 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=69 2024-03-26T16:58:34.004 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:33] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:34.004 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:33] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:34.004 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:34.004 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:34.004 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:34.005 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:34.005 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=70 2024-03-26T16:58:34.005 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:33] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:34.005 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:33] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:34.005 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:34.005 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:34.005 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:34.005 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:34.005 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=71 2024-03-26T16:58:34.006 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:33] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:34.006 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:33] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:34.006 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:34.006 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:34.006 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:34.006 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:34.006 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=72 2024-03-26T16:58:34.007 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:33] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:34.007 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:33] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:34.007 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:34.007 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:34.007 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:34.007 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:34.007 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=73 2024-03-26T16:58:34.008 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:33] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:34.008 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:33] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:34.008 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:34.008 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:34.008 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:34.008 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:34.008 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=74 2024-03-26T16:58:34.008 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:33] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:34.008 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:33] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:34.008 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:34.008 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:34.008 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:34.008 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:34.008 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=75 2024-03-26T16:58:34.009 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:33] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:34.009 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:33] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:34.009 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:34.009 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:34.009 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:34.009 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:34.009 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=76 2024-03-26T16:58:34.010 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:33] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:34.010 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:33] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:34.010 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:34.010 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:34.010 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:34.010 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:34.011 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=77 2024-03-26T16:58:34.011 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:33] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:34.011 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:33] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:34.011 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:34.011 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:34.011 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:34.011 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:34.011 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=78 2024-03-26T16:58:34.011 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:33] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:34.011 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:33] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:34.011 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:34.011 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:34.011 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:34.012 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:34.012 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=79 2024-03-26T16:58:34.012 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:33] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:34.012 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:33] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:34.012 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:34.012 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:34.012 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:34.012 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:34.012 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=80 2024-03-26T16:58:34.012 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:33] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:34.012 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:33] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:34.013 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:34.013 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:34.013 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:34.013 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:34.013 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=81 2024-03-26T16:58:34.013 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:33] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:34.013 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:33] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:34.013 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:34.013 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:34.013 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:34.013 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:34.013 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=82 2024-03-26T16:58:34.013 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:33] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:34.013 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:33] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:34.014 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:34.014 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:34.014 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:34.014 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:34.014 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=83 2024-03-26T16:58:34.014 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:33] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:34.014 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:33] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:34.014 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:34.014 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:34.014 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:34.014 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:34.014 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=84 2024-03-26T16:58:34.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:33] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:34.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:33] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:34.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:34.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:34.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:34.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:34.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=85 2024-03-26T16:58:34.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:33] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:34.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:33] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:34.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:34.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:34.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:34.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:34.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=86 2024-03-26T16:58:34.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:33] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:34.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:33] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:34.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:34.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:34.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:34.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:34.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=87 2024-03-26T16:58:34.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:33] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:34.017 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:33] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:34.017 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:34.017 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:34.017 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:34.017 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:34.017 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=88 2024-03-26T16:58:34.017 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:33] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:34.017 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:33] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:34.017 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:34.017 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:34.017 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:34.017 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:34.017 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=89 2024-03-26T16:58:34.018 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:33] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:34.018 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:33] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:34.018 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:34.018 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:34.018 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:34.018 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:34.018 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=90 2024-03-26T16:58:34.018 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:33] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:34.018 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:33] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:34.018 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:34.018 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:34.019 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:34.019 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:34.019 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=91 2024-03-26T16:58:34.019 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:33] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:34.019 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:33] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:34.019 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:34.019 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:34.019 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:34.019 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:34.019 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=92 2024-03-26T16:58:34.019 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:33] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:34.019 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:33] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:34.019 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:34.019 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:34.020 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:34.020 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:34.020 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=93 2024-03-26T16:58:34.020 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:33] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:34.020 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:33] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:34.020 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:34.020 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:34.020 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:34.020 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:34.020 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=94 2024-03-26T16:58:34.020 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:33] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:34.020 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:33] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:34.020 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:34.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:34.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:34.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:34.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=95 2024-03-26T16:58:34.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:33] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:34.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:33] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:34.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:34.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:34.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:34.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:34.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=96 2024-03-26T16:58:34.147 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:33 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:33] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:58:34.147 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:33 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:33] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}] 2024-03-26T16:58:34.248 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-mon[30624]: pgmap v357: 33 pgs: 33 active+clean; 609 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 4.9 KiB/s rd, 511 B/s wr, 6 op/s 2024-03-26T16:58:34.252 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:34.252 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:34.252 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:34.252 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:34.253 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:34.253 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:34.253 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=97 2024-03-26T16:58:34.253 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:34.253 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:34.253 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:34.253 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:34.254 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:34.254 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:34.254 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=98 2024-03-26T16:58:34.254 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:34.254 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:34.254 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:34.254 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:34.254 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:34.255 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:34.255 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=99 2024-03-26T16:58:34.255 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:34.255 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:34.255 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:34.255 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:34.255 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:34.255 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:34.256 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=100 2024-03-26T16:58:34.257 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:34.258 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:34.258 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:34.258 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:34.258 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:34.258 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:34.258 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=101 2024-03-26T16:58:34.258 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:34.258 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:34.258 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:34.259 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:34.259 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:34.259 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:34.259 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=102 2024-03-26T16:58:34.259 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:34.259 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:34.259 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:34.259 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:34.259 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:34.260 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:34.260 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=103 2024-03-26T16:58:34.260 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:34.260 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:34.260 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:34.260 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:34.260 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:34.261 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:34.261 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=104 2024-03-26T16:58:34.261 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:34.261 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:34.261 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:34.261 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:34.261 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:34.261 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:34.262 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=105 2024-03-26T16:58:34.262 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:34.262 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:34.262 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:34.262 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:34.262 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:34.262 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:34.262 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=106 2024-03-26T16:58:34.262 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:34.262 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:34.262 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:34.263 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:34.263 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:34.263 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:34.263 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=107 2024-03-26T16:58:34.263 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:34.263 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:34.263 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:34.263 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:34.263 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:34.263 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:34.264 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=108 2024-03-26T16:58:34.264 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:34.264 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:34.264 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:34.264 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:34.264 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:34.264 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:34.264 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=109 2024-03-26T16:58:34.264 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:34.264 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:34.264 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:34.265 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:34.265 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:34.265 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:34.265 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=110 2024-03-26T16:58:34.265 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:34.265 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:34.265 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:34.265 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:34.265 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:34.265 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:34.265 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=111 2024-03-26T16:58:34.266 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:34.266 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:34.266 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:34.266 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:34.266 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:34.266 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:34.266 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=112 2024-03-26T16:58:34.266 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:34.266 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:34.267 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:34.267 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:34.267 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:34.267 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:34.267 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=113 2024-03-26T16:58:34.267 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:34.267 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:34.267 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:34.267 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:34.267 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:34.268 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:34.268 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=114 2024-03-26T16:58:34.268 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:34.268 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:34.268 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:34.268 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:34.268 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:34.268 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:34.269 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=115 2024-03-26T16:58:34.269 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:34.269 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:34.269 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:34.269 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:34.269 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:34.269 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:34.269 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=116 2024-03-26T16:58:34.269 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:34.270 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:34.270 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:34.270 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:34.270 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:34.270 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:34.270 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=117 2024-03-26T16:58:34.270 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:34.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:34.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:34.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:34.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:34.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:34.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=118 2024-03-26T16:58:34.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:34.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:34.271 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:34.272 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:34.272 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:34.272 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:34.272 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=119 2024-03-26T16:58:34.272 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:34.272 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:34.272 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:34.272 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:34.272 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:34.273 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:34.273 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=120 2024-03-26T16:58:34.273 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:34.273 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:34.273 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:34.273 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:34.273 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:34.274 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:34.274 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=121 2024-03-26T16:58:34.274 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:34.274 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:34.274 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:34.274 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:34.274 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:34.275 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:34.275 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=122 2024-03-26T16:58:34.275 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:34.275 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:34.275 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:34.275 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:34.275 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:34.275 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:34.275 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=123 2024-03-26T16:58:34.275 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:34.276 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:34.276 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:34.276 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:34.276 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:34.276 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:34.276 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=124 2024-03-26T16:58:34.276 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:34.276 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:34.276 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:34.277 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:34.277 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:34.277 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:34.277 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=125 2024-03-26T16:58:34.277 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:34.277 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:34.277 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:34.277 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:34.277 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:34.277 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:34.278 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=126 2024-03-26T16:58:34.278 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:34.278 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:34.278 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:34.278 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:34.278 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:34.278 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:34.278 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=127 2024-03-26T16:58:34.279 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:34.279 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:34.279 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:34.279 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:34.279 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:34.279 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:34.279 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=128 2024-03-26T16:58:34.505 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:34.505 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:34.505 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:34.505 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:34.505 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:34.505 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:34.506 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=129 2024-03-26T16:58:34.506 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:34.506 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:34.506 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:34.506 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:34.506 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:34.506 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:34.506 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=130 2024-03-26T16:58:34.506 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:34.506 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:34.506 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:34.506 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:34.506 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:34.506 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:34.506 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=131 2024-03-26T16:58:34.507 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:34.507 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:34.507 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:34.507 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:34.507 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:34.507 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:34.507 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=132 2024-03-26T16:58:34.508 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:34.508 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:34.508 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:34.508 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:34.508 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:34.508 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:34.508 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=133 2024-03-26T16:58:34.509 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:34.509 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:34.509 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:34.509 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:34.509 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:34.509 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:34.509 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=134 2024-03-26T16:58:34.509 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:34.509 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:34.509 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:34.509 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:34.509 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:34.509 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:34.509 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=135 2024-03-26T16:58:34.510 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:34.510 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:34.510 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:34.510 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:34.510 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:34.510 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:34.510 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=136 2024-03-26T16:58:34.510 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:34.510 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:34.510 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:34.510 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:34.510 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:34.510 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:34.511 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=137 2024-03-26T16:58:34.511 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:34.511 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:34.511 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:34.511 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:34.511 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:34.511 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:34.511 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=138 2024-03-26T16:58:34.511 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:34.511 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:34.511 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:34.511 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:34.511 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:34.511 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:34.511 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=139 2024-03-26T16:58:34.512 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:34.512 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:34.512 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:34.512 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:34.512 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:34.512 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:34.512 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=140 2024-03-26T16:58:34.512 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:34.512 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:34.512 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:34.512 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:34.512 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:34.512 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:34.513 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=141 2024-03-26T16:58:34.513 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:34.513 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:34.513 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:34.513 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:34.513 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:34.513 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:34.513 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=142 2024-03-26T16:58:34.513 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:34.513 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:34.513 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:34.513 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:34.513 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:34.513 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:34.514 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=143 2024-03-26T16:58:34.514 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:34.514 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:34.514 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:34.514 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:34.514 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:34.514 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:34.514 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=144 2024-03-26T16:58:34.514 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:34.514 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:34.514 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:34.514 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:34.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:34.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:34.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=145 2024-03-26T16:58:34.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:34.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:34.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:34.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:34.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:34.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:34.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=146 2024-03-26T16:58:34.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:34.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:34.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:34.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:34.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:34.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:34.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=147 2024-03-26T16:58:34.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:34.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:34.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:34.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:34.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:34.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:34.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=148 2024-03-26T16:58:34.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:34.517 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:34.517 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:34.517 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:34.517 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:34.517 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:34.517 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=149 2024-03-26T16:58:34.517 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:34.517 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:34.518 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:34.518 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:34.518 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:34.518 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:34.518 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=150 2024-03-26T16:58:34.518 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:34.518 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:34.518 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:34.518 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:34.518 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:34.518 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:34.518 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=151 2024-03-26T16:58:34.518 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:34.519 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:34.519 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:34.519 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:34.519 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:34.519 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:34.519 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=152 2024-03-26T16:58:34.519 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:34.519 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:34.519 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:34.519 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:34.519 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:34.519 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:34.519 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=153 2024-03-26T16:58:34.519 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:34.519 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:34.520 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:34.520 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:34.520 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:34.520 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:34.520 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=154 2024-03-26T16:58:34.520 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:34.520 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:34.520 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:34.520 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:34.520 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:34.520 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:34.520 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=155 2024-03-26T16:58:34.520 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:34.520 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:34.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:34.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:34.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:34.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:34.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=156 2024-03-26T16:58:34.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:34.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:34.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:34.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:34.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:34.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:34.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=157 2024-03-26T16:58:34.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:34.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:34.521 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:34.522 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:34.522 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:34.522 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:34.522 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=158 2024-03-26T16:58:34.522 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:34.522 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:34.522 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:34.522 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:34.522 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:34.522 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:34.522 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=159 2024-03-26T16:58:34.522 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:34.522 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:34.522 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:34.522 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:34.523 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:34.523 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:34.523 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=160 2024-03-26T16:58:34.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:58:34 smithi064 ceph-mon[34420]: pgmap v357: 33 pgs: 33 active+clean; 609 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 4.9 KiB/s rd, 511 B/s wr, 6 op/s 2024-03-26T16:58:34.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:58:34 smithi149 ceph-mon[34678]: pgmap v357: 33 pgs: 33 active+clean; 609 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 4.9 KiB/s rd, 511 B/s wr, 6 op/s 2024-03-26T16:58:34.761 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:34.761 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:34.761 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:34.761 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:34.761 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:34.761 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:34.761 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=161 2024-03-26T16:58:34.761 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:34.761 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:34.762 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:34.762 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:34.762 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:34.762 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:34.762 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=162 2024-03-26T16:58:34.762 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:34.762 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:34.762 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:34.762 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:34.762 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:34.762 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:34.762 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=163 2024-03-26T16:58:34.762 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:34.763 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:34.763 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:34.763 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:34.763 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:34.763 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:34.763 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=164 2024-03-26T16:58:34.764 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:34.764 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:34.764 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:34.764 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:34.764 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:34.764 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:34.764 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=165 2024-03-26T16:58:34.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:34.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:34.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:34.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:34.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:34.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:34.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=166 2024-03-26T16:58:34.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:34.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:34.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:34.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:34.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:34.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:34.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=167 2024-03-26T16:58:34.766 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:34.766 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:34.766 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:34.766 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:34.766 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:34.766 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:34.766 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=168 2024-03-26T16:58:34.766 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:34.766 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:34.766 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:34.766 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:34.766 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:34.766 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:34.767 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=169 2024-03-26T16:58:34.767 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:34.767 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:34.767 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:34.767 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:34.767 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:34.767 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:34.767 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=170 2024-03-26T16:58:34.767 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:34.767 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:34.767 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:34.767 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:34.767 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:34.767 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:34.767 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=171 2024-03-26T16:58:34.767 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:34.768 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:34.768 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:34.768 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:34.768 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:34.768 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:34.768 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=172 2024-03-26T16:58:34.768 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:34.768 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:34.768 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:34.768 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:34.768 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:34.768 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:34.768 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=173 2024-03-26T16:58:34.768 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:34.768 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:34.769 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:34.769 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:34.769 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:34.769 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:34.769 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=174 2024-03-26T16:58:34.769 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:34.769 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:34.769 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:34.769 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:34.769 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:34.769 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:34.769 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=175 2024-03-26T16:58:34.769 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:34.769 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:34.770 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:34.770 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:34.770 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:34.770 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:34.770 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=176 2024-03-26T16:58:34.770 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:34.770 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:34.770 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:34.770 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:34.770 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:34.770 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:34.770 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=177 2024-03-26T16:58:34.770 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:34.770 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:34.770 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:34.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:34.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:34.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:34.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=178 2024-03-26T16:58:34.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:34.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:34.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:34.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:34.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:34.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:34.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=179 2024-03-26T16:58:34.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:34.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:34.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:34.771 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:34.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:34.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:34.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=180 2024-03-26T16:58:34.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:34.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:34.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:34.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:34.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:34.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:34.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=181 2024-03-26T16:58:34.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:34.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:34.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:34.772 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:34.773 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:34.773 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:34.773 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=182 2024-03-26T16:58:34.773 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:34.773 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:34.773 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:34.773 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:34.773 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:34.773 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:34.773 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=183 2024-03-26T16:58:34.773 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:34.773 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:34.773 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:34.774 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:34.774 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:34.774 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:34.774 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=184 2024-03-26T16:58:34.774 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:34.775 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:34.775 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:34.775 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:34.775 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:34.775 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:34.775 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=185 2024-03-26T16:58:34.775 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:34.775 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:34.775 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:34.775 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:34.775 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:34.775 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:34.775 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=186 2024-03-26T16:58:34.775 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:34.776 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:34.776 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:34.776 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:34.776 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:34.776 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:34.776 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=187 2024-03-26T16:58:34.776 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:34.776 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:34.776 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:34.776 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:34.776 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:34.776 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:34.776 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=188 2024-03-26T16:58:34.776 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:34.776 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:34.777 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:34.777 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:34.777 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:34.777 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:34.777 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=189 2024-03-26T16:58:34.777 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:34.777 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:34.777 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:34.777 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:34.777 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:34.777 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:34.777 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=190 2024-03-26T16:58:34.777 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:34.777 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:34.777 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:34.777 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:34.778 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:34.778 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:34.778 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=191 2024-03-26T16:58:34.778 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:34.778 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:34.778 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:34.778 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:34.778 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:34.778 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:34.778 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=192 2024-03-26T16:58:35.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:35.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:35.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:35.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:35.017 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:35.017 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:35.017 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=193 2024-03-26T16:58:35.017 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:35.017 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:35.017 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:35.017 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:35.017 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:35.017 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:35.017 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=194 2024-03-26T16:58:35.017 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:35.017 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:35.018 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:35.018 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:35.018 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:35.018 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:35.018 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=195 2024-03-26T16:58:35.018 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:35.018 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:35.018 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:35.018 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:35.018 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:35.019 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:35.019 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=196 2024-03-26T16:58:35.019 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:35.020 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:35.020 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:35.020 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:35.020 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:35.020 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:35.020 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=197 2024-03-26T16:58:35.020 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:35.020 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:35.020 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:35.020 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:35.020 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:35.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:35.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=198 2024-03-26T16:58:35.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:35.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:35.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:35.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:35.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:35.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:35.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=199 2024-03-26T16:58:35.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:35.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:35.021 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:35.022 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:35.022 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:35.022 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:35.022 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=200 2024-03-26T16:58:35.022 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:35.022 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:35.022 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:35.022 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:35.022 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:35.022 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:35.022 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=201 2024-03-26T16:58:35.022 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:35.022 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:35.022 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:35.023 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:35.023 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:35.023 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:35.023 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=202 2024-03-26T16:58:35.023 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:35.023 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:35.023 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:35.023 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:35.023 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:35.023 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:35.023 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=203 2024-03-26T16:58:35.023 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:35.023 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:35.024 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:35.024 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:35.024 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:35.024 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:35.024 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=204 2024-03-26T16:58:35.024 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:35.024 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:35.024 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:35.024 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:35.024 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:35.024 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:35.025 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=205 2024-03-26T16:58:35.025 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:35.025 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:35.025 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:35.025 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:35.025 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:35.025 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:35.025 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=206 2024-03-26T16:58:35.025 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:35.025 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:35.025 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:35.025 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:35.026 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:35.026 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:35.026 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=207 2024-03-26T16:58:35.026 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:35.026 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:35.026 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:35.026 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:35.026 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:35.026 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:35.026 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=208 2024-03-26T16:58:35.026 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:35.028 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:35.028 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:35.028 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:35.028 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:35.028 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:35.028 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=209 2024-03-26T16:58:35.028 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:35.028 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:35.028 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:35.028 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:35.029 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:35.029 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:35.029 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=210 2024-03-26T16:58:35.029 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:35.029 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:35.029 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:35.029 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:35.029 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:35.029 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:35.029 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=211 2024-03-26T16:58:35.029 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:35.030 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:35.030 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:35.030 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:35.030 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:35.030 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:35.030 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=212 2024-03-26T16:58:35.030 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:35.030 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:35.030 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:35.030 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:35.031 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:35.031 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:35.031 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=213 2024-03-26T16:58:35.031 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:35.031 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:35.031 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:35.031 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:35.031 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:35.031 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:35.031 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=214 2024-03-26T16:58:35.031 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:35.031 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:35.031 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:35.032 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:35.032 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:35.032 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:35.032 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=215 2024-03-26T16:58:35.032 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:35.032 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:35.032 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:35.032 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:35.032 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:35.032 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:35.032 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=216 2024-03-26T16:58:35.032 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:35.032 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:35.032 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:35.033 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:35.033 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:35.033 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:35.033 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=217 2024-03-26T16:58:35.033 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:35.033 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:35.033 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:35.033 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:35.033 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:35.033 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:35.033 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=218 2024-03-26T16:58:35.033 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:35.033 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:35.033 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:35.033 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:35.034 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:35.034 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:35.034 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=219 2024-03-26T16:58:35.034 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:35.034 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:35.034 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:35.034 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:35.034 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:35.034 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:35.034 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=220 2024-03-26T16:58:35.034 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:35.034 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:34] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:35.034 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:35.035 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:35.035 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:35.035 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:35.035 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=221 2024-03-26T16:58:35.035 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:35] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:35.035 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:35] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:35.035 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:35.035 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:35.035 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:35.035 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:35.035 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=222 2024-03-26T16:58:35.035 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:35] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:35.035 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:35] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:35.035 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:35.035 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:35.036 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:35.036 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:35.036 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=223 2024-03-26T16:58:35.036 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:35] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:35.036 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:35] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:35.036 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:35.036 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:35.036 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:35.036 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:35.036 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=224 2024-03-26T16:58:35.055 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:34 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:34] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:58:35.055 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:34 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:34] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}] 2024-03-26T16:58:35.273 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:35] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:35.273 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:35] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:35.273 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:35.273 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:35.273 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:35.273 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:35.273 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=225 2024-03-26T16:58:35.273 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:35] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:35.273 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:35] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:35.274 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:35.274 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:35.274 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:35.274 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:35.274 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=226 2024-03-26T16:58:35.274 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:35] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:35.274 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:35] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:35.274 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:35.274 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:35.274 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:35.274 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:35.274 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=227 2024-03-26T16:58:35.274 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:35] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:35.274 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:35] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:35.274 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:35.275 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:35.275 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:35.275 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:35.275 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=228 2024-03-26T16:58:35.276 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:35] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:35.276 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:35] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:35.276 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:35.276 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:35.276 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:35.276 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:35.276 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=229 2024-03-26T16:58:35.276 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:35] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:35.276 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:35] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:35.276 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:35.276 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:35.276 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:35.276 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:35.277 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=230 2024-03-26T16:58:35.277 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:35] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:35.277 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:35] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:35.277 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:35.277 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:35.277 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:35.277 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:35.277 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=231 2024-03-26T16:58:35.277 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:35] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:35.277 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:35] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:35.277 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:35.277 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:35.277 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:35.277 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:35.278 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=232 2024-03-26T16:58:35.278 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:35] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:35.278 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:35] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:35.278 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:35.278 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:35.278 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:35.278 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:35.278 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=233 2024-03-26T16:58:35.278 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:35] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:35.278 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:35] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:35.278 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:35.278 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:35.278 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:35.278 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:35.279 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=234 2024-03-26T16:58:35.279 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:35] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:35.279 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:35] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:35.279 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:35.279 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:35.279 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:35.279 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:35.279 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=235 2024-03-26T16:58:35.279 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:35] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:35.279 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:35] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:35.279 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:35.279 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:35.280 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:35.280 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:35.280 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=236 2024-03-26T16:58:35.280 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:35] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:35.280 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:35] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:35.280 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:35.280 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:35.280 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:35.280 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:35.280 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=237 2024-03-26T16:58:35.280 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:35] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:35.280 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:35] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:35.280 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:35.280 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:35.281 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:35.281 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:35.281 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=238 2024-03-26T16:58:35.281 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:35] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:35.281 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:35] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:35.281 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:35.281 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:35.281 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:35.281 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:35.281 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=239 2024-03-26T16:58:35.281 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:35] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:35.281 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:35] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:35.281 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:35.281 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:35.281 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:35.282 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:35.282 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=240 2024-03-26T16:58:35.282 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:35] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:35.282 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:35] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:35.282 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:35.282 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:35.282 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:35.282 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:35.282 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=241 2024-03-26T16:58:35.282 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:35] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:35.282 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:35] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:35.282 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:35.282 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:35.282 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:35.283 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:35.283 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=242 2024-03-26T16:58:35.283 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:35] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:35.283 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:35] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:35.283 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:35.283 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:35.283 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:35.283 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:35.283 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=243 2024-03-26T16:58:35.283 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:35] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:35.283 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:35] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:35.283 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:35.283 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:35.283 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:35.283 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:35.284 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=244 2024-03-26T16:58:35.284 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:35] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:35.284 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:35] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:35.284 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:35.284 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:35.284 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:35.284 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:35.284 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=245 2024-03-26T16:58:35.284 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:35] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:35.284 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:35] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:35.285 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:35.285 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:35.285 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:35.285 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:35.285 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=246 2024-03-26T16:58:35.285 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:35] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:35.285 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:35] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:35.285 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:35.285 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:35.285 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:35.285 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:35.285 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=247 2024-03-26T16:58:35.285 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:35] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:35.285 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:35] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:35.286 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:35.286 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:35.286 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:35.286 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:35.286 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=248 2024-03-26T16:58:35.286 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:35] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:35.286 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:35] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:35.287 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:35.287 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:35.287 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:35.287 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:35.287 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=249 2024-03-26T16:58:35.287 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:35] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:35.287 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:35] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:35.287 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:35.287 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:35.287 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:35.287 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:35.287 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=250 2024-03-26T16:58:35.287 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:35] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:35.287 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:35] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:35.288 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:35.288 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:35.288 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:35.288 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:35.288 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=251 2024-03-26T16:58:35.288 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:35] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:35.288 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:35] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:35.288 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:35.288 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:35.288 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:35.288 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:35.288 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=252 2024-03-26T16:58:35.288 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:35] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:35.288 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:35] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:35.289 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:35.289 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:35.289 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:35.289 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:35.289 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=253 2024-03-26T16:58:35.289 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:35] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:35.289 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:35] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:35.289 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:35.289 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:35.289 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:35.289 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:35.289 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=254 2024-03-26T16:58:35.289 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:35] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:35.289 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:35] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:35.289 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:35.290 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:35.290 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:35.290 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:35.290 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=255 2024-03-26T16:58:35.290 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:35] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:35.290 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:35] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:35.290 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: host_name: "smithi044" 2024-03-26T16:58:35.290 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: traddr: "172.21.15.44" 2024-03-26T16:58:35.290 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: adrfam: ipv4 2024-03-26T16:58:35.290 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: trsvcid: 4420 2024-03-26T16:58:35.290 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: _ana_state='inaccessible' anagrpid=256 2024-03-26T16:58:35.291 INFO:tasks.workunit.client.3.smithi157.stdout:Adding nqn.2016-06.io.spdk:cnode3 listener at 172.21.15.44:4420: Successful 2024-03-26T16:58:35.555 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:35 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:35] INFO grpc.py:1992: Received request to create smithi044 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode3 at 172.21.15.44:4420, context: None 2024-03-26T16:58:35.555 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:35 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:35] INFO grpc.py:2031: Listener not created as gateway's host name smithi064 differs from requested host smithi044 2024-03-26T16:58:35.646 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:35 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:35] INFO grpc.py:1992: Received request to create smithi044 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode3 at 172.21.15.44:4420, context: None 2024-03-26T16:58:35.646 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:35 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:35] INFO grpc.py:2031: Listener not created as gateway's host name smithi149 differs from requested host smithi044 2024-03-26T16:58:35.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:35] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:35.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:35] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:58:35.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:35] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}] 2024-03-26T16:58:36.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:35 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:35] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:58:36.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:35 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:35] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}] 2024-03-26T16:58:36.157 INFO:tasks.workunit.client.3.smithi157.stderr:+ for i in "${!gateway_ips[@]}" 2024-03-26T16:58:36.157 INFO:tasks.workunit.client.3.smithi157.stderr:+ ip=172.21.15.64 2024-03-26T16:58:36.157 INFO:tasks.workunit.client.3.smithi157.stderr:+ name=smithi064 2024-03-26T16:58:36.158 INFO:tasks.workunit.client.3.smithi157.stderr:++ seq 1 3 2024-03-26T16:58:36.160 INFO:tasks.workunit.client.3.smithi157.stderr:+ for j in $(seq 1 $NVMEOF_SUBSYSTEMS_COUNT) 2024-03-26T16:58:36.161 INFO:tasks.workunit.client.3.smithi157.stderr:+ subsystem_nqn=nqn.2016-06.io.spdk:cnode1 2024-03-26T16:58:36.161 INFO:tasks.workunit.client.3.smithi157.stderr:+ echo 'Adding gateway listener with IP 172.21.15.64 and name smithi064' 2024-03-26T16:58:36.161 INFO:tasks.workunit.client.3.smithi157.stdout:Adding gateway listener with IP 172.21.15.64 and name smithi064 2024-03-26T16:58:36.161 INFO:tasks.workunit.client.3.smithi157.stderr:+ sudo podman run -it quay.io/barakda1/nvmeof-cli:qe_ceph_devel_21e59b2 --server-address 172.21.15.64 --server-port 5500 listener add --subsystem nqn.2016-06.io.spdk:cnode1 --host-name smithi064 --traddr 172.21.15.64 --trsvcid 4420 2024-03-26T16:58:36.248 INFO:tasks.workunit.client.3.smithi157.stderr:time="2024-03-26T16:58:36Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2024-03-26T16:58:36.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:58:36 smithi044 ceph-mon[30624]: pgmap v358: 33 pgs: 33 active+clean; 609 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 3.7 KiB/s rd, 341 B/s wr, 4 op/s 2024-03-26T16:58:36.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:58:36 smithi064 ceph-mon[34420]: pgmap v358: 33 pgs: 33 active+clean; 609 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 3.7 KiB/s rd, 341 B/s wr, 4 op/s 2024-03-26T16:58:36.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:58:36 smithi149 ceph-mon[34678]: pgmap v358: 33 pgs: 33 active+clean; 609 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 3.7 KiB/s rd, 341 B/s wr, 4 op/s 2024-03-26T16:58:36.937 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:36 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:36] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:58:36.938 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:36 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:36] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}] 2024-03-26T16:58:36.938 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:36 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:36] INFO grpc.py:1992: Received request to create smithi064 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode1 at 172.21.15.64:4420, context: 2024-03-26T16:58:37.194 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:36 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [2024-03-26 16:58:36.941592] tcp.c: 850:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 172.21.15.64 port 4420 *** 2024-03-26T16:58:37.194 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:36 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:36] INFO grpc.py:2023: create_listener: True 2024-03-26T16:58:37.194 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:36 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:36] INFO grpc.py:1958: Subsystem nqn.2016-06.io.spdk:cnode1 enable_ha: True 2024-03-26T16:58:37.194 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:36 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:36] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 1 2024-03-26T16:58:37.194 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:36 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:36] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:37.195 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:36 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:37.195 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:36 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:37.195 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:36 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:37.195 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:36 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:37.195 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:36 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=1 2024-03-26T16:58:37.195 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:36 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:36] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:37.195 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:36 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:36] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : optimized for group : 2 2024-03-26T16:58:37.195 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:36 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:36] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:37.195 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:36 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:37.195 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:36 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:37.195 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:36 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:37.195 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:36 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:37.196 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:36 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='optimized' anagrpid=2 2024-03-26T16:58:37.196 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:36 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:36] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:37.196 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:36 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:36] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 3 2024-03-26T16:58:37.196 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:36 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:36] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:37.196 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:36 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:37.196 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:36 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:37.196 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:36 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:37.196 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:36 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:37.196 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:36 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=3 2024-03-26T16:58:37.197 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:36 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:36] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:37.197 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:36 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:36] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 4 2024-03-26T16:58:37.197 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:36 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:36] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:37.197 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:36 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:37.198 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:36 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:37.198 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:36 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:37.198 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:36 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:37.198 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:36 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=4 2024-03-26T16:58:37.198 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:36 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:36] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:37.198 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:36 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:36] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 5 2024-03-26T16:58:37.198 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:36 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:36] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:37.198 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:36 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:37.198 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:36 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:37.198 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:36 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:37.198 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:36 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:37.198 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:36 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=5 2024-03-26T16:58:37.198 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:36 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:36] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:37.199 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:36 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:36] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 6 2024-03-26T16:58:37.199 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:36 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:36] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:37.199 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:36 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:37.199 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:36 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:37.199 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:36 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:37.199 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:36 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:37.199 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:36 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=6 2024-03-26T16:58:37.199 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:36 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:36] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:37.199 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:36 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:36] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 7 2024-03-26T16:58:37.199 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:36 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:36] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:37.199 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:36 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:37.199 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:36 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:37.199 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:36 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:37.199 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:36 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:37.200 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:36 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=7 2024-03-26T16:58:37.200 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:37.200 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 8 2024-03-26T16:58:37.200 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:37.200 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:37.200 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:37.200 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:37.200 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:37.200 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=8 2024-03-26T16:58:37.200 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:37.200 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 9 2024-03-26T16:58:37.200 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:37.200 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:37.201 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:37.201 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:37.201 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:37.201 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=9 2024-03-26T16:58:37.201 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:37.201 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 10 2024-03-26T16:58:37.201 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:37.201 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:37.201 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:37.201 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:37.201 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:37.201 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=10 2024-03-26T16:58:37.201 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:37.202 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 11 2024-03-26T16:58:37.202 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:37.202 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:37.202 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:37.202 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:37.202 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:37.202 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=11 2024-03-26T16:58:37.202 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:37.202 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 12 2024-03-26T16:58:37.202 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:37.202 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:37.202 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:37.202 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:37.202 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:37.203 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=12 2024-03-26T16:58:37.203 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:37.203 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 13 2024-03-26T16:58:37.203 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:37.203 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:37.203 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:37.203 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:37.203 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:37.203 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=13 2024-03-26T16:58:37.203 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:37.203 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 14 2024-03-26T16:58:37.203 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:37.203 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:37.203 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:37.204 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:37.204 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:37.204 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=14 2024-03-26T16:58:37.204 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:37.204 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 15 2024-03-26T16:58:37.204 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:37.204 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:37.204 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:37.204 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:37.204 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:37.204 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=15 2024-03-26T16:58:37.204 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:37.204 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 16 2024-03-26T16:58:37.204 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:37.205 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:37.205 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:37.205 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:37.205 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:37.205 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=16 2024-03-26T16:58:37.205 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:37.205 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 17 2024-03-26T16:58:37.205 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:37.205 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:37.205 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:37.205 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:37.205 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:37.205 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=17 2024-03-26T16:58:37.205 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:37.205 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 18 2024-03-26T16:58:37.206 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:37.206 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:37.206 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:37.206 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:37.206 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:37.206 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=18 2024-03-26T16:58:37.206 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:37.206 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 19 2024-03-26T16:58:37.206 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:37.206 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:37.206 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:37.206 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:37.206 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:37.207 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=19 2024-03-26T16:58:37.207 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:37.207 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 20 2024-03-26T16:58:37.207 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:37.207 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:37.207 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:37.207 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:37.207 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:37.207 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=20 2024-03-26T16:58:37.207 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:37.207 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 21 2024-03-26T16:58:37.207 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:37.207 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:37.207 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:37.207 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:37.208 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:37.208 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=21 2024-03-26T16:58:37.208 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:37.208 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 22 2024-03-26T16:58:37.208 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:37.208 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:37.208 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:37.208 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:37.208 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:37.208 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=22 2024-03-26T16:58:37.208 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:37.208 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 23 2024-03-26T16:58:37.208 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:37.208 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:37.209 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:37.209 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:37.209 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:37.209 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=23 2024-03-26T16:58:37.210 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:37.210 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 24 2024-03-26T16:58:37.210 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:37.210 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:37.210 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:37.210 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:37.210 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:37.210 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=24 2024-03-26T16:58:37.210 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:37.210 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 25 2024-03-26T16:58:37.210 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:37.210 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:37.210 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:37.211 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:37.211 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:37.211 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=25 2024-03-26T16:58:37.211 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:37.211 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 26 2024-03-26T16:58:37.211 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:37.211 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:37.211 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:37.211 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:37.211 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:37.211 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=26 2024-03-26T16:58:37.211 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:37.212 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 27 2024-03-26T16:58:37.212 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:37.212 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:37.212 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:37.212 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:37.212 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:37.212 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=27 2024-03-26T16:58:37.212 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:37.212 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 28 2024-03-26T16:58:37.212 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:37.212 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:37.212 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:37.212 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:37.212 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:37.213 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=28 2024-03-26T16:58:37.213 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:37.213 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 29 2024-03-26T16:58:37.213 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:37.213 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:37.213 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:37.213 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:37.213 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:37.213 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=29 2024-03-26T16:58:37.213 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:37.213 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 30 2024-03-26T16:58:37.213 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:37.213 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:37.213 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:37.214 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:37.214 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:37.214 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=30 2024-03-26T16:58:37.214 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:37.214 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 31 2024-03-26T16:58:37.214 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:37.214 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:37.214 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:37.214 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:37.214 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:37.214 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=31 2024-03-26T16:58:37.214 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:37.214 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 32 2024-03-26T16:58:37.215 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:37.215 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:37.215 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:37.215 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:37.215 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:37.215 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=32 2024-03-26T16:58:37.450 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:37.451 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 33 2024-03-26T16:58:37.451 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:37.451 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:37.451 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:37.451 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:37.451 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:37.451 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=33 2024-03-26T16:58:37.451 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:37.451 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 34 2024-03-26T16:58:37.451 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:37.451 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:37.452 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:37.452 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:37.452 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:37.452 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=34 2024-03-26T16:58:37.452 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:37.452 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 35 2024-03-26T16:58:37.452 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:37.452 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:37.452 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:37.452 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:37.452 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:37.452 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=35 2024-03-26T16:58:37.453 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:37.453 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 36 2024-03-26T16:58:37.453 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:37.454 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:37.454 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:37.454 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:37.454 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:37.454 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=36 2024-03-26T16:58:37.454 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:37.454 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 37 2024-03-26T16:58:37.454 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:37.454 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:37.455 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:37.455 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:37.455 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:37.455 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=37 2024-03-26T16:58:37.455 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:37.455 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 38 2024-03-26T16:58:37.455 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:37.455 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:37.455 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:37.455 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:37.455 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:37.455 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=38 2024-03-26T16:58:37.456 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:37.456 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 39 2024-03-26T16:58:37.456 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:37.456 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:37.456 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:37.456 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:37.456 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:37.456 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=39 2024-03-26T16:58:37.456 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:37.456 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 40 2024-03-26T16:58:37.456 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:37.457 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:37.457 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:37.457 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:37.457 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:37.457 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=40 2024-03-26T16:58:37.457 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:37.457 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 41 2024-03-26T16:58:37.457 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:37.457 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:37.457 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:37.457 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:37.458 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:37.458 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=41 2024-03-26T16:58:37.458 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:37.458 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 42 2024-03-26T16:58:37.458 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:37.458 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:37.458 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:37.458 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:37.458 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:37.458 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=42 2024-03-26T16:58:37.458 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:37.459 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 43 2024-03-26T16:58:37.459 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:37.459 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:37.459 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:37.459 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:37.459 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:37.459 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=43 2024-03-26T16:58:37.459 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:37.459 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 44 2024-03-26T16:58:37.459 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:37.459 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:37.459 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:37.460 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:37.460 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:37.460 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=44 2024-03-26T16:58:37.460 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:37.460 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 45 2024-03-26T16:58:37.460 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:37.460 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:37.460 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:37.460 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:37.460 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:37.461 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=45 2024-03-26T16:58:37.462 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:37.462 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 46 2024-03-26T16:58:37.462 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:37.462 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:37.462 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:37.463 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:37.463 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:37.463 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=46 2024-03-26T16:58:37.463 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:37.463 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 47 2024-03-26T16:58:37.463 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:37.463 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:37.463 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:37.463 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:37.463 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:37.463 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=47 2024-03-26T16:58:37.463 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:37.464 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 48 2024-03-26T16:58:37.464 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:37.464 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:37.464 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:37.464 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:37.464 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:37.464 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=48 2024-03-26T16:58:37.464 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:37.464 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 49 2024-03-26T16:58:37.464 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:37.464 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:37.465 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:37.465 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:37.465 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:37.465 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=49 2024-03-26T16:58:37.465 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:37.465 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 50 2024-03-26T16:58:37.465 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:37.465 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:37.465 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:37.465 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:37.465 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:37.466 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=50 2024-03-26T16:58:37.466 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:37.466 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 51 2024-03-26T16:58:37.466 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:37.466 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:37.466 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:37.466 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:37.466 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:37.466 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=51 2024-03-26T16:58:37.466 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:37.466 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 52 2024-03-26T16:58:37.466 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:37.467 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:37.467 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:37.467 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:37.467 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:37.467 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=52 2024-03-26T16:58:37.467 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:37.467 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 53 2024-03-26T16:58:37.467 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:37.467 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:37.467 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:37.467 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:37.467 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:37.468 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=53 2024-03-26T16:58:37.468 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:37.468 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 54 2024-03-26T16:58:37.468 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:37.468 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:37.468 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:37.468 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:37.468 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:37.468 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=54 2024-03-26T16:58:37.469 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:37.469 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 55 2024-03-26T16:58:37.469 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:37.469 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:37.469 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:37.469 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:37.469 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:37.469 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=55 2024-03-26T16:58:37.469 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:37.469 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 56 2024-03-26T16:58:37.469 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:37.469 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:37.469 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:37.469 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:37.470 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:37.470 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=56 2024-03-26T16:58:37.470 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:37.470 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 57 2024-03-26T16:58:37.470 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:37.470 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:37.470 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:37.470 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:37.470 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:37.470 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=57 2024-03-26T16:58:37.470 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:37.470 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 58 2024-03-26T16:58:37.470 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:37.470 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:37.471 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:37.471 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:37.471 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:37.471 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=58 2024-03-26T16:58:37.471 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:37.471 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 59 2024-03-26T16:58:37.471 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:37.471 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:37.471 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:37.471 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:37.471 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:37.471 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=59 2024-03-26T16:58:37.471 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:37.472 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 60 2024-03-26T16:58:37.472 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:37.472 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:37.472 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:37.472 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:37.472 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:37.472 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=60 2024-03-26T16:58:37.472 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:37.472 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 61 2024-03-26T16:58:37.472 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:37.472 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:37.472 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:37.472 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:37.472 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:37.472 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=61 2024-03-26T16:58:37.473 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:37.473 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 62 2024-03-26T16:58:37.473 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:37.473 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:37.473 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:37.473 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:37.473 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:37.473 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=62 2024-03-26T16:58:37.473 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:37.473 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 63 2024-03-26T16:58:37.473 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:37.473 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:37.473 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:37.473 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:37.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:37.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=63 2024-03-26T16:58:37.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:37.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 64 2024-03-26T16:58:37.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:37.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:37.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:37.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:37.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:37.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=64 2024-03-26T16:58:37.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:37.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 65 2024-03-26T16:58:37.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:37.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:37.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:37.475 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:37.475 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:37.475 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=65 2024-03-26T16:58:37.706 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:37.707 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 66 2024-03-26T16:58:37.707 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:37.707 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:37.707 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:37.707 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:37.707 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:37.707 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=66 2024-03-26T16:58:37.707 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:37.707 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 67 2024-03-26T16:58:37.707 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:37.707 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:37.707 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:37.707 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:37.708 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:37.708 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=67 2024-03-26T16:58:37.708 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:37.708 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 68 2024-03-26T16:58:37.708 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:37.708 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:37.708 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:37.708 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:37.708 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:37.708 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=68 2024-03-26T16:58:37.708 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:37.709 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 69 2024-03-26T16:58:37.709 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:37.709 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:37.709 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:37.709 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:37.709 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:37.709 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=69 2024-03-26T16:58:37.709 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:37.710 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 70 2024-03-26T16:58:37.710 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:37.710 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:37.710 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:37.710 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:37.710 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:37.710 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=70 2024-03-26T16:58:37.710 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:37.710 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 71 2024-03-26T16:58:37.710 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:37.710 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:37.710 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:37.711 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:37.711 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:37.711 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=71 2024-03-26T16:58:37.711 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:37.711 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 72 2024-03-26T16:58:37.711 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:37.711 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:37.711 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:37.711 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:37.711 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:37.711 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=72 2024-03-26T16:58:37.711 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:37.711 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 73 2024-03-26T16:58:37.712 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:37.712 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:37.712 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:37.712 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:37.712 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:37.712 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=73 2024-03-26T16:58:37.712 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:37.712 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 74 2024-03-26T16:58:37.712 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:37.712 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:37.712 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:37.712 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:37.712 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:37.712 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=74 2024-03-26T16:58:37.712 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:37.713 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 75 2024-03-26T16:58:37.713 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:37.713 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:37.713 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:37.713 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:37.714 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:37.714 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=75 2024-03-26T16:58:37.714 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:37.714 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 76 2024-03-26T16:58:37.714 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:37.714 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:37.714 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:37.714 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:37.714 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:37.715 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=76 2024-03-26T16:58:37.715 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:37.715 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 77 2024-03-26T16:58:37.715 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:37.715 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:37.715 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:37.715 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:37.715 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:37.715 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=77 2024-03-26T16:58:37.715 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:37.715 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 78 2024-03-26T16:58:37.715 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:37.715 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:37.715 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:37.716 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:37.716 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:37.716 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=78 2024-03-26T16:58:37.716 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:37.716 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 79 2024-03-26T16:58:37.716 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:37.716 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:37.716 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:37.716 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:37.716 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:37.716 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=79 2024-03-26T16:58:37.716 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:37.717 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 80 2024-03-26T16:58:37.717 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:37.717 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:37.717 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:37.717 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:37.717 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:37.717 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=80 2024-03-26T16:58:37.717 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:37.717 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 81 2024-03-26T16:58:37.717 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:37.717 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:37.717 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:37.718 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:37.718 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:37.718 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=81 2024-03-26T16:58:37.718 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:37.718 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 82 2024-03-26T16:58:37.718 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:37.718 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:37.718 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:37.718 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:37.718 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:37.718 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=82 2024-03-26T16:58:37.718 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:37.718 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 83 2024-03-26T16:58:37.719 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:37.719 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:37.719 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:37.719 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:37.719 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:37.719 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=83 2024-03-26T16:58:37.719 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:37.719 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 84 2024-03-26T16:58:37.719 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:37.719 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:37.719 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:37.719 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:37.719 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:37.720 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=84 2024-03-26T16:58:37.720 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:37.720 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 85 2024-03-26T16:58:37.720 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:37.720 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:37.720 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:37.720 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:37.720 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:37.720 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=85 2024-03-26T16:58:37.720 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:37.720 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 86 2024-03-26T16:58:37.720 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:37.720 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:37.720 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:37.721 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:37.721 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:37.721 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=86 2024-03-26T16:58:37.721 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:37.721 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 87 2024-03-26T16:58:37.721 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:37.721 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:37.721 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:37.721 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:37.721 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:37.721 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=87 2024-03-26T16:58:37.721 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:37.721 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 88 2024-03-26T16:58:37.722 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:37.722 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:37.722 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:37.722 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:37.722 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:37.722 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=88 2024-03-26T16:58:37.722 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:37.722 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 89 2024-03-26T16:58:37.722 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:37.722 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:37.722 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:37.722 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:37.722 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:37.722 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=89 2024-03-26T16:58:37.723 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:37.723 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 90 2024-03-26T16:58:37.723 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:37.723 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:37.723 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:37.723 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:37.723 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:37.723 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=90 2024-03-26T16:58:37.723 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:37.723 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 91 2024-03-26T16:58:37.723 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:37.723 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:37.723 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:37.723 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:37.724 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:37.724 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=91 2024-03-26T16:58:37.724 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:37.724 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 92 2024-03-26T16:58:37.724 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:37.724 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:37.724 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:37.724 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:37.725 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:37.725 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=92 2024-03-26T16:58:37.725 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:37.725 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 93 2024-03-26T16:58:37.725 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:37.725 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:37.725 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:37.725 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:37.725 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:37.725 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=93 2024-03-26T16:58:37.725 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:37.725 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 94 2024-03-26T16:58:37.725 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:37.725 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:37.725 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:37.726 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:37.726 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:37.726 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=94 2024-03-26T16:58:37.726 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:37.726 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 95 2024-03-26T16:58:37.726 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:37.726 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:37.726 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:37.726 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:37.726 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:37.726 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=95 2024-03-26T16:58:37.726 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:37.726 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 96 2024-03-26T16:58:37.726 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:37.727 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:37.727 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:37.727 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:37.727 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:37.727 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=96 2024-03-26T16:58:37.727 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:37.727 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 97 2024-03-26T16:58:37.727 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:37.727 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:37.727 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:37.727 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:37.727 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:37.727 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=97 2024-03-26T16:58:37.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:37 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:37] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:58:37.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:37 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:37] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}] 2024-03-26T16:58:37.962 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:37.962 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 98 2024-03-26T16:58:37.963 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:37.963 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:37.963 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:37.963 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:37.963 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:37.963 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=98 2024-03-26T16:58:37.963 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:37.963 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 99 2024-03-26T16:58:37.963 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:37.963 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:37.964 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:37.964 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:37.964 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:37.964 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=99 2024-03-26T16:58:37.964 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:37.964 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 100 2024-03-26T16:58:37.964 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:37.964 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:37.964 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:37.964 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:37.964 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:37.964 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=100 2024-03-26T16:58:37.965 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:37.965 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 101 2024-03-26T16:58:37.966 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:37.966 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:37.966 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:37.966 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:37.966 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:37.966 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=101 2024-03-26T16:58:37.966 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:37.966 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 102 2024-03-26T16:58:37.967 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:37.967 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:37.967 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:37.967 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:37.967 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:37.967 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=102 2024-03-26T16:58:37.967 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:37.967 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 103 2024-03-26T16:58:37.967 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:37.967 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:37.967 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:37.967 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:37.968 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:37.968 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=103 2024-03-26T16:58:37.968 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:37.968 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 104 2024-03-26T16:58:37.968 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:37.968 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:37.968 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:37.968 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:37.968 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:37.968 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=104 2024-03-26T16:58:37.968 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:37.969 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 105 2024-03-26T16:58:37.969 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:37.969 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:37.969 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:37.969 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:37.969 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:37.969 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=105 2024-03-26T16:58:37.969 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:37.969 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 106 2024-03-26T16:58:37.969 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:37.969 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:37.969 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:37.970 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:37.970 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:37.970 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=106 2024-03-26T16:58:37.970 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:37.970 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 107 2024-03-26T16:58:37.970 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:37.970 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:37.970 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:37.970 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:37.970 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:37.971 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=107 2024-03-26T16:58:37.971 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:37.971 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 108 2024-03-26T16:58:37.971 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:37.971 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:37.971 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:37.971 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:37.971 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:37.971 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=108 2024-03-26T16:58:37.971 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:37.971 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 109 2024-03-26T16:58:37.972 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:37.972 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:37.972 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:37.972 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:37.972 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:37.972 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=109 2024-03-26T16:58:37.972 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:37.972 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 110 2024-03-26T16:58:37.972 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:37.972 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:37.972 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:37.972 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:37.973 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:37.973 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=110 2024-03-26T16:58:37.974 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:37.974 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 111 2024-03-26T16:58:37.974 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:37.974 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:37.974 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:37.974 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:37.975 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:37.975 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=111 2024-03-26T16:58:37.975 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:37.975 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 112 2024-03-26T16:58:37.975 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:37.975 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:37.975 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:37.975 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:37.975 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:37.975 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=112 2024-03-26T16:58:37.975 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:37.975 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 113 2024-03-26T16:58:37.976 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:37.976 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:37.976 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:37.976 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:37.976 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:37.976 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=113 2024-03-26T16:58:37.976 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:37.976 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 114 2024-03-26T16:58:37.976 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:37.976 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:37.977 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:37.977 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:37.977 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:37.977 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=114 2024-03-26T16:58:37.977 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:37.977 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 115 2024-03-26T16:58:37.977 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:37.977 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:37.977 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:37.977 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:37.977 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:37.977 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=115 2024-03-26T16:58:37.977 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:37.978 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 116 2024-03-26T16:58:37.978 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:37.978 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:37.978 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:37.978 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:37.978 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:37.978 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=116 2024-03-26T16:58:37.978 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:37.978 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 117 2024-03-26T16:58:37.978 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:37.978 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:37.979 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:37.979 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:37.979 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:37.979 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=117 2024-03-26T16:58:37.979 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:37.979 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 118 2024-03-26T16:58:37.979 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:37.979 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:37.979 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:37.979 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:37.979 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:37.979 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=118 2024-03-26T16:58:37.980 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:37.980 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 119 2024-03-26T16:58:37.980 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:37.980 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:37.980 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:37.980 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:37.980 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:37.980 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=119 2024-03-26T16:58:37.980 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:37.980 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 120 2024-03-26T16:58:37.980 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:37.980 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:37.980 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:37.981 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:37.981 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:37.981 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=120 2024-03-26T16:58:37.981 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:37.981 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 121 2024-03-26T16:58:37.981 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:37.981 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:37.981 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:37.981 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:37.981 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:37.982 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=121 2024-03-26T16:58:37.982 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:37.982 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 122 2024-03-26T16:58:37.982 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:37.982 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:37.982 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:37.982 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:37.982 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:37.982 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=122 2024-03-26T16:58:37.982 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:37.982 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 123 2024-03-26T16:58:37.982 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:37.982 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:37.982 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:37.983 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:37.983 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:37.983 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=123 2024-03-26T16:58:37.983 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:37.983 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 124 2024-03-26T16:58:37.983 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:37.983 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:37.983 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:37.983 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:37.983 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:37.983 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=124 2024-03-26T16:58:37.983 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:37.983 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 125 2024-03-26T16:58:37.983 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:37.984 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:37.984 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:37.984 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:37.984 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:37.984 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=125 2024-03-26T16:58:37.984 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:37.984 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 126 2024-03-26T16:58:37.984 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:37.984 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:37.984 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:37.984 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:37.984 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:37.984 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=126 2024-03-26T16:58:37.984 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:37.984 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 127 2024-03-26T16:58:37.985 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:37.985 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:37.985 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:37.985 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:37.985 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:37.985 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=127 2024-03-26T16:58:37.985 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:37.985 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 128 2024-03-26T16:58:37.985 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:37.985 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:37.985 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:37.985 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:37.985 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:37.985 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=128 2024-03-26T16:58:37.986 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:37.986 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 129 2024-03-26T16:58:37.986 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:37.986 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:37.986 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:37.986 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:37.986 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:37.986 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=129 2024-03-26T16:58:38.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:37 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:37] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:58:38.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:37 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:37] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}] 2024-03-26T16:58:38.217 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-mon[34420]: pgmap v359: 33 pgs: 33 active+clean; 609 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 3.7 KiB/s rd, 341 B/s wr, 4 op/s 2024-03-26T16:58:38.218 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:38.219 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 130 2024-03-26T16:58:38.219 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:38.219 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:38.219 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:38.219 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:38.219 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:38.219 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=130 2024-03-26T16:58:38.219 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:38.219 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 131 2024-03-26T16:58:38.219 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:38.219 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:38.219 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:38.219 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:38.220 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:38.220 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=131 2024-03-26T16:58:38.220 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:38.220 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 132 2024-03-26T16:58:38.220 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:37] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:38.220 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:38.220 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:38.220 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:38.220 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:38.220 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=132 2024-03-26T16:58:38.220 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:38.221 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 133 2024-03-26T16:58:38.221 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:38.221 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:38.221 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:38.221 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:38.221 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:38.221 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=133 2024-03-26T16:58:38.221 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:38.222 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 134 2024-03-26T16:58:38.222 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:38.222 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:38.222 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:38.222 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:38.222 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:38.222 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=134 2024-03-26T16:58:38.222 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:38.222 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 135 2024-03-26T16:58:38.222 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:38.222 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:38.222 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:38.222 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:38.223 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:38.223 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=135 2024-03-26T16:58:38.223 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:38.223 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 136 2024-03-26T16:58:38.223 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:38.223 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:38.223 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:38.223 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:38.223 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:38.223 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=136 2024-03-26T16:58:38.223 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:38.223 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 137 2024-03-26T16:58:38.223 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:38.224 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:38.224 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:38.224 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:38.224 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:38.224 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=137 2024-03-26T16:58:38.224 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:38.224 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 138 2024-03-26T16:58:38.224 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:38.224 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:38.224 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:38.224 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:38.224 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:38.224 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=138 2024-03-26T16:58:38.224 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:38.225 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 139 2024-03-26T16:58:38.225 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:38.225 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:38.225 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:38.225 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:38.226 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:38.226 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=139 2024-03-26T16:58:38.226 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:38.226 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 140 2024-03-26T16:58:38.226 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:38.226 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:38.226 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:38.226 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:38.226 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:38.227 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=140 2024-03-26T16:58:38.227 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:38.227 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 141 2024-03-26T16:58:38.227 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:38.227 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:38.227 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:38.227 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:38.227 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:38.227 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=141 2024-03-26T16:58:38.227 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:38.227 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 142 2024-03-26T16:58:38.227 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:38.227 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:38.228 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:38.228 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:38.228 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:38.228 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=142 2024-03-26T16:58:38.228 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:38.228 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 143 2024-03-26T16:58:38.228 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:38.228 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:38.228 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:38.228 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:38.228 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:38.228 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=143 2024-03-26T16:58:38.228 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:38.228 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 144 2024-03-26T16:58:38.229 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:38.229 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:38.229 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:38.229 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:38.229 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:38.229 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=144 2024-03-26T16:58:38.229 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:38.229 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 145 2024-03-26T16:58:38.229 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:38.229 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:38.229 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:38.229 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:38.230 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:38.230 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=145 2024-03-26T16:58:38.230 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:38.230 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 146 2024-03-26T16:58:38.230 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:38.230 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:38.230 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:38.230 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:38.230 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:38.230 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=146 2024-03-26T16:58:38.230 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:38.231 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 147 2024-03-26T16:58:38.231 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:38.231 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:38.231 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:38.231 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:38.231 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:38.231 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=147 2024-03-26T16:58:38.231 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:38.231 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 148 2024-03-26T16:58:38.231 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:38.231 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:38.231 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:38.232 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:38.232 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:38.232 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=148 2024-03-26T16:58:38.232 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:38.232 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 149 2024-03-26T16:58:38.232 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:38.232 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:38.232 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:38.232 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:38.232 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:38.232 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=149 2024-03-26T16:58:38.233 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:38.233 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 150 2024-03-26T16:58:38.233 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:38.233 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:38.233 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:38.233 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:38.233 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:38.233 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=150 2024-03-26T16:58:38.233 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:38.233 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 151 2024-03-26T16:58:38.233 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:38.234 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:38.234 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:38.234 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:38.234 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:38.234 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=151 2024-03-26T16:58:38.234 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:38.234 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 152 2024-03-26T16:58:38.234 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:38.234 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:38.234 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:38.234 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:38.235 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:38.235 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=152 2024-03-26T16:58:38.235 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:38.235 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 153 2024-03-26T16:58:38.235 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:38.235 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:38.235 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:38.235 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:38.235 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:38.235 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=153 2024-03-26T16:58:38.235 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:38.236 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 154 2024-03-26T16:58:38.236 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:38.236 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:38.236 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:38.236 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:38.236 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:38.236 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=154 2024-03-26T16:58:38.236 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:38.236 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 155 2024-03-26T16:58:38.236 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:38.236 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:38.236 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:38.237 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:38.237 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:38.237 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=155 2024-03-26T16:58:38.237 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:38.237 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 156 2024-03-26T16:58:38.237 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:38.238 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:38.238 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:38.238 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:38.238 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:38.239 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=156 2024-03-26T16:58:38.239 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:38.239 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 157 2024-03-26T16:58:38.239 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:38.239 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:38.239 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:38.239 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:38.239 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:38.240 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=157 2024-03-26T16:58:38.240 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:38.240 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 158 2024-03-26T16:58:38.240 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:38.240 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:38.240 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:38.240 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:38.240 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:38.240 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=158 2024-03-26T16:58:38.240 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:38.240 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 159 2024-03-26T16:58:38.240 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:38.240 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:38.240 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:38.241 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:38.241 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:38.241 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=159 2024-03-26T16:58:38.241 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:38.241 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 160 2024-03-26T16:58:38.241 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:38.241 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:38.241 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:38.241 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:38.241 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:38.241 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=160 2024-03-26T16:58:38.241 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:38.241 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 161 2024-03-26T16:58:38.241 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:38.241 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:38.242 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:38.242 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:38.242 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:38.242 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=161 2024-03-26T16:58:38.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:38.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 162 2024-03-26T16:58:38.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:38.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:38.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:38.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:38.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:38.475 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=162 2024-03-26T16:58:38.475 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:38.475 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 163 2024-03-26T16:58:38.475 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:38.475 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:38.475 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:38.475 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:38.475 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:38.475 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=163 2024-03-26T16:58:38.475 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:38.476 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 164 2024-03-26T16:58:38.476 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:38.476 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:38.476 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:38.476 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:38.476 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:38.476 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=164 2024-03-26T16:58:38.476 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:38.477 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 165 2024-03-26T16:58:38.478 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:38.478 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:38.478 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:38.478 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:38.478 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:38.478 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=165 2024-03-26T16:58:38.478 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:38.478 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 166 2024-03-26T16:58:38.478 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:38.478 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:38.478 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:38.479 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:38.479 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:38.479 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=166 2024-03-26T16:58:38.479 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:38.479 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 167 2024-03-26T16:58:38.479 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:38.479 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:38.479 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:38.479 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:38.479 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:38.479 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=167 2024-03-26T16:58:38.479 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:38.480 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 168 2024-03-26T16:58:38.480 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:38.480 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:38.480 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:38.480 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:38.480 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:38.480 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=168 2024-03-26T16:58:38.480 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:38.480 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 169 2024-03-26T16:58:38.480 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:38.480 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:38.480 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:38.481 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:38.481 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:38.481 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=169 2024-03-26T16:58:38.481 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:38.481 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 170 2024-03-26T16:58:38.481 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:38.481 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:38.481 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:38.481 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:38.481 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:38.481 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=170 2024-03-26T16:58:38.481 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:38.481 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 171 2024-03-26T16:58:38.482 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:38.482 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:38.482 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:38.482 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:38.482 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:38.482 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=171 2024-03-26T16:58:38.482 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:38.482 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 172 2024-03-26T16:58:38.482 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:38.482 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:38.482 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:38.482 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:38.483 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:38.483 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=172 2024-03-26T16:58:38.483 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:38.483 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 173 2024-03-26T16:58:38.483 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:38.483 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:38.483 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:38.483 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:38.483 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:38.483 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=173 2024-03-26T16:58:38.483 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:38.484 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 174 2024-03-26T16:58:38.484 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:38.484 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:38.484 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:38.484 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:38.484 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:38.484 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=174 2024-03-26T16:58:38.484 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:38.484 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 175 2024-03-26T16:58:38.484 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:38.485 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:38.485 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:38.485 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:38.485 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:38.485 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=175 2024-03-26T16:58:38.485 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:38.485 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 176 2024-03-26T16:58:38.485 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:38.485 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:38.485 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:38.485 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:38.486 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:38.486 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=176 2024-03-26T16:58:38.486 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:38.486 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 177 2024-03-26T16:58:38.486 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:38.486 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:38.486 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:38.486 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:38.486 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:38.486 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=177 2024-03-26T16:58:38.486 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:38.486 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 178 2024-03-26T16:58:38.486 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:38.487 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:38.487 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:38.487 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:38.487 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:38.487 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=178 2024-03-26T16:58:38.487 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:38.487 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 179 2024-03-26T16:58:38.487 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:38.487 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:38.487 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:38.487 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:38.487 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:38.488 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=179 2024-03-26T16:58:38.488 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:38.488 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 180 2024-03-26T16:58:38.488 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:38.488 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:38.488 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:38.488 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:38.488 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:38.488 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=180 2024-03-26T16:58:38.488 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:38.488 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 181 2024-03-26T16:58:38.488 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:38.489 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:38.489 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:38.489 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:38.489 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:38.489 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=181 2024-03-26T16:58:38.489 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:38.489 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 182 2024-03-26T16:58:38.489 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:38.489 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:38.489 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:38.489 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:38.489 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:38.489 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=182 2024-03-26T16:58:38.490 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:38.490 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 183 2024-03-26T16:58:38.490 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:38.490 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:38.490 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:38.490 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:38.490 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:38.490 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=183 2024-03-26T16:58:38.490 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:38.490 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 184 2024-03-26T16:58:38.491 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:38.491 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:38.491 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:38.491 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:38.491 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:38.491 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=184 2024-03-26T16:58:38.491 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:38.491 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 185 2024-03-26T16:58:38.491 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:38.491 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:38.491 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:38.492 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:38.492 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:38.492 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=185 2024-03-26T16:58:38.492 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:38.492 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 186 2024-03-26T16:58:38.492 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:38.492 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:38.492 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:38.492 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:38.492 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:38.492 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=186 2024-03-26T16:58:38.492 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:38.493 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 187 2024-03-26T16:58:38.493 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:38.493 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:38.493 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:38.493 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:38.493 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:38.493 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=187 2024-03-26T16:58:38.493 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:38.494 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 188 2024-03-26T16:58:38.494 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:38.494 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:38.494 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:38.494 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:38.494 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:38.495 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=188 2024-03-26T16:58:38.495 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:38.495 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 189 2024-03-26T16:58:38.495 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:38.495 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:38.495 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:38.495 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:38.495 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:38.495 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=189 2024-03-26T16:58:38.495 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:38.495 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 190 2024-03-26T16:58:38.495 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:38.496 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:38.496 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:38.496 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:38.496 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:38.496 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=190 2024-03-26T16:58:38.496 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:38.496 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 191 2024-03-26T16:58:38.496 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:38.496 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:38.496 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:38.496 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:38.496 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:38.497 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=191 2024-03-26T16:58:38.497 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:38.497 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 192 2024-03-26T16:58:38.497 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:38.497 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:38.497 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:38.497 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:38.497 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:38.497 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=192 2024-03-26T16:58:38.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:58:38 smithi044 ceph-mon[30624]: pgmap v359: 33 pgs: 33 active+clean; 609 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 3.7 KiB/s rd, 341 B/s wr, 4 op/s 2024-03-26T16:58:38.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:58:38 smithi149 ceph-mon[34678]: pgmap v359: 33 pgs: 33 active+clean; 609 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 3.7 KiB/s rd, 341 B/s wr, 4 op/s 2024-03-26T16:58:38.730 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:38.730 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 193 2024-03-26T16:58:38.730 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:38.730 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:38.731 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:38.731 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:38.731 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:38.731 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=193 2024-03-26T16:58:38.731 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:38.731 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 194 2024-03-26T16:58:38.731 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:38.731 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:38.731 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:38.731 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:38.731 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:38.731 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=194 2024-03-26T16:58:38.732 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:38.732 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 195 2024-03-26T16:58:38.732 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:38.732 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:38.732 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:38.732 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:38.732 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:38.732 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=195 2024-03-26T16:58:38.732 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:38.732 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 196 2024-03-26T16:58:38.732 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:38.732 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:38.732 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:38.732 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:38.733 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:38.733 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=196 2024-03-26T16:58:38.733 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:38.733 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 197 2024-03-26T16:58:38.733 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:38.733 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:38.733 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:38.733 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:38.733 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:38.733 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=197 2024-03-26T16:58:38.733 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:38.733 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 198 2024-03-26T16:58:38.733 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:38.733 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:38.734 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:38.734 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:38.734 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:38.734 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=198 2024-03-26T16:58:38.734 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:38.734 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 199 2024-03-26T16:58:38.734 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:38.735 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:38.735 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:38.735 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:38.735 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:38.736 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=199 2024-03-26T16:58:38.736 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:38.736 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 200 2024-03-26T16:58:38.736 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:38.736 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:38.736 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:38.736 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:38.736 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:38.736 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=200 2024-03-26T16:58:38.736 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:38.736 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 201 2024-03-26T16:58:38.736 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:38.736 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:38.736 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:38.737 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:38.737 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:38.737 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=201 2024-03-26T16:58:38.737 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:38.737 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 202 2024-03-26T16:58:38.737 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:38.737 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:38.737 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:38.737 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:38.737 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:38.737 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=202 2024-03-26T16:58:38.737 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:38.737 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 203 2024-03-26T16:58:38.737 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:38.738 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:38.738 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:38.738 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:38.738 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:38.738 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=203 2024-03-26T16:58:38.738 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:38.738 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 204 2024-03-26T16:58:38.738 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:38.738 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:38.738 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:38.738 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:38.738 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:38.738 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=204 2024-03-26T16:58:38.738 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:38.739 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 205 2024-03-26T16:58:38.739 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:38.739 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:38.739 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:38.739 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:38.739 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:38.739 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=205 2024-03-26T16:58:38.739 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:38.739 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 206 2024-03-26T16:58:38.739 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:38.739 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:38.739 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:38.740 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:38.740 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:38.740 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=206 2024-03-26T16:58:38.740 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:38.740 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 207 2024-03-26T16:58:38.740 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:38.740 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:38.740 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:38.740 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:38.740 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:38.740 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=207 2024-03-26T16:58:38.740 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:38.740 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 208 2024-03-26T16:58:38.740 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:38.741 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:38.741 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:38.741 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:38.741 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:38.741 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=208 2024-03-26T16:58:38.741 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:38.741 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 209 2024-03-26T16:58:38.741 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:38.741 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:38.741 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:38.741 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:38.742 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:38.742 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=209 2024-03-26T16:58:38.742 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:38.742 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 210 2024-03-26T16:58:38.742 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:38.742 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:38.742 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:38.742 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:38.742 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:38.742 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=210 2024-03-26T16:58:38.743 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:38.743 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 211 2024-03-26T16:58:38.743 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:38.743 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:38.743 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:38.743 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:38.743 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:38.743 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=211 2024-03-26T16:58:38.743 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:38.743 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 212 2024-03-26T16:58:38.743 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:38.743 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:38.744 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:38.744 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:38.744 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:38.744 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=212 2024-03-26T16:58:38.744 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:38.744 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 213 2024-03-26T16:58:38.744 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:38.744 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:38.744 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:38.744 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:38.744 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:38.744 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=213 2024-03-26T16:58:38.744 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:38.744 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 214 2024-03-26T16:58:38.745 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:38.745 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:38.745 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:38.745 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:38.745 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:38.745 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=214 2024-03-26T16:58:38.745 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:38.745 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 215 2024-03-26T16:58:38.745 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:38.745 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:38.745 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:38.745 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:38.745 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:38.745 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=215 2024-03-26T16:58:38.746 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:38.746 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 216 2024-03-26T16:58:38.746 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:38.746 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:38.746 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:38.746 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:38.746 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:38.746 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=216 2024-03-26T16:58:38.746 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:38.746 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 217 2024-03-26T16:58:38.746 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:38.746 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:38.746 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:38.746 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:38.747 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:38.747 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=217 2024-03-26T16:58:38.747 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:38.747 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 218 2024-03-26T16:58:38.747 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:38.747 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:38.747 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:38.747 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:38.747 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:38.747 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=218 2024-03-26T16:58:38.747 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:38.747 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 219 2024-03-26T16:58:38.747 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:38.747 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:38.748 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:38.748 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:38.748 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:38.748 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=219 2024-03-26T16:58:38.748 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:38.748 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 220 2024-03-26T16:58:38.748 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:38.748 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:38.748 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:38.748 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:38.748 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:38.748 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=220 2024-03-26T16:58:38.748 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:38.748 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 221 2024-03-26T16:58:38.748 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:38.749 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:38.749 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:38.749 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:38.749 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:38.749 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=221 2024-03-26T16:58:38.749 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:38.749 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 222 2024-03-26T16:58:38.749 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:38.749 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:38.749 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:38.749 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:38.749 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:38.749 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=222 2024-03-26T16:58:38.749 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:38.750 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 223 2024-03-26T16:58:38.750 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:38.750 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:38.750 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:38.750 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:38.750 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:38.750 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=223 2024-03-26T16:58:38.750 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:38.750 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 224 2024-03-26T16:58:38.750 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:38.750 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:38.750 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:38.750 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:38.750 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:38.751 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=224 2024-03-26T16:58:38.986 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:38.986 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 225 2024-03-26T16:58:38.986 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:38.986 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:38.986 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:38.986 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:38.986 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:38.987 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=225 2024-03-26T16:58:38.987 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:38.987 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 226 2024-03-26T16:58:38.987 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:38.987 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:38.987 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:38.987 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:38.987 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:38.987 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=226 2024-03-26T16:58:38.987 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:38.987 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 227 2024-03-26T16:58:38.987 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:38.987 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:38.987 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:38.988 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:38.988 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:38.988 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=227 2024-03-26T16:58:38.988 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:38.989 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 228 2024-03-26T16:58:38.989 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:38.989 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:38.989 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:38.989 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:38.989 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:38.989 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=228 2024-03-26T16:58:38.989 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:38.990 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 229 2024-03-26T16:58:38.990 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:38.990 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:38.990 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:38.990 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:38.990 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:38.990 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=229 2024-03-26T16:58:38.990 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:38.990 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 230 2024-03-26T16:58:38.990 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:38.990 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:38.990 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:38.990 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:38.991 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:38.991 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=230 2024-03-26T16:58:38.991 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:38.991 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 231 2024-03-26T16:58:38.991 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:38.991 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:38.991 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:38.991 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:38.991 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:38.991 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=231 2024-03-26T16:58:38.991 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:38.991 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 232 2024-03-26T16:58:38.991 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:38.991 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:38.992 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:38.992 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:38.992 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:38.992 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=232 2024-03-26T16:58:38.992 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:38.992 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 233 2024-03-26T16:58:38.992 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:38.992 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:38.992 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:38.992 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:38.992 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:38.992 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=233 2024-03-26T16:58:38.992 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:38.992 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 234 2024-03-26T16:58:38.993 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:38.993 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:38.993 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:38.993 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:38.993 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:38.993 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=234 2024-03-26T16:58:38.993 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:38.993 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 235 2024-03-26T16:58:38.993 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:38.993 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:38.993 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:38.993 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:38.994 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:38.994 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=235 2024-03-26T16:58:38.994 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:38.994 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 236 2024-03-26T16:58:38.994 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:38.994 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:38.994 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:38.994 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:38.994 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:38.994 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=236 2024-03-26T16:58:38.994 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:38.995 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 237 2024-03-26T16:58:38.995 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:38.995 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:38.995 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:38.995 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:38.995 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:38.995 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=237 2024-03-26T16:58:38.995 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:38.995 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 238 2024-03-26T16:58:38.995 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:38.995 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:38.995 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:38.995 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:38.996 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:38.996 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=238 2024-03-26T16:58:38.996 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:38.996 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 239 2024-03-26T16:58:38.996 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:38.996 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:38.996 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:38.996 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:38.996 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:38.996 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=239 2024-03-26T16:58:38.996 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:38.996 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 240 2024-03-26T16:58:38.997 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:38.997 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:38.997 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:38.997 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:38.997 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:38.997 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=240 2024-03-26T16:58:38.997 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:38.997 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 241 2024-03-26T16:58:38.997 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:38.997 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:38.998 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:38.998 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:38.998 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:38.998 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=241 2024-03-26T16:58:38.998 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:38.998 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 242 2024-03-26T16:58:38.998 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:38.998 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:38.998 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:38.998 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:38.998 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:38.998 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=242 2024-03-26T16:58:38.999 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:38.999 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 243 2024-03-26T16:58:38.999 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:38.999 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:38.999 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:38.999 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:38.999 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:38.999 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=243 2024-03-26T16:58:38.999 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:38.999 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 244 2024-03-26T16:58:38.999 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:38.999 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:39.000 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:39.000 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:39.000 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:39.000 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=244 2024-03-26T16:58:39.000 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:39.000 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 245 2024-03-26T16:58:39.000 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:39.000 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:39.000 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:39.000 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:39.001 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:39.001 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=245 2024-03-26T16:58:39.001 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:39.001 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 246 2024-03-26T16:58:39.001 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:39.001 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:39.001 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:39.001 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:39.001 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:39.001 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=246 2024-03-26T16:58:39.002 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:39.002 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 247 2024-03-26T16:58:39.002 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:39.002 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:39.002 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:39.002 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:39.002 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:39.003 INFO:tasks.workunit.client.3.smithi157.stdout:Adding nqn.2016-06.io.spdk:cnode1 listener at 172.21.15.64:4420: Successful 2024-03-26T16:58:39.003 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=247 2024-03-26T16:58:39.003 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:39.004 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 248 2024-03-26T16:58:39.004 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:39.004 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:39.004 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:39.004 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:39.004 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:39.004 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=248 2024-03-26T16:58:39.004 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:39.004 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 249 2024-03-26T16:58:39.004 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:39.004 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:39.005 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:39.005 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:39.005 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:39.005 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=249 2024-03-26T16:58:39.005 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:39.005 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 250 2024-03-26T16:58:39.005 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:39.005 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:39.005 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:39.005 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:39.005 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:39.005 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=250 2024-03-26T16:58:39.006 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:39.006 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 251 2024-03-26T16:58:39.006 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:39.006 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:39.006 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:39.006 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:39.006 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:39.006 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=251 2024-03-26T16:58:39.006 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:39.006 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 252 2024-03-26T16:58:39.006 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:39.007 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:39.007 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:39.007 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:39.007 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:39.007 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=252 2024-03-26T16:58:39.007 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:39.007 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 253 2024-03-26T16:58:39.007 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:39.008 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:39.008 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:39.008 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:39.008 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:39.008 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=253 2024-03-26T16:58:39.008 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:39.008 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 254 2024-03-26T16:58:39.008 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:39.008 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:39.008 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:39.009 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:39.009 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:39.009 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=254 2024-03-26T16:58:39.009 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:39.009 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 255 2024-03-26T16:58:39.009 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:39.009 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:39.009 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:39.009 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:39.009 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:39.009 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=255 2024-03-26T16:58:39.010 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:39.010 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 256 2024-03-26T16:58:39.010 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:39.010 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:39.010 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:39.157 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:39.158 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:39.158 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=256 2024-03-26T16:58:39.265 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:38 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:38] INFO grpc.py:1992: Received request to create smithi064 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode1 at 172.21.15.64:4420, context: None 2024-03-26T16:58:39.265 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:38 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:38] INFO grpc.py:2031: Listener not created as gateway's host name smithi044 differs from requested host smithi064 2024-03-26T16:58:39.305 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:39.306 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:38] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:58:39.306 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:39 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:39] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}] 2024-03-26T16:58:39.396 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:38 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:38] INFO grpc.py:1992: Received request to create smithi064 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode1 at 172.21.15.64:4420, context: None 2024-03-26T16:58:39.396 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:38 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:38] INFO grpc.py:2031: Listener not created as gateway's host name smithi149 differs from requested host smithi064 2024-03-26T16:58:39.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:39 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:39] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:58:39.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:39 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:39] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}] 2024-03-26T16:58:39.858 INFO:tasks.workunit.client.3.smithi157.stderr:+ for j in $(seq 1 $NVMEOF_SUBSYSTEMS_COUNT) 2024-03-26T16:58:39.858 INFO:tasks.workunit.client.3.smithi157.stderr:+ subsystem_nqn=nqn.2016-06.io.spdk:cnode2 2024-03-26T16:58:39.858 INFO:tasks.workunit.client.3.smithi157.stderr:+ echo 'Adding gateway listener with IP 172.21.15.64 and name smithi064' 2024-03-26T16:58:39.858 INFO:tasks.workunit.client.3.smithi157.stdout:Adding gateway listener with IP 172.21.15.64 and name smithi064 2024-03-26T16:58:39.859 INFO:tasks.workunit.client.3.smithi157.stderr:+ sudo podman run -it quay.io/barakda1/nvmeof-cli:qe_ceph_devel_21e59b2 --server-address 172.21.15.64 --server-port 5500 listener add --subsystem nqn.2016-06.io.spdk:cnode2 --host-name smithi064 --traddr 172.21.15.64 --trsvcid 4420 2024-03-26T16:58:39.937 INFO:tasks.workunit.client.3.smithi157.stderr:time="2024-03-26T16:58:39Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2024-03-26T16:58:40.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:39 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:39] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:58:40.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:39 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:39] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}] 2024-03-26T16:58:40.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:58:40 smithi044 ceph-mon[30624]: pgmap v360: 33 pgs: 33 active+clean; 609 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 7.0 KiB/s rd, 682 B/s wr, 7 op/s 2024-03-26T16:58:40.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-mon[34420]: pgmap v360: 33 pgs: 33 active+clean; 609 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 7.0 KiB/s rd, 682 B/s wr, 7 op/s 2024-03-26T16:58:40.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:58:40 smithi149 ceph-mon[34678]: pgmap v360: 33 pgs: 33 active+clean; 609 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 7.0 KiB/s rd, 682 B/s wr, 7 op/s 2024-03-26T16:58:40.934 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:40] INFO grpc.py:1992: Received request to create smithi064 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode2 at 172.21.15.64:4420, context: 2024-03-26T16:58:40.934 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:40] INFO grpc.py:2023: create_listener: True 2024-03-26T16:58:40.935 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:40] INFO grpc.py:1958: Subsystem nqn.2016-06.io.spdk:cnode2 enable_ha: True 2024-03-26T16:58:40.935 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:40] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:40.935 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:40.935 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:40.935 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:40.935 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:40.935 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=1 2024-03-26T16:58:40.935 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:40] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:40.935 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:40] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:40.935 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:40.935 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:40.935 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:40.935 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:40.936 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=2 2024-03-26T16:58:40.936 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:40] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:40.936 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:40] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:40.936 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:40.936 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:40.936 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:40.936 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:40.936 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=3 2024-03-26T16:58:40.936 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:40] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:40.936 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:40] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:40.936 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:40.937 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:40.937 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:40.937 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:40.937 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=4 2024-03-26T16:58:40.937 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:40] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:40.937 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:40] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:40.937 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:40.937 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:40.937 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:40.938 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:40.938 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=5 2024-03-26T16:58:40.938 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:40] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:40.938 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:40] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:40.938 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:40.938 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:40.938 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:40.938 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:40.938 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=6 2024-03-26T16:58:40.938 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:40] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:40.938 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:40] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:40.938 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:40.939 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:40.939 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:40.939 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:40.939 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=7 2024-03-26T16:58:40.939 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:40] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:40.939 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:40] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:40.939 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:40.939 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:40.939 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:40.939 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:40.939 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=8 2024-03-26T16:58:40.939 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:40] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:40.939 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:40] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:40.939 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:40.940 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:40.940 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:40.940 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:40.940 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=9 2024-03-26T16:58:40.940 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:40] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:40.940 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:40] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:40.940 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:40.940 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:40.940 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:40.940 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:40.940 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=10 2024-03-26T16:58:40.940 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:40] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:40.940 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:40] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:40.940 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:40.941 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:40.941 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:40.941 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:40.941 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=11 2024-03-26T16:58:40.941 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:40] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:40.941 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:40] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:40.941 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:40.941 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:40.941 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:40.942 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:40.942 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=12 2024-03-26T16:58:40.942 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:40] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:40.942 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:40] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:40.942 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:40.942 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:40.943 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:40.943 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:40.943 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=13 2024-03-26T16:58:40.943 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:40] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:40.943 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:40] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:40.943 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:40.943 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:40.943 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:40.943 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:40.943 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=14 2024-03-26T16:58:40.944 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:40] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:40.944 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:40] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:40.944 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:40.944 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:40.944 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:40.944 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:40.944 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=15 2024-03-26T16:58:40.944 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:40] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:40.944 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:40] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:40.944 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:40.944 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:40.944 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:40.945 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:40.945 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=16 2024-03-26T16:58:40.945 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:40] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:40.945 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:40] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:40.945 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:40.945 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:40.945 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:40.945 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:40.945 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=17 2024-03-26T16:58:40.945 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:40] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:40.945 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:40] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:40.945 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:40.945 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:40.946 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:40.946 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:40.946 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=18 2024-03-26T16:58:40.946 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:40] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:40.946 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:40] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:40.946 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:40.946 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:40.946 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:40.946 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:40.946 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=19 2024-03-26T16:58:40.946 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:40] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:40.946 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:40] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:40.946 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:40.946 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:40.947 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:40.947 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:40.947 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=20 2024-03-26T16:58:40.947 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:40] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:40.947 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:40] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:40.947 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:40.947 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:40.947 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:40.947 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:40.947 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=21 2024-03-26T16:58:40.947 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:40] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:40.947 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:40] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:40.947 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:40.947 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:40.948 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:40.948 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:40.948 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=22 2024-03-26T16:58:40.948 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:40] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:40.948 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:40] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:40.948 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:40.948 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:40.948 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:40.948 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:40.948 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=23 2024-03-26T16:58:40.948 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:40] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:40.948 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:40] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:40.948 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:40.948 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:40.948 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:40.949 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:40.949 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=24 2024-03-26T16:58:40.949 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:40] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:40.949 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:40] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:40.949 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:40.949 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:40.949 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:40.949 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:40.949 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=25 2024-03-26T16:58:40.949 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:40] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:40.949 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:40] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:40.949 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:40.949 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:40.949 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:40.950 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:40.950 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=26 2024-03-26T16:58:40.950 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:40] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:40.950 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:40] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:40.950 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:40.950 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:40.950 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:40.950 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:40.950 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=27 2024-03-26T16:58:40.950 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:40] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:40.950 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:40] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:40.950 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:40.950 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:40.950 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:40.951 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:40.951 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=28 2024-03-26T16:58:40.951 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:40] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:40.951 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:40] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:40.951 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:40.951 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:40.951 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:40.951 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:40.951 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=29 2024-03-26T16:58:40.951 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:40] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:40.951 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:40] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:40.951 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:40.951 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:40.951 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:40.952 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:40.952 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=30 2024-03-26T16:58:40.952 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:40] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:40.952 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:40] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:40.952 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:40.952 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:40.952 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:40.952 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:40.952 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=31 2024-03-26T16:58:40.952 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:40] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:40.952 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:40] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:40.952 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:40.952 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:40.953 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:40.953 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:40.953 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=32 2024-03-26T16:58:41.191 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:40] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:41.191 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:40] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:41.191 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:41.191 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:41.191 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:41.191 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:41.191 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=33 2024-03-26T16:58:41.191 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:40] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:41.191 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:40] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:41.191 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:41.191 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:41.192 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:41.192 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:41.192 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=34 2024-03-26T16:58:41.192 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:40] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:41.192 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:40] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:41.192 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:41.192 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:41.192 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:41.192 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:41.192 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=35 2024-03-26T16:58:41.192 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:40] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:41.192 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:40] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:41.192 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:41.192 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:41.193 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:41.193 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:41.193 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=36 2024-03-26T16:58:41.193 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:40] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:41.193 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:40] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:41.194 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:41.194 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:41.194 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:41.194 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:41.194 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=37 2024-03-26T16:58:41.194 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:40] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:41.194 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:40] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:41.194 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:41.194 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:41.194 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:41.194 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:41.194 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=38 2024-03-26T16:58:41.194 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:40] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:41.195 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:40] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:41.195 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:41.195 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:41.195 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:41.195 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:41.195 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=39 2024-03-26T16:58:41.195 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:41.195 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:41.195 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:41.195 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:41.195 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:41.195 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:41.195 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=40 2024-03-26T16:58:41.196 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:41.196 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:41.196 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:41.196 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:41.196 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:41.196 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:41.196 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=41 2024-03-26T16:58:41.196 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:41.196 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:41.196 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:41.196 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:41.196 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:41.196 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:41.196 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=42 2024-03-26T16:58:41.197 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:41.197 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:41.197 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:41.197 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:41.197 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:41.197 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:41.197 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=43 2024-03-26T16:58:41.197 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:41.197 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:41.197 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:41.197 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:41.197 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:41.197 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:41.198 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=44 2024-03-26T16:58:41.198 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:41.198 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:41.198 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:41.198 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:41.198 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:41.198 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:41.198 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=45 2024-03-26T16:58:41.198 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:41.198 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:41.198 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:41.198 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:41.199 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:41.199 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:41.199 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=46 2024-03-26T16:58:41.199 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:41.199 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:41.199 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:41.199 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:41.199 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:41.199 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:41.199 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=47 2024-03-26T16:58:41.199 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:41.199 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:41.199 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:41.200 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:41.200 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:41.200 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:41.200 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=48 2024-03-26T16:58:41.200 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:41.201 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:41.201 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:41.201 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:41.201 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:41.201 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:41.201 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=49 2024-03-26T16:58:41.201 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:41.201 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:41.201 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:41.201 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:41.201 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:41.201 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:41.202 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=50 2024-03-26T16:58:41.202 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:41.202 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:41.202 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:41.202 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:41.202 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:41.202 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:41.202 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=51 2024-03-26T16:58:41.202 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:41.202 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:41.202 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:41.202 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:41.202 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:41.203 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:41.203 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=52 2024-03-26T16:58:41.203 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:41.203 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:41.203 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:41.203 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:41.203 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:41.203 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:41.203 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=53 2024-03-26T16:58:41.203 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:41.203 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:41.203 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:41.203 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:41.203 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:41.204 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:41.204 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=54 2024-03-26T16:58:41.204 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:41.204 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:41.204 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:41.204 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:41.204 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:41.204 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:41.204 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=55 2024-03-26T16:58:41.204 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:41.204 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:41.204 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:41.204 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:41.204 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:41.205 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:41.205 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=56 2024-03-26T16:58:41.205 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:41.205 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:41.205 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:41.205 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:41.205 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:41.205 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:41.205 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=57 2024-03-26T16:58:41.205 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:41.205 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:41.206 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:41.206 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:41.206 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:41.206 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:41.206 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=58 2024-03-26T16:58:41.206 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:41.206 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:41.206 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:41.206 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:41.206 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:41.206 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:41.206 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=59 2024-03-26T16:58:41.206 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:41.207 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:41.207 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:41.207 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:41.207 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:41.207 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:41.207 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=60 2024-03-26T16:58:41.207 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:41.207 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:41.207 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:41.207 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:41.207 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:41.207 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:41.208 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=61 2024-03-26T16:58:41.208 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:41.208 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:41.208 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:41.208 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:41.208 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:41.208 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:41.208 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=62 2024-03-26T16:58:41.208 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:41.208 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:41.208 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:41.208 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:41.208 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:41.208 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:41.209 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=63 2024-03-26T16:58:41.209 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:41.209 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:41.209 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:41.209 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:41.209 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:41.209 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:41.209 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=64 2024-03-26T16:58:41.446 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:41.447 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:41.447 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:41.447 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:41.447 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:41.447 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:41.447 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=65 2024-03-26T16:58:41.447 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:41.447 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:41.447 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:41.447 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:41.447 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:41.447 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:41.448 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=66 2024-03-26T16:58:41.448 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:41.448 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:41.448 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:41.448 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:41.448 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:41.448 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:41.448 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=67 2024-03-26T16:58:41.448 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:41.448 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:41.448 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:41.448 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:41.448 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:41.448 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:41.448 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=68 2024-03-26T16:58:41.449 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:41.449 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:41.449 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:41.449 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:41.449 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:41.449 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:41.450 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=69 2024-03-26T16:58:41.450 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:41.450 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:41.450 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:41.450 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:41.450 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:41.450 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:41.450 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=70 2024-03-26T16:58:41.450 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:41.450 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:41.450 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:41.450 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:41.450 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:41.451 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:41.451 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=71 2024-03-26T16:58:41.451 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:41.451 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:41.451 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:41.451 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:41.451 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:41.451 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:41.451 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=72 2024-03-26T16:58:41.451 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:41.451 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:41.451 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:41.451 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:41.451 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:41.452 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:41.452 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=73 2024-03-26T16:58:41.452 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:41.452 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:41.452 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:41.452 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:41.452 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:41.452 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:41.452 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=74 2024-03-26T16:58:41.452 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:41.452 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:41.452 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:41.453 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:41.453 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:41.453 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:41.453 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=75 2024-03-26T16:58:41.453 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:41.453 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:41.453 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:41.453 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:41.453 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:41.453 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:41.453 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=76 2024-03-26T16:58:41.454 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:41.454 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:41.454 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:41.454 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:41.455 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:41.455 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:41.455 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=77 2024-03-26T16:58:41.455 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:41.455 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:41.455 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:41.455 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:41.455 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:41.455 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:41.455 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=78 2024-03-26T16:58:41.455 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:41.455 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:41.455 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:41.455 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:41.456 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:41.456 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:41.456 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=79 2024-03-26T16:58:41.456 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:41.456 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:41.456 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:41.456 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:41.456 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:41.456 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:41.456 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=80 2024-03-26T16:58:41.456 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:41.456 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:41.456 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:41.456 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:41.457 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:41.457 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:41.457 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=81 2024-03-26T16:58:41.457 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:41.457 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:41.457 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:41.457 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:41.457 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:41.457 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:41.457 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=82 2024-03-26T16:58:41.458 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:41.458 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:41.458 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:41.458 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:41.458 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:41.458 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:41.458 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=83 2024-03-26T16:58:41.458 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:41.458 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:41.458 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:41.458 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:41.458 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:41.458 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:41.459 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=84 2024-03-26T16:58:41.459 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:41.459 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:41.459 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:41.459 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:41.459 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:41.459 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:41.459 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=85 2024-03-26T16:58:41.459 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:41.459 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:41.459 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:41.459 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:41.459 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:41.459 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:41.460 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=86 2024-03-26T16:58:41.460 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:41.460 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:41.460 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:41.460 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:41.460 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:41.460 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:41.460 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=87 2024-03-26T16:58:41.460 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:41.460 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:41.460 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:41.460 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:41.460 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:41.461 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:41.461 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=88 2024-03-26T16:58:41.461 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:41.461 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:41.461 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:41.461 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:41.461 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:41.461 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:41.461 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=89 2024-03-26T16:58:41.461 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:41.461 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:41.461 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:41.461 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:41.461 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:41.462 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:41.462 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=90 2024-03-26T16:58:41.462 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:41.462 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:41.462 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:41.462 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:41.462 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:41.462 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:41.462 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=91 2024-03-26T16:58:41.462 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:41.462 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:41.462 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:41.462 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:41.462 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:41.463 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:41.463 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=92 2024-03-26T16:58:41.463 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:41.463 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:41.463 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:41.463 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:41.463 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:41.463 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:41.463 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=93 2024-03-26T16:58:41.463 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:41.463 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:41.463 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:41.463 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:41.463 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:41.464 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:41.464 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=94 2024-03-26T16:58:41.464 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:41.464 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:41.464 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:41.464 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:41.464 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:41.464 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:41.464 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=95 2024-03-26T16:58:41.464 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:41.464 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:41.464 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:41.464 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:41.465 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:41.465 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:41.465 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=96 2024-03-26T16:58:41.702 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:41.703 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:41.703 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:41.703 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:41.703 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:41.703 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:41.703 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=97 2024-03-26T16:58:41.703 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:41.703 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:41.703 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:41.703 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:41.703 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:41.703 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:41.704 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=98 2024-03-26T16:58:41.704 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:41.704 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:41.704 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:41.704 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:41.704 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:41.704 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:41.704 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=99 2024-03-26T16:58:41.704 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:41.704 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:41.704 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:41.704 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:41.704 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:41.704 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:41.705 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=100 2024-03-26T16:58:41.705 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:41.705 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:41.705 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:41.705 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:41.705 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:41.705 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:41.706 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=101 2024-03-26T16:58:41.706 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:41.706 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:41.706 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:41.706 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:41.706 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:41.706 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:41.706 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=102 2024-03-26T16:58:41.706 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:41.706 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:41.706 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:41.706 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:41.706 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:41.707 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:41.707 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=103 2024-03-26T16:58:41.707 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:41.707 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:41.707 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:41.707 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:41.707 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:41.707 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:41.707 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=104 2024-03-26T16:58:41.707 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:41.707 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:41.707 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:41.707 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:41.707 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:41.708 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:41.708 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=105 2024-03-26T16:58:41.708 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:41.708 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:41.708 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:41.708 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:41.708 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:41.708 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:41.708 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=106 2024-03-26T16:58:41.708 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:41.708 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:41.708 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:41.708 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:41.708 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:41.708 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:41.709 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=107 2024-03-26T16:58:41.709 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:41.709 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:41.709 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:41.709 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:41.709 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:41.709 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:41.709 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=108 2024-03-26T16:58:41.710 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:41.710 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:41.711 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:41.711 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:41.711 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:41.711 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:41.711 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=109 2024-03-26T16:58:41.711 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:41.711 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:41.711 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:41.711 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:41.711 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:41.711 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:41.711 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=110 2024-03-26T16:58:41.711 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:41.711 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:41.712 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:41.712 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:41.712 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:41.712 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:41.712 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=111 2024-03-26T16:58:41.712 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:41.712 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:41.712 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:41.712 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:41.712 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:41.712 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:41.712 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=112 2024-03-26T16:58:41.712 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:41.712 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:41.713 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:41.713 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:41.713 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:41.713 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:41.713 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=113 2024-03-26T16:58:41.713 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:41.713 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:41.713 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:41.713 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:41.713 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:41.713 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:41.713 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=114 2024-03-26T16:58:41.713 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:41.713 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:41.714 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:41.714 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:41.714 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:41.714 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:41.714 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=115 2024-03-26T16:58:41.714 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:41.714 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:41.714 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:41.714 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:41.714 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:41.714 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:41.714 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=116 2024-03-26T16:58:41.714 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:41.714 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:41.715 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:41.715 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:41.715 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:41.715 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:41.715 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=117 2024-03-26T16:58:41.715 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:41.715 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:41.715 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:41.715 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:41.715 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:41.715 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:41.715 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=118 2024-03-26T16:58:41.715 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:41.715 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:41.716 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:41.716 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:41.716 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:41.716 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:41.716 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=119 2024-03-26T16:58:41.716 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:41.716 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:41.716 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:41.716 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:41.716 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:41.716 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:41.716 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=120 2024-03-26T16:58:41.716 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:41.716 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:41.717 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:41.717 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:41.717 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:41.717 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:41.717 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=121 2024-03-26T16:58:41.717 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:41.717 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:41.717 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:41.717 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:41.717 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:41.717 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:41.717 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=122 2024-03-26T16:58:41.717 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:41.717 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:41.718 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:41.718 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:41.718 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:41.718 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:41.718 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=123 2024-03-26T16:58:41.718 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:41.718 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:41.718 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:41.718 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:41.718 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:41.718 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:41.718 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=124 2024-03-26T16:58:41.718 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:41.719 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:41.719 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:41.719 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:41.719 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:41.719 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:41.719 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=125 2024-03-26T16:58:41.719 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:41.719 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:41.719 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:41.719 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:41.719 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:41.719 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:41.719 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=126 2024-03-26T16:58:41.719 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:41.719 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:41.720 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:41.720 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:41.720 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:41.720 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:41.720 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=127 2024-03-26T16:58:41.720 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:41.720 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:41.720 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:41.720 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:41.720 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:41.720 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:41.720 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=128 2024-03-26T16:58:41.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:41 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:41] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:58:41.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:41 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:41] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}] 2024-03-26T16:58:41.958 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:41.959 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:41.959 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:41.959 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:41.959 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:41.959 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:41.959 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=129 2024-03-26T16:58:41.959 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:41.959 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:41.959 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:41.959 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:41.959 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:41.959 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:41.959 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=130 2024-03-26T16:58:41.959 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:41.960 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:41.960 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:41.960 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:41.960 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:41.960 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:41.960 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=131 2024-03-26T16:58:41.960 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:41.960 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:41.960 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:41.960 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:41.960 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:41.960 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:41.960 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=132 2024-03-26T16:58:41.961 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:41.961 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:41.961 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:41.961 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:41.961 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:41.961 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:41.961 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=133 2024-03-26T16:58:41.961 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:41.962 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:41.962 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:41.962 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:41.962 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:41.962 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:41.962 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=134 2024-03-26T16:58:41.962 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:41.962 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:41.962 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:41.962 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:41.962 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:41.962 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:41.962 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=135 2024-03-26T16:58:41.962 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:41.963 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:41.963 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:41.963 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:41.963 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:41.963 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:41.963 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=136 2024-03-26T16:58:41.963 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:41.963 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:41.963 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:41.963 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:41.963 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:41.963 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:41.963 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=137 2024-03-26T16:58:41.963 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:41.964 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:41.964 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:41.964 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:41.964 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:41.964 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:41.964 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=138 2024-03-26T16:58:41.964 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:41.964 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:41.964 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:41.964 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:41.964 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:41.964 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:41.964 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=139 2024-03-26T16:58:41.964 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:41.964 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:41.965 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:41.965 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:41.965 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:41.965 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:41.965 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=140 2024-03-26T16:58:41.966 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:41.966 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:41.966 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:41.966 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:41.966 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:41.966 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:41.966 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=141 2024-03-26T16:58:41.966 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:41.966 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:41.966 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:41.966 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:41.967 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:41.967 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:41.967 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=142 2024-03-26T16:58:41.967 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:41.967 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:41.967 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:41.967 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:41.967 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:41.967 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:41.967 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=143 2024-03-26T16:58:41.967 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:41.967 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:41.967 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:41.967 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:41.967 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:41.968 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:41.968 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=144 2024-03-26T16:58:41.968 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:41.968 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:41.968 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:41.968 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:41.968 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:41.968 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:41.968 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=145 2024-03-26T16:58:41.968 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:41.968 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:41.968 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:41.968 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:41.968 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:41.968 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:41.969 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=146 2024-03-26T16:58:41.969 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:41.969 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:41.969 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:41.969 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:41.969 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:41.969 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:41.969 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=147 2024-03-26T16:58:41.969 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:41.969 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:41.969 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:41.969 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:41.969 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:41.969 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:41.969 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=148 2024-03-26T16:58:41.970 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:41.970 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:41.970 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:41.970 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:41.970 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:41.970 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:41.970 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=149 2024-03-26T16:58:41.970 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:41.970 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:41.970 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:41.970 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:41.970 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:41.970 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:41.970 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=150 2024-03-26T16:58:41.971 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:41.971 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:41.971 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:41.971 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:41.971 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:41.971 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:41.971 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=151 2024-03-26T16:58:41.971 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:41.971 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:41.971 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:41.971 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:41.971 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:41.971 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:41.971 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=152 2024-03-26T16:58:41.971 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:41.972 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:41.972 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:41.972 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:41.972 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:41.972 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:41.972 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=153 2024-03-26T16:58:41.972 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:41.972 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:41.972 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:41.972 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:41.972 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:41.972 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:41.972 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=154 2024-03-26T16:58:41.972 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:41.973 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:41.973 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:41.973 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:41.973 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:41.973 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:41.973 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=155 2024-03-26T16:58:41.973 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:41.973 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:41.973 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:41.973 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:41.973 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:41.973 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:41.973 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=156 2024-03-26T16:58:41.973 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:41.974 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:41.974 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:41.974 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:41.974 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:41.974 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:41.974 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=157 2024-03-26T16:58:41.974 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:41.974 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:41.974 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:41.974 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:41.974 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:41.974 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:41.974 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=158 2024-03-26T16:58:41.974 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:41.975 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:41.975 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:41.975 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:41.975 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:41.975 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:41.975 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=159 2024-03-26T16:58:41.975 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:41.975 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:41.975 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:41.975 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:41.975 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:41.975 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:41.975 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=160 2024-03-26T16:58:42.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:41 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:41] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:58:42.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:41 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:41] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}] 2024-03-26T16:58:42.213 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-mon[34420]: pgmap v361: 33 pgs: 33 active+clean; 609 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 4.7 KiB/s rd, 511 B/s wr, 4 op/s 2024-03-26T16:58:42.214 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:42.214 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:42.214 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:42.215 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:42.215 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:42.215 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:42.215 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=161 2024-03-26T16:58:42.215 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:42.215 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:42.215 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:42.215 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:42.215 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:42.215 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:42.215 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=162 2024-03-26T16:58:42.215 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:42.215 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:42.215 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:42.216 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:42.216 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:42.216 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:42.216 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=163 2024-03-26T16:58:42.216 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:42.216 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:41] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:42.216 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:42.216 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:42.216 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:42.216 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:42.216 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=164 2024-03-26T16:58:42.217 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:42] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:42.217 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:42] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:42.217 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:42.217 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:42.217 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:42.217 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:42.217 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=165 2024-03-26T16:58:42.217 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:42] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:42.217 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:42] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:42.217 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:42.218 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:42.218 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:42.218 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:42.218 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=166 2024-03-26T16:58:42.218 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:42] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:42.218 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:42] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:42.218 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:42.218 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:42.218 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:42.218 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:42.218 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=167 2024-03-26T16:58:42.218 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:42] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:42.218 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:42] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:42.218 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:42.219 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:42.219 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:42.219 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:42.219 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=168 2024-03-26T16:58:42.219 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:42] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:42.219 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:42] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:42.219 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:42.219 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:42.219 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:42.219 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:42.219 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=169 2024-03-26T16:58:42.219 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:42] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:42.219 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:42] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:42.220 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:42.220 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:42.220 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:42.220 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:42.220 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=170 2024-03-26T16:58:42.220 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:42] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:42.220 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:42] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:42.220 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:42.220 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:42.220 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:42.220 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:42.220 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=171 2024-03-26T16:58:42.220 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:42] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:42.220 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:42] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:42.221 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:42.221 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:42.221 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:42.221 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:42.221 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=172 2024-03-26T16:58:42.222 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:42] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:42.222 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:42] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:42.222 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:42.222 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:42.222 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:42.222 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:42.222 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=173 2024-03-26T16:58:42.222 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:42] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:42.222 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:42] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:42.222 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:42.223 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:42.223 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:42.223 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:42.223 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=174 2024-03-26T16:58:42.223 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:42] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:42.223 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:42] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:42.223 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:42.223 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:42.223 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:42.223 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:42.223 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=175 2024-03-26T16:58:42.224 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:42] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:42.224 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:42] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:42.224 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:42.224 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:42.224 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:42.224 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:42.224 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=176 2024-03-26T16:58:42.224 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:42] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:42.224 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:42] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:42.224 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:42.224 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:42.224 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:42.225 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:42.225 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=177 2024-03-26T16:58:42.225 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:42] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:42.225 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:42] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:42.225 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:42.225 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:42.225 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:42.225 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:42.225 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=178 2024-03-26T16:58:42.225 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:42] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:42.225 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:42] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:42.225 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:42.225 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:42.225 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:42.226 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:42.226 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=179 2024-03-26T16:58:42.226 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:42] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:42.226 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:42] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:42.226 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:42.226 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:42.226 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:42.226 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:42.226 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=180 2024-03-26T16:58:42.226 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:42] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:42.226 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:42] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:42.226 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:42.226 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:42.227 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:42.227 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:42.227 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=181 2024-03-26T16:58:42.227 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:42] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:42.227 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:42] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:42.227 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:42.227 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:42.227 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:42.227 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:42.227 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=182 2024-03-26T16:58:42.227 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:42] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:42.227 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:42] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:42.227 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:42.228 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:42.228 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:42.228 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:42.228 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=183 2024-03-26T16:58:42.228 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:42] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:42.228 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:42] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:42.228 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:42.228 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:42.228 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:42.228 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:42.228 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=184 2024-03-26T16:58:42.228 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:42] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:42.228 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:42] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:42.229 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:42.229 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:42.229 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:42.229 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:42.229 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=185 2024-03-26T16:58:42.229 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:42] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:42.229 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:42] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:42.229 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:42.229 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:42.229 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:42.229 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:42.229 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=186 2024-03-26T16:58:42.229 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:42] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:42.229 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:42] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:42.230 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:42.230 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:42.230 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:42.230 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:42.230 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=187 2024-03-26T16:58:42.230 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:42] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:42.230 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:42] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:42.230 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:42.230 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:42.230 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:42.230 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:42.230 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=188 2024-03-26T16:58:42.230 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:42] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:42.231 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:42] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:42.231 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:42.231 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:42.231 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:42.231 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:42.231 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=189 2024-03-26T16:58:42.231 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:42] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:42.231 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:42] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:42.231 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:42.231 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:42.231 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:42.231 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:42.231 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=190 2024-03-26T16:58:42.232 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:42] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:42.232 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:42] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:42.232 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:42.232 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:42.232 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:42.232 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:42.232 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=191 2024-03-26T16:58:42.232 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:42] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:42.232 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:42] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:42.232 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:42.232 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:42.232 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:42.232 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:42.232 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=192 2024-03-26T16:58:42.470 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:42] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:42.471 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:42] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:42.471 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:42.471 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:42.471 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:42.471 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:42.471 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=193 2024-03-26T16:58:42.471 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:42] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:42.471 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:42] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:42.471 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:42.471 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:42.471 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:42.471 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:42.471 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=194 2024-03-26T16:58:42.472 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:42] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:42.472 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:42] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:42.472 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:42.472 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:42.472 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:42.472 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:42.472 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=195 2024-03-26T16:58:42.472 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:42] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:42.472 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:42] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:42.472 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:42.472 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:42.472 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:42.472 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:42.472 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=196 2024-03-26T16:58:42.473 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:42] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:42.473 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:42] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:42.473 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:42.473 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:42.473 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:42.473 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:42.473 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=197 2024-03-26T16:58:42.473 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:42] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:42.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:42] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:42.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:42.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:42.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:42.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:42.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=198 2024-03-26T16:58:42.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:42] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:42.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:42] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:42.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:42.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:42.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:42.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:42.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=199 2024-03-26T16:58:42.475 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:42] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:42.475 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:42] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:42.475 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:42.475 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:42.475 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:42.475 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:42.475 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=200 2024-03-26T16:58:42.475 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:42] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:42.475 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:42] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:42.475 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:42.475 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:42.475 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:42.475 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:42.475 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=201 2024-03-26T16:58:42.476 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:42] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:42.476 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:42] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:42.476 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:42.476 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:42.476 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:42.476 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:42.476 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=202 2024-03-26T16:58:42.476 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:42] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:42.476 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:42] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:42.476 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:42.476 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:42.476 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:42.476 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:42.476 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=203 2024-03-26T16:58:42.477 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:42] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:42.477 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:42] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:42.477 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:42.477 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:42.477 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:42.477 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:42.477 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=204 2024-03-26T16:58:42.478 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:42] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:42.478 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:42] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:42.478 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:42.478 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:42.478 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:42.478 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:42.478 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=205 2024-03-26T16:58:42.478 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:42] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:42.479 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:42] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:42.479 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:42.479 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:42.479 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:42.479 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:42.479 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=206 2024-03-26T16:58:42.479 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:42] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:42.479 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:42] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:42.479 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:42.479 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:42.479 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:42.479 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:42.479 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=207 2024-03-26T16:58:42.479 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:42] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:42.480 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:42] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:42.480 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:42.480 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:42.480 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:42.480 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:42.480 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=208 2024-03-26T16:58:42.480 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:42] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:42.480 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:42] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:42.480 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:42.480 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:42.480 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:42.480 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:42.480 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=209 2024-03-26T16:58:42.480 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:42] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:42.480 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:42] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:42.481 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:42.481 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:42.481 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:42.481 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:42.481 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=210 2024-03-26T16:58:42.481 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:42] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:42.481 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:42] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:42.481 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:42.481 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:42.481 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:42.481 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:42.481 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=211 2024-03-26T16:58:42.481 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:42] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:42.481 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:42] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:42.482 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:42.482 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:42.482 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:42.482 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:42.482 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=212 2024-03-26T16:58:42.482 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:42] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:42.482 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:42] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:42.482 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:42.482 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:42.482 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:42.482 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:42.482 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=213 2024-03-26T16:58:42.482 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:42] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:42.482 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:42] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:42.483 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:42.483 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:42.483 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:42.483 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:42.483 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=214 2024-03-26T16:58:42.483 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:42] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:42.483 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:42] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:42.483 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:42.483 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:42.483 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:42.483 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:42.483 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=215 2024-03-26T16:58:42.483 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:42] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:42.483 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:42] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:42.484 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:42.484 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:42.484 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:42.484 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:42.484 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=216 2024-03-26T16:58:42.484 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:42] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:42.484 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:42] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:42.484 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:42.484 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:42.484 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:42.484 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:42.484 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=217 2024-03-26T16:58:42.484 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:42] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:42.484 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:42] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:42.485 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:42.485 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:42.485 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:42.485 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:42.485 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=218 2024-03-26T16:58:42.485 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:42] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:42.485 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:42] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:42.485 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:42.485 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:42.485 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:42.485 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:42.485 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=219 2024-03-26T16:58:42.485 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:42] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:42.485 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:42] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:42.485 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:42.486 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:42.486 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:42.486 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:42.486 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=220 2024-03-26T16:58:42.486 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:42] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:42.486 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:42] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:42.486 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:42.486 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:42.486 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:42.486 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:42.486 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=221 2024-03-26T16:58:42.486 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:42] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:42.486 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:42] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:42.487 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:42.487 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:42.487 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:42.487 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:42.487 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=222 2024-03-26T16:58:42.487 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:42] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:42.487 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:42] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:42.487 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:42.487 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:42.487 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:42.487 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:42.487 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=223 2024-03-26T16:58:42.487 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:42] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:42.487 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:42] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:42.488 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:42.488 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:42.488 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:42.488 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:42.488 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=224 2024-03-26T16:58:42.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:58:42 smithi044 ceph-mon[30624]: pgmap v361: 33 pgs: 33 active+clean; 609 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 4.7 KiB/s rd, 511 B/s wr, 4 op/s 2024-03-26T16:58:42.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:58:42 smithi149 ceph-mon[34678]: pgmap v361: 33 pgs: 33 active+clean; 609 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 4.7 KiB/s rd, 511 B/s wr, 4 op/s 2024-03-26T16:58:42.726 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:42] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:42.726 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:42] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:42.727 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:42.727 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:42.727 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:42.727 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:42.727 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=225 2024-03-26T16:58:42.727 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:42] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:42.727 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:42] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:42.727 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:42.727 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:42.727 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:42.727 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:42.727 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=226 2024-03-26T16:58:42.728 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:42] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:42.728 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:42] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:42.728 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:42.728 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:42.728 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:42.728 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:42.728 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=227 2024-03-26T16:58:42.728 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:42] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:42.728 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:42] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:42.728 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:42.728 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:42.728 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:42.728 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:42.728 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=228 2024-03-26T16:58:42.729 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:42] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:42.729 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:42] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:42.729 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:42.729 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:42.729 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:42.729 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:42.729 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=229 2024-03-26T16:58:42.730 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:42] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:42.730 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:42] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:42.730 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:42.730 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:42.730 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:42.730 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:42.730 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=230 2024-03-26T16:58:42.730 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:42] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:42.730 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:42] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:42.730 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:42.730 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:42.730 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:42.730 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:42.731 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=231 2024-03-26T16:58:42.731 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:42] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:42.731 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:42] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:42.731 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:42.731 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:42.731 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:42.731 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:42.731 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=232 2024-03-26T16:58:42.731 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:42] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:42.731 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:42] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:42.731 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:42.731 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:42.731 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:42.731 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:42.732 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=233 2024-03-26T16:58:42.732 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:42] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:42.732 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:42] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:42.732 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:42.732 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:42.732 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:42.732 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:42.732 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=234 2024-03-26T16:58:42.732 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:42] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:42.732 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:42] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:42.732 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:42.732 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:42.732 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:42.732 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:42.732 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=235 2024-03-26T16:58:42.733 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:42] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:42.733 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:42] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:42.733 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:42.733 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:42.733 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:42.733 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:42.733 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=236 2024-03-26T16:58:42.734 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:42] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:42.734 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:42] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:42.734 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:42.734 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:42.734 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:42.734 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:42.734 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=237 2024-03-26T16:58:42.734 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:42] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:42.734 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:42] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:42.735 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:42.735 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:42.735 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:42.735 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:42.735 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=238 2024-03-26T16:58:42.735 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:42] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:42.735 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:42] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:42.735 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:42.735 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:42.735 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:42.735 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:42.735 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=239 2024-03-26T16:58:42.735 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:42] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:42.735 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:42] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:42.736 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:42.736 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:42.736 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:42.736 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:42.736 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=240 2024-03-26T16:58:42.736 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:42] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:42.736 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:42] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:42.736 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:42.736 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:42.736 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:42.736 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:42.736 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=241 2024-03-26T16:58:42.736 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:42] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:42.736 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:42] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:42.736 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:42.737 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:42.737 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:42.737 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:42.737 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=242 2024-03-26T16:58:42.737 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:42] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:42.737 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:42] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:42.737 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:42.737 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:42.737 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:42.737 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:42.737 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=243 2024-03-26T16:58:42.737 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:42] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:42.737 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:42] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:42.737 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:42.737 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:42.738 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:42.738 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:42.738 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=244 2024-03-26T16:58:42.738 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:42] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:42.738 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:42] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:42.738 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:42.738 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:42.738 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:42.738 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:42.738 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=245 2024-03-26T16:58:42.738 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:42] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:42.738 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:42] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:42.738 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:42.738 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:42.739 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:42.739 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:42.739 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=246 2024-03-26T16:58:42.739 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:42] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:42.739 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:42] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:42.739 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:42.739 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:42.739 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:42.739 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:42.739 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=247 2024-03-26T16:58:42.739 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:42] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:42.739 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:42] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:42.739 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:42.739 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:42.740 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:42.740 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:42.740 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=248 2024-03-26T16:58:42.740 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:42] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:42.740 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:42] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:42.740 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:42.740 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:42.740 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:42.740 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:42.740 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=249 2024-03-26T16:58:42.740 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:42] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:42.740 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:42] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:42.740 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:42.740 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:42.741 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:42.741 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:42.741 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=250 2024-03-26T16:58:42.741 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:42] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:42.741 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:42] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:42.741 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:42.741 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:42.741 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:42.741 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:42.741 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=251 2024-03-26T16:58:42.741 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:42] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:42.741 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:42] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:42.741 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:42.741 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:42.742 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:42.742 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:42.742 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=252 2024-03-26T16:58:42.742 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:42] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:42.742 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:42] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:42.742 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:42.742 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:42.742 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:42.742 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:42.742 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=253 2024-03-26T16:58:42.742 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:42] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:42.742 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:42] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:42.742 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:42.743 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:42.743 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:42.743 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:42.743 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=254 2024-03-26T16:58:42.743 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:42] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:42.743 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:42] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:42.743 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:42.743 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:42.743 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:42.743 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:42.743 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=255 2024-03-26T16:58:42.743 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:42] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:42.743 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:42] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:42.743 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:42.743 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:42.744 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:42.744 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:42.744 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=256 2024-03-26T16:58:42.747 INFO:tasks.workunit.client.3.smithi157.stdout:Adding nqn.2016-06.io.spdk:cnode2 listener at 172.21.15.64:4420: Successful 2024-03-26T16:58:43.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:42 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:42] INFO grpc.py:1992: Received request to create smithi064 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode2 at 172.21.15.64:4420, context: None 2024-03-26T16:58:43.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:42 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:42] INFO grpc.py:2031: Listener not created as gateway's host name smithi044 differs from requested host smithi064 2024-03-26T16:58:43.055 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:42] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:43.055 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:42] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:58:43.055 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:42] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}] 2024-03-26T16:58:43.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:42 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:42] INFO grpc.py:1992: Received request to create smithi064 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode2 at 172.21.15.64:4420, context: None 2024-03-26T16:58:43.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:42 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:42] INFO grpc.py:2031: Listener not created as gateway's host name smithi149 differs from requested host smithi064 2024-03-26T16:58:43.651 INFO:tasks.workunit.client.3.smithi157.stderr:+ for j in $(seq 1 $NVMEOF_SUBSYSTEMS_COUNT) 2024-03-26T16:58:43.651 INFO:tasks.workunit.client.3.smithi157.stderr:+ subsystem_nqn=nqn.2016-06.io.spdk:cnode3 2024-03-26T16:58:43.652 INFO:tasks.workunit.client.3.smithi157.stdout:Adding gateway listener with IP 172.21.15.64 and name smithi064 2024-03-26T16:58:43.652 INFO:tasks.workunit.client.3.smithi157.stderr:+ echo 'Adding gateway listener with IP 172.21.15.64 and name smithi064' 2024-03-26T16:58:43.652 INFO:tasks.workunit.client.3.smithi157.stderr:+ sudo podman run -it quay.io/barakda1/nvmeof-cli:qe_ceph_devel_21e59b2 --server-address 172.21.15.64 --server-port 5500 listener add --subsystem nqn.2016-06.io.spdk:cnode3 --host-name smithi064 --traddr 172.21.15.64 --trsvcid 4420 2024-03-26T16:58:43.735 INFO:tasks.workunit.client.3.smithi157.stderr:time="2024-03-26T16:58:43Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2024-03-26T16:58:43.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:43 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:43] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:58:43.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:43 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:43] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}] 2024-03-26T16:58:44.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:43 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:43] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:58:44.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:43 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:43] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}] 2024-03-26T16:58:44.438 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-mon[34420]: pgmap v362: 33 pgs: 33 active+clean; 609 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 6.5 KiB/s rd, 682 B/s wr, 6 op/s 2024-03-26T16:58:44.438 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:44] INFO grpc.py:1992: Received request to create smithi064 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode3 at 172.21.15.64:4420, context: 2024-03-26T16:58:44.438 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:44] INFO grpc.py:2023: create_listener: True 2024-03-26T16:58:44.438 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:44] INFO grpc.py:1958: Subsystem nqn.2016-06.io.spdk:cnode3 enable_ha: True 2024-03-26T16:58:44.439 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:44] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:44.439 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:44.439 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:44.439 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:44.439 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:44.439 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=1 2024-03-26T16:58:44.439 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:44] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:44.439 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:44] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:44.439 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:44.439 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:44.439 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:44.439 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:44.439 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=2 2024-03-26T16:58:44.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:58:44 smithi044 ceph-mon[30624]: pgmap v362: 33 pgs: 33 active+clean; 609 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 6.5 KiB/s rd, 682 B/s wr, 6 op/s 2024-03-26T16:58:44.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:58:44 smithi149 ceph-mon[34678]: pgmap v362: 33 pgs: 33 active+clean; 609 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 6.5 KiB/s rd, 682 B/s wr, 6 op/s 2024-03-26T16:58:44.695 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:44] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:44.695 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:44] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:44.695 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:44.696 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:44.696 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:44.696 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:44.696 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=3 2024-03-26T16:58:44.696 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:44] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:44.696 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:44] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:44.696 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:44.697 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:44.697 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:44.697 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:44.697 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=4 2024-03-26T16:58:44.697 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:44] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:44.697 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:44] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:44.697 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:44.698 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:44.698 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:44.698 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:44.698 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=5 2024-03-26T16:58:44.698 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:44] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:44.698 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:44] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:44.698 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:44.699 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:44.699 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:44.699 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:44.699 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=6 2024-03-26T16:58:44.699 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:44] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:44.699 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:44] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:44.699 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:44.699 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:44.700 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:44.700 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:44.700 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=7 2024-03-26T16:58:44.700 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:44] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:44.700 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:44] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:44.700 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:44.700 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:44.701 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:44.701 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:44.701 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=8 2024-03-26T16:58:44.701 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:44] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:44.701 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:44] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:44.701 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:44.701 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:44.702 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:44.702 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:44.702 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=9 2024-03-26T16:58:44.702 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:44] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:44.702 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:44] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:44.702 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:44.702 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:44.703 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:44.703 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:44.703 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=10 2024-03-26T16:58:44.703 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:44] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:44.703 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:44] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:44.703 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:44.704 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:44.704 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:44.704 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:44.704 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=11 2024-03-26T16:58:44.704 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:44] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:44.704 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:44] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:44.704 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:44.704 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:44.705 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:44.705 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:44.705 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=12 2024-03-26T16:58:44.705 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:44] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:44.705 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:44] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:44.705 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:44.705 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:44.705 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:44.705 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:44.705 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=13 2024-03-26T16:58:44.706 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:44] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:44.706 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:44] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:44.706 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:44.706 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:44.706 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:44.706 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:44.706 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=14 2024-03-26T16:58:44.707 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:44] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:44.708 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:44] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:44.708 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:44.708 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:44.708 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:44.708 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:44.708 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=15 2024-03-26T16:58:44.708 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:44] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:44.709 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:44] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:44.709 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:44.709 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:44.709 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:44.709 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:44.709 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=16 2024-03-26T16:58:44.709 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:44] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:44.709 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:44] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:44.710 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:44.710 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:44.710 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:44.710 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:44.710 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=17 2024-03-26T16:58:44.710 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:44] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:44.710 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:44] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:44.710 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:44.710 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:44.711 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:44.711 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:44.711 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=18 2024-03-26T16:58:44.711 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:44] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:44.711 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:44] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:44.711 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:44.711 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:44.712 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:44.712 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:44.712 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=19 2024-03-26T16:58:44.712 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:44] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:44.712 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:44] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:44.712 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:44.712 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:44.712 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:44.713 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:44.713 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=20 2024-03-26T16:58:44.713 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:44] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:44.713 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:44] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:44.713 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:44.713 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:44.713 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:44.713 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:44.714 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=21 2024-03-26T16:58:44.714 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:44] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:44.714 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:44] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:44.714 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:44.714 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:44.714 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:44.714 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:44.715 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=22 2024-03-26T16:58:44.715 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:44] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:44.715 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:44] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:44.715 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:44.715 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:44.715 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:44.715 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:44.715 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=23 2024-03-26T16:58:44.716 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:44] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:44.716 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:44] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:44.716 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:44.716 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:44.716 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:44.716 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:44.716 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=24 2024-03-26T16:58:44.717 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:44] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:44.717 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:44] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:44.717 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:44.717 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:44.717 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:44.717 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:44.717 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=25 2024-03-26T16:58:44.717 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:44] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:44.718 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:44] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:44.718 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:44.718 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:44.718 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:44.718 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:44.718 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=26 2024-03-26T16:58:44.718 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:44] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:44.718 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:44] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:44.719 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:44.719 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:44.719 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:44.719 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:44.719 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=27 2024-03-26T16:58:44.719 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:44] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:44.719 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:44] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:44.720 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:44.720 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:44.720 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:44.720 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:44.720 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=28 2024-03-26T16:58:44.720 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:44] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:44.720 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:44] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:44.720 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:44.720 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:44.721 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:44.721 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:44.721 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=29 2024-03-26T16:58:44.721 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:44] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:44.721 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:44] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:44.721 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:44.721 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:44.721 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:44.722 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:44.722 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=30 2024-03-26T16:58:44.722 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:44] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:44.722 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:44] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:44.722 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:44.722 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:44.722 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:44.722 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:44.723 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=31 2024-03-26T16:58:44.723 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:44] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:44.723 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:44] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:44.723 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:44.723 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:44.723 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:44.723 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:44.723 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=32 2024-03-26T16:58:44.724 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:44] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:44.724 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:44] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:44.724 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:44.724 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:44.724 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:44.724 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:44.724 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=33 2024-03-26T16:58:44.724 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:44] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:44.725 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:44] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:44.725 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:44.725 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:44.725 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:44.725 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:44.725 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=34 2024-03-26T16:58:44.950 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:44] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:44.951 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:44] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:44.951 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:44.951 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:44.951 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:44.951 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:44.951 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=35 2024-03-26T16:58:44.951 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:44] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:44.951 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:44] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:44.951 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:44.951 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:44.951 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:44.951 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:44.951 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=36 2024-03-26T16:58:44.951 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:44] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:44.952 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:44] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:44.952 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:44.952 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:44.952 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:44.952 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:44.952 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=37 2024-03-26T16:58:44.952 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:44] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:44.952 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:44] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:44.952 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:44.952 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:44.952 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:44.952 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:44.952 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=38 2024-03-26T16:58:44.953 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:44] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:44.953 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:44] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:44.953 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:44.953 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:44.953 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:44.953 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:44.953 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=39 2024-03-26T16:58:44.953 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:44] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:44.953 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:44] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:44.954 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:44.954 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:44.954 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:44.954 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:44.954 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=40 2024-03-26T16:58:44.954 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:44] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:44.954 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:44] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:44.954 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:44.954 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:44.954 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:44.954 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:44.954 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=41 2024-03-26T16:58:44.954 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:44] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:44.954 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:44] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:44.955 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:44.955 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:44.955 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:44.955 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:44.955 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=42 2024-03-26T16:58:44.955 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:44] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:44.955 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:44] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:44.955 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:44.955 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:44.955 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:44.955 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:44.955 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=43 2024-03-26T16:58:44.955 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:44] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:44.955 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:44] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:44.955 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:44.956 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:44.956 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:44.956 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:44.956 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=44 2024-03-26T16:58:44.956 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:44] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:44.956 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:44] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:44.956 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:44.956 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:44.956 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:44.956 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:44.956 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=45 2024-03-26T16:58:44.956 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:44] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:44.956 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:44] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:44.956 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:44.956 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:44.957 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:44.957 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:44.957 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=46 2024-03-26T16:58:44.959 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:44] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:44.959 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:44] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:44.960 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:44.960 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:44.960 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:44.960 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:44.960 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=47 2024-03-26T16:58:44.961 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:44] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:44.961 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:44] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:44.961 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:44.961 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:44.961 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:44.962 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:44.963 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=48 2024-03-26T16:58:44.963 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:44] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:44.964 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:44] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:44.964 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:44.964 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:44.965 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:44.966 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:44.966 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=49 2024-03-26T16:58:44.966 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:44] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:44.966 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:44] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:44.966 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:44.966 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:44.966 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:44.966 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:44.966 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=50 2024-03-26T16:58:44.966 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:44] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:44.966 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:44] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:44.966 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:44.966 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:44.967 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:44.967 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:44.967 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=51 2024-03-26T16:58:44.967 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:44] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:44.967 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:44] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:44.967 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:44.967 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:44.967 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:44.967 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:44.967 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=52 2024-03-26T16:58:44.967 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:44] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:44.967 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:44] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:44.967 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:44.967 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:44.967 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:44.968 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:44.968 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=53 2024-03-26T16:58:44.968 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:44] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:44.968 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:44] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:44.968 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:44.968 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:44.968 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:44.968 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:44.968 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=54 2024-03-26T16:58:44.968 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:44] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:44.968 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:44] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:44.968 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:44.968 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:44.968 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:44.969 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:44.969 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=55 2024-03-26T16:58:44.969 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:44] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:44.969 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:44] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:44.969 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:44.969 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:44.969 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:44.969 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:44.969 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=56 2024-03-26T16:58:44.969 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:44] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:44.969 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:44] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:44.969 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:44.969 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:44.969 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:44.969 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:44.970 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=57 2024-03-26T16:58:44.970 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:44] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:44.970 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:44] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:44.970 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:44.970 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:44.970 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:44.970 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:44.970 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=58 2024-03-26T16:58:44.970 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:44] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:44.970 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:44] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:44.970 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:44.970 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:44.970 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:44.970 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:44.971 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=59 2024-03-26T16:58:44.971 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:44] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:44.971 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:44] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:44.971 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:44.971 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:44.971 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:44.971 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:44.971 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=60 2024-03-26T16:58:44.971 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:44] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:44.971 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:44] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:44.971 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:44.971 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:44.971 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:44.971 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:44.971 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=61 2024-03-26T16:58:44.972 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:44] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:44.972 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:44] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:44.972 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:44.972 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:44.972 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:44.972 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:44.972 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=62 2024-03-26T16:58:44.972 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:44] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:44.972 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:44] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:44.972 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:44.972 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:44.972 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:44.972 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:44.972 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=63 2024-03-26T16:58:44.972 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:44] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:44.973 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:44] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:44.973 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:44.973 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:44.973 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:44.973 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:44.973 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=64 2024-03-26T16:58:44.973 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:44] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:44.973 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:44] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:44.973 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:44.973 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:44.973 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:44.973 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:44.973 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=65 2024-03-26T16:58:44.973 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:44] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:44.974 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:44] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:44.974 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:44.974 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:44.974 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:44.974 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:44.974 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=66 2024-03-26T16:58:44.974 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:44] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:44.974 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:44] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:44.974 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:44.974 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:44.974 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:44.974 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:44.974 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=67 2024-03-26T16:58:45.206 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:44] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:45.207 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:44] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:45.207 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:45.207 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:45.207 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:45.207 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:45.207 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=68 2024-03-26T16:58:45.207 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:44] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:45.207 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:44] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:45.207 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:45.207 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:45.207 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:45.207 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:45.207 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=69 2024-03-26T16:58:45.208 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:44] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:45.208 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:44] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:45.208 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:45.208 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:45.208 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:45.208 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:45.208 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=70 2024-03-26T16:58:45.208 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:44] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:45.208 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:44] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:45.208 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:45.208 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:45.208 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:45.208 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:45.208 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=71 2024-03-26T16:58:45.209 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:44] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:45.209 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:44] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:45.209 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:45.209 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:45.209 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:45.209 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:45.209 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=72 2024-03-26T16:58:45.209 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:45.209 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:45.209 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:45.209 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:45.209 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:45.209 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:45.209 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=73 2024-03-26T16:58:45.210 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:45.210 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:45.210 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:45.210 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:45.210 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:45.210 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:45.210 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=74 2024-03-26T16:58:45.210 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:45.210 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:45.210 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:45.210 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:45.210 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:45.210 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:45.211 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=75 2024-03-26T16:58:45.212 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:45.212 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:45.212 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:45.212 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:45.212 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:45.212 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:45.212 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=76 2024-03-26T16:58:45.212 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:45.212 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:45.212 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:45.212 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:45.212 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:45.212 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:45.213 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=77 2024-03-26T16:58:45.213 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:45.213 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:45.213 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:45.213 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:45.213 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:45.213 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:45.213 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=78 2024-03-26T16:58:45.213 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:45.213 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:45.213 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:45.213 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:45.213 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:45.213 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:45.214 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=79 2024-03-26T16:58:45.214 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:45.214 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:45.214 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:45.214 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:45.214 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:45.214 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:45.214 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=80 2024-03-26T16:58:45.214 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:45.214 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:45.214 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:45.214 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:45.214 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:45.214 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:45.215 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=81 2024-03-26T16:58:45.215 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:45.215 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:45.215 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:45.215 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:45.215 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:45.215 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:45.215 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=82 2024-03-26T16:58:45.215 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:45.215 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:45.215 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:45.215 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:45.215 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:45.215 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:45.215 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=83 2024-03-26T16:58:45.216 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:45.216 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:45.216 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:45.216 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:45.216 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:45.216 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:45.216 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=84 2024-03-26T16:58:45.216 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:45.216 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:45.216 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:45.216 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:45.216 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:45.216 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:45.216 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=85 2024-03-26T16:58:45.216 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:45.217 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:45.217 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:45.217 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:45.217 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:45.217 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:45.217 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=86 2024-03-26T16:58:45.217 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:45.217 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:45.217 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:45.217 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:45.217 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:45.218 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:45.218 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=87 2024-03-26T16:58:45.218 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:45.218 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:45.218 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:45.218 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:45.218 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:45.218 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:45.218 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=88 2024-03-26T16:58:45.218 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:45.218 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:45.218 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:45.218 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:45.218 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:45.219 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:45.219 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=89 2024-03-26T16:58:45.219 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:45.219 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:45.219 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:45.219 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:45.219 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:45.219 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:45.219 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=90 2024-03-26T16:58:45.219 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:45.219 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:45.219 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:45.219 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:45.219 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:45.219 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:45.219 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=91 2024-03-26T16:58:45.220 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:45.220 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:45.220 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:45.220 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:45.220 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:45.220 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:45.220 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=92 2024-03-26T16:58:45.220 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:45.220 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:45.220 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:45.220 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:45.220 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:45.220 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:45.220 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=93 2024-03-26T16:58:45.221 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:45.221 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:45.221 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:45.221 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:45.221 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:45.221 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:45.221 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=94 2024-03-26T16:58:45.221 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:45.221 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:45.221 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:45.221 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:45.221 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:45.221 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:45.221 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=95 2024-03-26T16:58:45.221 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:45.222 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:45.222 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:45.222 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:45.222 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:45.222 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:45.222 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=96 2024-03-26T16:58:45.222 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:45.222 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:45.222 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:45.222 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:45.223 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:45.223 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:45.223 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=97 2024-03-26T16:58:45.223 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:45.223 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:45.223 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:45.223 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:45.223 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:45.223 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:45.223 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=98 2024-03-26T16:58:45.462 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:45.462 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:45.462 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:45.462 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:45.462 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:45.463 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:45.463 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=99 2024-03-26T16:58:45.463 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:45.463 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:45.463 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:45.463 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:45.463 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:45.463 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:45.463 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=100 2024-03-26T16:58:45.463 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:45.463 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:45.463 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:45.463 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:45.464 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:45.464 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:45.464 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=101 2024-03-26T16:58:45.464 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:45.464 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:45.464 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:45.464 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:45.464 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:45.464 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:45.464 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=102 2024-03-26T16:58:45.465 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:45.465 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:45.465 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:45.465 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:45.465 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:45.465 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:45.466 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=103 2024-03-26T16:58:45.466 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:45.466 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:45.466 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:45.466 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:45.466 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:45.466 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:45.466 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=104 2024-03-26T16:58:45.466 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:45.466 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:45.466 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:45.466 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:45.466 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:45.467 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:45.467 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=105 2024-03-26T16:58:45.467 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:45.467 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:45.467 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:45.467 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:45.467 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:45.467 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:45.467 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=106 2024-03-26T16:58:45.467 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:45.467 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:45.467 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:45.467 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:45.467 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:45.468 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:45.468 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=107 2024-03-26T16:58:45.468 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:45.468 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:45.468 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:45.468 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:45.468 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:45.468 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:45.468 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=108 2024-03-26T16:58:45.468 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:45.468 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:45.468 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:45.468 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:45.468 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:45.469 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:45.469 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=109 2024-03-26T16:58:45.469 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:45.469 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:45.469 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:45.469 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:45.469 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:45.469 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:45.469 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=110 2024-03-26T16:58:45.469 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:45.469 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:45.469 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:45.469 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:45.469 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:45.470 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:45.470 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=111 2024-03-26T16:58:45.470 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:45.470 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:45.470 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:45.470 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:45.470 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:45.470 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:45.470 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=112 2024-03-26T16:58:45.470 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:45.470 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:45.470 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:45.470 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:45.470 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:45.471 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:45.471 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=113 2024-03-26T16:58:45.471 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:45.471 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:45.471 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:45.471 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:45.471 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:45.471 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:45.471 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=114 2024-03-26T16:58:45.471 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:45.471 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:45.471 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:45.471 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:45.471 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:45.471 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:45.472 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=115 2024-03-26T16:58:45.472 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:45.472 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:45.472 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:45.472 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:45.472 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:45.472 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:45.472 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=116 2024-03-26T16:58:45.472 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:45.472 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:45.472 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:45.472 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:45.472 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:45.472 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:45.472 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=117 2024-03-26T16:58:45.473 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:45.473 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:45.473 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:45.473 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:45.473 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:45.473 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:45.473 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=118 2024-03-26T16:58:45.473 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:45.473 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:45.473 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:45.473 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:45.473 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:45.473 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:45.473 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=119 2024-03-26T16:58:45.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:45.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:45.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:45.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:45.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:45.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:45.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=120 2024-03-26T16:58:45.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:45.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:45.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:45.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:45.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:45.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:45.474 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=121 2024-03-26T16:58:45.475 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:45.475 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:45.475 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:45.475 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:45.475 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:45.475 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:45.475 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=122 2024-03-26T16:58:45.475 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:45.476 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:45.476 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:45.476 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:45.476 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:45.476 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:45.476 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=123 2024-03-26T16:58:45.476 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:45.476 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:45.476 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:45.476 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:45.476 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:45.476 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:45.477 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=124 2024-03-26T16:58:45.477 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:45.477 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:45.477 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:45.477 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:45.477 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:45.477 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:45.477 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=125 2024-03-26T16:58:45.477 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:45.477 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:45.477 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:45.477 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:45.477 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:45.477 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:45.478 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=126 2024-03-26T16:58:45.478 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:45.478 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:45.478 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:45.478 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:45.478 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:45.478 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:45.478 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=127 2024-03-26T16:58:45.478 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:45.478 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:45.478 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:45.478 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:45.479 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:45.479 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:45.479 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=128 2024-03-26T16:58:45.479 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:45.479 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:45.479 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:45.479 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:45.479 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:45.479 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:45.479 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=129 2024-03-26T16:58:45.479 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:45.479 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:45.479 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:45.480 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:45.480 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:45.480 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:45.480 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=130 2024-03-26T16:58:45.718 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:45.718 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:45.718 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:45.718 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:45.719 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:45.719 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:45.719 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=131 2024-03-26T16:58:45.719 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:45.719 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:45.719 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:45.719 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:45.719 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:45.719 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:45.719 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=132 2024-03-26T16:58:45.719 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:45.719 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:45.719 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:45.720 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:45.720 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:45.720 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:45.720 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=133 2024-03-26T16:58:45.720 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:45.720 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:45.720 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:45.720 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:45.720 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:45.720 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:45.720 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=134 2024-03-26T16:58:45.721 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:45.721 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:45.721 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:45.722 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:45.722 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:45.722 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:45.722 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=135 2024-03-26T16:58:45.722 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:45.722 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:45.722 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:45.722 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:45.722 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:45.722 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:45.722 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=136 2024-03-26T16:58:45.722 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:45.723 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:45.723 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:45.723 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:45.723 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:45.723 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:45.723 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=137 2024-03-26T16:58:45.723 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:45.723 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:45.723 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:45.724 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:45.724 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:45.724 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:45.724 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=138 2024-03-26T16:58:45.724 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:45.724 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:45.724 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:45.724 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:45.724 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:45.724 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:45.724 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=139 2024-03-26T16:58:45.724 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:45.725 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:45.725 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:45.725 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:45.725 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:45.725 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:45.725 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=140 2024-03-26T16:58:45.725 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:45.725 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:45.725 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:45.725 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:45.725 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:45.725 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:45.726 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=141 2024-03-26T16:58:45.726 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:45.726 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:45.726 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:45.726 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:45.726 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:45.726 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:45.726 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=142 2024-03-26T16:58:45.726 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:45.726 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:45.726 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:45.727 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:45.727 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:45.727 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:45.727 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=143 2024-03-26T16:58:45.727 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:45.727 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:45.727 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:45.727 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:45.727 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:45.727 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:45.727 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=144 2024-03-26T16:58:45.727 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:45.727 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:45.728 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:45.728 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:45.728 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:45.728 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:45.728 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=145 2024-03-26T16:58:45.728 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:45.728 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:45.728 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:45.728 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:45.728 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:45.728 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:45.728 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=146 2024-03-26T16:58:45.729 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:45.729 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:45.729 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:45.729 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:45.729 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:45.729 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:45.729 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=147 2024-03-26T16:58:45.729 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:45.729 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:45.729 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:45.729 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:45.730 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:45.730 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:45.730 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=148 2024-03-26T16:58:45.730 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:45.730 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:45.730 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:45.730 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:45.730 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:45.730 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:45.730 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=149 2024-03-26T16:58:45.730 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:45.730 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:45.731 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:45.731 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:45.731 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:45.731 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:45.731 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=150 2024-03-26T16:58:45.731 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:45.731 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:45.731 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:45.731 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:45.731 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:45.731 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:45.731 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=151 2024-03-26T16:58:45.732 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:45.732 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:45.732 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:45.732 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:45.732 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:45.732 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:45.732 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=152 2024-03-26T16:58:45.732 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:45.732 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:45.732 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:45.732 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:45.733 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:45.733 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:45.733 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=153 2024-03-26T16:58:45.733 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:45.733 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:45.733 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:45.733 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:45.733 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:45.733 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:45.733 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=154 2024-03-26T16:58:45.733 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:45.733 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:45.733 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:45.734 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:45.734 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:45.734 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:45.734 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=155 2024-03-26T16:58:45.734 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:45.734 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:45.734 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:45.734 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:45.734 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:45.734 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:45.734 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=156 2024-03-26T16:58:45.734 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:45.734 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:45.734 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:45.735 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:45.735 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:45.735 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:45.735 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=157 2024-03-26T16:58:45.735 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:45.735 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:45.735 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:45.735 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:45.735 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:45.735 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:45.735 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=158 2024-03-26T16:58:45.736 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:45.736 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:45.736 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:45.736 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:45.737 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:45.737 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:45.737 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=159 2024-03-26T16:58:45.737 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:45.737 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:45.737 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:45.737 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:45.737 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:45.737 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:45.737 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=160 2024-03-26T16:58:45.737 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:45.737 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:45.737 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:45.738 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:45.738 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:45.738 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:45.738 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=161 2024-03-26T16:58:45.738 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:45.738 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:45.738 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:45.738 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:45.738 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:45.738 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:45.738 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=162 2024-03-26T16:58:45.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:45 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:45] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:58:45.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:45 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:45] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}] 2024-03-26T16:58:45.974 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:45.974 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:45.974 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:45.974 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:45.974 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:45.975 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:45.975 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=163 2024-03-26T16:58:45.975 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:45.975 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:45.975 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:45.975 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:45.975 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:45.975 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:45.975 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=164 2024-03-26T16:58:45.975 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:45.975 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:45.976 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:45.976 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:45.976 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:45.976 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:45.976 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=165 2024-03-26T16:58:45.976 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:45.976 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:45.976 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:45.976 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:45.976 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:45.976 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:45.976 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=166 2024-03-26T16:58:45.978 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:45.978 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:45.978 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:45.978 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:45.978 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:45.978 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:45.978 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=167 2024-03-26T16:58:45.978 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:45.978 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:45.979 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:45.979 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:45.979 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:45.979 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:45.979 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=168 2024-03-26T16:58:45.979 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:45.979 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:45.979 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:45.979 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:45.979 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:45.979 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:45.979 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=169 2024-03-26T16:58:45.980 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:45.980 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:45.980 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:45.980 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:45.980 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:45.980 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:45.980 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=170 2024-03-26T16:58:45.980 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:45.980 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:45.980 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:45.980 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:45.980 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:45.981 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:45.981 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=171 2024-03-26T16:58:45.981 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:45.981 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:45.981 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:45.981 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:45.981 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:45.981 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:45.981 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=172 2024-03-26T16:58:45.981 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:45.981 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:45.982 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:45.982 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:45.982 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:45.982 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:45.982 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=173 2024-03-26T16:58:45.982 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:45.982 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:45.982 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:45.982 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:45.982 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:45.982 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:45.982 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=174 2024-03-26T16:58:45.982 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:45.983 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:45.983 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:45.983 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:45.983 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:45.983 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:45.983 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=175 2024-03-26T16:58:45.983 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:45.983 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:45.983 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:45.983 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:45.983 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:45.983 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:45.984 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=176 2024-03-26T16:58:45.984 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:45.984 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:45.984 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:45.984 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:45.984 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:45.984 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:45.984 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=177 2024-03-26T16:58:45.984 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:45.984 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:45.984 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:45.985 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:45.985 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:45.985 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:45.985 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=178 2024-03-26T16:58:45.985 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:45.985 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:45.985 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:45.985 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:45.985 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:45.985 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:45.985 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=179 2024-03-26T16:58:45.985 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:45.985 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:45.986 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:45.986 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:45.986 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:45.986 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:45.986 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=180 2024-03-26T16:58:45.986 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:45.986 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:45.986 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:45.986 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:45.986 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:45.986 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:45.986 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=181 2024-03-26T16:58:45.987 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:45.987 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:45.987 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:45.987 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:45.987 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:45.987 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:45.987 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=182 2024-03-26T16:58:45.987 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:45.987 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:45.987 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:45.987 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:45.987 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:45.988 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:45.988 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=183 2024-03-26T16:58:45.988 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:45.988 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:45.988 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:45.988 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:45.988 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:45.988 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:45.988 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=184 2024-03-26T16:58:45.988 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:45.988 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:45.988 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:45.989 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:45.989 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:45.989 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:45.989 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=185 2024-03-26T16:58:45.989 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:45.989 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:45.989 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:45.989 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:45.989 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:45.989 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:45.989 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=186 2024-03-26T16:58:45.990 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:45.990 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:45.990 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:45.990 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:45.990 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:45.990 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:45.990 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=187 2024-03-26T16:58:45.990 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:45.990 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:45.990 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:45.990 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:45.990 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:45.991 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:45.991 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=188 2024-03-26T16:58:45.991 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:45.991 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:45.991 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:45.991 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:45.991 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:45.991 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:45.991 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=189 2024-03-26T16:58:45.991 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:45.991 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:45.991 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:45.992 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:45.992 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:45.992 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:45.992 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=190 2024-03-26T16:58:45.992 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:45.992 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:45.992 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:45.992 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:45.992 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:45.992 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:45.992 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=191 2024-03-26T16:58:45.992 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:45.993 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:45.993 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:45.993 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:45.993 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:45.993 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:45.993 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=192 2024-03-26T16:58:45.993 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:45.993 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:45.993 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:45.993 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:45.993 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:45.993 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:45.994 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=193 2024-03-26T16:58:45.994 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:45.994 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:45.994 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:45.994 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:45.994 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:45.994 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:45.994 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=194 2024-03-26T16:58:46.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:45 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:45] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:58:46.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:45 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:45] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}] 2024-03-26T16:58:46.229 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-mon[34420]: pgmap v363: 33 pgs: 33 active+clean; 609 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 5.1 KiB/s rd, 511 B/s wr, 4 op/s 2024-03-26T16:58:46.230 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:46.230 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:46.230 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:46.230 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:46.230 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:46.230 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:46.230 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=195 2024-03-26T16:58:46.230 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:46.230 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:46.231 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:46.231 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:46.231 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:46.231 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:46.231 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=196 2024-03-26T16:58:46.231 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:46.231 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:45] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:46.231 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:46.231 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:46.231 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:46.231 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:46.231 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=197 2024-03-26T16:58:46.231 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:46] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:46.231 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:46] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:46.232 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:46.232 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:46.232 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:46.232 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:46.232 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=198 2024-03-26T16:58:46.233 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:46] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:46.233 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:46] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:46.233 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:46.233 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:46.233 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:46.233 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:46.233 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=199 2024-03-26T16:58:46.233 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:46] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:46.233 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:46] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:46.233 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:46.233 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:46.234 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:46.234 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:46.234 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=200 2024-03-26T16:58:46.234 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:46] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:46.234 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:46] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:46.234 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:46.234 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:46.234 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:46.234 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:46.234 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=201 2024-03-26T16:58:46.234 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:46] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:46.234 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:46] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:46.234 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:46.235 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:46.235 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:46.235 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:46.235 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=202 2024-03-26T16:58:46.235 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:46] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:46.235 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:46] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:46.235 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:46.235 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:46.235 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:46.235 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:46.235 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=203 2024-03-26T16:58:46.235 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:46] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:46.235 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:46] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:46.235 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:46.236 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:46.236 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:46.236 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:46.236 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=204 2024-03-26T16:58:46.236 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:46] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:46.236 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:46] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:46.236 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:46.236 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:46.236 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:46.236 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:46.236 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=205 2024-03-26T16:58:46.236 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:46] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:46.236 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:46] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:46.236 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:46.237 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:46.237 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:46.237 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:46.237 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=206 2024-03-26T16:58:46.237 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:46] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:46.237 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:46] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:46.237 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:46.237 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:46.237 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:46.237 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:46.237 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=207 2024-03-26T16:58:46.237 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:46] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:46.237 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:46] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:46.238 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:46.238 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:46.238 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:46.238 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:46.238 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=208 2024-03-26T16:58:46.238 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:46] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:46.238 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:46] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:46.238 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:46.238 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:46.238 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:46.238 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:46.238 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=209 2024-03-26T16:58:46.238 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:46] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:46.238 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:46] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:46.239 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:46.239 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:46.239 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:46.239 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:46.239 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=210 2024-03-26T16:58:46.239 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:46] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:46.239 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:46] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:46.239 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:46.239 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:46.239 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:46.239 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:46.239 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=211 2024-03-26T16:58:46.239 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:46] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:46.239 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:46] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:46.240 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:46.240 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:46.240 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:46.240 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:46.240 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=212 2024-03-26T16:58:46.240 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:46] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:46.240 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:46] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:46.240 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:46.240 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:46.240 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:46.240 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:46.240 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=213 2024-03-26T16:58:46.240 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:46] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:46.240 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:46] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:46.240 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:46.241 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:46.241 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:46.241 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:46.241 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=214 2024-03-26T16:58:46.241 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:46] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:46.241 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:46] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:46.241 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:46.241 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:46.241 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:46.241 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:46.241 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=215 2024-03-26T16:58:46.241 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:46] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:46.241 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:46] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:46.241 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:46.241 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:46.242 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:46.242 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:46.242 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=216 2024-03-26T16:58:46.242 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:46] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:46.242 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:46] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:46.242 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:46.242 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:46.242 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:46.242 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:46.242 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=217 2024-03-26T16:58:46.242 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:46] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:46.242 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:46] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:46.242 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:46.242 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:46.243 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:46.243 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:46.243 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=218 2024-03-26T16:58:46.243 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:46] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:46.243 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:46] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:46.244 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:46.244 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:46.244 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:46.244 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:46.244 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=219 2024-03-26T16:58:46.244 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:46] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:46.244 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:46] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:46.244 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:46.244 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:46.244 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:46.244 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:46.244 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=220 2024-03-26T16:58:46.244 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:46] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:46.245 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:46] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:46.245 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:46.245 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:46.245 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:46.245 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:46.245 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=221 2024-03-26T16:58:46.245 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:46] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:46.245 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:46] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:46.245 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:46.245 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:46.245 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:46.245 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:46.245 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=222 2024-03-26T16:58:46.245 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:46] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:46.245 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:46] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:46.246 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:46.246 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:46.246 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:46.246 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:46.246 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=223 2024-03-26T16:58:46.246 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:46] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:46.246 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:46] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:46.246 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:46.246 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:46.246 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:46.246 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:46.246 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=224 2024-03-26T16:58:46.246 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:46] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:46.246 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:46] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:46.247 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:46.247 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:46.247 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:46.247 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:46.247 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=225 2024-03-26T16:58:46.247 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:46] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:46.247 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:46] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:46.247 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:46.247 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:46.247 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:46.247 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:46.247 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=226 2024-03-26T16:58:46.482 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:58:46 smithi044 ceph-mon[30624]: pgmap v363: 33 pgs: 33 active+clean; 609 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 5.1 KiB/s rd, 511 B/s wr, 4 op/s 2024-03-26T16:58:46.483 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:58:46 smithi149 ceph-mon[34678]: pgmap v363: 33 pgs: 33 active+clean; 609 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 5.1 KiB/s rd, 511 B/s wr, 4 op/s 2024-03-26T16:58:46.484 INFO:tasks.workunit.client.3.smithi157.stdout:Adding nqn.2016-06.io.spdk:cnode3 listener at 172.21.15.64:4420: Successful 2024-03-26T16:58:46.484 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:46] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:46.484 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:46] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:46.484 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:46.484 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:46.484 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:46.484 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:46.484 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=227 2024-03-26T16:58:46.485 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:46] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:46.485 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:46] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:46.485 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:46.485 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:46.485 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:46.485 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:46.485 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=228 2024-03-26T16:58:46.485 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:46] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:46.485 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:46] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:46.485 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:46.485 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:46.485 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:46.485 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:46.485 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=229 2024-03-26T16:58:46.486 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:46] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:46.486 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:46] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:46.486 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:46.486 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:46.486 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:46.486 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:46.486 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=230 2024-03-26T16:58:46.487 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:46] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:46.487 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:46] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:46.487 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:46.487 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:46.487 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:46.487 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:46.487 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=231 2024-03-26T16:58:46.487 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:46] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:46.488 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:46] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:46.488 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:46.488 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:46.488 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:46.488 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:46.488 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=232 2024-03-26T16:58:46.488 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:46] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:46.488 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:46] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:46.488 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:46.488 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:46.488 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:46.488 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:46.488 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=233 2024-03-26T16:58:46.488 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:46] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:46.488 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:46] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:46.488 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:46.489 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:46.489 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:46.489 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:46.489 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=234 2024-03-26T16:58:46.489 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:46] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:46.489 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:46] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:46.489 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:46.489 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:46.489 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:46.489 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:46.489 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=235 2024-03-26T16:58:46.489 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:46] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:46.489 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:46] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:46.489 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:46.489 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:46.490 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:46.490 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:46.490 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=236 2024-03-26T16:58:46.490 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:46] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:46.490 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:46] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:46.490 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:46.490 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:46.490 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:46.490 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:46.490 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=237 2024-03-26T16:58:46.490 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:46] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:46.490 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:46] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:46.490 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:46.491 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:46.491 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:46.491 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:46.491 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=238 2024-03-26T16:58:46.491 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:46] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:46.491 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:46] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:46.491 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:46.491 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:46.491 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:46.491 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:46.491 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=239 2024-03-26T16:58:46.491 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:46] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:46.491 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:46] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:46.491 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:46.491 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:46.492 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:46.492 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:46.492 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=240 2024-03-26T16:58:46.492 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:46] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:46.492 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:46] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:46.492 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:46.492 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:46.492 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:46.492 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:46.492 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=241 2024-03-26T16:58:46.492 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:46] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:46.492 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:46] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:46.492 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:46.492 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:46.493 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:46.493 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:46.493 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=242 2024-03-26T16:58:46.493 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:46] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:46.493 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:46] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:46.493 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:46.493 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:46.493 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:46.493 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:46.493 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=243 2024-03-26T16:58:46.493 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:46] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:46.493 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:46] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:46.493 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:46.493 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:46.494 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:46.494 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:46.494 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=244 2024-03-26T16:58:46.494 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:46] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:46.494 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:46] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:46.494 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:46.494 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:46.494 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:46.494 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:46.494 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=245 2024-03-26T16:58:46.495 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:46] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:46.495 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:46] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:46.495 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:46.495 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:46.495 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:46.495 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:46.495 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=246 2024-03-26T16:58:46.495 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:46] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:46.495 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:46] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:46.495 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:46.495 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:46.495 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:46.495 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:46.496 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=247 2024-03-26T16:58:46.496 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:46] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:46.496 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:46] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:46.496 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:46.496 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:46.496 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:46.496 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:46.496 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=248 2024-03-26T16:58:46.496 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:46] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:46.496 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:46] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:46.496 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:46.496 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:46.496 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:46.496 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:46.496 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=249 2024-03-26T16:58:46.496 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:46] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:46.497 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:46] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:46.497 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:46.497 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:46.497 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:46.497 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:46.497 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=250 2024-03-26T16:58:46.497 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:46] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:46.497 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:46] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:46.498 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:46.498 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:46.498 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:46.498 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:46.498 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=251 2024-03-26T16:58:46.498 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:46] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:46.498 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:46] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:46.498 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:46.498 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:46.498 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:46.498 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:46.498 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=252 2024-03-26T16:58:46.498 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:46] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:46.499 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:46] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:46.499 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:46.499 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:46.499 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:46.499 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:46.499 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=253 2024-03-26T16:58:46.499 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:46] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:46.499 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:46] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:46.499 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:46.499 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:46.499 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:46.499 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:46.499 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=254 2024-03-26T16:58:46.499 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:46] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:46.500 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:46] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:46.500 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:46.500 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:46.500 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:46.500 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:46.500 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=255 2024-03-26T16:58:46.500 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:46] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:46.500 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:46] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:46.500 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: host_name: "smithi064" 2024-03-26T16:58:46.500 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: traddr: "172.21.15.64" 2024-03-26T16:58:46.500 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: adrfam: ipv4 2024-03-26T16:58:46.500 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: trsvcid: 4420 2024-03-26T16:58:46.500 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: _ana_state='inaccessible' anagrpid=256 2024-03-26T16:58:46.500 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:46] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:46.501 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:46] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:58:46.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:46 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:46] INFO grpc.py:1992: Received request to create smithi064 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode3 at 172.21.15.64:4420, context: None 2024-03-26T16:58:46.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:46 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:46] INFO grpc.py:2031: Listener not created as gateway's host name smithi044 differs from requested host smithi064 2024-03-26T16:58:46.805 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:46] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}] 2024-03-26T16:58:46.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:46 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:46] INFO grpc.py:1992: Received request to create smithi064 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode3 at 172.21.15.64:4420, context: None 2024-03-26T16:58:46.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:46 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:46] INFO grpc.py:2031: Listener not created as gateway's host name smithi149 differs from requested host smithi064 2024-03-26T16:58:47.393 INFO:tasks.workunit.client.3.smithi157.stderr:+ for i in "${!gateway_ips[@]}" 2024-03-26T16:58:47.393 INFO:tasks.workunit.client.3.smithi157.stderr:+ ip=172.21.15.149 2024-03-26T16:58:47.393 INFO:tasks.workunit.client.3.smithi157.stderr:+ name=smithi149 2024-03-26T16:58:47.394 INFO:tasks.workunit.client.3.smithi157.stderr:++ seq 1 3 2024-03-26T16:58:47.395 INFO:tasks.workunit.client.3.smithi157.stderr:+ for j in $(seq 1 $NVMEOF_SUBSYSTEMS_COUNT) 2024-03-26T16:58:47.395 INFO:tasks.workunit.client.3.smithi157.stderr:+ subsystem_nqn=nqn.2016-06.io.spdk:cnode1 2024-03-26T16:58:47.395 INFO:tasks.workunit.client.3.smithi157.stdout:Adding gateway listener with IP 172.21.15.149 and name smithi149 2024-03-26T16:58:47.396 INFO:tasks.workunit.client.3.smithi157.stderr:+ echo 'Adding gateway listener with IP 172.21.15.149 and name smithi149' 2024-03-26T16:58:47.396 INFO:tasks.workunit.client.3.smithi157.stderr:+ sudo podman run -it quay.io/barakda1/nvmeof-cli:qe_ceph_devel_21e59b2 --server-address 172.21.15.149 --server-port 5500 listener add --subsystem nqn.2016-06.io.spdk:cnode1 --host-name smithi149 --traddr 172.21.15.149 --trsvcid 4420 2024-03-26T16:58:47.497 INFO:tasks.workunit.client.3.smithi157.stderr:time="2024-03-26T16:58:47Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2024-03-26T16:58:47.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:47 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:47] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:58:47.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:47 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:47] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}] 2024-03-26T16:58:48.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:47 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:47] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:58:48.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:47 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:47] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}] 2024-03-26T16:58:48.438 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-mon[34678]: pgmap v364: 33 pgs: 33 active+clean; 609 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 5.1 KiB/s rd, 511 B/s wr, 4 op/s 2024-03-26T16:58:48.438 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:1992: Received request to create smithi149 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode1 at 172.21.15.149:4420, context: 2024-03-26T16:58:48.438 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [2024-03-26 16:58:48.234116] tcp.c: 850:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 172.21.15.149 port 4420 *** 2024-03-26T16:58:48.438 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2023: create_listener: True 2024-03-26T16:58:48.439 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:1958: Subsystem nqn.2016-06.io.spdk:cnode1 enable_ha: True 2024-03-26T16:58:48.439 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : optimized for group : 1 2024-03-26T16:58:48.439 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:48.439 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:48.439 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:48.439 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:48.439 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:48.439 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='optimized' anagrpid=1 2024-03-26T16:58:48.439 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:48.439 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 2 2024-03-26T16:58:48.439 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:48.439 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:48.439 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:48.440 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:48.440 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:48.440 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=2 2024-03-26T16:58:48.440 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:48.440 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 3 2024-03-26T16:58:48.440 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:48.440 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:48.440 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:48.441 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:48.441 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:48.441 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=3 2024-03-26T16:58:48.441 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:48.441 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 4 2024-03-26T16:58:48.441 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:48.441 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:48.442 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:48.442 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:48.442 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:48.442 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=4 2024-03-26T16:58:48.442 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:48.442 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 5 2024-03-26T16:58:48.442 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:48.442 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:48.442 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:48.442 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:48.442 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:48.442 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=5 2024-03-26T16:58:48.442 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:48.443 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 6 2024-03-26T16:58:48.443 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:48.443 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:48.443 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:48.443 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:48.443 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:48.443 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=6 2024-03-26T16:58:48.443 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:48.443 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 7 2024-03-26T16:58:48.444 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:48.444 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:48.444 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:48.444 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:48.444 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:48.444 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=7 2024-03-26T16:58:48.444 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:48.444 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 8 2024-03-26T16:58:48.444 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:48.445 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:48.445 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:48.445 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:48.445 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:48.445 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=8 2024-03-26T16:58:48.445 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:48.445 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 9 2024-03-26T16:58:48.445 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:48.445 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:48.445 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:48.445 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:48.445 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:48.445 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=9 2024-03-26T16:58:48.445 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:48.446 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 10 2024-03-26T16:58:48.446 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:48.446 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:48.446 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:48.446 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:48.446 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:48.446 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=10 2024-03-26T16:58:48.446 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:48.446 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 11 2024-03-26T16:58:48.446 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:48.446 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:48.447 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:48.447 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:48.447 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:48.447 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=11 2024-03-26T16:58:48.447 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:48.447 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 12 2024-03-26T16:58:48.447 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:48.447 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:48.447 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:48.447 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:48.448 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:48.448 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=12 2024-03-26T16:58:48.448 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:48.448 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 13 2024-03-26T16:58:48.448 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:48.448 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:48.448 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:48.448 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:48.448 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:48.448 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=13 2024-03-26T16:58:48.448 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:48.448 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 14 2024-03-26T16:58:48.448 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:48.448 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:48.449 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:48.449 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:48.449 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:48.449 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=14 2024-03-26T16:58:48.449 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:48.449 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 15 2024-03-26T16:58:48.449 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:48.449 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:48.449 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:48.449 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:48.449 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:48.449 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=15 2024-03-26T16:58:48.449 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:48.449 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 16 2024-03-26T16:58:48.449 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:48.450 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:48.450 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:48.450 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:48.450 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:48.450 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=16 2024-03-26T16:58:48.450 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:48.450 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 17 2024-03-26T16:58:48.450 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:48.450 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:48.450 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:48.450 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:48.450 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:48.450 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=17 2024-03-26T16:58:48.450 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:48.451 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 18 2024-03-26T16:58:48.451 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:48.451 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:48.451 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:48.451 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:48.451 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:48.451 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=18 2024-03-26T16:58:48.451 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:48.451 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 19 2024-03-26T16:58:48.451 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:48.451 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:48.451 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:48.451 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:48.451 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:48.451 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=19 2024-03-26T16:58:48.452 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:48.452 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 20 2024-03-26T16:58:48.452 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:48.452 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:48.453 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:48.453 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:48.453 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:48.453 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=20 2024-03-26T16:58:48.453 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:48.453 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 21 2024-03-26T16:58:48.453 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:48.453 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:48.453 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:48.453 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:48.453 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:48.453 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=21 2024-03-26T16:58:48.454 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:48.454 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 22 2024-03-26T16:58:48.454 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:48.454 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:48.454 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:48.454 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:48.454 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:48.454 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=22 2024-03-26T16:58:48.454 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:48.454 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 23 2024-03-26T16:58:48.455 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:48.455 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:48.455 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:48.455 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:48.455 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:48.455 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=23 2024-03-26T16:58:48.455 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:48.455 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 24 2024-03-26T16:58:48.455 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:48.455 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:48.455 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:48.455 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:48.455 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:48.455 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=24 2024-03-26T16:58:48.455 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:48.456 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 25 2024-03-26T16:58:48.456 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:48.456 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:48.456 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:48.456 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:48.456 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:48.456 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=25 2024-03-26T16:58:48.456 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:48.456 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 26 2024-03-26T16:58:48.456 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:48.456 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:48.456 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:48.456 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:48.456 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:48.456 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=26 2024-03-26T16:58:48.492 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:58:48 smithi064 ceph-mon[34420]: pgmap v364: 33 pgs: 33 active+clean; 609 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 5.1 KiB/s rd, 511 B/s wr, 4 op/s 2024-03-26T16:58:48.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:58:48 smithi044 ceph-mon[30624]: pgmap v364: 33 pgs: 33 active+clean; 609 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 5.1 KiB/s rd, 511 B/s wr, 4 op/s 2024-03-26T16:58:48.694 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:48.695 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 27 2024-03-26T16:58:48.695 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:48.695 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:48.695 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:48.695 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:48.695 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:48.695 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=27 2024-03-26T16:58:48.695 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:48.695 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 28 2024-03-26T16:58:48.695 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:48.695 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:48.695 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:48.695 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:48.695 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:48.696 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=28 2024-03-26T16:58:48.696 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:48.696 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 29 2024-03-26T16:58:48.696 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:48.696 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:48.696 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:48.696 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:48.696 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:48.696 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=29 2024-03-26T16:58:48.696 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:48.697 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 30 2024-03-26T16:58:48.697 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:48.697 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:48.697 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:48.697 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:48.697 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:48.698 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=30 2024-03-26T16:58:48.698 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:48.698 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 31 2024-03-26T16:58:48.698 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:48.698 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:48.698 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:48.698 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:48.698 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:48.698 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=31 2024-03-26T16:58:48.698 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:48.698 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 32 2024-03-26T16:58:48.698 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:48.698 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:48.698 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:48.699 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:48.699 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:48.699 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=32 2024-03-26T16:58:48.699 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:48.699 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 33 2024-03-26T16:58:48.699 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:48.699 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:48.699 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:48.699 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:48.699 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:48.699 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=33 2024-03-26T16:58:48.699 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:48.699 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 34 2024-03-26T16:58:48.700 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:48.700 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:48.700 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:48.700 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:48.700 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:48.700 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=34 2024-03-26T16:58:48.700 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:48.700 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 35 2024-03-26T16:58:48.700 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:48.700 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:48.700 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:48.700 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:48.700 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:48.700 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=35 2024-03-26T16:58:48.700 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:48.701 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 36 2024-03-26T16:58:48.701 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:48.701 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:48.701 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:48.701 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:48.701 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:48.701 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=36 2024-03-26T16:58:48.701 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:48.701 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 37 2024-03-26T16:58:48.701 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:48.701 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:48.701 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:48.701 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:48.701 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:48.702 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=37 2024-03-26T16:58:48.702 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:48.702 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 38 2024-03-26T16:58:48.702 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:48.702 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:48.702 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:48.702 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:48.702 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:48.702 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=38 2024-03-26T16:58:48.702 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:48.702 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 39 2024-03-26T16:58:48.702 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:48.702 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:48.702 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:48.703 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:48.703 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:48.703 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=39 2024-03-26T16:58:48.703 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:48.703 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 40 2024-03-26T16:58:48.703 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:48.703 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:48.703 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:48.703 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:48.703 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:48.703 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=40 2024-03-26T16:58:48.703 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:48.703 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 41 2024-03-26T16:58:48.704 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:48.704 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:48.704 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:48.704 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:48.704 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:48.704 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=41 2024-03-26T16:58:48.704 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:48.704 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 42 2024-03-26T16:58:48.704 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:48.704 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:48.704 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:48.704 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:48.704 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:48.704 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=42 2024-03-26T16:58:48.704 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:48.705 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 43 2024-03-26T16:58:48.705 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:48.705 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:48.705 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:48.705 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:48.705 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:48.705 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=43 2024-03-26T16:58:48.705 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:48.705 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 44 2024-03-26T16:58:48.705 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:48.705 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:48.705 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:48.705 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:48.706 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:48.706 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=44 2024-03-26T16:58:48.706 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:48.706 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 45 2024-03-26T16:58:48.706 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:48.706 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:48.706 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:48.706 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:48.706 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:48.706 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=45 2024-03-26T16:58:48.706 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:48.706 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 46 2024-03-26T16:58:48.706 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:48.706 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:48.707 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:48.707 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:48.707 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:48.708 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=46 2024-03-26T16:58:48.708 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:48.708 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 47 2024-03-26T16:58:48.708 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:48.708 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:48.708 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:48.708 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:48.708 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:48.708 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=47 2024-03-26T16:58:48.708 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:48.708 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 48 2024-03-26T16:58:48.708 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:48.708 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:48.709 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:48.709 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:48.709 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:48.709 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=48 2024-03-26T16:58:48.709 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:48.709 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 49 2024-03-26T16:58:48.709 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:48.709 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:48.709 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:48.709 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:48.709 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:48.709 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=49 2024-03-26T16:58:48.709 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:48.709 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 50 2024-03-26T16:58:48.710 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:48.710 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:48.710 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:48.710 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:48.710 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:48.710 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=50 2024-03-26T16:58:48.710 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:48.710 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 51 2024-03-26T16:58:48.710 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:48.710 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:48.710 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:48.710 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:48.710 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:48.710 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=51 2024-03-26T16:58:48.711 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:48.711 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 52 2024-03-26T16:58:48.711 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:48.711 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:48.711 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:48.711 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:48.711 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:48.711 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=52 2024-03-26T16:58:48.711 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:48.711 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 53 2024-03-26T16:58:48.711 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:48.711 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:48.711 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:48.711 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:48.711 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:48.712 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=53 2024-03-26T16:58:48.712 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:48.712 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 54 2024-03-26T16:58:48.712 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:48.712 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:48.712 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:48.712 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:48.712 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:48.712 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=54 2024-03-26T16:58:48.712 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:48.712 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 55 2024-03-26T16:58:48.712 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:48.712 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:48.712 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:48.713 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:48.713 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:48.713 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=55 2024-03-26T16:58:48.713 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:48.713 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 56 2024-03-26T16:58:48.713 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:48.713 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:48.713 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:48.713 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:48.713 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:48.713 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=56 2024-03-26T16:58:48.713 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:48.713 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 57 2024-03-26T16:58:48.713 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:48.714 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:48.714 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:48.714 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:48.714 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:48.714 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=57 2024-03-26T16:58:48.714 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:48.714 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 58 2024-03-26T16:58:48.714 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:48.714 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:48.714 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:48.714 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:48.714 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:48.714 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=58 2024-03-26T16:58:48.805 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:48 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:48] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:58:48.805 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:48 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:48] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}] 2024-03-26T16:58:48.951 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:48.951 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 59 2024-03-26T16:58:48.951 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:48.951 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:48.951 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:48.951 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:48.951 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:48.951 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=59 2024-03-26T16:58:48.951 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:48.951 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 60 2024-03-26T16:58:48.952 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:48.952 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:48.952 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:48.952 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:48.952 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:48.952 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=60 2024-03-26T16:58:48.952 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:48.952 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 61 2024-03-26T16:58:48.952 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:48.952 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:48.952 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:48.953 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:48.953 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:48.953 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=61 2024-03-26T16:58:48.953 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:48.954 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 62 2024-03-26T16:58:48.955 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:48.955 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:48.955 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:48.955 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:48.955 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:48.955 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=62 2024-03-26T16:58:48.955 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:48.955 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 63 2024-03-26T16:58:48.955 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:48.955 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:48.955 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:48.955 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:48.956 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:48.956 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=63 2024-03-26T16:58:48.956 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:48.956 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 64 2024-03-26T16:58:48.956 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:48.956 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:48.956 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:48.956 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:48.956 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:48.956 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=64 2024-03-26T16:58:48.956 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:48.957 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 65 2024-03-26T16:58:48.957 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:48.957 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:48.957 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:48.957 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:48.957 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:48.957 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=65 2024-03-26T16:58:48.957 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:48.957 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 66 2024-03-26T16:58:48.957 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:48.957 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:48.957 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:48.957 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:48.957 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:48.958 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=66 2024-03-26T16:58:48.958 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:48.958 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 67 2024-03-26T16:58:48.958 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:48.958 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:48.959 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:48.959 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:48.959 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:48.959 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=67 2024-03-26T16:58:48.959 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:48.959 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 68 2024-03-26T16:58:48.959 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:48.959 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:48.959 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:48.959 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:48.959 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:48.959 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=68 2024-03-26T16:58:48.960 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:48.960 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 69 2024-03-26T16:58:48.960 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:48.960 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:48.960 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:48.960 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:48.960 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:48.960 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=69 2024-03-26T16:58:48.960 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:48.960 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 70 2024-03-26T16:58:48.960 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:48.961 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:48.961 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:48.961 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:48.961 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:48.961 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=70 2024-03-26T16:58:48.961 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:48.961 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 71 2024-03-26T16:58:48.961 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:48.961 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:48.962 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:48.962 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:48.962 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:48.962 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=71 2024-03-26T16:58:48.962 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:48.962 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 72 2024-03-26T16:58:48.962 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:48.962 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:48.962 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:48.962 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:48.962 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:48.962 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=72 2024-03-26T16:58:48.963 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:48.963 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 73 2024-03-26T16:58:48.963 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:48.963 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:48.963 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:48.963 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:48.963 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:48.963 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=73 2024-03-26T16:58:48.963 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:48.963 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 74 2024-03-26T16:58:48.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:48.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:48.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:48.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:48.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:48.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=74 2024-03-26T16:58:48.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:48.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 75 2024-03-26T16:58:48.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:48.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:48.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:48.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:48.965 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:48.965 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=75 2024-03-26T16:58:48.965 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:48.965 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 76 2024-03-26T16:58:48.965 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:48.965 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:48.965 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:48.965 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:48.965 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:48.965 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=76 2024-03-26T16:58:48.966 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:48.966 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 77 2024-03-26T16:58:48.966 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:48.966 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:48.966 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:48.966 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:48.966 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:48.966 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=77 2024-03-26T16:58:48.966 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:48.966 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 78 2024-03-26T16:58:48.966 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:48.967 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:48.967 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:48.967 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:48.967 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:48.967 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=78 2024-03-26T16:58:48.967 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:48.967 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 79 2024-03-26T16:58:48.967 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:48.967 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:48.967 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:48.967 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:48.967 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:48.967 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=79 2024-03-26T16:58:48.967 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:48.968 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 80 2024-03-26T16:58:48.968 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:48.968 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:48.968 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:48.968 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:48.968 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:48.968 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=80 2024-03-26T16:58:48.968 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:48.968 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 81 2024-03-26T16:58:48.968 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:48.968 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:48.968 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:48.968 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:48.968 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:48.969 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=81 2024-03-26T16:58:48.969 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:48.969 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 82 2024-03-26T16:58:48.969 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:48.969 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:48.969 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:48.969 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:48.969 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:48.969 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=82 2024-03-26T16:58:48.969 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:48.970 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 83 2024-03-26T16:58:48.970 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:48.970 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:48.970 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:48.970 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:48.970 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:48.970 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=83 2024-03-26T16:58:48.970 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:48.970 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 84 2024-03-26T16:58:48.970 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:48.971 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:48.971 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:48.971 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:48.971 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:48.971 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=84 2024-03-26T16:58:48.971 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:48.971 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 85 2024-03-26T16:58:48.971 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:48.971 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:48.971 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:48.971 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:48.971 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:48.971 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=85 2024-03-26T16:58:48.971 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:48.971 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 86 2024-03-26T16:58:48.972 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:48.972 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:48.972 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:48.972 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:48.972 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:48.972 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=86 2024-03-26T16:58:48.972 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:48.972 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 87 2024-03-26T16:58:48.972 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:48.972 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:48.972 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:48.972 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:48.972 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:48.972 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=87 2024-03-26T16:58:48.973 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:48.973 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 88 2024-03-26T16:58:48.973 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:48.973 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:48.973 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:48.973 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:48.974 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:48.974 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=88 2024-03-26T16:58:48.974 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:48.974 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 89 2024-03-26T16:58:48.974 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:48.974 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:48.974 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:48.974 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:48.974 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:48.974 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=89 2024-03-26T16:58:48.974 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:48.974 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 90 2024-03-26T16:58:48.974 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:48.975 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:48.975 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:48.975 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:48.975 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:48.975 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=90 2024-03-26T16:58:49.206 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:49.207 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 91 2024-03-26T16:58:49.207 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:49.207 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:49.207 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:49.207 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:49.207 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:49.207 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=91 2024-03-26T16:58:49.207 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:49.207 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 92 2024-03-26T16:58:49.207 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:49.207 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:49.207 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:49.207 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:49.207 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:49.208 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=92 2024-03-26T16:58:49.208 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:49.208 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 93 2024-03-26T16:58:49.208 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:49.208 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:49.208 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:49.208 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:49.208 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:49.208 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=93 2024-03-26T16:58:49.208 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:49.209 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 94 2024-03-26T16:58:49.209 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:49.209 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:49.209 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:49.209 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:49.209 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:49.209 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=94 2024-03-26T16:58:49.210 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:49.210 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 95 2024-03-26T16:58:49.210 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:49.210 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:49.210 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:49.210 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:49.210 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:49.210 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=95 2024-03-26T16:58:49.210 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:49.210 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 96 2024-03-26T16:58:49.210 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:48] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:49.210 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:49.210 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:49.210 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:49.210 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:49.211 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=96 2024-03-26T16:58:49.211 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:49.211 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 97 2024-03-26T16:58:49.211 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:49.211 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:49.211 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:49.211 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:49.211 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:49.211 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=97 2024-03-26T16:58:49.211 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:49.211 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 98 2024-03-26T16:58:49.211 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:49.211 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:49.211 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:49.211 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:49.211 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:49.212 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=98 2024-03-26T16:58:49.212 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:49.212 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 99 2024-03-26T16:58:49.212 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:49.212 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:49.212 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:49.212 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:49.212 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:49.212 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=99 2024-03-26T16:58:49.212 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:49.212 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 100 2024-03-26T16:58:49.212 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:49.212 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:49.212 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:49.212 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:49.213 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:49.213 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=100 2024-03-26T16:58:49.213 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:49.213 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 101 2024-03-26T16:58:49.213 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:49.213 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:49.213 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:49.213 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:49.213 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:49.213 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=101 2024-03-26T16:58:49.213 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:49.213 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 102 2024-03-26T16:58:49.213 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:49.214 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:49.214 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:49.214 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:49.214 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:49.214 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=102 2024-03-26T16:58:49.214 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:49.214 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 103 2024-03-26T16:58:49.214 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:49.214 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:49.214 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:49.214 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:49.214 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:49.214 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=103 2024-03-26T16:58:49.214 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:49.215 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 104 2024-03-26T16:58:49.215 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:49.215 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:49.215 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:49.215 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:49.215 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:49.215 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=104 2024-03-26T16:58:49.215 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:49.215 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 105 2024-03-26T16:58:49.215 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:49.215 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:49.215 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:49.215 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:49.215 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:49.215 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=105 2024-03-26T16:58:49.215 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:49.216 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 106 2024-03-26T16:58:49.216 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:49.216 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:49.216 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:49.216 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:49.216 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:49.216 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=106 2024-03-26T16:58:49.216 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:49.216 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 107 2024-03-26T16:58:49.216 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:49.216 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:49.216 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:49.216 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:49.216 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:49.216 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=107 2024-03-26T16:58:49.217 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:49.217 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 108 2024-03-26T16:58:49.217 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:49.217 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:49.217 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:49.217 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:49.217 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:49.217 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=108 2024-03-26T16:58:49.217 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:49.217 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 109 2024-03-26T16:58:49.217 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:49.217 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:49.217 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:49.217 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:49.217 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:49.218 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=109 2024-03-26T16:58:49.218 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:49.218 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 110 2024-03-26T16:58:49.218 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:49.218 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:49.219 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:49.219 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:49.219 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:49.219 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=110 2024-03-26T16:58:49.219 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:49.219 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 111 2024-03-26T16:58:49.219 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:49.219 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:49.219 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:49.219 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:49.219 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:49.219 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=111 2024-03-26T16:58:49.219 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:49.220 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 112 2024-03-26T16:58:49.220 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:49.220 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:49.220 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:49.220 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:49.220 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:49.220 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=112 2024-03-26T16:58:49.220 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:49.220 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 113 2024-03-26T16:58:49.220 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:49.220 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:49.220 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:49.220 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:49.220 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:49.220 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=113 2024-03-26T16:58:49.221 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:49.221 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 114 2024-03-26T16:58:49.221 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:49.221 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:49.221 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:49.221 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:49.221 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:49.221 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=114 2024-03-26T16:58:49.221 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:49.221 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 115 2024-03-26T16:58:49.221 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:49.221 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:49.221 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:49.221 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:49.221 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:49.222 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=115 2024-03-26T16:58:49.222 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:49.222 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 116 2024-03-26T16:58:49.222 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:49.222 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:49.222 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:49.222 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:49.222 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:49.222 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=116 2024-03-26T16:58:49.222 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:49.222 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 117 2024-03-26T16:58:49.222 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:49.222 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:49.222 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:49.223 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:49.223 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:49.223 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=117 2024-03-26T16:58:49.223 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:49.223 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 118 2024-03-26T16:58:49.223 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:49.223 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:49.223 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:49.223 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:49.223 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:49.223 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=118 2024-03-26T16:58:49.223 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:49.223 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 119 2024-03-26T16:58:49.223 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:49.223 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:49.224 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:49.224 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:49.224 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:49.224 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=119 2024-03-26T16:58:49.224 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:49.224 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 120 2024-03-26T16:58:49.224 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:49.224 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:49.224 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:49.224 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:49.224 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:49.224 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=120 2024-03-26T16:58:49.224 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:49.224 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 121 2024-03-26T16:58:49.225 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:49.225 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:49.225 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:49.225 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:49.225 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:49.225 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=121 2024-03-26T16:58:49.225 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:49.225 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 122 2024-03-26T16:58:49.225 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:49.225 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:49.225 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:49.225 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:49.225 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:49.225 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=122 2024-03-26T16:58:49.462 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:49.463 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 123 2024-03-26T16:58:49.463 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:49.463 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:49.463 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:49.463 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:49.463 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:49.463 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=123 2024-03-26T16:58:49.463 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:49.463 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 124 2024-03-26T16:58:49.463 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:49.463 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:49.463 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:49.463 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:49.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:49.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=124 2024-03-26T16:58:49.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:49.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 125 2024-03-26T16:58:49.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:49.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:49.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:49.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:49.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:49.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=125 2024-03-26T16:58:49.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:49.465 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 126 2024-03-26T16:58:49.465 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:49.465 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:49.465 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:49.465 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:49.465 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:49.466 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=126 2024-03-26T16:58:49.466 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:49.466 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 127 2024-03-26T16:58:49.466 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:49.466 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:49.466 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:49.466 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:49.466 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:49.466 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=127 2024-03-26T16:58:49.466 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:49.466 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 128 2024-03-26T16:58:49.466 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:49.466 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:49.466 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:49.466 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:49.466 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:49.467 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=128 2024-03-26T16:58:49.467 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:49.467 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 129 2024-03-26T16:58:49.467 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:49.467 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:49.467 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:49.467 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:49.467 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:49.467 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=129 2024-03-26T16:58:49.467 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:49.467 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 130 2024-03-26T16:58:49.467 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:49.467 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:49.467 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:49.467 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:49.467 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:49.468 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=130 2024-03-26T16:58:49.468 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:49.468 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 131 2024-03-26T16:58:49.468 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:49.468 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:49.468 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:49.468 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:49.468 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:49.468 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=131 2024-03-26T16:58:49.468 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:49.468 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 132 2024-03-26T16:58:49.468 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:49.468 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:49.468 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:49.468 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:49.468 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:49.469 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=132 2024-03-26T16:58:49.469 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:49.469 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 133 2024-03-26T16:58:49.469 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:49.469 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:49.469 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:49.469 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:49.469 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:49.469 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=133 2024-03-26T16:58:49.469 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:49.469 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 134 2024-03-26T16:58:49.469 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:49.469 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:49.469 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:49.469 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:49.469 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:49.470 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=134 2024-03-26T16:58:49.470 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:49.470 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 135 2024-03-26T16:58:49.470 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:49.470 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:49.470 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:49.470 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:49.470 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:49.470 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=135 2024-03-26T16:58:49.470 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:49.470 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 136 2024-03-26T16:58:49.470 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:49.470 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:49.470 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:49.470 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:49.471 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:49.471 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=136 2024-03-26T16:58:49.471 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:49.471 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 137 2024-03-26T16:58:49.471 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:49.471 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:49.471 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:49.471 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:49.471 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:49.471 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=137 2024-03-26T16:58:49.471 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:49.471 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 138 2024-03-26T16:58:49.471 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:49.471 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:49.471 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:49.471 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:49.472 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:49.472 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=138 2024-03-26T16:58:49.472 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:49.472 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 139 2024-03-26T16:58:49.472 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:49.472 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:49.472 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:49.472 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:49.472 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:49.472 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=139 2024-03-26T16:58:49.472 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:49.472 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 140 2024-03-26T16:58:49.472 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:49.472 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:49.472 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:49.473 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:49.473 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:49.473 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=140 2024-03-26T16:58:49.473 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:49.473 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 141 2024-03-26T16:58:49.473 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:49.473 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:49.473 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:49.473 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:49.473 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:49.473 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=141 2024-03-26T16:58:49.473 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:49.473 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 142 2024-03-26T16:58:49.473 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:49.473 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:49.474 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:49.474 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:49.474 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:49.474 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=142 2024-03-26T16:58:49.474 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:49.474 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 143 2024-03-26T16:58:49.475 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:49.475 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:49.475 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:49.475 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:49.475 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:49.475 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=143 2024-03-26T16:58:49.475 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:49.475 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 144 2024-03-26T16:58:49.475 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:49.475 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:49.475 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:49.475 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:49.475 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:49.475 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=144 2024-03-26T16:58:49.475 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:49.475 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 145 2024-03-26T16:58:49.476 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:49.476 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:49.476 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:49.476 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:49.476 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:49.476 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=145 2024-03-26T16:58:49.476 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:49.476 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 146 2024-03-26T16:58:49.476 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:49.476 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:49.476 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:49.476 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:49.476 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:49.476 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=146 2024-03-26T16:58:49.476 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:49.476 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 147 2024-03-26T16:58:49.477 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:49.477 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:49.477 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:49.477 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:49.477 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:49.477 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=147 2024-03-26T16:58:49.477 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:49.477 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 148 2024-03-26T16:58:49.477 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:49.477 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:49.477 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:49.477 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:49.477 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:49.477 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=148 2024-03-26T16:58:49.477 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:49.477 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 149 2024-03-26T16:58:49.477 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:49.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:49.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:49.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:49.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:49.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=149 2024-03-26T16:58:49.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:49.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 150 2024-03-26T16:58:49.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:49.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:49.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:49.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:49.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:49.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=150 2024-03-26T16:58:49.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:49.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 151 2024-03-26T16:58:49.479 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:49.479 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:49.479 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:49.479 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:49.479 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:49.479 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=151 2024-03-26T16:58:49.479 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:49.479 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 152 2024-03-26T16:58:49.479 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:49.479 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:49.479 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:49.479 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:49.479 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:49.479 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=152 2024-03-26T16:58:49.479 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:49.479 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 153 2024-03-26T16:58:49.480 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:49.480 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:49.480 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:49.480 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:49.480 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:49.480 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=153 2024-03-26T16:58:49.480 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:49.480 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 154 2024-03-26T16:58:49.480 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:49.480 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:49.480 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:49.480 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:49.480 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:49.480 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=154 2024-03-26T16:58:49.718 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:49.718 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 155 2024-03-26T16:58:49.719 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:49.719 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:49.719 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:49.719 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:49.719 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:49.719 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=155 2024-03-26T16:58:49.719 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:49.719 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 156 2024-03-26T16:58:49.719 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:49.719 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:49.719 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:49.719 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:49.719 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:49.719 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=156 2024-03-26T16:58:49.720 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:49.720 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 157 2024-03-26T16:58:49.720 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:49.720 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:49.720 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:49.720 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:49.720 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:49.720 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=157 2024-03-26T16:58:49.720 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:49.721 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 158 2024-03-26T16:58:49.721 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:49.721 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:49.721 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:49.721 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:49.721 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:49.721 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=158 2024-03-26T16:58:49.721 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:49.721 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 159 2024-03-26T16:58:49.721 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:49.722 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:49.722 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:49.722 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:49.722 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:49.722 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=159 2024-03-26T16:58:49.722 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:49.722 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 160 2024-03-26T16:58:49.722 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:49.722 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:49.722 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:49.722 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:49.722 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:49.722 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=160 2024-03-26T16:58:49.722 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:49.723 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 161 2024-03-26T16:58:49.723 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:49.723 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:49.723 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:49.723 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:49.723 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:49.723 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=161 2024-03-26T16:58:49.723 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:49.723 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 162 2024-03-26T16:58:49.723 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:49.723 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:49.723 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:49.723 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:49.723 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:49.723 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=162 2024-03-26T16:58:49.724 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:49.724 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 163 2024-03-26T16:58:49.724 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:49.724 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:49.724 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:49.724 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:49.724 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:49.724 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=163 2024-03-26T16:58:49.724 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:49.724 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 164 2024-03-26T16:58:49.724 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:49.724 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:49.724 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:49.724 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:49.725 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:49.725 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=164 2024-03-26T16:58:49.725 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:49.725 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 165 2024-03-26T16:58:49.725 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:49.725 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:49.725 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:49.725 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:49.725 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:49.725 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=165 2024-03-26T16:58:49.725 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:49.725 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 166 2024-03-26T16:58:49.725 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:49.725 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:49.725 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:49.725 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:49.726 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:49.726 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=166 2024-03-26T16:58:49.726 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:49.726 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 167 2024-03-26T16:58:49.726 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:49.726 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:49.726 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:49.726 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:49.726 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:49.726 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=167 2024-03-26T16:58:49.727 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:49.727 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 168 2024-03-26T16:58:49.727 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:49.727 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:49.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:49.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:49.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:49.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=168 2024-03-26T16:58:49.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:49.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 169 2024-03-26T16:58:49.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:49.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:49.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:49.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:49.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:49.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=169 2024-03-26T16:58:49.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:49.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 170 2024-03-26T16:58:49.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:49.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:49.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:49.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:49.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:49.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=170 2024-03-26T16:58:49.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:49.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 171 2024-03-26T16:58:49.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:49.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:49.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:49.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:49.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:49.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=171 2024-03-26T16:58:49.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:49.730 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 172 2024-03-26T16:58:49.730 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:49.730 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:49.730 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:49.730 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:49.730 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:49.730 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=172 2024-03-26T16:58:49.730 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:49.730 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 173 2024-03-26T16:58:49.730 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:49.730 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:49.730 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:49.730 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:49.730 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:49.730 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=173 2024-03-26T16:58:49.731 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:49.731 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 174 2024-03-26T16:58:49.731 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:49.731 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:49.731 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:49.731 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:49.731 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:49.731 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=174 2024-03-26T16:58:49.731 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:49.731 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 175 2024-03-26T16:58:49.731 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:49.731 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:49.731 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:49.731 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:49.731 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:49.732 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=175 2024-03-26T16:58:49.732 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:49.732 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 176 2024-03-26T16:58:49.732 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:49.732 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:49.732 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:49.732 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:49.732 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:49.732 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=176 2024-03-26T16:58:49.732 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:49.732 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 177 2024-03-26T16:58:49.732 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:49.732 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:49.732 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:49.732 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:49.733 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:49.733 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=177 2024-03-26T16:58:49.733 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:49.733 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 178 2024-03-26T16:58:49.733 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:49.733 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:49.733 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:49.733 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:49.733 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:49.733 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=178 2024-03-26T16:58:49.733 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:49.733 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 179 2024-03-26T16:58:49.733 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:49.733 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:49.734 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:49.734 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:49.734 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:49.734 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=179 2024-03-26T16:58:49.734 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:49.734 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 180 2024-03-26T16:58:49.734 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:49.734 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:49.734 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:49.734 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:49.734 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:49.734 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=180 2024-03-26T16:58:49.734 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:49.734 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 181 2024-03-26T16:58:49.734 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:49.735 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:49.735 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:49.735 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:49.735 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:49.735 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=181 2024-03-26T16:58:49.735 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:49.735 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 182 2024-03-26T16:58:49.735 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:49.735 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:49.735 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:49.735 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:49.735 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:49.735 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=182 2024-03-26T16:58:49.735 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:49.736 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 183 2024-03-26T16:58:49.736 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:49.736 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:49.736 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:49.736 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:49.736 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:49.736 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=183 2024-03-26T16:58:49.736 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:49.736 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 184 2024-03-26T16:58:49.736 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:49.736 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:49.736 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:49.736 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:49.736 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:49.736 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=184 2024-03-26T16:58:49.736 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:49.737 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 185 2024-03-26T16:58:49.737 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:49.737 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:49.737 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:49.737 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:49.737 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:49.737 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=185 2024-03-26T16:58:49.737 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:49.737 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 186 2024-03-26T16:58:49.737 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:49.737 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:49.737 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:49.737 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:49.737 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:49.737 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=186 2024-03-26T16:58:49.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:49 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:49] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:58:49.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:49 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:49] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}] 2024-03-26T16:58:49.974 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:49.975 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 187 2024-03-26T16:58:49.975 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:49.975 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:49.975 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:49.975 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:49.975 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:49.975 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=187 2024-03-26T16:58:49.975 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:49.975 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 188 2024-03-26T16:58:49.975 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:49.975 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:49.975 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:49.975 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:49.975 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:49.975 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=188 2024-03-26T16:58:49.976 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:49.976 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 189 2024-03-26T16:58:49.976 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:49.976 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:49.976 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:49.976 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:49.976 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:49.976 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=189 2024-03-26T16:58:49.976 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:49.977 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 190 2024-03-26T16:58:49.977 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:49.977 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:49.977 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:49.977 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:49.977 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:49.977 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=190 2024-03-26T16:58:49.977 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:49.977 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 191 2024-03-26T16:58:49.977 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:49.977 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:49.977 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:49.977 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:49.977 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:49.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=191 2024-03-26T16:58:49.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:49.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 192 2024-03-26T16:58:49.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:49.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:49.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:49.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:49.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:49.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=192 2024-03-26T16:58:49.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:49.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 193 2024-03-26T16:58:49.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:49.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:49.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:49.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:49.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:49.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=193 2024-03-26T16:58:49.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:49.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 194 2024-03-26T16:58:49.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:49.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:49.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:49.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:49.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:49.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=194 2024-03-26T16:58:49.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:49.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 195 2024-03-26T16:58:49.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:49.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:49.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:49.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:49.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:49.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=195 2024-03-26T16:58:49.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:49.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 196 2024-03-26T16:58:49.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:49.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:49.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:49.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:49.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:49.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=196 2024-03-26T16:58:49.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:49.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 197 2024-03-26T16:58:49.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:49.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:49.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:49.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:49.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:49.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=197 2024-03-26T16:58:49.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:49.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 198 2024-03-26T16:58:49.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:49.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:49.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:49.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:49.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:49.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=198 2024-03-26T16:58:49.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:49.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 199 2024-03-26T16:58:49.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:49.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:49.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:49.982 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:49.982 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:49.982 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=199 2024-03-26T16:58:49.983 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:49.983 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 200 2024-03-26T16:58:49.983 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:49.983 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:49.983 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:49.983 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:49.983 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:49.983 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=200 2024-03-26T16:58:49.983 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:49.983 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 201 2024-03-26T16:58:49.983 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:49.983 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:49.983 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:49.983 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:49.984 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:49.984 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=201 2024-03-26T16:58:49.984 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:49.984 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 202 2024-03-26T16:58:49.984 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:49.984 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:49.984 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:49.984 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:49.984 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:49.984 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=202 2024-03-26T16:58:49.984 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:49.984 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 203 2024-03-26T16:58:49.984 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:49.984 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:49.984 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:49.985 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:49.985 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:49.985 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=203 2024-03-26T16:58:49.985 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:49.985 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 204 2024-03-26T16:58:49.985 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:49.985 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:49.985 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:49.985 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:49.985 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:49.985 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=204 2024-03-26T16:58:49.985 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:49.985 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 205 2024-03-26T16:58:49.985 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:49.985 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:49.986 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:49.986 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:49.986 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:49.986 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=205 2024-03-26T16:58:49.986 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:49.986 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 206 2024-03-26T16:58:49.986 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:49.986 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:49.986 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:49.986 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:49.986 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:49.986 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=206 2024-03-26T16:58:49.986 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:49.986 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 207 2024-03-26T16:58:49.986 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:49.987 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:49.987 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:49.987 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:49.987 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:49.987 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=207 2024-03-26T16:58:49.987 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:49.987 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 208 2024-03-26T16:58:49.987 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:49.987 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:49.987 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:49.987 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:49.987 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:49.987 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=208 2024-03-26T16:58:49.987 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:49.987 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 209 2024-03-26T16:58:49.987 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:49.988 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:49.988 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:49.988 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:49.988 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:49.988 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=209 2024-03-26T16:58:49.988 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:49.988 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 210 2024-03-26T16:58:49.988 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:49.988 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:49.988 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:49.988 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:49.988 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:49.988 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=210 2024-03-26T16:58:49.988 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:49.988 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 211 2024-03-26T16:58:49.989 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:49.989 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:49.989 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:49.989 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:49.989 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:49.989 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=211 2024-03-26T16:58:49.989 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:49.989 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 212 2024-03-26T16:58:49.989 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:49.989 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:49.989 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:49.989 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:49.989 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:49.989 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=212 2024-03-26T16:58:49.989 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:49.989 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 213 2024-03-26T16:58:49.990 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:49.990 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:49.990 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:49.990 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:49.990 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:49.990 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=213 2024-03-26T16:58:49.990 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:49.990 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 214 2024-03-26T16:58:49.990 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:49.990 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:49.990 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:49.990 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:49.990 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:49.990 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=214 2024-03-26T16:58:49.990 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:49.990 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 215 2024-03-26T16:58:49.991 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:49.991 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:49.991 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:49.991 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:49.991 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:49.991 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=215 2024-03-26T16:58:49.991 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:49.991 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 216 2024-03-26T16:58:49.991 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:49.991 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:49.991 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:49.991 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:49.991 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:49.991 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=216 2024-03-26T16:58:49.991 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:49.991 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 217 2024-03-26T16:58:49.992 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:49.992 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:49.992 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:49.992 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:49.992 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:49.992 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=217 2024-03-26T16:58:49.992 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:49.992 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 218 2024-03-26T16:58:49.992 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:49.992 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:49.992 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:49.992 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:49.992 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:49.992 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=218 2024-03-26T16:58:50.230 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-mon[34678]: pgmap v365: 33 pgs: 33 active+clean; 609 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 7.0 KiB/s rd, 682 B/s wr, 6 op/s 2024-03-26T16:58:50.230 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:50.230 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 219 2024-03-26T16:58:50.230 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:50.231 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:50.231 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:50.231 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:50.231 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:50.231 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=219 2024-03-26T16:58:50.231 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:50.231 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 220 2024-03-26T16:58:50.231 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:50.231 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:50.231 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:50.231 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:50.231 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:50.231 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=220 2024-03-26T16:58:50.232 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:50.232 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 221 2024-03-26T16:58:50.232 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:49] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:50.232 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:50.232 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:50.232 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:50.232 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:50.232 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=221 2024-03-26T16:58:50.232 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:50] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:50.233 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:50] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 222 2024-03-26T16:58:50.233 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:50] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:50.233 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:50.233 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:50.233 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:50.234 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:50.234 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=222 2024-03-26T16:58:50.234 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:50] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:50.234 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:50] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 223 2024-03-26T16:58:50.234 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:50] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:50.234 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:50.234 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:50.234 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:50.234 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:50.234 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=223 2024-03-26T16:58:50.234 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:50] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:50.234 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:50] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 224 2024-03-26T16:58:50.235 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:50] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:50.235 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:50.235 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:50.235 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:50.235 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:50.235 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=224 2024-03-26T16:58:50.235 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:50] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:50.235 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:50] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 225 2024-03-26T16:58:50.235 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:50] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:50.235 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:50.235 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:50.235 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:50.235 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:50.235 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=225 2024-03-26T16:58:50.236 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:50] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:50.236 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:50] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 226 2024-03-26T16:58:50.236 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:50] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:50.236 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:50.236 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:50.236 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:50.236 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:50.236 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=226 2024-03-26T16:58:50.236 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:50] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:50.236 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:50] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 227 2024-03-26T16:58:50.236 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:50] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:50.236 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:50.236 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:50.236 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:50.237 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:50.237 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=227 2024-03-26T16:58:50.237 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:50] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:50.237 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:50] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 228 2024-03-26T16:58:50.237 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:50] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:50.237 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:50.237 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:50.237 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:50.237 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:50.237 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=228 2024-03-26T16:58:50.237 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:50] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:50.237 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:50] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 229 2024-03-26T16:58:50.237 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:50] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:50.237 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:50.238 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:50.238 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:50.238 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:50.238 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=229 2024-03-26T16:58:50.238 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:50] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:50.238 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:50] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 230 2024-03-26T16:58:50.238 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:50] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:50.238 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:50.238 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:50.238 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:50.238 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:50.238 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=230 2024-03-26T16:58:50.238 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:50] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:50.238 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:50] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 231 2024-03-26T16:58:50.239 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:50] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:50.239 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:50.239 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:50.239 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:50.239 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:50.239 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=231 2024-03-26T16:58:50.239 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:50] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:50.239 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:50] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 232 2024-03-26T16:58:50.239 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:50] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:50.239 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:50.239 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:50.239 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:50.239 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:50.240 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=232 2024-03-26T16:58:50.240 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:50] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:50.240 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:50] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 233 2024-03-26T16:58:50.240 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:50] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:50.240 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:50.240 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:50.240 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:50.240 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:50.240 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=233 2024-03-26T16:58:50.240 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:50] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:50.240 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:50] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 234 2024-03-26T16:58:50.240 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:50] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:50.240 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:50.241 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:50.241 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:50.241 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:50.241 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=234 2024-03-26T16:58:50.241 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:50] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:50.241 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:50] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 235 2024-03-26T16:58:50.241 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:50] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:50.241 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:50.241 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:50.241 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:50.241 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:50.241 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=235 2024-03-26T16:58:50.241 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:50] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:50.241 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:50] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 236 2024-03-26T16:58:50.242 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:50] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:50.242 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:50.242 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:50.242 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:50.242 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:50.242 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=236 2024-03-26T16:58:50.242 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:50] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:50.242 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:50] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 237 2024-03-26T16:58:50.242 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:50] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:50.242 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:50.242 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:50.242 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:50.242 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:50.242 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=237 2024-03-26T16:58:50.243 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:50] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:50.243 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:50] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 238 2024-03-26T16:58:50.243 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:50] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:50.243 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:50.243 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:50.244 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:50.244 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:50.244 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=238 2024-03-26T16:58:50.244 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:50] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:50.244 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:50] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 239 2024-03-26T16:58:50.244 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:50] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:50.244 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:50.244 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:50.244 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:50.244 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:50.244 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=239 2024-03-26T16:58:50.244 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:50] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:50.245 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:50] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 240 2024-03-26T16:58:50.245 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:50] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:50.245 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:50.245 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:50.245 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:50.245 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:50.245 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=240 2024-03-26T16:58:50.245 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:50] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:50.245 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:50] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 241 2024-03-26T16:58:50.245 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:50] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:50.245 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:50.245 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:50.245 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:50.245 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:50.246 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=241 2024-03-26T16:58:50.246 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:50] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:50.246 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:50] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 242 2024-03-26T16:58:50.246 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:50] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:50.246 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:50.246 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:50.246 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:50.246 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:50.246 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=242 2024-03-26T16:58:50.246 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:50] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:50.246 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:50] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 243 2024-03-26T16:58:50.246 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:50] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:50.246 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:50.246 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:50.247 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:50.247 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:50.247 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=243 2024-03-26T16:58:50.247 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:50] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:50.247 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:50] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 244 2024-03-26T16:58:50.247 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:50] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:50.247 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:50.247 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:50.247 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:50.247 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:50.247 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=244 2024-03-26T16:58:50.247 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:50] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:50.247 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:50] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 245 2024-03-26T16:58:50.248 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:50] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:50.248 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:50.248 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:50.248 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:50.248 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:50.248 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=245 2024-03-26T16:58:50.248 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:50] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:50.248 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:50] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 246 2024-03-26T16:58:50.248 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:50] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:50.248 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:50.248 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:50.248 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:50.248 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:50.248 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=246 2024-03-26T16:58:50.249 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:50] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:50.249 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:50] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 247 2024-03-26T16:58:50.249 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:50] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:50.249 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:50.249 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:50.249 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:50.249 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:50.249 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=247 2024-03-26T16:58:50.249 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:50] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:50.249 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:50] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 248 2024-03-26T16:58:50.249 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:50] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:50.249 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:50.249 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:50.249 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:50.249 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:50.250 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=248 2024-03-26T16:58:50.250 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:50] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:50.250 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:50] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 249 2024-03-26T16:58:50.250 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:50] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:50.250 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:50.250 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:50.250 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:50.250 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:50.250 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=249 2024-03-26T16:58:50.301 INFO:tasks.workunit.client.3.smithi157.stdout:Adding nqn.2016-06.io.spdk:cnode1 listener at 172.21.15.149:4420: Successful 2024-03-26T16:58:50.499 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:58:50 smithi064 ceph-mon[34420]: pgmap v365: 33 pgs: 33 active+clean; 609 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 7.0 KiB/s rd, 682 B/s wr, 6 op/s 2024-03-26T16:58:50.500 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:58:50 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-b[34416]: 2024-03-26T16:58:50.275+0000 7ff022916700 -1 mon.b@2(peon) e3 get_health_metrics reporting 1 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T16:58:50.500 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:50 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:50] INFO grpc.py:1992: Received request to create smithi149 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode1 at 172.21.15.149:4420, context: None 2024-03-26T16:58:50.500 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:50 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:50] INFO grpc.py:2031: Listener not created as gateway's host name smithi064 differs from requested host smithi149 2024-03-26T16:58:50.500 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:50 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:50] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:58:50.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:58:50 smithi044 ceph-mon[30624]: pgmap v365: 33 pgs: 33 active+clean; 609 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 7.0 KiB/s rd, 682 B/s wr, 6 op/s 2024-03-26T16:58:50.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:50 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:50] INFO grpc.py:1992: Received request to create smithi149 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode1 at 172.21.15.149:4420, context: None 2024-03-26T16:58:50.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:50 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:50] INFO grpc.py:2031: Listener not created as gateway's host name smithi044 differs from requested host smithi149 2024-03-26T16:58:50.646 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:50] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:50.647 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:50] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 250 2024-03-26T16:58:50.647 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:50] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:50.647 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:50.647 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:50.647 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:50.647 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:50.647 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=250 2024-03-26T16:58:50.647 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:50] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:50.647 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:50] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 251 2024-03-26T16:58:50.647 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:50] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:50.647 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:50.647 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:50.648 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:50.648 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:50.648 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=251 2024-03-26T16:58:50.648 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:50] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:50.648 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:50] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 252 2024-03-26T16:58:50.648 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:50] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:50.648 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:50.648 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:50.648 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:50.648 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:50.648 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=252 2024-03-26T16:58:50.648 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:50] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:50.649 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:50] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 253 2024-03-26T16:58:50.649 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:50] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:50.649 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:50.649 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:50.649 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:50.649 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:50.649 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=253 2024-03-26T16:58:50.649 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:50] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:50.649 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:50] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 254 2024-03-26T16:58:50.649 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:50] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:50.650 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:50.650 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:50.650 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:50.650 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:50.650 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=254 2024-03-26T16:58:50.650 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:50] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:50.650 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:50] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 255 2024-03-26T16:58:50.650 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:50] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:50.650 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:50.650 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:50.650 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:50.650 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:50.650 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=255 2024-03-26T16:58:50.650 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:50] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:50.651 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:50] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode1 ana state : inaccessible for group : 256 2024-03-26T16:58:50.651 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:50] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T16:58:50.651 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:50.651 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:50.651 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:50.651 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:50.651 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=256 2024-03-26T16:58:50.651 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:50] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:50.651 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:50] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:58:50.651 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:50] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}] 2024-03-26T16:58:50.805 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:50 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:50] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}] 2024-03-26T16:58:51.137 INFO:tasks.workunit.client.3.smithi157.stderr:+ for j in $(seq 1 $NVMEOF_SUBSYSTEMS_COUNT) 2024-03-26T16:58:51.137 INFO:tasks.workunit.client.3.smithi157.stderr:+ subsystem_nqn=nqn.2016-06.io.spdk:cnode2 2024-03-26T16:58:51.137 INFO:tasks.workunit.client.3.smithi157.stdout:Adding gateway listener with IP 172.21.15.149 and name smithi149 2024-03-26T16:58:51.137 INFO:tasks.workunit.client.3.smithi157.stderr:+ echo 'Adding gateway listener with IP 172.21.15.149 and name smithi149' 2024-03-26T16:58:51.137 INFO:tasks.workunit.client.3.smithi157.stderr:+ sudo podman run -it quay.io/barakda1/nvmeof-cli:qe_ceph_devel_21e59b2 --server-address 172.21.15.149 --server-port 5500 listener add --subsystem nqn.2016-06.io.spdk:cnode2 --host-name smithi149 --traddr 172.21.15.149 --trsvcid 4420 2024-03-26T16:58:51.229 INFO:tasks.workunit.client.3.smithi157.stderr:time="2024-03-26T16:58:51Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2024-03-26T16:58:51.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:58:51 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 2024-03-26T16:58:51.200+0000 7fa707a55700 -1 mon.c@1(peon) e3 get_health_metrics reporting 1 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T16:58:51.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:51 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:51] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:58:51.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:51 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:51] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}] 2024-03-26T16:58:52.188 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:51 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:51] INFO grpc.py:1992: Received request to create smithi149 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode2 at 172.21.15.149:4420, context: 2024-03-26T16:58:52.188 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:51 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:51] INFO grpc.py:2023: create_listener: True 2024-03-26T16:58:52.188 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:51 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:51] INFO grpc.py:1958: Subsystem nqn.2016-06.io.spdk:cnode2 enable_ha: True 2024-03-26T16:58:52.189 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:51 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:51] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : optimized for group : 1 2024-03-26T16:58:52.189 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:51 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:51] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:52.189 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:51 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:52.189 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:51 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:52.189 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:51 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:52.189 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:51 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:52.189 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:51 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='optimized' anagrpid=1 2024-03-26T16:58:52.189 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:51 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:51] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:52.189 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:51 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:51] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 2 2024-03-26T16:58:52.189 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:51 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:51] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:52.190 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:51 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:52.190 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:51 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:52.190 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:51 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:52.190 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:51 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:52.190 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:51 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=2 2024-03-26T16:58:52.190 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:51 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:51] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:52.190 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:51 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:51] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 3 2024-03-26T16:58:52.190 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:51 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:51] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:52.190 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:51 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:52.190 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:51 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:52.190 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:51 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:52.190 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:51 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:52.191 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:51 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=3 2024-03-26T16:58:52.191 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:51 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:51] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:52.192 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:51 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:51] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 4 2024-03-26T16:58:52.192 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:51 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:51] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:52.192 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:51 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:52.192 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:51 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:52.192 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:51 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:52.192 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:51 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:52.192 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:51 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=4 2024-03-26T16:58:52.192 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:51 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:51] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:52.192 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:51 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:51] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 5 2024-03-26T16:58:52.192 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:51 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:51] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:52.192 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:51 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:52.192 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:51 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:52.193 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:51 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:52.193 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:51 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:52.193 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:51 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=5 2024-03-26T16:58:52.193 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:51 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:51] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:52.193 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:51 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:51] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 6 2024-03-26T16:58:52.193 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:51 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:51] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:52.193 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:51 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:52.193 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:51 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:52.193 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:51 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:52.193 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:51 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:52.193 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:51 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=6 2024-03-26T16:58:52.193 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:51 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:51] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:52.193 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:51 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:51] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 7 2024-03-26T16:58:52.194 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:51 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:51] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:52.194 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:51 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:52.194 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:51 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:52.194 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:51 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:52.194 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:51 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:52.194 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:51 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=7 2024-03-26T16:58:52.194 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:51 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:51] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:52.194 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:51 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:51] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 8 2024-03-26T16:58:52.194 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:51 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:51] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:52.194 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:51 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:52.194 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:51 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:52.195 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:51 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:52.195 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:51 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:52.195 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:51 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=8 2024-03-26T16:58:52.195 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:52.195 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 9 2024-03-26T16:58:52.195 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:52.195 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:52.195 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:52.195 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:52.195 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:52.195 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=9 2024-03-26T16:58:52.195 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:52.195 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 10 2024-03-26T16:58:52.196 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:52.196 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:52.196 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:52.196 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:52.196 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:52.196 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=10 2024-03-26T16:58:52.196 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:52.196 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 11 2024-03-26T16:58:52.196 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:52.196 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:52.196 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:52.196 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:52.197 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:52.197 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=11 2024-03-26T16:58:52.197 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:52.197 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 12 2024-03-26T16:58:52.197 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:52.197 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:52.197 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:52.197 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:52.197 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:52.197 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=12 2024-03-26T16:58:52.197 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:52.197 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 13 2024-03-26T16:58:52.198 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:52.198 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:52.198 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:52.198 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:52.198 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:52.198 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=13 2024-03-26T16:58:52.198 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:52.198 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 14 2024-03-26T16:58:52.198 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:52.198 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:52.198 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:52.198 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:52.199 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:52.199 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=14 2024-03-26T16:58:52.199 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:52.199 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 15 2024-03-26T16:58:52.199 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:52.199 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:52.199 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:52.199 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:52.199 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:52.199 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=15 2024-03-26T16:58:52.199 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:52.199 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 16 2024-03-26T16:58:52.199 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:52.200 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:52.200 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:52.200 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:52.200 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:52.200 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=16 2024-03-26T16:58:52.201 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:52.201 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 17 2024-03-26T16:58:52.201 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:52.201 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:52.201 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:52.201 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:52.201 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:52.201 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=17 2024-03-26T16:58:52.202 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:52.202 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 18 2024-03-26T16:58:52.202 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:52.202 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:52.202 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:52.202 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:52.202 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:52.202 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=18 2024-03-26T16:58:52.202 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:52.202 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 19 2024-03-26T16:58:52.202 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:52.202 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:52.203 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:52.203 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:52.203 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:52.203 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=19 2024-03-26T16:58:52.203 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:52.203 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 20 2024-03-26T16:58:52.203 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:52.203 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:52.203 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:52.203 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:52.203 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:52.203 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=20 2024-03-26T16:58:52.204 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:52.204 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 21 2024-03-26T16:58:52.204 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:52.204 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:52.204 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:52.204 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:52.204 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:52.204 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=21 2024-03-26T16:58:52.204 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:52.204 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 22 2024-03-26T16:58:52.204 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:52.204 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:52.205 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:52.205 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:52.205 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:52.205 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=22 2024-03-26T16:58:52.205 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:52.205 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 23 2024-03-26T16:58:52.205 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:52.205 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:52.205 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:52.206 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:52.206 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:52.206 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=23 2024-03-26T16:58:52.206 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:52.206 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 24 2024-03-26T16:58:52.206 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:52.206 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:52.206 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:52.206 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:52.206 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:52.206 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=24 2024-03-26T16:58:52.207 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:52.207 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 25 2024-03-26T16:58:52.207 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:52.207 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:52.207 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:52.207 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:52.207 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:52.207 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=25 2024-03-26T16:58:52.207 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:52.207 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 26 2024-03-26T16:58:52.207 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:52.207 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:52.208 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:52.208 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:52.208 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:52.208 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=26 2024-03-26T16:58:52.208 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:52.208 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 27 2024-03-26T16:58:52.208 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:52.208 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:52.208 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:52.208 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:52.208 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:52.209 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=27 2024-03-26T16:58:52.209 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:52.209 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 28 2024-03-26T16:58:52.209 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:52.209 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:52.209 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:52.209 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:52.209 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:52.209 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=28 2024-03-26T16:58:52.209 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:52.209 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 29 2024-03-26T16:58:52.209 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:52.209 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:52.210 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:52.210 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:52.210 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:52.210 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=29 2024-03-26T16:58:52.210 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:52.210 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 30 2024-03-26T16:58:52.210 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:52.210 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:52.210 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:52.210 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:52.210 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:52.210 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=30 2024-03-26T16:58:52.211 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:52.211 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 31 2024-03-26T16:58:52.211 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:52.211 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:52.211 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:52.211 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:52.211 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:52.211 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=31 2024-03-26T16:58:52.211 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:52.211 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 32 2024-03-26T16:58:52.211 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:52.211 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:52.212 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:52.212 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:52.212 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:52.212 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=32 2024-03-26T16:58:52.438 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-mon[34678]: pgmap v366: 33 pgs: 33 active+clean; 609 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 3.7 KiB/s rd, 341 B/s wr, 3 op/s 2024-03-26T16:58:52.438 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:52.438 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 33 2024-03-26T16:58:52.439 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:52.439 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:52.439 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:52.439 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:52.439 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:52.439 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=33 2024-03-26T16:58:52.439 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:52.439 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 34 2024-03-26T16:58:52.439 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:52.439 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:52.439 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:52.439 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:52.439 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:52.439 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=34 2024-03-26T16:58:52.440 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:52.440 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 35 2024-03-26T16:58:52.440 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:52.440 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:52.440 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:52.440 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:52.440 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:52.440 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=35 2024-03-26T16:58:52.440 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:52.441 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 36 2024-03-26T16:58:52.441 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:52.441 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:52.441 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:52.442 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:52.442 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:52.442 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=36 2024-03-26T16:58:52.442 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:52.442 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 37 2024-03-26T16:58:52.442 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:52.442 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:52.442 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:52.442 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:52.442 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:52.442 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=37 2024-03-26T16:58:52.442 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:52.442 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 38 2024-03-26T16:58:52.442 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:52.443 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:52.443 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:52.443 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:52.443 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:52.443 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=38 2024-03-26T16:58:52.443 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:52.443 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 39 2024-03-26T16:58:52.443 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:52.443 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:52.443 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:52.443 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:52.443 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:52.443 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=39 2024-03-26T16:58:52.444 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:52.444 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 40 2024-03-26T16:58:52.444 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:52.444 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:52.444 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:52.444 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:52.444 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:52.444 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=40 2024-03-26T16:58:52.444 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:52.444 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 41 2024-03-26T16:58:52.444 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:52.444 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:52.444 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:52.444 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:52.445 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:52.445 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=41 2024-03-26T16:58:52.445 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:52.445 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 42 2024-03-26T16:58:52.445 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:52.445 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:52.445 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:52.445 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:52.445 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:52.445 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=42 2024-03-26T16:58:52.445 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:52.445 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 43 2024-03-26T16:58:52.446 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:52.446 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:52.446 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:52.446 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:52.446 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:52.446 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=43 2024-03-26T16:58:52.446 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:52.446 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 44 2024-03-26T16:58:52.446 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:52.446 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:52.446 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:52.446 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:52.446 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:52.447 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=44 2024-03-26T16:58:52.447 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:52.447 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 45 2024-03-26T16:58:52.447 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:52.447 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:52.447 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:52.447 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:52.447 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:52.447 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=45 2024-03-26T16:58:52.447 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:52.447 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 46 2024-03-26T16:58:52.447 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:52.447 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:52.447 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:52.448 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:52.448 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:52.448 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=46 2024-03-26T16:58:52.448 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:52.448 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 47 2024-03-26T16:58:52.448 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:52.448 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:52.448 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:52.448 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:52.448 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:52.448 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=47 2024-03-26T16:58:52.448 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:52.448 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 48 2024-03-26T16:58:52.448 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:52.449 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:52.449 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:52.449 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:52.449 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:52.449 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=48 2024-03-26T16:58:52.449 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:52.449 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 49 2024-03-26T16:58:52.449 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:52.449 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:52.449 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:52.449 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:52.449 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:52.449 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=49 2024-03-26T16:58:52.450 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:52.450 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 50 2024-03-26T16:58:52.450 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:52.450 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:52.450 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:52.450 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:52.450 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:52.450 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=50 2024-03-26T16:58:52.450 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:52.450 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 51 2024-03-26T16:58:52.450 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:52.450 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:52.450 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:52.451 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:52.451 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:52.451 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=51 2024-03-26T16:58:52.451 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:52.451 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 52 2024-03-26T16:58:52.451 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:52.451 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:52.451 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:52.451 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:52.451 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:52.451 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=52 2024-03-26T16:58:52.451 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:52.451 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 53 2024-03-26T16:58:52.451 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:52.452 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:52.452 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:52.452 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:52.452 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:52.452 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=53 2024-03-26T16:58:52.452 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:52.452 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 54 2024-03-26T16:58:52.452 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:52.452 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:52.452 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:52.452 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:52.452 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:52.452 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=54 2024-03-26T16:58:52.452 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:52.453 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 55 2024-03-26T16:58:52.453 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:52.453 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:52.453 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:52.453 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:52.453 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:52.453 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=55 2024-03-26T16:58:52.454 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:52.454 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 56 2024-03-26T16:58:52.454 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:52.454 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:52.454 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:52.454 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:52.454 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:52.454 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=56 2024-03-26T16:58:52.454 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:52.454 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 57 2024-03-26T16:58:52.454 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:52.454 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:52.454 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:52.455 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:52.455 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:52.455 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=57 2024-03-26T16:58:52.455 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:52.455 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 58 2024-03-26T16:58:52.455 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:52.455 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:52.455 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:52.455 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:52.455 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:52.455 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=58 2024-03-26T16:58:52.455 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:52.455 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 59 2024-03-26T16:58:52.455 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:52.456 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:52.456 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:52.456 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:52.456 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:52.456 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=59 2024-03-26T16:58:52.456 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:52.456 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 60 2024-03-26T16:58:52.456 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:52.456 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:52.456 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:52.456 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:52.456 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:52.456 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=60 2024-03-26T16:58:52.456 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:52.457 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 61 2024-03-26T16:58:52.457 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:52.457 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:52.457 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:52.457 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:52.457 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:52.457 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=61 2024-03-26T16:58:52.457 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:52.457 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 62 2024-03-26T16:58:52.457 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:52.457 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:52.457 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:52.457 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:52.457 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:52.458 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=62 2024-03-26T16:58:52.458 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:52.458 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 63 2024-03-26T16:58:52.458 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:52.458 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:52.458 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:52.458 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:52.458 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:52.458 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=63 2024-03-26T16:58:52.507 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:58:52 smithi064 ceph-mon[34420]: pgmap v366: 33 pgs: 33 active+clean; 609 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 3.7 KiB/s rd, 341 B/s wr, 3 op/s 2024-03-26T16:58:52.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:58:52 smithi044 ceph-mon[30624]: pgmap v366: 33 pgs: 33 active+clean; 609 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 3.7 KiB/s rd, 341 B/s wr, 3 op/s 2024-03-26T16:58:52.695 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:52.695 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 64 2024-03-26T16:58:52.695 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:52.695 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:52.695 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:52.695 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:52.695 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:52.695 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=64 2024-03-26T16:58:52.695 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:52.696 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 65 2024-03-26T16:58:52.696 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:52.696 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:52.696 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:52.696 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:52.696 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:52.696 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=65 2024-03-26T16:58:52.696 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:52.696 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 66 2024-03-26T16:58:52.696 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:52.696 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:52.696 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:52.696 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:52.697 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:52.697 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=66 2024-03-26T16:58:52.697 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:52.697 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 67 2024-03-26T16:58:52.697 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:52.697 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:52.697 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:52.697 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:52.697 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:52.697 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=67 2024-03-26T16:58:52.697 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:52.697 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 68 2024-03-26T16:58:52.697 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:52.697 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:52.698 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:52.698 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:52.698 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:52.698 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=68 2024-03-26T16:58:52.698 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:52.698 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 69 2024-03-26T16:58:52.698 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:52.698 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:52.698 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:52.698 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:52.698 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:52.698 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=69 2024-03-26T16:58:52.698 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:52.699 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 70 2024-03-26T16:58:52.699 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:52.700 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:52.700 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:52.700 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:52.700 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:52.700 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=70 2024-03-26T16:58:52.700 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:52.700 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 71 2024-03-26T16:58:52.700 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:52.701 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:52.701 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:52.701 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:52.701 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:52.701 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=71 2024-03-26T16:58:52.701 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:52.701 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 72 2024-03-26T16:58:52.701 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:52.701 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:52.702 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:52.702 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:52.702 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:52.702 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=72 2024-03-26T16:58:52.702 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:52.702 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 73 2024-03-26T16:58:52.702 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:52.702 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:52.702 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:52.702 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:52.702 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:52.702 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=73 2024-03-26T16:58:52.702 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:52.703 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 74 2024-03-26T16:58:52.703 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:52.703 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:52.703 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:52.703 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:52.703 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:52.703 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=74 2024-03-26T16:58:52.703 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:52.703 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 75 2024-03-26T16:58:52.703 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:52.703 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:52.703 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:52.704 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:52.704 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:52.704 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=75 2024-03-26T16:58:52.704 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:52.704 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 76 2024-03-26T16:58:52.704 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:52.704 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:52.704 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:52.704 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:52.704 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:52.704 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=76 2024-03-26T16:58:52.704 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:52.704 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 77 2024-03-26T16:58:52.704 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:52.705 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:52.705 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:52.705 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:52.705 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:52.705 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=77 2024-03-26T16:58:52.705 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:52.705 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 78 2024-03-26T16:58:52.705 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:52.705 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:52.705 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:52.705 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:52.705 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:52.705 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=78 2024-03-26T16:58:52.706 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:52.706 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 79 2024-03-26T16:58:52.706 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:52.706 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:52.706 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:52.706 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:52.706 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:52.706 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=79 2024-03-26T16:58:52.706 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:52.706 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 80 2024-03-26T16:58:52.706 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:52.706 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:52.706 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:52.706 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:52.707 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:52.707 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=80 2024-03-26T16:58:52.707 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:52.707 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 81 2024-03-26T16:58:52.707 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:52.707 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:52.707 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:52.707 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:52.707 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:52.707 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=81 2024-03-26T16:58:52.707 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:52.707 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 82 2024-03-26T16:58:52.707 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:52.707 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:52.708 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:52.708 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:52.708 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:52.708 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=82 2024-03-26T16:58:52.708 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:52.708 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 83 2024-03-26T16:58:52.708 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:52.708 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:52.708 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:52.708 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:52.708 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:52.708 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=83 2024-03-26T16:58:52.708 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:52.708 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 84 2024-03-26T16:58:52.709 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:52.709 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:52.709 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:52.709 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:52.709 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:52.709 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=84 2024-03-26T16:58:52.709 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:52.709 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 85 2024-03-26T16:58:52.709 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:52.709 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:52.709 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:52.709 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:52.709 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:52.709 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=85 2024-03-26T16:58:52.710 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:52.710 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 86 2024-03-26T16:58:52.710 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:52.710 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:52.710 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:52.710 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:52.710 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:52.710 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=86 2024-03-26T16:58:52.710 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:52.710 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 87 2024-03-26T16:58:52.710 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:52.710 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:52.710 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:52.711 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:52.711 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:52.711 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=87 2024-03-26T16:58:52.711 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:52.711 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 88 2024-03-26T16:58:52.711 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:52.711 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:52.711 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:52.711 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:52.711 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:52.711 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=88 2024-03-26T16:58:52.711 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:52.711 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 89 2024-03-26T16:58:52.712 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:52.712 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:52.712 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:52.712 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:52.712 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:52.712 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=89 2024-03-26T16:58:52.712 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:52.712 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 90 2024-03-26T16:58:52.712 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:52.712 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:52.712 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:52.712 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:52.712 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:52.712 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=90 2024-03-26T16:58:52.713 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:52.713 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 91 2024-03-26T16:58:52.713 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:52.713 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:52.713 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:52.713 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:52.713 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:52.713 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=91 2024-03-26T16:58:52.713 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:52.713 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 92 2024-03-26T16:58:52.713 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:52.713 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:52.713 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:52.713 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:52.714 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:52.714 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=92 2024-03-26T16:58:52.714 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:52.714 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 93 2024-03-26T16:58:52.714 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:52.714 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:52.714 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:52.714 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:52.714 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:52.714 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=93 2024-03-26T16:58:52.714 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:52.714 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 94 2024-03-26T16:58:52.715 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:52.715 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:52.715 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:52.715 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:52.715 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:52.715 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=94 2024-03-26T16:58:52.715 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:52.715 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 95 2024-03-26T16:58:52.715 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:52.715 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:52.715 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:52.715 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:52.715 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:52.715 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=95 2024-03-26T16:58:52.805 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:52 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:52] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:58:52.805 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:52 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:52] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}] 2024-03-26T16:58:52.950 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:52.950 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 96 2024-03-26T16:58:52.951 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:52.951 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:52.951 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:52.951 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:52.951 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:52.951 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=96 2024-03-26T16:58:52.951 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:52.951 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 97 2024-03-26T16:58:52.951 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:52.951 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:52.951 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:52.951 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:52.951 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:52.951 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=97 2024-03-26T16:58:52.952 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:52.952 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 98 2024-03-26T16:58:52.952 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:52.952 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:52.952 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:52.952 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:52.952 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:52.952 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=98 2024-03-26T16:58:52.952 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:52.953 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 99 2024-03-26T16:58:52.953 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:52.953 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:52.953 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:52.953 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:52.953 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:52.954 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=99 2024-03-26T16:58:52.954 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:52.954 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 100 2024-03-26T16:58:52.954 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:52.954 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:52.954 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:52.954 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:52.954 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:52.954 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=100 2024-03-26T16:58:52.954 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:52.954 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 101 2024-03-26T16:58:52.954 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:52.954 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:52.955 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:52.955 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:52.955 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:52.955 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=101 2024-03-26T16:58:52.955 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:52.955 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 102 2024-03-26T16:58:52.955 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:52.955 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:52.955 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:52.955 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:52.955 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:52.955 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=102 2024-03-26T16:58:52.955 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:52.955 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 103 2024-03-26T16:58:52.956 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:52.956 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:52.956 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:52.956 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:52.956 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:52.956 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=103 2024-03-26T16:58:52.956 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:52.956 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 104 2024-03-26T16:58:52.956 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:52.956 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:52.956 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:52.956 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:52.956 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:52.956 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=104 2024-03-26T16:58:52.957 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:52.957 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 105 2024-03-26T16:58:52.957 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:52.957 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:52.957 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:52.957 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:52.957 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:52.957 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=105 2024-03-26T16:58:52.957 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:52.957 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 106 2024-03-26T16:58:52.957 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:52.957 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:52.957 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:52.957 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:52.957 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:52.958 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=106 2024-03-26T16:58:52.958 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:52.958 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 107 2024-03-26T16:58:52.958 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:52.958 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:52.958 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:52.958 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:52.958 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:52.958 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=107 2024-03-26T16:58:52.958 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:52.958 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 108 2024-03-26T16:58:52.958 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:52.958 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:52.958 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:52.959 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:52.959 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:52.959 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=108 2024-03-26T16:58:52.959 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:52.959 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 109 2024-03-26T16:58:52.959 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:52.959 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:52.959 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:52.959 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:52.959 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:52.959 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=109 2024-03-26T16:58:52.959 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:52.959 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 110 2024-03-26T16:58:52.960 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:52.960 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:52.960 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:52.960 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:52.960 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:52.960 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=110 2024-03-26T16:58:52.960 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:52.960 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 111 2024-03-26T16:58:52.960 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:52.960 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:52.960 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:52.960 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:52.960 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:52.960 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=111 2024-03-26T16:58:52.961 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:52.961 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 112 2024-03-26T16:58:52.961 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:52.961 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:52.961 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:52.961 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:52.961 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:52.961 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=112 2024-03-26T16:58:52.961 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:52.961 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 113 2024-03-26T16:58:52.961 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:52.961 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:52.961 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:52.961 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:52.962 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:52.962 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=113 2024-03-26T16:58:52.962 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:52.962 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 114 2024-03-26T16:58:52.962 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:52.962 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:52.962 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:52.962 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:52.962 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:52.962 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=114 2024-03-26T16:58:52.962 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:52.962 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 115 2024-03-26T16:58:52.962 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:52.962 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:52.963 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:52.963 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:52.963 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:52.963 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=115 2024-03-26T16:58:52.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:52.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 116 2024-03-26T16:58:52.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:52.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:52.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:52.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:52.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:52.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=116 2024-03-26T16:58:52.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:52.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 117 2024-03-26T16:58:52.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:52.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:52.964 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:52.965 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:52.965 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:52.965 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=117 2024-03-26T16:58:52.965 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:52.965 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 118 2024-03-26T16:58:52.965 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:52.965 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:52.965 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:52.965 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:52.965 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:52.965 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=118 2024-03-26T16:58:52.965 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:52.965 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 119 2024-03-26T16:58:52.965 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:52.966 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:52.966 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:52.966 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:52.966 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:52.966 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=119 2024-03-26T16:58:52.966 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:52.966 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 120 2024-03-26T16:58:52.966 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:52.966 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:52.966 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:52.966 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:52.966 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:52.966 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=120 2024-03-26T16:58:52.967 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:52.967 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 121 2024-03-26T16:58:52.967 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:52.967 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:52.967 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:52.967 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:52.967 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:52.967 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=121 2024-03-26T16:58:52.967 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:52.967 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 122 2024-03-26T16:58:52.967 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:52.967 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:52.967 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:52.967 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:52.968 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:52.969 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=122 2024-03-26T16:58:52.969 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:52.969 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 123 2024-03-26T16:58:52.969 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:52.969 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:52.969 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:52.969 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:52.970 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:52.970 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=123 2024-03-26T16:58:52.970 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:52.970 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 124 2024-03-26T16:58:52.970 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:52.970 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:52.970 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:52.970 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:52.970 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:52.970 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=124 2024-03-26T16:58:52.970 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:52.970 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 125 2024-03-26T16:58:52.970 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:52.970 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:52.971 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:52.971 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:52.971 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:52.971 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=125 2024-03-26T16:58:52.971 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:52.971 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 126 2024-03-26T16:58:52.971 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:52.971 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:52.971 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:52.971 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:52.971 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:52.971 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=126 2024-03-26T16:58:52.971 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:52.971 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 127 2024-03-26T16:58:52.972 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:52.972 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:52.972 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:52.972 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:52.972 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:52.972 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=127 2024-03-26T16:58:53.206 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:53.207 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 128 2024-03-26T16:58:53.207 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:53.207 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:53.207 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:53.207 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:53.207 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:53.207 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=128 2024-03-26T16:58:53.207 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:53.207 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 129 2024-03-26T16:58:53.207 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:53.207 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:53.207 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:53.207 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:53.208 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:53.208 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=129 2024-03-26T16:58:53.208 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:53.208 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 130 2024-03-26T16:58:53.208 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:53.208 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:53.208 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:53.208 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:53.208 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:53.208 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=130 2024-03-26T16:58:53.208 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:53.209 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 131 2024-03-26T16:58:53.209 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:53.210 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:53.210 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:53.210 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:53.210 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:53.210 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=131 2024-03-26T16:58:53.210 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:53.210 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 132 2024-03-26T16:58:53.211 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:53.211 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:53.211 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:53.211 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:53.211 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:53.211 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=132 2024-03-26T16:58:53.211 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:53.211 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 133 2024-03-26T16:58:53.211 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:52] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:53.211 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:53.211 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:53.211 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:53.211 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:53.212 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=133 2024-03-26T16:58:53.212 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:53.212 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 134 2024-03-26T16:58:53.212 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:53.212 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:53.212 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:53.212 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:53.212 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:53.212 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=134 2024-03-26T16:58:53.212 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:53.212 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 135 2024-03-26T16:58:53.212 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:53.212 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:53.212 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:53.213 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:53.213 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:53.213 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=135 2024-03-26T16:58:53.213 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:53.213 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 136 2024-03-26T16:58:53.213 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:53.213 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:53.213 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:53.213 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:53.213 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:53.213 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=136 2024-03-26T16:58:53.213 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:53.213 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 137 2024-03-26T16:58:53.214 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:53.214 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:53.214 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:53.214 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:53.214 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:53.214 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=137 2024-03-26T16:58:53.214 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:53.214 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 138 2024-03-26T16:58:53.214 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:53.214 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:53.215 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:53.215 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:53.215 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:53.215 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=138 2024-03-26T16:58:53.215 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:53.215 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 139 2024-03-26T16:58:53.215 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:53.215 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:53.215 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:53.215 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:53.215 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:53.215 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=139 2024-03-26T16:58:53.215 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:53.215 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 140 2024-03-26T16:58:53.216 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:53.216 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:53.216 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:53.216 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:53.216 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:53.216 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=140 2024-03-26T16:58:53.216 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:53.216 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 141 2024-03-26T16:58:53.216 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:53.216 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:53.216 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:53.216 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:53.216 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:53.216 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=141 2024-03-26T16:58:53.217 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:53.217 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 142 2024-03-26T16:58:53.217 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:53.217 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:53.217 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:53.217 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:53.217 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:53.217 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=142 2024-03-26T16:58:53.217 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:53.217 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 143 2024-03-26T16:58:53.217 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:53.217 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:53.217 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:53.217 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:53.218 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:53.218 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=143 2024-03-26T16:58:53.218 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:53.218 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 144 2024-03-26T16:58:53.218 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:53.218 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:53.218 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:53.218 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:53.218 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:53.218 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=144 2024-03-26T16:58:53.218 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:53.218 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 145 2024-03-26T16:58:53.218 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:53.219 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:53.219 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:53.219 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:53.219 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:53.219 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=145 2024-03-26T16:58:53.219 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:53.219 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 146 2024-03-26T16:58:53.219 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:53.219 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:53.219 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:53.219 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:53.219 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:53.220 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=146 2024-03-26T16:58:53.220 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:53.220 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 147 2024-03-26T16:58:53.220 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:53.220 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:53.220 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:53.220 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:53.220 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:53.220 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=147 2024-03-26T16:58:53.220 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:53.220 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 148 2024-03-26T16:58:53.221 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:53.221 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:53.221 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:53.221 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:53.221 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:53.221 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=148 2024-03-26T16:58:53.221 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:53.221 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 149 2024-03-26T16:58:53.221 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:53.221 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:53.222 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:53.222 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:53.222 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:53.222 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=149 2024-03-26T16:58:53.222 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:53.222 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 150 2024-03-26T16:58:53.222 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:53.222 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:53.222 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:53.222 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:53.222 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:53.224 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=150 2024-03-26T16:58:53.224 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:53.224 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 151 2024-03-26T16:58:53.224 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:53.224 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:53.224 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:53.224 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:53.224 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:53.224 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=151 2024-03-26T16:58:53.225 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:53.225 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 152 2024-03-26T16:58:53.225 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:53.225 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:53.225 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:53.225 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:53.225 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:53.225 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=152 2024-03-26T16:58:53.225 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:53.225 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 153 2024-03-26T16:58:53.225 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:53.225 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:53.225 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:53.225 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:53.226 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:53.226 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=153 2024-03-26T16:58:53.226 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:53.226 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 154 2024-03-26T16:58:53.226 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:53.226 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:53.226 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:53.226 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:53.226 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:53.226 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=154 2024-03-26T16:58:53.226 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:53.226 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 155 2024-03-26T16:58:53.226 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:53.227 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:53.227 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:53.227 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:53.227 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:53.227 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=155 2024-03-26T16:58:53.227 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:53.227 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 156 2024-03-26T16:58:53.227 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:53.227 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:53.227 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:53.227 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:53.227 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:53.227 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=156 2024-03-26T16:58:53.227 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:53.227 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 157 2024-03-26T16:58:53.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:53.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:53.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:53.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:53.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:53.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=157 2024-03-26T16:58:53.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:53.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 158 2024-03-26T16:58:53.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:53.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:53.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:53.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:53.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:53.228 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=158 2024-03-26T16:58:53.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:53.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 159 2024-03-26T16:58:53.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:53.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:53.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:53.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:53.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:53.229 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=159 2024-03-26T16:58:53.462 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:53.462 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 160 2024-03-26T16:58:53.463 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:53.463 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:53.463 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:53.463 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:53.463 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:53.463 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=160 2024-03-26T16:58:53.463 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:53.463 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 161 2024-03-26T16:58:53.463 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:53.463 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:53.463 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:53.463 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:53.463 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:53.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=161 2024-03-26T16:58:53.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:53.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 162 2024-03-26T16:58:53.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:53.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:53.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:53.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:53.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:53.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=162 2024-03-26T16:58:53.464 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:53.465 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 163 2024-03-26T16:58:53.465 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:53.465 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:53.465 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:53.466 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:53.466 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:53.466 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=163 2024-03-26T16:58:53.466 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:53.466 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 164 2024-03-26T16:58:53.466 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:53.466 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:53.466 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:53.466 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:53.466 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:53.466 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=164 2024-03-26T16:58:53.466 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:53.467 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 165 2024-03-26T16:58:53.467 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:53.467 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:53.467 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:53.467 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:53.467 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:53.467 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=165 2024-03-26T16:58:53.467 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:53.467 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 166 2024-03-26T16:58:53.467 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:53.467 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:53.467 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:53.468 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:53.468 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:53.468 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=166 2024-03-26T16:58:53.468 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:53.468 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 167 2024-03-26T16:58:53.468 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:53.468 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:53.468 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:53.468 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:53.468 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:53.468 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=167 2024-03-26T16:58:53.468 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:53.468 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 168 2024-03-26T16:58:53.468 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:53.469 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:53.469 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:53.469 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:53.469 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:53.469 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=168 2024-03-26T16:58:53.469 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:53.469 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 169 2024-03-26T16:58:53.469 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:53.469 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:53.469 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:53.469 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:53.469 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:53.469 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=169 2024-03-26T16:58:53.469 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:53.469 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 170 2024-03-26T16:58:53.470 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:53.470 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:53.470 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:53.470 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:53.470 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:53.470 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=170 2024-03-26T16:58:53.470 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:53.470 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 171 2024-03-26T16:58:53.470 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:53.470 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:53.470 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:53.470 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:53.470 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:53.470 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=171 2024-03-26T16:58:53.470 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:53.471 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 172 2024-03-26T16:58:53.471 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:53.471 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:53.471 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:53.471 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:53.471 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:53.471 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=172 2024-03-26T16:58:53.471 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:53.471 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 173 2024-03-26T16:58:53.471 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:53.471 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:53.471 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:53.471 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:53.471 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:53.471 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=173 2024-03-26T16:58:53.472 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:53.472 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 174 2024-03-26T16:58:53.472 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:53.472 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:53.472 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:53.472 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:53.472 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:53.472 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=174 2024-03-26T16:58:53.472 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:53.472 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 175 2024-03-26T16:58:53.472 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:53.472 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:53.472 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:53.472 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:53.472 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:53.473 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=175 2024-03-26T16:58:53.473 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:53.473 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 176 2024-03-26T16:58:53.473 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:53.473 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:53.473 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:53.473 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:53.473 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:53.473 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=176 2024-03-26T16:58:53.473 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:53.473 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 177 2024-03-26T16:58:53.473 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:53.473 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:53.473 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:53.473 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:53.474 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:53.474 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=177 2024-03-26T16:58:53.474 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:53.474 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 178 2024-03-26T16:58:53.474 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:53.474 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:53.474 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:53.474 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:53.474 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:53.474 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=178 2024-03-26T16:58:53.474 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:53.474 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 179 2024-03-26T16:58:53.474 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:53.474 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:53.475 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:53.475 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:53.475 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:53.475 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=179 2024-03-26T16:58:53.475 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:53.476 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 180 2024-03-26T16:58:53.476 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:53.476 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:53.476 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:53.476 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:53.476 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:53.476 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=180 2024-03-26T16:58:53.476 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:53.476 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 181 2024-03-26T16:58:53.476 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:53.476 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:53.476 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:53.476 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:53.476 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:53.476 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=181 2024-03-26T16:58:53.477 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:53.477 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 182 2024-03-26T16:58:53.477 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:53.477 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:53.477 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:53.477 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:53.477 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:53.477 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=182 2024-03-26T16:58:53.477 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:53.477 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 183 2024-03-26T16:58:53.477 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:53.477 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:53.477 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:53.477 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:53.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:53.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=183 2024-03-26T16:58:53.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:53.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 184 2024-03-26T16:58:53.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:53.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:53.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:53.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:53.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:53.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=184 2024-03-26T16:58:53.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:53.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 185 2024-03-26T16:58:53.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:53.478 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:53.479 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:53.479 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:53.479 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:53.479 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=185 2024-03-26T16:58:53.479 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:53.479 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 186 2024-03-26T16:58:53.479 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:53.479 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:53.479 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:53.479 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:53.479 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:53.479 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=186 2024-03-26T16:58:53.479 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:53.480 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 187 2024-03-26T16:58:53.480 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:53.480 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:53.480 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:53.480 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:53.480 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:53.480 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=187 2024-03-26T16:58:53.480 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:53.480 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 188 2024-03-26T16:58:53.480 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:53.480 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:53.480 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:53.480 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:53.480 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:53.481 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=188 2024-03-26T16:58:53.481 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:53.481 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 189 2024-03-26T16:58:53.481 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:53.481 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:53.481 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:53.481 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:53.481 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:53.481 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=189 2024-03-26T16:58:53.481 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:53.481 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 190 2024-03-26T16:58:53.481 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:53.481 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:53.481 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:53.482 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:53.482 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:53.482 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=190 2024-03-26T16:58:53.482 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:53.482 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 191 2024-03-26T16:58:53.482 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:53.482 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:53.482 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:53.482 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:53.482 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:53.482 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=191 2024-03-26T16:58:53.718 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:53.719 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 192 2024-03-26T16:58:53.719 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:53.719 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:53.719 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:53.719 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:53.719 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:53.719 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=192 2024-03-26T16:58:53.719 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:53.719 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 193 2024-03-26T16:58:53.719 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:53.719 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:53.719 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:53.720 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:53.720 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:53.720 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=193 2024-03-26T16:58:53.720 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:53.720 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 194 2024-03-26T16:58:53.720 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:53.720 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:53.720 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:53.720 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:53.720 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:53.720 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=194 2024-03-26T16:58:53.720 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:53.721 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 195 2024-03-26T16:58:53.722 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:53.722 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:53.722 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:53.722 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:53.722 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:53.722 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=195 2024-03-26T16:58:53.722 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:53.722 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 196 2024-03-26T16:58:53.722 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:53.722 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:53.722 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:53.722 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:53.723 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:53.723 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=196 2024-03-26T16:58:53.723 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:53.723 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 197 2024-03-26T16:58:53.723 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:53.723 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:53.723 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:53.723 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:53.723 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:53.723 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=197 2024-03-26T16:58:53.723 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:53.723 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 198 2024-03-26T16:58:53.723 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:53.724 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:53.724 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:53.724 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:53.724 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:53.724 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=198 2024-03-26T16:58:53.724 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:53.724 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 199 2024-03-26T16:58:53.724 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:53.724 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:53.724 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:53.724 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:53.724 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:53.724 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=199 2024-03-26T16:58:53.725 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:53.725 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 200 2024-03-26T16:58:53.725 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:53.725 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:53.725 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:53.725 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:53.725 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:53.725 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=200 2024-03-26T16:58:53.725 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:53.725 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 201 2024-03-26T16:58:53.725 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:53.725 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:53.725 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:53.725 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:53.726 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:53.726 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=201 2024-03-26T16:58:53.726 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:53.726 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 202 2024-03-26T16:58:53.726 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:53.726 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:53.726 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:53.726 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:53.726 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:53.726 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=202 2024-03-26T16:58:53.726 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:53.726 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 203 2024-03-26T16:58:53.726 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:53.727 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:53.727 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:53.727 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:53.727 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:53.727 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=203 2024-03-26T16:58:53.727 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:53.727 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 204 2024-03-26T16:58:53.727 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:53.727 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:53.727 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:53.727 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:53.727 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:53.727 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=204 2024-03-26T16:58:53.727 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:53.727 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 205 2024-03-26T16:58:53.727 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:53.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:53.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:53.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:53.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:53.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=205 2024-03-26T16:58:53.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:53.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 206 2024-03-26T16:58:53.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:53.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:53.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:53.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:53.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:53.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=206 2024-03-26T16:58:53.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:53.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 207 2024-03-26T16:58:53.728 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:53.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:53.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:53.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:53.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:53.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=207 2024-03-26T16:58:53.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:53.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 208 2024-03-26T16:58:53.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:53.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:53.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:53.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:53.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:53.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=208 2024-03-26T16:58:53.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:53.729 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 209 2024-03-26T16:58:53.730 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:53.730 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:53.730 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:53.730 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:53.730 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:53.730 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=209 2024-03-26T16:58:53.730 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:53.730 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 210 2024-03-26T16:58:53.730 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:53.730 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:53.730 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:53.730 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:53.730 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:53.731 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=210 2024-03-26T16:58:53.731 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:53.731 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 211 2024-03-26T16:58:53.731 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:53.731 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:53.731 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:53.731 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:53.731 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:53.731 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=211 2024-03-26T16:58:53.731 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:53.731 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 212 2024-03-26T16:58:53.731 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:53.731 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:53.731 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:53.732 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:53.732 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:53.732 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=212 2024-03-26T16:58:53.732 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:53.732 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 213 2024-03-26T16:58:53.732 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:53.732 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:53.732 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:53.732 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:53.732 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:53.732 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=213 2024-03-26T16:58:53.732 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:53.732 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 214 2024-03-26T16:58:53.732 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:53.733 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:53.733 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:53.733 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:53.733 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:53.734 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=214 2024-03-26T16:58:53.734 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:53.734 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 215 2024-03-26T16:58:53.734 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:53.734 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:53.734 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:53.734 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:53.734 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:53.734 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=215 2024-03-26T16:58:53.734 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:53.734 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 216 2024-03-26T16:58:53.734 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:53.735 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:53.735 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:53.735 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:53.735 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:53.735 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=216 2024-03-26T16:58:53.735 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:53.735 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 217 2024-03-26T16:58:53.735 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:53.735 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:53.735 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:53.735 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:53.735 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:53.735 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=217 2024-03-26T16:58:53.735 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:53.736 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 218 2024-03-26T16:58:53.736 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:53.736 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:53.736 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:53.736 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:53.736 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:53.736 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=218 2024-03-26T16:58:53.736 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:53.736 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 219 2024-03-26T16:58:53.736 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:53.736 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:53.736 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:53.736 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:53.736 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:53.737 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=219 2024-03-26T16:58:53.737 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:53.737 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 220 2024-03-26T16:58:53.737 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:53.737 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:53.737 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:53.737 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:53.737 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:53.737 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=220 2024-03-26T16:58:53.737 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:53.737 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 221 2024-03-26T16:58:53.737 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:53.737 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:53.738 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:53.738 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:53.738 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:53.738 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=221 2024-03-26T16:58:53.738 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:53.738 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 222 2024-03-26T16:58:53.738 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:53.738 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:53.738 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:53.738 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:53.738 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:53.738 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=222 2024-03-26T16:58:53.738 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:53.738 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 223 2024-03-26T16:58:53.739 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:53.739 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:53.739 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:53.739 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:53.739 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:53.739 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=223 2024-03-26T16:58:53.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:53 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:53] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:58:53.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:53 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:53] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}] 2024-03-26T16:58:53.974 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:53.975 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 224 2024-03-26T16:58:53.975 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:53.975 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:53.975 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:53.975 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:53.975 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:53.975 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=224 2024-03-26T16:58:53.975 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:53.975 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 225 2024-03-26T16:58:53.975 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:53.975 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:53.975 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:53.975 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:53.975 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:53.975 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=225 2024-03-26T16:58:53.976 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:53.976 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 226 2024-03-26T16:58:53.976 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:53.976 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:53.976 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:53.976 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:53.976 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:53.976 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=226 2024-03-26T16:58:53.976 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:53.977 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 227 2024-03-26T16:58:53.977 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:53.977 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:53.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:53.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:53.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:53.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=227 2024-03-26T16:58:53.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:53.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 228 2024-03-26T16:58:53.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:53.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:53.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:53.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:53.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:53.978 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=228 2024-03-26T16:58:53.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:53.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 229 2024-03-26T16:58:53.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:53.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:53.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:53.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:53.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:53.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=229 2024-03-26T16:58:53.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:53.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 230 2024-03-26T16:58:53.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:53.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:53.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:53.979 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:53.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:53.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=230 2024-03-26T16:58:53.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:53.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 231 2024-03-26T16:58:53.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:53.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:53.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:53.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:53.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:53.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=231 2024-03-26T16:58:53.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:53.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 232 2024-03-26T16:58:53.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:53.980 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:53.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:53.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:53.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:53.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=232 2024-03-26T16:58:53.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:53.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 233 2024-03-26T16:58:53.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:53.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:53.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:53.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:53.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:53.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=233 2024-03-26T16:58:53.981 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:53.982 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 234 2024-03-26T16:58:53.982 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:53.982 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:53.982 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:53.982 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:53.982 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:53.982 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=234 2024-03-26T16:58:53.982 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:53.982 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 235 2024-03-26T16:58:53.982 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:53.982 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:53.982 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:53.982 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:53.982 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:53.982 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=235 2024-03-26T16:58:53.983 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:53.983 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 236 2024-03-26T16:58:53.983 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:53.983 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:53.983 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:53.983 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:53.983 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:53.983 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=236 2024-03-26T16:58:53.983 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:53.983 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 237 2024-03-26T16:58:53.983 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:53.983 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:53.983 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:53.983 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:53.984 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:53.984 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=237 2024-03-26T16:58:53.984 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:53.984 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 238 2024-03-26T16:58:53.984 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:53.984 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:53.984 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:53.984 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:53.984 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:53.984 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=238 2024-03-26T16:58:53.984 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:53.984 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 239 2024-03-26T16:58:53.984 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:53.984 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:53.984 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:53.985 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:53.985 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:53.985 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=239 2024-03-26T16:58:53.985 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:53.985 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 240 2024-03-26T16:58:53.985 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:53.985 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:53.985 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:53.985 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:53.985 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:53.985 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=240 2024-03-26T16:58:53.985 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:53.985 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 241 2024-03-26T16:58:53.985 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:53.986 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:53.986 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:53.986 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:53.986 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:53.986 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=241 2024-03-26T16:58:53.986 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:53.986 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 242 2024-03-26T16:58:53.986 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:53.986 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:53.986 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:53.986 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:53.986 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:53.986 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=242 2024-03-26T16:58:53.986 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:53.987 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 243 2024-03-26T16:58:53.987 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:53.987 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:53.987 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:53.987 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:53.987 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:53.987 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=243 2024-03-26T16:58:53.987 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:53.987 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 244 2024-03-26T16:58:53.987 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:53.987 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:53.987 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:53.987 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:53.988 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:53.988 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=244 2024-03-26T16:58:53.988 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:53.988 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 245 2024-03-26T16:58:53.988 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:53.988 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:53.988 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:53.988 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:53.988 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:53.988 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=245 2024-03-26T16:58:53.988 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:53.988 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 246 2024-03-26T16:58:53.988 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:53.988 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:53.988 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:53.989 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:53.989 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:53.989 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=246 2024-03-26T16:58:53.989 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:53.989 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 247 2024-03-26T16:58:53.989 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:53.990 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:53.990 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:53.990 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:53.990 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:53.990 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=247 2024-03-26T16:58:53.990 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:53.990 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 248 2024-03-26T16:58:53.990 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:53.990 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:53.990 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:53.990 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:53.990 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:53.990 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=248 2024-03-26T16:58:53.990 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:53.991 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 249 2024-03-26T16:58:53.991 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:53.991 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:53.991 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:53.991 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:53.991 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:53.991 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=249 2024-03-26T16:58:53.991 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:53.991 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 250 2024-03-26T16:58:53.991 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:53.991 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:53.991 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:53.991 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:53.991 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:53.992 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=250 2024-03-26T16:58:53.992 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:53.992 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 251 2024-03-26T16:58:53.992 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:53.992 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:53.992 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:53.992 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:53.992 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:53.992 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=251 2024-03-26T16:58:53.992 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:53.992 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 252 2024-03-26T16:58:53.992 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:53.992 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:53.992 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:53.992 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:53.993 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:53.993 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=252 2024-03-26T16:58:53.993 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:53.993 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 253 2024-03-26T16:58:53.993 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:53.993 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:53.993 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:53.993 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:53.993 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:53.993 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=253 2024-03-26T16:58:53.993 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:53.993 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 254 2024-03-26T16:58:53.993 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:53.993 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:53.993 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:53.994 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:53.994 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:53.994 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=254 2024-03-26T16:58:53.994 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:53.994 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 255 2024-03-26T16:58:53.994 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:53.994 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:53.994 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:53.994 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:53.994 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:53.994 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=255 2024-03-26T16:58:53.996 INFO:tasks.workunit.client.3.smithi157.stdout:Adding nqn.2016-06.io.spdk:cnode2 listener at 172.21.15.149:4420: Successful 2024-03-26T16:58:54.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:58:54 smithi044 ceph-mon[30624]: pgmap v367: 33 pgs: 33 active+clean; 609 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 8.0 KiB/s rd, 682 B/s wr, 6 op/s 2024-03-26T16:58:54.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:58:54 smithi044 ceph-mon[30624]: Health check failed: 1 slow ops, oldest one blocked for 33 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T16:58:54.265 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:53 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:53] INFO grpc.py:1992: Received request to create smithi149 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode2 at 172.21.15.149:4420, context: None 2024-03-26T16:58:54.265 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:53 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:53] INFO grpc.py:2031: Listener not created as gateway's host name smithi044 differs from requested host smithi149 2024-03-26T16:58:54.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:58:54 smithi064 ceph-mon[34420]: pgmap v367: 33 pgs: 33 active+clean; 609 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 8.0 KiB/s rd, 682 B/s wr, 6 op/s 2024-03-26T16:58:54.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:58:54 smithi064 ceph-mon[34420]: Health check failed: 1 slow ops, oldest one blocked for 33 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T16:58:54.305 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:53 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:53] INFO grpc.py:1992: Received request to create smithi149 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode2 at 172.21.15.149:4420, context: None 2024-03-26T16:58:54.305 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:53 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:53] INFO grpc.py:2031: Listener not created as gateway's host name smithi064 differs from requested host smithi149 2024-03-26T16:58:54.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:58:54 smithi149 ceph-mon[34678]: pgmap v367: 33 pgs: 33 active+clean; 609 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 8.0 KiB/s rd, 682 B/s wr, 6 op/s 2024-03-26T16:58:54.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:58:54 smithi149 ceph-mon[34678]: Health check failed: 1 slow ops, oldest one blocked for 33 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T16:58:54.396 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:54.396 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2056: using ana_map: set listener on nqn : nqn.2016-06.io.spdk:cnode2 ana state : inaccessible for group : 256 2024-03-26T16:58:54.396 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:58:54.396 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:54.396 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:54.397 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:54.397 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:54.397 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=256 2024-03-26T16:58:54.397 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:54.397 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:53] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:58:54.397 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:54 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:54] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}] 2024-03-26T16:58:54.805 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:54 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:54] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:58:54.805 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:54 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:54] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}] 2024-03-26T16:58:54.871 INFO:tasks.workunit.client.3.smithi157.stderr:+ for j in $(seq 1 $NVMEOF_SUBSYSTEMS_COUNT) 2024-03-26T16:58:54.871 INFO:tasks.workunit.client.3.smithi157.stderr:+ subsystem_nqn=nqn.2016-06.io.spdk:cnode3 2024-03-26T16:58:54.872 INFO:tasks.workunit.client.3.smithi157.stdout:Adding gateway listener with IP 172.21.15.149 and name smithi149 2024-03-26T16:58:54.872 INFO:tasks.workunit.client.3.smithi157.stderr:+ echo 'Adding gateway listener with IP 172.21.15.149 and name smithi149' 2024-03-26T16:58:54.872 INFO:tasks.workunit.client.3.smithi157.stderr:+ sudo podman run -it quay.io/barakda1/nvmeof-cli:qe_ceph_devel_21e59b2 --server-address 172.21.15.149 --server-port 5500 listener add --subsystem nqn.2016-06.io.spdk:cnode3 --host-name smithi149 --traddr 172.21.15.149 --trsvcid 4420 2024-03-26T16:58:54.955 INFO:tasks.workunit.client.3.smithi157.stderr:time="2024-03-26T16:58:54Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2024-03-26T16:58:55.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:58:55 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-b[34416]: 2024-03-26T16:58:55.276+0000 7ff022916700 -1 mon.b@2(peon) e3 get_health_metrics reporting 1 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T16:58:55.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:55 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:55] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:58:55.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:55 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:55] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}] 2024-03-26T16:58:55.890 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:55] INFO grpc.py:1992: Received request to create smithi149 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode3 at 172.21.15.149:4420, context: 2024-03-26T16:58:55.891 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:55] INFO grpc.py:2023: create_listener: True 2024-03-26T16:58:55.891 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:55] INFO grpc.py:1958: Subsystem nqn.2016-06.io.spdk:cnode3 enable_ha: True 2024-03-26T16:58:55.891 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:55] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:55.891 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:55.891 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:55.891 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:55.891 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:55.891 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=1 2024-03-26T16:58:55.891 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:55] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:55.891 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:55] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:55.891 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:55.891 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:55.892 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:55.892 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:55.892 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=2 2024-03-26T16:58:55.892 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:55] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:55.892 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:55] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:55.892 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:55.892 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:55.892 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:55.892 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:55.892 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=3 2024-03-26T16:58:55.892 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:55] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:55.892 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:55] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:55.892 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:55.893 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:55.893 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:55.893 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:55.894 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=4 2024-03-26T16:58:55.894 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:55] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:55.894 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:55] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:55.894 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:55.894 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:55.894 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:55.894 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:55.894 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=5 2024-03-26T16:58:55.894 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:55] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:55.894 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:55] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:55.894 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:55.894 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:55.894 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:55.895 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:55.895 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=6 2024-03-26T16:58:55.895 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:55] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:55.895 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:55] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:55.895 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:55.895 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:55.895 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:55.895 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:55.895 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=7 2024-03-26T16:58:55.895 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:55] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:55.895 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:55] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:55.895 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:55.895 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:55.895 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:55.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:55.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=8 2024-03-26T16:58:55.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:55] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:55.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:55] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:55.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:55.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:55.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:55.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:55.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=9 2024-03-26T16:58:55.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:55] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:55.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:55] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:55.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:55.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:55.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:55.897 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:55.897 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=10 2024-03-26T16:58:55.897 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:55] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:55.897 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:55] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:55.897 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:55.897 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:55.897 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:55.897 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:55.897 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=11 2024-03-26T16:58:55.897 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:55] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:55.897 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:55] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:55.897 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:55.897 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:55.897 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:55.898 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:55.898 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=12 2024-03-26T16:58:55.898 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:55] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:55.898 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:55] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:55.898 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:55.898 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:55.898 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:55.898 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:55.898 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=13 2024-03-26T16:58:55.898 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:55] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:55.898 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:55] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:55.898 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:55.898 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:55.899 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:55.899 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:55.899 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=14 2024-03-26T16:58:55.899 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:55] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:55.899 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:55] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:55.899 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:55.899 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:55.899 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:55.899 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:55.899 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=15 2024-03-26T16:58:55.899 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:55] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:55.899 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:55] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:55.899 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:55.899 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:55.900 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:55.900 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:55.900 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=16 2024-03-26T16:58:55.900 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:55] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:55.900 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:55] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:55.900 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:55.900 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:55.900 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:55.900 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:55.900 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=17 2024-03-26T16:58:55.900 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:55] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:55.900 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:55] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:55.900 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:55.900 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:55.900 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:55.901 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:55.901 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=18 2024-03-26T16:58:55.901 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:55] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:55.901 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:55] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:55.901 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:55.901 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:55.901 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:55.901 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:55.901 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=19 2024-03-26T16:58:55.901 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:55] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:55.901 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:55] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:55.901 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:55.901 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:55.901 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:55.901 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:55.902 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=20 2024-03-26T16:58:55.902 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:55] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:55.902 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:55] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:55.902 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:55.902 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:55.902 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:55.902 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:55.903 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=21 2024-03-26T16:58:55.903 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:55] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:55.903 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:55] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:55.903 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:55.903 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:55.903 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:55.903 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:55.903 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=22 2024-03-26T16:58:55.903 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:55] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:55.904 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:55] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:55.904 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:55.904 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:55.904 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:55.904 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:55.904 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=23 2024-03-26T16:58:55.904 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:55] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:55.904 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:55] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:55.904 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:55.904 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:55.904 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:55.904 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:55.905 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=24 2024-03-26T16:58:55.905 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:55] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:55.905 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:55] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:55.905 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:55.905 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:55.905 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:55.905 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:55.905 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=25 2024-03-26T16:58:55.905 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:55] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:55.906 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:55] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:55.906 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:55.906 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:55.906 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:55.906 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:55.906 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=26 2024-03-26T16:58:55.906 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:55] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:55.906 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:55] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:55.906 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:55.906 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:55.906 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:55.906 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:55.906 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=27 2024-03-26T16:58:55.906 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:55] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:55.907 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:55] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:55.907 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:55.907 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:55.907 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:55.907 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:55.907 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=28 2024-03-26T16:58:55.907 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:55] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:55.907 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:55] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:55.907 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:55.907 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:55.907 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:55.907 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:55.907 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=29 2024-03-26T16:58:55.907 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:55] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:55.908 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:55] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:55.908 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:55.908 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:55.908 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:55.908 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:55.908 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=30 2024-03-26T16:58:55.908 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:55] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:55.908 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:55] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:55.908 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:55.908 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:55.908 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:55.908 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:55.908 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=31 2024-03-26T16:58:55.908 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:55] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:55.909 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:55] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:55.909 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:55.909 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:55.909 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:55.909 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:55.909 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=32 2024-03-26T16:58:56.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:55] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:56.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:55] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:56.147 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:56.147 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:56.147 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:56.147 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:56.147 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=33 2024-03-26T16:58:56.147 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:55] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:56.147 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:55] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:56.147 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:56.147 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:56.147 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:56.147 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:56.147 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=34 2024-03-26T16:58:56.147 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:55] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:56.147 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:55] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:56.147 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:56.148 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:56.148 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:56.148 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:56.148 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=35 2024-03-26T16:58:56.148 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:55] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:56.148 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:55] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:56.148 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:56.148 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:56.148 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:56.148 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:56.148 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=36 2024-03-26T16:58:56.149 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:55] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:56.149 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:55] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:56.149 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:56.149 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:56.149 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:56.149 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:56.150 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=37 2024-03-26T16:58:56.150 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:55] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:56.150 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:55] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:56.150 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:56.150 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:56.150 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:56.150 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:56.150 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=38 2024-03-26T16:58:56.150 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:55] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:56.150 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:55] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:56.150 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:56.150 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:56.150 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:56.151 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:56.151 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=39 2024-03-26T16:58:56.151 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:55] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:56.151 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:55] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:56.151 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:56.151 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:56.151 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:56.151 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:56.151 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=40 2024-03-26T16:58:56.151 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:55] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:56.151 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:55] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:56.151 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:56.151 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:56.151 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:56.151 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:56.152 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=41 2024-03-26T16:58:56.152 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:55] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:56.152 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:55] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:56.152 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:56.152 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:56.152 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:56.152 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:56.152 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=42 2024-03-26T16:58:56.152 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:55] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:56.152 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:55] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:56.152 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:56.152 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:56.152 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:56.152 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:56.152 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=43 2024-03-26T16:58:56.153 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:55] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:56.153 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:55] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:56.153 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:56.153 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:56.153 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:56.153 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:56.153 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=44 2024-03-26T16:58:56.153 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:55] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:56.153 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:55] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:56.153 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:56.153 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:56.153 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:56.153 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:56.154 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=45 2024-03-26T16:58:56.154 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:56.154 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:56.154 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:56.154 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:56.154 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:56.154 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:56.154 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=46 2024-03-26T16:58:56.154 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:56.154 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:56.154 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:56.154 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:56.154 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:56.154 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:56.155 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=47 2024-03-26T16:58:56.155 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:56.155 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:56.155 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:56.155 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:56.155 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:56.155 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:56.155 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=48 2024-03-26T16:58:56.155 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:56.155 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:56.155 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:56.155 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:56.155 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:56.155 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:56.156 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=49 2024-03-26T16:58:56.156 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:56.156 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:56.156 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:56.156 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:56.156 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:56.156 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:56.156 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=50 2024-03-26T16:58:56.156 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:56.156 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:56.156 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:56.156 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:56.156 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:56.156 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:56.156 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=51 2024-03-26T16:58:56.156 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:56.157 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:56.157 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:56.157 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:56.157 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:56.157 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:56.157 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=52 2024-03-26T16:58:56.157 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:56.157 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:56.157 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:56.157 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:56.157 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:56.157 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:56.157 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=53 2024-03-26T16:58:56.157 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:56.157 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:56.158 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:56.158 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:56.158 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:56.158 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:56.158 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=54 2024-03-26T16:58:56.158 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:56.158 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:56.158 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:56.158 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:56.158 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:56.158 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:56.158 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=55 2024-03-26T16:58:56.158 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:56.158 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:56.158 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:56.159 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:56.159 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:56.159 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:56.159 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=56 2024-03-26T16:58:56.159 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:56.159 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:56.159 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:56.159 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:56.160 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:56.160 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:56.160 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=57 2024-03-26T16:58:56.160 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:56.160 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:56.160 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:56.160 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:56.160 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:56.160 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:56.160 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=58 2024-03-26T16:58:56.160 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:56.160 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:56.160 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:56.160 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:56.161 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:56.161 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:56.161 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=59 2024-03-26T16:58:56.161 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:56.161 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:56.161 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:56.161 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:56.161 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:56.161 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:56.161 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=60 2024-03-26T16:58:56.161 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:56.161 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:56.161 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:56.161 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:56.161 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:56.162 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:56.162 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=61 2024-03-26T16:58:56.162 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:56.162 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:56.162 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:56.162 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:56.162 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:56.162 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:56.162 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=62 2024-03-26T16:58:56.162 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:56.162 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:56.162 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:56.162 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:56.163 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:56.163 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:56.163 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=63 2024-03-26T16:58:56.163 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:56.163 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:56.163 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:56.163 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:56.163 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:56.163 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:56.163 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=64 2024-03-26T16:58:56.402 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-mon[34678]: pgmap v368: 33 pgs: 33 active+clean; 609 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 6.2 KiB/s rd, 511 B/s wr, 4 op/s 2024-03-26T16:58:56.402 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 2024-03-26T16:58:56.200+0000 7fa707a55700 -1 mon.c@1(peon) e3 get_health_metrics reporting 1 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T16:58:56.402 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:56.403 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:56.403 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:56.403 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:56.403 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:56.403 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:56.403 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=65 2024-03-26T16:58:56.403 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:56.403 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:56.403 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:56.403 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:56.403 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:56.403 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:56.404 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=66 2024-03-26T16:58:56.404 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:56.404 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:56.404 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:56.404 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:56.404 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:56.404 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:56.404 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=67 2024-03-26T16:58:56.404 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:56.404 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:56.404 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:56.404 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:56.404 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:56.405 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:56.405 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=68 2024-03-26T16:58:56.406 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:56.406 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:56.406 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:56.406 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:56.406 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:56.406 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:56.406 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=69 2024-03-26T16:58:56.406 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:56.406 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:56.406 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:56.407 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:56.407 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:56.407 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:56.407 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=70 2024-03-26T16:58:56.407 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:56.407 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:56.407 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:56.407 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:56.407 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:56.407 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:56.407 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=71 2024-03-26T16:58:56.407 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:56.407 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:56.407 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:56.408 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:56.408 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:56.408 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:56.408 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=72 2024-03-26T16:58:56.408 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:56.408 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:56.408 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:56.408 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:56.408 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:56.408 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:56.408 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=73 2024-03-26T16:58:56.408 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:56.408 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:56.408 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:56.409 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:56.409 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:56.409 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:56.409 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=74 2024-03-26T16:58:56.409 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:56.409 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:56.409 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:56.409 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:56.409 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:56.409 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:56.409 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=75 2024-03-26T16:58:56.409 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:56.409 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:56.410 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:56.410 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:56.410 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:56.410 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:56.410 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=76 2024-03-26T16:58:56.410 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:56.410 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:56.410 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:56.410 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:56.410 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:56.410 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:56.410 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=77 2024-03-26T16:58:56.410 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:56.411 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:56.411 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:56.411 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:56.411 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:56.411 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:56.411 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=78 2024-03-26T16:58:56.411 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:56.411 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:56.411 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:56.411 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:56.411 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:56.411 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:56.411 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=79 2024-03-26T16:58:56.411 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:56.412 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:56.412 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:56.412 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:56.412 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:56.412 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:56.412 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=80 2024-03-26T16:58:56.412 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:56.412 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:56.412 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:56.412 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:56.412 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:56.412 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:56.412 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=81 2024-03-26T16:58:56.413 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:56.413 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:56.413 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:56.413 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:56.413 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:56.413 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:56.413 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=82 2024-03-26T16:58:56.413 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:56.413 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:56.413 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:56.413 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:56.413 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:56.413 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:56.414 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=83 2024-03-26T16:58:56.414 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:56.414 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:56.414 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:56.414 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:56.414 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:56.414 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:56.414 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=84 2024-03-26T16:58:56.414 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:56.414 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:56.414 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:56.414 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:56.414 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:56.415 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:56.415 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=85 2024-03-26T16:58:56.415 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:56.415 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:56.415 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:56.415 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:56.415 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:56.415 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:56.415 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=86 2024-03-26T16:58:56.415 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:56.415 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:56.415 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:56.415 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:56.415 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:56.416 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:56.416 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=87 2024-03-26T16:58:56.416 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:56.416 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:56.416 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:56.416 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:56.416 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:56.416 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:56.416 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=88 2024-03-26T16:58:56.416 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:56.416 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:56.416 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:56.416 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:56.416 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:56.416 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:56.417 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=89 2024-03-26T16:58:56.417 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:56.417 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:56.417 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:56.417 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:56.417 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:56.417 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:56.417 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=90 2024-03-26T16:58:56.417 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:56.417 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:56.417 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:56.417 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:56.417 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:56.417 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:56.417 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=91 2024-03-26T16:58:56.417 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:56.418 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:56.418 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:56.418 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:56.418 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:56.418 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:56.418 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=92 2024-03-26T16:58:56.418 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:56.418 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:56.418 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:56.418 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:56.419 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:56.419 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:56.419 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=93 2024-03-26T16:58:56.419 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:56.419 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:56.419 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:56.419 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:56.419 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:56.419 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:56.419 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=94 2024-03-26T16:58:56.419 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:56.419 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:56.419 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:56.419 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:56.419 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:56.419 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:56.420 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=95 2024-03-26T16:58:56.420 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:56.420 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:56.420 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:56.420 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:56.420 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:56.420 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:56.420 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=96 2024-03-26T16:58:56.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:58:56 smithi044 ceph-mon[30624]: pgmap v368: 33 pgs: 33 active+clean; 609 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 6.2 KiB/s rd, 511 B/s wr, 4 op/s 2024-03-26T16:58:56.523 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:58:56 smithi064 ceph-mon[34420]: pgmap v368: 33 pgs: 33 active+clean; 609 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 6.2 KiB/s rd, 511 B/s wr, 4 op/s 2024-03-26T16:58:56.658 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:56.659 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:56.659 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:56.659 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:56.659 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:56.659 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:56.659 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=97 2024-03-26T16:58:56.661 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:56.661 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:56.661 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:56.661 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:56.661 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:56.662 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:56.662 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=98 2024-03-26T16:58:56.662 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:56.662 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:56.662 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:56.662 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:56.662 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:56.662 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:56.662 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=99 2024-03-26T16:58:56.662 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:56.662 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:56.662 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:56.662 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:56.663 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:56.663 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:56.663 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=100 2024-03-26T16:58:56.664 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:56.664 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:56.664 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:56.664 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:56.664 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:56.664 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:56.664 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=101 2024-03-26T16:58:56.664 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:56.665 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:56.665 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:56.665 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:56.665 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:56.665 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:56.665 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=102 2024-03-26T16:58:56.665 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:56.665 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:56.665 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:56.665 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:56.665 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:56.665 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:56.665 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=103 2024-03-26T16:58:56.666 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:56.666 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:56.666 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:56.666 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:56.666 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:56.666 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:56.666 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=104 2024-03-26T16:58:56.666 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:56.666 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:56.666 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:56.666 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:56.666 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:56.666 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:56.666 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=105 2024-03-26T16:58:56.666 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:56.667 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:56.667 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:56.667 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:56.667 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:56.667 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:56.667 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=106 2024-03-26T16:58:56.667 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:56.667 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:56.667 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:56.667 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:56.667 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:56.667 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:56.667 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=107 2024-03-26T16:58:56.667 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:56.668 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:56.668 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:56.668 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:56.668 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:56.668 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:56.668 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=108 2024-03-26T16:58:56.668 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:56.668 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:56.668 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:56.668 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:56.668 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:56.668 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:56.668 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=109 2024-03-26T16:58:56.668 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:56.668 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:56.669 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:56.669 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:56.669 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:56.669 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:56.669 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=110 2024-03-26T16:58:56.669 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:56.669 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:56.669 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:56.669 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:56.669 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:56.669 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:56.669 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=111 2024-03-26T16:58:56.669 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:56.669 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:56.669 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:56.670 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:56.670 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:56.670 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:56.670 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=112 2024-03-26T16:58:56.670 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:56.670 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:56.670 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:56.670 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:56.670 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:56.670 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:56.670 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=113 2024-03-26T16:58:56.670 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:56.670 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:56.671 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:56.671 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:56.671 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:56.671 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:56.671 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=114 2024-03-26T16:58:56.671 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:56.671 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:56.671 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:56.671 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:56.671 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:56.671 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:56.671 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=115 2024-03-26T16:58:56.671 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:56.671 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:56.672 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:56.672 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:56.672 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:56.672 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:56.672 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=116 2024-03-26T16:58:56.672 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:56.672 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:56.672 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:56.672 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:56.672 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:56.672 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:56.672 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=117 2024-03-26T16:58:56.672 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:56.673 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:56.673 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:56.673 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:56.673 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:56.673 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:56.673 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=118 2024-03-26T16:58:56.673 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:56.673 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:56.673 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:56.673 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:56.673 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:56.673 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:56.673 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=119 2024-03-26T16:58:56.673 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:56.674 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:56.674 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:56.674 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:56.674 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:56.674 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:56.674 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=120 2024-03-26T16:58:56.674 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:56.674 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:56.674 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:56.674 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:56.674 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:56.674 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:56.674 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=121 2024-03-26T16:58:56.674 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:56.675 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:56.675 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:56.675 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:56.675 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:56.675 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:56.675 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=122 2024-03-26T16:58:56.675 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:56.675 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:56.675 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:56.675 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:56.675 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:56.675 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:56.675 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=123 2024-03-26T16:58:56.675 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:56.675 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:56.676 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:56.676 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:56.676 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:56.676 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:56.676 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=124 2024-03-26T16:58:56.676 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:56.676 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:56.676 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:56.676 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:56.676 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:56.676 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:56.676 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=125 2024-03-26T16:58:56.676 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:56.676 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:56.676 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:56.677 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:56.677 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:56.677 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:56.677 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=126 2024-03-26T16:58:56.677 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:56.677 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:56.677 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:56.677 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:56.677 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:56.677 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:56.677 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=127 2024-03-26T16:58:56.677 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:56.677 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:56.677 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:56.678 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:56.678 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:56.678 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:56.678 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=128 2024-03-26T16:58:56.805 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:56 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:56] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:58:56.806 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:56 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:56] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}] 2024-03-26T16:58:56.915 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:56.915 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:56.915 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:56.915 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:56.915 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:56.915 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:56.915 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=129 2024-03-26T16:58:56.915 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:56.915 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:56.915 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:56.915 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:56.915 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:56.916 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:56.916 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=130 2024-03-26T16:58:56.916 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:56.916 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:56.916 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:56.916 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:56.916 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:56.916 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:56.916 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=131 2024-03-26T16:58:56.916 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:56.916 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:56.916 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:56.916 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:56.917 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:56.917 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:56.917 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=132 2024-03-26T16:58:56.919 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:56.919 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:56.919 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:56.919 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:56.919 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:56.919 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:56.919 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=133 2024-03-26T16:58:56.919 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:56.919 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:56.919 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:56.919 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:56.919 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:56.920 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:56.920 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=134 2024-03-26T16:58:56.920 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:56.920 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:56.920 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:56.920 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:56.920 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:56.920 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:56.920 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=135 2024-03-26T16:58:56.920 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:56.920 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:56.920 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:56.920 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:56.920 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:56.921 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:56.921 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=136 2024-03-26T16:58:56.921 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:56.921 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:56.921 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:56.921 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:56.921 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:56.921 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:56.921 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=137 2024-03-26T16:58:56.921 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:56.921 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:56.921 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:56.921 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:56.921 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:56.922 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:56.922 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=138 2024-03-26T16:58:56.922 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:56.922 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:56.922 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:56.922 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:56.922 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:56.922 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:56.922 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=139 2024-03-26T16:58:56.922 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:56.922 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:56.922 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:56.922 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:56.922 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:56.923 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:56.923 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=140 2024-03-26T16:58:56.923 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:56.923 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:56.923 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:56.923 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:56.923 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:56.923 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:56.923 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=141 2024-03-26T16:58:56.923 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:56.923 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:56.923 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:56.923 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:56.923 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:56.923 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:56.924 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=142 2024-03-26T16:58:56.924 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:56.924 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:56.924 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:56.924 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:56.924 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:56.924 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:56.924 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=143 2024-03-26T16:58:56.924 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:56.924 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:56.924 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:56.924 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:56.924 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:56.924 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:56.925 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=144 2024-03-26T16:58:56.925 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:56.925 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:56.925 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:56.925 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:56.925 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:56.925 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:56.925 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=145 2024-03-26T16:58:56.925 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:56.925 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:56.925 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:56.925 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:56.926 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:56.926 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:56.926 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=146 2024-03-26T16:58:56.926 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:56.926 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:56.927 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:56.927 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:56.927 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:56.927 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:56.927 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=147 2024-03-26T16:58:56.927 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:56.927 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:56.927 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:56.927 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:56.927 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:56.927 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:56.927 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=148 2024-03-26T16:58:56.928 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:56.928 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:56.928 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:56.928 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:56.928 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:56.928 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:56.928 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=149 2024-03-26T16:58:56.928 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:56.928 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:56.928 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:56.928 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:56.928 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:56.928 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:56.929 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=150 2024-03-26T16:58:56.929 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:56.929 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:56.929 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:56.929 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:56.929 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:56.929 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:56.929 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=151 2024-03-26T16:58:56.929 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:56.929 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:56.929 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:56.929 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:56.929 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:56.929 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:56.930 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=152 2024-03-26T16:58:56.930 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:56.930 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:56.930 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:56.930 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:56.930 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:56.930 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:56.930 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=153 2024-03-26T16:58:56.930 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:56.930 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:56.930 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:56.930 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:56.930 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:56.931 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:56.931 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=154 2024-03-26T16:58:56.931 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:56.931 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:56.931 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:56.931 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:56.931 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:56.931 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:56.931 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=155 2024-03-26T16:58:56.931 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:56.931 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:56.931 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:56.931 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:56.931 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:56.932 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:56.932 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=156 2024-03-26T16:58:56.932 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:56.932 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:56.932 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:56.932 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:56.932 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:56.932 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:56.932 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=157 2024-03-26T16:58:56.932 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:56.932 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:56.932 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:56.932 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:56.932 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:56.932 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:56.933 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=158 2024-03-26T16:58:56.933 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:56.933 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:56.933 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:56.933 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:56.933 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:56.933 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:56.933 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=159 2024-03-26T16:58:56.933 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:56.933 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:56.933 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:56.933 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:56.933 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:56.933 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:56.933 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=160 2024-03-26T16:58:57.171 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:57.171 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:57.171 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:57.171 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:57.171 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:57.171 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:57.171 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=161 2024-03-26T16:58:57.171 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:57.171 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:57.171 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:57.172 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:57.172 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:57.172 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:57.172 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=162 2024-03-26T16:58:57.172 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:57.172 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:57.172 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:57.172 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:57.172 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:57.172 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:57.172 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=163 2024-03-26T16:58:57.172 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:57.172 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:57.172 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:57.173 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:57.173 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:57.173 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:57.173 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=164 2024-03-26T16:58:57.174 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:57.174 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:57.174 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:57.174 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:57.174 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:57.174 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:57.174 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=165 2024-03-26T16:58:57.174 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:57.174 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:57.175 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:57.175 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:57.175 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:57.175 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:57.175 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=166 2024-03-26T16:58:57.175 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:57.175 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:57.175 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:57.175 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:57.175 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:57.175 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:57.175 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=167 2024-03-26T16:58:57.175 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:57.175 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:57.176 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:57.176 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:57.176 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:57.176 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:57.176 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=168 2024-03-26T16:58:57.176 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:57.176 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:57.176 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:57.176 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:57.176 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:57.176 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:57.176 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=169 2024-03-26T16:58:57.176 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:57.176 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:56] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:57.176 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:57.177 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:57.177 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:57.177 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:57.177 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=170 2024-03-26T16:58:57.177 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:57] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:57.177 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:57] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:57.177 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:57.177 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:57.177 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:57.177 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:57.177 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=171 2024-03-26T16:58:57.177 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:57] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:57.177 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:57] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:57.177 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:57.178 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:57.178 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:57.178 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:57.178 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=172 2024-03-26T16:58:57.178 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:57] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:57.178 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:57] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:57.178 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:57.178 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:57.178 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:57.178 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:57.178 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=173 2024-03-26T16:58:57.178 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:57] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:57.178 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:57] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:57.178 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:57.178 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:57.179 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:57.179 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:57.179 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=174 2024-03-26T16:58:57.179 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:57] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:57.179 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:57] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:57.179 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:57.179 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:57.179 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:57.179 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:57.179 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=175 2024-03-26T16:58:57.179 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:57] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:57.179 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:57] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:57.179 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:57.179 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:57.180 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:57.180 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:57.180 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=176 2024-03-26T16:58:57.180 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:57] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:57.180 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:57] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:57.180 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:57.180 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:57.180 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:57.180 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:57.180 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=177 2024-03-26T16:58:57.180 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:57] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:57.180 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:57] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:57.180 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:57.180 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:57.181 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:57.181 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:57.181 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=178 2024-03-26T16:58:57.181 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:57] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:57.181 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:57] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:57.181 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:57.181 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:57.181 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:57.181 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:57.181 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=179 2024-03-26T16:58:57.181 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:57] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:57.181 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:57] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:57.181 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:57.181 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:57.181 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:57.182 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:57.182 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=180 2024-03-26T16:58:57.182 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:57] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:57.182 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:57] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:57.182 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:57.182 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:57.182 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:57.182 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:57.182 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=181 2024-03-26T16:58:57.182 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:57] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:57.182 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:57] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:57.182 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:57.182 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:57.182 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:57.183 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:57.183 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=182 2024-03-26T16:58:57.183 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:57] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:57.183 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:57] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:57.183 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:57.183 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:57.183 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:57.183 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:57.183 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=183 2024-03-26T16:58:57.183 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:57] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:57.183 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:57] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:57.183 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:57.183 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:57.183 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:57.184 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:57.184 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=184 2024-03-26T16:58:57.184 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:57] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:57.184 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:57] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:57.184 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:57.184 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:57.184 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:57.184 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:57.184 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=185 2024-03-26T16:58:57.184 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:57] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:57.184 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:57] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:57.184 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:57.184 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:57.184 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:57.185 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:57.185 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=186 2024-03-26T16:58:57.185 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:57] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:57.185 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:57] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:57.185 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:57.185 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:57.185 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:57.185 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:57.185 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=187 2024-03-26T16:58:57.185 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:57] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:57.185 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:57] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:57.185 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:57.185 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:57.185 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:57.186 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:57.186 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=188 2024-03-26T16:58:57.186 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:57] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:57.186 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:57] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:57.186 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:57.186 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:57.186 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:57.186 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:57.186 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=189 2024-03-26T16:58:57.187 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:57] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:57.187 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:57] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:57.187 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:57.187 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:57.187 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:57.187 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:57.187 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=190 2024-03-26T16:58:57.187 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:57] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:57.187 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:57] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:57.187 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:57.187 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:57.187 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:57.187 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:57.187 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=191 2024-03-26T16:58:57.187 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:57] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:57.188 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:57] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:57.188 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:57.188 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:57.188 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:57.188 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:57.188 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=192 2024-03-26T16:58:57.426 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:57] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:57.427 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:57] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:57.427 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:57.427 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:57.427 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:57.427 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:57.427 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=193 2024-03-26T16:58:57.427 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:57] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:57.427 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:57] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:57.427 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:57.427 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:57.427 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:57.427 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:57.427 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=194 2024-03-26T16:58:57.428 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:57] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:57.428 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:57] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:57.428 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:57.428 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:57.428 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:57.428 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:57.428 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=195 2024-03-26T16:58:57.428 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:57] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:57.428 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:57] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:57.428 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:57.428 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:57.428 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:57.428 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:57.428 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=196 2024-03-26T16:58:57.429 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:57] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:57.429 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:57] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:57.429 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:57.429 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:57.429 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:57.430 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:57.430 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=197 2024-03-26T16:58:57.430 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:57] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:57.430 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:57] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:57.430 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:57.430 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:57.430 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:57.430 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:57.430 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=198 2024-03-26T16:58:57.430 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:57] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:57.430 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:57] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:57.430 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:57.430 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:57.430 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:57.430 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:57.431 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=199 2024-03-26T16:58:57.431 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:57] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:57.431 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:57] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:57.431 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:57.431 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:57.431 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:57.431 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:57.431 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=200 2024-03-26T16:58:57.431 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:57] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:57.431 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:57] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:57.431 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:57.431 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:57.432 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:57.432 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:57.432 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=201 2024-03-26T16:58:57.432 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:57] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:57.432 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:57] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:57.433 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:57.433 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:57.433 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:57.433 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:57.434 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=202 2024-03-26T16:58:57.434 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:57] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:57.434 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:57] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:57.434 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:57.434 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:57.434 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:57.434 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:57.434 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=203 2024-03-26T16:58:57.434 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:57] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:57.434 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:57] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:57.434 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:57.434 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:57.434 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:57.435 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:57.435 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=204 2024-03-26T16:58:57.435 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:57] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:57.435 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:57] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:57.435 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:57.435 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:57.435 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:57.435 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:57.435 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=205 2024-03-26T16:58:57.435 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:57] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:57.435 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:57] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:57.435 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:57.435 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:57.435 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:57.436 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:57.436 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=206 2024-03-26T16:58:57.436 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:57] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:57.436 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:57] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:57.436 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:57.436 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:57.436 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:57.436 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:57.436 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=207 2024-03-26T16:58:57.436 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:57] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:57.436 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:57] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:57.436 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:57.436 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:57.436 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:57.436 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:57.437 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=208 2024-03-26T16:58:57.437 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:57] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:57.437 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:57] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:57.437 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:57.437 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:57.437 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:57.437 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:57.437 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=209 2024-03-26T16:58:57.437 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:57] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:57.437 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:57] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:57.437 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:57.437 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:57.437 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:57.437 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:57.437 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=210 2024-03-26T16:58:57.438 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:57] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:57.438 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:57] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:57.438 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:57.438 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:57.438 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:57.438 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:57.438 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=211 2024-03-26T16:58:57.438 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:57] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:57.438 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:57] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:57.438 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:57.438 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:57.438 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:57.438 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:57.438 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=212 2024-03-26T16:58:57.438 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:57] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:57.439 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:57] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:57.439 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:57.439 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:57.439 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:57.439 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:57.439 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=213 2024-03-26T16:58:57.439 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:57] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:57.439 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:57] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:57.439 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:57.439 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:57.439 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:57.439 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:57.439 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=214 2024-03-26T16:58:57.440 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:57] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:57.440 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:57] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:57.440 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:57.440 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:57.440 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:57.440 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:57.440 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=215 2024-03-26T16:58:57.440 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:57] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:57.440 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:57] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:57.440 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:57.440 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:57.440 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:57.440 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:57.440 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=216 2024-03-26T16:58:57.440 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:57] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:57.441 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:57] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:57.441 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:57.441 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:57.441 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:57.441 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:57.441 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=217 2024-03-26T16:58:57.441 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:57] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:57.441 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:57] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:57.442 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:57.442 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:57.442 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:57.442 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:57.442 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=218 2024-03-26T16:58:57.442 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:57] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:57.442 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:57] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:57.442 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:57.442 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:57.442 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:57.442 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:57.442 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=219 2024-03-26T16:58:57.442 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:57] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:57.442 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:57] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:57.443 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:57.443 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:57.443 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:57.443 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:57.443 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=220 2024-03-26T16:58:57.443 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:57] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:57.443 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:57] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:57.443 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:57.443 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:57.443 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:57.443 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:57.443 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=221 2024-03-26T16:58:57.443 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:57] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:57.443 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:57] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:57.444 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:57.444 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:57.444 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:57.444 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:57.444 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=222 2024-03-26T16:58:57.444 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:57] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:57.444 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:57] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:57.444 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:57.444 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:57.444 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:57.444 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:57.444 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=223 2024-03-26T16:58:57.444 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:57] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:57.444 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:57] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:57.444 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:57.445 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:57.445 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:57.445 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:57.445 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=224 2024-03-26T16:58:57.683 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:57] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:57.683 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:57] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:57.683 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:57.684 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:57.684 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:57.684 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:57.684 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=225 2024-03-26T16:58:57.684 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:57] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:57.685 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:57] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:57.685 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:57.685 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:57.685 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:57.685 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:57.685 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=226 2024-03-26T16:58:57.686 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:57] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:57.686 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:57] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:57.686 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:57.686 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:57.686 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:57.686 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:57.687 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=227 2024-03-26T16:58:57.687 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:57] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:57.687 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:57] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:57.687 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:57.687 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:57.687 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:57.687 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:57.688 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=228 2024-03-26T16:58:57.688 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:57] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:57.688 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:57] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:57.688 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:57.688 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:57.688 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:57.688 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:57.689 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=229 2024-03-26T16:58:57.689 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:57] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:57.689 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:57] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:57.689 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:57.689 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:57.689 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:57.689 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:57.689 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=230 2024-03-26T16:58:57.690 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:57] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:57.690 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:57] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:57.690 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:57.690 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:57.690 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:57.690 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:57.690 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=231 2024-03-26T16:58:57.690 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:57] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:57.691 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:57] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:57.691 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:57.691 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:57.691 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:57.691 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:57.691 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=232 2024-03-26T16:58:57.693 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:57] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:57.693 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:57] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:57.693 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:57.693 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:57.693 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:57.694 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:57.694 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=233 2024-03-26T16:58:57.694 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:57] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:57.694 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:57] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:57.694 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:57.694 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:57.695 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:57.695 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:57.695 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=234 2024-03-26T16:58:57.695 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:57] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:57.695 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:57] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:57.695 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:57.695 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:57.696 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:57.696 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:57.696 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=235 2024-03-26T16:58:57.696 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:57] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:57.696 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:57] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:57.696 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:57.696 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:57.697 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:57.697 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:57.697 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=236 2024-03-26T16:58:57.697 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:57] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:57.697 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:57] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:57.697 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:57.698 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:57.698 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:57.698 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:57.698 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=237 2024-03-26T16:58:57.698 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:57] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:57.698 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:57] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:57.699 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:57.699 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:57.699 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:57.699 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:57.699 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=238 2024-03-26T16:58:57.699 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:57] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:57.700 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:57] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:57.700 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:57.700 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:57.700 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:57.700 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:57.701 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=239 2024-03-26T16:58:57.701 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:57] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:57.701 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:57] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:57.701 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:57.701 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:57.701 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:57.702 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:57.702 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=240 2024-03-26T16:58:57.702 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:57] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:57.702 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:57] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:57.702 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:57.703 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:57.703 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:57.703 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:57.703 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=241 2024-03-26T16:58:57.703 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:57] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:57.703 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:57] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:57.704 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:57.704 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:57.704 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:57.704 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:57.704 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=242 2024-03-26T16:58:57.704 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:57] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:57.704 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:57] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:57.705 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:57.705 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:57.705 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:57.705 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:57.705 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=243 2024-03-26T16:58:57.705 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:57] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:57.705 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:57] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:57.705 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:57.706 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:57.706 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:57.706 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:57.706 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=244 2024-03-26T16:58:57.706 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:57] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:57.706 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:57] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:57.707 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:57.707 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:57.707 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:57.707 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:57.707 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=245 2024-03-26T16:58:57.707 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:57] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:57.707 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:57] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:57.707 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:57.708 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:57.708 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:57.708 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:57.708 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=246 2024-03-26T16:58:57.708 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:57] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:57.708 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:57] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:57.708 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:57.708 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:57.709 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:57.709 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:57.709 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=247 2024-03-26T16:58:57.709 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:57] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:57.709 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:57] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:57.709 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:57.709 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:57.710 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:57.710 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:57.710 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=248 2024-03-26T16:58:57.710 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:57] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:57.710 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:57] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:57.710 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:57.710 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:57.710 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:57.711 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:57.711 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=249 2024-03-26T16:58:57.711 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:57] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:57.711 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:57] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:57.711 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:57.711 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:57.711 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:57.712 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:57.712 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=250 2024-03-26T16:58:57.712 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:57] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:57.712 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:57] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:57.712 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:57.712 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:57.712 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:57.712 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:57.712 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=251 2024-03-26T16:58:57.712 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:57] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:57.713 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:57] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:57.713 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:57.713 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:57.713 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:57.713 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:57.713 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=252 2024-03-26T16:58:57.713 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:57] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:57.713 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:57] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:57.713 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:57.713 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:57.713 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:57.713 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:57.713 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=253 2024-03-26T16:58:57.714 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:57] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:57.714 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:57] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:57.714 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:57.714 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:57.714 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:57.714 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:57.714 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=254 2024-03-26T16:58:57.714 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:57] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:57.714 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:57] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:57.714 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:57.714 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:57.714 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:57.714 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:57.715 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=255 2024-03-26T16:58:57.715 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:57] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:57.715 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:57] INFO grpc.py:2058: create_listener nvmf_subsystem_listener_set_ana_state request=nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:58:57.715 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: host_name: "smithi149" 2024-03-26T16:58:57.715 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: traddr: "172.21.15.149" 2024-03-26T16:58:57.715 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: adrfam: ipv4 2024-03-26T16:58:57.715 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: trsvcid: 4420 2024-03-26T16:58:57.715 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: _ana_state='inaccessible' anagrpid=256 2024-03-26T16:58:57.716 INFO:tasks.workunit.client.3.smithi157.stdout:Adding nqn.2016-06.io.spdk:cnode3 listener at 172.21.15.149:4420: Successful 2024-03-26T16:58:57.716 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:57 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:57] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:58:57.716 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:57 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:57] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}] 2024-03-26T16:58:57.716 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:57 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:57] INFO grpc.py:1992: Received request to create smithi149 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode3 at 172.21.15.149:4420, context: None 2024-03-26T16:58:58.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:57 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:57] INFO grpc.py:2031: Listener not created as gateway's host name smithi044 differs from requested host smithi149 2024-03-26T16:58:58.055 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:57 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:57] INFO grpc.py:1992: Received request to create smithi149 TCP ipv4 listener for nqn.2016-06.io.spdk:cnode3 at 172.21.15.149:4420, context: None 2024-03-26T16:58:58.055 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:57 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:57] INFO grpc.py:2031: Listener not created as gateway's host name smithi064 differs from requested host smithi149 2024-03-26T16:58:58.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:57] INFO grpc.py:2068: create_listener nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:58:58.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:57] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:58:58.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:57] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}] 2024-03-26T16:58:58.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:58:58 smithi044 ceph-mon[30624]: pgmap v369: 33 pgs: 33 active+clean; 609 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 6.2 KiB/s rd, 511 B/s wr, 4 op/s 2024-03-26T16:58:58.531 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:58:58 smithi064 ceph-mon[34420]: pgmap v369: 33 pgs: 33 active+clean; 609 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 6.2 KiB/s rd, 511 B/s wr, 4 op/s 2024-03-26T16:58:58.548 INFO:tasks.workunit.client.3.smithi157.stderr:++ seq 1 3 2024-03-26T16:58:58.549 INFO:tasks.workunit.client.3.smithi157.stderr:+ for i in $(seq 1 $NVMEOF_SUBSYSTEMS_COUNT) 2024-03-26T16:58:58.549 INFO:tasks.workunit.client.3.smithi157.stderr:+ subsystem_nqn=nqn.2016-06.io.spdk:cnode1 2024-03-26T16:58:58.549 INFO:tasks.workunit.client.3.smithi157.stderr:+ sudo podman run -it quay.io/barakda1/nvmeof-cli:qe_ceph_devel_21e59b2 --server-address 172.21.15.44 --server-port 5500 host add --subsystem nqn.2016-06.io.spdk:cnode1 --host '*' 2024-03-26T16:58:58.645 INFO:tasks.workunit.client.3.smithi157.stderr:time="2024-03-26T16:58:58Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2024-03-26T16:58:58.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:58:58 smithi149 ceph-mon[34678]: pgmap v369: 33 pgs: 33 active+clean; 609 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 6.2 KiB/s rd, 511 B/s wr, 4 op/s 2024-03-26T16:58:58.805 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:58 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:58] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:58:58.805 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:58 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:58] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}] 2024-03-26T16:58:59.351 INFO:tasks.workunit.client.3.smithi157.stdout:Allowing open host access to nqn.2016-06.io.spdk:cnode1: Successful 2024-03-26T16:58:59.646 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:59 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:59] INFO grpc.py:1636: Received request to allow any host access for nqn.2016-06.io.spdk:cnode1, context: None 2024-03-26T16:58:59.646 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:59 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:59] INFO grpc.py:1642: add_host *: True 2024-03-26T16:58:59.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:59 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:59] INFO grpc.py:1636: Received request to allow any host access for nqn.2016-06.io.spdk:cnode1, context: 2024-03-26T16:58:59.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:59 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:59] INFO grpc.py:1642: add_host *: True 2024-03-26T16:58:59.766 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:59 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:59] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:58:59.766 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:58:59 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:58:59] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}] 2024-03-26T16:58:59.806 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:59 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:59] INFO grpc.py:1636: Received request to allow any host access for nqn.2016-06.io.spdk:cnode1, context: None 2024-03-26T16:58:59.806 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:58:59 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:58:59] INFO grpc.py:1642: add_host *: True 2024-03-26T16:59:00.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:59 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:59] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:59:00.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:58:59 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:58:59] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}] 2024-03-26T16:59:00.181 INFO:tasks.workunit.client.3.smithi157.stderr:+ for i in $(seq 1 $NVMEOF_SUBSYSTEMS_COUNT) 2024-03-26T16:59:00.182 INFO:tasks.workunit.client.3.smithi157.stderr:+ subsystem_nqn=nqn.2016-06.io.spdk:cnode2 2024-03-26T16:59:00.182 INFO:tasks.workunit.client.3.smithi157.stderr:+ sudo podman run -it quay.io/barakda1/nvmeof-cli:qe_ceph_devel_21e59b2 --server-address 172.21.15.44 --server-port 5500 host add --subsystem nqn.2016-06.io.spdk:cnode2 --host '*' 2024-03-26T16:59:00.270 INFO:tasks.workunit.client.3.smithi157.stderr:time="2024-03-26T16:59:00Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2024-03-26T16:59:00.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:59:00 smithi044 ceph-mon[30624]: pgmap v370: 33 pgs: 33 active+clean; 609 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 8.5 KiB/s rd, 682 B/s wr, 6 op/s 2024-03-26T16:59:00.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:59:00 smithi044 ceph-mon[30624]: Health check update: 2 slow ops, oldest one blocked for 38 sec, daemons [mon.b,mon.c] have slow ops. (SLOW_OPS) 2024-03-26T16:59:00.539 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:59:00 smithi064 ceph-mon[34420]: pgmap v370: 33 pgs: 33 active+clean; 609 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 8.5 KiB/s rd, 682 B/s wr, 6 op/s 2024-03-26T16:59:00.539 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:59:00 smithi064 ceph-mon[34420]: Health check update: 2 slow ops, oldest one blocked for 38 sec, daemons [mon.b,mon.c] have slow ops. (SLOW_OPS) 2024-03-26T16:59:00.540 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:59:00 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-b[34416]: 2024-03-26T16:59:00.275+0000 7ff022916700 -1 mon.b@2(peon) e3 get_health_metrics reporting 1 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T16:59:00.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:59:00 smithi149 ceph-mon[34678]: pgmap v370: 33 pgs: 33 active+clean; 609 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 8.5 KiB/s rd, 682 B/s wr, 6 op/s 2024-03-26T16:59:00.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:59:00 smithi149 ceph-mon[34678]: Health check update: 2 slow ops, oldest one blocked for 38 sec, daemons [mon.b,mon.c] have slow ops. (SLOW_OPS) 2024-03-26T16:59:00.805 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:00 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:00] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:59:00.805 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:00 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:00] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}] 2024-03-26T16:59:01.014 INFO:tasks.workunit.client.3.smithi157.stdout:Allowing open host access to nqn.2016-06.io.spdk:cnode2: Successful 2024-03-26T16:59:01.265 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:01 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:01] INFO grpc.py:1636: Received request to allow any host access for nqn.2016-06.io.spdk:cnode2, context: 2024-03-26T16:59:01.265 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:01 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:01] INFO grpc.py:1642: add_host *: True 2024-03-26T16:59:01.305 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:01 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:01] INFO grpc.py:1636: Received request to allow any host access for nqn.2016-06.io.spdk:cnode2, context: None 2024-03-26T16:59:01.305 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:01 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:01] INFO grpc.py:1642: add_host *: True 2024-03-26T16:59:01.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:59:01 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 2024-03-26T16:59:01.201+0000 7fa707a55700 -1 mon.c@1(peon) e3 get_health_metrics reporting 1 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T16:59:01.396 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:01 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:01] INFO grpc.py:1636: Received request to allow any host access for nqn.2016-06.io.spdk:cnode2, context: None 2024-03-26T16:59:01.396 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:01 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:01] INFO grpc.py:1642: add_host *: True 2024-03-26T16:59:01.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:01 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:01] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:59:01.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:01 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:01] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}] 2024-03-26T16:59:01.825 INFO:tasks.workunit.client.3.smithi157.stderr:+ for i in $(seq 1 $NVMEOF_SUBSYSTEMS_COUNT) 2024-03-26T16:59:01.825 INFO:tasks.workunit.client.3.smithi157.stderr:+ subsystem_nqn=nqn.2016-06.io.spdk:cnode3 2024-03-26T16:59:01.825 INFO:tasks.workunit.client.3.smithi157.stderr:+ sudo podman run -it quay.io/barakda1/nvmeof-cli:qe_ceph_devel_21e59b2 --server-address 172.21.15.44 --server-port 5500 host add --subsystem nqn.2016-06.io.spdk:cnode3 --host '*' 2024-03-26T16:59:01.933 INFO:tasks.workunit.client.3.smithi157.stderr:time="2024-03-26T16:59:01Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2024-03-26T16:59:02.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:01 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:01] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:59:02.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:01 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:01] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}] 2024-03-26T16:59:02.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:59:02 smithi044 ceph-mon[30624]: pgmap v371: 33 pgs: 33 active+clean; 609 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 6.6 KiB/s rd, 511 B/s wr, 4 op/s 2024-03-26T16:59:02.547 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:59:02 smithi064 ceph-mon[34420]: pgmap v371: 33 pgs: 33 active+clean; 609 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 6.6 KiB/s rd, 511 B/s wr, 4 op/s 2024-03-26T16:59:02.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:59:02 smithi149 ceph-mon[34678]: pgmap v371: 33 pgs: 33 active+clean; 609 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 6.6 KiB/s rd, 511 B/s wr, 4 op/s 2024-03-26T16:59:02.675 INFO:tasks.workunit.client.3.smithi157.stdout:Allowing open host access to nqn.2016-06.io.spdk:cnode3: Successful 2024-03-26T16:59:02.805 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:02 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:02] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:59:02.806 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:02 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:02] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': False, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}] 2024-03-26T16:59:02.806 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:02 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:02] INFO grpc.py:1636: Received request to allow any host access for nqn.2016-06.io.spdk:cnode3, context: None 2024-03-26T16:59:02.806 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:02 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:02] INFO grpc.py:1642: add_host *: True 2024-03-26T16:59:03.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:02 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:02] INFO grpc.py:1636: Received request to allow any host access for nqn.2016-06.io.spdk:cnode3, context: 2024-03-26T16:59:03.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:02 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:02] INFO grpc.py:1642: add_host *: True 2024-03-26T16:59:03.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:02 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:02] INFO grpc.py:1636: Received request to allow any host access for nqn.2016-06.io.spdk:cnode3, context: None 2024-03-26T16:59:03.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:02 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:02] INFO grpc.py:1642: add_host *: True 2024-03-26T16:59:03.535 INFO:tasks.workunit.client.3.smithi157.stderr:+ image_index=1 2024-03-26T16:59:03.535 INFO:tasks.workunit.client.3.smithi157.stderr:++ seq 1 3 2024-03-26T16:59:03.536 INFO:tasks.workunit.client.3.smithi157.stderr:+ for i in $(seq 1 $NVMEOF_SUBSYSTEMS_COUNT) 2024-03-26T16:59:03.536 INFO:tasks.workunit.client.3.smithi157.stderr:+ subsystem_nqn=nqn.2016-06.io.spdk:cnode1 2024-03-26T16:59:03.536 INFO:tasks.workunit.client.3.smithi157.stderr:++ seq 1 20 2024-03-26T16:59:03.537 INFO:tasks.workunit.client.3.smithi157.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2024-03-26T16:59:03.537 INFO:tasks.workunit.client.3.smithi157.stderr:+ image=myimage1 2024-03-26T16:59:03.537 INFO:tasks.workunit.client.3.smithi157.stderr:+ sudo podman run -it quay.io/barakda1/nvmeof-cli:qe_ceph_devel_21e59b2 --server-address 172.21.15.44 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode1 --rbd-pool mypool --rbd-image myimage1 --load-balancing-group 2 2024-03-26T16:59:03.629 INFO:tasks.workunit.client.3.smithi157.stderr:time="2024-03-26T16:59:03Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2024-03-26T16:59:03.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:03 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:03] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:59:03.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:03 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:03] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}] 2024-03-26T16:59:04.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:03 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:03] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:59:04.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:03 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:03] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}] 2024-03-26T16:59:04.393 INFO:tasks.workunit.client.3.smithi157.stdout:Adding namespace 1 to nqn.2016-06.io.spdk:cnode1, load balancing group 2: Successful 2024-03-26T16:59:04.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:59:04 smithi044 ceph-mon[30624]: pgmap v372: 33 pgs: 33 active+clean; 609 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 13 KiB/s rd, 1023 B/s wr, 9 op/s 2024-03-26T16:59:04.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:04 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:04] INFO grpc.py:843: Received request to add a namespace to nqn.2016-06.io.spdk:cnode1, context: 2024-03-26T16:59:04.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:04 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:04] INFO grpc.py:299: Received request to create bdev bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b from mypool/myimage1 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-26T16:59:04.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:04 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [2024-03-26 16:59:04.365472] bdev_rbd.c:1113:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_context_2_0, nonce 172.21.15.44:0/3221600408, rc 0 2024-03-26T16:59:04.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:04 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [2024-03-26 16:59:04.365557] bdev_rbd.c: 803:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_context_2_0, nonce 172.21.15.44:0/3221600408 2024-03-26T16:59:04.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:04 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:04] INFO grpc.py:276: Allocated cluster name='cluster_context_2_0' nonce='172.21.15.44:0/3221600408' anagrp=2 2024-03-26T16:59:04.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:04 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [2024-03-26 16:59:04.377726] bdev_rbd.c:1278:bdev_rbd_create: *NOTICE*: Add bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b rbd disk to lun 2024-03-26T16:59:04.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:04 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:04] INFO grpc.py:338: bdev_rbd_create: bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b, cluster_name cluster_context_2_0 2024-03-26T16:59:04.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:04 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:04] INFO grpc.py:709: Received request to add bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b to nqn.2016-06.io.spdk:cnode1 with ANA group id 2 using UUID da4a4580-2a9d-4ce8-9740-82cebdee1a5b 2024-03-26T16:59:04.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:04 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:04] INFO grpc.py:732: subsystem_add_ns: 1 2024-03-26T16:59:04.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:59:04 smithi064 ceph-mon[34420]: pgmap v372: 33 pgs: 33 active+clean; 609 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 13 KiB/s rd, 1023 B/s wr, 9 op/s 2024-03-26T16:59:04.556 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:04 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:04] INFO grpc.py:843: Received request to add a namespace using NSID 1 and UUID da4a4580-2a9d-4ce8-9740-82cebdee1a5b to nqn.2016-06.io.spdk:cnode1, context: None 2024-03-26T16:59:04.556 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:04 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:04] INFO grpc.py:299: Received request to create bdev bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b from mypool/myimage1 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-26T16:59:04.556 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:04 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [2024-03-26 16:59:04.406489] bdev_rbd.c:1113:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_context_2_0, nonce 172.21.15.64:0/1727848942, rc 0 2024-03-26T16:59:04.556 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:04 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [2024-03-26 16:59:04.406584] bdev_rbd.c: 803:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_context_2_0, nonce 172.21.15.64:0/1727848942 2024-03-26T16:59:04.556 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:04 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:04] INFO grpc.py:276: Allocated cluster name='cluster_context_2_0' nonce='172.21.15.64:0/1727848942' anagrp=2 2024-03-26T16:59:04.557 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:04 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [2024-03-26 16:59:04.419538] bdev_rbd.c:1278:bdev_rbd_create: *NOTICE*: Add bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b rbd disk to lun 2024-03-26T16:59:04.557 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:04 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:04] INFO grpc.py:338: bdev_rbd_create: bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b, cluster_name cluster_context_2_0 2024-03-26T16:59:04.557 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:04 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:04] INFO grpc.py:709: Received request to add bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b to nqn.2016-06.io.spdk:cnode1 with ANA group id 2 using NSID 1 and UUID da4a4580-2a9d-4ce8-9740-82cebdee1a5b 2024-03-26T16:59:04.557 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:04 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:04] INFO grpc.py:732: subsystem_add_ns: 1 2024-03-26T16:59:04.557 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:04 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:04] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:59:04.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:59:04 smithi149 ceph-mon[34678]: pgmap v372: 33 pgs: 33 active+clean; 609 KiB data, 223 MiB used, 715 GiB / 715 GiB avail; 13 KiB/s rd, 1023 B/s wr, 9 op/s 2024-03-26T16:59:04.647 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:04 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:04] INFO grpc.py:843: Received request to add a namespace using NSID 1 and UUID da4a4580-2a9d-4ce8-9740-82cebdee1a5b to nqn.2016-06.io.spdk:cnode1, context: None 2024-03-26T16:59:04.649 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:04 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:04] INFO grpc.py:299: Received request to create bdev bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b from mypool/myimage1 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-26T16:59:04.649 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:04 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [2024-03-26 16:59:04.402999] bdev_rbd.c:1113:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_context_2_0, nonce 172.21.15.149:0/3730307388, rc 0 2024-03-26T16:59:04.649 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:04 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [2024-03-26 16:59:04.403082] bdev_rbd.c: 803:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_context_2_0, nonce 172.21.15.149:0/3730307388 2024-03-26T16:59:04.649 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:04 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:04] INFO grpc.py:276: Allocated cluster name='cluster_context_2_0' nonce='172.21.15.149:0/3730307388' anagrp=2 2024-03-26T16:59:04.650 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:04 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [2024-03-26 16:59:04.415357] bdev_rbd.c:1278:bdev_rbd_create: *NOTICE*: Add bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b rbd disk to lun 2024-03-26T16:59:04.650 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:04 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:04] INFO grpc.py:338: bdev_rbd_create: bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b, cluster_name cluster_context_2_0 2024-03-26T16:59:04.650 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:04 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:04] INFO grpc.py:709: Received request to add bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b to nqn.2016-06.io.spdk:cnode1 with ANA group id 2 using NSID 1 and UUID da4a4580-2a9d-4ce8-9740-82cebdee1a5b 2024-03-26T16:59:04.650 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:04 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:04] INFO grpc.py:732: subsystem_add_ns: 1 2024-03-26T16:59:05.055 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:04 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:04] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}] 2024-03-26T16:59:05.244 INFO:tasks.workunit.client.3.smithi157.stderr:+ (( image_index++ )) 2024-03-26T16:59:05.244 INFO:tasks.workunit.client.3.smithi157.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2024-03-26T16:59:05.244 INFO:tasks.workunit.client.3.smithi157.stderr:+ image=myimage2 2024-03-26T16:59:05.244 INFO:tasks.workunit.client.3.smithi157.stderr:+ sudo podman run -it quay.io/barakda1/nvmeof-cli:qe_ceph_devel_21e59b2 --server-address 172.21.15.44 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode1 --rbd-pool mypool --rbd-image myimage2 --load-balancing-group 3 2024-03-26T16:59:05.332 INFO:tasks.workunit.client.3.smithi157.stderr:time="2024-03-26T16:59:05Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2024-03-26T16:59:05.532 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-b[34416]: 2024-03-26T16:59:05.276+0000 7ff022916700 -1 mon.b@2(peon) e3 get_health_metrics reporting 1 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T16:59:05.532 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:05] INFO grpc.py:770: Received request to set ana states [nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T16:59:05.532 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: states { 2024-03-26T16:59:05.533 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: grp_id: 1 2024-03-26T16:59:05.533 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: state: INACCESSIBLE 2024-03-26T16:59:05.533 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: } 2024-03-26T16:59:05.533 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: states { 2024-03-26T16:59:05.533 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: grp_id: 2 2024-03-26T16:59:05.533 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: state: OPTIMIZED 2024-03-26T16:59:05.533 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: } 2024-03-26T16:59:05.533 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: states { 2024-03-26T16:59:05.533 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: grp_id: 3 2024-03-26T16:59:05.533 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: state: INACCESSIBLE 2024-03-26T16:59:05.533 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: } 2024-03-26T16:59:05.533 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: states { 2024-03-26T16:59:05.534 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: grp_id: 4 2024-03-26T16:59:05.534 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: state: INACCESSIBLE 2024-03-26T16:59:05.534 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: } 2024-03-26T16:59:05.534 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: states { 2024-03-26T16:59:05.534 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: grp_id: 5 2024-03-26T16:59:05.534 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: state: INACCESSIBLE 2024-03-26T16:59:05.534 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: } 2024-03-26T16:59:05.534 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: states { 2024-03-26T16:59:05.534 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: grp_id: 6 2024-03-26T16:59:05.534 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: state: INACCESSIBLE 2024-03-26T16:59:05.534 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: } 2024-03-26T16:59:05.534 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: states { 2024-03-26T16:59:05.534 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: grp_id: 7 2024-03-26T16:59:05.535 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: state: INACCESSIBLE 2024-03-26T16:59:05.535 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: } 2024-03-26T16:59:05.535 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: states { 2024-03-26T16:59:05.535 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: grp_id: 8 2024-03-26T16:59:05.535 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: state: INACCESSIBLE 2024-03-26T16:59:05.535 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: } 2024-03-26T16:59:05.535 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: states { 2024-03-26T16:59:05.535 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: grp_id: 9 2024-03-26T16:59:05.535 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: state: INACCESSIBLE 2024-03-26T16:59:05.535 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: } 2024-03-26T16:59:05.535 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: states { 2024-03-26T16:59:05.536 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: grp_id: 10 2024-03-26T16:59:05.537 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: state: INACCESSIBLE 2024-03-26T16:59:05.537 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: } 2024-03-26T16:59:05.537 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: states { 2024-03-26T16:59:05.537 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: grp_id: 11 2024-03-26T16:59:05.537 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: state: INACCESSIBLE 2024-03-26T16:59:05.537 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: } 2024-03-26T16:59:05.537 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: states { 2024-03-26T16:59:05.537 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: grp_id: 12 2024-03-26T16:59:05.537 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: state: INACCESSIBLE 2024-03-26T16:59:05.537 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: } 2024-03-26T16:59:05.537 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: states { 2024-03-26T16:59:05.537 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: grp_id: 13 2024-03-26T16:59:05.538 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: state: INACCESSIBLE 2024-03-26T16:59:05.538 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: } 2024-03-26T16:59:05.538 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: states { 2024-03-26T16:59:05.538 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: grp_id: 14 2024-03-26T16:59:05.538 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: state: INACCESSIBLE 2024-03-26T16:59:05.538 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: } 2024-03-26T16:59:05.538 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: states { 2024-03-26T16:59:05.538 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: grp_id: 15 2024-03-26T16:59:05.538 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: state: INACCESSIBLE 2024-03-26T16:59:05.538 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: } 2024-03-26T16:59:05.538 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: states { 2024-03-26T16:59:05.538 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: grp_id: 16 2024-03-26T16:59:05.538 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: state: INACCESSIBLE 2024-03-26T16:59:05.538 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: } 2024-03-26T16:59:05.539 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: , nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:59:05.539 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: states { 2024-03-26T16:59:05.539 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: grp_id: 1 2024-03-26T16:59:05.539 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: state: INACCESSIBLE 2024-03-26T16:59:05.539 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: } 2024-03-26T16:59:05.539 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: states { 2024-03-26T16:59:05.539 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: grp_id: 2 2024-03-26T16:59:05.539 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: state: OPTIMIZED 2024-03-26T16:59:05.539 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: } 2024-03-26T16:59:05.539 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: states { 2024-03-26T16:59:05.539 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: grp_id: 3 2024-03-26T16:59:05.539 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: state: INACCESSIBLE 2024-03-26T16:59:05.539 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: } 2024-03-26T16:59:05.539 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: states { 2024-03-26T16:59:05.540 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: grp_id: 4 2024-03-26T16:59:05.540 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: state: INACCESSIBLE 2024-03-26T16:59:05.540 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: } 2024-03-26T16:59:05.540 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: states { 2024-03-26T16:59:05.540 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: grp_id: 5 2024-03-26T16:59:05.540 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: state: INACCESSIBLE 2024-03-26T16:59:05.540 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: } 2024-03-26T16:59:05.540 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: states { 2024-03-26T16:59:05.540 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: grp_id: 6 2024-03-26T16:59:05.540 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: state: INACCESSIBLE 2024-03-26T16:59:05.540 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: } 2024-03-26T16:59:05.540 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: states { 2024-03-26T16:59:05.540 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: grp_id: 7 2024-03-26T16:59:05.540 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: state: INACCESSIBLE 2024-03-26T16:59:05.540 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: } 2024-03-26T16:59:05.541 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: states { 2024-03-26T16:59:05.541 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: grp_id: 8 2024-03-26T16:59:05.541 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: state: INACCESSIBLE 2024-03-26T16:59:05.541 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: } 2024-03-26T16:59:05.541 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: states { 2024-03-26T16:59:05.541 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: grp_id: 9 2024-03-26T16:59:05.541 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: state: INACCESSIBLE 2024-03-26T16:59:05.541 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: } 2024-03-26T16:59:05.541 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: states { 2024-03-26T16:59:05.541 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: grp_id: 10 2024-03-26T16:59:05.541 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: state: INACCESSIBLE 2024-03-26T16:59:05.541 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: } 2024-03-26T16:59:05.541 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: states { 2024-03-26T16:59:05.541 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: grp_id: 11 2024-03-26T16:59:05.541 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: state: INACCESSIBLE 2024-03-26T16:59:05.542 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: } 2024-03-26T16:59:05.542 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: states { 2024-03-26T16:59:05.542 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: grp_id: 12 2024-03-26T16:59:05.542 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: state: INACCESSIBLE 2024-03-26T16:59:05.542 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: } 2024-03-26T16:59:05.542 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: states { 2024-03-26T16:59:05.542 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: grp_id: 13 2024-03-26T16:59:05.542 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: state: INACCESSIBLE 2024-03-26T16:59:05.542 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: } 2024-03-26T16:59:05.542 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: states { 2024-03-26T16:59:05.542 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: grp_id: 14 2024-03-26T16:59:05.542 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: state: INACCESSIBLE 2024-03-26T16:59:05.542 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: } 2024-03-26T16:59:05.543 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: states { 2024-03-26T16:59:05.543 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: grp_id: 15 2024-03-26T16:59:05.543 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: state: INACCESSIBLE 2024-03-26T16:59:05.543 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: } 2024-03-26T16:59:05.543 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: states { 2024-03-26T16:59:05.543 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: grp_id: 16 2024-03-26T16:59:05.543 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: state: INACCESSIBLE 2024-03-26T16:59:05.543 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: } 2024-03-26T16:59:05.543 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: ] 2024-03-26T16:59:05.543 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:05] INFO grpc.py:1958: Subsystem nqn.2016-06.io.spdk:cnode2 enable_ha: True 2024-03-26T16:59:05.543 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:05] INFO grpc.py:782: Iterate over nqn='nqn.2016-06.io.spdk:cnode2' prefix='listener_nqn.2016-06.io.spdk:cnode2_smithi064_' listener_keys=['listener_nqn.2016-06.io.spdk:cnode2_smithi064_TCP_172.21.15.64_4420'] 2024-03-26T16:59:05.543 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:05] INFO grpc.py:789: listener_key='listener_nqn.2016-06.io.spdk:cnode2_smithi064_TCP_172.21.15.64_4420' listener={'nqn': 'nqn.2016-06.io.spdk:cnode2', 'host_name': 'smithi064', 'traddr': '172.21.15.64', 'adrfam': 'ipv4', 'trsvcid': 4420} 2024-03-26T16:59:05.543 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:05] INFO grpc.py:810: set_ana_state nvmf_subsystem_listener_set_ana_state nqn='nqn.2016-06.io.spdk:cnode2' listener={'nqn': 'nqn.2016-06.io.spdk:cnode2', 'host_name': 'smithi064', 'traddr': '172.21.15.64', 'adrfam': 'ipv4', 'trsvcid': 4420} ana_state='inaccessible' grp_id=1 2024-03-26T16:59:05.543 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:05] INFO grpc.py:822: set_ana_state nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:59:05.544 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [2024-03-26 16:59:05.288092] bdev_rbd.c: 874:_bdev_rbd_wait_for_latest_osdmap: *ERROR*: rados_wait_for_latest_osdmap cluster: cluster_context_2_0 elapsed time: 0.000283 seconds 2024-03-26T16:59:05.544 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:05] INFO grpc.py:807: set_ana_state bdev_rbd_wait_for_latest_osdmap cluster='cluster_context_2_0' 2024-03-26T16:59:05.544 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:05] INFO grpc.py:810: set_ana_state nvmf_subsystem_listener_set_ana_state nqn='nqn.2016-06.io.spdk:cnode2' listener={'nqn': 'nqn.2016-06.io.spdk:cnode2', 'host_name': 'smithi064', 'traddr': '172.21.15.64', 'adrfam': 'ipv4', 'trsvcid': 4420} ana_state='optimized' grp_id=2 2024-03-26T16:59:05.544 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:05] INFO grpc.py:822: set_ana_state nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:59:05.544 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:05] INFO grpc.py:810: set_ana_state nvmf_subsystem_listener_set_ana_state nqn='nqn.2016-06.io.spdk:cnode2' listener={'nqn': 'nqn.2016-06.io.spdk:cnode2', 'host_name': 'smithi064', 'traddr': '172.21.15.64', 'adrfam': 'ipv4', 'trsvcid': 4420} ana_state='inaccessible' grp_id=3 2024-03-26T16:59:05.544 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:05] INFO grpc.py:822: set_ana_state nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:59:05.544 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:05] INFO grpc.py:810: set_ana_state nvmf_subsystem_listener_set_ana_state nqn='nqn.2016-06.io.spdk:cnode2' listener={'nqn': 'nqn.2016-06.io.spdk:cnode2', 'host_name': 'smithi064', 'traddr': '172.21.15.64', 'adrfam': 'ipv4', 'trsvcid': 4420} ana_state='inaccessible' grp_id=4 2024-03-26T16:59:05.544 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:05] INFO grpc.py:822: set_ana_state nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:59:05.544 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:05] INFO grpc.py:810: set_ana_state nvmf_subsystem_listener_set_ana_state nqn='nqn.2016-06.io.spdk:cnode2' listener={'nqn': 'nqn.2016-06.io.spdk:cnode2', 'host_name': 'smithi064', 'traddr': '172.21.15.64', 'adrfam': 'ipv4', 'trsvcid': 4420} ana_state='inaccessible' grp_id=5 2024-03-26T16:59:05.544 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:05] INFO grpc.py:822: set_ana_state nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:59:05.544 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:05] INFO grpc.py:810: set_ana_state nvmf_subsystem_listener_set_ana_state nqn='nqn.2016-06.io.spdk:cnode2' listener={'nqn': 'nqn.2016-06.io.spdk:cnode2', 'host_name': 'smithi064', 'traddr': '172.21.15.64', 'adrfam': 'ipv4', 'trsvcid': 4420} ana_state='inaccessible' grp_id=6 2024-03-26T16:59:05.544 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:05] INFO grpc.py:822: set_ana_state nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:59:05.544 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:05] INFO grpc.py:810: set_ana_state nvmf_subsystem_listener_set_ana_state nqn='nqn.2016-06.io.spdk:cnode2' listener={'nqn': 'nqn.2016-06.io.spdk:cnode2', 'host_name': 'smithi064', 'traddr': '172.21.15.64', 'adrfam': 'ipv4', 'trsvcid': 4420} ana_state='inaccessible' grp_id=7 2024-03-26T16:59:05.545 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:05] INFO grpc.py:822: set_ana_state nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:59:05.545 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:05] INFO grpc.py:810: set_ana_state nvmf_subsystem_listener_set_ana_state nqn='nqn.2016-06.io.spdk:cnode2' listener={'nqn': 'nqn.2016-06.io.spdk:cnode2', 'host_name': 'smithi064', 'traddr': '172.21.15.64', 'adrfam': 'ipv4', 'trsvcid': 4420} ana_state='inaccessible' grp_id=8 2024-03-26T16:59:05.545 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:05] INFO grpc.py:822: set_ana_state nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:59:05.545 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:05] INFO grpc.py:810: set_ana_state nvmf_subsystem_listener_set_ana_state nqn='nqn.2016-06.io.spdk:cnode2' listener={'nqn': 'nqn.2016-06.io.spdk:cnode2', 'host_name': 'smithi064', 'traddr': '172.21.15.64', 'adrfam': 'ipv4', 'trsvcid': 4420} ana_state='inaccessible' grp_id=9 2024-03-26T16:59:05.545 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:05] INFO grpc.py:822: set_ana_state nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:59:05.545 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:05] INFO grpc.py:810: set_ana_state nvmf_subsystem_listener_set_ana_state nqn='nqn.2016-06.io.spdk:cnode2' listener={'nqn': 'nqn.2016-06.io.spdk:cnode2', 'host_name': 'smithi064', 'traddr': '172.21.15.64', 'adrfam': 'ipv4', 'trsvcid': 4420} ana_state='inaccessible' grp_id=10 2024-03-26T16:59:05.545 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:05] INFO grpc.py:822: set_ana_state nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:59:05.545 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:05] INFO grpc.py:810: set_ana_state nvmf_subsystem_listener_set_ana_state nqn='nqn.2016-06.io.spdk:cnode2' listener={'nqn': 'nqn.2016-06.io.spdk:cnode2', 'host_name': 'smithi064', 'traddr': '172.21.15.64', 'adrfam': 'ipv4', 'trsvcid': 4420} ana_state='inaccessible' grp_id=11 2024-03-26T16:59:05.545 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:05] INFO grpc.py:822: set_ana_state nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:59:05.545 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:05] INFO grpc.py:810: set_ana_state nvmf_subsystem_listener_set_ana_state nqn='nqn.2016-06.io.spdk:cnode2' listener={'nqn': 'nqn.2016-06.io.spdk:cnode2', 'host_name': 'smithi064', 'traddr': '172.21.15.64', 'adrfam': 'ipv4', 'trsvcid': 4420} ana_state='inaccessible' grp_id=12 2024-03-26T16:59:05.545 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:05] INFO grpc.py:822: set_ana_state nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:59:05.545 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:05] INFO grpc.py:810: set_ana_state nvmf_subsystem_listener_set_ana_state nqn='nqn.2016-06.io.spdk:cnode2' listener={'nqn': 'nqn.2016-06.io.spdk:cnode2', 'host_name': 'smithi064', 'traddr': '172.21.15.64', 'adrfam': 'ipv4', 'trsvcid': 4420} ana_state='inaccessible' grp_id=13 2024-03-26T16:59:05.545 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:05] INFO grpc.py:822: set_ana_state nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:59:05.545 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:05] INFO grpc.py:810: set_ana_state nvmf_subsystem_listener_set_ana_state nqn='nqn.2016-06.io.spdk:cnode2' listener={'nqn': 'nqn.2016-06.io.spdk:cnode2', 'host_name': 'smithi064', 'traddr': '172.21.15.64', 'adrfam': 'ipv4', 'trsvcid': 4420} ana_state='inaccessible' grp_id=14 2024-03-26T16:59:05.546 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:05] INFO grpc.py:822: set_ana_state nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:59:05.546 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:05] INFO grpc.py:810: set_ana_state nvmf_subsystem_listener_set_ana_state nqn='nqn.2016-06.io.spdk:cnode2' listener={'nqn': 'nqn.2016-06.io.spdk:cnode2', 'host_name': 'smithi064', 'traddr': '172.21.15.64', 'adrfam': 'ipv4', 'trsvcid': 4420} ana_state='inaccessible' grp_id=15 2024-03-26T16:59:05.546 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:05] INFO grpc.py:822: set_ana_state nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:59:05.546 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:05] INFO grpc.py:810: set_ana_state nvmf_subsystem_listener_set_ana_state nqn='nqn.2016-06.io.spdk:cnode2' listener={'nqn': 'nqn.2016-06.io.spdk:cnode2', 'host_name': 'smithi064', 'traddr': '172.21.15.64', 'adrfam': 'ipv4', 'trsvcid': 4420} ana_state='inaccessible' grp_id=16 2024-03-26T16:59:05.546 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:05] INFO grpc.py:822: set_ana_state nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:59:05.546 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:05] INFO grpc.py:1958: Subsystem nqn.2016-06.io.spdk:cnode3 enable_ha: True 2024-03-26T16:59:05.546 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:05] INFO grpc.py:782: Iterate over nqn='nqn.2016-06.io.spdk:cnode3' prefix='listener_nqn.2016-06.io.spdk:cnode3_smithi064_' listener_keys=['listener_nqn.2016-06.io.spdk:cnode3_smithi064_TCP_172.21.15.64_4420'] 2024-03-26T16:59:05.546 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:05] INFO grpc.py:789: listener_key='listener_nqn.2016-06.io.spdk:cnode3_smithi064_TCP_172.21.15.64_4420' listener={'nqn': 'nqn.2016-06.io.spdk:cnode3', 'host_name': 'smithi064', 'traddr': '172.21.15.64', 'adrfam': 'ipv4', 'trsvcid': 4420} 2024-03-26T16:59:05.546 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:05] INFO grpc.py:810: set_ana_state nvmf_subsystem_listener_set_ana_state nqn='nqn.2016-06.io.spdk:cnode3' listener={'nqn': 'nqn.2016-06.io.spdk:cnode3', 'host_name': 'smithi064', 'traddr': '172.21.15.64', 'adrfam': 'ipv4', 'trsvcid': 4420} ana_state='inaccessible' grp_id=1 2024-03-26T16:59:05.546 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:05] INFO grpc.py:822: set_ana_state nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:59:05.546 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:05] INFO grpc.py:810: set_ana_state nvmf_subsystem_listener_set_ana_state nqn='nqn.2016-06.io.spdk:cnode3' listener={'nqn': 'nqn.2016-06.io.spdk:cnode3', 'host_name': 'smithi064', 'traddr': '172.21.15.64', 'adrfam': 'ipv4', 'trsvcid': 4420} ana_state='optimized' grp_id=2 2024-03-26T16:59:05.546 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:05] INFO grpc.py:822: set_ana_state nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:59:05.546 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:05] INFO grpc.py:810: set_ana_state nvmf_subsystem_listener_set_ana_state nqn='nqn.2016-06.io.spdk:cnode3' listener={'nqn': 'nqn.2016-06.io.spdk:cnode3', 'host_name': 'smithi064', 'traddr': '172.21.15.64', 'adrfam': 'ipv4', 'trsvcid': 4420} ana_state='inaccessible' grp_id=3 2024-03-26T16:59:05.547 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:05] INFO grpc.py:822: set_ana_state nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:59:05.547 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:05] INFO grpc.py:810: set_ana_state nvmf_subsystem_listener_set_ana_state nqn='nqn.2016-06.io.spdk:cnode3' listener={'nqn': 'nqn.2016-06.io.spdk:cnode3', 'host_name': 'smithi064', 'traddr': '172.21.15.64', 'adrfam': 'ipv4', 'trsvcid': 4420} ana_state='inaccessible' grp_id=4 2024-03-26T16:59:05.547 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:05] INFO grpc.py:822: set_ana_state nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:59:05.547 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:05] INFO grpc.py:810: set_ana_state nvmf_subsystem_listener_set_ana_state nqn='nqn.2016-06.io.spdk:cnode3' listener={'nqn': 'nqn.2016-06.io.spdk:cnode3', 'host_name': 'smithi064', 'traddr': '172.21.15.64', 'adrfam': 'ipv4', 'trsvcid': 4420} ana_state='inaccessible' grp_id=5 2024-03-26T16:59:05.547 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:05] INFO grpc.py:822: set_ana_state nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:59:05.547 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:05] INFO grpc.py:810: set_ana_state nvmf_subsystem_listener_set_ana_state nqn='nqn.2016-06.io.spdk:cnode3' listener={'nqn': 'nqn.2016-06.io.spdk:cnode3', 'host_name': 'smithi064', 'traddr': '172.21.15.64', 'adrfam': 'ipv4', 'trsvcid': 4420} ana_state='inaccessible' grp_id=6 2024-03-26T16:59:05.547 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:05] INFO grpc.py:822: set_ana_state nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:59:05.547 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:05] INFO grpc.py:810: set_ana_state nvmf_subsystem_listener_set_ana_state nqn='nqn.2016-06.io.spdk:cnode3' listener={'nqn': 'nqn.2016-06.io.spdk:cnode3', 'host_name': 'smithi064', 'traddr': '172.21.15.64', 'adrfam': 'ipv4', 'trsvcid': 4420} ana_state='inaccessible' grp_id=7 2024-03-26T16:59:05.547 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:05] INFO grpc.py:822: set_ana_state nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:59:05.547 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:05] INFO grpc.py:810: set_ana_state nvmf_subsystem_listener_set_ana_state nqn='nqn.2016-06.io.spdk:cnode3' listener={'nqn': 'nqn.2016-06.io.spdk:cnode3', 'host_name': 'smithi064', 'traddr': '172.21.15.64', 'adrfam': 'ipv4', 'trsvcid': 4420} ana_state='inaccessible' grp_id=8 2024-03-26T16:59:05.547 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:05] INFO grpc.py:822: set_ana_state nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:59:05.547 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:05] INFO grpc.py:810: set_ana_state nvmf_subsystem_listener_set_ana_state nqn='nqn.2016-06.io.spdk:cnode3' listener={'nqn': 'nqn.2016-06.io.spdk:cnode3', 'host_name': 'smithi064', 'traddr': '172.21.15.64', 'adrfam': 'ipv4', 'trsvcid': 4420} ana_state='inaccessible' grp_id=9 2024-03-26T16:59:05.547 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:05] INFO grpc.py:822: set_ana_state nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:59:05.547 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:05] INFO grpc.py:810: set_ana_state nvmf_subsystem_listener_set_ana_state nqn='nqn.2016-06.io.spdk:cnode3' listener={'nqn': 'nqn.2016-06.io.spdk:cnode3', 'host_name': 'smithi064', 'traddr': '172.21.15.64', 'adrfam': 'ipv4', 'trsvcid': 4420} ana_state='inaccessible' grp_id=10 2024-03-26T16:59:05.548 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:05] INFO grpc.py:822: set_ana_state nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:59:05.548 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:05] INFO grpc.py:810: set_ana_state nvmf_subsystem_listener_set_ana_state nqn='nqn.2016-06.io.spdk:cnode3' listener={'nqn': 'nqn.2016-06.io.spdk:cnode3', 'host_name': 'smithi064', 'traddr': '172.21.15.64', 'adrfam': 'ipv4', 'trsvcid': 4420} ana_state='inaccessible' grp_id=11 2024-03-26T16:59:05.548 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:05] INFO grpc.py:822: set_ana_state nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:59:05.548 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:05] INFO grpc.py:810: set_ana_state nvmf_subsystem_listener_set_ana_state nqn='nqn.2016-06.io.spdk:cnode3' listener={'nqn': 'nqn.2016-06.io.spdk:cnode3', 'host_name': 'smithi064', 'traddr': '172.21.15.64', 'adrfam': 'ipv4', 'trsvcid': 4420} ana_state='inaccessible' grp_id=12 2024-03-26T16:59:05.548 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:05] INFO grpc.py:822: set_ana_state nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:59:05.548 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:05] INFO grpc.py:810: set_ana_state nvmf_subsystem_listener_set_ana_state nqn='nqn.2016-06.io.spdk:cnode3' listener={'nqn': 'nqn.2016-06.io.spdk:cnode3', 'host_name': 'smithi064', 'traddr': '172.21.15.64', 'adrfam': 'ipv4', 'trsvcid': 4420} ana_state='inaccessible' grp_id=13 2024-03-26T16:59:05.548 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:05] INFO grpc.py:822: set_ana_state nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:59:05.548 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:05] INFO grpc.py:810: set_ana_state nvmf_subsystem_listener_set_ana_state nqn='nqn.2016-06.io.spdk:cnode3' listener={'nqn': 'nqn.2016-06.io.spdk:cnode3', 'host_name': 'smithi064', 'traddr': '172.21.15.64', 'adrfam': 'ipv4', 'trsvcid': 4420} ana_state='inaccessible' grp_id=14 2024-03-26T16:59:05.548 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:05] INFO grpc.py:822: set_ana_state nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:59:05.548 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:05] INFO grpc.py:810: set_ana_state nvmf_subsystem_listener_set_ana_state nqn='nqn.2016-06.io.spdk:cnode3' listener={'nqn': 'nqn.2016-06.io.spdk:cnode3', 'host_name': 'smithi064', 'traddr': '172.21.15.64', 'adrfam': 'ipv4', 'trsvcid': 4420} ana_state='inaccessible' grp_id=15 2024-03-26T16:59:05.548 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:05] INFO grpc.py:822: set_ana_state nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:59:05.548 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:05] INFO grpc.py:810: set_ana_state nvmf_subsystem_listener_set_ana_state nqn='nqn.2016-06.io.spdk:cnode3' listener={'nqn': 'nqn.2016-06.io.spdk:cnode3', 'host_name': 'smithi064', 'traddr': '172.21.15.64', 'adrfam': 'ipv4', 'trsvcid': 4420} ana_state='inaccessible' grp_id=16 2024-03-26T16:59:05.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:05 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:05] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:59:05.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:05 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:05] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}] 2024-03-26T16:59:05.806 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:05] INFO grpc.py:822: set_ana_state nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:59:05.806 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:05] INFO grpc.py:1487: == recycle_safe started == for anagrp1 time 1711472345.539886 2024-03-26T16:59:05.806 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:05] INFO grpc.py:1489: Doing loop on 1 map; subsystem_nsid_anagrp: 2024-03-26T16:59:05.806 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:05] INFO grpc.py:1493: nsid: 1 ana_val: 2 2024-03-26T16:59:05.806 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:05] INFO grpc.py:1536: == recycle_safe completed == for anagrp1; latency time 0.00022125244140625 sec 2024-03-26T16:59:05.806 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:05] INFO grpc.py:1487: == recycle_safe started == for anagrp3 time 1711472345.540179 2024-03-26T16:59:05.806 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:05] INFO grpc.py:1489: Doing loop on 3 map; subsystem_nsid_anagrp: 2024-03-26T16:59:05.806 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:05] INFO grpc.py:1493: nsid: 1 ana_val: 2 2024-03-26T16:59:05.807 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:05] INFO grpc.py:1536: == recycle_safe completed == for anagrp3; latency time 0.00017595291137695312 sec 2024-03-26T16:59:05.807 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:05] INFO grpc.py:1487: == recycle_safe started == for anagrp4 time 1711472345.5404131 2024-03-26T16:59:05.807 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:05] INFO grpc.py:1489: Doing loop on 4 map; subsystem_nsid_anagrp: 2024-03-26T16:59:05.807 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:05] INFO grpc.py:1493: nsid: 1 ana_val: 2 2024-03-26T16:59:05.807 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:05] INFO grpc.py:1536: == recycle_safe completed == for anagrp4; latency time 0.00016617774963378906 sec 2024-03-26T16:59:05.807 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:05] INFO grpc.py:1487: == recycle_safe started == for anagrp5 time 1711472345.540636 2024-03-26T16:59:05.807 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:05] INFO grpc.py:1489: Doing loop on 5 map; subsystem_nsid_anagrp: 2024-03-26T16:59:05.807 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:05] INFO grpc.py:1493: nsid: 1 ana_val: 2 2024-03-26T16:59:05.807 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:05] INFO grpc.py:1536: == recycle_safe completed == for anagrp5; latency time 0.00017762184143066406 sec 2024-03-26T16:59:05.807 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:05] INFO grpc.py:1487: == recycle_safe started == for anagrp6 time 1711472345.5408707 2024-03-26T16:59:05.807 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:05] INFO grpc.py:1489: Doing loop on 6 map; subsystem_nsid_anagrp: 2024-03-26T16:59:05.807 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:05] INFO grpc.py:1493: nsid: 1 ana_val: 2 2024-03-26T16:59:05.807 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:05] INFO grpc.py:1536: == recycle_safe completed == for anagrp6; latency time 0.0001659393310546875 sec 2024-03-26T16:59:05.808 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:05] INFO grpc.py:1487: == recycle_safe started == for anagrp7 time 1711472345.5410936 2024-03-26T16:59:05.808 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:05] INFO grpc.py:1489: Doing loop on 7 map; subsystem_nsid_anagrp: 2024-03-26T16:59:05.808 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:05] INFO grpc.py:1493: nsid: 1 ana_val: 2 2024-03-26T16:59:05.808 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:05] INFO grpc.py:1536: == recycle_safe completed == for anagrp7; latency time 0.00017976760864257812 sec 2024-03-26T16:59:05.808 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:05] INFO grpc.py:1487: == recycle_safe started == for anagrp8 time 1711472345.5413396 2024-03-26T16:59:05.808 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:05] INFO grpc.py:1489: Doing loop on 8 map; subsystem_nsid_anagrp: 2024-03-26T16:59:05.808 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:05] INFO grpc.py:1493: nsid: 1 ana_val: 2 2024-03-26T16:59:05.808 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:05] INFO grpc.py:1536: == recycle_safe completed == for anagrp8; latency time 0.00016760826110839844 sec 2024-03-26T16:59:05.808 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:05] INFO grpc.py:1487: == recycle_safe started == for anagrp9 time 1711472345.5415719 2024-03-26T16:59:05.808 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:05] INFO grpc.py:1489: Doing loop on 9 map; subsystem_nsid_anagrp: 2024-03-26T16:59:05.808 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:05] INFO grpc.py:1493: nsid: 1 ana_val: 2 2024-03-26T16:59:05.808 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:05] INFO grpc.py:1536: == recycle_safe completed == for anagrp9; latency time 0.00016808509826660156 sec 2024-03-26T16:59:05.808 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:05] INFO grpc.py:1487: == recycle_safe started == for anagrp10 time 1711472345.5417964 2024-03-26T16:59:05.809 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:05] INFO grpc.py:1489: Doing loop on 10 map; subsystem_nsid_anagrp: 2024-03-26T16:59:05.809 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:05] INFO grpc.py:1493: nsid: 1 ana_val: 2 2024-03-26T16:59:05.809 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:05] INFO grpc.py:1536: == recycle_safe completed == for anagrp10; latency time 0.00016498565673828125 sec 2024-03-26T16:59:05.809 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:05] INFO grpc.py:1487: == recycle_safe started == for anagrp11 time 1711472345.5420177 2024-03-26T16:59:05.809 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:05] INFO grpc.py:1489: Doing loop on 11 map; subsystem_nsid_anagrp: 2024-03-26T16:59:05.809 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:05] INFO grpc.py:1493: nsid: 1 ana_val: 2 2024-03-26T16:59:05.809 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:05] INFO grpc.py:1536: == recycle_safe completed == for anagrp11; latency time 0.0001766681671142578 sec 2024-03-26T16:59:05.809 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:05] INFO grpc.py:1487: == recycle_safe started == for anagrp12 time 1711472345.5422535 2024-03-26T16:59:05.809 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:05] INFO grpc.py:1489: Doing loop on 12 map; subsystem_nsid_anagrp: 2024-03-26T16:59:05.809 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:05] INFO grpc.py:1493: nsid: 1 ana_val: 2 2024-03-26T16:59:05.810 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:05] INFO grpc.py:1536: == recycle_safe completed == for anagrp12; latency time 0.00016546249389648438 sec 2024-03-26T16:59:05.810 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:05] INFO grpc.py:1487: == recycle_safe started == for anagrp13 time 1711472345.5424752 2024-03-26T16:59:05.810 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:05] INFO grpc.py:1489: Doing loop on 13 map; subsystem_nsid_anagrp: 2024-03-26T16:59:05.810 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:05] INFO grpc.py:1493: nsid: 1 ana_val: 2 2024-03-26T16:59:05.810 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:05] INFO grpc.py:1536: == recycle_safe completed == for anagrp13; latency time 0.0001652240753173828 sec 2024-03-26T16:59:05.810 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:05] INFO grpc.py:1487: == recycle_safe started == for anagrp14 time 1711472345.542697 2024-03-26T16:59:05.810 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:05] INFO grpc.py:1489: Doing loop on 14 map; subsystem_nsid_anagrp: 2024-03-26T16:59:05.810 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:05] INFO grpc.py:1493: nsid: 1 ana_val: 2 2024-03-26T16:59:05.810 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:05] INFO grpc.py:1536: == recycle_safe completed == for anagrp14; latency time 0.00016379356384277344 sec 2024-03-26T16:59:05.810 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:05] INFO grpc.py:1487: == recycle_safe started == for anagrp15 time 1711472345.5429168 2024-03-26T16:59:05.810 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:05] INFO grpc.py:1489: Doing loop on 15 map; subsystem_nsid_anagrp: 2024-03-26T16:59:05.810 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:05] INFO grpc.py:1493: nsid: 1 ana_val: 2 2024-03-26T16:59:05.811 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:05] INFO grpc.py:1536: == recycle_safe completed == for anagrp15; latency time 0.00016498565673828125 sec 2024-03-26T16:59:05.811 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:05] INFO grpc.py:1487: == recycle_safe started == for anagrp16 time 1711472345.543138 2024-03-26T16:59:05.811 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:05] INFO grpc.py:1489: Doing loop on 16 map; subsystem_nsid_anagrp: 2024-03-26T16:59:05.811 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:05] INFO grpc.py:1493: nsid: 1 ana_val: 2 2024-03-26T16:59:05.811 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:05] INFO grpc.py:1536: == recycle_safe completed == for anagrp16; latency time 0.0001773834228515625 sec 2024-03-26T16:59:06.035 INFO:tasks.workunit.client.3.smithi157.stdout:Adding namespace 2 to nqn.2016-06.io.spdk:cnode1, load balancing group 3: Successful 2024-03-26T16:59:06.035 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:05 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:05] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:59:06.036 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:05 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:05] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}] 2024-03-26T16:59:06.036 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:06] INFO grpc.py:843: Received request to add a namespace using NSID 2 and UUID a1755742-338c-47ea-8ef2-33f2fc007e14 to nqn.2016-06.io.spdk:cnode1, context: None 2024-03-26T16:59:06.036 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:06] INFO grpc.py:299: Received request to create bdev bdev_a1755742-338c-47ea-8ef2-33f2fc007e14 from mypool/myimage2 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-26T16:59:06.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:59:06 smithi044 ceph-mon[30624]: pgmap v373: 33 pgs: 33 active+clean; 609 KiB data, 227 MiB used, 715 GiB / 715 GiB avail; 15 KiB/s rd, 767 B/s wr, 13 op/s 2024-03-26T16:59:06.265 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:05 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:05] INFO grpc.py:843: Received request to add a namespace to nqn.2016-06.io.spdk:cnode1, context: 2024-03-26T16:59:06.265 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:05 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:05] INFO grpc.py:299: Received request to create bdev bdev_a1755742-338c-47ea-8ef2-33f2fc007e14 from mypool/myimage2 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-26T16:59:06.266 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:06 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [2024-03-26 16:59:06.008905] bdev_rbd.c:1113:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_context_3_0, nonce 172.21.15.44:0/2702072163, rc 0 2024-03-26T16:59:06.266 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:06 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [2024-03-26 16:59:06.009011] bdev_rbd.c: 803:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_context_3_0, nonce 172.21.15.44:0/2702072163 2024-03-26T16:59:06.266 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:06 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:06] INFO grpc.py:276: Allocated cluster name='cluster_context_3_0' nonce='172.21.15.44:0/2702072163' anagrp=3 2024-03-26T16:59:06.266 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:06 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [2024-03-26 16:59:06.021831] bdev_rbd.c:1278:bdev_rbd_create: *NOTICE*: Add bdev_a1755742-338c-47ea-8ef2-33f2fc007e14 rbd disk to lun 2024-03-26T16:59:06.266 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:06 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:06] INFO grpc.py:338: bdev_rbd_create: bdev_a1755742-338c-47ea-8ef2-33f2fc007e14, cluster_name cluster_context_3_0 2024-03-26T16:59:06.266 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:06 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:06] INFO grpc.py:709: Received request to add bdev_a1755742-338c-47ea-8ef2-33f2fc007e14 to nqn.2016-06.io.spdk:cnode1 with ANA group id 3 using UUID a1755742-338c-47ea-8ef2-33f2fc007e14 2024-03-26T16:59:06.266 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:06 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:06] INFO grpc.py:732: subsystem_add_ns: 2 2024-03-26T16:59:06.289 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-mon[34678]: pgmap v373: 33 pgs: 33 active+clean; 609 KiB data, 227 MiB used, 715 GiB / 715 GiB avail; 15 KiB/s rd, 767 B/s wr, 13 op/s 2024-03-26T16:59:06.289 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 2024-03-26T16:59:06.201+0000 7fa707a55700 -1 mon.c@1(peon) e3 get_health_metrics reporting 1 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T16:59:06.289 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [2024-03-26 16:59:06.059195] bdev_rbd.c:1113:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_context_3_0, nonce 172.21.15.149:0/2299868107, rc 0 2024-03-26T16:59:06.289 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [2024-03-26 16:59:06.059300] bdev_rbd.c: 803:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_context_3_0, nonce 172.21.15.149:0/2299868107 2024-03-26T16:59:06.289 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:06] INFO grpc.py:276: Allocated cluster name='cluster_context_3_0' nonce='172.21.15.149:0/2299868107' anagrp=3 2024-03-26T16:59:06.289 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [2024-03-26 16:59:06.072262] bdev_rbd.c:1278:bdev_rbd_create: *NOTICE*: Add bdev_a1755742-338c-47ea-8ef2-33f2fc007e14 rbd disk to lun 2024-03-26T16:59:06.290 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:06] INFO grpc.py:338: bdev_rbd_create: bdev_a1755742-338c-47ea-8ef2-33f2fc007e14, cluster_name cluster_context_3_0 2024-03-26T16:59:06.290 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:06] INFO grpc.py:709: Received request to add bdev_a1755742-338c-47ea-8ef2-33f2fc007e14 to nqn.2016-06.io.spdk:cnode1 with ANA group id 3 using NSID 2 and UUID a1755742-338c-47ea-8ef2-33f2fc007e14 2024-03-26T16:59:06.290 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:06] INFO grpc.py:732: subsystem_add_ns: 2 2024-03-26T16:59:06.290 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:06] INFO grpc.py:770: Received request to set ana states [nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:59:06.290 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: states { 2024-03-26T16:59:06.290 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: grp_id: 1 2024-03-26T16:59:06.290 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: state: OPTIMIZED 2024-03-26T16:59:06.290 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: } 2024-03-26T16:59:06.290 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: states { 2024-03-26T16:59:06.290 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: grp_id: 2 2024-03-26T16:59:06.290 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: state: INACCESSIBLE 2024-03-26T16:59:06.290 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: } 2024-03-26T16:59:06.291 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: states { 2024-03-26T16:59:06.291 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: grp_id: 3 2024-03-26T16:59:06.291 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: state: INACCESSIBLE 2024-03-26T16:59:06.291 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: } 2024-03-26T16:59:06.291 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: states { 2024-03-26T16:59:06.291 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: grp_id: 4 2024-03-26T16:59:06.291 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: state: INACCESSIBLE 2024-03-26T16:59:06.291 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: } 2024-03-26T16:59:06.291 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: states { 2024-03-26T16:59:06.291 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: grp_id: 5 2024-03-26T16:59:06.291 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: state: INACCESSIBLE 2024-03-26T16:59:06.291 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: } 2024-03-26T16:59:06.291 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: states { 2024-03-26T16:59:06.292 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: grp_id: 6 2024-03-26T16:59:06.292 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: state: INACCESSIBLE 2024-03-26T16:59:06.292 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: } 2024-03-26T16:59:06.292 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: states { 2024-03-26T16:59:06.292 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: grp_id: 7 2024-03-26T16:59:06.292 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: state: INACCESSIBLE 2024-03-26T16:59:06.292 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: } 2024-03-26T16:59:06.293 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: states { 2024-03-26T16:59:06.293 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: grp_id: 8 2024-03-26T16:59:06.293 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: state: INACCESSIBLE 2024-03-26T16:59:06.293 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: } 2024-03-26T16:59:06.293 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: states { 2024-03-26T16:59:06.293 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: grp_id: 9 2024-03-26T16:59:06.293 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: state: INACCESSIBLE 2024-03-26T16:59:06.293 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: } 2024-03-26T16:59:06.293 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: states { 2024-03-26T16:59:06.294 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: grp_id: 10 2024-03-26T16:59:06.294 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: state: INACCESSIBLE 2024-03-26T16:59:06.294 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: } 2024-03-26T16:59:06.294 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: states { 2024-03-26T16:59:06.294 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: grp_id: 11 2024-03-26T16:59:06.294 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: state: INACCESSIBLE 2024-03-26T16:59:06.294 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: } 2024-03-26T16:59:06.294 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: states { 2024-03-26T16:59:06.294 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: grp_id: 12 2024-03-26T16:59:06.294 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: state: INACCESSIBLE 2024-03-26T16:59:06.294 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: } 2024-03-26T16:59:06.294 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: states { 2024-03-26T16:59:06.295 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: grp_id: 13 2024-03-26T16:59:06.295 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: state: INACCESSIBLE 2024-03-26T16:59:06.295 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: } 2024-03-26T16:59:06.295 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: states { 2024-03-26T16:59:06.295 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: grp_id: 14 2024-03-26T16:59:06.295 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: state: INACCESSIBLE 2024-03-26T16:59:06.295 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: } 2024-03-26T16:59:06.295 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: states { 2024-03-26T16:59:06.295 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: grp_id: 15 2024-03-26T16:59:06.295 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: state: INACCESSIBLE 2024-03-26T16:59:06.295 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: } 2024-03-26T16:59:06.295 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: states { 2024-03-26T16:59:06.295 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: grp_id: 16 2024-03-26T16:59:06.295 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: state: INACCESSIBLE 2024-03-26T16:59:06.295 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: } 2024-03-26T16:59:06.296 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: ] 2024-03-26T16:59:06.296 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:06] INFO grpc.py:1958: Subsystem nqn.2016-06.io.spdk:cnode3 enable_ha: True 2024-03-26T16:59:06.296 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:06] INFO grpc.py:782: Iterate over nqn='nqn.2016-06.io.spdk:cnode3' prefix='listener_nqn.2016-06.io.spdk:cnode3_smithi149_' listener_keys=['listener_nqn.2016-06.io.spdk:cnode3_smithi149_TCP_172.21.15.149_4420'] 2024-03-26T16:59:06.296 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:06] INFO grpc.py:789: listener_key='listener_nqn.2016-06.io.spdk:cnode3_smithi149_TCP_172.21.15.149_4420' listener={'nqn': 'nqn.2016-06.io.spdk:cnode3', 'host_name': 'smithi149', 'traddr': '172.21.15.149', 'adrfam': 'ipv4', 'trsvcid': 4420} 2024-03-26T16:59:06.296 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:06] INFO grpc.py:810: set_ana_state nvmf_subsystem_listener_set_ana_state nqn='nqn.2016-06.io.spdk:cnode3' listener={'nqn': 'nqn.2016-06.io.spdk:cnode3', 'host_name': 'smithi149', 'traddr': '172.21.15.149', 'adrfam': 'ipv4', 'trsvcid': 4420} ana_state='optimized' grp_id=1 2024-03-26T16:59:06.296 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:06] INFO grpc.py:822: set_ana_state nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:59:06.296 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:06] INFO grpc.py:810: set_ana_state nvmf_subsystem_listener_set_ana_state nqn='nqn.2016-06.io.spdk:cnode3' listener={'nqn': 'nqn.2016-06.io.spdk:cnode3', 'host_name': 'smithi149', 'traddr': '172.21.15.149', 'adrfam': 'ipv4', 'trsvcid': 4420} ana_state='inaccessible' grp_id=2 2024-03-26T16:59:06.296 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:06] INFO grpc.py:822: set_ana_state nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:59:06.296 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:06] INFO grpc.py:810: set_ana_state nvmf_subsystem_listener_set_ana_state nqn='nqn.2016-06.io.spdk:cnode3' listener={'nqn': 'nqn.2016-06.io.spdk:cnode3', 'host_name': 'smithi149', 'traddr': '172.21.15.149', 'adrfam': 'ipv4', 'trsvcid': 4420} ana_state='inaccessible' grp_id=3 2024-03-26T16:59:06.296 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:06] INFO grpc.py:822: set_ana_state nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:59:06.296 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:06] INFO grpc.py:810: set_ana_state nvmf_subsystem_listener_set_ana_state nqn='nqn.2016-06.io.spdk:cnode3' listener={'nqn': 'nqn.2016-06.io.spdk:cnode3', 'host_name': 'smithi149', 'traddr': '172.21.15.149', 'adrfam': 'ipv4', 'trsvcid': 4420} ana_state='inaccessible' grp_id=4 2024-03-26T16:59:06.296 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:06] INFO grpc.py:822: set_ana_state nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:59:06.296 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:06] INFO grpc.py:810: set_ana_state nvmf_subsystem_listener_set_ana_state nqn='nqn.2016-06.io.spdk:cnode3' listener={'nqn': 'nqn.2016-06.io.spdk:cnode3', 'host_name': 'smithi149', 'traddr': '172.21.15.149', 'adrfam': 'ipv4', 'trsvcid': 4420} ana_state='inaccessible' grp_id=5 2024-03-26T16:59:06.296 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:06] INFO grpc.py:822: set_ana_state nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:59:06.297 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:06] INFO grpc.py:810: set_ana_state nvmf_subsystem_listener_set_ana_state nqn='nqn.2016-06.io.spdk:cnode3' listener={'nqn': 'nqn.2016-06.io.spdk:cnode3', 'host_name': 'smithi149', 'traddr': '172.21.15.149', 'adrfam': 'ipv4', 'trsvcid': 4420} ana_state='inaccessible' grp_id=6 2024-03-26T16:59:06.297 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:06] INFO grpc.py:822: set_ana_state nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:59:06.297 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:06] INFO grpc.py:810: set_ana_state nvmf_subsystem_listener_set_ana_state nqn='nqn.2016-06.io.spdk:cnode3' listener={'nqn': 'nqn.2016-06.io.spdk:cnode3', 'host_name': 'smithi149', 'traddr': '172.21.15.149', 'adrfam': 'ipv4', 'trsvcid': 4420} ana_state='inaccessible' grp_id=7 2024-03-26T16:59:06.297 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:06] INFO grpc.py:822: set_ana_state nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:59:06.297 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:06] INFO grpc.py:810: set_ana_state nvmf_subsystem_listener_set_ana_state nqn='nqn.2016-06.io.spdk:cnode3' listener={'nqn': 'nqn.2016-06.io.spdk:cnode3', 'host_name': 'smithi149', 'traddr': '172.21.15.149', 'adrfam': 'ipv4', 'trsvcid': 4420} ana_state='inaccessible' grp_id=8 2024-03-26T16:59:06.297 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:06] INFO grpc.py:822: set_ana_state nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:59:06.297 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:06] INFO grpc.py:810: set_ana_state nvmf_subsystem_listener_set_ana_state nqn='nqn.2016-06.io.spdk:cnode3' listener={'nqn': 'nqn.2016-06.io.spdk:cnode3', 'host_name': 'smithi149', 'traddr': '172.21.15.149', 'adrfam': 'ipv4', 'trsvcid': 4420} ana_state='inaccessible' grp_id=9 2024-03-26T16:59:06.297 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:06] INFO grpc.py:822: set_ana_state nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:59:06.297 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:06] INFO grpc.py:810: set_ana_state nvmf_subsystem_listener_set_ana_state nqn='nqn.2016-06.io.spdk:cnode3' listener={'nqn': 'nqn.2016-06.io.spdk:cnode3', 'host_name': 'smithi149', 'traddr': '172.21.15.149', 'adrfam': 'ipv4', 'trsvcid': 4420} ana_state='inaccessible' grp_id=10 2024-03-26T16:59:06.297 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:06] INFO grpc.py:822: set_ana_state nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:59:06.297 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:06] INFO grpc.py:810: set_ana_state nvmf_subsystem_listener_set_ana_state nqn='nqn.2016-06.io.spdk:cnode3' listener={'nqn': 'nqn.2016-06.io.spdk:cnode3', 'host_name': 'smithi149', 'traddr': '172.21.15.149', 'adrfam': 'ipv4', 'trsvcid': 4420} ana_state='inaccessible' grp_id=11 2024-03-26T16:59:06.297 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:06] INFO grpc.py:822: set_ana_state nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:59:06.297 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:06] INFO grpc.py:810: set_ana_state nvmf_subsystem_listener_set_ana_state nqn='nqn.2016-06.io.spdk:cnode3' listener={'nqn': 'nqn.2016-06.io.spdk:cnode3', 'host_name': 'smithi149', 'traddr': '172.21.15.149', 'adrfam': 'ipv4', 'trsvcid': 4420} ana_state='inaccessible' grp_id=12 2024-03-26T16:59:06.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:59:06 smithi064 ceph-mon[34420]: pgmap v373: 33 pgs: 33 active+clean; 609 KiB data, 227 MiB used, 715 GiB / 715 GiB avail; 15 KiB/s rd, 767 B/s wr, 13 op/s 2024-03-26T16:59:06.306 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:06 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:06] INFO grpc.py:843: Received request to add a namespace using NSID 2 and UUID a1755742-338c-47ea-8ef2-33f2fc007e14 to nqn.2016-06.io.spdk:cnode1, context: None 2024-03-26T16:59:06.306 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:06 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:06] INFO grpc.py:299: Received request to create bdev bdev_a1755742-338c-47ea-8ef2-33f2fc007e14 from mypool/myimage2 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-26T16:59:06.306 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:06 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [2024-03-26 16:59:06.054257] bdev_rbd.c:1113:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_context_3_0, nonce 172.21.15.64:0/2414666382, rc 0 2024-03-26T16:59:06.306 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:06 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [2024-03-26 16:59:06.054369] bdev_rbd.c: 803:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_context_3_0, nonce 172.21.15.64:0/2414666382 2024-03-26T16:59:06.306 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:06 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:06] INFO grpc.py:276: Allocated cluster name='cluster_context_3_0' nonce='172.21.15.64:0/2414666382' anagrp=3 2024-03-26T16:59:06.306 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:06 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [2024-03-26 16:59:06.067677] bdev_rbd.c:1278:bdev_rbd_create: *NOTICE*: Add bdev_a1755742-338c-47ea-8ef2-33f2fc007e14 rbd disk to lun 2024-03-26T16:59:06.306 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:06 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:06] INFO grpc.py:338: bdev_rbd_create: bdev_a1755742-338c-47ea-8ef2-33f2fc007e14, cluster_name cluster_context_3_0 2024-03-26T16:59:06.306 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:06 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:06] INFO grpc.py:709: Received request to add bdev_a1755742-338c-47ea-8ef2-33f2fc007e14 to nqn.2016-06.io.spdk:cnode1 with ANA group id 3 using NSID 2 and UUID a1755742-338c-47ea-8ef2-33f2fc007e14 2024-03-26T16:59:06.306 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:06 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:06] INFO grpc.py:732: subsystem_add_ns: 2 2024-03-26T16:59:06.646 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:06] INFO grpc.py:822: set_ana_state nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:59:06.646 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:06] INFO grpc.py:810: set_ana_state nvmf_subsystem_listener_set_ana_state nqn='nqn.2016-06.io.spdk:cnode3' listener={'nqn': 'nqn.2016-06.io.spdk:cnode3', 'host_name': 'smithi149', 'traddr': '172.21.15.149', 'adrfam': 'ipv4', 'trsvcid': 4420} ana_state='inaccessible' grp_id=13 2024-03-26T16:59:06.647 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:06] INFO grpc.py:822: set_ana_state nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:59:06.647 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:06] INFO grpc.py:810: set_ana_state nvmf_subsystem_listener_set_ana_state nqn='nqn.2016-06.io.spdk:cnode3' listener={'nqn': 'nqn.2016-06.io.spdk:cnode3', 'host_name': 'smithi149', 'traddr': '172.21.15.149', 'adrfam': 'ipv4', 'trsvcid': 4420} ana_state='inaccessible' grp_id=14 2024-03-26T16:59:06.647 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:06] INFO grpc.py:822: set_ana_state nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:59:06.647 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:06] INFO grpc.py:810: set_ana_state nvmf_subsystem_listener_set_ana_state nqn='nqn.2016-06.io.spdk:cnode3' listener={'nqn': 'nqn.2016-06.io.spdk:cnode3', 'host_name': 'smithi149', 'traddr': '172.21.15.149', 'adrfam': 'ipv4', 'trsvcid': 4420} ana_state='inaccessible' grp_id=15 2024-03-26T16:59:06.647 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:06] INFO grpc.py:822: set_ana_state nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:59:06.647 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:06] INFO grpc.py:810: set_ana_state nvmf_subsystem_listener_set_ana_state nqn='nqn.2016-06.io.spdk:cnode3' listener={'nqn': 'nqn.2016-06.io.spdk:cnode3', 'host_name': 'smithi149', 'traddr': '172.21.15.149', 'adrfam': 'ipv4', 'trsvcid': 4420} ana_state='inaccessible' grp_id=16 2024-03-26T16:59:06.647 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:06] INFO grpc.py:822: set_ana_state nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:59:06.647 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:06] INFO grpc.py:1487: == recycle_safe started == for anagrp2 time 1711472346.3290155 2024-03-26T16:59:06.647 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:06] INFO grpc.py:1489: Doing loop on 2 map; subsystem_nsid_anagrp: 2024-03-26T16:59:06.647 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:06] INFO grpc.py:1493: nsid: 1 ana_val: 2 2024-03-26T16:59:06.647 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:06] INFO grpc.py:1495: nsid 1 for nqn nqn.2016-06.io.spdk:cnode1 to recycle: 2024-03-26T16:59:06.647 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:06] INFO grpc.py:1501: nsid :1, pool_name: mypool, rbd_name: myimage1, block_size: 512, uuid:da4a4580-2a9d-4ce8-9740-82cebdee1a5b, anagrpid:2 2024-03-26T16:59:06.647 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:06] INFO grpc.py:1070: Received request to remove namespace 1 from nqn.2016-06.io.spdk:cnode1 2024-03-26T16:59:06.648 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:06] INFO grpc.py:1083: remove_namespace 1: True 2024-03-26T16:59:06.648 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:06] INFO grpc.py:398: Received request to delete bdev bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b 2024-03-26T16:59:06.649 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:06] INFO grpc.py:252: Free cluster name='cluster_context_2_0' ret=True 2024-03-26T16:59:06.649 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:06] INFO grpc.py:407: delete_bdev bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b: True 2024-03-26T16:59:06.649 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:06] INFO grpc.py:1493: nsid: 2 ana_val: 3 2024-03-26T16:59:06.649 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:06] INFO grpc.py:1514: Recreate nsid: 1 2024-03-26T16:59:06.649 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:06] INFO grpc.py:1515: ns params: {'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'subsys': 'nqn.2016-06.io.spdk:cnode1'} 2024-03-26T16:59:06.649 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:06] INFO grpc.py:299: Received request to create bdev bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b from mypool/myimage1 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-26T16:59:06.649 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [2024-03-26 16:59:06.367502] bdev_rbd.c:1113:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_context_2_0, nonce 172.21.15.149:0/388809590, rc 0 2024-03-26T16:59:06.649 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [2024-03-26 16:59:06.367588] bdev_rbd.c: 803:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_context_2_0, nonce 172.21.15.149:0/388809590 2024-03-26T16:59:06.649 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:06] INFO grpc.py:276: Allocated cluster name='cluster_context_2_0' nonce='172.21.15.149:0/388809590' anagrp=2 2024-03-26T16:59:06.649 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [2024-03-26 16:59:06.380069] bdev_rbd.c:1278:bdev_rbd_create: *NOTICE*: Add bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b rbd disk to lun 2024-03-26T16:59:06.649 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:06] INFO grpc.py:338: bdev_rbd_create: bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b, cluster_name cluster_context_2_0 2024-03-26T16:59:06.649 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:06] INFO grpc.py:1519: bdev_rbd_create: bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b 2024-03-26T16:59:06.649 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:06] INFO grpc.py:709: Received request to add bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b to nqn.2016-06.io.spdk:cnode1 with ANA group id 2 using NSID 1 and UUID da4a4580-2a9d-4ce8-9740-82cebdee1a5b 2024-03-26T16:59:06.649 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:06] INFO grpc.py:732: subsystem_add_ns: 1 2024-03-26T16:59:06.650 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:06] INFO grpc.py:1536: == recycle_safe completed == for anagrp2; latency time 0.059412240982055664 sec 2024-03-26T16:59:06.650 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:06] INFO grpc.py:1487: == recycle_safe started == for anagrp3 time 1711472346.3885 2024-03-26T16:59:06.650 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:06] INFO grpc.py:1489: Doing loop on 3 map; subsystem_nsid_anagrp: 2024-03-26T16:59:06.650 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:06] INFO grpc.py:1493: nsid: 1 ana_val: 2 2024-03-26T16:59:06.650 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:06] INFO grpc.py:1493: nsid: 2 ana_val: 3 2024-03-26T16:59:06.650 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:06] INFO grpc.py:1495: nsid 2 for nqn nqn.2016-06.io.spdk:cnode1 to recycle: 2024-03-26T16:59:06.650 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:06] INFO grpc.py:1501: nsid :2, pool_name: mypool, rbd_name: myimage2, block_size: 512, uuid:a1755742-338c-47ea-8ef2-33f2fc007e14, anagrpid:3 2024-03-26T16:59:06.650 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:06] INFO grpc.py:1070: Received request to remove namespace 2 from nqn.2016-06.io.spdk:cnode1 2024-03-26T16:59:06.650 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:06] INFO grpc.py:1083: remove_namespace 2: True 2024-03-26T16:59:06.650 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:06] INFO grpc.py:398: Received request to delete bdev bdev_a1755742-338c-47ea-8ef2-33f2fc007e14 2024-03-26T16:59:06.650 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:06] INFO grpc.py:252: Free cluster name='cluster_context_3_0' ret=True 2024-03-26T16:59:06.650 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:06] INFO grpc.py:407: delete_bdev bdev_a1755742-338c-47ea-8ef2-33f2fc007e14: True 2024-03-26T16:59:06.650 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:06] INFO grpc.py:1514: Recreate nsid: 2 2024-03-26T16:59:06.651 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:06] INFO grpc.py:1515: ns params: {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'subsys': 'nqn.2016-06.io.spdk:cnode1'} 2024-03-26T16:59:06.651 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:06] INFO grpc.py:299: Received request to create bdev bdev_a1755742-338c-47ea-8ef2-33f2fc007e14 from mypool/myimage2 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-26T16:59:06.651 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [2024-03-26 16:59:06.426785] bdev_rbd.c:1113:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_context_3_0, nonce 172.21.15.149:0/1344909772, rc 0 2024-03-26T16:59:06.651 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [2024-03-26 16:59:06.426890] bdev_rbd.c: 803:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_context_3_0, nonce 172.21.15.149:0/1344909772 2024-03-26T16:59:06.651 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:06] INFO grpc.py:276: Allocated cluster name='cluster_context_3_0' nonce='172.21.15.149:0/1344909772' anagrp=3 2024-03-26T16:59:06.651 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [2024-03-26 16:59:06.439195] bdev_rbd.c:1278:bdev_rbd_create: *NOTICE*: Add bdev_a1755742-338c-47ea-8ef2-33f2fc007e14 rbd disk to lun 2024-03-26T16:59:06.651 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:06] INFO grpc.py:338: bdev_rbd_create: bdev_a1755742-338c-47ea-8ef2-33f2fc007e14, cluster_name cluster_context_3_0 2024-03-26T16:59:06.651 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:06] INFO grpc.py:1519: bdev_rbd_create: bdev_a1755742-338c-47ea-8ef2-33f2fc007e14 2024-03-26T16:59:06.651 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:06] INFO grpc.py:709: Received request to add bdev_a1755742-338c-47ea-8ef2-33f2fc007e14 to nqn.2016-06.io.spdk:cnode1 with ANA group id 3 using NSID 2 and UUID a1755742-338c-47ea-8ef2-33f2fc007e14 2024-03-26T16:59:06.651 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:06] INFO grpc.py:732: subsystem_add_ns: 2 2024-03-26T16:59:06.651 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:06] INFO grpc.py:1536: == recycle_safe completed == for anagrp3; latency time 0.059151649475097656 sec 2024-03-26T16:59:06.651 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:06] INFO grpc.py:1487: == recycle_safe started == for anagrp4 time 1711472346.4477248 2024-03-26T16:59:06.651 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:06] INFO grpc.py:1489: Doing loop on 4 map; subsystem_nsid_anagrp: 2024-03-26T16:59:06.651 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:06] INFO grpc.py:1493: nsid: 1 ana_val: 2 2024-03-26T16:59:06.652 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:06] INFO grpc.py:1493: nsid: 2 ana_val: 3 2024-03-26T16:59:06.652 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:06] INFO grpc.py:1536: == recycle_safe completed == for anagrp4; latency time 0.00023031234741210938 sec 2024-03-26T16:59:06.652 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:06] INFO grpc.py:1487: == recycle_safe started == for anagrp5 time 1711472346.4480116 2024-03-26T16:59:06.652 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:06] INFO grpc.py:1489: Doing loop on 5 map; subsystem_nsid_anagrp: 2024-03-26T16:59:06.652 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:06] INFO grpc.py:1493: nsid: 1 ana_val: 2 2024-03-26T16:59:06.652 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:06] INFO grpc.py:1493: nsid: 2 ana_val: 3 2024-03-26T16:59:06.652 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:06] INFO grpc.py:1536: == recycle_safe completed == for anagrp5; latency time 0.00020503997802734375 sec 2024-03-26T16:59:06.652 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:06] INFO grpc.py:1487: == recycle_safe started == for anagrp6 time 1711472346.44827 2024-03-26T16:59:06.652 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:06] INFO grpc.py:1489: Doing loop on 6 map; subsystem_nsid_anagrp: 2024-03-26T16:59:06.652 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:06] INFO grpc.py:1493: nsid: 1 ana_val: 2 2024-03-26T16:59:06.652 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:06] INFO grpc.py:1493: nsid: 2 ana_val: 3 2024-03-26T16:59:06.652 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:06] INFO grpc.py:1536: == recycle_safe completed == for anagrp6; latency time 0.0002033710479736328 sec 2024-03-26T16:59:06.652 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:06] INFO grpc.py:1487: == recycle_safe started == for anagrp7 time 1711472346.4485264 2024-03-26T16:59:06.652 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:06] INFO grpc.py:1489: Doing loop on 7 map; subsystem_nsid_anagrp: 2024-03-26T16:59:06.653 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:06] INFO grpc.py:1493: nsid: 1 ana_val: 2 2024-03-26T16:59:06.653 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:06] INFO grpc.py:1493: nsid: 2 ana_val: 3 2024-03-26T16:59:06.653 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:06] INFO grpc.py:1536: == recycle_safe completed == for anagrp7; latency time 0.00020313262939453125 sec 2024-03-26T16:59:06.653 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:06] INFO grpc.py:1487: == recycle_safe started == for anagrp8 time 1711472346.4487827 2024-03-26T16:59:06.653 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:06] INFO grpc.py:1489: Doing loop on 8 map; subsystem_nsid_anagrp: 2024-03-26T16:59:06.653 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:06] INFO grpc.py:1493: nsid: 1 ana_val: 2 2024-03-26T16:59:06.653 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:06] INFO grpc.py:1493: nsid: 2 ana_val: 3 2024-03-26T16:59:06.653 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:06] INFO grpc.py:1536: == recycle_safe completed == for anagrp8; latency time 0.0002219676971435547 sec 2024-03-26T16:59:06.653 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:06] INFO grpc.py:1487: == recycle_safe started == for anagrp9 time 1711472346.4490683 2024-03-26T16:59:06.653 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:06] INFO grpc.py:1489: Doing loop on 9 map; subsystem_nsid_anagrp: 2024-03-26T16:59:06.653 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:06] INFO grpc.py:1493: nsid: 1 ana_val: 2 2024-03-26T16:59:06.653 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:06] INFO grpc.py:1493: nsid: 2 ana_val: 3 2024-03-26T16:59:06.653 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:06] INFO grpc.py:1536: == recycle_safe completed == for anagrp9; latency time 0.00020742416381835938 sec 2024-03-26T16:59:06.654 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:06] INFO grpc.py:1487: == recycle_safe started == for anagrp10 time 1711472346.4493299 2024-03-26T16:59:06.654 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:06] INFO grpc.py:1489: Doing loop on 10 map; subsystem_nsid_anagrp: 2024-03-26T16:59:06.654 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:06] INFO grpc.py:1493: nsid: 1 ana_val: 2 2024-03-26T16:59:06.654 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:06] INFO grpc.py:1493: nsid: 2 ana_val: 3 2024-03-26T16:59:06.654 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:06] INFO grpc.py:1536: == recycle_safe completed == for anagrp10; latency time 0.00020360946655273438 sec 2024-03-26T16:59:06.654 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:06] INFO grpc.py:1487: == recycle_safe started == for anagrp11 time 1711472346.4495866 2024-03-26T16:59:06.654 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:06] INFO grpc.py:1489: Doing loop on 11 map; subsystem_nsid_anagrp: 2024-03-26T16:59:06.654 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:06] INFO grpc.py:1493: nsid: 1 ana_val: 2 2024-03-26T16:59:06.654 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:06] INFO grpc.py:1493: nsid: 2 ana_val: 3 2024-03-26T16:59:06.654 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:06] INFO grpc.py:1536: == recycle_safe completed == for anagrp11; latency time 0.00020456314086914062 sec 2024-03-26T16:59:06.654 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:06] INFO grpc.py:1487: == recycle_safe started == for anagrp12 time 1711472346.4498446 2024-03-26T16:59:06.654 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:06] INFO grpc.py:1489: Doing loop on 12 map; subsystem_nsid_anagrp: 2024-03-26T16:59:06.654 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:06] INFO grpc.py:1493: nsid: 1 ana_val: 2 2024-03-26T16:59:06.655 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:06] INFO grpc.py:1493: nsid: 2 ana_val: 3 2024-03-26T16:59:06.655 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:06] INFO grpc.py:1536: == recycle_safe completed == for anagrp12; latency time 0.00021147727966308594 sec 2024-03-26T16:59:06.655 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:06] INFO grpc.py:1487: == recycle_safe started == for anagrp13 time 1711472346.4501095 2024-03-26T16:59:06.655 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:06] INFO grpc.py:1489: Doing loop on 13 map; subsystem_nsid_anagrp: 2024-03-26T16:59:06.655 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:06] INFO grpc.py:1493: nsid: 1 ana_val: 2 2024-03-26T16:59:06.655 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:06] INFO grpc.py:1493: nsid: 2 ana_val: 3 2024-03-26T16:59:06.655 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:06] INFO grpc.py:1536: == recycle_safe completed == for anagrp13; latency time 0.0002033710479736328 sec 2024-03-26T16:59:06.655 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:06] INFO grpc.py:1487: == recycle_safe started == for anagrp14 time 1711472346.4503658 2024-03-26T16:59:06.655 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:06] INFO grpc.py:1489: Doing loop on 14 map; subsystem_nsid_anagrp: 2024-03-26T16:59:06.655 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:06] INFO grpc.py:1493: nsid: 1 ana_val: 2 2024-03-26T16:59:06.655 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:06] INFO grpc.py:1493: nsid: 2 ana_val: 3 2024-03-26T16:59:06.655 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:06] INFO grpc.py:1536: == recycle_safe completed == for anagrp14; latency time 0.00020360946655273438 sec 2024-03-26T16:59:06.655 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:06] INFO grpc.py:1487: == recycle_safe started == for anagrp15 time 1711472346.4506226 2024-03-26T16:59:06.655 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:06] INFO grpc.py:1489: Doing loop on 15 map; subsystem_nsid_anagrp: 2024-03-26T16:59:06.656 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:06] INFO grpc.py:1493: nsid: 1 ana_val: 2 2024-03-26T16:59:06.656 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:06] INFO grpc.py:1493: nsid: 2 ana_val: 3 2024-03-26T16:59:06.656 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:06] INFO grpc.py:1536: == recycle_safe completed == for anagrp15; latency time 0.0002028942108154297 sec 2024-03-26T16:59:06.656 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:06] INFO grpc.py:1487: == recycle_safe started == for anagrp16 time 1711472346.4508781 2024-03-26T16:59:06.656 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:06] INFO grpc.py:1489: Doing loop on 16 map; subsystem_nsid_anagrp: 2024-03-26T16:59:06.656 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:06] INFO grpc.py:1493: nsid: 1 ana_val: 2 2024-03-26T16:59:06.656 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:06] INFO grpc.py:1493: nsid: 2 ana_val: 3 2024-03-26T16:59:06.656 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:06] INFO grpc.py:1536: == recycle_safe completed == for anagrp16; latency time 0.00021028518676757812 sec 2024-03-26T16:59:06.879 INFO:tasks.workunit.client.3.smithi157.stderr:+ (( image_index++ )) 2024-03-26T16:59:06.879 INFO:tasks.workunit.client.3.smithi157.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2024-03-26T16:59:06.879 INFO:tasks.workunit.client.3.smithi157.stderr:+ image=myimage3 2024-03-26T16:59:06.879 INFO:tasks.workunit.client.3.smithi157.stderr:+ sudo podman run -it quay.io/barakda1/nvmeof-cli:qe_ceph_devel_21e59b2 --server-address 172.21.15.44 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode1 --rbd-pool mypool --rbd-image myimage3 --load-balancing-group 1 2024-03-26T16:59:06.955 INFO:tasks.workunit.client.3.smithi157.stderr:time="2024-03-26T16:59:06Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2024-03-26T16:59:07.055 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:06 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:06] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:59:07.055 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:06 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:06] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}] 2024-03-26T16:59:07.684 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:07 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:07] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:59:07.684 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:07 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:07] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}] 2024-03-26T16:59:07.684 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:07 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:07] INFO grpc.py:843: Received request to add a namespace to nqn.2016-06.io.spdk:cnode1, context: 2024-03-26T16:59:07.723 INFO:tasks.workunit.client.3.smithi157.stdout:Adding namespace 3 to nqn.2016-06.io.spdk:cnode1, load balancing group 1: Successful 2024-03-26T16:59:08.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:07 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:07] INFO grpc.py:299: Received request to create bdev bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf from mypool/myimage3 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-26T16:59:08.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:07 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [2024-03-26 16:59:07.696838] bdev_rbd.c:1113:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_context_1_0, nonce 172.21.15.44:0/2191874838, rc 0 2024-03-26T16:59:08.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:07 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [2024-03-26 16:59:07.696924] bdev_rbd.c: 803:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_context_1_0, nonce 172.21.15.44:0/2191874838 2024-03-26T16:59:08.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:07 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:07] INFO grpc.py:276: Allocated cluster name='cluster_context_1_0' nonce='172.21.15.44:0/2191874838' anagrp=1 2024-03-26T16:59:08.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:07 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [2024-03-26 16:59:07.708689] bdev_rbd.c:1278:bdev_rbd_create: *NOTICE*: Add bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf rbd disk to lun 2024-03-26T16:59:08.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:07 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:07] INFO grpc.py:338: bdev_rbd_create: bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf, cluster_name cluster_context_1_0 2024-03-26T16:59:08.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:07 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:07] INFO grpc.py:709: Received request to add bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf to nqn.2016-06.io.spdk:cnode1 with ANA group id 1 using UUID 7717f2c5-9bb6-4924-8148-adf5c9e343bf 2024-03-26T16:59:08.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:07 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:07] INFO grpc.py:732: subsystem_add_ns: 3 2024-03-26T16:59:08.055 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:07 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:07] INFO grpc.py:843: Received request to add a namespace using NSID 3 and UUID 7717f2c5-9bb6-4924-8148-adf5c9e343bf to nqn.2016-06.io.spdk:cnode1, context: None 2024-03-26T16:59:08.055 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:07 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:07] INFO grpc.py:299: Received request to create bdev bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf from mypool/myimage3 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-26T16:59:08.055 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:07 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [2024-03-26 16:59:07.730750] bdev_rbd.c:1113:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_context_1_0, nonce 172.21.15.64:0/3905403923, rc 0 2024-03-26T16:59:08.056 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:07 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [2024-03-26 16:59:07.730836] bdev_rbd.c: 803:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_context_1_0, nonce 172.21.15.64:0/3905403923 2024-03-26T16:59:08.056 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:07 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:07] INFO grpc.py:276: Allocated cluster name='cluster_context_1_0' nonce='172.21.15.64:0/3905403923' anagrp=1 2024-03-26T16:59:08.056 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:07 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [2024-03-26 16:59:07.743429] bdev_rbd.c:1278:bdev_rbd_create: *NOTICE*: Add bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf rbd disk to lun 2024-03-26T16:59:08.056 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:07 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:07] INFO grpc.py:338: bdev_rbd_create: bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf, cluster_name cluster_context_1_0 2024-03-26T16:59:08.056 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:07 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:07] INFO grpc.py:709: Received request to add bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf to nqn.2016-06.io.spdk:cnode1 with ANA group id 1 using NSID 3 and UUID 7717f2c5-9bb6-4924-8148-adf5c9e343bf 2024-03-26T16:59:08.056 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:07 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:07] INFO grpc.py:732: subsystem_add_ns: 3 2024-03-26T16:59:08.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:07 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:07] INFO grpc.py:843: Received request to add a namespace using NSID 3 and UUID 7717f2c5-9bb6-4924-8148-adf5c9e343bf to nqn.2016-06.io.spdk:cnode1, context: None 2024-03-26T16:59:08.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:07 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:07] INFO grpc.py:299: Received request to create bdev bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf from mypool/myimage3 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-26T16:59:08.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:07 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [2024-03-26 16:59:07.730227] bdev_rbd.c:1113:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_context_1_0, nonce 172.21.15.149:0/103213201, rc 0 2024-03-26T16:59:08.147 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:07 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [2024-03-26 16:59:07.730545] bdev_rbd.c: 803:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_context_1_0, nonce 172.21.15.149:0/103213201 2024-03-26T16:59:08.147 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:07 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:07] INFO grpc.py:276: Allocated cluster name='cluster_context_1_0' nonce='172.21.15.149:0/103213201' anagrp=1 2024-03-26T16:59:08.147 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:07 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [2024-03-26 16:59:07.744473] bdev_rbd.c:1278:bdev_rbd_create: *NOTICE*: Add bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf rbd disk to lun 2024-03-26T16:59:08.147 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:07 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:07] INFO grpc.py:338: bdev_rbd_create: bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf, cluster_name cluster_context_1_0 2024-03-26T16:59:08.147 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:07 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:07] INFO grpc.py:709: Received request to add bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf to nqn.2016-06.io.spdk:cnode1 with ANA group id 1 using NSID 3 and UUID 7717f2c5-9bb6-4924-8148-adf5c9e343bf 2024-03-26T16:59:08.147 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:07 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:07] INFO grpc.py:732: subsystem_add_ns: 3 2024-03-26T16:59:08.147 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:07 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:07] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:59:08.147 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:07 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:07] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}] 2024-03-26T16:59:08.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-mon[30624]: pgmap v374: 33 pgs: 33 active+clean; 609 KiB data, 227 MiB used, 715 GiB / 715 GiB avail; 15 KiB/s rd, 767 B/s wr, 14 op/s 2024-03-26T16:59:08.520 INFO:tasks.workunit.client.3.smithi157.stderr:+ (( image_index++ )) 2024-03-26T16:59:08.521 INFO:tasks.workunit.client.3.smithi157.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2024-03-26T16:59:08.521 INFO:tasks.workunit.client.3.smithi157.stderr:+ image=myimage4 2024-03-26T16:59:08.521 INFO:tasks.workunit.client.3.smithi157.stderr:+ sudo podman run -it quay.io/barakda1/nvmeof-cli:qe_ceph_devel_21e59b2 --server-address 172.21.15.44 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode1 --rbd-pool mypool --rbd-image myimage4 --load-balancing-group 2 2024-03-26T16:59:08.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:59:08 smithi064 ceph-mon[34420]: pgmap v374: 33 pgs: 33 active+clean; 609 KiB data, 227 MiB used, 715 GiB / 715 GiB avail; 15 KiB/s rd, 767 B/s wr, 14 op/s 2024-03-26T16:59:08.621 INFO:tasks.workunit.client.3.smithi157.stderr:time="2024-03-26T16:59:08Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2024-03-26T16:59:08.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:59:08 smithi149 ceph-mon[34678]: pgmap v374: 33 pgs: 33 active+clean; 609 KiB data, 227 MiB used, 715 GiB / 715 GiB avail; 15 KiB/s rd, 767 B/s wr, 14 op/s 2024-03-26T16:59:08.787 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:08] INFO grpc.py:770: Received request to set ana states [nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T16:59:08.787 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: states { 2024-03-26T16:59:08.787 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: grp_id: 1 2024-03-26T16:59:08.788 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: state: INACCESSIBLE 2024-03-26T16:59:08.788 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: } 2024-03-26T16:59:08.788 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: states { 2024-03-26T16:59:08.788 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: grp_id: 2 2024-03-26T16:59:08.788 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: state: INACCESSIBLE 2024-03-26T16:59:08.788 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: } 2024-03-26T16:59:08.788 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: states { 2024-03-26T16:59:08.788 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: grp_id: 3 2024-03-26T16:59:08.788 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: state: OPTIMIZED 2024-03-26T16:59:08.788 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: } 2024-03-26T16:59:08.788 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: states { 2024-03-26T16:59:08.788 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: grp_id: 4 2024-03-26T16:59:08.788 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: state: INACCESSIBLE 2024-03-26T16:59:08.789 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: } 2024-03-26T16:59:08.789 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: states { 2024-03-26T16:59:08.789 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: grp_id: 5 2024-03-26T16:59:08.789 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: state: INACCESSIBLE 2024-03-26T16:59:08.789 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: } 2024-03-26T16:59:08.789 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: states { 2024-03-26T16:59:08.789 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: grp_id: 6 2024-03-26T16:59:08.789 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: state: INACCESSIBLE 2024-03-26T16:59:08.789 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: } 2024-03-26T16:59:08.789 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: states { 2024-03-26T16:59:08.789 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: grp_id: 7 2024-03-26T16:59:08.789 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: state: INACCESSIBLE 2024-03-26T16:59:08.789 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: } 2024-03-26T16:59:08.789 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: states { 2024-03-26T16:59:08.789 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: grp_id: 8 2024-03-26T16:59:08.790 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: state: INACCESSIBLE 2024-03-26T16:59:08.790 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: } 2024-03-26T16:59:08.790 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: states { 2024-03-26T16:59:08.790 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: grp_id: 9 2024-03-26T16:59:08.790 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: state: INACCESSIBLE 2024-03-26T16:59:08.790 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: } 2024-03-26T16:59:08.790 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: states { 2024-03-26T16:59:08.791 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: grp_id: 10 2024-03-26T16:59:08.791 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: state: INACCESSIBLE 2024-03-26T16:59:08.791 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: } 2024-03-26T16:59:08.791 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: states { 2024-03-26T16:59:08.791 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: grp_id: 11 2024-03-26T16:59:08.791 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: state: INACCESSIBLE 2024-03-26T16:59:08.792 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: } 2024-03-26T16:59:08.792 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: states { 2024-03-26T16:59:08.792 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: grp_id: 12 2024-03-26T16:59:08.792 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: state: INACCESSIBLE 2024-03-26T16:59:08.792 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: } 2024-03-26T16:59:08.792 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: states { 2024-03-26T16:59:08.792 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: grp_id: 13 2024-03-26T16:59:08.792 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: state: INACCESSIBLE 2024-03-26T16:59:08.792 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: } 2024-03-26T16:59:08.792 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: states { 2024-03-26T16:59:08.792 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: grp_id: 14 2024-03-26T16:59:08.792 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: state: INACCESSIBLE 2024-03-26T16:59:08.792 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: } 2024-03-26T16:59:08.792 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: states { 2024-03-26T16:59:08.793 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: grp_id: 15 2024-03-26T16:59:08.793 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: state: INACCESSIBLE 2024-03-26T16:59:08.793 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: } 2024-03-26T16:59:08.793 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: states { 2024-03-26T16:59:08.793 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: grp_id: 16 2024-03-26T16:59:08.793 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: state: INACCESSIBLE 2024-03-26T16:59:08.793 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: } 2024-03-26T16:59:08.793 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: ] 2024-03-26T16:59:08.793 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:08] INFO grpc.py:1958: Subsystem nqn.2016-06.io.spdk:cnode3 enable_ha: True 2024-03-26T16:59:08.793 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:08] INFO grpc.py:782: Iterate over nqn='nqn.2016-06.io.spdk:cnode3' prefix='listener_nqn.2016-06.io.spdk:cnode3_smithi044_' listener_keys=['listener_nqn.2016-06.io.spdk:cnode3_smithi044_TCP_172.21.15.44_4420'] 2024-03-26T16:59:08.793 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:08] INFO grpc.py:789: listener_key='listener_nqn.2016-06.io.spdk:cnode3_smithi044_TCP_172.21.15.44_4420' listener={'nqn': 'nqn.2016-06.io.spdk:cnode3', 'host_name': 'smithi044', 'traddr': '172.21.15.44', 'adrfam': 'ipv4', 'trsvcid': 4420} 2024-03-26T16:59:08.793 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:08] INFO grpc.py:810: set_ana_state nvmf_subsystem_listener_set_ana_state nqn='nqn.2016-06.io.spdk:cnode3' listener={'nqn': 'nqn.2016-06.io.spdk:cnode3', 'host_name': 'smithi044', 'traddr': '172.21.15.44', 'adrfam': 'ipv4', 'trsvcid': 4420} ana_state='inaccessible' grp_id=1 2024-03-26T16:59:08.794 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:08] INFO grpc.py:822: set_ana_state nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:59:08.794 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:08] INFO grpc.py:810: set_ana_state nvmf_subsystem_listener_set_ana_state nqn='nqn.2016-06.io.spdk:cnode3' listener={'nqn': 'nqn.2016-06.io.spdk:cnode3', 'host_name': 'smithi044', 'traddr': '172.21.15.44', 'adrfam': 'ipv4', 'trsvcid': 4420} ana_state='inaccessible' grp_id=2 2024-03-26T16:59:08.794 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:08] INFO grpc.py:822: set_ana_state nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:59:08.794 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [2024-03-26 16:59:08.553226] bdev_rbd.c: 874:_bdev_rbd_wait_for_latest_osdmap: *ERROR*: rados_wait_for_latest_osdmap cluster: cluster_context_3_0 elapsed time: 0.000274 seconds 2024-03-26T16:59:08.794 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:08] INFO grpc.py:807: set_ana_state bdev_rbd_wait_for_latest_osdmap cluster='cluster_context_3_0' 2024-03-26T16:59:08.794 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:08] INFO grpc.py:810: set_ana_state nvmf_subsystem_listener_set_ana_state nqn='nqn.2016-06.io.spdk:cnode3' listener={'nqn': 'nqn.2016-06.io.spdk:cnode3', 'host_name': 'smithi044', 'traddr': '172.21.15.44', 'adrfam': 'ipv4', 'trsvcid': 4420} ana_state='optimized' grp_id=3 2024-03-26T16:59:08.794 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:08] INFO grpc.py:822: set_ana_state nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:59:08.794 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:08] INFO grpc.py:810: set_ana_state nvmf_subsystem_listener_set_ana_state nqn='nqn.2016-06.io.spdk:cnode3' listener={'nqn': 'nqn.2016-06.io.spdk:cnode3', 'host_name': 'smithi044', 'traddr': '172.21.15.44', 'adrfam': 'ipv4', 'trsvcid': 4420} ana_state='inaccessible' grp_id=4 2024-03-26T16:59:08.794 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:08] INFO grpc.py:822: set_ana_state nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:59:08.794 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:08] INFO grpc.py:810: set_ana_state nvmf_subsystem_listener_set_ana_state nqn='nqn.2016-06.io.spdk:cnode3' listener={'nqn': 'nqn.2016-06.io.spdk:cnode3', 'host_name': 'smithi044', 'traddr': '172.21.15.44', 'adrfam': 'ipv4', 'trsvcid': 4420} ana_state='inaccessible' grp_id=5 2024-03-26T16:59:08.794 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:08] INFO grpc.py:822: set_ana_state nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:59:08.794 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:08] INFO grpc.py:810: set_ana_state nvmf_subsystem_listener_set_ana_state nqn='nqn.2016-06.io.spdk:cnode3' listener={'nqn': 'nqn.2016-06.io.spdk:cnode3', 'host_name': 'smithi044', 'traddr': '172.21.15.44', 'adrfam': 'ipv4', 'trsvcid': 4420} ana_state='inaccessible' grp_id=6 2024-03-26T16:59:08.794 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:08] INFO grpc.py:822: set_ana_state nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:59:08.794 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:08] INFO grpc.py:810: set_ana_state nvmf_subsystem_listener_set_ana_state nqn='nqn.2016-06.io.spdk:cnode3' listener={'nqn': 'nqn.2016-06.io.spdk:cnode3', 'host_name': 'smithi044', 'traddr': '172.21.15.44', 'adrfam': 'ipv4', 'trsvcid': 4420} ana_state='inaccessible' grp_id=7 2024-03-26T16:59:08.795 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:08] INFO grpc.py:822: set_ana_state nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:59:08.795 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:08] INFO grpc.py:810: set_ana_state nvmf_subsystem_listener_set_ana_state nqn='nqn.2016-06.io.spdk:cnode3' listener={'nqn': 'nqn.2016-06.io.spdk:cnode3', 'host_name': 'smithi044', 'traddr': '172.21.15.44', 'adrfam': 'ipv4', 'trsvcid': 4420} ana_state='inaccessible' grp_id=8 2024-03-26T16:59:08.795 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:08] INFO grpc.py:822: set_ana_state nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:59:08.795 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:08] INFO grpc.py:810: set_ana_state nvmf_subsystem_listener_set_ana_state nqn='nqn.2016-06.io.spdk:cnode3' listener={'nqn': 'nqn.2016-06.io.spdk:cnode3', 'host_name': 'smithi044', 'traddr': '172.21.15.44', 'adrfam': 'ipv4', 'trsvcid': 4420} ana_state='inaccessible' grp_id=9 2024-03-26T16:59:08.795 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:08] INFO grpc.py:822: set_ana_state nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:59:08.795 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:08] INFO grpc.py:810: set_ana_state nvmf_subsystem_listener_set_ana_state nqn='nqn.2016-06.io.spdk:cnode3' listener={'nqn': 'nqn.2016-06.io.spdk:cnode3', 'host_name': 'smithi044', 'traddr': '172.21.15.44', 'adrfam': 'ipv4', 'trsvcid': 4420} ana_state='inaccessible' grp_id=10 2024-03-26T16:59:08.795 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:08] INFO grpc.py:822: set_ana_state nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:59:08.795 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:08] INFO grpc.py:810: set_ana_state nvmf_subsystem_listener_set_ana_state nqn='nqn.2016-06.io.spdk:cnode3' listener={'nqn': 'nqn.2016-06.io.spdk:cnode3', 'host_name': 'smithi044', 'traddr': '172.21.15.44', 'adrfam': 'ipv4', 'trsvcid': 4420} ana_state='inaccessible' grp_id=11 2024-03-26T16:59:08.795 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:08] INFO grpc.py:822: set_ana_state nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:59:08.795 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:08] INFO grpc.py:810: set_ana_state nvmf_subsystem_listener_set_ana_state nqn='nqn.2016-06.io.spdk:cnode3' listener={'nqn': 'nqn.2016-06.io.spdk:cnode3', 'host_name': 'smithi044', 'traddr': '172.21.15.44', 'adrfam': 'ipv4', 'trsvcid': 4420} ana_state='inaccessible' grp_id=12 2024-03-26T16:59:08.795 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:08] INFO grpc.py:822: set_ana_state nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:59:08.795 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:08] INFO grpc.py:810: set_ana_state nvmf_subsystem_listener_set_ana_state nqn='nqn.2016-06.io.spdk:cnode3' listener={'nqn': 'nqn.2016-06.io.spdk:cnode3', 'host_name': 'smithi044', 'traddr': '172.21.15.44', 'adrfam': 'ipv4', 'trsvcid': 4420} ana_state='inaccessible' grp_id=13 2024-03-26T16:59:08.796 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:08] INFO grpc.py:822: set_ana_state nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:59:08.796 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:08] INFO grpc.py:810: set_ana_state nvmf_subsystem_listener_set_ana_state nqn='nqn.2016-06.io.spdk:cnode3' listener={'nqn': 'nqn.2016-06.io.spdk:cnode3', 'host_name': 'smithi044', 'traddr': '172.21.15.44', 'adrfam': 'ipv4', 'trsvcid': 4420} ana_state='inaccessible' grp_id=14 2024-03-26T16:59:08.796 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:08] INFO grpc.py:822: set_ana_state nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:59:08.796 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:08] INFO grpc.py:810: set_ana_state nvmf_subsystem_listener_set_ana_state nqn='nqn.2016-06.io.spdk:cnode3' listener={'nqn': 'nqn.2016-06.io.spdk:cnode3', 'host_name': 'smithi044', 'traddr': '172.21.15.44', 'adrfam': 'ipv4', 'trsvcid': 4420} ana_state='inaccessible' grp_id=15 2024-03-26T16:59:08.796 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:08] INFO grpc.py:822: set_ana_state nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:59:08.796 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:08] INFO grpc.py:810: set_ana_state nvmf_subsystem_listener_set_ana_state nqn='nqn.2016-06.io.spdk:cnode3' listener={'nqn': 'nqn.2016-06.io.spdk:cnode3', 'host_name': 'smithi044', 'traddr': '172.21.15.44', 'adrfam': 'ipv4', 'trsvcid': 4420} ana_state='inaccessible' grp_id=16 2024-03-26T16:59:08.796 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:08] INFO grpc.py:822: set_ana_state nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T16:59:08.796 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:08] INFO grpc.py:1487: == recycle_safe started == for anagrp1 time 1711472348.6690273 2024-03-26T16:59:08.796 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:08] INFO grpc.py:1489: Doing loop on 1 map; subsystem_nsid_anagrp: 2024-03-26T16:59:08.796 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:08] INFO grpc.py:1493: nsid: 1 ana_val: 2 2024-03-26T16:59:08.796 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:08] INFO grpc.py:1493: nsid: 2 ana_val: 3 2024-03-26T16:59:08.796 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:08] INFO grpc.py:1493: nsid: 3 ana_val: 1 2024-03-26T16:59:08.796 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:08] INFO grpc.py:1495: nsid 3 for nqn nqn.2016-06.io.spdk:cnode1 to recycle: 2024-03-26T16:59:08.796 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:08] INFO grpc.py:1501: nsid :3, pool_name: mypool, rbd_name: myimage3, block_size: 512, uuid:7717f2c5-9bb6-4924-8148-adf5c9e343bf, anagrpid:1 2024-03-26T16:59:08.797 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:08] INFO grpc.py:1070: Received request to remove namespace 3 from nqn.2016-06.io.spdk:cnode1 2024-03-26T16:59:08.797 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:08] INFO grpc.py:1083: remove_namespace 3: True 2024-03-26T16:59:08.797 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:08] INFO grpc.py:398: Received request to delete bdev bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf 2024-03-26T16:59:08.797 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:08] INFO grpc.py:252: Free cluster name='cluster_context_1_0' ret=True 2024-03-26T16:59:08.797 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:08] INFO grpc.py:407: delete_bdev bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf: True 2024-03-26T16:59:08.797 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:08] INFO grpc.py:1514: Recreate nsid: 3 2024-03-26T16:59:08.797 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:08] INFO grpc.py:1515: ns params: {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'subsys': 'nqn.2016-06.io.spdk:cnode1'} 2024-03-26T16:59:08.797 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:08] INFO grpc.py:299: Received request to create bdev bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf from mypool/myimage3 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-26T16:59:08.797 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [2024-03-26 16:59:08.707340] bdev_rbd.c:1113:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_context_1_0, nonce 172.21.15.44:0/2419552040, rc 0 2024-03-26T16:59:08.797 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [2024-03-26 16:59:08.707450] bdev_rbd.c: 803:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_context_1_0, nonce 172.21.15.44:0/2419552040 2024-03-26T16:59:08.797 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:08] INFO grpc.py:276: Allocated cluster name='cluster_context_1_0' nonce='172.21.15.44:0/2419552040' anagrp=1 2024-03-26T16:59:08.797 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [2024-03-26 16:59:08.718692] bdev_rbd.c:1278:bdev_rbd_create: *NOTICE*: Add bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf rbd disk to lun 2024-03-26T16:59:08.797 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:08] INFO grpc.py:338: bdev_rbd_create: bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf, cluster_name cluster_context_1_0 2024-03-26T16:59:08.798 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:08] INFO grpc.py:1519: bdev_rbd_create: bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf 2024-03-26T16:59:08.798 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:08] INFO grpc.py:709: Received request to add bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf to nqn.2016-06.io.spdk:cnode1 with ANA group id 1 using NSID 3 and UUID 7717f2c5-9bb6-4924-8148-adf5c9e343bf 2024-03-26T16:59:08.798 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:08] INFO grpc.py:732: subsystem_add_ns: 3 2024-03-26T16:59:08.798 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:08] INFO grpc.py:1536: == recycle_safe completed == for anagrp1; latency time 0.05797410011291504 sec 2024-03-26T16:59:08.798 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:08] INFO grpc.py:1487: == recycle_safe started == for anagrp2 time 1711472348.7270765 2024-03-26T16:59:08.798 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:08] INFO grpc.py:1489: Doing loop on 2 map; subsystem_nsid_anagrp: 2024-03-26T16:59:08.798 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:08] INFO grpc.py:1493: nsid: 1 ana_val: 2 2024-03-26T16:59:08.798 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:08] INFO grpc.py:1495: nsid 1 for nqn nqn.2016-06.io.spdk:cnode1 to recycle: 2024-03-26T16:59:08.798 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:08] INFO grpc.py:1501: nsid :1, pool_name: mypool, rbd_name: myimage1, block_size: 512, uuid:da4a4580-2a9d-4ce8-9740-82cebdee1a5b, anagrpid:2 2024-03-26T16:59:08.798 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:08] INFO grpc.py:1070: Received request to remove namespace 1 from nqn.2016-06.io.spdk:cnode1 2024-03-26T16:59:08.798 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:08] INFO grpc.py:1083: remove_namespace 1: True 2024-03-26T16:59:08.798 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:08] INFO grpc.py:398: Received request to delete bdev bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b 2024-03-26T16:59:08.799 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:08] INFO grpc.py:252: Free cluster name='cluster_context_2_0' ret=True 2024-03-26T16:59:08.799 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:08] INFO grpc.py:407: delete_bdev bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b: True 2024-03-26T16:59:08.800 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:08] INFO grpc.py:1493: nsid: 2 ana_val: 3 2024-03-26T16:59:08.800 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:08] INFO grpc.py:1493: nsid: 3 ana_val: 1 2024-03-26T16:59:08.800 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:08] INFO grpc.py:1514: Recreate nsid: 1 2024-03-26T16:59:08.800 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:08] INFO grpc.py:1515: ns params: {'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'subsys': 'nqn.2016-06.io.spdk:cnode1'} 2024-03-26T16:59:08.800 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:08] INFO grpc.py:299: Received request to create bdev bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b from mypool/myimage1 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-26T16:59:08.800 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [2024-03-26 16:59:08.765444] bdev_rbd.c:1113:rbd_register_cluster: *NOTICE*: rbd_register_cluster cluster_context_2_0, nonce 172.21.15.44:0/3241788124, rc 0 2024-03-26T16:59:08.800 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [2024-03-26 16:59:08.765654] bdev_rbd.c: 803:dump_cluster_nonce: *NOTICE*: dump_cluster_nonce cluster_context_2_0, nonce 172.21.15.44:0/3241788124 2024-03-26T16:59:08.800 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:08] INFO grpc.py:276: Allocated cluster name='cluster_context_2_0' nonce='172.21.15.44:0/3241788124' anagrp=2 2024-03-26T16:59:08.800 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [2024-03-26 16:59:08.777536] bdev_rbd.c:1278:bdev_rbd_create: *NOTICE*: Add bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b rbd disk to lun 2024-03-26T16:59:08.800 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:08] INFO grpc.py:338: bdev_rbd_create: bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b, cluster_name cluster_context_2_0 2024-03-26T16:59:08.800 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:08] INFO grpc.py:1519: bdev_rbd_create: bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b 2024-03-26T16:59:08.801 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:08] INFO grpc.py:709: Received request to add bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b to nqn.2016-06.io.spdk:cnode1 with ANA group id 2 using NSID 1 and UUID da4a4580-2a9d-4ce8-9740-82cebdee1a5b 2024-03-26T16:59:08.801 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:08] INFO grpc.py:732: subsystem_add_ns: 1 2024-03-26T16:59:08.801 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:08] INFO grpc.py:1536: == recycle_safe completed == for anagrp2; latency time 0.05876779556274414 sec 2024-03-26T16:59:08.801 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:08] INFO grpc.py:1487: == recycle_safe started == for anagrp4 time 1711472348.785968 2024-03-26T16:59:08.801 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:08] INFO grpc.py:1489: Doing loop on 4 map; subsystem_nsid_anagrp: 2024-03-26T16:59:08.801 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:08] INFO grpc.py:1493: nsid: 1 ana_val: 2 2024-03-26T16:59:08.801 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:08] INFO grpc.py:1493: nsid: 2 ana_val: 3 2024-03-26T16:59:08.801 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:08] INFO grpc.py:1493: nsid: 3 ana_val: 1 2024-03-26T16:59:08.801 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:08] INFO grpc.py:1536: == recycle_safe completed == for anagrp4; latency time 0.00037026405334472656 sec 2024-03-26T16:59:08.801 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:08] INFO grpc.py:1487: == recycle_safe started == for anagrp5 time 1711472348.786412 2024-03-26T16:59:08.801 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:08] INFO grpc.py:1489: Doing loop on 5 map; subsystem_nsid_anagrp: 2024-03-26T16:59:08.801 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:08] INFO grpc.py:1493: nsid: 1 ana_val: 2 2024-03-26T16:59:08.802 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:08] INFO grpc.py:1493: nsid: 2 ana_val: 3 2024-03-26T16:59:08.802 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:08] INFO grpc.py:1493: nsid: 3 ana_val: 1 2024-03-26T16:59:08.802 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:08] INFO grpc.py:1536: == recycle_safe completed == for anagrp5; latency time 0.0004470348358154297 sec 2024-03-26T16:59:08.802 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:08] INFO grpc.py:1487: == recycle_safe started == for anagrp6 time 1711472348.786916 2024-03-26T16:59:08.802 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:08] INFO grpc.py:1489: Doing loop on 6 map; subsystem_nsid_anagrp: 2024-03-26T16:59:08.802 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:08] INFO grpc.py:1493: nsid: 1 ana_val: 2 2024-03-26T16:59:08.802 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:08] INFO grpc.py:1493: nsid: 2 ana_val: 3 2024-03-26T16:59:08.802 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:08] INFO grpc.py:1493: nsid: 3 ana_val: 1 2024-03-26T16:59:08.803 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:08] INFO grpc.py:1536: == recycle_safe completed == for anagrp6; latency time 0.00026679039001464844 sec 2024-03-26T16:59:08.803 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:08] INFO grpc.py:1487: == recycle_safe started == for anagrp7 time 1711472348.7872384 2024-03-26T16:59:08.803 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:08] INFO grpc.py:1489: Doing loop on 7 map; subsystem_nsid_anagrp: 2024-03-26T16:59:08.803 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:08] INFO grpc.py:1493: nsid: 1 ana_val: 2 2024-03-26T16:59:08.803 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:08] INFO grpc.py:1493: nsid: 2 ana_val: 3 2024-03-26T16:59:08.803 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:08] INFO grpc.py:1493: nsid: 3 ana_val: 1 2024-03-26T16:59:08.803 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:08] INFO grpc.py:1536: == recycle_safe completed == for anagrp7; latency time 0.0002925395965576172 sec 2024-03-26T16:59:08.803 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:08] INFO grpc.py:1487: == recycle_safe started == for anagrp8 time 1711472348.7876182 2024-03-26T16:59:08.803 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:08] INFO grpc.py:1489: Doing loop on 8 map; subsystem_nsid_anagrp: 2024-03-26T16:59:08.803 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:08] INFO grpc.py:1493: nsid: 1 ana_val: 2 2024-03-26T16:59:08.803 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:08] INFO grpc.py:1493: nsid: 2 ana_val: 3 2024-03-26T16:59:08.803 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:08] INFO grpc.py:1493: nsid: 3 ana_val: 1 2024-03-26T16:59:08.803 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:08] INFO grpc.py:1536: == recycle_safe completed == for anagrp8; latency time 0.0002963542938232422 sec 2024-03-26T16:59:08.804 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:08] INFO grpc.py:1487: == recycle_safe started == for anagrp9 time 1711472348.7879796 2024-03-26T16:59:08.804 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:08] INFO grpc.py:1489: Doing loop on 9 map; subsystem_nsid_anagrp: 2024-03-26T16:59:08.804 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:08] INFO grpc.py:1493: nsid: 1 ana_val: 2 2024-03-26T16:59:08.804 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:08] INFO grpc.py:1493: nsid: 2 ana_val: 3 2024-03-26T16:59:08.804 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:08] INFO grpc.py:1493: nsid: 3 ana_val: 1 2024-03-26T16:59:08.804 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:08] INFO grpc.py:1536: == recycle_safe completed == for anagrp9; latency time 0.00029754638671875 sec 2024-03-26T16:59:08.804 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:08] INFO grpc.py:1487: == recycle_safe started == for anagrp10 time 1711472348.788333 2024-03-26T16:59:08.804 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:08] INFO grpc.py:1489: Doing loop on 10 map; subsystem_nsid_anagrp: 2024-03-26T16:59:08.804 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:08] INFO grpc.py:1493: nsid: 1 ana_val: 2 2024-03-26T16:59:08.804 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:08] INFO grpc.py:1493: nsid: 2 ana_val: 3 2024-03-26T16:59:08.804 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:08] INFO grpc.py:1493: nsid: 3 ana_val: 1 2024-03-26T16:59:08.804 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:08] INFO grpc.py:1536: == recycle_safe completed == for anagrp10; latency time 0.0002846717834472656 sec 2024-03-26T16:59:08.805 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:08] INFO grpc.py:1487: == recycle_safe started == for anagrp11 time 1711472348.7886744 2024-03-26T16:59:08.805 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:08] INFO grpc.py:1489: Doing loop on 11 map; subsystem_nsid_anagrp: 2024-03-26T16:59:08.805 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:08] INFO grpc.py:1493: nsid: 1 ana_val: 2 2024-03-26T16:59:08.805 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:08] INFO grpc.py:1493: nsid: 2 ana_val: 3 2024-03-26T16:59:08.805 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:08] INFO grpc.py:1493: nsid: 3 ana_val: 1 2024-03-26T16:59:08.805 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:08] INFO grpc.py:1536: == recycle_safe completed == for anagrp11; latency time 0.00031447410583496094 sec 2024-03-26T16:59:08.805 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:08] INFO grpc.py:1487: == recycle_safe started == for anagrp12 time 1711472348.7890453 2024-03-26T16:59:08.805 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:08] INFO grpc.py:1489: Doing loop on 12 map; subsystem_nsid_anagrp: 2024-03-26T16:59:08.805 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:08] INFO grpc.py:1493: nsid: 1 ana_val: 2 2024-03-26T16:59:08.806 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:08] INFO grpc.py:1493: nsid: 2 ana_val: 3 2024-03-26T16:59:08.806 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:08] INFO grpc.py:1493: nsid: 3 ana_val: 1 2024-03-26T16:59:08.806 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:08] INFO grpc.py:1536: == recycle_safe completed == for anagrp12; latency time 0.0002930164337158203 sec 2024-03-26T16:59:08.806 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:08] INFO grpc.py:1487: == recycle_safe started == for anagrp13 time 1711472348.7894099 2024-03-26T16:59:08.806 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:08] INFO grpc.py:1489: Doing loop on 13 map; subsystem_nsid_anagrp: 2024-03-26T16:59:08.806 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:08] INFO grpc.py:1493: nsid: 1 ana_val: 2 2024-03-26T16:59:08.806 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:08] INFO grpc.py:1493: nsid: 2 ana_val: 3 2024-03-26T16:59:08.806 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:08] INFO grpc.py:1493: nsid: 3 ana_val: 1 2024-03-26T16:59:08.806 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:08] INFO grpc.py:1536: == recycle_safe completed == for anagrp13; latency time 0.0002892017364501953 sec 2024-03-26T16:59:08.806 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:08] INFO grpc.py:1487: == recycle_safe started == for anagrp14 time 1711472348.789764 2024-03-26T16:59:08.806 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:08] INFO grpc.py:1489: Doing loop on 14 map; subsystem_nsid_anagrp: 2024-03-26T16:59:08.806 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:08] INFO grpc.py:1493: nsid: 1 ana_val: 2 2024-03-26T16:59:08.806 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:08] INFO grpc.py:1493: nsid: 2 ana_val: 3 2024-03-26T16:59:08.806 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:08] INFO grpc.py:1493: nsid: 3 ana_val: 1 2024-03-26T16:59:08.807 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:08] INFO grpc.py:1536: == recycle_safe completed == for anagrp14; latency time 0.0003147125244140625 sec 2024-03-26T16:59:08.807 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:08] INFO grpc.py:1487: == recycle_safe started == for anagrp15 time 1711472348.7901347 2024-03-26T16:59:08.807 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:08] INFO grpc.py:1489: Doing loop on 15 map; subsystem_nsid_anagrp: 2024-03-26T16:59:08.807 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:08] INFO grpc.py:1493: nsid: 1 ana_val: 2 2024-03-26T16:59:08.807 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:08] INFO grpc.py:1493: nsid: 2 ana_val: 3 2024-03-26T16:59:08.807 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:08] INFO grpc.py:1493: nsid: 3 ana_val: 1 2024-03-26T16:59:08.807 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:08] INFO grpc.py:1536: == recycle_safe completed == for anagrp15; latency time 0.0002753734588623047 sec 2024-03-26T16:59:08.807 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:08] INFO grpc.py:1487: == recycle_safe started == for anagrp16 time 1711472348.7904754 2024-03-26T16:59:08.807 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:08] INFO grpc.py:1489: Doing loop on 16 map; subsystem_nsid_anagrp: 2024-03-26T16:59:08.807 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:08] INFO grpc.py:1493: nsid: 1 ana_val: 2 2024-03-26T16:59:08.807 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:08] INFO grpc.py:1493: nsid: 2 ana_val: 3 2024-03-26T16:59:08.807 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:08] INFO grpc.py:1493: nsid: 3 ana_val: 1 2024-03-26T16:59:08.807 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:08] INFO grpc.py:1536: == recycle_safe completed == for anagrp16; latency time 0.0003113746643066406 sec 2024-03-26T16:59:09.055 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:08 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:08] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:59:09.055 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:08 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:08] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}] 2024-03-26T16:59:09.320 INFO:tasks.workunit.client.3.smithi157.stdout:Adding namespace 4 to nqn.2016-06.io.spdk:cnode1, load balancing group 2: Successful 2024-03-26T16:59:09.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:59:09 smithi044 ceph-mon[30624]: Health check update: 2 slow ops, oldest one blocked for 43 sec, daemons [mon.b,mon.c] have slow ops. (SLOW_OPS) 2024-03-26T16:59:09.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:09 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:09] INFO grpc.py:843: Received request to add a namespace to nqn.2016-06.io.spdk:cnode1, context: 2024-03-26T16:59:09.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:09 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:09] INFO grpc.py:299: Received request to create bdev bdev_6060c284-177d-4f51-aee2-022f2e268fb6 from mypool/myimage4 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-26T16:59:09.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:09 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [2024-03-26 16:59:09.305268] bdev_rbd.c:1278:bdev_rbd_create: *NOTICE*: Add bdev_6060c284-177d-4f51-aee2-022f2e268fb6 rbd disk to lun 2024-03-26T16:59:09.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:09 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:09] INFO grpc.py:338: bdev_rbd_create: bdev_6060c284-177d-4f51-aee2-022f2e268fb6, cluster_name cluster_context_2_0 2024-03-26T16:59:09.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:09 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:09] INFO grpc.py:709: Received request to add bdev_6060c284-177d-4f51-aee2-022f2e268fb6 to nqn.2016-06.io.spdk:cnode1 with ANA group id 2 using UUID 6060c284-177d-4f51-aee2-022f2e268fb6 2024-03-26T16:59:09.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:09 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:09] INFO grpc.py:732: subsystem_add_ns: 4 2024-03-26T16:59:09.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:09 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:09] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:59:09.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:09 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:09] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}] 2024-03-26T16:59:09.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:59:09 smithi064 ceph-mon[34420]: Health check update: 2 slow ops, oldest one blocked for 43 sec, daemons [mon.b,mon.c] have slow ops. (SLOW_OPS) 2024-03-26T16:59:09.556 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:09 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:09] INFO grpc.py:843: Received request to add a namespace using NSID 4 and UUID 6060c284-177d-4f51-aee2-022f2e268fb6 to nqn.2016-06.io.spdk:cnode1, context: None 2024-03-26T16:59:09.556 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:09 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:09] INFO grpc.py:299: Received request to create bdev bdev_6060c284-177d-4f51-aee2-022f2e268fb6 from mypool/myimage4 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-26T16:59:09.556 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:09 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [2024-03-26 16:59:09.332499] bdev_rbd.c:1278:bdev_rbd_create: *NOTICE*: Add bdev_6060c284-177d-4f51-aee2-022f2e268fb6 rbd disk to lun 2024-03-26T16:59:09.556 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:09 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:09] INFO grpc.py:338: bdev_rbd_create: bdev_6060c284-177d-4f51-aee2-022f2e268fb6, cluster_name cluster_context_2_0 2024-03-26T16:59:09.556 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:09 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:09] INFO grpc.py:709: Received request to add bdev_6060c284-177d-4f51-aee2-022f2e268fb6 to nqn.2016-06.io.spdk:cnode1 with ANA group id 2 using NSID 4 and UUID 6060c284-177d-4f51-aee2-022f2e268fb6 2024-03-26T16:59:09.556 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:09 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:09] INFO grpc.py:732: subsystem_add_ns: 4 2024-03-26T16:59:09.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:59:09 smithi149 ceph-mon[34678]: Health check update: 2 slow ops, oldest one blocked for 43 sec, daemons [mon.b,mon.c] have slow ops. (SLOW_OPS) 2024-03-26T16:59:09.646 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:09 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:09] INFO grpc.py:843: Received request to add a namespace using NSID 4 and UUID 6060c284-177d-4f51-aee2-022f2e268fb6 to nqn.2016-06.io.spdk:cnode1, context: None 2024-03-26T16:59:09.646 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:09 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:09] INFO grpc.py:299: Received request to create bdev bdev_6060c284-177d-4f51-aee2-022f2e268fb6 from mypool/myimage4 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-26T16:59:09.646 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:09 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [2024-03-26 16:59:09.329932] bdev_rbd.c:1278:bdev_rbd_create: *NOTICE*: Add bdev_6060c284-177d-4f51-aee2-022f2e268fb6 rbd disk to lun 2024-03-26T16:59:09.647 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:09 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:09] INFO grpc.py:338: bdev_rbd_create: bdev_6060c284-177d-4f51-aee2-022f2e268fb6, cluster_name cluster_context_2_0 2024-03-26T16:59:09.647 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:09 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:09] INFO grpc.py:709: Received request to add bdev_6060c284-177d-4f51-aee2-022f2e268fb6 to nqn.2016-06.io.spdk:cnode1 with ANA group id 2 using NSID 4 and UUID 6060c284-177d-4f51-aee2-022f2e268fb6 2024-03-26T16:59:09.647 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:09 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:09] INFO grpc.py:732: subsystem_add_ns: 4 2024-03-26T16:59:10.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:09 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:09] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:59:10.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:09 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:09] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}] 2024-03-26T16:59:10.148 INFO:tasks.workunit.client.3.smithi157.stderr:+ (( image_index++ )) 2024-03-26T16:59:10.148 INFO:tasks.workunit.client.3.smithi157.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2024-03-26T16:59:10.148 INFO:tasks.workunit.client.3.smithi157.stderr:+ image=myimage5 2024-03-26T16:59:10.148 INFO:tasks.workunit.client.3.smithi157.stderr:+ sudo podman run -it quay.io/barakda1/nvmeof-cli:qe_ceph_devel_21e59b2 --server-address 172.21.15.44 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode1 --rbd-pool mypool --rbd-image myimage5 --load-balancing-group 3 2024-03-26T16:59:10.223 INFO:tasks.workunit.client.3.smithi157.stderr:time="2024-03-26T16:59:10Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2024-03-26T16:59:10.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:59:10 smithi044 ceph-mon[30624]: pgmap v375: 33 pgs: 33 active+clean; 609 KiB data, 227 MiB used, 715 GiB / 715 GiB avail; 44 KiB/s rd, 1.4 KiB/s wr, 46 op/s 2024-03-26T16:59:10.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:59:10 smithi064 ceph-mon[34420]: pgmap v375: 33 pgs: 33 active+clean; 609 KiB data, 227 MiB used, 715 GiB / 715 GiB avail; 44 KiB/s rd, 1.4 KiB/s wr, 46 op/s 2024-03-26T16:59:10.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:59:10 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-b[34416]: 2024-03-26T16:59:10.276+0000 7ff022916700 -1 mon.b@2(peon) e3 get_health_metrics reporting 1 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T16:59:10.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:59:10 smithi149 ceph-mon[34678]: pgmap v375: 33 pgs: 33 active+clean; 609 KiB data, 227 MiB used, 715 GiB / 715 GiB avail; 44 KiB/s rd, 1.4 KiB/s wr, 46 op/s 2024-03-26T16:59:11.035 INFO:tasks.workunit.client.3.smithi157.stdout:Adding namespace 5 to nqn.2016-06.io.spdk:cnode1, load balancing group 3: Successful 2024-03-26T16:59:11.036 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:10 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:10] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:59:11.036 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:10 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:10] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}] 2024-03-26T16:59:11.036 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:11 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:11] INFO grpc.py:843: Received request to add a namespace using NSID 5 and UUID 9f5354a4-1a93-4270-b370-63e819567f34 to nqn.2016-06.io.spdk:cnode1, context: None 2024-03-26T16:59:11.036 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:11 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:11] INFO grpc.py:299: Received request to create bdev bdev_9f5354a4-1a93-4270-b370-63e819567f34 from mypool/myimage5 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-26T16:59:11.265 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:11 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:11] INFO grpc.py:843: Received request to add a namespace to nqn.2016-06.io.spdk:cnode1, context: 2024-03-26T16:59:11.265 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:11 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:11] INFO grpc.py:299: Received request to create bdev bdev_9f5354a4-1a93-4270-b370-63e819567f34 from mypool/myimage5 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-26T16:59:11.265 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:11 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [2024-03-26 16:59:11.020675] bdev_rbd.c:1278:bdev_rbd_create: *NOTICE*: Add bdev_9f5354a4-1a93-4270-b370-63e819567f34 rbd disk to lun 2024-03-26T16:59:11.265 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:11 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:11] INFO grpc.py:338: bdev_rbd_create: bdev_9f5354a4-1a93-4270-b370-63e819567f34, cluster_name cluster_context_3_0 2024-03-26T16:59:11.265 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:11 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:11] INFO grpc.py:709: Received request to add bdev_9f5354a4-1a93-4270-b370-63e819567f34 to nqn.2016-06.io.spdk:cnode1 with ANA group id 3 using UUID 9f5354a4-1a93-4270-b370-63e819567f34 2024-03-26T16:59:11.265 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:11 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:11] INFO grpc.py:732: subsystem_add_ns: 5 2024-03-26T16:59:11.305 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:11 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [2024-03-26 16:59:11.044350] bdev_rbd.c:1278:bdev_rbd_create: *NOTICE*: Add bdev_9f5354a4-1a93-4270-b370-63e819567f34 rbd disk to lun 2024-03-26T16:59:11.305 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:11 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:11] INFO grpc.py:338: bdev_rbd_create: bdev_9f5354a4-1a93-4270-b370-63e819567f34, cluster_name cluster_context_3_0 2024-03-26T16:59:11.305 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:11 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:11] INFO grpc.py:709: Received request to add bdev_9f5354a4-1a93-4270-b370-63e819567f34 to nqn.2016-06.io.spdk:cnode1 with ANA group id 3 using NSID 5 and UUID 9f5354a4-1a93-4270-b370-63e819567f34 2024-03-26T16:59:11.306 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:11 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:11] INFO grpc.py:732: subsystem_add_ns: 5 2024-03-26T16:59:11.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:59:11 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 2024-03-26T16:59:11.201+0000 7fa707a55700 -1 mon.c@1(peon) e3 get_health_metrics reporting 1 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T16:59:11.397 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:11 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:11] INFO grpc.py:843: Received request to add a namespace using NSID 5 and UUID 9f5354a4-1a93-4270-b370-63e819567f34 to nqn.2016-06.io.spdk:cnode1, context: None 2024-03-26T16:59:11.397 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:11 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:11] INFO grpc.py:299: Received request to create bdev bdev_9f5354a4-1a93-4270-b370-63e819567f34 from mypool/myimage5 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-26T16:59:11.397 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:11 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [2024-03-26 16:59:11.045517] bdev_rbd.c:1278:bdev_rbd_create: *NOTICE*: Add bdev_9f5354a4-1a93-4270-b370-63e819567f34 rbd disk to lun 2024-03-26T16:59:11.397 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:11 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:11] INFO grpc.py:338: bdev_rbd_create: bdev_9f5354a4-1a93-4270-b370-63e819567f34, cluster_name cluster_context_3_0 2024-03-26T16:59:11.397 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:11 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:11] INFO grpc.py:709: Received request to add bdev_9f5354a4-1a93-4270-b370-63e819567f34 to nqn.2016-06.io.spdk:cnode1 with ANA group id 3 using NSID 5 and UUID 9f5354a4-1a93-4270-b370-63e819567f34 2024-03-26T16:59:11.397 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:11 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:11] INFO grpc.py:732: subsystem_add_ns: 5 2024-03-26T16:59:11.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:11 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:11] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:59:11.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:11 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:11] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}] 2024-03-26T16:59:11.882 INFO:tasks.workunit.client.3.smithi157.stderr:+ (( image_index++ )) 2024-03-26T16:59:11.882 INFO:tasks.workunit.client.3.smithi157.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2024-03-26T16:59:11.883 INFO:tasks.workunit.client.3.smithi157.stderr:+ image=myimage6 2024-03-26T16:59:11.883 INFO:tasks.workunit.client.3.smithi157.stderr:+ sudo podman run -it quay.io/barakda1/nvmeof-cli:qe_ceph_devel_21e59b2 --server-address 172.21.15.44 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode1 --rbd-pool mypool --rbd-image myimage6 --load-balancing-group 1 2024-03-26T16:59:11.982 INFO:tasks.workunit.client.3.smithi157.stderr:time="2024-03-26T16:59:11Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2024-03-26T16:59:12.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:11 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:11] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:59:12.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:11 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:11] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}] 2024-03-26T16:59:12.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:59:12 smithi044 ceph-mon[30624]: pgmap v376: 33 pgs: 33 active+clean; 609 KiB data, 227 MiB used, 715 GiB / 715 GiB avail; 42 KiB/s rd, 1.2 KiB/s wr, 44 op/s 2024-03-26T16:59:12.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:59:12 smithi064 ceph-mon[34420]: pgmap v376: 33 pgs: 33 active+clean; 609 KiB data, 227 MiB used, 715 GiB / 715 GiB avail; 42 KiB/s rd, 1.2 KiB/s wr, 44 op/s 2024-03-26T16:59:12.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:59:12 smithi149 ceph-mon[34678]: pgmap v376: 33 pgs: 33 active+clean; 609 KiB data, 227 MiB used, 715 GiB / 715 GiB avail; 42 KiB/s rd, 1.2 KiB/s wr, 44 op/s 2024-03-26T16:59:12.711 INFO:tasks.workunit.client.3.smithi157.stdout:Adding namespace 6 to nqn.2016-06.io.spdk:cnode1, load balancing group 1: Successful 2024-03-26T16:59:13.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:12 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:12] INFO grpc.py:843: Received request to add a namespace to nqn.2016-06.io.spdk:cnode1, context: 2024-03-26T16:59:13.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:12 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:12] INFO grpc.py:299: Received request to create bdev bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9 from mypool/myimage6 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-26T16:59:13.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:12 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [2024-03-26 16:59:12.697129] bdev_rbd.c:1278:bdev_rbd_create: *NOTICE*: Add bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9 rbd disk to lun 2024-03-26T16:59:13.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:12 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:12] INFO grpc.py:338: bdev_rbd_create: bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9, cluster_name cluster_context_1_0 2024-03-26T16:59:13.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:12 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:12] INFO grpc.py:709: Received request to add bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9 to nqn.2016-06.io.spdk:cnode1 with ANA group id 1 using UUID c4744537-f8b3-4b20-8574-5fcd7b0891e9 2024-03-26T16:59:13.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:12 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:12] INFO grpc.py:732: subsystem_add_ns: 6 2024-03-26T16:59:13.056 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:12 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:12] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:59:13.056 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:12 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:12] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}] 2024-03-26T16:59:13.056 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:12 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:12] INFO grpc.py:843: Received request to add a namespace using NSID 6 and UUID c4744537-f8b3-4b20-8574-5fcd7b0891e9 to nqn.2016-06.io.spdk:cnode1, context: None 2024-03-26T16:59:13.056 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:12 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:12] INFO grpc.py:299: Received request to create bdev bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9 from mypool/myimage6 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-26T16:59:13.056 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:12 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [2024-03-26 16:59:12.719708] bdev_rbd.c:1278:bdev_rbd_create: *NOTICE*: Add bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9 rbd disk to lun 2024-03-26T16:59:13.056 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:12 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:12] INFO grpc.py:338: bdev_rbd_create: bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9, cluster_name cluster_context_1_0 2024-03-26T16:59:13.056 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:12 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:12] INFO grpc.py:709: Received request to add bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9 to nqn.2016-06.io.spdk:cnode1 with ANA group id 1 using NSID 6 and UUID c4744537-f8b3-4b20-8574-5fcd7b0891e9 2024-03-26T16:59:13.056 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:12 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:12] INFO grpc.py:732: subsystem_add_ns: 6 2024-03-26T16:59:13.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:12 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:12] INFO grpc.py:843: Received request to add a namespace using NSID 6 and UUID c4744537-f8b3-4b20-8574-5fcd7b0891e9 to nqn.2016-06.io.spdk:cnode1, context: None 2024-03-26T16:59:13.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:12 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:12] INFO grpc.py:299: Received request to create bdev bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9 from mypool/myimage6 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-26T16:59:13.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:12 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [2024-03-26 16:59:12.722609] bdev_rbd.c:1278:bdev_rbd_create: *NOTICE*: Add bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9 rbd disk to lun 2024-03-26T16:59:13.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:12 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:12] INFO grpc.py:338: bdev_rbd_create: bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9, cluster_name cluster_context_1_0 2024-03-26T16:59:13.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:12 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:12] INFO grpc.py:709: Received request to add bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9 to nqn.2016-06.io.spdk:cnode1 with ANA group id 1 using NSID 6 and UUID c4744537-f8b3-4b20-8574-5fcd7b0891e9 2024-03-26T16:59:13.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:12 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:12] INFO grpc.py:732: subsystem_add_ns: 6 2024-03-26T16:59:13.518 INFO:tasks.workunit.client.3.smithi157.stderr:+ (( image_index++ )) 2024-03-26T16:59:13.518 INFO:tasks.workunit.client.3.smithi157.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2024-03-26T16:59:13.519 INFO:tasks.workunit.client.3.smithi157.stderr:+ image=myimage7 2024-03-26T16:59:13.519 INFO:tasks.workunit.client.3.smithi157.stderr:+ sudo podman run -it quay.io/barakda1/nvmeof-cli:qe_ceph_devel_21e59b2 --server-address 172.21.15.44 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode1 --rbd-pool mypool --rbd-image myimage7 --load-balancing-group 2 2024-03-26T16:59:13.588 INFO:tasks.workunit.client.3.smithi157.stderr:time="2024-03-26T16:59:13Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2024-03-26T16:59:13.765 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:59:13 smithi044 ceph-mon[30624]: Health check update: 2 slow ops, oldest one blocked for 48 sec, daemons [mon.b,mon.c] have slow ops. (SLOW_OPS) 2024-03-26T16:59:13.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:13 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:13] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:59:13.766 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:13 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:13] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}] 2024-03-26T16:59:13.896 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:59:13 smithi149 ceph-mon[34678]: Health check update: 2 slow ops, oldest one blocked for 48 sec, daemons [mon.b,mon.c] have slow ops. (SLOW_OPS) 2024-03-26T16:59:13.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:13 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:13] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:59:13.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:13 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:13] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}] 2024-03-26T16:59:14.055 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:59:13 smithi064 ceph-mon[34420]: Health check update: 2 slow ops, oldest one blocked for 48 sec, daemons [mon.b,mon.c] have slow ops. (SLOW_OPS) 2024-03-26T16:59:14.285 INFO:tasks.workunit.client.3.smithi157.stdout:Adding namespace 7 to nqn.2016-06.io.spdk:cnode1, load balancing group 2: Successful 2024-03-26T16:59:14.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:14 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:14] INFO grpc.py:843: Received request to add a namespace to nqn.2016-06.io.spdk:cnode1, context: 2024-03-26T16:59:14.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:14 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:14] INFO grpc.py:299: Received request to create bdev bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786 from mypool/myimage7 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-26T16:59:14.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:14 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [2024-03-26 16:59:14.271220] bdev_rbd.c:1278:bdev_rbd_create: *NOTICE*: Add bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786 rbd disk to lun 2024-03-26T16:59:14.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:14 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:14] INFO grpc.py:338: bdev_rbd_create: bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786, cluster_name cluster_context_2_0 2024-03-26T16:59:14.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:14 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:14] INFO grpc.py:709: Received request to add bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786 to nqn.2016-06.io.spdk:cnode1 with ANA group id 2 using UUID 0fbd24ec-f925-4370-b9a5-5f94bccb6786 2024-03-26T16:59:14.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:14 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:14] INFO grpc.py:732: subsystem_add_ns: 7 2024-03-26T16:59:14.555 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:14 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:14] INFO grpc.py:843: Received request to add a namespace using NSID 7 and UUID 0fbd24ec-f925-4370-b9a5-5f94bccb6786 to nqn.2016-06.io.spdk:cnode1, context: None 2024-03-26T16:59:14.555 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:14 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:14] INFO grpc.py:299: Received request to create bdev bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786 from mypool/myimage7 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-26T16:59:14.556 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:14 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [2024-03-26 16:59:14.297926] bdev_rbd.c:1278:bdev_rbd_create: *NOTICE*: Add bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786 rbd disk to lun 2024-03-26T16:59:14.556 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:14 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:14] INFO grpc.py:338: bdev_rbd_create: bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786, cluster_name cluster_context_2_0 2024-03-26T16:59:14.556 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:14 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:14] INFO grpc.py:709: Received request to add bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786 to nqn.2016-06.io.spdk:cnode1 with ANA group id 2 using NSID 7 and UUID 0fbd24ec-f925-4370-b9a5-5f94bccb6786 2024-03-26T16:59:14.556 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:14 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:14] INFO grpc.py:732: subsystem_add_ns: 7 2024-03-26T16:59:14.588 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:14 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:14] INFO grpc.py:843: Received request to add a namespace using NSID 7 and UUID 0fbd24ec-f925-4370-b9a5-5f94bccb6786 to nqn.2016-06.io.spdk:cnode1, context: None 2024-03-26T16:59:14.589 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:14 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:14] INFO grpc.py:299: Received request to create bdev bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786 from mypool/myimage7 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-26T16:59:14.589 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:14 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [2024-03-26 16:59:14.294766] bdev_rbd.c:1278:bdev_rbd_create: *NOTICE*: Add bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786 rbd disk to lun 2024-03-26T16:59:14.589 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:14 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:14] INFO grpc.py:338: bdev_rbd_create: bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786, cluster_name cluster_context_2_0 2024-03-26T16:59:14.589 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:14 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:14] INFO grpc.py:709: Received request to add bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786 to nqn.2016-06.io.spdk:cnode1 with ANA group id 2 using NSID 7 and UUID 0fbd24ec-f925-4370-b9a5-5f94bccb6786 2024-03-26T16:59:14.589 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:14 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:14] INFO grpc.py:732: subsystem_add_ns: 7 2024-03-26T16:59:14.896 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:59:14 smithi149 ceph-mon[34678]: pgmap v377: 33 pgs: 33 active+clean; 609 KiB data, 227 MiB used, 715 GiB / 715 GiB avail; 62 KiB/s rd, 1.9 KiB/s wr, 63 op/s 2024-03-26T16:59:15.015 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:59:14 smithi044 ceph-mon[30624]: pgmap v377: 33 pgs: 33 active+clean; 609 KiB data, 227 MiB used, 715 GiB / 715 GiB avail; 62 KiB/s rd, 1.9 KiB/s wr, 63 op/s 2024-03-26T16:59:15.055 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:59:14 smithi064 ceph-mon[34420]: pgmap v377: 33 pgs: 33 active+clean; 609 KiB data, 227 MiB used, 715 GiB / 715 GiB avail; 62 KiB/s rd, 1.9 KiB/s wr, 63 op/s 2024-03-26T16:59:15.056 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:14 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:14] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:59:15.056 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:14 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:14] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}] 2024-03-26T16:59:15.129 INFO:tasks.workunit.client.3.smithi157.stderr:+ (( image_index++ )) 2024-03-26T16:59:15.130 INFO:tasks.workunit.client.3.smithi157.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2024-03-26T16:59:15.130 INFO:tasks.workunit.client.3.smithi157.stderr:+ image=myimage8 2024-03-26T16:59:15.130 INFO:tasks.workunit.client.3.smithi157.stderr:+ sudo podman run -it quay.io/barakda1/nvmeof-cli:qe_ceph_devel_21e59b2 --server-address 172.21.15.44 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode1 --rbd-pool mypool --rbd-image myimage8 --load-balancing-group 3 2024-03-26T16:59:15.214 INFO:tasks.workunit.client.3.smithi157.stderr:time="2024-03-26T16:59:15Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2024-03-26T16:59:15.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:59:15 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-b[34416]: 2024-03-26T16:59:15.276+0000 7ff022916700 -1 mon.b@2(peon) e3 get_health_metrics reporting 1 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T16:59:15.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:15 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:15] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:59:15.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:15 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:15] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}] 2024-03-26T16:59:15.923 INFO:tasks.workunit.client.3.smithi157.stdout:Adding namespace 8 to nqn.2016-06.io.spdk:cnode1, load balancing group 3: Successful 2024-03-26T16:59:16.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:15 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:15] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:59:16.147 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:15 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:15] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}] 2024-03-26T16:59:16.147 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:15 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:15] INFO grpc.py:843: Received request to add a namespace using NSID 8 and UUID 082e5959-2b79-418e-99dc-c3195cfa988f to nqn.2016-06.io.spdk:cnode1, context: None 2024-03-26T16:59:16.147 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:15 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:15] INFO grpc.py:299: Received request to create bdev bdev_082e5959-2b79-418e-99dc-c3195cfa988f from mypool/myimage8 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-26T16:59:16.147 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:15 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [2024-03-26 16:59:15.930288] bdev_rbd.c:1278:bdev_rbd_create: *NOTICE*: Add bdev_082e5959-2b79-418e-99dc-c3195cfa988f rbd disk to lun 2024-03-26T16:59:16.147 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:15 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:15] INFO grpc.py:338: bdev_rbd_create: bdev_082e5959-2b79-418e-99dc-c3195cfa988f, cluster_name cluster_context_3_0 2024-03-26T16:59:16.147 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:15 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:15] INFO grpc.py:709: Received request to add bdev_082e5959-2b79-418e-99dc-c3195cfa988f to nqn.2016-06.io.spdk:cnode1 with ANA group id 3 using NSID 8 and UUID 082e5959-2b79-418e-99dc-c3195cfa988f 2024-03-26T16:59:16.147 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:15 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:15] INFO grpc.py:732: subsystem_add_ns: 8 2024-03-26T16:59:16.191 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:15 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:15] INFO grpc.py:843: Received request to add a namespace to nqn.2016-06.io.spdk:cnode1, context: 2024-03-26T16:59:16.191 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:15 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:15] INFO grpc.py:299: Received request to create bdev bdev_082e5959-2b79-418e-99dc-c3195cfa988f from mypool/myimage8 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-26T16:59:16.191 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:15 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [2024-03-26 16:59:15.907587] bdev_rbd.c:1278:bdev_rbd_create: *NOTICE*: Add bdev_082e5959-2b79-418e-99dc-c3195cfa988f rbd disk to lun 2024-03-26T16:59:16.191 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:15 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:15] INFO grpc.py:338: bdev_rbd_create: bdev_082e5959-2b79-418e-99dc-c3195cfa988f, cluster_name cluster_context_3_0 2024-03-26T16:59:16.191 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:15 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:15] INFO grpc.py:709: Received request to add bdev_082e5959-2b79-418e-99dc-c3195cfa988f to nqn.2016-06.io.spdk:cnode1 with ANA group id 3 using UUID 082e5959-2b79-418e-99dc-c3195cfa988f 2024-03-26T16:59:16.191 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:15 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:15] INFO grpc.py:732: subsystem_add_ns: 8 2024-03-26T16:59:16.192 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:15 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:15] INFO grpc.py:843: Received request to add a namespace using NSID 8 and UUID 082e5959-2b79-418e-99dc-c3195cfa988f to nqn.2016-06.io.spdk:cnode1, context: None 2024-03-26T16:59:16.192 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:15 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:15] INFO grpc.py:299: Received request to create bdev bdev_082e5959-2b79-418e-99dc-c3195cfa988f from mypool/myimage8 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-26T16:59:16.192 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:15 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [2024-03-26 16:59:15.934289] bdev_rbd.c:1278:bdev_rbd_create: *NOTICE*: Add bdev_082e5959-2b79-418e-99dc-c3195cfa988f rbd disk to lun 2024-03-26T16:59:16.192 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:15 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:15] INFO grpc.py:338: bdev_rbd_create: bdev_082e5959-2b79-418e-99dc-c3195cfa988f, cluster_name cluster_context_3_0 2024-03-26T16:59:16.192 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:15 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:15] INFO grpc.py:709: Received request to add bdev_082e5959-2b79-418e-99dc-c3195cfa988f to nqn.2016-06.io.spdk:cnode1 with ANA group id 3 using NSID 8 and UUID 082e5959-2b79-418e-99dc-c3195cfa988f 2024-03-26T16:59:16.192 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:15 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:15] INFO grpc.py:732: subsystem_add_ns: 8 2024-03-26T16:59:16.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:59:16 smithi044 ceph-mon[30624]: pgmap v378: 33 pgs: 33 active+clean; 609 KiB data, 227 MiB used, 715 GiB / 715 GiB avail; 56 KiB/s rd, 1.4 KiB/s wr, 59 op/s 2024-03-26T16:59:16.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:59:16 smithi064 ceph-mon[34420]: pgmap v378: 33 pgs: 33 active+clean; 609 KiB data, 227 MiB used, 715 GiB / 715 GiB avail; 56 KiB/s rd, 1.4 KiB/s wr, 59 op/s 2024-03-26T16:59:16.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:59:16 smithi149 ceph-mon[34678]: pgmap v378: 33 pgs: 33 active+clean; 609 KiB data, 227 MiB used, 715 GiB / 715 GiB avail; 56 KiB/s rd, 1.4 KiB/s wr, 59 op/s 2024-03-26T16:59:16.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:59:16 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 2024-03-26T16:59:16.202+0000 7fa707a55700 -1 mon.c@1(peon) e3 get_health_metrics reporting 1 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T16:59:16.755 INFO:tasks.workunit.client.3.smithi157.stderr:+ (( image_index++ )) 2024-03-26T16:59:16.755 INFO:tasks.workunit.client.3.smithi157.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2024-03-26T16:59:16.755 INFO:tasks.workunit.client.3.smithi157.stderr:+ image=myimage9 2024-03-26T16:59:16.755 INFO:tasks.workunit.client.3.smithi157.stderr:+ sudo podman run -it quay.io/barakda1/nvmeof-cli:qe_ceph_devel_21e59b2 --server-address 172.21.15.44 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode1 --rbd-pool mypool --rbd-image myimage9 --load-balancing-group 1 2024-03-26T16:59:16.844 INFO:tasks.workunit.client.3.smithi157.stderr:time="2024-03-26T16:59:16Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2024-03-26T16:59:17.055 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:16 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:16] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:59:17.055 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:16 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:16] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}] 2024-03-26T16:59:17.590 INFO:tasks.workunit.client.3.smithi157.stdout:Adding namespace 9 to nqn.2016-06.io.spdk:cnode1, load balancing group 1: Successful 2024-03-26T16:59:17.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:17 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:17] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:59:17.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:17 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:17] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}] 2024-03-26T16:59:17.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:17 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:17] INFO grpc.py:843: Received request to add a namespace to nqn.2016-06.io.spdk:cnode1, context: 2024-03-26T16:59:17.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:17 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:17] INFO grpc.py:299: Received request to create bdev bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c from mypool/myimage9 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-26T16:59:17.766 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:17 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [2024-03-26 16:59:17.575858] bdev_rbd.c:1278:bdev_rbd_create: *NOTICE*: Add bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c rbd disk to lun 2024-03-26T16:59:17.766 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:17 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:17] INFO grpc.py:338: bdev_rbd_create: bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c, cluster_name cluster_context_1_0 2024-03-26T16:59:17.766 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:17 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:17] INFO grpc.py:709: Received request to add bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c to nqn.2016-06.io.spdk:cnode1 with ANA group id 1 using UUID 534ef0bb-59d3-439a-b8d0-c3542ab84f6c 2024-03-26T16:59:17.766 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:17 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:17] INFO grpc.py:732: subsystem_add_ns: 9 2024-03-26T16:59:17.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:17 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:17] INFO grpc.py:843: Received request to add a namespace using NSID 9 and UUID 534ef0bb-59d3-439a-b8d0-c3542ab84f6c to nqn.2016-06.io.spdk:cnode1, context: None 2024-03-26T16:59:17.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:17 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:17] INFO grpc.py:299: Received request to create bdev bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c from mypool/myimage9 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-26T16:59:17.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:17 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [2024-03-26 16:59:17.600421] bdev_rbd.c:1278:bdev_rbd_create: *NOTICE*: Add bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c rbd disk to lun 2024-03-26T16:59:17.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:17 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:17] INFO grpc.py:338: bdev_rbd_create: bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c, cluster_name cluster_context_1_0 2024-03-26T16:59:17.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:17 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:17] INFO grpc.py:709: Received request to add bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c to nqn.2016-06.io.spdk:cnode1 with ANA group id 1 using NSID 9 and UUID 534ef0bb-59d3-439a-b8d0-c3542ab84f6c 2024-03-26T16:59:17.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:17 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:17] INFO grpc.py:732: subsystem_add_ns: 9 2024-03-26T16:59:17.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:17 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:17] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:59:17.897 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:17 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:17] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}] 2024-03-26T16:59:18.055 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:17 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:17] INFO grpc.py:843: Received request to add a namespace using NSID 9 and UUID 534ef0bb-59d3-439a-b8d0-c3542ab84f6c to nqn.2016-06.io.spdk:cnode1, context: None 2024-03-26T16:59:18.055 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:17 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:17] INFO grpc.py:299: Received request to create bdev bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c from mypool/myimage9 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-26T16:59:18.056 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:17 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [2024-03-26 16:59:17.599575] bdev_rbd.c:1278:bdev_rbd_create: *NOTICE*: Add bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c rbd disk to lun 2024-03-26T16:59:18.056 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:17 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:17] INFO grpc.py:338: bdev_rbd_create: bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c, cluster_name cluster_context_1_0 2024-03-26T16:59:18.056 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:17 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:17] INFO grpc.py:709: Received request to add bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c to nqn.2016-06.io.spdk:cnode1 with ANA group id 1 using NSID 9 and UUID 534ef0bb-59d3-439a-b8d0-c3542ab84f6c 2024-03-26T16:59:18.056 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:17 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:17] INFO grpc.py:732: subsystem_add_ns: 9 2024-03-26T16:59:18.423 INFO:tasks.workunit.client.3.smithi157.stderr:+ (( image_index++ )) 2024-03-26T16:59:18.423 INFO:tasks.workunit.client.3.smithi157.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2024-03-26T16:59:18.423 INFO:tasks.workunit.client.3.smithi157.stderr:+ image=myimage10 2024-03-26T16:59:18.423 INFO:tasks.workunit.client.3.smithi157.stderr:+ sudo podman run -it quay.io/barakda1/nvmeof-cli:qe_ceph_devel_21e59b2 --server-address 172.21.15.44 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode1 --rbd-pool mypool --rbd-image myimage10 --load-balancing-group 2 2024-03-26T16:59:18.511 INFO:tasks.workunit.client.3.smithi157.stderr:time="2024-03-26T16:59:18Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2024-03-26T16:59:18.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:59:18 smithi044 ceph-mon[30624]: pgmap v379: 33 pgs: 33 active+clean; 609 KiB data, 227 MiB used, 715 GiB / 715 GiB avail; 66 KiB/s rd, 1.6 KiB/s wr, 72 op/s 2024-03-26T16:59:18.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:59:18 smithi064 ceph-mon[34420]: pgmap v379: 33 pgs: 33 active+clean; 609 KiB data, 227 MiB used, 715 GiB / 715 GiB avail; 66 KiB/s rd, 1.6 KiB/s wr, 72 op/s 2024-03-26T16:59:18.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:59:18 smithi149 ceph-mon[34678]: pgmap v379: 33 pgs: 33 active+clean; 609 KiB data, 227 MiB used, 715 GiB / 715 GiB avail; 66 KiB/s rd, 1.6 KiB/s wr, 72 op/s 2024-03-26T16:59:19.055 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:18 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:18] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:59:19.056 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:18 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:18] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}] 2024-03-26T16:59:19.215 INFO:tasks.workunit.client.3.smithi157.stdout:Adding namespace 10 to nqn.2016-06.io.spdk:cnode1, load balancing group 2: Successful 2024-03-26T16:59:19.466 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:59:19 smithi044 ceph-mon[30624]: Health check update: 2 slow ops, oldest one blocked for 53 sec, daemons [mon.b,mon.c] have slow ops. (SLOW_OPS) 2024-03-26T16:59:19.466 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:19 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:19] INFO grpc.py:843: Received request to add a namespace to nqn.2016-06.io.spdk:cnode1, context: 2024-03-26T16:59:19.466 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:19 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:19] INFO grpc.py:299: Received request to create bdev bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a from mypool/myimage10 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-26T16:59:19.467 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:19 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [2024-03-26 16:59:19.201530] bdev_rbd.c:1278:bdev_rbd_create: *NOTICE*: Add bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a rbd disk to lun 2024-03-26T16:59:19.467 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:19 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:19] INFO grpc.py:338: bdev_rbd_create: bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a, cluster_name cluster_context_2_0 2024-03-26T16:59:19.467 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:19 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:19] INFO grpc.py:709: Received request to add bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a to nqn.2016-06.io.spdk:cnode1 with ANA group id 2 using UUID a8f5f33b-b8e1-47df-85bb-973d3baca17a 2024-03-26T16:59:19.467 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:19 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:19] INFO grpc.py:732: subsystem_add_ns: 10 2024-03-26T16:59:19.467 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:19 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:19] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:59:19.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:59:19 smithi064 ceph-mon[34420]: Health check update: 2 slow ops, oldest one blocked for 53 sec, daemons [mon.b,mon.c] have slow ops. (SLOW_OPS) 2024-03-26T16:59:19.556 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:19 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:19] INFO grpc.py:843: Received request to add a namespace using NSID 10 and UUID a8f5f33b-b8e1-47df-85bb-973d3baca17a to nqn.2016-06.io.spdk:cnode1, context: None 2024-03-26T16:59:19.556 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:19 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:19] INFO grpc.py:299: Received request to create bdev bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a from mypool/myimage10 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-26T16:59:19.556 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:19 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [2024-03-26 16:59:19.224946] bdev_rbd.c:1278:bdev_rbd_create: *NOTICE*: Add bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a rbd disk to lun 2024-03-26T16:59:19.556 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:19 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:19] INFO grpc.py:338: bdev_rbd_create: bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a, cluster_name cluster_context_2_0 2024-03-26T16:59:19.556 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:19 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:19] INFO grpc.py:709: Received request to add bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a to nqn.2016-06.io.spdk:cnode1 with ANA group id 2 using NSID 10 and UUID a8f5f33b-b8e1-47df-85bb-973d3baca17a 2024-03-26T16:59:19.556 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:19 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:19] INFO grpc.py:732: subsystem_add_ns: 10 2024-03-26T16:59:19.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:59:19 smithi149 ceph-mon[34678]: Health check update: 2 slow ops, oldest one blocked for 53 sec, daemons [mon.b,mon.c] have slow ops. (SLOW_OPS) 2024-03-26T16:59:19.646 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:19 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:19] INFO grpc.py:843: Received request to add a namespace using NSID 10 and UUID a8f5f33b-b8e1-47df-85bb-973d3baca17a to nqn.2016-06.io.spdk:cnode1, context: None 2024-03-26T16:59:19.646 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:19 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:19] INFO grpc.py:299: Received request to create bdev bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a from mypool/myimage10 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-26T16:59:19.646 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:19 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [2024-03-26 16:59:19.223872] bdev_rbd.c:1278:bdev_rbd_create: *NOTICE*: Add bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a rbd disk to lun 2024-03-26T16:59:19.646 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:19 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:19] INFO grpc.py:338: bdev_rbd_create: bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a, cluster_name cluster_context_2_0 2024-03-26T16:59:19.646 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:19 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:19] INFO grpc.py:709: Received request to add bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a to nqn.2016-06.io.spdk:cnode1 with ANA group id 2 using NSID 10 and UUID a8f5f33b-b8e1-47df-85bb-973d3baca17a 2024-03-26T16:59:19.647 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:19 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:19] INFO grpc.py:732: subsystem_add_ns: 10 2024-03-26T16:59:19.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:19 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:19] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}] 2024-03-26T16:59:20.033 INFO:tasks.workunit.client.3.smithi157.stderr:+ (( image_index++ )) 2024-03-26T16:59:20.033 INFO:tasks.workunit.client.3.smithi157.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2024-03-26T16:59:20.033 INFO:tasks.workunit.client.3.smithi157.stderr:+ image=myimage11 2024-03-26T16:59:20.033 INFO:tasks.workunit.client.3.smithi157.stderr:+ sudo podman run -it quay.io/barakda1/nvmeof-cli:qe_ceph_devel_21e59b2 --server-address 172.21.15.44 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode1 --rbd-pool mypool --rbd-image myimage11 --load-balancing-group 3 2024-03-26T16:59:20.119 INFO:tasks.workunit.client.3.smithi157.stderr:time="2024-03-26T16:59:20Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2024-03-26T16:59:20.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:19 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:19] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:59:20.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:19 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:19] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}] 2024-03-26T16:59:20.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:59:20 smithi044 ceph-mon[30624]: pgmap v380: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 78 KiB/s rd, 2.1 KiB/s wr, 77 op/s 2024-03-26T16:59:20.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:59:20 smithi064 ceph-mon[34420]: pgmap v380: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 78 KiB/s rd, 2.1 KiB/s wr, 77 op/s 2024-03-26T16:59:20.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:59:20 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-b[34416]: 2024-03-26T16:59:20.276+0000 7ff022916700 -1 mon.b@2(peon) e3 get_health_metrics reporting 1 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T16:59:20.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:59:20 smithi149 ceph-mon[34678]: pgmap v380: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 78 KiB/s rd, 2.1 KiB/s wr, 77 op/s 2024-03-26T16:59:20.838 INFO:tasks.workunit.client.3.smithi157.stdout:Adding namespace 11 to nqn.2016-06.io.spdk:cnode1, load balancing group 3: Successful 2024-03-26T16:59:21.056 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:20 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:20] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:59:21.056 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:20 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:20] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}] 2024-03-26T16:59:21.056 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:20 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:20] INFO grpc.py:843: Received request to add a namespace using NSID 11 and UUID ba551130-b365-468c-9ac2-2c5c81e90eda to nqn.2016-06.io.spdk:cnode1, context: None 2024-03-26T16:59:21.056 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:20 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:20] INFO grpc.py:299: Received request to create bdev bdev_ba551130-b365-468c-9ac2-2c5c81e90eda from mypool/myimage11 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-26T16:59:21.056 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:20 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [2024-03-26 16:59:20.849900] bdev_rbd.c:1278:bdev_rbd_create: *NOTICE*: Add bdev_ba551130-b365-468c-9ac2-2c5c81e90eda rbd disk to lun 2024-03-26T16:59:21.056 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:20 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:20] INFO grpc.py:338: bdev_rbd_create: bdev_ba551130-b365-468c-9ac2-2c5c81e90eda, cluster_name cluster_context_3_0 2024-03-26T16:59:21.056 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:20 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:20] INFO grpc.py:709: Received request to add bdev_ba551130-b365-468c-9ac2-2c5c81e90eda to nqn.2016-06.io.spdk:cnode1 with ANA group id 3 using NSID 11 and UUID ba551130-b365-468c-9ac2-2c5c81e90eda 2024-03-26T16:59:21.056 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:20 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:20] INFO grpc.py:732: subsystem_add_ns: 11 2024-03-26T16:59:21.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:20 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:20] INFO grpc.py:843: Received request to add a namespace using NSID 11 and UUID ba551130-b365-468c-9ac2-2c5c81e90eda to nqn.2016-06.io.spdk:cnode1, context: None 2024-03-26T16:59:21.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:20 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:20] INFO grpc.py:299: Received request to create bdev bdev_ba551130-b365-468c-9ac2-2c5c81e90eda from mypool/myimage11 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-26T16:59:21.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:20 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [2024-03-26 16:59:20.847402] bdev_rbd.c:1278:bdev_rbd_create: *NOTICE*: Add bdev_ba551130-b365-468c-9ac2-2c5c81e90eda rbd disk to lun 2024-03-26T16:59:21.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:20 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:20] INFO grpc.py:338: bdev_rbd_create: bdev_ba551130-b365-468c-9ac2-2c5c81e90eda, cluster_name cluster_context_3_0 2024-03-26T16:59:21.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:20 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:20] INFO grpc.py:709: Received request to add bdev_ba551130-b365-468c-9ac2-2c5c81e90eda to nqn.2016-06.io.spdk:cnode1 with ANA group id 3 using NSID 11 and UUID ba551130-b365-468c-9ac2-2c5c81e90eda 2024-03-26T16:59:21.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:20 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:20] INFO grpc.py:732: subsystem_add_ns: 11 2024-03-26T16:59:21.265 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:20 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:20] INFO grpc.py:843: Received request to add a namespace to nqn.2016-06.io.spdk:cnode1, context: 2024-03-26T16:59:21.265 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:20 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:20] INFO grpc.py:299: Received request to create bdev bdev_ba551130-b365-468c-9ac2-2c5c81e90eda from mypool/myimage11 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-26T16:59:21.265 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:20 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [2024-03-26 16:59:20.823510] bdev_rbd.c:1278:bdev_rbd_create: *NOTICE*: Add bdev_ba551130-b365-468c-9ac2-2c5c81e90eda rbd disk to lun 2024-03-26T16:59:21.265 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:20 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:20] INFO grpc.py:338: bdev_rbd_create: bdev_ba551130-b365-468c-9ac2-2c5c81e90eda, cluster_name cluster_context_3_0 2024-03-26T16:59:21.265 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:20 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:20] INFO grpc.py:709: Received request to add bdev_ba551130-b365-468c-9ac2-2c5c81e90eda to nqn.2016-06.io.spdk:cnode1 with ANA group id 3 using UUID ba551130-b365-468c-9ac2-2c5c81e90eda 2024-03-26T16:59:21.265 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:20 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:20] INFO grpc.py:732: subsystem_add_ns: 11 2024-03-26T16:59:21.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:59:21 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 2024-03-26T16:59:21.202+0000 7fa707a55700 -1 mon.c@1(peon) e3 get_health_metrics reporting 1 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T16:59:21.651 INFO:tasks.workunit.client.3.smithi157.stderr:+ (( image_index++ )) 2024-03-26T16:59:21.651 INFO:tasks.workunit.client.3.smithi157.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2024-03-26T16:59:21.651 INFO:tasks.workunit.client.3.smithi157.stderr:+ image=myimage12 2024-03-26T16:59:21.651 INFO:tasks.workunit.client.3.smithi157.stderr:+ sudo podman run -it quay.io/barakda1/nvmeof-cli:qe_ceph_devel_21e59b2 --server-address 172.21.15.44 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode1 --rbd-pool mypool --rbd-image myimage12 --load-balancing-group 1 2024-03-26T16:59:21.726 INFO:tasks.workunit.client.3.smithi157.stderr:time="2024-03-26T16:59:21Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2024-03-26T16:59:21.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:21 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:21] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:59:21.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:21 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:21] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}] 2024-03-26T16:59:22.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:21 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:21] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:59:22.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:21 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:21] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}] 2024-03-26T16:59:22.440 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:59:22 smithi044 ceph-mon[30624]: pgmap v381: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 54 KiB/s rd, 1.5 KiB/s wr, 52 op/s 2024-03-26T16:59:22.440 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:22 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:22] INFO grpc.py:843: Received request to add a namespace to nqn.2016-06.io.spdk:cnode1, context: 2024-03-26T16:59:22.440 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:22 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:22] INFO grpc.py:299: Received request to create bdev bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb from mypool/myimage12 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-26T16:59:22.441 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:22 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [2024-03-26 16:59:22.431647] bdev_rbd.c:1278:bdev_rbd_create: *NOTICE*: Add bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb rbd disk to lun 2024-03-26T16:59:22.441 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:22 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:22] INFO grpc.py:338: bdev_rbd_create: bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb, cluster_name cluster_context_1_0 2024-03-26T16:59:22.441 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:22 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:22] INFO grpc.py:709: Received request to add bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb to nqn.2016-06.io.spdk:cnode1 with ANA group id 1 using UUID dc39ff28-61dd-4e08-b69e-0a8559ae9feb 2024-03-26T16:59:22.441 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:22 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:22] INFO grpc.py:732: subsystem_add_ns: 12 2024-03-26T16:59:22.445 INFO:tasks.workunit.client.3.smithi157.stdout:Adding namespace 12 to nqn.2016-06.io.spdk:cnode1, load balancing group 1: Successful 2024-03-26T16:59:22.446 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:59:22 smithi064 ceph-mon[34420]: pgmap v381: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 54 KiB/s rd, 1.5 KiB/s wr, 52 op/s 2024-03-26T16:59:22.446 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:59:22 smithi149 ceph-mon[34678]: pgmap v381: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 54 KiB/s rd, 1.5 KiB/s wr, 52 op/s 2024-03-26T16:59:22.806 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:22 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:22] INFO grpc.py:843: Received request to add a namespace using NSID 12 and UUID dc39ff28-61dd-4e08-b69e-0a8559ae9feb to nqn.2016-06.io.spdk:cnode1, context: None 2024-03-26T16:59:22.806 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:22 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:22] INFO grpc.py:299: Received request to create bdev bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb from mypool/myimage12 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-26T16:59:22.806 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:22 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [2024-03-26 16:59:22.457495] bdev_rbd.c:1278:bdev_rbd_create: *NOTICE*: Add bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb rbd disk to lun 2024-03-26T16:59:22.806 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:22 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:22] INFO grpc.py:338: bdev_rbd_create: bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb, cluster_name cluster_context_1_0 2024-03-26T16:59:22.806 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:22 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:22] INFO grpc.py:709: Received request to add bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb to nqn.2016-06.io.spdk:cnode1 with ANA group id 1 using NSID 12 and UUID dc39ff28-61dd-4e08-b69e-0a8559ae9feb 2024-03-26T16:59:22.806 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:22 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:22] INFO grpc.py:732: subsystem_add_ns: 12 2024-03-26T16:59:22.806 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:22 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:22] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:59:22.806 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:22 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:22] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}] 2024-03-26T16:59:22.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:22 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:22] INFO grpc.py:843: Received request to add a namespace using NSID 12 and UUID dc39ff28-61dd-4e08-b69e-0a8559ae9feb to nqn.2016-06.io.spdk:cnode1, context: None 2024-03-26T16:59:22.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:22 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:22] INFO grpc.py:299: Received request to create bdev bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb from mypool/myimage12 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-26T16:59:22.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:22 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [2024-03-26 16:59:22.455090] bdev_rbd.c:1278:bdev_rbd_create: *NOTICE*: Add bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb rbd disk to lun 2024-03-26T16:59:22.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:22 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:22] INFO grpc.py:338: bdev_rbd_create: bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb, cluster_name cluster_context_1_0 2024-03-26T16:59:22.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:22 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:22] INFO grpc.py:709: Received request to add bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb to nqn.2016-06.io.spdk:cnode1 with ANA group id 1 using NSID 12 and UUID dc39ff28-61dd-4e08-b69e-0a8559ae9feb 2024-03-26T16:59:22.897 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:22 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:22] INFO grpc.py:732: subsystem_add_ns: 12 2024-03-26T16:59:23.311 INFO:tasks.workunit.client.3.smithi157.stderr:+ (( image_index++ )) 2024-03-26T16:59:23.311 INFO:tasks.workunit.client.3.smithi157.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2024-03-26T16:59:23.311 INFO:tasks.workunit.client.3.smithi157.stderr:+ image=myimage13 2024-03-26T16:59:23.311 INFO:tasks.workunit.client.3.smithi157.stderr:+ sudo podman run -it quay.io/barakda1/nvmeof-cli:qe_ceph_devel_21e59b2 --server-address 172.21.15.44 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode1 --rbd-pool mypool --rbd-image myimage13 --load-balancing-group 2 2024-03-26T16:59:23.396 INFO:tasks.workunit.client.3.smithi157.stderr:time="2024-03-26T16:59:23Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2024-03-26T16:59:23.765 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:59:23 smithi044 ceph-mon[30624]: Health check update: 2 slow ops, oldest one blocked for 58 sec, daemons [mon.b,mon.c] have slow ops. (SLOW_OPS) 2024-03-26T16:59:23.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:23 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:23] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:59:23.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:23 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:23] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}] 2024-03-26T16:59:23.896 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:59:23 smithi149 ceph-mon[34678]: Health check update: 2 slow ops, oldest one blocked for 58 sec, daemons [mon.b,mon.c] have slow ops. (SLOW_OPS) 2024-03-26T16:59:23.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:23 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:23] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:59:23.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:23 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:23] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}] 2024-03-26T16:59:24.055 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:59:23 smithi064 ceph-mon[34420]: Health check update: 2 slow ops, oldest one blocked for 58 sec, daemons [mon.b,mon.c] have slow ops. (SLOW_OPS) 2024-03-26T16:59:24.173 INFO:tasks.workunit.client.3.smithi157.stdout:Adding namespace 13 to nqn.2016-06.io.spdk:cnode1, load balancing group 2: Successful 2024-03-26T16:59:24.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:24 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:24] INFO grpc.py:843: Received request to add a namespace to nqn.2016-06.io.spdk:cnode1, context: 2024-03-26T16:59:24.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:24 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:24] INFO grpc.py:299: Received request to create bdev bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17 from mypool/myimage13 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-26T16:59:24.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:24 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [2024-03-26 16:59:24.158812] bdev_rbd.c:1278:bdev_rbd_create: *NOTICE*: Add bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17 rbd disk to lun 2024-03-26T16:59:24.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:24 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:24] INFO grpc.py:338: bdev_rbd_create: bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17, cluster_name cluster_context_2_0 2024-03-26T16:59:24.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:24 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:24] INFO grpc.py:709: Received request to add bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17 to nqn.2016-06.io.spdk:cnode1 with ANA group id 2 using UUID 9e6e9ccd-76f6-452d-b3d7-4bcb00171e17 2024-03-26T16:59:24.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:24 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:24] INFO grpc.py:732: subsystem_add_ns: 13 2024-03-26T16:59:24.555 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:24 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:24] INFO grpc.py:843: Received request to add a namespace using NSID 13 and UUID 9e6e9ccd-76f6-452d-b3d7-4bcb00171e17 to nqn.2016-06.io.spdk:cnode1, context: None 2024-03-26T16:59:24.556 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:24 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:24] INFO grpc.py:299: Received request to create bdev bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17 from mypool/myimage13 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-26T16:59:24.556 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:24 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [2024-03-26 16:59:24.187121] bdev_rbd.c:1278:bdev_rbd_create: *NOTICE*: Add bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17 rbd disk to lun 2024-03-26T16:59:24.556 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:24 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:24] INFO grpc.py:338: bdev_rbd_create: bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17, cluster_name cluster_context_2_0 2024-03-26T16:59:24.556 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:24 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:24] INFO grpc.py:709: Received request to add bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17 to nqn.2016-06.io.spdk:cnode1 with ANA group id 2 using NSID 13 and UUID 9e6e9ccd-76f6-452d-b3d7-4bcb00171e17 2024-03-26T16:59:24.556 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:24 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:24] INFO grpc.py:732: subsystem_add_ns: 13 2024-03-26T16:59:24.590 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:24 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:24] INFO grpc.py:843: Received request to add a namespace using NSID 13 and UUID 9e6e9ccd-76f6-452d-b3d7-4bcb00171e17 to nqn.2016-06.io.spdk:cnode1, context: None 2024-03-26T16:59:24.590 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:24 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:24] INFO grpc.py:299: Received request to create bdev bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17 from mypool/myimage13 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-26T16:59:24.590 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:24 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [2024-03-26 16:59:24.184124] bdev_rbd.c:1278:bdev_rbd_create: *NOTICE*: Add bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17 rbd disk to lun 2024-03-26T16:59:24.590 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:24 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:24] INFO grpc.py:338: bdev_rbd_create: bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17, cluster_name cluster_context_2_0 2024-03-26T16:59:24.591 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:24 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:24] INFO grpc.py:709: Received request to add bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17 to nqn.2016-06.io.spdk:cnode1 with ANA group id 2 using NSID 13 and UUID 9e6e9ccd-76f6-452d-b3d7-4bcb00171e17 2024-03-26T16:59:24.591 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:24 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:24] INFO grpc.py:732: subsystem_add_ns: 13 2024-03-26T16:59:24.896 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:59:24 smithi149 ceph-mon[34678]: pgmap v382: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 78 KiB/s rd, 2.2 KiB/s wr, 72 op/s 2024-03-26T16:59:24.996 INFO:tasks.workunit.client.3.smithi157.stderr:+ (( image_index++ )) 2024-03-26T16:59:24.996 INFO:tasks.workunit.client.3.smithi157.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2024-03-26T16:59:24.996 INFO:tasks.workunit.client.3.smithi157.stderr:+ image=myimage14 2024-03-26T16:59:24.996 INFO:tasks.workunit.client.3.smithi157.stderr:+ sudo podman run -it quay.io/barakda1/nvmeof-cli:qe_ceph_devel_21e59b2 --server-address 172.21.15.44 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode1 --rbd-pool mypool --rbd-image myimage14 --load-balancing-group 3 2024-03-26T16:59:25.015 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:59:24 smithi044 ceph-mon[30624]: pgmap v382: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 78 KiB/s rd, 2.2 KiB/s wr, 72 op/s 2024-03-26T16:59:25.055 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:59:24 smithi064 ceph-mon[34420]: pgmap v382: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 78 KiB/s rd, 2.2 KiB/s wr, 72 op/s 2024-03-26T16:59:25.056 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:24 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:24] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:59:25.056 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:24 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:24] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}] 2024-03-26T16:59:25.078 INFO:tasks.workunit.client.3.smithi157.stderr:time="2024-03-26T16:59:25Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2024-03-26T16:59:25.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:59:25 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-b[34416]: 2024-03-26T16:59:25.277+0000 7ff022916700 -1 mon.b@2(peon) e3 get_health_metrics reporting 1 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T16:59:25.766 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:25] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:59:25.766 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:25] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}] 2024-03-26T16:59:25.806 INFO:tasks.workunit.client.3.smithi157.stdout:Adding namespace 14 to nqn.2016-06.io.spdk:cnode1, load balancing group 3: Successful 2024-03-26T16:59:26.055 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:25 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:25] INFO grpc.py:843: Received request to add a namespace using NSID 14 and UUID 89d6e70d-b953-4551-9256-1dd8e30b2d0f to nqn.2016-06.io.spdk:cnode1, context: None 2024-03-26T16:59:26.056 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:25 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:25] INFO grpc.py:299: Received request to create bdev bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f from mypool/myimage14 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-26T16:59:26.056 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:25 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [2024-03-26 16:59:25.816104] bdev_rbd.c:1278:bdev_rbd_create: *NOTICE*: Add bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f rbd disk to lun 2024-03-26T16:59:26.056 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:25 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:25] INFO grpc.py:338: bdev_rbd_create: bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f, cluster_name cluster_context_3_0 2024-03-26T16:59:26.056 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:25 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:25] INFO grpc.py:709: Received request to add bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f to nqn.2016-06.io.spdk:cnode1 with ANA group id 3 using NSID 14 and UUID 89d6e70d-b953-4551-9256-1dd8e30b2d0f 2024-03-26T16:59:26.056 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:25 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:25] INFO grpc.py:732: subsystem_add_ns: 14 2024-03-26T16:59:26.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:25 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:25] INFO grpc.py:843: Received request to add a namespace using NSID 14 and UUID 89d6e70d-b953-4551-9256-1dd8e30b2d0f to nqn.2016-06.io.spdk:cnode1, context: None 2024-03-26T16:59:26.147 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:25 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:25] INFO grpc.py:299: Received request to create bdev bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f from mypool/myimage14 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-26T16:59:26.147 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:25 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [2024-03-26 16:59:25.812137] bdev_rbd.c:1278:bdev_rbd_create: *NOTICE*: Add bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f rbd disk to lun 2024-03-26T16:59:26.147 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:25 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:25] INFO grpc.py:338: bdev_rbd_create: bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f, cluster_name cluster_context_3_0 2024-03-26T16:59:26.147 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:25 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:25] INFO grpc.py:709: Received request to add bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f to nqn.2016-06.io.spdk:cnode1 with ANA group id 3 using NSID 14 and UUID 89d6e70d-b953-4551-9256-1dd8e30b2d0f 2024-03-26T16:59:26.147 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:25 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:25] INFO grpc.py:732: subsystem_add_ns: 14 2024-03-26T16:59:26.147 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:25 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:25] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:59:26.147 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:25 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:25] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}] 2024-03-26T16:59:26.189 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:25] INFO grpc.py:843: Received request to add a namespace to nqn.2016-06.io.spdk:cnode1, context: 2024-03-26T16:59:26.190 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:25] INFO grpc.py:299: Received request to create bdev bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f from mypool/myimage14 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-26T16:59:26.190 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [2024-03-26 16:59:25.789248] bdev_rbd.c:1278:bdev_rbd_create: *NOTICE*: Add bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f rbd disk to lun 2024-03-26T16:59:26.190 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:25] INFO grpc.py:338: bdev_rbd_create: bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f, cluster_name cluster_context_3_0 2024-03-26T16:59:26.190 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:25] INFO grpc.py:709: Received request to add bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f to nqn.2016-06.io.spdk:cnode1 with ANA group id 3 using UUID 89d6e70d-b953-4551-9256-1dd8e30b2d0f 2024-03-26T16:59:26.190 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:25] INFO grpc.py:732: subsystem_add_ns: 14 2024-03-26T16:59:26.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:59:26 smithi044 ceph-mon[30624]: pgmap v383: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 64 KiB/s rd, 1.6 KiB/s wr, 61 op/s 2024-03-26T16:59:26.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:59:26 smithi064 ceph-mon[34420]: pgmap v383: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 64 KiB/s rd, 1.6 KiB/s wr, 61 op/s 2024-03-26T16:59:26.631 INFO:tasks.workunit.client.3.smithi157.stderr:+ (( image_index++ )) 2024-03-26T16:59:26.631 INFO:tasks.workunit.client.3.smithi157.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2024-03-26T16:59:26.631 INFO:tasks.workunit.client.3.smithi157.stderr:+ image=myimage15 2024-03-26T16:59:26.631 INFO:tasks.workunit.client.3.smithi157.stderr:+ sudo podman run -it quay.io/barakda1/nvmeof-cli:qe_ceph_devel_21e59b2 --server-address 172.21.15.44 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode1 --rbd-pool mypool --rbd-image myimage15 --load-balancing-group 1 2024-03-26T16:59:26.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:59:26 smithi149 ceph-mon[34678]: pgmap v383: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 64 KiB/s rd, 1.6 KiB/s wr, 61 op/s 2024-03-26T16:59:26.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:59:26 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 2024-03-26T16:59:26.202+0000 7fa707a55700 -1 mon.c@1(peon) e3 get_health_metrics reporting 1 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T16:59:26.710 INFO:tasks.workunit.client.3.smithi157.stderr:time="2024-03-26T16:59:26Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2024-03-26T16:59:27.055 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:26 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:26] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:59:27.056 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:26 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:26] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}] 2024-03-26T16:59:27.428 INFO:tasks.workunit.client.3.smithi157.stdout:Adding namespace 15 to nqn.2016-06.io.spdk:cnode1, load balancing group 1: Successful 2024-03-26T16:59:27.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:27] INFO grpc.py:843: Received request to add a namespace to nqn.2016-06.io.spdk:cnode1, context: 2024-03-26T16:59:27.766 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:27] INFO grpc.py:299: Received request to create bdev bdev_48c15cff-e791-4341-9256-88cfb39f6693 from mypool/myimage15 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-26T16:59:27.766 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [2024-03-26 16:59:27.412984] bdev_rbd.c:1278:bdev_rbd_create: *NOTICE*: Add bdev_48c15cff-e791-4341-9256-88cfb39f6693 rbd disk to lun 2024-03-26T16:59:27.766 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:27] INFO grpc.py:338: bdev_rbd_create: bdev_48c15cff-e791-4341-9256-88cfb39f6693, cluster_name cluster_context_1_0 2024-03-26T16:59:27.766 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:27] INFO grpc.py:709: Received request to add bdev_48c15cff-e791-4341-9256-88cfb39f6693 to nqn.2016-06.io.spdk:cnode1 with ANA group id 1 using UUID 48c15cff-e791-4341-9256-88cfb39f6693 2024-03-26T16:59:27.766 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:27] INFO grpc.py:732: subsystem_add_ns: 15 2024-03-26T16:59:27.766 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:27] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:59:27.766 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:27] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}] 2024-03-26T16:59:27.806 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:27 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:27] INFO grpc.py:843: Received request to add a namespace using NSID 15 and UUID 48c15cff-e791-4341-9256-88cfb39f6693 to nqn.2016-06.io.spdk:cnode1, context: None 2024-03-26T16:59:27.806 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:27 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:27] INFO grpc.py:299: Received request to create bdev bdev_48c15cff-e791-4341-9256-88cfb39f6693 from mypool/myimage15 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-26T16:59:27.806 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:27 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [2024-03-26 16:59:27.440064] bdev_rbd.c:1278:bdev_rbd_create: *NOTICE*: Add bdev_48c15cff-e791-4341-9256-88cfb39f6693 rbd disk to lun 2024-03-26T16:59:27.806 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:27 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:27] INFO grpc.py:338: bdev_rbd_create: bdev_48c15cff-e791-4341-9256-88cfb39f6693, cluster_name cluster_context_1_0 2024-03-26T16:59:27.806 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:27 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:27] INFO grpc.py:709: Received request to add bdev_48c15cff-e791-4341-9256-88cfb39f6693 to nqn.2016-06.io.spdk:cnode1 with ANA group id 1 using NSID 15 and UUID 48c15cff-e791-4341-9256-88cfb39f6693 2024-03-26T16:59:27.806 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:27 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:27] INFO grpc.py:732: subsystem_add_ns: 15 2024-03-26T16:59:27.839 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:27 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:27] INFO grpc.py:843: Received request to add a namespace using NSID 15 and UUID 48c15cff-e791-4341-9256-88cfb39f6693 to nqn.2016-06.io.spdk:cnode1, context: None 2024-03-26T16:59:27.839 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:27 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:27] INFO grpc.py:299: Received request to create bdev bdev_48c15cff-e791-4341-9256-88cfb39f6693 from mypool/myimage15 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-26T16:59:27.839 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:27 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [2024-03-26 16:59:27.436067] bdev_rbd.c:1278:bdev_rbd_create: *NOTICE*: Add bdev_48c15cff-e791-4341-9256-88cfb39f6693 rbd disk to lun 2024-03-26T16:59:27.840 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:27 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:27] INFO grpc.py:338: bdev_rbd_create: bdev_48c15cff-e791-4341-9256-88cfb39f6693, cluster_name cluster_context_1_0 2024-03-26T16:59:27.840 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:27 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:27] INFO grpc.py:709: Received request to add bdev_48c15cff-e791-4341-9256-88cfb39f6693 to nqn.2016-06.io.spdk:cnode1 with ANA group id 1 using NSID 15 and UUID 48c15cff-e791-4341-9256-88cfb39f6693 2024-03-26T16:59:27.840 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:27 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:27] INFO grpc.py:732: subsystem_add_ns: 15 2024-03-26T16:59:27.840 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:27 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:27] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:59:28.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:27 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:27] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}] 2024-03-26T16:59:28.300 INFO:tasks.workunit.client.3.smithi157.stderr:+ (( image_index++ )) 2024-03-26T16:59:28.300 INFO:tasks.workunit.client.3.smithi157.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2024-03-26T16:59:28.300 INFO:tasks.workunit.client.3.smithi157.stderr:+ image=myimage16 2024-03-26T16:59:28.300 INFO:tasks.workunit.client.3.smithi157.stderr:+ sudo podman run -it quay.io/barakda1/nvmeof-cli:qe_ceph_devel_21e59b2 --server-address 172.21.15.44 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode1 --rbd-pool mypool --rbd-image myimage16 --load-balancing-group 2 2024-03-26T16:59:28.374 INFO:tasks.workunit.client.3.smithi157.stderr:time="2024-03-26T16:59:28Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2024-03-26T16:59:28.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:59:28 smithi044 ceph-mon[30624]: pgmap v384: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 64 KiB/s rd, 1.6 KiB/s wr, 62 op/s 2024-03-26T16:59:28.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:59:28 smithi064 ceph-mon[34420]: pgmap v384: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 64 KiB/s rd, 1.6 KiB/s wr, 62 op/s 2024-03-26T16:59:28.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:59:28 smithi149 ceph-mon[34678]: pgmap v384: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 64 KiB/s rd, 1.6 KiB/s wr, 62 op/s 2024-03-26T16:59:29.055 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:28 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:28] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:59:29.056 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:28 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:28] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}] 2024-03-26T16:59:29.069 INFO:tasks.workunit.client.3.smithi157.stdout:Adding namespace 16 to nqn.2016-06.io.spdk:cnode1, load balancing group 2: Successful 2024-03-26T16:59:29.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:59:29 smithi149 ceph-mon[34678]: Health check update: 2 slow ops, oldest one blocked for 63 sec, daemons [mon.b,mon.c] have slow ops. (SLOW_OPS) 2024-03-26T16:59:29.396 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:29 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:29] INFO grpc.py:843: Received request to add a namespace using NSID 16 and UUID 38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47 to nqn.2016-06.io.spdk:cnode1, context: None 2024-03-26T16:59:29.396 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:29 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:29] INFO grpc.py:299: Received request to create bdev bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47 from mypool/myimage16 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-26T16:59:29.397 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:29 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [2024-03-26 16:59:29.079971] bdev_rbd.c:1278:bdev_rbd_create: *NOTICE*: Add bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47 rbd disk to lun 2024-03-26T16:59:29.397 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:29 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:29] INFO grpc.py:338: bdev_rbd_create: bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47, cluster_name cluster_context_2_0 2024-03-26T16:59:29.397 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:29 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:29] INFO grpc.py:709: Received request to add bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47 to nqn.2016-06.io.spdk:cnode1 with ANA group id 2 using NSID 16 and UUID 38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47 2024-03-26T16:59:29.397 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:29 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:29] INFO grpc.py:732: subsystem_add_ns: 16 2024-03-26T16:59:29.512 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:59:29 smithi044 ceph-mon[30624]: Health check update: 2 slow ops, oldest one blocked for 63 sec, daemons [mon.b,mon.c] have slow ops. (SLOW_OPS) 2024-03-26T16:59:29.513 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:29] INFO grpc.py:843: Received request to add a namespace to nqn.2016-06.io.spdk:cnode1, context: 2024-03-26T16:59:29.513 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:29] INFO grpc.py:299: Received request to create bdev bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47 from mypool/myimage16 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-26T16:59:29.513 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [2024-03-26 16:59:29.055126] bdev_rbd.c:1278:bdev_rbd_create: *NOTICE*: Add bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47 rbd disk to lun 2024-03-26T16:59:29.513 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:29] INFO grpc.py:338: bdev_rbd_create: bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47, cluster_name cluster_context_2_0 2024-03-26T16:59:29.513 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:29] INFO grpc.py:709: Received request to add bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47 to nqn.2016-06.io.spdk:cnode1 with ANA group id 2 using UUID 38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47 2024-03-26T16:59:29.513 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:29] INFO grpc.py:732: subsystem_add_ns: 16 2024-03-26T16:59:29.513 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:29] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:59:29.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:59:29 smithi064 ceph-mon[34420]: Health check update: 2 slow ops, oldest one blocked for 63 sec, daemons [mon.b,mon.c] have slow ops. (SLOW_OPS) 2024-03-26T16:59:29.556 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:29 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:29] INFO grpc.py:843: Received request to add a namespace using NSID 16 and UUID 38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47 to nqn.2016-06.io.spdk:cnode1, context: None 2024-03-26T16:59:29.556 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:29 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:29] INFO grpc.py:299: Received request to create bdev bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47 from mypool/myimage16 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-26T16:59:29.556 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:29 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [2024-03-26 16:59:29.081307] bdev_rbd.c:1278:bdev_rbd_create: *NOTICE*: Add bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47 rbd disk to lun 2024-03-26T16:59:29.556 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:29 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:29] INFO grpc.py:338: bdev_rbd_create: bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47, cluster_name cluster_context_2_0 2024-03-26T16:59:29.556 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:29 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:29] INFO grpc.py:709: Received request to add bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47 to nqn.2016-06.io.spdk:cnode1 with ANA group id 2 using NSID 16 and UUID 38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47 2024-03-26T16:59:29.556 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:29 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:29] INFO grpc.py:732: subsystem_add_ns: 16 2024-03-26T16:59:29.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:29] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}] 2024-03-26T16:59:29.968 INFO:tasks.workunit.client.3.smithi157.stderr:+ (( image_index++ )) 2024-03-26T16:59:29.968 INFO:tasks.workunit.client.3.smithi157.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2024-03-26T16:59:29.968 INFO:tasks.workunit.client.3.smithi157.stderr:+ image=myimage17 2024-03-26T16:59:29.968 INFO:tasks.workunit.client.3.smithi157.stderr:+ sudo podman run -it quay.io/barakda1/nvmeof-cli:qe_ceph_devel_21e59b2 --server-address 172.21.15.44 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode1 --rbd-pool mypool --rbd-image myimage17 --load-balancing-group 3 2024-03-26T16:59:30.042 INFO:tasks.workunit.client.3.smithi157.stderr:time="2024-03-26T16:59:30Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2024-03-26T16:59:30.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:29 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:29] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:59:30.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:29 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:29] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}] 2024-03-26T16:59:30.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:59:30 smithi044 ceph-mon[30624]: pgmap v385: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 78 KiB/s rd, 2.1 KiB/s wr, 66 op/s 2024-03-26T16:59:30.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:59:30 smithi064 ceph-mon[34420]: pgmap v385: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 78 KiB/s rd, 2.1 KiB/s wr, 66 op/s 2024-03-26T16:59:30.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:59:30 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-b[34416]: 2024-03-26T16:59:30.277+0000 7ff022916700 -1 mon.b@2(peon) e3 get_health_metrics reporting 1 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T16:59:30.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:59:30 smithi149 ceph-mon[34678]: pgmap v385: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 78 KiB/s rd, 2.1 KiB/s wr, 66 op/s 2024-03-26T16:59:30.775 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:30] INFO grpc.py:843: Received request to add a namespace to nqn.2016-06.io.spdk:cnode1, context: 2024-03-26T16:59:30.775 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:30] INFO grpc.py:299: Received request to create bdev bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a from mypool/myimage17 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-26T16:59:30.775 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [2024-03-26 16:59:30.774810] bdev_rbd.c:1278:bdev_rbd_create: *NOTICE*: Add bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a rbd disk to lun 2024-03-26T16:59:30.791 INFO:tasks.workunit.client.3.smithi157.stdout:Adding namespace 17 to nqn.2016-06.io.spdk:cnode1, load balancing group 3: Successful 2024-03-26T16:59:31.055 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:30 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:30] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:59:31.056 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:30 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:30] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}] 2024-03-26T16:59:31.056 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:30 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:30] INFO grpc.py:843: Received request to add a namespace using NSID 17 and UUID 0aaf3983-217a-4d6b-a3aa-63888b07164a to nqn.2016-06.io.spdk:cnode1, context: None 2024-03-26T16:59:31.056 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:30 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:30] INFO grpc.py:299: Received request to create bdev bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a from mypool/myimage17 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-26T16:59:31.056 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:30 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [2024-03-26 16:59:30.797031] bdev_rbd.c:1278:bdev_rbd_create: *NOTICE*: Add bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a rbd disk to lun 2024-03-26T16:59:31.056 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:30 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:30] INFO grpc.py:338: bdev_rbd_create: bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a, cluster_name cluster_context_3_0 2024-03-26T16:59:31.056 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:30 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:30] INFO grpc.py:709: Received request to add bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a to nqn.2016-06.io.spdk:cnode1 with ANA group id 3 using NSID 17 and UUID 0aaf3983-217a-4d6b-a3aa-63888b07164a 2024-03-26T16:59:31.056 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:30 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:30] INFO grpc.py:732: subsystem_add_ns: 17 2024-03-26T16:59:31.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:30 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:30] INFO grpc.py:843: Received request to add a namespace using NSID 17 and UUID 0aaf3983-217a-4d6b-a3aa-63888b07164a to nqn.2016-06.io.spdk:cnode1, context: None 2024-03-26T16:59:31.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:30 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:30] INFO grpc.py:299: Received request to create bdev bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a from mypool/myimage17 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-26T16:59:31.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:30 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [2024-03-26 16:59:30.801039] bdev_rbd.c:1278:bdev_rbd_create: *NOTICE*: Add bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a rbd disk to lun 2024-03-26T16:59:31.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:30 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:30] INFO grpc.py:338: bdev_rbd_create: bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a, cluster_name cluster_context_3_0 2024-03-26T16:59:31.147 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:30 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:30] INFO grpc.py:709: Received request to add bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a to nqn.2016-06.io.spdk:cnode1 with ANA group id 3 using NSID 17 and UUID 0aaf3983-217a-4d6b-a3aa-63888b07164a 2024-03-26T16:59:31.147 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:30 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:30] INFO grpc.py:732: subsystem_add_ns: 17 2024-03-26T16:59:31.195 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:30] INFO grpc.py:338: bdev_rbd_create: bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a, cluster_name cluster_context_3_0 2024-03-26T16:59:31.195 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:30] INFO grpc.py:709: Received request to add bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a to nqn.2016-06.io.spdk:cnode1 with ANA group id 3 using UUID 0aaf3983-217a-4d6b-a3aa-63888b07164a 2024-03-26T16:59:31.195 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:30] INFO grpc.py:732: subsystem_add_ns: 17 2024-03-26T16:59:31.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:59:31 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-26T16:59:31.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:59:31 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-26T16:59:31.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:59:31 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-26T16:59:31.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:59:31 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 2024-03-26T16:59:31.202+0000 7fa707a55700 -1 mon.c@1(peon) e3 get_health_metrics reporting 1 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T16:59:31.677 INFO:tasks.workunit.client.3.smithi157.stderr:+ (( image_index++ )) 2024-03-26T16:59:31.677 INFO:tasks.workunit.client.3.smithi157.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2024-03-26T16:59:31.677 INFO:tasks.workunit.client.3.smithi157.stderr:+ image=myimage18 2024-03-26T16:59:31.677 INFO:tasks.workunit.client.3.smithi157.stderr:+ sudo podman run -it quay.io/barakda1/nvmeof-cli:qe_ceph_devel_21e59b2 --server-address 172.21.15.44 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode1 --rbd-pool mypool --rbd-image myimage18 --load-balancing-group 1 2024-03-26T16:59:31.760 INFO:tasks.workunit.client.3.smithi157.stderr:time="2024-03-26T16:59:31Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2024-03-26T16:59:32.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:31] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:59:32.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:31] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}] 2024-03-26T16:59:32.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:31 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:31] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:59:32.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:31 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:31] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}] 2024-03-26T16:59:32.468 INFO:tasks.workunit.client.3.smithi157.stdout:Adding namespace 18 to nqn.2016-06.io.spdk:cnode1, load balancing group 1: Successful 2024-03-26T16:59:32.765 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:59:32 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:59:32.765 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:59:32 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:59:32.765 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:59:32 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:59:32.765 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:59:32 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:59:32.765 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:59:32 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:59:32.765 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:59:32 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:59:32.765 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:59:32 smithi044 ceph-mon[30624]: pgmap v386: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 66 KiB/s rd, 1.6 KiB/s wr, 60 op/s 2024-03-26T16:59:32.765 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:59:32 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:59:32.765 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:59:32 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:59:32.766 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:32 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:32] INFO grpc.py:843: Received request to add a namespace to nqn.2016-06.io.spdk:cnode1, context: 2024-03-26T16:59:32.766 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:32 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:32] INFO grpc.py:299: Received request to create bdev bdev_c6887013-be71-4aaf-b084-84236db9e43d from mypool/myimage18 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-26T16:59:32.766 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:32 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [2024-03-26 16:59:32.454286] bdev_rbd.c:1278:bdev_rbd_create: *NOTICE*: Add bdev_c6887013-be71-4aaf-b084-84236db9e43d rbd disk to lun 2024-03-26T16:59:32.766 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:32 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:32] INFO grpc.py:338: bdev_rbd_create: bdev_c6887013-be71-4aaf-b084-84236db9e43d, cluster_name cluster_context_1_0 2024-03-26T16:59:32.766 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:32 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:32] INFO grpc.py:709: Received request to add bdev_c6887013-be71-4aaf-b084-84236db9e43d to nqn.2016-06.io.spdk:cnode1 with ANA group id 1 using UUID c6887013-be71-4aaf-b084-84236db9e43d 2024-03-26T16:59:32.766 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:32 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:32] INFO grpc.py:732: subsystem_add_ns: 18 2024-03-26T16:59:32.805 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:59:32 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:59:32.806 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:59:32 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:59:32.806 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:59:32 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:59:32.806 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:59:32 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:59:32.806 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:59:32 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:59:32.806 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:59:32 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:59:32.806 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:59:32 smithi064 ceph-mon[34420]: pgmap v386: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 66 KiB/s rd, 1.6 KiB/s wr, 60 op/s 2024-03-26T16:59:32.806 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:59:32 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:59:32.806 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:59:32 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:59:32.806 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:32 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:32] INFO grpc.py:843: Received request to add a namespace using NSID 18 and UUID c6887013-be71-4aaf-b084-84236db9e43d to nqn.2016-06.io.spdk:cnode1, context: None 2024-03-26T16:59:32.806 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:32 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:32] INFO grpc.py:299: Received request to create bdev bdev_c6887013-be71-4aaf-b084-84236db9e43d from mypool/myimage18 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-26T16:59:32.806 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:32 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [2024-03-26 16:59:32.484050] bdev_rbd.c:1278:bdev_rbd_create: *NOTICE*: Add bdev_c6887013-be71-4aaf-b084-84236db9e43d rbd disk to lun 2024-03-26T16:59:32.807 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:32 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:32] INFO grpc.py:338: bdev_rbd_create: bdev_c6887013-be71-4aaf-b084-84236db9e43d, cluster_name cluster_context_1_0 2024-03-26T16:59:32.807 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:32 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:32] INFO grpc.py:709: Received request to add bdev_c6887013-be71-4aaf-b084-84236db9e43d to nqn.2016-06.io.spdk:cnode1 with ANA group id 1 using NSID 18 and UUID c6887013-be71-4aaf-b084-84236db9e43d 2024-03-26T16:59:32.807 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:32 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:32] INFO grpc.py:732: subsystem_add_ns: 18 2024-03-26T16:59:32.807 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:32 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:32] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:59:32.807 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:32 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:32] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}] 2024-03-26T16:59:32.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:32 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:32] INFO grpc.py:843: Received request to add a namespace using NSID 18 and UUID c6887013-be71-4aaf-b084-84236db9e43d to nqn.2016-06.io.spdk:cnode1, context: None 2024-03-26T16:59:32.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:32 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:32] INFO grpc.py:299: Received request to create bdev bdev_c6887013-be71-4aaf-b084-84236db9e43d from mypool/myimage18 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-26T16:59:32.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:32 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [2024-03-26 16:59:32.483022] bdev_rbd.c:1278:bdev_rbd_create: *NOTICE*: Add bdev_c6887013-be71-4aaf-b084-84236db9e43d rbd disk to lun 2024-03-26T16:59:32.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:32 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:32] INFO grpc.py:338: bdev_rbd_create: bdev_c6887013-be71-4aaf-b084-84236db9e43d, cluster_name cluster_context_1_0 2024-03-26T16:59:32.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:32 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:32] INFO grpc.py:709: Received request to add bdev_c6887013-be71-4aaf-b084-84236db9e43d to nqn.2016-06.io.spdk:cnode1 with ANA group id 1 using NSID 18 and UUID c6887013-be71-4aaf-b084-84236db9e43d 2024-03-26T16:59:32.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:32 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:32] INFO grpc.py:732: subsystem_add_ns: 18 2024-03-26T16:59:32.897 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:59:32 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:59:32.897 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:59:32 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:59:32.897 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:59:32 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:59:32.897 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:59:32 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:59:32.897 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:59:32 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:59:32.897 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:59:32 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:59:32.897 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:59:32 smithi149 ceph-mon[34678]: pgmap v386: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 66 KiB/s rd, 1.6 KiB/s wr, 60 op/s 2024-03-26T16:59:32.897 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:59:32 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:59:32.897 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:59:32 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:59:33.354 INFO:tasks.workunit.client.3.smithi157.stderr:+ (( image_index++ )) 2024-03-26T16:59:33.354 INFO:tasks.workunit.client.3.smithi157.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2024-03-26T16:59:33.354 INFO:tasks.workunit.client.3.smithi157.stderr:+ image=myimage19 2024-03-26T16:59:33.354 INFO:tasks.workunit.client.3.smithi157.stderr:+ sudo podman run -it quay.io/barakda1/nvmeof-cli:qe_ceph_devel_21e59b2 --server-address 172.21.15.44 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode1 --rbd-pool mypool --rbd-image myimage19 --load-balancing-group 2 2024-03-26T16:59:33.434 INFO:tasks.workunit.client.3.smithi157.stderr:time="2024-03-26T16:59:33Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2024-03-26T16:59:33.896 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:59:33 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi157", "name": "osd_memory_target"} : dispatch 2024-03-26T16:59:33.896 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:59:33 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T16:59:33.896 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:59:33 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-26T16:59:33.896 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:59:33 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:59:33.896 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:59:33 smithi149 ceph-mon[34678]: Health check update: 2 slow ops, oldest one blocked for 68 sec, daemons [mon.b,mon.c] have slow ops. (SLOW_OPS) 2024-03-26T16:59:33.897 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:33 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:33] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:59:33.897 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:33 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:33] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}] 2024-03-26T16:59:34.015 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:59:33 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi157", "name": "osd_memory_target"} : dispatch 2024-03-26T16:59:34.015 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:59:33 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T16:59:34.015 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:59:33 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-26T16:59:34.015 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:59:33 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:59:34.015 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:59:33 smithi044 ceph-mon[30624]: Health check update: 2 slow ops, oldest one blocked for 68 sec, daemons [mon.b,mon.c] have slow ops. (SLOW_OPS) 2024-03-26T16:59:34.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:33] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:59:34.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:33] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}] 2024-03-26T16:59:34.055 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:59:33 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi157", "name": "osd_memory_target"} : dispatch 2024-03-26T16:59:34.055 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:59:33 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T16:59:34.055 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:59:33 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-26T16:59:34.055 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:59:33 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T16:59:34.055 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:59:33 smithi064 ceph-mon[34420]: Health check update: 2 slow ops, oldest one blocked for 68 sec, daemons [mon.b,mon.c] have slow ops. (SLOW_OPS) 2024-03-26T16:59:34.151 INFO:tasks.workunit.client.3.smithi157.stdout:Adding namespace 19 to nqn.2016-06.io.spdk:cnode1, load balancing group 2: Successful 2024-03-26T16:59:34.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:34] INFO grpc.py:843: Received request to add a namespace to nqn.2016-06.io.spdk:cnode1, context: 2024-03-26T16:59:34.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:34] INFO grpc.py:299: Received request to create bdev bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361 from mypool/myimage19 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-26T16:59:34.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [2024-03-26 16:59:34.135561] bdev_rbd.c:1278:bdev_rbd_create: *NOTICE*: Add bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361 rbd disk to lun 2024-03-26T16:59:34.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:34] INFO grpc.py:338: bdev_rbd_create: bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361, cluster_name cluster_context_2_0 2024-03-26T16:59:34.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:34] INFO grpc.py:709: Received request to add bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361 to nqn.2016-06.io.spdk:cnode1 with ANA group id 2 using UUID d686ab7c-1ace-4ff8-aec0-b3b6741b3361 2024-03-26T16:59:34.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:34] INFO grpc.py:732: subsystem_add_ns: 19 2024-03-26T16:59:34.555 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:34 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:34] INFO grpc.py:843: Received request to add a namespace using NSID 19 and UUID d686ab7c-1ace-4ff8-aec0-b3b6741b3361 to nqn.2016-06.io.spdk:cnode1, context: None 2024-03-26T16:59:34.555 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:34 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:34] INFO grpc.py:299: Received request to create bdev bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361 from mypool/myimage19 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-26T16:59:34.555 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:34 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [2024-03-26 16:59:34.159245] bdev_rbd.c:1278:bdev_rbd_create: *NOTICE*: Add bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361 rbd disk to lun 2024-03-26T16:59:34.555 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:34 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:34] INFO grpc.py:338: bdev_rbd_create: bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361, cluster_name cluster_context_2_0 2024-03-26T16:59:34.555 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:34 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:34] INFO grpc.py:709: Received request to add bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361 to nqn.2016-06.io.spdk:cnode1 with ANA group id 2 using NSID 19 and UUID d686ab7c-1ace-4ff8-aec0-b3b6741b3361 2024-03-26T16:59:34.555 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:34 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:34] INFO grpc.py:732: subsystem_add_ns: 19 2024-03-26T16:59:34.636 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:34 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:34] INFO grpc.py:843: Received request to add a namespace using NSID 19 and UUID d686ab7c-1ace-4ff8-aec0-b3b6741b3361 to nqn.2016-06.io.spdk:cnode1, context: None 2024-03-26T16:59:34.636 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:34 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:34] INFO grpc.py:299: Received request to create bdev bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361 from mypool/myimage19 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-26T16:59:34.636 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:34 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [2024-03-26 16:59:34.160768] bdev_rbd.c:1278:bdev_rbd_create: *NOTICE*: Add bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361 rbd disk to lun 2024-03-26T16:59:34.636 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:34 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:34] INFO grpc.py:338: bdev_rbd_create: bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361, cluster_name cluster_context_2_0 2024-03-26T16:59:34.636 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:34 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:34] INFO grpc.py:709: Received request to add bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361 to nqn.2016-06.io.spdk:cnode1 with ANA group id 2 using NSID 19 and UUID d686ab7c-1ace-4ff8-aec0-b3b6741b3361 2024-03-26T16:59:34.636 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:34 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:34] INFO grpc.py:732: subsystem_add_ns: 19 2024-03-26T16:59:34.896 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:59:34 smithi149 ceph-mon[34678]: pgmap v387: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 87 KiB/s rd, 2.2 KiB/s wr, 73 op/s 2024-03-26T16:59:34.955 INFO:tasks.workunit.client.3.smithi157.stderr:+ (( image_index++ )) 2024-03-26T16:59:34.955 INFO:tasks.workunit.client.3.smithi157.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2024-03-26T16:59:34.956 INFO:tasks.workunit.client.3.smithi157.stderr:+ image=myimage20 2024-03-26T16:59:34.956 INFO:tasks.workunit.client.3.smithi157.stderr:+ sudo podman run -it quay.io/barakda1/nvmeof-cli:qe_ceph_devel_21e59b2 --server-address 172.21.15.44 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode1 --rbd-pool mypool --rbd-image myimage20 --load-balancing-group 3 2024-03-26T16:59:35.015 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:59:34 smithi044 ceph-mon[30624]: pgmap v387: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 87 KiB/s rd, 2.2 KiB/s wr, 73 op/s 2024-03-26T16:59:35.037 INFO:tasks.workunit.client.3.smithi157.stderr:time="2024-03-26T16:59:35Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2024-03-26T16:59:35.055 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:59:34 smithi064 ceph-mon[34420]: pgmap v387: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 87 KiB/s rd, 2.2 KiB/s wr, 73 op/s 2024-03-26T16:59:35.055 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:34 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:34] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:59:35.056 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:34 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:34] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}] 2024-03-26T16:59:35.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:59:35 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-b[34416]: 2024-03-26T16:59:35.277+0000 7ff022916700 -1 mon.b@2(peon) e3 get_health_metrics reporting 2 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T16:59:35.774 INFO:tasks.workunit.client.3.smithi157.stdout:Adding namespace 20 to nqn.2016-06.io.spdk:cnode1, load balancing group 3: Successful 2024-03-26T16:59:36.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:35] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:59:36.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:35] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}] 2024-03-26T16:59:36.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:35] INFO grpc.py:843: Received request to add a namespace to nqn.2016-06.io.spdk:cnode1, context: 2024-03-26T16:59:36.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:35] INFO grpc.py:299: Received request to create bdev bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95 from mypool/myimage20 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-26T16:59:36.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [2024-03-26 16:59:35.759253] bdev_rbd.c:1278:bdev_rbd_create: *NOTICE*: Add bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95 rbd disk to lun 2024-03-26T16:59:36.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:35] INFO grpc.py:338: bdev_rbd_create: bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95, cluster_name cluster_context_3_0 2024-03-26T16:59:36.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:35] INFO grpc.py:709: Received request to add bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95 to nqn.2016-06.io.spdk:cnode1 with ANA group id 3 using UUID c358261a-15a0-4e64-8640-7ff4cf1c4b95 2024-03-26T16:59:36.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:35] INFO grpc.py:732: subsystem_add_ns: 20 2024-03-26T16:59:36.055 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:35 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:35] INFO grpc.py:843: Received request to add a namespace using NSID 20 and UUID c358261a-15a0-4e64-8640-7ff4cf1c4b95 to nqn.2016-06.io.spdk:cnode1, context: None 2024-03-26T16:59:36.055 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:35 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:35] INFO grpc.py:299: Received request to create bdev bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95 from mypool/myimage20 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-26T16:59:36.055 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:35 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [2024-03-26 16:59:35.783557] bdev_rbd.c:1278:bdev_rbd_create: *NOTICE*: Add bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95 rbd disk to lun 2024-03-26T16:59:36.055 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:35 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:35] INFO grpc.py:338: bdev_rbd_create: bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95, cluster_name cluster_context_3_0 2024-03-26T16:59:36.055 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:35 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:35] INFO grpc.py:709: Received request to add bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95 to nqn.2016-06.io.spdk:cnode1 with ANA group id 3 using NSID 20 and UUID c358261a-15a0-4e64-8640-7ff4cf1c4b95 2024-03-26T16:59:36.056 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:35 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:35] INFO grpc.py:732: subsystem_add_ns: 20 2024-03-26T16:59:36.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:35 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:35] INFO grpc.py:843: Received request to add a namespace using NSID 20 and UUID c358261a-15a0-4e64-8640-7ff4cf1c4b95 to nqn.2016-06.io.spdk:cnode1, context: None 2024-03-26T16:59:36.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:35 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:35] INFO grpc.py:299: Received request to create bdev bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95 from mypool/myimage20 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-26T16:59:36.147 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:35 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [2024-03-26 16:59:35.784644] bdev_rbd.c:1278:bdev_rbd_create: *NOTICE*: Add bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95 rbd disk to lun 2024-03-26T16:59:36.147 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:35 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:35] INFO grpc.py:338: bdev_rbd_create: bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95, cluster_name cluster_context_3_0 2024-03-26T16:59:36.147 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:35 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:35] INFO grpc.py:709: Received request to add bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95 to nqn.2016-06.io.spdk:cnode1 with ANA group id 3 using NSID 20 and UUID c358261a-15a0-4e64-8640-7ff4cf1c4b95 2024-03-26T16:59:36.147 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:35 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:35] INFO grpc.py:732: subsystem_add_ns: 20 2024-03-26T16:59:36.147 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:35 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:35] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:59:36.147 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:35 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:35] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}] 2024-03-26T16:59:36.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:59:36 smithi044 ceph-mon[30624]: pgmap v388: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 75 KiB/s rd, 1.7 KiB/s wr, 66 op/s 2024-03-26T16:59:36.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:59:36 smithi064 ceph-mon[34420]: pgmap v388: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 75 KiB/s rd, 1.7 KiB/s wr, 66 op/s 2024-03-26T16:59:36.601 INFO:tasks.workunit.client.3.smithi157.stderr:+ (( image_index++ )) 2024-03-26T16:59:36.601 INFO:tasks.workunit.client.3.smithi157.stderr:+ for i in $(seq 1 $NVMEOF_SUBSYSTEMS_COUNT) 2024-03-26T16:59:36.601 INFO:tasks.workunit.client.3.smithi157.stderr:+ subsystem_nqn=nqn.2016-06.io.spdk:cnode2 2024-03-26T16:59:36.601 INFO:tasks.workunit.client.3.smithi157.stderr:++ seq 1 20 2024-03-26T16:59:36.602 INFO:tasks.workunit.client.3.smithi157.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2024-03-26T16:59:36.602 INFO:tasks.workunit.client.3.smithi157.stderr:+ image=myimage21 2024-03-26T16:59:36.602 INFO:tasks.workunit.client.3.smithi157.stderr:+ sudo podman run -it quay.io/barakda1/nvmeof-cli:qe_ceph_devel_21e59b2 --server-address 172.21.15.44 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode2 --rbd-pool mypool --rbd-image myimage21 --load-balancing-group 1 2024-03-26T16:59:36.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:59:36 smithi149 ceph-mon[34678]: pgmap v388: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 75 KiB/s rd, 1.7 KiB/s wr, 66 op/s 2024-03-26T16:59:36.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:59:36 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 2024-03-26T16:59:36.203+0000 7fa707a55700 -1 mon.c@1(peon) e3 get_health_metrics reporting 2 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T16:59:36.685 INFO:tasks.workunit.client.3.smithi157.stderr:time="2024-03-26T16:59:36Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2024-03-26T16:59:37.055 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:36 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:36] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:59:37.055 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:36 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:36] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}] 2024-03-26T16:59:37.424 INFO:tasks.workunit.client.3.smithi157.stdout:Adding namespace 1 to nqn.2016-06.io.spdk:cnode2, load balancing group 1: Successful 2024-03-26T16:59:37.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:37 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:37] INFO grpc.py:843: Received request to add a namespace to nqn.2016-06.io.spdk:cnode2, context: 2024-03-26T16:59:37.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:37 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:37] INFO grpc.py:299: Received request to create bdev bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776 from mypool/myimage21 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-26T16:59:37.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:37 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [2024-03-26 16:59:37.408232] bdev_rbd.c:1278:bdev_rbd_create: *NOTICE*: Add bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776 rbd disk to lun 2024-03-26T16:59:37.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:37 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:37] INFO grpc.py:338: bdev_rbd_create: bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776, cluster_name cluster_context_1_0 2024-03-26T16:59:37.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:37 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:37] INFO grpc.py:709: Received request to add bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776 to nqn.2016-06.io.spdk:cnode2 with ANA group id 1 using UUID 05b2e1a6-3d5a-4b69-871c-1ac01c6d8776 2024-03-26T16:59:37.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:37 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:37] INFO grpc.py:732: subsystem_add_ns: 1 2024-03-26T16:59:37.766 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:37 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:37] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:59:37.766 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:37 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:37] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}] 2024-03-26T16:59:37.805 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:37] INFO grpc.py:843: Received request to add a namespace using NSID 1 and UUID 05b2e1a6-3d5a-4b69-871c-1ac01c6d8776 to nqn.2016-06.io.spdk:cnode2, context: None 2024-03-26T16:59:37.805 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:37] INFO grpc.py:299: Received request to create bdev bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776 from mypool/myimage21 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-26T16:59:37.805 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [2024-03-26 16:59:37.435396] bdev_rbd.c:1278:bdev_rbd_create: *NOTICE*: Add bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776 rbd disk to lun 2024-03-26T16:59:37.805 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:37] INFO grpc.py:338: bdev_rbd_create: bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776, cluster_name cluster_context_1_0 2024-03-26T16:59:37.806 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:37] INFO grpc.py:709: Received request to add bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776 to nqn.2016-06.io.spdk:cnode2 with ANA group id 1 using NSID 1 and UUID 05b2e1a6-3d5a-4b69-871c-1ac01c6d8776 2024-03-26T16:59:37.806 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:37] INFO grpc.py:732: subsystem_add_ns: 1 2024-03-26T16:59:37.884 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:37 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:37] INFO grpc.py:843: Received request to add a namespace using NSID 1 and UUID 05b2e1a6-3d5a-4b69-871c-1ac01c6d8776 to nqn.2016-06.io.spdk:cnode2, context: None 2024-03-26T16:59:37.884 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:37 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:37] INFO grpc.py:299: Received request to create bdev bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776 from mypool/myimage21 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-26T16:59:37.884 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:37 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [2024-03-26 16:59:37.434153] bdev_rbd.c:1278:bdev_rbd_create: *NOTICE*: Add bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776 rbd disk to lun 2024-03-26T16:59:37.884 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:37 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:37] INFO grpc.py:338: bdev_rbd_create: bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776, cluster_name cluster_context_1_0 2024-03-26T16:59:37.885 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:37 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:37] INFO grpc.py:709: Received request to add bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776 to nqn.2016-06.io.spdk:cnode2 with ANA group id 1 using NSID 1 and UUID 05b2e1a6-3d5a-4b69-871c-1ac01c6d8776 2024-03-26T16:59:37.885 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:37 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:37] INFO grpc.py:732: subsystem_add_ns: 1 2024-03-26T16:59:37.885 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:37 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:37] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:59:38.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:37 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:37] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}] 2024-03-26T16:59:38.302 INFO:tasks.workunit.client.3.smithi157.stderr:+ (( image_index++ )) 2024-03-26T16:59:38.302 INFO:tasks.workunit.client.3.smithi157.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2024-03-26T16:59:38.302 INFO:tasks.workunit.client.3.smithi157.stderr:+ image=myimage22 2024-03-26T16:59:38.302 INFO:tasks.workunit.client.3.smithi157.stderr:+ sudo podman run -it quay.io/barakda1/nvmeof-cli:qe_ceph_devel_21e59b2 --server-address 172.21.15.44 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode2 --rbd-pool mypool --rbd-image myimage22 --load-balancing-group 2 2024-03-26T16:59:38.380 INFO:tasks.workunit.client.3.smithi157.stderr:time="2024-03-26T16:59:38Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2024-03-26T16:59:38.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:59:38 smithi044 ceph-mon[30624]: pgmap v389: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 74 KiB/s rd, 1.7 KiB/s wr, 65 op/s 2024-03-26T16:59:38.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:59:38 smithi064 ceph-mon[34420]: pgmap v389: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 74 KiB/s rd, 1.7 KiB/s wr, 65 op/s 2024-03-26T16:59:38.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:59:38 smithi149 ceph-mon[34678]: pgmap v389: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 74 KiB/s rd, 1.7 KiB/s wr, 65 op/s 2024-03-26T16:59:39.055 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:38] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:59:39.055 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:38 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:38] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}] 2024-03-26T16:59:39.091 INFO:tasks.workunit.client.3.smithi157.stdout:Adding namespace 2 to nqn.2016-06.io.spdk:cnode2, load balancing group 2: Successful 2024-03-26T16:59:39.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:59:39 smithi149 ceph-mon[34678]: Health check update: 2 slow ops, oldest one blocked for 73 sec, daemons [mon.b,mon.c] have slow ops. (SLOW_OPS) 2024-03-26T16:59:39.396 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:39 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:39] INFO grpc.py:843: Received request to add a namespace using NSID 2 and UUID 8cb4fb23-ee03-4621-a45c-b79e612fbaa4 to nqn.2016-06.io.spdk:cnode2, context: None 2024-03-26T16:59:39.396 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:39 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:39] INFO grpc.py:299: Received request to create bdev bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4 from mypool/myimage22 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-26T16:59:39.396 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:39 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [2024-03-26 16:59:39.102327] bdev_rbd.c:1278:bdev_rbd_create: *NOTICE*: Add bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4 rbd disk to lun 2024-03-26T16:59:39.396 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:39 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:39] INFO grpc.py:338: bdev_rbd_create: bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4, cluster_name cluster_context_2_0 2024-03-26T16:59:39.396 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:39 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:39] INFO grpc.py:709: Received request to add bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4 to nqn.2016-06.io.spdk:cnode2 with ANA group id 2 using NSID 2 and UUID 8cb4fb23-ee03-4621-a45c-b79e612fbaa4 2024-03-26T16:59:39.396 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:39 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:39] INFO grpc.py:732: subsystem_add_ns: 2 2024-03-26T16:59:39.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:59:39 smithi044 ceph-mon[30624]: Health check update: 2 slow ops, oldest one blocked for 73 sec, daemons [mon.b,mon.c] have slow ops. (SLOW_OPS) 2024-03-26T16:59:39.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:39 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:39] INFO grpc.py:843: Received request to add a namespace to nqn.2016-06.io.spdk:cnode2, context: 2024-03-26T16:59:39.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:39 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:39] INFO grpc.py:299: Received request to create bdev bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4 from mypool/myimage22 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-26T16:59:39.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:39 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [2024-03-26 16:59:39.076514] bdev_rbd.c:1278:bdev_rbd_create: *NOTICE*: Add bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4 rbd disk to lun 2024-03-26T16:59:39.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:39 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:39] INFO grpc.py:338: bdev_rbd_create: bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4, cluster_name cluster_context_2_0 2024-03-26T16:59:39.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:39 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:39] INFO grpc.py:709: Received request to add bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4 to nqn.2016-06.io.spdk:cnode2 with ANA group id 2 using UUID 8cb4fb23-ee03-4621-a45c-b79e612fbaa4 2024-03-26T16:59:39.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:39 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:39] INFO grpc.py:732: subsystem_add_ns: 2 2024-03-26T16:59:39.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:59:39 smithi064 ceph-mon[34420]: Health check update: 2 slow ops, oldest one blocked for 73 sec, daemons [mon.b,mon.c] have slow ops. (SLOW_OPS) 2024-03-26T16:59:39.555 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:39 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:39] INFO grpc.py:843: Received request to add a namespace using NSID 2 and UUID 8cb4fb23-ee03-4621-a45c-b79e612fbaa4 to nqn.2016-06.io.spdk:cnode2, context: None 2024-03-26T16:59:39.555 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:39 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:39] INFO grpc.py:299: Received request to create bdev bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4 from mypool/myimage22 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-26T16:59:39.555 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:39 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [2024-03-26 16:59:39.100266] bdev_rbd.c:1278:bdev_rbd_create: *NOTICE*: Add bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4 rbd disk to lun 2024-03-26T16:59:39.555 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:39 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:39] INFO grpc.py:338: bdev_rbd_create: bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4, cluster_name cluster_context_2_0 2024-03-26T16:59:39.556 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:39 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:39] INFO grpc.py:709: Received request to add bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4 to nqn.2016-06.io.spdk:cnode2 with ANA group id 2 using NSID 2 and UUID 8cb4fb23-ee03-4621-a45c-b79e612fbaa4 2024-03-26T16:59:39.556 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:39 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:39] INFO grpc.py:732: subsystem_add_ns: 2 2024-03-26T16:59:39.960 INFO:tasks.workunit.client.3.smithi157.stderr:+ (( image_index++ )) 2024-03-26T16:59:39.961 INFO:tasks.workunit.client.3.smithi157.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2024-03-26T16:59:39.961 INFO:tasks.workunit.client.3.smithi157.stderr:+ image=myimage23 2024-03-26T16:59:39.961 INFO:tasks.workunit.client.3.smithi157.stderr:+ sudo podman run -it quay.io/barakda1/nvmeof-cli:qe_ceph_devel_21e59b2 --server-address 172.21.15.44 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode2 --rbd-pool mypool --rbd-image myimage23 --load-balancing-group 3 2024-03-26T16:59:40.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:39 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:39] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:59:40.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:39 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:39] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}] 2024-03-26T16:59:40.053 INFO:tasks.workunit.client.3.smithi157.stderr:time="2024-03-26T16:59:40Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2024-03-26T16:59:40.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:39 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:39] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:59:40.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:39 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:39] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}] 2024-03-26T16:59:40.457 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:59:40 smithi064 ceph-mon[34420]: pgmap v390: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 96 KiB/s rd, 2.2 KiB/s wr, 76 op/s 2024-03-26T16:59:40.457 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:59:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-b[34416]: 2024-03-26T16:59:40.277+0000 7ff022916700 -1 mon.b@2(peon) e3 get_health_metrics reporting 4 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T16:59:40.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:59:40 smithi044 ceph-mon[30624]: pgmap v390: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 96 KiB/s rd, 2.2 KiB/s wr, 76 op/s 2024-03-26T16:59:40.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:59:40 smithi149 ceph-mon[34678]: pgmap v390: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 96 KiB/s rd, 2.2 KiB/s wr, 76 op/s 2024-03-26T16:59:40.804 INFO:tasks.workunit.client.3.smithi157.stdout:Adding namespace 3 to nqn.2016-06.io.spdk:cnode2, load balancing group 3: Successful 2024-03-26T16:59:41.056 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:40] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:59:41.056 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:40] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}] 2024-03-26T16:59:41.056 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:40] INFO grpc.py:843: Received request to add a namespace using NSID 3 and UUID cdfc396b-4911-47eb-a9ea-a3af2ac6cc80 to nqn.2016-06.io.spdk:cnode2, context: None 2024-03-26T16:59:41.056 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:40] INFO grpc.py:299: Received request to create bdev bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80 from mypool/myimage23 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-26T16:59:41.056 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [2024-03-26 16:59:40.816131] bdev_rbd.c:1278:bdev_rbd_create: *NOTICE*: Add bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80 rbd disk to lun 2024-03-26T16:59:41.056 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:40] INFO grpc.py:338: bdev_rbd_create: bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80, cluster_name cluster_context_3_0 2024-03-26T16:59:41.056 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:40] INFO grpc.py:709: Received request to add bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80 to nqn.2016-06.io.spdk:cnode2 with ANA group id 3 using NSID 3 and UUID cdfc396b-4911-47eb-a9ea-a3af2ac6cc80 2024-03-26T16:59:41.056 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:40] INFO grpc.py:732: subsystem_add_ns: 3 2024-03-26T16:59:41.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:40 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:40] INFO grpc.py:843: Received request to add a namespace using NSID 3 and UUID cdfc396b-4911-47eb-a9ea-a3af2ac6cc80 to nqn.2016-06.io.spdk:cnode2, context: None 2024-03-26T16:59:41.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:40 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:40] INFO grpc.py:299: Received request to create bdev bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80 from mypool/myimage23 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-26T16:59:41.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:40 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [2024-03-26 16:59:40.814045] bdev_rbd.c:1278:bdev_rbd_create: *NOTICE*: Add bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80 rbd disk to lun 2024-03-26T16:59:41.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:40 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:40] INFO grpc.py:338: bdev_rbd_create: bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80, cluster_name cluster_context_3_0 2024-03-26T16:59:41.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:40 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:40] INFO grpc.py:709: Received request to add bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80 to nqn.2016-06.io.spdk:cnode2 with ANA group id 3 using NSID 3 and UUID cdfc396b-4911-47eb-a9ea-a3af2ac6cc80 2024-03-26T16:59:41.147 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:40 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:40] INFO grpc.py:732: subsystem_add_ns: 3 2024-03-26T16:59:41.265 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:40 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:40] INFO grpc.py:843: Received request to add a namespace to nqn.2016-06.io.spdk:cnode2, context: 2024-03-26T16:59:41.265 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:40 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:40] INFO grpc.py:299: Received request to create bdev bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80 from mypool/myimage23 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-26T16:59:41.265 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:40 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [2024-03-26 16:59:40.789831] bdev_rbd.c:1278:bdev_rbd_create: *NOTICE*: Add bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80 rbd disk to lun 2024-03-26T16:59:41.265 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:40 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:40] INFO grpc.py:338: bdev_rbd_create: bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80, cluster_name cluster_context_3_0 2024-03-26T16:59:41.265 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:40 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:40] INFO grpc.py:709: Received request to add bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80 to nqn.2016-06.io.spdk:cnode2 with ANA group id 3 using UUID cdfc396b-4911-47eb-a9ea-a3af2ac6cc80 2024-03-26T16:59:41.265 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:40 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:40] INFO grpc.py:732: subsystem_add_ns: 3 2024-03-26T16:59:41.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:59:41 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 2024-03-26T16:59:41.203+0000 7fa707a55700 -1 mon.c@1(peon) e3 get_health_metrics reporting 3 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T16:59:41.662 INFO:tasks.workunit.client.3.smithi157.stderr:+ (( image_index++ )) 2024-03-26T16:59:41.662 INFO:tasks.workunit.client.3.smithi157.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2024-03-26T16:59:41.662 INFO:tasks.workunit.client.3.smithi157.stderr:+ image=myimage24 2024-03-26T16:59:41.662 INFO:tasks.workunit.client.3.smithi157.stderr:+ sudo podman run -it quay.io/barakda1/nvmeof-cli:qe_ceph_devel_21e59b2 --server-address 172.21.15.44 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode2 --rbd-pool mypool --rbd-image myimage24 --load-balancing-group 1 2024-03-26T16:59:41.757 INFO:tasks.workunit.client.3.smithi157.stderr:time="2024-03-26T16:59:41Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2024-03-26T16:59:42.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:41 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:41] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:59:42.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:41 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:41] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}] 2024-03-26T16:59:42.191 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:41 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:41] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:59:42.191 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:41 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:41] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}] 2024-03-26T16:59:42.458 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:59:42 smithi044 ceph-mon[30624]: pgmap v391: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 66 KiB/s rd, 1.5 KiB/s wr, 52 op/s 2024-03-26T16:59:42.486 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:59:42 smithi149 ceph-mon[34678]: pgmap v391: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 66 KiB/s rd, 1.5 KiB/s wr, 52 op/s 2024-03-26T16:59:42.486 INFO:tasks.workunit.client.3.smithi157.stdout:Adding namespace 4 to nqn.2016-06.io.spdk:cnode2, load balancing group 1: Successful 2024-03-26T16:59:42.486 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:59:42 smithi064 ceph-mon[34420]: pgmap v391: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 66 KiB/s rd, 1.5 KiB/s wr, 52 op/s 2024-03-26T16:59:42.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:42 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:42] INFO grpc.py:843: Received request to add a namespace to nqn.2016-06.io.spdk:cnode2, context: 2024-03-26T16:59:42.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:42 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:42] INFO grpc.py:299: Received request to create bdev bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792 from mypool/myimage24 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-26T16:59:42.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:42 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [2024-03-26 16:59:42.471057] bdev_rbd.c:1278:bdev_rbd_create: *NOTICE*: Add bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792 rbd disk to lun 2024-03-26T16:59:42.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:42 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:42] INFO grpc.py:338: bdev_rbd_create: bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792, cluster_name cluster_context_1_0 2024-03-26T16:59:42.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:42 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:42] INFO grpc.py:709: Received request to add bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792 to nqn.2016-06.io.spdk:cnode2 with ANA group id 1 using UUID fa7d8c13-5edf-4558-a74d-2c9100ecc792 2024-03-26T16:59:42.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:42 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:42] INFO grpc.py:732: subsystem_add_ns: 4 2024-03-26T16:59:42.806 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:42] INFO grpc.py:843: Received request to add a namespace using NSID 4 and UUID fa7d8c13-5edf-4558-a74d-2c9100ecc792 to nqn.2016-06.io.spdk:cnode2, context: None 2024-03-26T16:59:42.806 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:42] INFO grpc.py:299: Received request to create bdev bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792 from mypool/myimage24 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-26T16:59:42.806 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [2024-03-26 16:59:42.496428] bdev_rbd.c:1278:bdev_rbd_create: *NOTICE*: Add bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792 rbd disk to lun 2024-03-26T16:59:42.806 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:42] INFO grpc.py:338: bdev_rbd_create: bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792, cluster_name cluster_context_1_0 2024-03-26T16:59:42.806 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:42] INFO grpc.py:709: Received request to add bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792 to nqn.2016-06.io.spdk:cnode2 with ANA group id 1 using NSID 4 and UUID fa7d8c13-5edf-4558-a74d-2c9100ecc792 2024-03-26T16:59:42.806 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:42] INFO grpc.py:732: subsystem_add_ns: 4 2024-03-26T16:59:42.806 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:42] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:59:42.807 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:42] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}] 2024-03-26T16:59:42.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:42 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:42] INFO grpc.py:843: Received request to add a namespace using NSID 4 and UUID fa7d8c13-5edf-4558-a74d-2c9100ecc792 to nqn.2016-06.io.spdk:cnode2, context: None 2024-03-26T16:59:42.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:42 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:42] INFO grpc.py:299: Received request to create bdev bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792 from mypool/myimage24 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-26T16:59:42.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:42 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [2024-03-26 16:59:42.493707] bdev_rbd.c:1278:bdev_rbd_create: *NOTICE*: Add bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792 rbd disk to lun 2024-03-26T16:59:42.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:42 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:42] INFO grpc.py:338: bdev_rbd_create: bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792, cluster_name cluster_context_1_0 2024-03-26T16:59:42.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:42 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:42] INFO grpc.py:709: Received request to add bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792 to nqn.2016-06.io.spdk:cnode2 with ANA group id 1 using NSID 4 and UUID fa7d8c13-5edf-4558-a74d-2c9100ecc792 2024-03-26T16:59:42.897 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:42 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:42] INFO grpc.py:732: subsystem_add_ns: 4 2024-03-26T16:59:43.339 INFO:tasks.workunit.client.3.smithi157.stderr:+ (( image_index++ )) 2024-03-26T16:59:43.339 INFO:tasks.workunit.client.3.smithi157.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2024-03-26T16:59:43.339 INFO:tasks.workunit.client.3.smithi157.stderr:+ image=myimage25 2024-03-26T16:59:43.339 INFO:tasks.workunit.client.3.smithi157.stderr:+ sudo podman run -it quay.io/barakda1/nvmeof-cli:qe_ceph_devel_21e59b2 --server-address 172.21.15.44 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode2 --rbd-pool mypool --rbd-image myimage25 --load-balancing-group 2 2024-03-26T16:59:43.435 INFO:tasks.workunit.client.3.smithi157.stderr:time="2024-03-26T16:59:43Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2024-03-26T16:59:43.896 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:59:43 smithi149 ceph-mon[34678]: Health check update: 4 slow ops, oldest one blocked for 78 sec, daemons [mon.b,mon.c] have slow ops. (SLOW_OPS) 2024-03-26T16:59:44.015 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:59:43 smithi044 ceph-mon[30624]: Health check update: 4 slow ops, oldest one blocked for 78 sec, daemons [mon.b,mon.c] have slow ops. (SLOW_OPS) 2024-03-26T16:59:44.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:43 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:43] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:59:44.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:43 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:43] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}] 2024-03-26T16:59:44.055 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:59:43 smithi064 ceph-mon[34420]: Health check update: 4 slow ops, oldest one blocked for 78 sec, daemons [mon.b,mon.c] have slow ops. (SLOW_OPS) 2024-03-26T16:59:44.137 INFO:tasks.workunit.client.3.smithi157.stdout:Adding namespace 5 to nqn.2016-06.io.spdk:cnode2, load balancing group 2: Successful 2024-03-26T16:59:44.396 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:43 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:43] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:59:44.396 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:43 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:43] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}] 2024-03-26T16:59:44.397 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:44 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:44] INFO grpc.py:843: Received request to add a namespace using NSID 5 and UUID dbd3d055-7949-4d28-88b7-dcced8014e1e to nqn.2016-06.io.spdk:cnode2, context: None 2024-03-26T16:59:44.397 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:44 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:44] INFO grpc.py:299: Received request to create bdev bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e from mypool/myimage25 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-26T16:59:44.397 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:44 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [2024-03-26 16:59:44.150861] bdev_rbd.c:1278:bdev_rbd_create: *NOTICE*: Add bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e rbd disk to lun 2024-03-26T16:59:44.397 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:44 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:44] INFO grpc.py:338: bdev_rbd_create: bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e, cluster_name cluster_context_2_0 2024-03-26T16:59:44.397 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:44 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:44] INFO grpc.py:709: Received request to add bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e to nqn.2016-06.io.spdk:cnode2 with ANA group id 2 using NSID 5 and UUID dbd3d055-7949-4d28-88b7-dcced8014e1e 2024-03-26T16:59:44.397 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:44 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:44] INFO grpc.py:732: subsystem_add_ns: 5 2024-03-26T16:59:44.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:44 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:44] INFO grpc.py:843: Received request to add a namespace to nqn.2016-06.io.spdk:cnode2, context: 2024-03-26T16:59:44.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:44 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:44] INFO grpc.py:299: Received request to create bdev bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e from mypool/myimage25 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-26T16:59:44.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:44 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [2024-03-26 16:59:44.123606] bdev_rbd.c:1278:bdev_rbd_create: *NOTICE*: Add bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e rbd disk to lun 2024-03-26T16:59:44.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:44 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:44] INFO grpc.py:338: bdev_rbd_create: bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e, cluster_name cluster_context_2_0 2024-03-26T16:59:44.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:44 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:44] INFO grpc.py:709: Received request to add bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e to nqn.2016-06.io.spdk:cnode2 with ANA group id 2 using UUID dbd3d055-7949-4d28-88b7-dcced8014e1e 2024-03-26T16:59:44.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:44 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:44] INFO grpc.py:732: subsystem_add_ns: 5 2024-03-26T16:59:44.555 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:44] INFO grpc.py:843: Received request to add a namespace using NSID 5 and UUID dbd3d055-7949-4d28-88b7-dcced8014e1e to nqn.2016-06.io.spdk:cnode2, context: None 2024-03-26T16:59:44.555 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:44] INFO grpc.py:299: Received request to create bdev bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e from mypool/myimage25 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-26T16:59:44.556 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [2024-03-26 16:59:44.147558] bdev_rbd.c:1278:bdev_rbd_create: *NOTICE*: Add bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e rbd disk to lun 2024-03-26T16:59:44.556 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:44] INFO grpc.py:338: bdev_rbd_create: bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e, cluster_name cluster_context_2_0 2024-03-26T16:59:44.556 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:44] INFO grpc.py:709: Received request to add bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e to nqn.2016-06.io.spdk:cnode2 with ANA group id 2 using NSID 5 and UUID dbd3d055-7949-4d28-88b7-dcced8014e1e 2024-03-26T16:59:44.556 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:44] INFO grpc.py:732: subsystem_add_ns: 5 2024-03-26T16:59:44.896 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:59:44 smithi149 ceph-mon[34678]: pgmap v392: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 94 KiB/s rd, 2.2 KiB/s wr, 71 op/s 2024-03-26T16:59:44.991 INFO:tasks.workunit.client.3.smithi157.stderr:+ (( image_index++ )) 2024-03-26T16:59:44.991 INFO:tasks.workunit.client.3.smithi157.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2024-03-26T16:59:44.991 INFO:tasks.workunit.client.3.smithi157.stderr:+ image=myimage26 2024-03-26T16:59:44.991 INFO:tasks.workunit.client.3.smithi157.stderr:+ sudo podman run -it quay.io/barakda1/nvmeof-cli:qe_ceph_devel_21e59b2 --server-address 172.21.15.44 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode2 --rbd-pool mypool --rbd-image myimage26 --load-balancing-group 3 2024-03-26T16:59:45.015 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:59:44 smithi044 ceph-mon[30624]: pgmap v392: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 94 KiB/s rd, 2.2 KiB/s wr, 71 op/s 2024-03-26T16:59:45.055 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:59:44 smithi064 ceph-mon[34420]: pgmap v392: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 94 KiB/s rd, 2.2 KiB/s wr, 71 op/s 2024-03-26T16:59:45.056 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:44] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:59:45.056 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:44 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:44] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}] 2024-03-26T16:59:45.064 INFO:tasks.workunit.client.3.smithi157.stderr:time="2024-03-26T16:59:45Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2024-03-26T16:59:45.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:59:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-b[34416]: 2024-03-26T16:59:45.279+0000 7ff022916700 -1 mon.b@2(peon) e3 get_health_metrics reporting 4 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T16:59:45.753 INFO:tasks.workunit.client.3.smithi157.stdout:Adding namespace 6 to nqn.2016-06.io.spdk:cnode2, load balancing group 3: Successful 2024-03-26T16:59:46.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:45 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:45] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:59:46.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:45 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:45] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}] 2024-03-26T16:59:46.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:45 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:45] INFO grpc.py:843: Received request to add a namespace to nqn.2016-06.io.spdk:cnode2, context: 2024-03-26T16:59:46.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:45 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:45] INFO grpc.py:299: Received request to create bdev bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f from mypool/myimage26 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-26T16:59:46.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:45 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [2024-03-26 16:59:45.739034] bdev_rbd.c:1278:bdev_rbd_create: *NOTICE*: Add bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f rbd disk to lun 2024-03-26T16:59:46.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:45 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:45] INFO grpc.py:338: bdev_rbd_create: bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f, cluster_name cluster_context_3_0 2024-03-26T16:59:46.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:45 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:45] INFO grpc.py:709: Received request to add bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f to nqn.2016-06.io.spdk:cnode2 with ANA group id 3 using UUID b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f 2024-03-26T16:59:46.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:45 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:45] INFO grpc.py:732: subsystem_add_ns: 6 2024-03-26T16:59:46.055 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:45] INFO grpc.py:843: Received request to add a namespace using NSID 6 and UUID b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f to nqn.2016-06.io.spdk:cnode2, context: None 2024-03-26T16:59:46.056 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:45] INFO grpc.py:299: Received request to create bdev bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f from mypool/myimage26 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-26T16:59:46.056 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [2024-03-26 16:59:45.764524] bdev_rbd.c:1278:bdev_rbd_create: *NOTICE*: Add bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f rbd disk to lun 2024-03-26T16:59:46.056 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:45] INFO grpc.py:338: bdev_rbd_create: bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f, cluster_name cluster_context_3_0 2024-03-26T16:59:46.056 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:45] INFO grpc.py:709: Received request to add bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f to nqn.2016-06.io.spdk:cnode2 with ANA group id 3 using NSID 6 and UUID b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f 2024-03-26T16:59:46.056 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:45] INFO grpc.py:732: subsystem_add_ns: 6 2024-03-26T16:59:46.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:45 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:45] INFO grpc.py:843: Received request to add a namespace using NSID 6 and UUID b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f to nqn.2016-06.io.spdk:cnode2, context: None 2024-03-26T16:59:46.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:45 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:45] INFO grpc.py:299: Received request to create bdev bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f from mypool/myimage26 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-26T16:59:46.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:45 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [2024-03-26 16:59:45.765569] bdev_rbd.c:1278:bdev_rbd_create: *NOTICE*: Add bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f rbd disk to lun 2024-03-26T16:59:46.147 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:45 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:45] INFO grpc.py:338: bdev_rbd_create: bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f, cluster_name cluster_context_3_0 2024-03-26T16:59:46.147 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:45 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:45] INFO grpc.py:709: Received request to add bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f to nqn.2016-06.io.spdk:cnode2 with ANA group id 3 using NSID 6 and UUID b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f 2024-03-26T16:59:46.147 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:45 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:45] INFO grpc.py:732: subsystem_add_ns: 6 2024-03-26T16:59:46.147 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:45 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:45] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:59:46.147 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:45 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:45] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}] 2024-03-26T16:59:46.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:59:46 smithi044 ceph-mon[30624]: pgmap v393: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 74 KiB/s rd, 1.6 KiB/s wr, 59 op/s 2024-03-26T16:59:46.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:59:46 smithi064 ceph-mon[34420]: pgmap v393: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 74 KiB/s rd, 1.6 KiB/s wr, 59 op/s 2024-03-26T16:59:46.626 INFO:tasks.workunit.client.3.smithi157.stderr:+ (( image_index++ )) 2024-03-26T16:59:46.627 INFO:tasks.workunit.client.3.smithi157.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2024-03-26T16:59:46.627 INFO:tasks.workunit.client.3.smithi157.stderr:+ image=myimage27 2024-03-26T16:59:46.627 INFO:tasks.workunit.client.3.smithi157.stderr:+ sudo podman run -it quay.io/barakda1/nvmeof-cli:qe_ceph_devel_21e59b2 --server-address 172.21.15.44 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode2 --rbd-pool mypool --rbd-image myimage27 --load-balancing-group 1 2024-03-26T16:59:46.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:59:46 smithi149 ceph-mon[34678]: pgmap v393: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 74 KiB/s rd, 1.6 KiB/s wr, 59 op/s 2024-03-26T16:59:46.647 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:59:46 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 2024-03-26T16:59:46.203+0000 7fa707a55700 -1 mon.c@1(peon) e3 get_health_metrics reporting 3 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T16:59:46.711 INFO:tasks.workunit.client.3.smithi157.stderr:time="2024-03-26T16:59:46Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2024-03-26T16:59:47.055 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:46] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:59:47.056 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:46 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:46] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}] 2024-03-26T16:59:47.449 INFO:tasks.workunit.client.3.smithi157.stdout:Adding namespace 7 to nqn.2016-06.io.spdk:cnode2, load balancing group 1: Successful 2024-03-26T16:59:47.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:47 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:47] INFO grpc.py:843: Received request to add a namespace to nqn.2016-06.io.spdk:cnode2, context: 2024-03-26T16:59:47.766 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:47 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:47] INFO grpc.py:299: Received request to create bdev bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9 from mypool/myimage27 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-26T16:59:47.766 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:47 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [2024-03-26 16:59:47.435401] bdev_rbd.c:1278:bdev_rbd_create: *NOTICE*: Add bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9 rbd disk to lun 2024-03-26T16:59:47.766 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:47 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:47] INFO grpc.py:338: bdev_rbd_create: bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9, cluster_name cluster_context_1_0 2024-03-26T16:59:47.766 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:47 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:47] INFO grpc.py:709: Received request to add bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9 to nqn.2016-06.io.spdk:cnode2 with ANA group id 1 using UUID 58fe2e66-c15a-4e64-8a9e-47cc37be9ce9 2024-03-26T16:59:47.766 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:47 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:47] INFO grpc.py:732: subsystem_add_ns: 7 2024-03-26T16:59:47.766 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:47 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:47] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:59:47.766 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:47 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:47] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}] 2024-03-26T16:59:47.805 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:47 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:47] INFO grpc.py:843: Received request to add a namespace using NSID 7 and UUID 58fe2e66-c15a-4e64-8a9e-47cc37be9ce9 to nqn.2016-06.io.spdk:cnode2, context: None 2024-03-26T16:59:47.806 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:47 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:47] INFO grpc.py:299: Received request to create bdev bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9 from mypool/myimage27 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-26T16:59:47.806 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:47 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [2024-03-26 16:59:47.455428] bdev_rbd.c:1278:bdev_rbd_create: *NOTICE*: Add bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9 rbd disk to lun 2024-03-26T16:59:47.806 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:47 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:47] INFO grpc.py:338: bdev_rbd_create: bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9, cluster_name cluster_context_1_0 2024-03-26T16:59:47.806 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:47 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:47] INFO grpc.py:709: Received request to add bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9 to nqn.2016-06.io.spdk:cnode2 with ANA group id 1 using NSID 7 and UUID 58fe2e66-c15a-4e64-8a9e-47cc37be9ce9 2024-03-26T16:59:47.806 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:47 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:47] INFO grpc.py:732: subsystem_add_ns: 7 2024-03-26T16:59:47.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:47 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:47] INFO grpc.py:843: Received request to add a namespace using NSID 7 and UUID 58fe2e66-c15a-4e64-8a9e-47cc37be9ce9 to nqn.2016-06.io.spdk:cnode2, context: None 2024-03-26T16:59:47.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:47 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:47] INFO grpc.py:299: Received request to create bdev bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9 from mypool/myimage27 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-26T16:59:47.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:47 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [2024-03-26 16:59:47.461540] bdev_rbd.c:1278:bdev_rbd_create: *NOTICE*: Add bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9 rbd disk to lun 2024-03-26T16:59:47.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:47 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:47] INFO grpc.py:338: bdev_rbd_create: bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9, cluster_name cluster_context_1_0 2024-03-26T16:59:47.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:47 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:47] INFO grpc.py:709: Received request to add bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9 to nqn.2016-06.io.spdk:cnode2 with ANA group id 1 using NSID 7 and UUID 58fe2e66-c15a-4e64-8a9e-47cc37be9ce9 2024-03-26T16:59:47.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:47 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:47] INFO grpc.py:732: subsystem_add_ns: 7 2024-03-26T16:59:48.193 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:47 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:47] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:59:48.194 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:47 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:47] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}] 2024-03-26T16:59:48.277 INFO:tasks.workunit.client.3.smithi157.stderr:+ (( image_index++ )) 2024-03-26T16:59:48.277 INFO:tasks.workunit.client.3.smithi157.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2024-03-26T16:59:48.277 INFO:tasks.workunit.client.3.smithi157.stderr:+ image=myimage28 2024-03-26T16:59:48.277 INFO:tasks.workunit.client.3.smithi157.stderr:+ sudo podman run -it quay.io/barakda1/nvmeof-cli:qe_ceph_devel_21e59b2 --server-address 172.21.15.44 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode2 --rbd-pool mypool --rbd-image myimage28 --load-balancing-group 2 2024-03-26T16:59:48.355 INFO:tasks.workunit.client.3.smithi157.stderr:time="2024-03-26T16:59:48Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2024-03-26T16:59:48.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:59:48 smithi044 ceph-mon[30624]: pgmap v394: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 69 KiB/s rd, 1.5 KiB/s wr, 53 op/s 2024-03-26T16:59:48.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:59:48 smithi064 ceph-mon[34420]: pgmap v394: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 69 KiB/s rd, 1.5 KiB/s wr, 53 op/s 2024-03-26T16:59:48.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:59:48 smithi149 ceph-mon[34678]: pgmap v394: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 69 KiB/s rd, 1.5 KiB/s wr, 53 op/s 2024-03-26T16:59:49.055 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:48 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:48] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:59:49.056 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:48 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:48] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}] 2024-03-26T16:59:49.091 INFO:tasks.workunit.client.3.smithi157.stdout:Adding namespace 8 to nqn.2016-06.io.spdk:cnode2, load balancing group 2: Successful 2024-03-26T16:59:49.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:59:49 smithi149 ceph-mon[34678]: Health check update: 7 slow ops, oldest one blocked for 83 sec, daemons [mon.b,mon.c] have slow ops. (SLOW_OPS) 2024-03-26T16:59:49.396 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:49] INFO grpc.py:843: Received request to add a namespace using NSID 8 and UUID df083c66-8523-462f-b725-47c2fbdeb60d to nqn.2016-06.io.spdk:cnode2, context: None 2024-03-26T16:59:49.396 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:49] INFO grpc.py:299: Received request to create bdev bdev_df083c66-8523-462f-b725-47c2fbdeb60d from mypool/myimage28 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-26T16:59:49.396 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [2024-03-26 16:59:49.100791] bdev_rbd.c:1278:bdev_rbd_create: *NOTICE*: Add bdev_df083c66-8523-462f-b725-47c2fbdeb60d rbd disk to lun 2024-03-26T16:59:49.396 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:49] INFO grpc.py:338: bdev_rbd_create: bdev_df083c66-8523-462f-b725-47c2fbdeb60d, cluster_name cluster_context_2_0 2024-03-26T16:59:49.396 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:49] INFO grpc.py:709: Received request to add bdev_df083c66-8523-462f-b725-47c2fbdeb60d to nqn.2016-06.io.spdk:cnode2 with ANA group id 2 using NSID 8 and UUID df083c66-8523-462f-b725-47c2fbdeb60d 2024-03-26T16:59:49.397 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:49] INFO grpc.py:732: subsystem_add_ns: 8 2024-03-26T16:59:49.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:59:49 smithi044 ceph-mon[30624]: Health check update: 7 slow ops, oldest one blocked for 83 sec, daemons [mon.b,mon.c] have slow ops. (SLOW_OPS) 2024-03-26T16:59:49.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:49 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:49] INFO grpc.py:843: Received request to add a namespace to nqn.2016-06.io.spdk:cnode2, context: 2024-03-26T16:59:49.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:49 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:49] INFO grpc.py:299: Received request to create bdev bdev_df083c66-8523-462f-b725-47c2fbdeb60d from mypool/myimage28 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-26T16:59:49.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:49 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [2024-03-26 16:59:49.077482] bdev_rbd.c:1278:bdev_rbd_create: *NOTICE*: Add bdev_df083c66-8523-462f-b725-47c2fbdeb60d rbd disk to lun 2024-03-26T16:59:49.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:49 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:49] INFO grpc.py:338: bdev_rbd_create: bdev_df083c66-8523-462f-b725-47c2fbdeb60d, cluster_name cluster_context_2_0 2024-03-26T16:59:49.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:49 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:49] INFO grpc.py:709: Received request to add bdev_df083c66-8523-462f-b725-47c2fbdeb60d to nqn.2016-06.io.spdk:cnode2 with ANA group id 2 using UUID df083c66-8523-462f-b725-47c2fbdeb60d 2024-03-26T16:59:49.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:49 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:49] INFO grpc.py:732: subsystem_add_ns: 8 2024-03-26T16:59:49.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:59:49 smithi064 ceph-mon[34420]: Health check update: 7 slow ops, oldest one blocked for 83 sec, daemons [mon.b,mon.c] have slow ops. (SLOW_OPS) 2024-03-26T16:59:49.555 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:49 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:49] INFO grpc.py:843: Received request to add a namespace using NSID 8 and UUID df083c66-8523-462f-b725-47c2fbdeb60d to nqn.2016-06.io.spdk:cnode2, context: None 2024-03-26T16:59:49.556 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:49 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:49] INFO grpc.py:299: Received request to create bdev bdev_df083c66-8523-462f-b725-47c2fbdeb60d from mypool/myimage28 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-26T16:59:49.556 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:49 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [2024-03-26 16:59:49.104058] bdev_rbd.c:1278:bdev_rbd_create: *NOTICE*: Add bdev_df083c66-8523-462f-b725-47c2fbdeb60d rbd disk to lun 2024-03-26T16:59:49.556 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:49 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:49] INFO grpc.py:338: bdev_rbd_create: bdev_df083c66-8523-462f-b725-47c2fbdeb60d, cluster_name cluster_context_2_0 2024-03-26T16:59:49.556 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:49 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:49] INFO grpc.py:709: Received request to add bdev_df083c66-8523-462f-b725-47c2fbdeb60d to nqn.2016-06.io.spdk:cnode2 with ANA group id 2 using NSID 8 and UUID df083c66-8523-462f-b725-47c2fbdeb60d 2024-03-26T16:59:49.556 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:49 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:49] INFO grpc.py:732: subsystem_add_ns: 8 2024-03-26T16:59:49.928 INFO:tasks.workunit.client.3.smithi157.stderr:+ (( image_index++ )) 2024-03-26T16:59:49.928 INFO:tasks.workunit.client.3.smithi157.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2024-03-26T16:59:49.928 INFO:tasks.workunit.client.3.smithi157.stderr:+ image=myimage29 2024-03-26T16:59:49.928 INFO:tasks.workunit.client.3.smithi157.stderr:+ sudo podman run -it quay.io/barakda1/nvmeof-cli:qe_ceph_devel_21e59b2 --server-address 172.21.15.44 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode2 --rbd-pool mypool --rbd-image myimage29 --load-balancing-group 3 2024-03-26T16:59:50.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:49 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:49] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:59:50.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:49 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:49] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}] 2024-03-26T16:59:50.025 INFO:tasks.workunit.client.3.smithi157.stderr:time="2024-03-26T16:59:50Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2024-03-26T16:59:50.198 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:49] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:59:50.198 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:49] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}] 2024-03-26T16:59:50.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:59:50 smithi044 ceph-mon[30624]: pgmap v395: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 89 KiB/s rd, 2.0 KiB/s wr, 60 op/s 2024-03-26T16:59:50.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:59:50 smithi064 ceph-mon[34420]: pgmap v395: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 89 KiB/s rd, 2.0 KiB/s wr, 60 op/s 2024-03-26T16:59:50.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:59:50 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-b[34416]: 2024-03-26T16:59:50.278+0000 7ff022916700 -1 mon.b@2(peon) e3 get_health_metrics reporting 4 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T16:59:50.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:59:50 smithi149 ceph-mon[34678]: pgmap v395: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 89 KiB/s rd, 2.0 KiB/s wr, 60 op/s 2024-03-26T16:59:50.789 INFO:tasks.workunit.client.3.smithi157.stdout:Adding namespace 9 to nqn.2016-06.io.spdk:cnode2, load balancing group 3: Successful 2024-03-26T16:59:51.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:50 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:50] INFO grpc.py:843: Received request to add a namespace to nqn.2016-06.io.spdk:cnode2, context: 2024-03-26T16:59:51.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:50 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:50] INFO grpc.py:299: Received request to create bdev bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3 from mypool/myimage29 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-26T16:59:51.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:50 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [2024-03-26 16:59:50.774349] bdev_rbd.c:1278:bdev_rbd_create: *NOTICE*: Add bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3 rbd disk to lun 2024-03-26T16:59:51.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:50 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:50] INFO grpc.py:338: bdev_rbd_create: bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3, cluster_name cluster_context_3_0 2024-03-26T16:59:51.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:50 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:50] INFO grpc.py:709: Received request to add bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3 to nqn.2016-06.io.spdk:cnode2 with ANA group id 3 using UUID 0213ed81-dc60-4b5e-ac6b-64bdf671f2c3 2024-03-26T16:59:51.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:50 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:50] INFO grpc.py:732: subsystem_add_ns: 9 2024-03-26T16:59:51.056 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:50 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:50] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:59:51.056 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:50 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:50] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}] 2024-03-26T16:59:51.056 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:50 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:50] INFO grpc.py:843: Received request to add a namespace using NSID 9 and UUID 0213ed81-dc60-4b5e-ac6b-64bdf671f2c3 to nqn.2016-06.io.spdk:cnode2, context: None 2024-03-26T16:59:51.056 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:50 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:50] INFO grpc.py:299: Received request to create bdev bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3 from mypool/myimage29 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-26T16:59:51.056 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:50 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [2024-03-26 16:59:50.799850] bdev_rbd.c:1278:bdev_rbd_create: *NOTICE*: Add bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3 rbd disk to lun 2024-03-26T16:59:51.056 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:50 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:50] INFO grpc.py:338: bdev_rbd_create: bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3, cluster_name cluster_context_3_0 2024-03-26T16:59:51.056 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:50 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:50] INFO grpc.py:709: Received request to add bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3 to nqn.2016-06.io.spdk:cnode2 with ANA group id 3 using NSID 9 and UUID 0213ed81-dc60-4b5e-ac6b-64bdf671f2c3 2024-03-26T16:59:51.056 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:50 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:50] INFO grpc.py:732: subsystem_add_ns: 9 2024-03-26T16:59:51.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:50] INFO grpc.py:843: Received request to add a namespace using NSID 9 and UUID 0213ed81-dc60-4b5e-ac6b-64bdf671f2c3 to nqn.2016-06.io.spdk:cnode2, context: None 2024-03-26T16:59:51.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:50] INFO grpc.py:299: Received request to create bdev bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3 from mypool/myimage29 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-26T16:59:51.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [2024-03-26 16:59:50.796486] bdev_rbd.c:1278:bdev_rbd_create: *NOTICE*: Add bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3 rbd disk to lun 2024-03-26T16:59:51.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:50] INFO grpc.py:338: bdev_rbd_create: bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3, cluster_name cluster_context_3_0 2024-03-26T16:59:51.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:50] INFO grpc.py:709: Received request to add bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3 to nqn.2016-06.io.spdk:cnode2 with ANA group id 3 using NSID 9 and UUID 0213ed81-dc60-4b5e-ac6b-64bdf671f2c3 2024-03-26T16:59:51.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:50] INFO grpc.py:732: subsystem_add_ns: 9 2024-03-26T16:59:51.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:59:51 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 2024-03-26T16:59:51.204+0000 7fa707a55700 -1 mon.c@1(peon) e3 get_health_metrics reporting 3 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T16:59:51.663 INFO:tasks.workunit.client.3.smithi157.stderr:+ (( image_index++ )) 2024-03-26T16:59:51.663 INFO:tasks.workunit.client.3.smithi157.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2024-03-26T16:59:51.663 INFO:tasks.workunit.client.3.smithi157.stderr:+ image=myimage30 2024-03-26T16:59:51.663 INFO:tasks.workunit.client.3.smithi157.stderr:+ sudo podman run -it quay.io/barakda1/nvmeof-cli:qe_ceph_devel_21e59b2 --server-address 172.21.15.44 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode2 --rbd-pool mypool --rbd-image myimage30 --load-balancing-group 1 2024-03-26T16:59:51.744 INFO:tasks.workunit.client.3.smithi157.stderr:time="2024-03-26T16:59:51Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2024-03-26T16:59:52.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:51 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:51] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:59:52.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:51 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:51] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}] 2024-03-26T16:59:52.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:59:52 smithi149 ceph-mon[34678]: pgmap v396: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 72 KiB/s rd, 1.5 KiB/s wr, 53 op/s 2024-03-26T16:59:52.396 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:51 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:51] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:59:52.397 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:51 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:51] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}] 2024-03-26T16:59:52.446 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:59:52 smithi044 ceph-mon[30624]: pgmap v396: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 72 KiB/s rd, 1.5 KiB/s wr, 53 op/s 2024-03-26T16:59:52.446 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:52 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:52] INFO grpc.py:843: Received request to add a namespace to nqn.2016-06.io.spdk:cnode2, context: 2024-03-26T16:59:52.447 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:52 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:52] INFO grpc.py:299: Received request to create bdev bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8 from mypool/myimage30 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-26T16:59:52.447 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:52 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [2024-03-26 16:59:52.446238] bdev_rbd.c:1278:bdev_rbd_create: *NOTICE*: Add bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8 rbd disk to lun 2024-03-26T16:59:52.462 INFO:tasks.workunit.client.3.smithi157.stdout:Adding namespace 10 to nqn.2016-06.io.spdk:cnode2, load balancing group 1: Successful 2024-03-26T16:59:52.462 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:59:52 smithi064 ceph-mon[34420]: pgmap v396: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 72 KiB/s rd, 1.5 KiB/s wr, 53 op/s 2024-03-26T16:59:52.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:52 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:52] INFO grpc.py:338: bdev_rbd_create: bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8, cluster_name cluster_context_1_0 2024-03-26T16:59:52.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:52 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:52] INFO grpc.py:709: Received request to add bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8 to nqn.2016-06.io.spdk:cnode2 with ANA group id 1 using UUID b19dd955-58ce-4f68-b8cb-4f2022edf2c8 2024-03-26T16:59:52.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:52 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:52] INFO grpc.py:732: subsystem_add_ns: 10 2024-03-26T16:59:52.772 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:52 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:52] INFO grpc.py:843: Received request to add a namespace using NSID 10 and UUID b19dd955-58ce-4f68-b8cb-4f2022edf2c8 to nqn.2016-06.io.spdk:cnode2, context: None 2024-03-26T16:59:52.772 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:52 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:52] INFO grpc.py:299: Received request to create bdev bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8 from mypool/myimage30 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-26T16:59:52.772 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:52 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [2024-03-26 16:59:52.472282] bdev_rbd.c:1278:bdev_rbd_create: *NOTICE*: Add bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8 rbd disk to lun 2024-03-26T16:59:52.772 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:52 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:52] INFO grpc.py:338: bdev_rbd_create: bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8, cluster_name cluster_context_1_0 2024-03-26T16:59:52.772 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:52 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:52] INFO grpc.py:709: Received request to add bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8 to nqn.2016-06.io.spdk:cnode2 with ANA group id 1 using NSID 10 and UUID b19dd955-58ce-4f68-b8cb-4f2022edf2c8 2024-03-26T16:59:52.772 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:52 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:52] INFO grpc.py:732: subsystem_add_ns: 10 2024-03-26T16:59:52.772 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:52 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:52] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:59:52.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:52] INFO grpc.py:843: Received request to add a namespace using NSID 10 and UUID b19dd955-58ce-4f68-b8cb-4f2022edf2c8 to nqn.2016-06.io.spdk:cnode2, context: None 2024-03-26T16:59:52.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:52] INFO grpc.py:299: Received request to create bdev bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8 from mypool/myimage30 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-26T16:59:52.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [2024-03-26 16:59:52.473479] bdev_rbd.c:1278:bdev_rbd_create: *NOTICE*: Add bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8 rbd disk to lun 2024-03-26T16:59:52.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:52] INFO grpc.py:338: bdev_rbd_create: bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8, cluster_name cluster_context_1_0 2024-03-26T16:59:52.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:52] INFO grpc.py:709: Received request to add bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8 to nqn.2016-06.io.spdk:cnode2 with ANA group id 1 using NSID 10 and UUID b19dd955-58ce-4f68-b8cb-4f2022edf2c8 2024-03-26T16:59:52.897 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:52] INFO grpc.py:732: subsystem_add_ns: 10 2024-03-26T16:59:53.055 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:52 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:52] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}] 2024-03-26T16:59:53.342 INFO:tasks.workunit.client.3.smithi157.stderr:+ (( image_index++ )) 2024-03-26T16:59:53.342 INFO:tasks.workunit.client.3.smithi157.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2024-03-26T16:59:53.342 INFO:tasks.workunit.client.3.smithi157.stderr:+ image=myimage31 2024-03-26T16:59:53.342 INFO:tasks.workunit.client.3.smithi157.stderr:+ sudo podman run -it quay.io/barakda1/nvmeof-cli:qe_ceph_devel_21e59b2 --server-address 172.21.15.44 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode2 --rbd-pool mypool --rbd-image myimage31 --load-balancing-group 2 2024-03-26T16:59:53.425 INFO:tasks.workunit.client.3.smithi157.stderr:time="2024-03-26T16:59:53Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2024-03-26T16:59:53.896 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:59:53 smithi149 ceph-mon[34678]: Health check update: 7 slow ops, oldest one blocked for 88 sec, daemons [mon.b,mon.c] have slow ops. (SLOW_OPS) 2024-03-26T16:59:54.015 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:59:53 smithi044 ceph-mon[30624]: Health check update: 7 slow ops, oldest one blocked for 88 sec, daemons [mon.b,mon.c] have slow ops. (SLOW_OPS) 2024-03-26T16:59:54.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:53 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:53] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:59:54.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:53 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:53] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}] 2024-03-26T16:59:54.055 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:59:53 smithi064 ceph-mon[34420]: Health check update: 7 slow ops, oldest one blocked for 88 sec, daemons [mon.b,mon.c] have slow ops. (SLOW_OPS) 2024-03-26T16:59:54.123 INFO:tasks.workunit.client.3.smithi157.stdout:Adding namespace 11 to nqn.2016-06.io.spdk:cnode2, load balancing group 2: Successful 2024-03-26T16:59:54.396 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:53] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:59:54.396 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:53] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}] 2024-03-26T16:59:54.397 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:54 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:54] INFO grpc.py:843: Received request to add a namespace using NSID 11 and UUID 64dd9e25-4738-44d3-b164-38aca4721574 to nqn.2016-06.io.spdk:cnode2, context: None 2024-03-26T16:59:54.397 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:54 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:54] INFO grpc.py:299: Received request to create bdev bdev_64dd9e25-4738-44d3-b164-38aca4721574 from mypool/myimage31 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-26T16:59:54.397 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:54 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [2024-03-26 16:59:54.134013] bdev_rbd.c:1278:bdev_rbd_create: *NOTICE*: Add bdev_64dd9e25-4738-44d3-b164-38aca4721574 rbd disk to lun 2024-03-26T16:59:54.397 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:54 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:54] INFO grpc.py:338: bdev_rbd_create: bdev_64dd9e25-4738-44d3-b164-38aca4721574, cluster_name cluster_context_2_0 2024-03-26T16:59:54.397 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:54 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:54] INFO grpc.py:709: Received request to add bdev_64dd9e25-4738-44d3-b164-38aca4721574 to nqn.2016-06.io.spdk:cnode2 with ANA group id 2 using NSID 11 and UUID 64dd9e25-4738-44d3-b164-38aca4721574 2024-03-26T16:59:54.397 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:54 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:54] INFO grpc.py:732: subsystem_add_ns: 11 2024-03-26T16:59:54.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:54 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:54] INFO grpc.py:843: Received request to add a namespace to nqn.2016-06.io.spdk:cnode2, context: 2024-03-26T16:59:54.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:54 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:54] INFO grpc.py:299: Received request to create bdev bdev_64dd9e25-4738-44d3-b164-38aca4721574 from mypool/myimage31 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-26T16:59:54.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:54 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [2024-03-26 16:59:54.108102] bdev_rbd.c:1278:bdev_rbd_create: *NOTICE*: Add bdev_64dd9e25-4738-44d3-b164-38aca4721574 rbd disk to lun 2024-03-26T16:59:54.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:54 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:54] INFO grpc.py:338: bdev_rbd_create: bdev_64dd9e25-4738-44d3-b164-38aca4721574, cluster_name cluster_context_2_0 2024-03-26T16:59:54.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:54 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:54] INFO grpc.py:709: Received request to add bdev_64dd9e25-4738-44d3-b164-38aca4721574 to nqn.2016-06.io.spdk:cnode2 with ANA group id 2 using UUID 64dd9e25-4738-44d3-b164-38aca4721574 2024-03-26T16:59:54.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:54 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:54] INFO grpc.py:732: subsystem_add_ns: 11 2024-03-26T16:59:54.555 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:54 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:54] INFO grpc.py:843: Received request to add a namespace using NSID 11 and UUID 64dd9e25-4738-44d3-b164-38aca4721574 to nqn.2016-06.io.spdk:cnode2, context: None 2024-03-26T16:59:54.555 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:54 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:54] INFO grpc.py:299: Received request to create bdev bdev_64dd9e25-4738-44d3-b164-38aca4721574 from mypool/myimage31 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-26T16:59:54.555 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:54 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [2024-03-26 16:59:54.132283] bdev_rbd.c:1278:bdev_rbd_create: *NOTICE*: Add bdev_64dd9e25-4738-44d3-b164-38aca4721574 rbd disk to lun 2024-03-26T16:59:54.555 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:54 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:54] INFO grpc.py:338: bdev_rbd_create: bdev_64dd9e25-4738-44d3-b164-38aca4721574, cluster_name cluster_context_2_0 2024-03-26T16:59:54.556 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:54 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:54] INFO grpc.py:709: Received request to add bdev_64dd9e25-4738-44d3-b164-38aca4721574 to nqn.2016-06.io.spdk:cnode2 with ANA group id 2 using NSID 11 and UUID 64dd9e25-4738-44d3-b164-38aca4721574 2024-03-26T16:59:54.556 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:54 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:54] INFO grpc.py:732: subsystem_add_ns: 11 2024-03-26T16:59:54.896 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:59:54 smithi149 ceph-mon[34678]: pgmap v397: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 103 KiB/s rd, 2.2 KiB/s wr, 71 op/s 2024-03-26T16:59:54.977 INFO:tasks.workunit.client.3.smithi157.stderr:+ (( image_index++ )) 2024-03-26T16:59:54.977 INFO:tasks.workunit.client.3.smithi157.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2024-03-26T16:59:54.977 INFO:tasks.workunit.client.3.smithi157.stderr:+ image=myimage32 2024-03-26T16:59:54.977 INFO:tasks.workunit.client.3.smithi157.stderr:+ sudo podman run -it quay.io/barakda1/nvmeof-cli:qe_ceph_devel_21e59b2 --server-address 172.21.15.44 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode2 --rbd-pool mypool --rbd-image myimage32 --load-balancing-group 3 2024-03-26T16:59:55.015 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:59:54 smithi044 ceph-mon[30624]: pgmap v397: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 103 KiB/s rd, 2.2 KiB/s wr, 71 op/s 2024-03-26T16:59:55.055 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:59:54 smithi064 ceph-mon[34420]: pgmap v397: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 103 KiB/s rd, 2.2 KiB/s wr, 71 op/s 2024-03-26T16:59:55.056 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:54 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:54] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:59:55.056 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:54 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:54] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '44 2024-03-26T16:59:55.056 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:54 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: 20'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}] 2024-03-26T16:59:55.063 INFO:tasks.workunit.client.3.smithi157.stderr:time="2024-03-26T16:59:55Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2024-03-26T16:59:55.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:59:55 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-b[34416]: 2024-03-26T16:59:55.278+0000 7ff022916700 -1 mon.b@2(peon) e3 get_health_metrics reporting 4 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T16:59:55.775 INFO:tasks.workunit.client.3.smithi157.stdout:Adding namespace 12 to nqn.2016-06.io.spdk:cnode2, load balancing group 3: Successful 2024-03-26T16:59:55.917 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:55 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:55] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:59:55.917 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:55 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:55] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '44 2024-03-26T16:59:55.917 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:55 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 20'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}] 2024-03-26T16:59:55.917 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:55 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:55] INFO grpc.py:843: Received request to add a namespace to nqn.2016-06.io.spdk:cnode2, context: 2024-03-26T16:59:55.917 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:55 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:55] INFO grpc.py:299: Received request to create bdev bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2 from mypool/myimage32 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-26T16:59:55.917 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:55 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [2024-03-26 16:59:55.760518] bdev_rbd.c:1278:bdev_rbd_create: *NOTICE*: Add bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2 rbd disk to lun 2024-03-26T16:59:55.917 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:55 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:55] INFO grpc.py:338: bdev_rbd_create: bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2, cluster_name cluster_context_3_0 2024-03-26T16:59:55.917 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:55 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:55] INFO grpc.py:709: Received request to add bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2 to nqn.2016-06.io.spdk:cnode2 with ANA group id 3 using UUID f39c41fc-2f73-4d4b-9972-e1a944915be2 2024-03-26T16:59:55.917 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:55 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:55] INFO grpc.py:732: subsystem_add_ns: 12 2024-03-26T16:59:56.055 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:55 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:55] INFO grpc.py:843: Received request to add a namespace using NSID 12 and UUID f39c41fc-2f73-4d4b-9972-e1a944915be2 to nqn.2016-06.io.spdk:cnode2, context: None 2024-03-26T16:59:56.056 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:55 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:55] INFO grpc.py:299: Received request to create bdev bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2 from mypool/myimage32 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-26T16:59:56.056 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:55 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [2024-03-26 16:59:55.784439] bdev_rbd.c:1278:bdev_rbd_create: *NOTICE*: Add bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2 rbd disk to lun 2024-03-26T16:59:56.056 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:55 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:55] INFO grpc.py:338: bdev_rbd_create: bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2, cluster_name cluster_context_3_0 2024-03-26T16:59:56.056 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:55 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:55] INFO grpc.py:709: Received request to add bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2 to nqn.2016-06.io.spdk:cnode2 with ANA group id 3 using NSID 12 and UUID f39c41fc-2f73-4d4b-9972-e1a944915be2 2024-03-26T16:59:56.056 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:55 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:55] INFO grpc.py:732: subsystem_add_ns: 12 2024-03-26T16:59:56.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:55] INFO grpc.py:843: Received request to add a namespace using NSID 12 and UUID f39c41fc-2f73-4d4b-9972-e1a944915be2 to nqn.2016-06.io.spdk:cnode2, context: None 2024-03-26T16:59:56.149 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:55] INFO grpc.py:299: Received request to create bdev bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2 from mypool/myimage32 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-26T16:59:56.150 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [2024-03-26 16:59:55.786005] bdev_rbd.c:1278:bdev_rbd_create: *NOTICE*: Add bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2 rbd disk to lun 2024-03-26T16:59:56.150 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:55] INFO grpc.py:338: bdev_rbd_create: bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2, cluster_name cluster_context_3_0 2024-03-26T16:59:56.150 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:55] INFO grpc.py:709: Received request to add bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2 to nqn.2016-06.io.spdk:cnode2 with ANA group id 3 using NSID 12 and UUID f39c41fc-2f73-4d4b-9972-e1a944915be2 2024-03-26T16:59:56.150 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:55] INFO grpc.py:732: subsystem_add_ns: 12 2024-03-26T16:59:56.150 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:55] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:59:56.150 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:55] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T16:59:56.150 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}] 2024-03-26T16:59:56.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:59:56 smithi044 ceph-mon[30624]: pgmap v398: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 80 KiB/s rd, 1.6 KiB/s wr, 59 op/s 2024-03-26T16:59:56.557 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:59:56 smithi064 ceph-mon[34420]: pgmap v398: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 80 KiB/s rd, 1.6 KiB/s wr, 59 op/s 2024-03-26T16:59:56.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:59:56 smithi149 ceph-mon[34678]: pgmap v398: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 80 KiB/s rd, 1.6 KiB/s wr, 59 op/s 2024-03-26T16:59:56.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:59:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 2024-03-26T16:59:56.204+0000 7fa707a55700 -1 mon.c@1(peon) e3 get_health_metrics reporting 3 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T16:59:56.662 INFO:tasks.workunit.client.3.smithi157.stderr:+ (( image_index++ )) 2024-03-26T16:59:56.662 INFO:tasks.workunit.client.3.smithi157.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2024-03-26T16:59:56.662 INFO:tasks.workunit.client.3.smithi157.stderr:+ image=myimage33 2024-03-26T16:59:56.662 INFO:tasks.workunit.client.3.smithi157.stderr:+ sudo podman run -it quay.io/barakda1/nvmeof-cli:qe_ceph_devel_21e59b2 --server-address 172.21.15.44 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode2 --rbd-pool mypool --rbd-image myimage33 --load-balancing-group 1 2024-03-26T16:59:56.745 INFO:tasks.workunit.client.3.smithi157.stderr:time="2024-03-26T16:59:56Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2024-03-26T16:59:57.056 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:56 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:56] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:59:57.056 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:56 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:56] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T16:59:57.056 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:56 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}] 2024-03-26T16:59:57.446 INFO:tasks.workunit.client.3.smithi157.stdout:Adding namespace 13 to nqn.2016-06.io.spdk:cnode2, load balancing group 1: Successful 2024-03-26T16:59:57.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:57 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:57] INFO grpc.py:843: Received request to add a namespace to nqn.2016-06.io.spdk:cnode2, context: 2024-03-26T16:59:57.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:57 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:57] INFO grpc.py:299: Received request to create bdev bdev_b0126702-a889-4773-8787-b89b9db99211 from mypool/myimage33 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-26T16:59:57.766 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:57 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [2024-03-26 16:59:57.429704] bdev_rbd.c:1278:bdev_rbd_create: *NOTICE*: Add bdev_b0126702-a889-4773-8787-b89b9db99211 rbd disk to lun 2024-03-26T16:59:57.766 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:57 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:57] INFO grpc.py:338: bdev_rbd_create: bdev_b0126702-a889-4773-8787-b89b9db99211, cluster_name cluster_context_1_0 2024-03-26T16:59:57.766 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:57 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:57] INFO grpc.py:709: Received request to add bdev_b0126702-a889-4773-8787-b89b9db99211 to nqn.2016-06.io.spdk:cnode2 with ANA group id 1 using UUID b0126702-a889-4773-8787-b89b9db99211 2024-03-26T16:59:57.766 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:57 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:57] INFO grpc.py:732: subsystem_add_ns: 13 2024-03-26T16:59:57.766 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:57 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:57] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:59:57.766 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:57 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:57] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T16:59:57.766 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:57 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}] 2024-03-26T16:59:57.805 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:57 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:57] INFO grpc.py:843: Received request to add a namespace using NSID 13 and UUID b0126702-a889-4773-8787-b89b9db99211 to nqn.2016-06.io.spdk:cnode2, context: None 2024-03-26T16:59:57.805 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:57 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:57] INFO grpc.py:299: Received request to create bdev bdev_b0126702-a889-4773-8787-b89b9db99211 from mypool/myimage33 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-26T16:59:57.805 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:57 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [2024-03-26 16:59:57.456467] bdev_rbd.c:1278:bdev_rbd_create: *NOTICE*: Add bdev_b0126702-a889-4773-8787-b89b9db99211 rbd disk to lun 2024-03-26T16:59:57.806 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:57 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:57] INFO grpc.py:338: bdev_rbd_create: bdev_b0126702-a889-4773-8787-b89b9db99211, cluster_name cluster_context_1_0 2024-03-26T16:59:57.806 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:57 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:57] INFO grpc.py:709: Received request to add bdev_b0126702-a889-4773-8787-b89b9db99211 to nqn.2016-06.io.spdk:cnode2 with ANA group id 1 using NSID 13 and UUID b0126702-a889-4773-8787-b89b9db99211 2024-03-26T16:59:57.806 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:57 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:57] INFO grpc.py:732: subsystem_add_ns: 13 2024-03-26T16:59:57.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:57] INFO grpc.py:843: Received request to add a namespace using NSID 13 and UUID b0126702-a889-4773-8787-b89b9db99211 to nqn.2016-06.io.spdk:cnode2, context: None 2024-03-26T16:59:57.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:57] INFO grpc.py:299: Received request to create bdev bdev_b0126702-a889-4773-8787-b89b9db99211 from mypool/myimage33 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-26T16:59:57.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [2024-03-26 16:59:57.452809] bdev_rbd.c:1278:bdev_rbd_create: *NOTICE*: Add bdev_b0126702-a889-4773-8787-b89b9db99211 rbd disk to lun 2024-03-26T16:59:57.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:57] INFO grpc.py:338: bdev_rbd_create: bdev_b0126702-a889-4773-8787-b89b9db99211, cluster_name cluster_context_1_0 2024-03-26T16:59:57.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:57] INFO grpc.py:709: Received request to add bdev_b0126702-a889-4773-8787-b89b9db99211 to nqn.2016-06.io.spdk:cnode2 with ANA group id 1 using NSID 13 and UUID b0126702-a889-4773-8787-b89b9db99211 2024-03-26T16:59:57.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:57] INFO grpc.py:732: subsystem_add_ns: 13 2024-03-26T16:59:58.274 INFO:tasks.workunit.client.3.smithi157.stderr:+ (( image_index++ )) 2024-03-26T16:59:58.274 INFO:tasks.workunit.client.3.smithi157.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2024-03-26T16:59:58.274 INFO:tasks.workunit.client.3.smithi157.stderr:+ image=myimage34 2024-03-26T16:59:58.274 INFO:tasks.workunit.client.3.smithi157.stderr:+ sudo podman run -it quay.io/barakda1/nvmeof-cli:qe_ceph_devel_21e59b2 --server-address 172.21.15.44 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode2 --rbd-pool mypool --rbd-image myimage34 --load-balancing-group 2 2024-03-26T16:59:58.358 INFO:tasks.workunit.client.3.smithi157.stderr:time="2024-03-26T16:59:58Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2024-03-26T16:59:58.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:59:58 smithi149 ceph-mon[34678]: pgmap v399: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 75 KiB/s rd, 1.5 KiB/s wr, 54 op/s 2024-03-26T16:59:58.397 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:57] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:59:58.397 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:57] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T16:59:58.397 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}] 2024-03-26T16:59:58.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:59:58 smithi044 ceph-mon[30624]: pgmap v399: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 75 KiB/s rd, 1.5 KiB/s wr, 54 op/s 2024-03-26T16:59:58.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:59:58 smithi064 ceph-mon[34420]: pgmap v399: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 75 KiB/s rd, 1.5 KiB/s wr, 54 op/s 2024-03-26T16:59:59.056 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:58 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:58] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T16:59:59.056 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:58 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:58] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T16:59:59.056 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:58 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}] 2024-03-26T16:59:59.088 INFO:tasks.workunit.client.3.smithi157.stdout:Adding namespace 14 to nqn.2016-06.io.spdk:cnode2, load balancing group 2: Successful 2024-03-26T16:59:59.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 16:59:59 smithi149 ceph-mon[34678]: Health check update: 7 slow ops, oldest one blocked for 93 sec, daemons [mon.b,mon.c] have slow ops. (SLOW_OPS) 2024-03-26T16:59:59.396 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:59 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:59] INFO grpc.py:843: Received request to add a namespace using NSID 14 and UUID 6de556ce-fd3a-4e65-a5ef-e98b3708c676 to nqn.2016-06.io.spdk:cnode2, context: None 2024-03-26T16:59:59.396 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:59 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:59] INFO grpc.py:299: Received request to create bdev bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676 from mypool/myimage34 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-26T16:59:59.396 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:59 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [2024-03-26 16:59:59.097916] bdev_rbd.c:1278:bdev_rbd_create: *NOTICE*: Add bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676 rbd disk to lun 2024-03-26T16:59:59.396 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:59 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:59] INFO grpc.py:338: bdev_rbd_create: bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676, cluster_name cluster_context_2_0 2024-03-26T16:59:59.396 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:59 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:59] INFO grpc.py:709: Received request to add bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676 to nqn.2016-06.io.spdk:cnode2 with ANA group id 2 using NSID 14 and UUID 6de556ce-fd3a-4e65-a5ef-e98b3708c676 2024-03-26T16:59:59.396 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:59 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:59] INFO grpc.py:732: subsystem_add_ns: 14 2024-03-26T16:59:59.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 16:59:59 smithi044 ceph-mon[30624]: Health check update: 7 slow ops, oldest one blocked for 93 sec, daemons [mon.b,mon.c] have slow ops. (SLOW_OPS) 2024-03-26T16:59:59.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:59 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:59] INFO grpc.py:843: Received request to add a namespace to nqn.2016-06.io.spdk:cnode2, context: 2024-03-26T16:59:59.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:59 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:59] INFO grpc.py:299: Received request to create bdev bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676 from mypool/myimage34 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-26T16:59:59.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:59 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [2024-03-26 16:59:59.072926] bdev_rbd.c:1278:bdev_rbd_create: *NOTICE*: Add bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676 rbd disk to lun 2024-03-26T16:59:59.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:59 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:59] INFO grpc.py:338: bdev_rbd_create: bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676, cluster_name cluster_context_2_0 2024-03-26T16:59:59.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:59 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:59] INFO grpc.py:709: Received request to add bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676 to nqn.2016-06.io.spdk:cnode2 with ANA group id 2 using UUID 6de556ce-fd3a-4e65-a5ef-e98b3708c676 2024-03-26T16:59:59.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:59 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:59] INFO grpc.py:732: subsystem_add_ns: 14 2024-03-26T16:59:59.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 16:59:59 smithi064 ceph-mon[34420]: Health check update: 7 slow ops, oldest one blocked for 93 sec, daemons [mon.b,mon.c] have slow ops. (SLOW_OPS) 2024-03-26T16:59:59.555 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:59 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:59] INFO grpc.py:843: Received request to add a namespace using NSID 14 and UUID 6de556ce-fd3a-4e65-a5ef-e98b3708c676 to nqn.2016-06.io.spdk:cnode2, context: None 2024-03-26T16:59:59.555 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:59 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:59] INFO grpc.py:299: Received request to create bdev bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676 from mypool/myimage34 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-26T16:59:59.555 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:59 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [2024-03-26 16:59:59.099904] bdev_rbd.c:1278:bdev_rbd_create: *NOTICE*: Add bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676 rbd disk to lun 2024-03-26T16:59:59.556 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:59 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:59] INFO grpc.py:338: bdev_rbd_create: bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676, cluster_name cluster_context_2_0 2024-03-26T16:59:59.556 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:59 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:59] INFO grpc.py:709: Received request to add bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676 to nqn.2016-06.io.spdk:cnode2 with ANA group id 2 using NSID 14 and UUID 6de556ce-fd3a-4e65-a5ef-e98b3708c676 2024-03-26T16:59:59.556 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 16:59:59 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 16:59:59] INFO grpc.py:732: subsystem_add_ns: 14 2024-03-26T16:59:59.967 INFO:tasks.workunit.client.3.smithi157.stderr:+ (( image_index++ )) 2024-03-26T16:59:59.967 INFO:tasks.workunit.client.3.smithi157.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2024-03-26T16:59:59.967 INFO:tasks.workunit.client.3.smithi157.stderr:+ image=myimage35 2024-03-26T16:59:59.967 INFO:tasks.workunit.client.3.smithi157.stderr:+ sudo podman run -it quay.io/barakda1/nvmeof-cli:qe_ceph_devel_21e59b2 --server-address 172.21.15.44 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode2 --rbd-pool mypool --rbd-image myimage35 --load-balancing-group 3 2024-03-26T17:00:00.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:59 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:59] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:00:00.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:59 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 16:59:59] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:00:00.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 16:59:59 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}] 2024-03-26T17:00:00.043 INFO:tasks.workunit.client.3.smithi157.stderr:time="2024-03-26T17:00:00Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2024-03-26T17:00:00.298 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:00:00 smithi149 ceph-mon[34678]: Health detail: HEALTH_WARN 7 slow ops, oldest one blocked for 93 sec, daemons [mon.b,mon.c] have slow ops. 2024-03-26T17:00:00.298 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:00:00 smithi149 ceph-mon[34678]: [WRN] SLOW_OPS: 7 slow ops, oldest one blocked for 93 sec, daemons [mon.b,mon.c] have slow ops. 2024-03-26T17:00:00.298 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:00:00 smithi149 ceph-mon[34678]: pgmap v400: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 103 KiB/s rd, 2.1 KiB/s wr, 65 op/s 2024-03-26T17:00:00.298 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:59 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:59] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:00:00.298 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:59 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 16:59:59] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:00:00.299 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 16:59:59 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}] 2024-03-26T17:00:00.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:00:00 smithi044 ceph-mon[30624]: Health detail: HEALTH_WARN 7 slow ops, oldest one blocked for 93 sec, daemons [mon.b,mon.c] have slow ops. 2024-03-26T17:00:00.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:00:00 smithi044 ceph-mon[30624]: [WRN] SLOW_OPS: 7 slow ops, oldest one blocked for 93 sec, daemons [mon.b,mon.c] have slow ops. 2024-03-26T17:00:00.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:00:00 smithi044 ceph-mon[30624]: pgmap v400: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 103 KiB/s rd, 2.1 KiB/s wr, 65 op/s 2024-03-26T17:00:00.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:00:00 smithi064 ceph-mon[34420]: Health detail: HEALTH_WARN 7 slow ops, oldest one blocked for 93 sec, daemons [mon.b,mon.c] have slow ops. 2024-03-26T17:00:00.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:00:00 smithi064 ceph-mon[34420]: [WRN] SLOW_OPS: 7 slow ops, oldest one blocked for 93 sec, daemons [mon.b,mon.c] have slow ops. 2024-03-26T17:00:00.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:00:00 smithi064 ceph-mon[34420]: pgmap v400: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 103 KiB/s rd, 2.1 KiB/s wr, 65 op/s 2024-03-26T17:00:00.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:00:00 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-b[34416]: 2024-03-26T17:00:00.278+0000 7ff022916700 -1 mon.b@2(peon) e3 get_health_metrics reporting 4 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T17:00:00.774 INFO:tasks.workunit.client.3.smithi157.stdout:Adding namespace 15 to nqn.2016-06.io.spdk:cnode2, load balancing group 3: Successful 2024-03-26T17:00:01.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:00 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:00] INFO grpc.py:843: Received request to add a namespace to nqn.2016-06.io.spdk:cnode2, context: 2024-03-26T17:00:01.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:00 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:00] INFO grpc.py:299: Received request to create bdev bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab from mypool/myimage35 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-26T17:00:01.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:00 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [2024-03-26 17:00:00.758597] bdev_rbd.c:1278:bdev_rbd_create: *NOTICE*: Add bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab rbd disk to lun 2024-03-26T17:00:01.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:00 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:00] INFO grpc.py:338: bdev_rbd_create: bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab, cluster_name cluster_context_3_0 2024-03-26T17:00:01.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:00 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:00] INFO grpc.py:709: Received request to add bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab to nqn.2016-06.io.spdk:cnode2 with ANA group id 3 using UUID 3e830603-72e5-456c-88e5-7bb0898fd4ab 2024-03-26T17:00:01.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:00 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:00] INFO grpc.py:732: subsystem_add_ns: 15 2024-03-26T17:00:01.058 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:00 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:00:00] INFO grpc.py:843: Received request to add a namespace using NSID 15 and UUID 3e830603-72e5-456c-88e5-7bb0898fd4ab to nqn.2016-06.io.spdk:cnode2, context: None 2024-03-26T17:00:01.058 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:00 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:00:00] INFO grpc.py:299: Received request to create bdev bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab from mypool/myimage35 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-26T17:00:01.058 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:00 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [2024-03-26 17:00:00.784424] bdev_rbd.c:1278:bdev_rbd_create: *NOTICE*: Add bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab rbd disk to lun 2024-03-26T17:00:01.058 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:00 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:00:00] INFO grpc.py:338: bdev_rbd_create: bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab, cluster_name cluster_context_3_0 2024-03-26T17:00:01.058 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:00 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:00:00] INFO grpc.py:709: Received request to add bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab to nqn.2016-06.io.spdk:cnode2 with ANA group id 3 using NSID 15 and UUID 3e830603-72e5-456c-88e5-7bb0898fd4ab 2024-03-26T17:00:01.058 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:00 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:00:00] INFO grpc.py:732: subsystem_add_ns: 15 2024-03-26T17:00:01.059 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:00 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:00:00] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:00:01.059 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:00 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:00:00] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:00:01.059 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:00 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}] 2024-03-26T17:00:01.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:00 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:00:00] INFO grpc.py:843: Received request to add a namespace using NSID 15 and UUID 3e830603-72e5-456c-88e5-7bb0898fd4ab to nqn.2016-06.io.spdk:cnode2, context: None 2024-03-26T17:00:01.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:00 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:00:00] INFO grpc.py:299: Received request to create bdev bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab from mypool/myimage35 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-26T17:00:01.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:00 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [2024-03-26 17:00:00.781043] bdev_rbd.c:1278:bdev_rbd_create: *NOTICE*: Add bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab rbd disk to lun 2024-03-26T17:00:01.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:00 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:00:00] INFO grpc.py:338: bdev_rbd_create: bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab, cluster_name cluster_context_3_0 2024-03-26T17:00:01.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:00 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:00:00] INFO grpc.py:709: Received request to add bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab to nqn.2016-06.io.spdk:cnode2 with ANA group id 3 using NSID 15 and UUID 3e830603-72e5-456c-88e5-7bb0898fd4ab 2024-03-26T17:00:01.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:00 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:00:00] INFO grpc.py:732: subsystem_add_ns: 15 2024-03-26T17:00:01.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:00:01 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 2024-03-26T17:00:01.204+0000 7fa707a55700 -1 mon.c@1(peon) e3 get_health_metrics reporting 3 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T17:00:01.659 INFO:tasks.workunit.client.3.smithi157.stderr:+ (( image_index++ )) 2024-03-26T17:00:01.659 INFO:tasks.workunit.client.3.smithi157.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2024-03-26T17:00:01.659 INFO:tasks.workunit.client.3.smithi157.stderr:+ image=myimage36 2024-03-26T17:00:01.660 INFO:tasks.workunit.client.3.smithi157.stderr:+ sudo podman run -it quay.io/barakda1/nvmeof-cli:qe_ceph_devel_21e59b2 --server-address 172.21.15.44 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode2 --rbd-pool mypool --rbd-image myimage36 --load-balancing-group 1 2024-03-26T17:00:01.750 INFO:tasks.workunit.client.3.smithi157.stderr:time="2024-03-26T17:00:01Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2024-03-26T17:00:02.017 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:01 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:01] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:00:02.017 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:01 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:01] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:00:02.018 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:01 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}] 2024-03-26T17:00:02.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:00:02 smithi149 ceph-mon[34678]: pgmap v401: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 83 KiB/s rd, 1.6 KiB/s wr, 59 op/s 2024-03-26T17:00:02.403 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:01 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:00:01] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:00:02.403 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:02 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:00:02] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:00:02.403 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:02 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}] 2024-03-26T17:00:02.444 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:00:02 smithi044 ceph-mon[30624]: pgmap v401: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 83 KiB/s rd, 1.6 KiB/s wr, 59 op/s 2024-03-26T17:00:02.445 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:02 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:02] INFO grpc.py:843: Received request to add a namespace to nqn.2016-06.io.spdk:cnode2, context: 2024-03-26T17:00:02.445 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:02 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:02] INFO grpc.py:299: Received request to create bdev bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c from mypool/myimage36 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-26T17:00:02.445 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:02 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [2024-03-26 17:00:02.444556] bdev_rbd.c:1278:bdev_rbd_create: *NOTICE*: Add bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c rbd disk to lun 2024-03-26T17:00:02.460 INFO:tasks.workunit.client.3.smithi157.stdout:Adding namespace 16 to nqn.2016-06.io.spdk:cnode2, load balancing group 1: Successful 2024-03-26T17:00:02.460 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:00:02 smithi064 ceph-mon[34420]: pgmap v401: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 83 KiB/s rd, 1.6 KiB/s wr, 59 op/s 2024-03-26T17:00:02.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:02 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:02] INFO grpc.py:338: bdev_rbd_create: bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c, cluster_name cluster_context_1_0 2024-03-26T17:00:02.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:02 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:02] INFO grpc.py:709: Received request to add bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c to nqn.2016-06.io.spdk:cnode2 with ANA group id 1 using UUID b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c 2024-03-26T17:00:02.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:02 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:02] INFO grpc.py:732: subsystem_add_ns: 16 2024-03-26T17:00:02.805 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:02 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:00:02] INFO grpc.py:843: Received request to add a namespace using NSID 16 and UUID b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c to nqn.2016-06.io.spdk:cnode2, context: None 2024-03-26T17:00:02.806 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:02 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:00:02] INFO grpc.py:299: Received request to create bdev bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c from mypool/myimage36 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-26T17:00:02.806 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:02 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [2024-03-26 17:00:02.468507] bdev_rbd.c:1278:bdev_rbd_create: *NOTICE*: Add bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c rbd disk to lun 2024-03-26T17:00:02.806 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:02 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:00:02] INFO grpc.py:338: bdev_rbd_create: bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c, cluster_name cluster_context_1_0 2024-03-26T17:00:02.806 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:02 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:00:02] INFO grpc.py:709: Received request to add bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c to nqn.2016-06.io.spdk:cnode2 with ANA group id 1 using NSID 16 and UUID b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c 2024-03-26T17:00:02.806 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:02 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:00:02] INFO grpc.py:732: subsystem_add_ns: 16 2024-03-26T17:00:02.897 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:02 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:00:02] INFO grpc.py:843: Received request to add a namespace using NSID 16 and UUID b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c to nqn.2016-06.io.spdk:cnode2, context: None 2024-03-26T17:00:02.898 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:02 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:00:02] INFO grpc.py:299: Received request to create bdev bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c from mypool/myimage36 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-26T17:00:02.898 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:02 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [2024-03-26 17:00:02.469272] bdev_rbd.c:1278:bdev_rbd_create: *NOTICE*: Add bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c rbd disk to lun 2024-03-26T17:00:02.898 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:02 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:00:02] INFO grpc.py:338: bdev_rbd_create: bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c, cluster_name cluster_context_1_0 2024-03-26T17:00:02.898 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:02 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:00:02] INFO grpc.py:709: Received request to add bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c to nqn.2016-06.io.spdk:cnode2 with ANA group id 1 using NSID 16 and UUID b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c 2024-03-26T17:00:02.898 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:02 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:00:02] INFO grpc.py:732: subsystem_add_ns: 16 2024-03-26T17:00:03.270 INFO:tasks.workunit.client.3.smithi157.stderr:+ (( image_index++ )) 2024-03-26T17:00:03.270 INFO:tasks.workunit.client.3.smithi157.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2024-03-26T17:00:03.271 INFO:tasks.workunit.client.3.smithi157.stderr:+ image=myimage37 2024-03-26T17:00:03.271 INFO:tasks.workunit.client.3.smithi157.stderr:+ sudo podman run -it quay.io/barakda1/nvmeof-cli:qe_ceph_devel_21e59b2 --server-address 172.21.15.44 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode2 --rbd-pool mypool --rbd-image myimage37 --load-balancing-group 2 2024-03-26T17:00:03.305 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:02 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:00:02] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:00:03.306 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:02 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:00:02] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:00:03.306 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:02 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}] 2024-03-26T17:00:03.359 INFO:tasks.workunit.client.3.smithi157.stderr:time="2024-03-26T17:00:03Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2024-03-26T17:00:03.896 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:00:03 smithi149 ceph-mon[34678]: Health check update: 7 slow ops, oldest one blocked for 98 sec, daemons [mon.b,mon.c] have slow ops. (SLOW_OPS) 2024-03-26T17:00:04.015 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:00:03 smithi044 ceph-mon[30624]: Health check update: 7 slow ops, oldest one blocked for 98 sec, daemons [mon.b,mon.c] have slow ops. (SLOW_OPS) 2024-03-26T17:00:04.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:03 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:03] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:00:04.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:03 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:03] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:00:04.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:03 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}] 2024-03-26T17:00:04.055 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:00:03 smithi064 ceph-mon[34420]: Health check update: 7 slow ops, oldest one blocked for 98 sec, daemons [mon.b,mon.c] have slow ops. (SLOW_OPS) 2024-03-26T17:00:04.108 INFO:tasks.workunit.client.3.smithi157.stdout:Adding namespace 17 to nqn.2016-06.io.spdk:cnode2, load balancing group 2: Successful 2024-03-26T17:00:04.396 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:04 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:00:04] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:00:04.396 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:04 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:00:04] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:00:04.397 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:04 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}] 2024-03-26T17:00:04.397 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:04 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:00:04] INFO grpc.py:843: Received request to add a namespace using NSID 17 and UUID ca27fdbb-df6d-4379-a6b3-8550edf613bb to nqn.2016-06.io.spdk:cnode2, context: None 2024-03-26T17:00:04.397 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:04 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:00:04] INFO grpc.py:299: Received request to create bdev bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb from mypool/myimage37 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-26T17:00:04.397 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:04 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [2024-03-26 17:00:04.117135] bdev_rbd.c:1278:bdev_rbd_create: *NOTICE*: Add bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb rbd disk to lun 2024-03-26T17:00:04.397 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:04 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:00:04] INFO grpc.py:338: bdev_rbd_create: bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb, cluster_name cluster_context_2_0 2024-03-26T17:00:04.397 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:04 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:00:04] INFO grpc.py:709: Received request to add bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb to nqn.2016-06.io.spdk:cnode2 with ANA group id 2 using NSID 17 and UUID ca27fdbb-df6d-4379-a6b3-8550edf613bb 2024-03-26T17:00:04.397 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:04 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:00:04] INFO grpc.py:732: subsystem_add_ns: 17 2024-03-26T17:00:04.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:04 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:04] INFO grpc.py:843: Received request to add a namespace to nqn.2016-06.io.spdk:cnode2, context: 2024-03-26T17:00:04.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:04 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:04] INFO grpc.py:299: Received request to create bdev bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb from mypool/myimage37 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-26T17:00:04.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:04 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [2024-03-26 17:00:04.094004] bdev_rbd.c:1278:bdev_rbd_create: *NOTICE*: Add bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb rbd disk to lun 2024-03-26T17:00:04.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:04 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:04] INFO grpc.py:338: bdev_rbd_create: bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb, cluster_name cluster_context_2_0 2024-03-26T17:00:04.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:04 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:04] INFO grpc.py:709: Received request to add bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb to nqn.2016-06.io.spdk:cnode2 with ANA group id 2 using UUID ca27fdbb-df6d-4379-a6b3-8550edf613bb 2024-03-26T17:00:04.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:04 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:04] INFO grpc.py:732: subsystem_add_ns: 17 2024-03-26T17:00:04.555 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:04 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:00:04] INFO grpc.py:843: Received request to add a namespace using NSID 17 and UUID ca27fdbb-df6d-4379-a6b3-8550edf613bb to nqn.2016-06.io.spdk:cnode2, context: None 2024-03-26T17:00:04.556 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:04 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:00:04] INFO grpc.py:299: Received request to create bdev bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb from mypool/myimage37 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-26T17:00:04.556 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:04 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [2024-03-26 17:00:04.116134] bdev_rbd.c:1278:bdev_rbd_create: *NOTICE*: Add bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb rbd disk to lun 2024-03-26T17:00:04.556 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:04 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:00:04] INFO grpc.py:338: bdev_rbd_create: bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb, cluster_name cluster_context_2_0 2024-03-26T17:00:04.556 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:04 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:00:04] INFO grpc.py:709: Received request to add bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb to nqn.2016-06.io.spdk:cnode2 with ANA group id 2 using NSID 17 and UUID ca27fdbb-df6d-4379-a6b3-8550edf613bb 2024-03-26T17:00:04.556 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:04 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:00:04] INFO grpc.py:732: subsystem_add_ns: 17 2024-03-26T17:00:04.896 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:00:04 smithi149 ceph-mon[34678]: pgmap v402: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 112 KiB/s rd, 2.2 KiB/s wr, 72 op/s 2024-03-26T17:00:04.987 INFO:tasks.workunit.client.3.smithi157.stderr:+ (( image_index++ )) 2024-03-26T17:00:04.987 INFO:tasks.workunit.client.3.smithi157.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2024-03-26T17:00:04.987 INFO:tasks.workunit.client.3.smithi157.stderr:+ image=myimage38 2024-03-26T17:00:04.987 INFO:tasks.workunit.client.3.smithi157.stderr:+ sudo podman run -it quay.io/barakda1/nvmeof-cli:qe_ceph_devel_21e59b2 --server-address 172.21.15.44 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode2 --rbd-pool mypool --rbd-image myimage38 --load-balancing-group 3 2024-03-26T17:00:05.015 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:00:04 smithi044 ceph-mon[30624]: pgmap v402: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 112 KiB/s rd, 2.2 KiB/s wr, 72 op/s 2024-03-26T17:00:05.055 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:00:04 smithi064 ceph-mon[34420]: pgmap v402: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 112 KiB/s rd, 2.2 KiB/s wr, 72 op/s 2024-03-26T17:00:05.056 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:04 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:00:04] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:00:05.056 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:04 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:00:04] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:00:05.056 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:04 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}] 2024-03-26T17:00:05.064 INFO:tasks.workunit.client.3.smithi157.stderr:time="2024-03-26T17:00:05Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2024-03-26T17:00:05.558 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:00:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-b[34416]: 2024-03-26T17:00:05.279+0000 7ff022916700 -1 mon.b@2(peon) e3 get_health_metrics reporting 4 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T17:00:05.804 INFO:tasks.workunit.client.3.smithi157.stdout:Adding namespace 18 to nqn.2016-06.io.spdk:cnode2, load balancing group 3: Successful 2024-03-26T17:00:06.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:05 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:05] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:00:06.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:05 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:05] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:00:06.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:05 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}] 2024-03-26T17:00:06.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:05 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:05] INFO grpc.py:843: Received request to add a namespace to nqn.2016-06.io.spdk:cnode2, context: 2024-03-26T17:00:06.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:05 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:05] INFO grpc.py:299: Received request to create bdev bdev_856c7df5-918e-47bc-865f-bf945817a40a from mypool/myimage38 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-26T17:00:06.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:05 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [2024-03-26 17:00:05.789563] bdev_rbd.c:1278:bdev_rbd_create: *NOTICE*: Add bdev_856c7df5-918e-47bc-865f-bf945817a40a rbd disk to lun 2024-03-26T17:00:06.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:05 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:05] INFO grpc.py:338: bdev_rbd_create: bdev_856c7df5-918e-47bc-865f-bf945817a40a, cluster_name cluster_context_3_0 2024-03-26T17:00:06.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:05 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:05] INFO grpc.py:709: Received request to add bdev_856c7df5-918e-47bc-865f-bf945817a40a to nqn.2016-06.io.spdk:cnode2 with ANA group id 3 using UUID 856c7df5-918e-47bc-865f-bf945817a40a 2024-03-26T17:00:06.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:05 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:05] INFO grpc.py:732: subsystem_add_ns: 18 2024-03-26T17:00:06.055 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:00:05] INFO grpc.py:843: Received request to add a namespace using NSID 18 and UUID 856c7df5-918e-47bc-865f-bf945817a40a to nqn.2016-06.io.spdk:cnode2, context: None 2024-03-26T17:00:06.056 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:00:05] INFO grpc.py:299: Received request to create bdev bdev_856c7df5-918e-47bc-865f-bf945817a40a from mypool/myimage38 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-26T17:00:06.056 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [2024-03-26 17:00:05.811775] bdev_rbd.c:1278:bdev_rbd_create: *NOTICE*: Add bdev_856c7df5-918e-47bc-865f-bf945817a40a rbd disk to lun 2024-03-26T17:00:06.056 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:00:05] INFO grpc.py:338: bdev_rbd_create: bdev_856c7df5-918e-47bc-865f-bf945817a40a, cluster_name cluster_context_3_0 2024-03-26T17:00:06.056 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:00:05] INFO grpc.py:709: Received request to add bdev_856c7df5-918e-47bc-865f-bf945817a40a to nqn.2016-06.io.spdk:cnode2 with ANA group id 3 using NSID 18 and UUID 856c7df5-918e-47bc-865f-bf945817a40a 2024-03-26T17:00:06.056 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:00:05] INFO grpc.py:732: subsystem_add_ns: 18 2024-03-26T17:00:06.147 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:05 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:00:05] INFO grpc.py:843: Received request to add a namespace using NSID 18 and UUID 856c7df5-918e-47bc-865f-bf945817a40a to nqn.2016-06.io.spdk:cnode2, context: None 2024-03-26T17:00:06.147 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:05 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:00:05] INFO grpc.py:299: Received request to create bdev bdev_856c7df5-918e-47bc-865f-bf945817a40a from mypool/myimage38 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-26T17:00:06.147 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:05 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [2024-03-26 17:00:05.812783] bdev_rbd.c:1278:bdev_rbd_create: *NOTICE*: Add bdev_856c7df5-918e-47bc-865f-bf945817a40a rbd disk to lun 2024-03-26T17:00:06.147 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:05 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:00:05] INFO grpc.py:338: bdev_rbd_create: bdev_856c7df5-918e-47bc-865f-bf945817a40a, cluster_name cluster_context_3_0 2024-03-26T17:00:06.147 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:05 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:00:05] INFO grpc.py:709: Received request to add bdev_856c7df5-918e-47bc-865f-bf945817a40a to nqn.2016-06.io.spdk:cnode2 with ANA group id 3 using NSID 18 and UUID 856c7df5-918e-47bc-865f-bf945817a40a 2024-03-26T17:00:06.147 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:05 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:00:05] INFO grpc.py:732: subsystem_add_ns: 18 2024-03-26T17:00:06.147 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:00:06] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:00:06.147 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:00:06] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:00:06.148 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}] 2024-03-26T17:00:06.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:00:06 smithi044 ceph-mon[30624]: pgmap v403: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 81 KiB/s rd, 1.5 KiB/s wr, 55 op/s 2024-03-26T17:00:06.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:00:06 smithi064 ceph-mon[34420]: pgmap v403: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 81 KiB/s rd, 1.5 KiB/s wr, 55 op/s 2024-03-26T17:00:06.630 INFO:tasks.workunit.client.3.smithi157.stderr:+ (( image_index++ )) 2024-03-26T17:00:06.630 INFO:tasks.workunit.client.3.smithi157.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2024-03-26T17:00:06.630 INFO:tasks.workunit.client.3.smithi157.stderr:+ image=myimage39 2024-03-26T17:00:06.630 INFO:tasks.workunit.client.3.smithi157.stderr:+ sudo podman run -it quay.io/barakda1/nvmeof-cli:qe_ceph_devel_21e59b2 --server-address 172.21.15.44 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode2 --rbd-pool mypool --rbd-image myimage39 --load-balancing-group 1 2024-03-26T17:00:06.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:00:06 smithi149 ceph-mon[34678]: pgmap v403: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 81 KiB/s rd, 1.5 KiB/s wr, 55 op/s 2024-03-26T17:00:06.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:00:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 2024-03-26T17:00:06.205+0000 7fa707a55700 -1 mon.c@1(peon) e3 get_health_metrics reporting 3 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T17:00:06.712 INFO:tasks.workunit.client.3.smithi157.stderr:time="2024-03-26T17:00:06Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2024-03-26T17:00:07.306 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:06 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:00:06] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:00:07.306 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:06 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:00:06] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:00:07.306 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:06 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}] 2024-03-26T17:00:07.407 INFO:tasks.workunit.client.3.smithi157.stdout:Adding namespace 19 to nqn.2016-06.io.spdk:cnode2, load balancing group 1: Successful 2024-03-26T17:00:07.702 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:07 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:07] INFO grpc.py:843: Received request to add a namespace to nqn.2016-06.io.spdk:cnode2, context: 2024-03-26T17:00:07.703 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:07 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:07] INFO grpc.py:299: Received request to create bdev bdev_73911108-c449-4dde-9e0b-f3c55fa58540 from mypool/myimage39 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-26T17:00:07.703 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:07 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [2024-03-26 17:00:07.390362] bdev_rbd.c:1278:bdev_rbd_create: *NOTICE*: Add bdev_73911108-c449-4dde-9e0b-f3c55fa58540 rbd disk to lun 2024-03-26T17:00:07.703 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:07 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:07] INFO grpc.py:338: bdev_rbd_create: bdev_73911108-c449-4dde-9e0b-f3c55fa58540, cluster_name cluster_context_1_0 2024-03-26T17:00:07.703 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:07 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:07] INFO grpc.py:709: Received request to add bdev_73911108-c449-4dde-9e0b-f3c55fa58540 to nqn.2016-06.io.spdk:cnode2 with ANA group id 1 using UUID 73911108-c449-4dde-9e0b-f3c55fa58540 2024-03-26T17:00:07.703 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:07 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:07] INFO grpc.py:732: subsystem_add_ns: 19 2024-03-26T17:00:07.703 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:07 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:07] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:00:07.805 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:07 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:00:07] INFO grpc.py:843: Received request to add a namespace using NSID 19 and UUID 73911108-c449-4dde-9e0b-f3c55fa58540 to nqn.2016-06.io.spdk:cnode2, context: None 2024-03-26T17:00:07.805 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:07 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:00:07] INFO grpc.py:299: Received request to create bdev bdev_73911108-c449-4dde-9e0b-f3c55fa58540 from mypool/myimage39 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-26T17:00:07.806 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:07 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [2024-03-26 17:00:07.416259] bdev_rbd.c:1278:bdev_rbd_create: *NOTICE*: Add bdev_73911108-c449-4dde-9e0b-f3c55fa58540 rbd disk to lun 2024-03-26T17:00:07.806 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:07 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:00:07] INFO grpc.py:338: bdev_rbd_create: bdev_73911108-c449-4dde-9e0b-f3c55fa58540, cluster_name cluster_context_1_0 2024-03-26T17:00:07.806 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:07 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:00:07] INFO grpc.py:709: Received request to add bdev_73911108-c449-4dde-9e0b-f3c55fa58540 to nqn.2016-06.io.spdk:cnode2 with ANA group id 1 using NSID 19 and UUID 73911108-c449-4dde-9e0b-f3c55fa58540 2024-03-26T17:00:07.806 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:07 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:00:07] INFO grpc.py:732: subsystem_add_ns: 19 2024-03-26T17:00:07.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:07 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:00:07] INFO grpc.py:843: Received request to add a namespace using NSID 19 and UUID 73911108-c449-4dde-9e0b-f3c55fa58540 to nqn.2016-06.io.spdk:cnode2, context: None 2024-03-26T17:00:07.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:07 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:00:07] INFO grpc.py:299: Received request to create bdev bdev_73911108-c449-4dde-9e0b-f3c55fa58540 from mypool/myimage39 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-26T17:00:07.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:07 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [2024-03-26 17:00:07.416707] bdev_rbd.c:1278:bdev_rbd_create: *NOTICE*: Add bdev_73911108-c449-4dde-9e0b-f3c55fa58540 rbd disk to lun 2024-03-26T17:00:07.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:07 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:00:07] INFO grpc.py:338: bdev_rbd_create: bdev_73911108-c449-4dde-9e0b-f3c55fa58540, cluster_name cluster_context_1_0 2024-03-26T17:00:07.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:07 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:00:07] INFO grpc.py:709: Received request to add bdev_73911108-c449-4dde-9e0b-f3c55fa58540 to nqn.2016-06.io.spdk:cnode2 with ANA group id 1 using NSID 19 and UUID 73911108-c449-4dde-9e0b-f3c55fa58540 2024-03-26T17:00:07.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:07 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:00:07] INFO grpc.py:732: subsystem_add_ns: 19 2024-03-26T17:00:08.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:07 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:07] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:00:08.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:07 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}] 2024-03-26T17:00:08.291 INFO:tasks.workunit.client.3.smithi157.stderr:+ (( image_index++ )) 2024-03-26T17:00:08.291 INFO:tasks.workunit.client.3.smithi157.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2024-03-26T17:00:08.291 INFO:tasks.workunit.client.3.smithi157.stderr:+ image=myimage40 2024-03-26T17:00:08.291 INFO:tasks.workunit.client.3.smithi157.stderr:+ sudo podman run -it quay.io/barakda1/nvmeof-cli:qe_ceph_devel_21e59b2 --server-address 172.21.15.44 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode2 --rbd-pool mypool --rbd-image myimage40 --load-balancing-group 2 2024-03-26T17:00:08.368 INFO:tasks.workunit.client.3.smithi157.stderr:time="2024-03-26T17:00:08Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2024-03-26T17:00:08.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:00:08 smithi149 ceph-mon[34678]: pgmap v404: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 86 KiB/s rd, 1.6 KiB/s wr, 60 op/s 2024-03-26T17:00:08.396 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:08 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:00:08] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:00:08.396 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:08 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:00:08] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:00:08.396 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:08 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}] 2024-03-26T17:00:08.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:00:08 smithi044 ceph-mon[30624]: pgmap v404: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 86 KiB/s rd, 1.6 KiB/s wr, 60 op/s 2024-03-26T17:00:08.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:00:08 smithi064 ceph-mon[34420]: pgmap v404: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 86 KiB/s rd, 1.6 KiB/s wr, 60 op/s 2024-03-26T17:00:09.087 INFO:tasks.workunit.client.3.smithi157.stdout:Adding namespace 20 to nqn.2016-06.io.spdk:cnode2, load balancing group 2: Successful 2024-03-26T17:00:09.097 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:08 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:00:08] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:00:09.097 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:08 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:00:08] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:00:09.097 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:08 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': []}] 2024-03-26T17:00:09.097 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:09 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:00:09] INFO grpc.py:843: Received request to add a namespace using NSID 20 and UUID 10b25a6d-4c83-43ac-82be-34e5f35e18eb to nqn.2016-06.io.spdk:cnode2, context: None 2024-03-26T17:00:09.097 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:09 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:00:09] INFO grpc.py:299: Received request to create bdev bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb from mypool/myimage40 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-26T17:00:09.097 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:09 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [2024-03-26 17:00:09.096646] bdev_rbd.c:1278:bdev_rbd_create: *NOTICE*: Add bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb rbd disk to lun 2024-03-26T17:00:09.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:00:09 smithi149 ceph-mon[34678]: Health check update: 7 slow ops, oldest one blocked for 103 sec, daemons [mon.b,mon.c] have slow ops. (SLOW_OPS) 2024-03-26T17:00:09.396 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:09 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:00:09] INFO grpc.py:843: Received request to add a namespace using NSID 20 and UUID 10b25a6d-4c83-43ac-82be-34e5f35e18eb to nqn.2016-06.io.spdk:cnode2, context: None 2024-03-26T17:00:09.396 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:09 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:00:09] INFO grpc.py:299: Received request to create bdev bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb from mypool/myimage40 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-26T17:00:09.396 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:09 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [2024-03-26 17:00:09.097526] bdev_rbd.c:1278:bdev_rbd_create: *NOTICE*: Add bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb rbd disk to lun 2024-03-26T17:00:09.396 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:09 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:00:09] INFO grpc.py:338: bdev_rbd_create: bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb, cluster_name cluster_context_2_0 2024-03-26T17:00:09.397 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:09 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:00:09] INFO grpc.py:709: Received request to add bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb to nqn.2016-06.io.spdk:cnode2 with ANA group id 2 using NSID 20 and UUID 10b25a6d-4c83-43ac-82be-34e5f35e18eb 2024-03-26T17:00:09.397 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:09 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:00:09] INFO grpc.py:732: subsystem_add_ns: 20 2024-03-26T17:00:09.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:00:09 smithi044 ceph-mon[30624]: Health check update: 7 slow ops, oldest one blocked for 103 sec, daemons [mon.b,mon.c] have slow ops. (SLOW_OPS) 2024-03-26T17:00:09.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:09 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:09] INFO grpc.py:843: Received request to add a namespace to nqn.2016-06.io.spdk:cnode2, context: 2024-03-26T17:00:09.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:09 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:09] INFO grpc.py:299: Received request to create bdev bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb from mypool/myimage40 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-26T17:00:09.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:09 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [2024-03-26 17:00:09.070952] bdev_rbd.c:1278:bdev_rbd_create: *NOTICE*: Add bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb rbd disk to lun 2024-03-26T17:00:09.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:09 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:09] INFO grpc.py:338: bdev_rbd_create: bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb, cluster_name cluster_context_2_0 2024-03-26T17:00:09.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:09 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:09] INFO grpc.py:709: Received request to add bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb to nqn.2016-06.io.spdk:cnode2 with ANA group id 2 using UUID 10b25a6d-4c83-43ac-82be-34e5f35e18eb 2024-03-26T17:00:09.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:09 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:09] INFO grpc.py:732: subsystem_add_ns: 20 2024-03-26T17:00:09.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:00:09 smithi064 ceph-mon[34420]: Health check update: 7 slow ops, oldest one blocked for 103 sec, daemons [mon.b,mon.c] have slow ops. (SLOW_OPS) 2024-03-26T17:00:09.556 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:09 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:00:09] INFO grpc.py:338: bdev_rbd_create: bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb, cluster_name cluster_context_2_0 2024-03-26T17:00:09.556 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:09 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:00:09] INFO grpc.py:709: Received request to add bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb to nqn.2016-06.io.spdk:cnode2 with ANA group id 2 using NSID 20 and UUID 10b25a6d-4c83-43ac-82be-34e5f35e18eb 2024-03-26T17:00:09.556 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:09 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:00:09] INFO grpc.py:732: subsystem_add_ns: 20 2024-03-26T17:00:09.917 INFO:tasks.workunit.client.3.smithi157.stderr:+ (( image_index++ )) 2024-03-26T17:00:09.917 INFO:tasks.workunit.client.3.smithi157.stderr:+ for i in $(seq 1 $NVMEOF_SUBSYSTEMS_COUNT) 2024-03-26T17:00:09.917 INFO:tasks.workunit.client.3.smithi157.stderr:+ subsystem_nqn=nqn.2016-06.io.spdk:cnode3 2024-03-26T17:00:09.918 INFO:tasks.workunit.client.3.smithi157.stderr:++ seq 1 20 2024-03-26T17:00:09.919 INFO:tasks.workunit.client.3.smithi157.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2024-03-26T17:00:09.919 INFO:tasks.workunit.client.3.smithi157.stderr:+ image=myimage41 2024-03-26T17:00:09.919 INFO:tasks.workunit.client.3.smithi157.stderr:+ sudo podman run -it quay.io/barakda1/nvmeof-cli:qe_ceph_devel_21e59b2 --server-address 172.21.15.44 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode3 --rbd-pool mypool --rbd-image myimage41 --load-balancing-group 3 2024-03-26T17:00:10.007 INFO:tasks.workunit.client.3.smithi157.stderr:time="2024-03-26T17:00:10Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2024-03-26T17:00:10.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:09 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:09] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:00:10.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:09 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:09] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:00:10.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:09 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': []}] 2024-03-26T17:00:10.297 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:00:10 smithi149 ceph-mon[34678]: pgmap v405: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 116 KiB/s rd, 2.2 KiB/s wr, 71 op/s 2024-03-26T17:00:10.297 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:10 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:00:10] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:00:10.297 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:10 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:00:10] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:00:10.298 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:10 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': []}] 2024-03-26T17:00:10.456 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:00:10 smithi064 ceph-mon[34420]: pgmap v405: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 116 KiB/s rd, 2.2 KiB/s wr, 71 op/s 2024-03-26T17:00:10.457 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:00:10 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-b[34416]: 2024-03-26T17:00:10.279+0000 7ff022916700 -1 mon.b@2(peon) e3 get_health_metrics reporting 4 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T17:00:10.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:00:10 smithi044 ceph-mon[30624]: pgmap v405: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 116 KiB/s rd, 2.2 KiB/s wr, 71 op/s 2024-03-26T17:00:10.708 INFO:tasks.workunit.client.3.smithi157.stdout:Adding namespace 1 to nqn.2016-06.io.spdk:cnode3, load balancing group 3: Successful 2024-03-26T17:00:11.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:10 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:10] INFO grpc.py:843: Received request to add a namespace to nqn.2016-06.io.spdk:cnode3, context: 2024-03-26T17:00:11.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:10 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:10] INFO grpc.py:299: Received request to create bdev bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be from mypool/myimage41 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-26T17:00:11.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:10 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [2024-03-26 17:00:10.692430] bdev_rbd.c:1278:bdev_rbd_create: *NOTICE*: Add bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be rbd disk to lun 2024-03-26T17:00:11.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:10 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:10] INFO grpc.py:338: bdev_rbd_create: bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be, cluster_name cluster_context_3_0 2024-03-26T17:00:11.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:10 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:10] INFO grpc.py:709: Received request to add bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be to nqn.2016-06.io.spdk:cnode3 with ANA group id 3 using UUID 3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be 2024-03-26T17:00:11.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:10 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:10] INFO grpc.py:732: subsystem_add_ns: 1 2024-03-26T17:00:11.056 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:10 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:00:10] INFO grpc.py:843: Received request to add a namespace using NSID 1 and UUID 3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be to nqn.2016-06.io.spdk:cnode3, context: None 2024-03-26T17:00:11.056 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:10 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:00:10] INFO grpc.py:299: Received request to create bdev bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be from mypool/myimage41 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-26T17:00:11.056 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:10 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [2024-03-26 17:00:10.718470] bdev_rbd.c:1278:bdev_rbd_create: *NOTICE*: Add bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be rbd disk to lun 2024-03-26T17:00:11.056 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:10 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:00:10] INFO grpc.py:338: bdev_rbd_create: bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be, cluster_name cluster_context_3_0 2024-03-26T17:00:11.056 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:10 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:00:10] INFO grpc.py:709: Received request to add bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be to nqn.2016-06.io.spdk:cnode3 with ANA group id 3 using NSID 1 and UUID 3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be 2024-03-26T17:00:11.056 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:10 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:00:10] INFO grpc.py:732: subsystem_add_ns: 1 2024-03-26T17:00:11.056 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:10 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:00:10] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:00:11.056 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:10 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:00:10] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:00:11.056 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:10 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}]}] 2024-03-26T17:00:11.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:10 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:00:10] INFO grpc.py:843: Received request to add a namespace using NSID 1 and UUID 3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be to nqn.2016-06.io.spdk:cnode3, context: None 2024-03-26T17:00:11.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:10 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:00:10] INFO grpc.py:299: Received request to create bdev bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be from mypool/myimage41 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-26T17:00:11.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:10 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [2024-03-26 17:00:10.717443] bdev_rbd.c:1278:bdev_rbd_create: *NOTICE*: Add bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be rbd disk to lun 2024-03-26T17:00:11.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:10 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:00:10] INFO grpc.py:338: bdev_rbd_create: bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be, cluster_name cluster_context_3_0 2024-03-26T17:00:11.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:10 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:00:10] INFO grpc.py:709: Received request to add bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be to nqn.2016-06.io.spdk:cnode3 with ANA group id 3 using NSID 1 and UUID 3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be 2024-03-26T17:00:11.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:10 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:00:10] INFO grpc.py:732: subsystem_add_ns: 1 2024-03-26T17:00:11.593 INFO:tasks.workunit.client.3.smithi157.stderr:+ (( image_index++ )) 2024-03-26T17:00:11.594 INFO:tasks.workunit.client.3.smithi157.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2024-03-26T17:00:11.594 INFO:tasks.workunit.client.3.smithi157.stderr:+ image=myimage42 2024-03-26T17:00:11.594 INFO:tasks.workunit.client.3.smithi157.stderr:+ sudo podman run -it quay.io/barakda1/nvmeof-cli:qe_ceph_devel_21e59b2 --server-address 172.21.15.44 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode3 --rbd-pool mypool --rbd-image myimage42 --load-balancing-group 1 2024-03-26T17:00:11.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:00:11 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 2024-03-26T17:00:11.205+0000 7fa707a55700 -1 mon.c@1(peon) e3 get_health_metrics reporting 3 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T17:00:11.672 INFO:tasks.workunit.client.3.smithi157.stderr:time="2024-03-26T17:00:11Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2024-03-26T17:00:12.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:11 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:11] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:00:12.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:11 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:11] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:00:12.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:11 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}]}] 2024-03-26T17:00:12.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:00:12 smithi149 ceph-mon[34678]: pgmap v406: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 83 KiB/s rd, 1.5 KiB/s wr, 54 op/s 2024-03-26T17:00:12.397 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:12 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:00:12] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:00:12.397 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:12 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:00:12] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:00:12.397 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:12 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}]}] 2024-03-26T17:00:12.397 INFO:tasks.workunit.client.3.smithi157.stdout:Adding namespace 2 to nqn.2016-06.io.spdk:cnode3, load balancing group 1: Successful 2024-03-26T17:00:12.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:00:12 smithi044 ceph-mon[30624]: pgmap v406: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 83 KiB/s rd, 1.5 KiB/s wr, 54 op/s 2024-03-26T17:00:12.624 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:12 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:12] INFO grpc.py:843: Received request to add a namespace to nqn.2016-06.io.spdk:cnode3, context: 2024-03-26T17:00:12.624 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:12 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:12] INFO grpc.py:299: Received request to create bdev bdev_50b4cca3-174e-43d5-9104-42a67f5e6251 from mypool/myimage42 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-26T17:00:12.624 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:12 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [2024-03-26 17:00:12.381869] bdev_rbd.c:1278:bdev_rbd_create: *NOTICE*: Add bdev_50b4cca3-174e-43d5-9104-42a67f5e6251 rbd disk to lun 2024-03-26T17:00:12.624 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:12 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:12] INFO grpc.py:338: bdev_rbd_create: bdev_50b4cca3-174e-43d5-9104-42a67f5e6251, cluster_name cluster_context_1_0 2024-03-26T17:00:12.624 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:12 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:12] INFO grpc.py:709: Received request to add bdev_50b4cca3-174e-43d5-9104-42a67f5e6251 to nqn.2016-06.io.spdk:cnode3 with ANA group id 1 using UUID 50b4cca3-174e-43d5-9104-42a67f5e6251 2024-03-26T17:00:12.624 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:12 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:12] INFO grpc.py:732: subsystem_add_ns: 2 2024-03-26T17:00:12.625 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:00:12 smithi064 ceph-mon[34420]: pgmap v406: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 83 KiB/s rd, 1.5 KiB/s wr, 54 op/s 2024-03-26T17:00:12.625 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:12 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:00:12] INFO grpc.py:843: Received request to add a namespace using NSID 2 and UUID 50b4cca3-174e-43d5-9104-42a67f5e6251 to nqn.2016-06.io.spdk:cnode3, context: None 2024-03-26T17:00:12.625 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:12 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:00:12] INFO grpc.py:299: Received request to create bdev bdev_50b4cca3-174e-43d5-9104-42a67f5e6251 from mypool/myimage42 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-26T17:00:12.625 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:12 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [2024-03-26 17:00:12.407030] bdev_rbd.c:1278:bdev_rbd_create: *NOTICE*: Add bdev_50b4cca3-174e-43d5-9104-42a67f5e6251 rbd disk to lun 2024-03-26T17:00:12.625 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:12 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:00:12] INFO grpc.py:338: bdev_rbd_create: bdev_50b4cca3-174e-43d5-9104-42a67f5e6251, cluster_name cluster_context_1_0 2024-03-26T17:00:12.625 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:12 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:00:12] INFO grpc.py:709: Received request to add bdev_50b4cca3-174e-43d5-9104-42a67f5e6251 to nqn.2016-06.io.spdk:cnode3 with ANA group id 1 using NSID 2 and UUID 50b4cca3-174e-43d5-9104-42a67f5e6251 2024-03-26T17:00:12.625 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:12 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:00:12] INFO grpc.py:732: subsystem_add_ns: 2 2024-03-26T17:00:12.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:12 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:00:12] INFO grpc.py:843: Received request to add a namespace using NSID 2 and UUID 50b4cca3-174e-43d5-9104-42a67f5e6251 to nqn.2016-06.io.spdk:cnode3, context: None 2024-03-26T17:00:12.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:12 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:00:12] INFO grpc.py:299: Received request to create bdev bdev_50b4cca3-174e-43d5-9104-42a67f5e6251 from mypool/myimage42 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-26T17:00:12.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:12 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [2024-03-26 17:00:12.404538] bdev_rbd.c:1278:bdev_rbd_create: *NOTICE*: Add bdev_50b4cca3-174e-43d5-9104-42a67f5e6251 rbd disk to lun 2024-03-26T17:00:12.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:12 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:00:12] INFO grpc.py:338: bdev_rbd_create: bdev_50b4cca3-174e-43d5-9104-42a67f5e6251, cluster_name cluster_context_1_0 2024-03-26T17:00:12.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:12 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:00:12] INFO grpc.py:709: Received request to add bdev_50b4cca3-174e-43d5-9104-42a67f5e6251 to nqn.2016-06.io.spdk:cnode3 with ANA group id 1 using NSID 2 and UUID 50b4cca3-174e-43d5-9104-42a67f5e6251 2024-03-26T17:00:12.897 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:12 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:00:12] INFO grpc.py:732: subsystem_add_ns: 2 2024-03-26T17:00:13.270 INFO:tasks.workunit.client.3.smithi157.stderr:+ (( image_index++ )) 2024-03-26T17:00:13.271 INFO:tasks.workunit.client.3.smithi157.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2024-03-26T17:00:13.271 INFO:tasks.workunit.client.3.smithi157.stderr:+ image=myimage43 2024-03-26T17:00:13.271 INFO:tasks.workunit.client.3.smithi157.stderr:+ sudo podman run -it quay.io/barakda1/nvmeof-cli:qe_ceph_devel_21e59b2 --server-address 172.21.15.44 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode3 --rbd-pool mypool --rbd-image myimage43 --load-balancing-group 2 2024-03-26T17:00:13.305 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:12 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:00:12] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:00:13.306 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:12 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:00:12] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:00:13.306 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:12 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}]}] 2024-03-26T17:00:13.354 INFO:tasks.workunit.client.3.smithi157.stderr:time="2024-03-26T17:00:13Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2024-03-26T17:00:13.896 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:00:13 smithi149 ceph-mon[34678]: Health check update: 7 slow ops, oldest one blocked for 108 sec, daemons [mon.b,mon.c] have slow ops. (SLOW_OPS) 2024-03-26T17:00:13.915 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:00:13 smithi044 ceph-mon[30624]: Health check update: 7 slow ops, oldest one blocked for 108 sec, daemons [mon.b,mon.c] have slow ops. (SLOW_OPS) 2024-03-26T17:00:13.916 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:13 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:13] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:00:13.916 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:13 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:13] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:00:13.916 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:13 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}]}] 2024-03-26T17:00:14.055 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:00:13 smithi064 ceph-mon[34420]: Health check update: 7 slow ops, oldest one blocked for 108 sec, daemons [mon.b,mon.c] have slow ops. (SLOW_OPS) 2024-03-26T17:00:14.101 INFO:tasks.workunit.client.3.smithi157.stdout:Adding namespace 3 to nqn.2016-06.io.spdk:cnode3, load balancing group 2: Successful 2024-03-26T17:00:14.265 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:14 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:14] INFO grpc.py:843: Received request to add a namespace to nqn.2016-06.io.spdk:cnode3, context: 2024-03-26T17:00:14.265 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:14 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:14] INFO grpc.py:299: Received request to create bdev bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2 from mypool/myimage43 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-26T17:00:14.265 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:14 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [2024-03-26 17:00:14.085737] bdev_rbd.c:1278:bdev_rbd_create: *NOTICE*: Add bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2 rbd disk to lun 2024-03-26T17:00:14.265 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:14 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:14] INFO grpc.py:338: bdev_rbd_create: bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2, cluster_name cluster_context_2_0 2024-03-26T17:00:14.265 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:14 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:14] INFO grpc.py:709: Received request to add bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2 to nqn.2016-06.io.spdk:cnode3 with ANA group id 2 using UUID 3b4cd01b-2e99-4652-88a6-fa90062ddcb2 2024-03-26T17:00:14.265 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:14 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:14] INFO grpc.py:732: subsystem_add_ns: 3 2024-03-26T17:00:14.396 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:14 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:00:14] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:00:14.396 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:14 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:00:14] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:00:14.397 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:14 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}]}] 2024-03-26T17:00:14.397 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:14 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:00:14] INFO grpc.py:843: Received request to add a namespace using NSID 3 and UUID 3b4cd01b-2e99-4652-88a6-fa90062ddcb2 to nqn.2016-06.io.spdk:cnode3, context: None 2024-03-26T17:00:14.397 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:14 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:00:14] INFO grpc.py:299: Received request to create bdev bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2 from mypool/myimage43 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-26T17:00:14.397 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:14 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [2024-03-26 17:00:14.112795] bdev_rbd.c:1278:bdev_rbd_create: *NOTICE*: Add bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2 rbd disk to lun 2024-03-26T17:00:14.397 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:14 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:00:14] INFO grpc.py:338: bdev_rbd_create: bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2, cluster_name cluster_context_2_0 2024-03-26T17:00:14.397 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:14 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:00:14] INFO grpc.py:709: Received request to add bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2 to nqn.2016-06.io.spdk:cnode3 with ANA group id 2 using NSID 3 and UUID 3b4cd01b-2e99-4652-88a6-fa90062ddcb2 2024-03-26T17:00:14.397 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:14 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:00:14] INFO grpc.py:732: subsystem_add_ns: 3 2024-03-26T17:00:14.555 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:14 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:00:14] INFO grpc.py:843: Received request to add a namespace using NSID 3 and UUID 3b4cd01b-2e99-4652-88a6-fa90062ddcb2 to nqn.2016-06.io.spdk:cnode3, context: None 2024-03-26T17:00:14.556 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:14 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:00:14] INFO grpc.py:299: Received request to create bdev bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2 from mypool/myimage43 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-26T17:00:14.556 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:14 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [2024-03-26 17:00:14.110023] bdev_rbd.c:1278:bdev_rbd_create: *NOTICE*: Add bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2 rbd disk to lun 2024-03-26T17:00:14.556 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:14 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:00:14] INFO grpc.py:338: bdev_rbd_create: bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2, cluster_name cluster_context_2_0 2024-03-26T17:00:14.556 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:14 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:00:14] INFO grpc.py:709: Received request to add bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2 to nqn.2016-06.io.spdk:cnode3 with ANA group id 2 using NSID 3 and UUID 3b4cd01b-2e99-4652-88a6-fa90062ddcb2 2024-03-26T17:00:14.556 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:14 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:00:14] INFO grpc.py:732: subsystem_add_ns: 3 2024-03-26T17:00:14.871 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:00:14 smithi064 ceph-mon[34420]: pgmap v407: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 120 KiB/s rd, 2.2 KiB/s wr, 71 op/s 2024-03-26T17:00:14.896 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:00:14 smithi149 ceph-mon[34678]: pgmap v407: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 120 KiB/s rd, 2.2 KiB/s wr, 71 op/s 2024-03-26T17:00:14.939 INFO:tasks.workunit.client.3.smithi157.stderr:+ (( image_index++ )) 2024-03-26T17:00:14.939 INFO:tasks.workunit.client.3.smithi157.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2024-03-26T17:00:14.939 INFO:tasks.workunit.client.3.smithi157.stderr:+ image=myimage44 2024-03-26T17:00:14.939 INFO:tasks.workunit.client.3.smithi157.stderr:+ sudo podman run -it quay.io/barakda1/nvmeof-cli:qe_ceph_devel_21e59b2 --server-address 172.21.15.44 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode3 --rbd-pool mypool --rbd-image myimage44 --load-balancing-group 3 2024-03-26T17:00:15.015 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:00:14 smithi044 ceph-mon[30624]: pgmap v407: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 120 KiB/s rd, 2.2 KiB/s wr, 71 op/s 2024-03-26T17:00:15.036 INFO:tasks.workunit.client.3.smithi157.stderr:time="2024-03-26T17:00:15Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2024-03-26T17:00:15.281 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:14 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:00:14] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:00:15.281 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:14 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:00:14] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:00:15.281 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:14 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}]}] 2024-03-26T17:00:15.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:00:15 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-b[34416]: 2024-03-26T17:00:15.279+0000 7ff022916700 -1 mon.b@2(peon) e3 get_health_metrics reporting 4 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T17:00:15.732 INFO:tasks.workunit.client.3.smithi157.stdout:Adding namespace 4 to nqn.2016-06.io.spdk:cnode3, load balancing group 3: Successful 2024-03-26T17:00:16.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:15 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:15] INFO grpc.py:843: Received request to add a namespace to nqn.2016-06.io.spdk:cnode3, context: 2024-03-26T17:00:16.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:15 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:15] INFO grpc.py:299: Received request to create bdev bdev_207949ff-8335-45b5-ada4-b479b5c558f0 from mypool/myimage44 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-26T17:00:16.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:15 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [2024-03-26 17:00:15.718020] bdev_rbd.c:1278:bdev_rbd_create: *NOTICE*: Add bdev_207949ff-8335-45b5-ada4-b479b5c558f0 rbd disk to lun 2024-03-26T17:00:16.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:15 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:15] INFO grpc.py:338: bdev_rbd_create: bdev_207949ff-8335-45b5-ada4-b479b5c558f0, cluster_name cluster_context_3_0 2024-03-26T17:00:16.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:15 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:15] INFO grpc.py:709: Received request to add bdev_207949ff-8335-45b5-ada4-b479b5c558f0 to nqn.2016-06.io.spdk:cnode3 with ANA group id 3 using UUID 207949ff-8335-45b5-ada4-b479b5c558f0 2024-03-26T17:00:16.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:15 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:15] INFO grpc.py:732: subsystem_add_ns: 4 2024-03-26T17:00:16.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:15 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:15] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:00:16.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:15 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:15] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:00:16.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:15 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}]}] 2024-03-26T17:00:16.055 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:15 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:00:15] INFO grpc.py:843: Received request to add a namespace using NSID 4 and UUID 207949ff-8335-45b5-ada4-b479b5c558f0 to nqn.2016-06.io.spdk:cnode3, context: None 2024-03-26T17:00:16.055 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:15 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:00:15] INFO grpc.py:299: Received request to create bdev bdev_207949ff-8335-45b5-ada4-b479b5c558f0 from mypool/myimage44 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-26T17:00:16.055 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:15 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [2024-03-26 17:00:15.741604] bdev_rbd.c:1278:bdev_rbd_create: *NOTICE*: Add bdev_207949ff-8335-45b5-ada4-b479b5c558f0 rbd disk to lun 2024-03-26T17:00:16.055 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:15 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:00:15] INFO grpc.py:338: bdev_rbd_create: bdev_207949ff-8335-45b5-ada4-b479b5c558f0, cluster_name cluster_context_3_0 2024-03-26T17:00:16.056 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:15 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:00:15] INFO grpc.py:709: Received request to add bdev_207949ff-8335-45b5-ada4-b479b5c558f0 to nqn.2016-06.io.spdk:cnode3 with ANA group id 3 using NSID 4 and UUID 207949ff-8335-45b5-ada4-b479b5c558f0 2024-03-26T17:00:16.056 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:15 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:00:15] INFO grpc.py:732: subsystem_add_ns: 4 2024-03-26T17:00:16.073 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:15 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:00:15] INFO grpc.py:843: Received request to add a namespace using NSID 4 and UUID 207949ff-8335-45b5-ada4-b479b5c558f0 to nqn.2016-06.io.spdk:cnode3, context: None 2024-03-26T17:00:16.073 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:15 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:00:15] INFO grpc.py:299: Received request to create bdev bdev_207949ff-8335-45b5-ada4-b479b5c558f0 from mypool/myimage44 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-26T17:00:16.073 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:15 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [2024-03-26 17:00:15.744767] bdev_rbd.c:1278:bdev_rbd_create: *NOTICE*: Add bdev_207949ff-8335-45b5-ada4-b479b5c558f0 rbd disk to lun 2024-03-26T17:00:16.073 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:15 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:00:15] INFO grpc.py:338: bdev_rbd_create: bdev_207949ff-8335-45b5-ada4-b479b5c558f0, cluster_name cluster_context_3_0 2024-03-26T17:00:16.073 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:15 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:00:15] INFO grpc.py:709: Received request to add bdev_207949ff-8335-45b5-ada4-b479b5c558f0 to nqn.2016-06.io.spdk:cnode3 with ANA group id 3 using NSID 4 and UUID 207949ff-8335-45b5-ada4-b479b5c558f0 2024-03-26T17:00:16.074 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:15 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:00:15] INFO grpc.py:732: subsystem_add_ns: 4 2024-03-26T17:00:16.074 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:16 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:00:16] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:00:16.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:00:16 smithi149 ceph-mon[34678]: pgmap v408: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 86 KiB/s rd, 1.5 KiB/s wr, 52 op/s 2024-03-26T17:00:16.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:00:16 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 2024-03-26T17:00:16.205+0000 7fa707a55700 -1 mon.c@1(peon) e3 get_health_metrics reporting 3 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T17:00:16.396 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:16 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:00:16] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:00:16.397 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:16 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}]}] 2024-03-26T17:00:16.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:00:16 smithi044 ceph-mon[30624]: pgmap v408: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 86 KiB/s rd, 1.5 KiB/s wr, 52 op/s 2024-03-26T17:00:16.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:00:16 smithi064 ceph-mon[34420]: pgmap v408: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 86 KiB/s rd, 1.5 KiB/s wr, 52 op/s 2024-03-26T17:00:16.600 INFO:tasks.workunit.client.3.smithi157.stderr:+ (( image_index++ )) 2024-03-26T17:00:16.600 INFO:tasks.workunit.client.3.smithi157.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2024-03-26T17:00:16.600 INFO:tasks.workunit.client.3.smithi157.stderr:+ image=myimage45 2024-03-26T17:00:16.600 INFO:tasks.workunit.client.3.smithi157.stderr:+ sudo podman run -it quay.io/barakda1/nvmeof-cli:qe_ceph_devel_21e59b2 --server-address 172.21.15.44 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode3 --rbd-pool mypool --rbd-image myimage45 --load-balancing-group 1 2024-03-26T17:00:16.685 INFO:tasks.workunit.client.3.smithi157.stderr:time="2024-03-26T17:00:16Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2024-03-26T17:00:17.306 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:16 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:00:16] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:00:17.306 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:16 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:00:16] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:00:17.306 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:16 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}]}] 2024-03-26T17:00:17.401 INFO:tasks.workunit.client.3.smithi157.stdout:Adding namespace 5 to nqn.2016-06.io.spdk:cnode3, load balancing group 1: Successful 2024-03-26T17:00:17.750 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:17 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:17] INFO grpc.py:843: Received request to add a namespace to nqn.2016-06.io.spdk:cnode3, context: 2024-03-26T17:00:17.751 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:17 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:17] INFO grpc.py:299: Received request to create bdev bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d from mypool/myimage45 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-26T17:00:17.751 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:17 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [2024-03-26 17:00:17.385470] bdev_rbd.c:1278:bdev_rbd_create: *NOTICE*: Add bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d rbd disk to lun 2024-03-26T17:00:17.751 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:17 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:17] INFO grpc.py:338: bdev_rbd_create: bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d, cluster_name cluster_context_1_0 2024-03-26T17:00:17.751 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:17 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:17] INFO grpc.py:709: Received request to add bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d to nqn.2016-06.io.spdk:cnode3 with ANA group id 1 using UUID 3c6807e7-6ca5-4091-97d3-4325dc5c205d 2024-03-26T17:00:17.751 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:17 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:17] INFO grpc.py:732: subsystem_add_ns: 5 2024-03-26T17:00:17.751 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:17 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:17] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:00:17.805 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:17 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:00:17] INFO grpc.py:843: Received request to add a namespace using NSID 5 and UUID 3c6807e7-6ca5-4091-97d3-4325dc5c205d to nqn.2016-06.io.spdk:cnode3, context: None 2024-03-26T17:00:17.806 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:17 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:00:17] INFO grpc.py:299: Received request to create bdev bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d from mypool/myimage45 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-26T17:00:17.806 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:17 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [2024-03-26 17:00:17.410244] bdev_rbd.c:1278:bdev_rbd_create: *NOTICE*: Add bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d rbd disk to lun 2024-03-26T17:00:17.806 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:17 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:00:17] INFO grpc.py:338: bdev_rbd_create: bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d, cluster_name cluster_context_1_0 2024-03-26T17:00:17.806 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:17 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:00:17] INFO grpc.py:709: Received request to add bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d to nqn.2016-06.io.spdk:cnode3 with ANA group id 1 using NSID 5 and UUID 3c6807e7-6ca5-4091-97d3-4325dc5c205d 2024-03-26T17:00:17.806 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:17 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:00:17] INFO grpc.py:732: subsystem_add_ns: 5 2024-03-26T17:00:17.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:17 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:00:17] INFO grpc.py:843: Received request to add a namespace using NSID 5 and UUID 3c6807e7-6ca5-4091-97d3-4325dc5c205d to nqn.2016-06.io.spdk:cnode3, context: None 2024-03-26T17:00:17.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:17 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:00:17] INFO grpc.py:299: Received request to create bdev bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d from mypool/myimage45 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-26T17:00:17.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:17 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [2024-03-26 17:00:17.415538] bdev_rbd.c:1278:bdev_rbd_create: *NOTICE*: Add bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d rbd disk to lun 2024-03-26T17:00:17.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:17 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:00:17] INFO grpc.py:338: bdev_rbd_create: bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d, cluster_name cluster_context_1_0 2024-03-26T17:00:17.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:17 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:00:17] INFO grpc.py:709: Received request to add bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d to nqn.2016-06.io.spdk:cnode3 with ANA group id 1 using NSID 5 and UUID 3c6807e7-6ca5-4091-97d3-4325dc5c205d 2024-03-26T17:00:17.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:17 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:00:17] INFO grpc.py:732: subsystem_add_ns: 5 2024-03-26T17:00:18.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:17 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:17] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:00:18.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:17 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}]}] 2024-03-26T17:00:18.262 INFO:tasks.workunit.client.3.smithi157.stderr:+ (( image_index++ )) 2024-03-26T17:00:18.262 INFO:tasks.workunit.client.3.smithi157.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2024-03-26T17:00:18.262 INFO:tasks.workunit.client.3.smithi157.stderr:+ image=myimage46 2024-03-26T17:00:18.263 INFO:tasks.workunit.client.3.smithi157.stderr:+ sudo podman run -it quay.io/barakda1/nvmeof-cli:qe_ceph_devel_21e59b2 --server-address 172.21.15.44 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode3 --rbd-pool mypool --rbd-image myimage46 --load-balancing-group 2 2024-03-26T17:00:18.341 INFO:tasks.workunit.client.3.smithi157.stderr:time="2024-03-26T17:00:18Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2024-03-26T17:00:18.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:00:18 smithi149 ceph-mon[34678]: pgmap v409: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 101 KiB/s rd, 1.7 KiB/s wr, 71 op/s 2024-03-26T17:00:18.396 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:18 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:00:18] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:00:18.396 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:18 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:00:18] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:00:18.397 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:18 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}]}] 2024-03-26T17:00:18.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:00:18 smithi044 ceph-mon[30624]: pgmap v409: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 101 KiB/s rd, 1.7 KiB/s wr, 71 op/s 2024-03-26T17:00:18.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:00:18 smithi064 ceph-mon[34420]: pgmap v409: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 101 KiB/s rd, 1.7 KiB/s wr, 71 op/s 2024-03-26T17:00:19.042 INFO:tasks.workunit.client.3.smithi157.stdout:Adding namespace 6 to nqn.2016-06.io.spdk:cnode3, load balancing group 2: Successful 2024-03-26T17:00:19.196 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:18 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:00:18] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:00:19.196 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:18 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:00:18] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:00:19.196 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:18 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}]}] 2024-03-26T17:00:19.196 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:19 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:00:19] INFO grpc.py:843: Received request to add a namespace using NSID 6 and UUID 93238733-93e8-4537-9db8-9a632ba1968b to nqn.2016-06.io.spdk:cnode3, context: None 2024-03-26T17:00:19.196 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:19 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:00:19] INFO grpc.py:299: Received request to create bdev bdev_93238733-93e8-4537-9db8-9a632ba1968b from mypool/myimage46 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-26T17:00:19.196 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:19 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [2024-03-26 17:00:19.049872] bdev_rbd.c:1278:bdev_rbd_create: *NOTICE*: Add bdev_93238733-93e8-4537-9db8-9a632ba1968b rbd disk to lun 2024-03-26T17:00:19.196 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:19 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:00:19] INFO grpc.py:338: bdev_rbd_create: bdev_93238733-93e8-4537-9db8-9a632ba1968b, cluster_name cluster_context_2_0 2024-03-26T17:00:19.196 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:19 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:00:19] INFO grpc.py:709: Received request to add bdev_93238733-93e8-4537-9db8-9a632ba1968b to nqn.2016-06.io.spdk:cnode3 with ANA group id 2 using NSID 6 and UUID 93238733-93e8-4537-9db8-9a632ba1968b 2024-03-26T17:00:19.197 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:19 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:00:19] INFO grpc.py:732: subsystem_add_ns: 6 2024-03-26T17:00:19.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:00:19 smithi149 ceph-mon[34678]: Health check update: 7 slow ops, oldest one blocked for 113 sec, daemons [mon.b,mon.c] have slow ops. (SLOW_OPS) 2024-03-26T17:00:19.396 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:19 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:00:19] INFO grpc.py:843: Received request to add a namespace using NSID 6 and UUID 93238733-93e8-4537-9db8-9a632ba1968b to nqn.2016-06.io.spdk:cnode3, context: None 2024-03-26T17:00:19.396 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:19 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:00:19] INFO grpc.py:299: Received request to create bdev bdev_93238733-93e8-4537-9db8-9a632ba1968b from mypool/myimage46 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-26T17:00:19.396 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:19 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [2024-03-26 17:00:19.051049] bdev_rbd.c:1278:bdev_rbd_create: *NOTICE*: Add bdev_93238733-93e8-4537-9db8-9a632ba1968b rbd disk to lun 2024-03-26T17:00:19.396 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:19 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:00:19] INFO grpc.py:338: bdev_rbd_create: bdev_93238733-93e8-4537-9db8-9a632ba1968b, cluster_name cluster_context_2_0 2024-03-26T17:00:19.396 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:19 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:00:19] INFO grpc.py:709: Received request to add bdev_93238733-93e8-4537-9db8-9a632ba1968b to nqn.2016-06.io.spdk:cnode3 with ANA group id 2 using NSID 6 and UUID 93238733-93e8-4537-9db8-9a632ba1968b 2024-03-26T17:00:19.396 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:19 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:00:19] INFO grpc.py:732: subsystem_add_ns: 6 2024-03-26T17:00:19.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:00:19 smithi044 ceph-mon[30624]: Health check update: 7 slow ops, oldest one blocked for 113 sec, daemons [mon.b,mon.c] have slow ops. (SLOW_OPS) 2024-03-26T17:00:19.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:19 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:19] INFO grpc.py:843: Received request to add a namespace to nqn.2016-06.io.spdk:cnode3, context: 2024-03-26T17:00:19.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:19 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:19] INFO grpc.py:299: Received request to create bdev bdev_93238733-93e8-4537-9db8-9a632ba1968b from mypool/myimage46 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-26T17:00:19.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:19 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [2024-03-26 17:00:19.025401] bdev_rbd.c:1278:bdev_rbd_create: *NOTICE*: Add bdev_93238733-93e8-4537-9db8-9a632ba1968b rbd disk to lun 2024-03-26T17:00:19.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:19 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:19] INFO grpc.py:338: bdev_rbd_create: bdev_93238733-93e8-4537-9db8-9a632ba1968b, cluster_name cluster_context_2_0 2024-03-26T17:00:19.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:19 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:19] INFO grpc.py:709: Received request to add bdev_93238733-93e8-4537-9db8-9a632ba1968b to nqn.2016-06.io.spdk:cnode3 with ANA group id 2 using UUID 93238733-93e8-4537-9db8-9a632ba1968b 2024-03-26T17:00:19.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:19 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:19] INFO grpc.py:732: subsystem_add_ns: 6 2024-03-26T17:00:19.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:00:19 smithi064 ceph-mon[34420]: Health check update: 7 slow ops, oldest one blocked for 113 sec, daemons [mon.b,mon.c] have slow ops. (SLOW_OPS) 2024-03-26T17:00:19.930 INFO:tasks.workunit.client.3.smithi157.stderr:+ (( image_index++ )) 2024-03-26T17:00:19.930 INFO:tasks.workunit.client.3.smithi157.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2024-03-26T17:00:19.930 INFO:tasks.workunit.client.3.smithi157.stderr:+ image=myimage47 2024-03-26T17:00:19.931 INFO:tasks.workunit.client.3.smithi157.stderr:+ sudo podman run -it quay.io/barakda1/nvmeof-cli:qe_ceph_devel_21e59b2 --server-address 172.21.15.44 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode3 --rbd-pool mypool --rbd-image myimage47 --load-balancing-group 3 2024-03-26T17:00:20.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:19 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:19] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:00:20.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:19 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:19] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:00:20.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:19 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}]}] 2024-03-26T17:00:20.017 INFO:tasks.workunit.client.3.smithi157.stderr:time="2024-03-26T17:00:20Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2024-03-26T17:00:20.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:00:20 smithi149 ceph-mon[34678]: pgmap v410: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 125 KiB/s rd, 2.2 KiB/s wr, 72 op/s 2024-03-26T17:00:20.396 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:20 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:00:20] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:00:20.397 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:20 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:00:20] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:00:20.397 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:20 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}]}] 2024-03-26T17:00:20.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:00:20 smithi044 ceph-mon[30624]: pgmap v410: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 125 KiB/s rd, 2.2 KiB/s wr, 72 op/s 2024-03-26T17:00:20.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:00:20 smithi064 ceph-mon[34420]: pgmap v410: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 125 KiB/s rd, 2.2 KiB/s wr, 72 op/s 2024-03-26T17:00:20.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:00:20 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-b[34416]: 2024-03-26T17:00:20.279+0000 7ff022916700 -1 mon.b@2(peon) e3 get_health_metrics reporting 4 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T17:00:20.748 INFO:tasks.workunit.client.3.smithi157.stdout:Adding namespace 7 to nqn.2016-06.io.spdk:cnode3, load balancing group 3: Successful 2024-03-26T17:00:21.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:20 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:20] INFO grpc.py:843: Received request to add a namespace to nqn.2016-06.io.spdk:cnode3, context: 2024-03-26T17:00:21.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:20 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:20] INFO grpc.py:299: Received request to create bdev bdev_93abae22-a363-48f4-af52-0cb060c979a9 from mypool/myimage47 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-26T17:00:21.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:20 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [2024-03-26 17:00:20.732730] bdev_rbd.c:1278:bdev_rbd_create: *NOTICE*: Add bdev_93abae22-a363-48f4-af52-0cb060c979a9 rbd disk to lun 2024-03-26T17:00:21.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:20 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:20] INFO grpc.py:338: bdev_rbd_create: bdev_93abae22-a363-48f4-af52-0cb060c979a9, cluster_name cluster_context_3_0 2024-03-26T17:00:21.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:20 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:20] INFO grpc.py:709: Received request to add bdev_93abae22-a363-48f4-af52-0cb060c979a9 to nqn.2016-06.io.spdk:cnode3 with ANA group id 3 using UUID 93abae22-a363-48f4-af52-0cb060c979a9 2024-03-26T17:00:21.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:20 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:20] INFO grpc.py:732: subsystem_add_ns: 7 2024-03-26T17:00:21.056 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:20 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:00:20] INFO grpc.py:843: Received request to add a namespace using NSID 7 and UUID 93abae22-a363-48f4-af52-0cb060c979a9 to nqn.2016-06.io.spdk:cnode3, context: None 2024-03-26T17:00:21.056 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:20 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:00:20] INFO grpc.py:299: Received request to create bdev bdev_93abae22-a363-48f4-af52-0cb060c979a9 from mypool/myimage47 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-26T17:00:21.056 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:20 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [2024-03-26 17:00:20.758194] bdev_rbd.c:1278:bdev_rbd_create: *NOTICE*: Add bdev_93abae22-a363-48f4-af52-0cb060c979a9 rbd disk to lun 2024-03-26T17:00:21.056 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:20 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:00:20] INFO grpc.py:338: bdev_rbd_create: bdev_93abae22-a363-48f4-af52-0cb060c979a9, cluster_name cluster_context_3_0 2024-03-26T17:00:21.056 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:20 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:00:20] INFO grpc.py:709: Received request to add bdev_93abae22-a363-48f4-af52-0cb060c979a9 to nqn.2016-06.io.spdk:cnode3 with ANA group id 3 using NSID 7 and UUID 93abae22-a363-48f4-af52-0cb060c979a9 2024-03-26T17:00:21.056 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:20 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:00:20] INFO grpc.py:732: subsystem_add_ns: 7 2024-03-26T17:00:21.056 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:20 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:00:20] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:00:21.056 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:20 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:00:20] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:00:21.056 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:20 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}]}] 2024-03-26T17:00:21.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:20 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:00:20] INFO grpc.py:843: Received request to add a namespace using NSID 7 and UUID 93abae22-a363-48f4-af52-0cb060c979a9 to nqn.2016-06.io.spdk:cnode3, context: None 2024-03-26T17:00:21.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:20 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:00:20] INFO grpc.py:299: Received request to create bdev bdev_93abae22-a363-48f4-af52-0cb060c979a9 from mypool/myimage47 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-26T17:00:21.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:20 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [2024-03-26 17:00:20.760264] bdev_rbd.c:1278:bdev_rbd_create: *NOTICE*: Add bdev_93abae22-a363-48f4-af52-0cb060c979a9 rbd disk to lun 2024-03-26T17:00:21.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:20 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:00:20] INFO grpc.py:338: bdev_rbd_create: bdev_93abae22-a363-48f4-af52-0cb060c979a9, cluster_name cluster_context_3_0 2024-03-26T17:00:21.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:20 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:00:20] INFO grpc.py:709: Received request to add bdev_93abae22-a363-48f4-af52-0cb060c979a9 to nqn.2016-06.io.spdk:cnode3 with ANA group id 3 using NSID 7 and UUID 93abae22-a363-48f4-af52-0cb060c979a9 2024-03-26T17:00:21.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:20 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:00:20] INFO grpc.py:732: subsystem_add_ns: 7 2024-03-26T17:00:21.642 INFO:tasks.workunit.client.3.smithi157.stderr:+ (( image_index++ )) 2024-03-26T17:00:21.642 INFO:tasks.workunit.client.3.smithi157.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2024-03-26T17:00:21.642 INFO:tasks.workunit.client.3.smithi157.stderr:+ image=myimage48 2024-03-26T17:00:21.642 INFO:tasks.workunit.client.3.smithi157.stderr:+ sudo podman run -it quay.io/barakda1/nvmeof-cli:qe_ceph_devel_21e59b2 --server-address 172.21.15.44 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode3 --rbd-pool mypool --rbd-image myimage48 --load-balancing-group 1 2024-03-26T17:00:21.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:00:21 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 2024-03-26T17:00:21.205+0000 7fa707a55700 -1 mon.c@1(peon) e3 get_health_metrics reporting 3 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T17:00:21.730 INFO:tasks.workunit.client.3.smithi157.stderr:time="2024-03-26T17:00:21Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2024-03-26T17:00:22.195 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:21 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:21] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:00:22.195 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:21 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:21] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:00:22.195 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:21 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}]}] 2024-03-26T17:00:22.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:00:22 smithi149 ceph-mon[34678]: pgmap v411: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 94 KiB/s rd, 1.6 KiB/s wr, 60 op/s 2024-03-26T17:00:22.396 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:22 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:00:22] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:00:22.397 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:22 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:00:22] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:00:22.397 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:22 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}]}] 2024-03-26T17:00:22.445 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:00:22 smithi044 ceph-mon[30624]: pgmap v411: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 94 KiB/s rd, 1.6 KiB/s wr, 60 op/s 2024-03-26T17:00:22.445 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:22 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:22] INFO grpc.py:843: Received request to add a namespace to nqn.2016-06.io.spdk:cnode3, context: 2024-03-26T17:00:22.445 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:22 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:22] INFO grpc.py:299: Received request to create bdev bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e from mypool/myimage48 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-26T17:00:22.445 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:22 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [2024-03-26 17:00:22.445174] bdev_rbd.c:1278:bdev_rbd_create: *NOTICE*: Add bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e rbd disk to lun 2024-03-26T17:00:22.457 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:00:22 smithi064 ceph-mon[34420]: pgmap v411: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 94 KiB/s rd, 1.6 KiB/s wr, 60 op/s 2024-03-26T17:00:22.457 INFO:tasks.workunit.client.3.smithi157.stdout:Adding namespace 8 to nqn.2016-06.io.spdk:cnode3, load balancing group 1: Successful 2024-03-26T17:00:22.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:22 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:22] INFO grpc.py:338: bdev_rbd_create: bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e, cluster_name cluster_context_1_0 2024-03-26T17:00:22.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:22 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:22] INFO grpc.py:709: Received request to add bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e to nqn.2016-06.io.spdk:cnode3 with ANA group id 1 using UUID 921a1ef8-41d8-474b-93fd-035acb5ad32e 2024-03-26T17:00:22.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:22 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:22] INFO grpc.py:732: subsystem_add_ns: 8 2024-03-26T17:00:22.805 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:22 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:00:22] INFO grpc.py:843: Received request to add a namespace using NSID 8 and UUID 921a1ef8-41d8-474b-93fd-035acb5ad32e to nqn.2016-06.io.spdk:cnode3, context: None 2024-03-26T17:00:22.805 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:22 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:00:22] INFO grpc.py:299: Received request to create bdev bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e from mypool/myimage48 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-26T17:00:22.805 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:22 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [2024-03-26 17:00:22.466617] bdev_rbd.c:1278:bdev_rbd_create: *NOTICE*: Add bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e rbd disk to lun 2024-03-26T17:00:22.806 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:22 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:00:22] INFO grpc.py:338: bdev_rbd_create: bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e, cluster_name cluster_context_1_0 2024-03-26T17:00:22.806 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:22 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:00:22] INFO grpc.py:709: Received request to add bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e to nqn.2016-06.io.spdk:cnode3 with ANA group id 1 using NSID 8 and UUID 921a1ef8-41d8-474b-93fd-035acb5ad32e 2024-03-26T17:00:22.806 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:22 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:00:22] INFO grpc.py:732: subsystem_add_ns: 8 2024-03-26T17:00:22.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:22 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:00:22] INFO grpc.py:843: Received request to add a namespace using NSID 8 and UUID 921a1ef8-41d8-474b-93fd-035acb5ad32e to nqn.2016-06.io.spdk:cnode3, context: None 2024-03-26T17:00:22.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:22 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:00:22] INFO grpc.py:299: Received request to create bdev bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e from mypool/myimage48 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-26T17:00:22.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:22 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [2024-03-26 17:00:22.468295] bdev_rbd.c:1278:bdev_rbd_create: *NOTICE*: Add bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e rbd disk to lun 2024-03-26T17:00:22.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:22 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:00:22] INFO grpc.py:338: bdev_rbd_create: bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e, cluster_name cluster_context_1_0 2024-03-26T17:00:22.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:22 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:00:22] INFO grpc.py:709: Received request to add bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e to nqn.2016-06.io.spdk:cnode3 with ANA group id 1 using NSID 8 and UUID 921a1ef8-41d8-474b-93fd-035acb5ad32e 2024-03-26T17:00:22.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:22 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:00:22] INFO grpc.py:732: subsystem_add_ns: 8 2024-03-26T17:00:23.306 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:22 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:00:22] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:00:23.306 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:22 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:00:22] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:00:23.306 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:22 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}]}] 2024-03-26T17:00:23.328 INFO:tasks.workunit.client.3.smithi157.stderr:+ (( image_index++ )) 2024-03-26T17:00:23.328 INFO:tasks.workunit.client.3.smithi157.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2024-03-26T17:00:23.328 INFO:tasks.workunit.client.3.smithi157.stderr:+ image=myimage49 2024-03-26T17:00:23.328 INFO:tasks.workunit.client.3.smithi157.stderr:+ sudo podman run -it quay.io/barakda1/nvmeof-cli:qe_ceph_devel_21e59b2 --server-address 172.21.15.44 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode3 --rbd-pool mypool --rbd-image myimage49 --load-balancing-group 2 2024-03-26T17:00:23.405 INFO:tasks.workunit.client.3.smithi157.stderr:time="2024-03-26T17:00:23Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2024-03-26T17:00:23.896 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:00:23 smithi149 ceph-mon[34678]: Health check update: 7 slow ops, oldest one blocked for 118 sec, daemons [mon.b,mon.c] have slow ops. (SLOW_OPS) 2024-03-26T17:00:24.015 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:00:23 smithi044 ceph-mon[30624]: Health check update: 7 slow ops, oldest one blocked for 118 sec, daemons [mon.b,mon.c] have slow ops. (SLOW_OPS) 2024-03-26T17:00:24.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:23 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:23] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:00:24.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:23 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:23] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:00:24.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:23 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}]}] 2024-03-26T17:00:24.055 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:00:23 smithi064 ceph-mon[34420]: Health check update: 7 slow ops, oldest one blocked for 118 sec, daemons [mon.b,mon.c] have slow ops. (SLOW_OPS) 2024-03-26T17:00:24.135 INFO:tasks.workunit.client.3.smithi157.stdout:Adding namespace 9 to nqn.2016-06.io.spdk:cnode3, load balancing group 2: Successful 2024-03-26T17:00:24.396 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:24 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:00:24] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:00:24.397 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:24 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:00:24] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:00:24.397 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:24 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}]}] 2024-03-26T17:00:24.397 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:24 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:00:24] INFO grpc.py:843: Received request to add a namespace using NSID 9 and UUID 8e461884-8460-4c4a-ab6c-8245c6ec1ee9 to nqn.2016-06.io.spdk:cnode3, context: None 2024-03-26T17:00:24.397 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:24 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:00:24] INFO grpc.py:299: Received request to create bdev bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9 from mypool/myimage49 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-26T17:00:24.397 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:24 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [2024-03-26 17:00:24.145047] bdev_rbd.c:1278:bdev_rbd_create: *NOTICE*: Add bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9 rbd disk to lun 2024-03-26T17:00:24.397 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:24 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:00:24] INFO grpc.py:338: bdev_rbd_create: bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9, cluster_name cluster_context_2_0 2024-03-26T17:00:24.397 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:24 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:00:24] INFO grpc.py:709: Received request to add bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9 to nqn.2016-06.io.spdk:cnode3 with ANA group id 2 using NSID 9 and UUID 8e461884-8460-4c4a-ab6c-8245c6ec1ee9 2024-03-26T17:00:24.397 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:24 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:00:24] INFO grpc.py:732: subsystem_add_ns: 9 2024-03-26T17:00:24.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:24 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:24] INFO grpc.py:843: Received request to add a namespace to nqn.2016-06.io.spdk:cnode3, context: 2024-03-26T17:00:24.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:24 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:24] INFO grpc.py:299: Received request to create bdev bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9 from mypool/myimage49 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-26T17:00:24.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:24 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [2024-03-26 17:00:24.119217] bdev_rbd.c:1278:bdev_rbd_create: *NOTICE*: Add bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9 rbd disk to lun 2024-03-26T17:00:24.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:24 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:24] INFO grpc.py:338: bdev_rbd_create: bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9, cluster_name cluster_context_2_0 2024-03-26T17:00:24.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:24 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:24] INFO grpc.py:709: Received request to add bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9 to nqn.2016-06.io.spdk:cnode3 with ANA group id 2 using UUID 8e461884-8460-4c4a-ab6c-8245c6ec1ee9 2024-03-26T17:00:24.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:24 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:24] INFO grpc.py:732: subsystem_add_ns: 9 2024-03-26T17:00:24.557 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:24 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:00:24] INFO grpc.py:843: Received request to add a namespace using NSID 9 and UUID 8e461884-8460-4c4a-ab6c-8245c6ec1ee9 to nqn.2016-06.io.spdk:cnode3, context: None 2024-03-26T17:00:24.558 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:24 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:00:24] INFO grpc.py:299: Received request to create bdev bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9 from mypool/myimage49 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-26T17:00:24.558 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:24 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [2024-03-26 17:00:24.146714] bdev_rbd.c:1278:bdev_rbd_create: *NOTICE*: Add bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9 rbd disk to lun 2024-03-26T17:00:24.558 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:24 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:00:24] INFO grpc.py:338: bdev_rbd_create: bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9, cluster_name cluster_context_2_0 2024-03-26T17:00:24.558 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:24 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:00:24] INFO grpc.py:709: Received request to add bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9 to nqn.2016-06.io.spdk:cnode3 with ANA group id 2 using NSID 9 and UUID 8e461884-8460-4c4a-ab6c-8245c6ec1ee9 2024-03-26T17:00:24.558 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:24 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:00:24] INFO grpc.py:732: subsystem_add_ns: 9 2024-03-26T17:00:24.896 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:00:24 smithi149 ceph-mon[34678]: pgmap v412: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 139 KiB/s rd, 2.3 KiB/s wr, 82 op/s 2024-03-26T17:00:24.927 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:00:24 smithi064 ceph-mon[34420]: pgmap v412: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 139 KiB/s rd, 2.3 KiB/s wr, 82 op/s 2024-03-26T17:00:24.979 INFO:tasks.workunit.client.3.smithi157.stderr:+ (( image_index++ )) 2024-03-26T17:00:24.979 INFO:tasks.workunit.client.3.smithi157.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2024-03-26T17:00:24.979 INFO:tasks.workunit.client.3.smithi157.stderr:+ image=myimage50 2024-03-26T17:00:24.979 INFO:tasks.workunit.client.3.smithi157.stderr:+ sudo podman run -it quay.io/barakda1/nvmeof-cli:qe_ceph_devel_21e59b2 --server-address 172.21.15.44 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode3 --rbd-pool mypool --rbd-image myimage50 --load-balancing-group 3 2024-03-26T17:00:25.015 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:00:24 smithi044 ceph-mon[30624]: pgmap v412: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 139 KiB/s rd, 2.3 KiB/s wr, 82 op/s 2024-03-26T17:00:25.059 INFO:tasks.workunit.client.3.smithi157.stderr:time="2024-03-26T17:00:25Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2024-03-26T17:00:25.281 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:24 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:00:24] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:00:25.281 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:24 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:00:24] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:00:25.282 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:24 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}]}] 2024-03-26T17:00:25.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:00:25 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-b[34416]: 2024-03-26T17:00:25.279+0000 7ff022916700 -1 mon.b@2(peon) e3 get_health_metrics reporting 4 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T17:00:25.765 INFO:tasks.workunit.client.3.smithi157.stdout:Adding namespace 10 to nqn.2016-06.io.spdk:cnode3, load balancing group 3: Successful 2024-03-26T17:00:26.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:25] INFO grpc.py:843: Received request to add a namespace to nqn.2016-06.io.spdk:cnode3, context: 2024-03-26T17:00:26.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:25] INFO grpc.py:299: Received request to create bdev bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34 from mypool/myimage50 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-26T17:00:26.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [2024-03-26 17:00:25.748719] bdev_rbd.c:1278:bdev_rbd_create: *NOTICE*: Add bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34 rbd disk to lun 2024-03-26T17:00:26.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:25] INFO grpc.py:338: bdev_rbd_create: bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34, cluster_name cluster_context_3_0 2024-03-26T17:00:26.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:25] INFO grpc.py:709: Received request to add bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34 to nqn.2016-06.io.spdk:cnode3 with ANA group id 3 using UUID 6dd22a0f-f02e-4022-b874-77a8c16d2b34 2024-03-26T17:00:26.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:25] INFO grpc.py:732: subsystem_add_ns: 10 2024-03-26T17:00:26.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:25] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:00:26.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:25] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:00:26.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}]}] 2024-03-26T17:00:26.056 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:25 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:00:25] INFO grpc.py:843: Received request to add a namespace using NSID 10 and UUID 6dd22a0f-f02e-4022-b874-77a8c16d2b34 to nqn.2016-06.io.spdk:cnode3, context: None 2024-03-26T17:00:26.056 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:25 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:00:25] INFO grpc.py:299: Received request to create bdev bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34 from mypool/myimage50 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-26T17:00:26.056 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:25 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [2024-03-26 17:00:25.774346] bdev_rbd.c:1278:bdev_rbd_create: *NOTICE*: Add bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34 rbd disk to lun 2024-03-26T17:00:26.056 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:25 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:00:25] INFO grpc.py:338: bdev_rbd_create: bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34, cluster_name cluster_context_3_0 2024-03-26T17:00:26.056 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:25 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:00:25] INFO grpc.py:709: Received request to add bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34 to nqn.2016-06.io.spdk:cnode3 with ANA group id 3 using NSID 10 and UUID 6dd22a0f-f02e-4022-b874-77a8c16d2b34 2024-03-26T17:00:26.056 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:25 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:00:25] INFO grpc.py:732: subsystem_add_ns: 10 2024-03-26T17:00:26.129 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:25 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:00:25] INFO grpc.py:843: Received request to add a namespace using NSID 10 and UUID 6dd22a0f-f02e-4022-b874-77a8c16d2b34 to nqn.2016-06.io.spdk:cnode3, context: None 2024-03-26T17:00:26.129 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:25 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:00:25] INFO grpc.py:299: Received request to create bdev bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34 from mypool/myimage50 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-26T17:00:26.129 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:25 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [2024-03-26 17:00:25.773215] bdev_rbd.c:1278:bdev_rbd_create: *NOTICE*: Add bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34 rbd disk to lun 2024-03-26T17:00:26.130 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:25 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:00:25] INFO grpc.py:338: bdev_rbd_create: bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34, cluster_name cluster_context_3_0 2024-03-26T17:00:26.130 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:25 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:00:25] INFO grpc.py:709: Received request to add bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34 to nqn.2016-06.io.spdk:cnode3 with ANA group id 3 using NSID 10 and UUID 6dd22a0f-f02e-4022-b874-77a8c16d2b34 2024-03-26T17:00:26.130 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:25 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:00:25] INFO grpc.py:732: subsystem_add_ns: 10 2024-03-26T17:00:26.130 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:26 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:00:26] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:00:26.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:00:26 smithi149 ceph-mon[34678]: pgmap v413: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 103 KiB/s rd, 1.7 KiB/s wr, 66 op/s 2024-03-26T17:00:26.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:00:26 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 2024-03-26T17:00:26.206+0000 7fa707a55700 -1 mon.c@1(peon) e3 get_health_metrics reporting 3 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T17:00:26.397 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:26 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:00:26] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:00:26.397 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:26 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}]}] 2024-03-26T17:00:26.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:00:26 smithi044 ceph-mon[30624]: pgmap v413: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 103 KiB/s rd, 1.7 KiB/s wr, 66 op/s 2024-03-26T17:00:26.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:00:26 smithi064 ceph-mon[34420]: pgmap v413: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 103 KiB/s rd, 1.7 KiB/s wr, 66 op/s 2024-03-26T17:00:26.606 INFO:tasks.workunit.client.3.smithi157.stderr:+ (( image_index++ )) 2024-03-26T17:00:26.607 INFO:tasks.workunit.client.3.smithi157.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2024-03-26T17:00:26.607 INFO:tasks.workunit.client.3.smithi157.stderr:+ image=myimage51 2024-03-26T17:00:26.607 INFO:tasks.workunit.client.3.smithi157.stderr:+ sudo podman run -it quay.io/barakda1/nvmeof-cli:qe_ceph_devel_21e59b2 --server-address 172.21.15.44 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode3 --rbd-pool mypool --rbd-image myimage51 --load-balancing-group 1 2024-03-26T17:00:26.681 INFO:tasks.workunit.client.3.smithi157.stderr:time="2024-03-26T17:00:26Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2024-03-26T17:00:27.306 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:26 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:00:26] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:00:27.306 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:26 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:00:26] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:00:27.306 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:26 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}]}] 2024-03-26T17:00:27.407 INFO:tasks.workunit.client.3.smithi157.stdout:Adding namespace 11 to nqn.2016-06.io.spdk:cnode3, load balancing group 1: Successful 2024-03-26T17:00:27.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:27] INFO grpc.py:843: Received request to add a namespace to nqn.2016-06.io.spdk:cnode3, context: 2024-03-26T17:00:27.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:27] INFO grpc.py:299: Received request to create bdev bdev_be42afac-1bb1-49d7-891e-1520dab96fea from mypool/myimage51 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-26T17:00:27.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [2024-03-26 17:00:27.392789] bdev_rbd.c:1278:bdev_rbd_create: *NOTICE*: Add bdev_be42afac-1bb1-49d7-891e-1520dab96fea rbd disk to lun 2024-03-26T17:00:27.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:27] INFO grpc.py:338: bdev_rbd_create: bdev_be42afac-1bb1-49d7-891e-1520dab96fea, cluster_name cluster_context_1_0 2024-03-26T17:00:27.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:27] INFO grpc.py:709: Received request to add bdev_be42afac-1bb1-49d7-891e-1520dab96fea to nqn.2016-06.io.spdk:cnode3 with ANA group id 1 using UUID be42afac-1bb1-49d7-891e-1520dab96fea 2024-03-26T17:00:27.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:27] INFO grpc.py:732: subsystem_add_ns: 11 2024-03-26T17:00:27.805 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:27 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:00:27] INFO grpc.py:843: Received request to add a namespace using NSID 11 and UUID be42afac-1bb1-49d7-891e-1520dab96fea to nqn.2016-06.io.spdk:cnode3, context: None 2024-03-26T17:00:27.805 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:27 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:00:27] INFO grpc.py:299: Received request to create bdev bdev_be42afac-1bb1-49d7-891e-1520dab96fea from mypool/myimage51 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-26T17:00:27.805 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:27 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [2024-03-26 17:00:27.417621] bdev_rbd.c:1278:bdev_rbd_create: *NOTICE*: Add bdev_be42afac-1bb1-49d7-891e-1520dab96fea rbd disk to lun 2024-03-26T17:00:27.806 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:27 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:00:27] INFO grpc.py:338: bdev_rbd_create: bdev_be42afac-1bb1-49d7-891e-1520dab96fea, cluster_name cluster_context_1_0 2024-03-26T17:00:27.806 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:27 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:00:27] INFO grpc.py:709: Received request to add bdev_be42afac-1bb1-49d7-891e-1520dab96fea to nqn.2016-06.io.spdk:cnode3 with ANA group id 1 using NSID 11 and UUID be42afac-1bb1-49d7-891e-1520dab96fea 2024-03-26T17:00:27.806 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:27 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:00:27] INFO grpc.py:732: subsystem_add_ns: 11 2024-03-26T17:00:27.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:27 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:00:27] INFO grpc.py:843: Received request to add a namespace using NSID 11 and UUID be42afac-1bb1-49d7-891e-1520dab96fea to nqn.2016-06.io.spdk:cnode3, context: None 2024-03-26T17:00:27.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:27 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:00:27] INFO grpc.py:299: Received request to create bdev bdev_be42afac-1bb1-49d7-891e-1520dab96fea from mypool/myimage51 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-26T17:00:27.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:27 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [2024-03-26 17:00:27.418152] bdev_rbd.c:1278:bdev_rbd_create: *NOTICE*: Add bdev_be42afac-1bb1-49d7-891e-1520dab96fea rbd disk to lun 2024-03-26T17:00:27.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:27 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:00:27] INFO grpc.py:338: bdev_rbd_create: bdev_be42afac-1bb1-49d7-891e-1520dab96fea, cluster_name cluster_context_1_0 2024-03-26T17:00:27.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:27 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:00:27] INFO grpc.py:709: Received request to add bdev_be42afac-1bb1-49d7-891e-1520dab96fea to nqn.2016-06.io.spdk:cnode3 with ANA group id 1 using NSID 11 and UUID be42afac-1bb1-49d7-891e-1520dab96fea 2024-03-26T17:00:27.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:27 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:00:27] INFO grpc.py:732: subsystem_add_ns: 11 2024-03-26T17:00:28.196 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:27] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:00:28.196 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:27] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:00:28.197 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}]}] 2024-03-26T17:00:28.250 INFO:tasks.workunit.client.3.smithi157.stderr:+ (( image_index++ )) 2024-03-26T17:00:28.250 INFO:tasks.workunit.client.3.smithi157.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2024-03-26T17:00:28.250 INFO:tasks.workunit.client.3.smithi157.stderr:+ image=myimage52 2024-03-26T17:00:28.250 INFO:tasks.workunit.client.3.smithi157.stderr:+ sudo podman run -it quay.io/barakda1/nvmeof-cli:qe_ceph_devel_21e59b2 --server-address 172.21.15.44 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode3 --rbd-pool mypool --rbd-image myimage52 --load-balancing-group 2 2024-03-26T17:00:28.329 INFO:tasks.workunit.client.3.smithi157.stderr:time="2024-03-26T17:00:28Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2024-03-26T17:00:28.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:00:28 smithi149 ceph-mon[34678]: pgmap v414: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 102 KiB/s rd, 1.7 KiB/s wr, 66 op/s 2024-03-26T17:00:28.396 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:28 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:00:28] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:00:28.396 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:28 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:00:28] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:00:28.396 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:28 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}]}] 2024-03-26T17:00:28.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:00:28 smithi044 ceph-mon[30624]: pgmap v414: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 102 KiB/s rd, 1.7 KiB/s wr, 66 op/s 2024-03-26T17:00:28.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:00:28 smithi064 ceph-mon[34420]: pgmap v414: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 102 KiB/s rd, 1.7 KiB/s wr, 66 op/s 2024-03-26T17:00:29.048 INFO:tasks.workunit.client.3.smithi157.stdout:Adding namespace 12 to nqn.2016-06.io.spdk:cnode3, load balancing group 2: Successful 2024-03-26T17:00:29.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:00:29 smithi064 ceph-mon[34420]: Health check update: 7 slow ops, oldest one blocked for 123 sec, daemons [mon.b,mon.c] have slow ops. (SLOW_OPS) 2024-03-26T17:00:29.306 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:28 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:00:28] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:00:29.306 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:28 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:00:28] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:00:29.306 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:28 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}]}] 2024-03-26T17:00:29.306 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:29 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:00:29] INFO grpc.py:843: Received request to add a namespace using NSID 12 and UUID 2d7cae06-634e-4d4e-84f6-3fd8b256908b to nqn.2016-06.io.spdk:cnode3, context: None 2024-03-26T17:00:29.307 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:29 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:00:29] INFO grpc.py:299: Received request to create bdev bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b from mypool/myimage52 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-26T17:00:29.307 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:29 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [2024-03-26 17:00:29.058707] bdev_rbd.c:1278:bdev_rbd_create: *NOTICE*: Add bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b rbd disk to lun 2024-03-26T17:00:29.307 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:29 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:00:29] INFO grpc.py:338: bdev_rbd_create: bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b, cluster_name cluster_context_2_0 2024-03-26T17:00:29.307 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:29 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:00:29] INFO grpc.py:709: Received request to add bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b to nqn.2016-06.io.spdk:cnode3 with ANA group id 2 using NSID 12 and UUID 2d7cae06-634e-4d4e-84f6-3fd8b256908b 2024-03-26T17:00:29.307 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:29 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:00:29] INFO grpc.py:732: subsystem_add_ns: 12 2024-03-26T17:00:29.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:00:29 smithi149 ceph-mon[34678]: Health check update: 7 slow ops, oldest one blocked for 123 sec, daemons [mon.b,mon.c] have slow ops. (SLOW_OPS) 2024-03-26T17:00:29.396 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:29 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:00:29] INFO grpc.py:843: Received request to add a namespace using NSID 12 and UUID 2d7cae06-634e-4d4e-84f6-3fd8b256908b to nqn.2016-06.io.spdk:cnode3, context: None 2024-03-26T17:00:29.396 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:29 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:00:29] INFO grpc.py:299: Received request to create bdev bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b from mypool/myimage52 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-26T17:00:29.396 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:29 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [2024-03-26 17:00:29.059950] bdev_rbd.c:1278:bdev_rbd_create: *NOTICE*: Add bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b rbd disk to lun 2024-03-26T17:00:29.397 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:29 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:00:29] INFO grpc.py:338: bdev_rbd_create: bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b, cluster_name cluster_context_2_0 2024-03-26T17:00:29.397 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:29 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:00:29] INFO grpc.py:709: Received request to add bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b to nqn.2016-06.io.spdk:cnode3 with ANA group id 2 using NSID 12 and UUID 2d7cae06-634e-4d4e-84f6-3fd8b256908b 2024-03-26T17:00:29.397 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:29 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:00:29] INFO grpc.py:732: subsystem_add_ns: 12 2024-03-26T17:00:29.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:00:29 smithi044 ceph-mon[30624]: Health check update: 7 slow ops, oldest one blocked for 123 sec, daemons [mon.b,mon.c] have slow ops. (SLOW_OPS) 2024-03-26T17:00:29.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:29] INFO grpc.py:843: Received request to add a namespace to nqn.2016-06.io.spdk:cnode3, context: 2024-03-26T17:00:29.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:29] INFO grpc.py:299: Received request to create bdev bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b from mypool/myimage52 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-26T17:00:29.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [2024-03-26 17:00:29.033290] bdev_rbd.c:1278:bdev_rbd_create: *NOTICE*: Add bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b rbd disk to lun 2024-03-26T17:00:29.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:29] INFO grpc.py:338: bdev_rbd_create: bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b, cluster_name cluster_context_2_0 2024-03-26T17:00:29.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:29] INFO grpc.py:709: Received request to add bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b to nqn.2016-06.io.spdk:cnode3 with ANA group id 2 using UUID 2d7cae06-634e-4d4e-84f6-3fd8b256908b 2024-03-26T17:00:29.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:29] INFO grpc.py:732: subsystem_add_ns: 12 2024-03-26T17:00:29.912 INFO:tasks.workunit.client.3.smithi157.stderr:+ (( image_index++ )) 2024-03-26T17:00:29.913 INFO:tasks.workunit.client.3.smithi157.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2024-03-26T17:00:29.913 INFO:tasks.workunit.client.3.smithi157.stderr:+ image=myimage53 2024-03-26T17:00:29.913 INFO:tasks.workunit.client.3.smithi157.stderr:+ sudo podman run -it quay.io/barakda1/nvmeof-cli:qe_ceph_devel_21e59b2 --server-address 172.21.15.44 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode3 --rbd-pool mypool --rbd-image myimage53 --load-balancing-group 3 2024-03-26T17:00:29.991 INFO:tasks.workunit.client.3.smithi157.stderr:time="2024-03-26T17:00:29Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2024-03-26T17:00:30.201 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:29] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:00:30.201 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:29] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:00:30.201 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}]}] 2024-03-26T17:00:30.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:00:30 smithi044 ceph-mon[30624]: pgmap v415: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 128 KiB/s rd, 2.1 KiB/s wr, 65 op/s 2024-03-26T17:00:30.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:00:30 smithi064 ceph-mon[34420]: pgmap v415: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 128 KiB/s rd, 2.1 KiB/s wr, 65 op/s 2024-03-26T17:00:30.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:00:30 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-b[34416]: 2024-03-26T17:00:30.280+0000 7ff022916700 -1 mon.b@2(peon) e3 get_health_metrics reporting 4 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T17:00:30.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:00:30 smithi149 ceph-mon[34678]: pgmap v415: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 128 KiB/s rd, 2.1 KiB/s wr, 65 op/s 2024-03-26T17:00:30.646 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:30 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:00:30] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:00:30.647 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:30 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:00:30] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:00:30.647 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:30 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}]}] 2024-03-26T17:00:30.735 INFO:tasks.workunit.client.3.smithi157.stdout:Adding namespace 13 to nqn.2016-06.io.spdk:cnode3, load balancing group 3: Successful 2024-03-26T17:00:31.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:30] INFO grpc.py:843: Received request to add a namespace to nqn.2016-06.io.spdk:cnode3, context: 2024-03-26T17:00:31.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:30] INFO grpc.py:299: Received request to create bdev bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e from mypool/myimage53 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-26T17:00:31.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [2024-03-26 17:00:30.718308] bdev_rbd.c:1278:bdev_rbd_create: *NOTICE*: Add bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e rbd disk to lun 2024-03-26T17:00:31.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:30] INFO grpc.py:338: bdev_rbd_create: bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e, cluster_name cluster_context_3_0 2024-03-26T17:00:31.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:30] INFO grpc.py:709: Received request to add bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e to nqn.2016-06.io.spdk:cnode3 with ANA group id 3 using UUID c8bdc24b-3beb-4416-8e5e-29302ab1738e 2024-03-26T17:00:31.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:30] INFO grpc.py:732: subsystem_add_ns: 13 2024-03-26T17:00:31.056 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:30 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:00:30] INFO grpc.py:843: Received request to add a namespace using NSID 13 and UUID c8bdc24b-3beb-4416-8e5e-29302ab1738e to nqn.2016-06.io.spdk:cnode3, context: None 2024-03-26T17:00:31.056 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:30 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:00:30] INFO grpc.py:299: Received request to create bdev bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e from mypool/myimage53 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-26T17:00:31.056 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:30 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [2024-03-26 17:00:30.743348] bdev_rbd.c:1278:bdev_rbd_create: *NOTICE*: Add bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e rbd disk to lun 2024-03-26T17:00:31.056 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:30 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:00:30] INFO grpc.py:338: bdev_rbd_create: bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e, cluster_name cluster_context_3_0 2024-03-26T17:00:31.056 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:30 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:00:30] INFO grpc.py:709: Received request to add bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e to nqn.2016-06.io.spdk:cnode3 with ANA group id 3 using NSID 13 and UUID c8bdc24b-3beb-4416-8e5e-29302ab1738e 2024-03-26T17:00:31.056 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:30 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:00:30] INFO grpc.py:732: subsystem_add_ns: 13 2024-03-26T17:00:31.056 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:30 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:00:30] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:00:31.056 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:30 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:00:30] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:00:31.056 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:30 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}]}] 2024-03-26T17:00:31.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:30 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:00:30] INFO grpc.py:843: Received request to add a namespace using NSID 13 and UUID c8bdc24b-3beb-4416-8e5e-29302ab1738e to nqn.2016-06.io.spdk:cnode3, context: None 2024-03-26T17:00:31.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:30 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:00:30] INFO grpc.py:299: Received request to create bdev bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e from mypool/myimage53 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-26T17:00:31.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:30 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [2024-03-26 17:00:30.744207] bdev_rbd.c:1278:bdev_rbd_create: *NOTICE*: Add bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e rbd disk to lun 2024-03-26T17:00:31.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:30 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:00:30] INFO grpc.py:338: bdev_rbd_create: bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e, cluster_name cluster_context_3_0 2024-03-26T17:00:31.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:30 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:00:30] INFO grpc.py:709: Received request to add bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e to nqn.2016-06.io.spdk:cnode3 with ANA group id 3 using NSID 13 and UUID c8bdc24b-3beb-4416-8e5e-29302ab1738e 2024-03-26T17:00:31.147 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:30 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:00:30] INFO grpc.py:732: subsystem_add_ns: 13 2024-03-26T17:00:31.570 INFO:tasks.workunit.client.3.smithi157.stderr:+ (( image_index++ )) 2024-03-26T17:00:31.570 INFO:tasks.workunit.client.3.smithi157.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2024-03-26T17:00:31.571 INFO:tasks.workunit.client.3.smithi157.stderr:+ image=myimage54 2024-03-26T17:00:31.571 INFO:tasks.workunit.client.3.smithi157.stderr:+ sudo podman run -it quay.io/barakda1/nvmeof-cli:qe_ceph_devel_21e59b2 --server-address 172.21.15.44 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode3 --rbd-pool mypool --rbd-image myimage54 --load-balancing-group 1 2024-03-26T17:00:31.643 INFO:tasks.workunit.client.3.smithi157.stderr:time="2024-03-26T17:00:31Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2024-03-26T17:00:31.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:00:31 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 2024-03-26T17:00:31.206+0000 7fa707a55700 -1 mon.c@1(peon) e3 get_health_metrics reporting 3 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T17:00:32.196 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:31] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:00:32.196 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:31] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:00:32.196 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}]}] 2024-03-26T17:00:32.387 INFO:tasks.workunit.client.3.smithi157.stdout:Adding namespace 14 to nqn.2016-06.io.spdk:cnode3, load balancing group 1: Successful 2024-03-26T17:00:32.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:00:32 smithi044 ceph-mon[30624]: pgmap v416: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 94 KiB/s rd, 1.5 KiB/s wr, 52 op/s 2024-03-26T17:00:32.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:32 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:32] INFO grpc.py:843: Received request to add a namespace to nqn.2016-06.io.spdk:cnode3, context: 2024-03-26T17:00:32.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:32 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:32] INFO grpc.py:299: Received request to create bdev bdev_880553c4-26f3-4feb-954f-8823b018602d from mypool/myimage54 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-26T17:00:32.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:32 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [2024-03-26 17:00:32.370268] bdev_rbd.c:1278:bdev_rbd_create: *NOTICE*: Add bdev_880553c4-26f3-4feb-954f-8823b018602d rbd disk to lun 2024-03-26T17:00:32.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:32 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:32] INFO grpc.py:338: bdev_rbd_create: bdev_880553c4-26f3-4feb-954f-8823b018602d, cluster_name cluster_context_1_0 2024-03-26T17:00:32.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:32 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:32] INFO grpc.py:709: Received request to add bdev_880553c4-26f3-4feb-954f-8823b018602d to nqn.2016-06.io.spdk:cnode3 with ANA group id 1 using UUID 880553c4-26f3-4feb-954f-8823b018602d 2024-03-26T17:00:32.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:32 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:32] INFO grpc.py:732: subsystem_add_ns: 14 2024-03-26T17:00:32.547 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:00:32 smithi149 ceph-mon[34678]: pgmap v416: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 94 KiB/s rd, 1.5 KiB/s wr, 52 op/s 2024-03-26T17:00:32.548 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:32 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:00:32] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:00:32.548 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:32 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:00:32] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:00:32.548 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:32 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}]}] 2024-03-26T17:00:32.548 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:32 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:00:32] INFO grpc.py:843: Received request to add a namespace using NSID 14 and UUID 880553c4-26f3-4feb-954f-8823b018602d to nqn.2016-06.io.spdk:cnode3, context: None 2024-03-26T17:00:32.548 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:32 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:00:32] INFO grpc.py:299: Received request to create bdev bdev_880553c4-26f3-4feb-954f-8823b018602d from mypool/myimage54 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-26T17:00:32.548 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:32 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [2024-03-26 17:00:32.396067] bdev_rbd.c:1278:bdev_rbd_create: *NOTICE*: Add bdev_880553c4-26f3-4feb-954f-8823b018602d rbd disk to lun 2024-03-26T17:00:32.548 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:32 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:00:32] INFO grpc.py:338: bdev_rbd_create: bdev_880553c4-26f3-4feb-954f-8823b018602d, cluster_name cluster_context_1_0 2024-03-26T17:00:32.548 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:32 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:00:32] INFO grpc.py:709: Received request to add bdev_880553c4-26f3-4feb-954f-8823b018602d to nqn.2016-06.io.spdk:cnode3 with ANA group id 1 using NSID 14 and UUID 880553c4-26f3-4feb-954f-8823b018602d 2024-03-26T17:00:32.549 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:32 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:00:32] INFO grpc.py:732: subsystem_add_ns: 14 2024-03-26T17:00:32.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:00:32 smithi064 ceph-mon[34420]: pgmap v416: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 94 KiB/s rd, 1.5 KiB/s wr, 52 op/s 2024-03-26T17:00:32.555 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:32 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:00:32] INFO grpc.py:843: Received request to add a namespace using NSID 14 and UUID 880553c4-26f3-4feb-954f-8823b018602d to nqn.2016-06.io.spdk:cnode3, context: None 2024-03-26T17:00:32.555 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:32 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:00:32] INFO grpc.py:299: Received request to create bdev bdev_880553c4-26f3-4feb-954f-8823b018602d from mypool/myimage54 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-26T17:00:32.555 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:32 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [2024-03-26 17:00:32.395295] bdev_rbd.c:1278:bdev_rbd_create: *NOTICE*: Add bdev_880553c4-26f3-4feb-954f-8823b018602d rbd disk to lun 2024-03-26T17:00:32.555 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:32 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:00:32] INFO grpc.py:338: bdev_rbd_create: bdev_880553c4-26f3-4feb-954f-8823b018602d, cluster_name cluster_context_1_0 2024-03-26T17:00:32.556 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:32 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:00:32] INFO grpc.py:709: Received request to add bdev_880553c4-26f3-4feb-954f-8823b018602d to nqn.2016-06.io.spdk:cnode3 with ANA group id 1 using NSID 14 and UUID 880553c4-26f3-4feb-954f-8823b018602d 2024-03-26T17:00:32.556 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:32 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:00:32] INFO grpc.py:732: subsystem_add_ns: 14 2024-03-26T17:00:33.280 INFO:tasks.workunit.client.3.smithi157.stderr:+ (( image_index++ )) 2024-03-26T17:00:33.280 INFO:tasks.workunit.client.3.smithi157.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2024-03-26T17:00:33.281 INFO:tasks.workunit.client.3.smithi157.stderr:+ image=myimage55 2024-03-26T17:00:33.281 INFO:tasks.workunit.client.3.smithi157.stderr:+ sudo podman run -it quay.io/barakda1/nvmeof-cli:qe_ceph_devel_21e59b2 --server-address 172.21.15.44 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode3 --rbd-pool mypool --rbd-image myimage55 --load-balancing-group 2 2024-03-26T17:00:33.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:00:33 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-26T17:00:33.306 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:32 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:00:32] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:00:33.306 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:32 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:00:32] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:00:33.306 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:32 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}]}] 2024-03-26T17:00:33.374 INFO:tasks.workunit.client.3.smithi157.stderr:time="2024-03-26T17:00:33Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2024-03-26T17:00:33.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:00:33 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-26T17:00:33.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:00:33 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-26T17:00:34.107 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:33] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:00:34.108 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:33] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:00:34.108 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}]}] 2024-03-26T17:00:34.108 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:34] INFO grpc.py:843: Received request to add a namespace to nqn.2016-06.io.spdk:cnode3, context: 2024-03-26T17:00:34.134 INFO:tasks.workunit.client.3.smithi157.stdout:Adding namespace 15 to nqn.2016-06.io.spdk:cnode3, load balancing group 2: Successful 2024-03-26T17:00:34.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:00:34 smithi149 ceph-mon[34678]: Health check update: 7 slow ops, oldest one blocked for 128 sec, daemons [mon.b,mon.c] have slow ops. (SLOW_OPS) 2024-03-26T17:00:34.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:00:34 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T17:00:34.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:00:34 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-26T17:00:34.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:00:34 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T17:00:34.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:00:34 smithi149 ceph-mon[34678]: pgmap v417: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 137 KiB/s rd, 2.2 KiB/s wr, 71 op/s 2024-03-26T17:00:34.397 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:34 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:00:34] INFO grpc.py:843: Received request to add a namespace using NSID 15 and UUID 6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d to nqn.2016-06.io.spdk:cnode3, context: None 2024-03-26T17:00:34.397 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:34 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:00:34] INFO grpc.py:299: Received request to create bdev bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d from mypool/myimage55 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-26T17:00:34.397 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:34 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [2024-03-26 17:00:34.143911] bdev_rbd.c:1278:bdev_rbd_create: *NOTICE*: Add bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d rbd disk to lun 2024-03-26T17:00:34.397 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:34 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:00:34] INFO grpc.py:338: bdev_rbd_create: bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d, cluster_name cluster_context_2_0 2024-03-26T17:00:34.397 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:34 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:00:34] INFO grpc.py:709: Received request to add bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d to nqn.2016-06.io.spdk:cnode3 with ANA group id 2 using NSID 15 and UUID 6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d 2024-03-26T17:00:34.397 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:34 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:00:34] INFO grpc.py:732: subsystem_add_ns: 15 2024-03-26T17:00:34.398 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:34 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:00:34] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:00:34.398 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:34 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:00:34] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:00:34.398 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:34 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}]}] 2024-03-26T17:00:34.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:00:34 smithi044 ceph-mon[30624]: Health check update: 7 slow ops, oldest one blocked for 128 sec, daemons [mon.b,mon.c] have slow ops. (SLOW_OPS) 2024-03-26T17:00:34.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:00:34 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T17:00:34.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:00:34 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-26T17:00:34.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:00:34 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T17:00:34.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:00:34 smithi044 ceph-mon[30624]: pgmap v417: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 137 KiB/s rd, 2.2 KiB/s wr, 71 op/s 2024-03-26T17:00:34.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:34] INFO grpc.py:299: Received request to create bdev bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d from mypool/myimage55 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-26T17:00:34.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [2024-03-26 17:00:34.119574] bdev_rbd.c:1278:bdev_rbd_create: *NOTICE*: Add bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d rbd disk to lun 2024-03-26T17:00:34.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:34] INFO grpc.py:338: bdev_rbd_create: bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d, cluster_name cluster_context_2_0 2024-03-26T17:00:34.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:34] INFO grpc.py:709: Received request to add bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d to nqn.2016-06.io.spdk:cnode3 with ANA group id 2 using UUID 6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d 2024-03-26T17:00:34.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:34] INFO grpc.py:732: subsystem_add_ns: 15 2024-03-26T17:00:34.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:00:34 smithi064 ceph-mon[34420]: Health check update: 7 slow ops, oldest one blocked for 128 sec, daemons [mon.b,mon.c] have slow ops. (SLOW_OPS) 2024-03-26T17:00:34.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:00:34 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T17:00:34.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:00:34 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-26T17:00:34.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:00:34 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T17:00:34.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:00:34 smithi064 ceph-mon[34420]: pgmap v417: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 137 KiB/s rd, 2.2 KiB/s wr, 71 op/s 2024-03-26T17:00:34.556 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:34 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:00:34] INFO grpc.py:843: Received request to add a namespace using NSID 15 and UUID 6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d to nqn.2016-06.io.spdk:cnode3, context: None 2024-03-26T17:00:34.556 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:34 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:00:34] INFO grpc.py:299: Received request to create bdev bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d from mypool/myimage55 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-26T17:00:34.556 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:34 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [2024-03-26 17:00:34.142820] bdev_rbd.c:1278:bdev_rbd_create: *NOTICE*: Add bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d rbd disk to lun 2024-03-26T17:00:34.556 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:34 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:00:34] INFO grpc.py:338: bdev_rbd_create: bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d, cluster_name cluster_context_2_0 2024-03-26T17:00:34.556 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:34 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:00:34] INFO grpc.py:709: Received request to add bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d to nqn.2016-06.io.spdk:cnode3 with ANA group id 2 using NSID 15 and UUID 6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d 2024-03-26T17:00:34.556 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:34 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:00:34] INFO grpc.py:732: subsystem_add_ns: 15 2024-03-26T17:00:35.023 INFO:tasks.workunit.client.3.smithi157.stderr:+ (( image_index++ )) 2024-03-26T17:00:35.023 INFO:tasks.workunit.client.3.smithi157.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2024-03-26T17:00:35.023 INFO:tasks.workunit.client.3.smithi157.stderr:+ image=myimage56 2024-03-26T17:00:35.023 INFO:tasks.workunit.client.3.smithi157.stderr:+ sudo podman run -it quay.io/barakda1/nvmeof-cli:qe_ceph_devel_21e59b2 --server-address 172.21.15.44 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode3 --rbd-pool mypool --rbd-image myimage56 --load-balancing-group 3 2024-03-26T17:00:35.097 INFO:tasks.workunit.client.3.smithi157.stderr:time="2024-03-26T17:00:35Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2024-03-26T17:00:35.282 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:34 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:00:34] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:00:35.282 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:34 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:00:34] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:00:35.282 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:34 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}]}] 2024-03-26T17:00:35.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:00:35 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-b[34416]: 2024-03-26T17:00:35.281+0000 7ff022916700 -1 mon.b@2(peon) e3 get_health_metrics reporting 4 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T17:00:35.833 INFO:tasks.workunit.client.3.smithi157.stdout:Adding namespace 16 to nqn.2016-06.io.spdk:cnode3, load balancing group 3: Successful 2024-03-26T17:00:36.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:35 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:00:35] INFO grpc.py:843: Received request to add a namespace using NSID 16 and UUID 2cad5054-30eb-42c3-8147-56ca2066bb5e to nqn.2016-06.io.spdk:cnode3, context: None 2024-03-26T17:00:36.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:35 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:00:35] INFO grpc.py:299: Received request to create bdev bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e from mypool/myimage56 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-26T17:00:36.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:35 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [2024-03-26 17:00:35.843274] bdev_rbd.c:1278:bdev_rbd_create: *NOTICE*: Add bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e rbd disk to lun 2024-03-26T17:00:36.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:35 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:00:35] INFO grpc.py:338: bdev_rbd_create: bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e, cluster_name cluster_context_3_0 2024-03-26T17:00:36.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:35 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:00:35] INFO grpc.py:709: Received request to add bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e to nqn.2016-06.io.spdk:cnode3 with ANA group id 3 using NSID 16 and UUID 2cad5054-30eb-42c3-8147-56ca2066bb5e 2024-03-26T17:00:36.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:35 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:00:35] INFO grpc.py:732: subsystem_add_ns: 16 2024-03-26T17:00:36.196 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:35 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:00:35] INFO grpc.py:843: Received request to add a namespace using NSID 16 and UUID 2cad5054-30eb-42c3-8147-56ca2066bb5e to nqn.2016-06.io.spdk:cnode3, context: None 2024-03-26T17:00:36.196 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:35 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:00:35] INFO grpc.py:299: Received request to create bdev bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e from mypool/myimage56 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-26T17:00:36.197 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:35 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [2024-03-26 17:00:35.844194] bdev_rbd.c:1278:bdev_rbd_create: *NOTICE*: Add bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e rbd disk to lun 2024-03-26T17:00:36.197 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:35 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:00:35] INFO grpc.py:338: bdev_rbd_create: bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e, cluster_name cluster_context_3_0 2024-03-26T17:00:36.197 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:35 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:00:35] INFO grpc.py:709: Received request to add bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e to nqn.2016-06.io.spdk:cnode3 with ANA group id 3 using NSID 16 and UUID 2cad5054-30eb-42c3-8147-56ca2066bb5e 2024-03-26T17:00:36.197 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:35 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:00:35] INFO grpc.py:732: subsystem_add_ns: 16 2024-03-26T17:00:36.197 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:35] INFO grpc.py:843: Received request to add a namespace to nqn.2016-06.io.spdk:cnode3, context: 2024-03-26T17:00:36.197 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:35] INFO grpc.py:299: Received request to create bdev bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e from mypool/myimage56 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-26T17:00:36.197 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [2024-03-26 17:00:35.815623] bdev_rbd.c:1278:bdev_rbd_create: *NOTICE*: Add bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e rbd disk to lun 2024-03-26T17:00:36.198 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:35] INFO grpc.py:338: bdev_rbd_create: bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e, cluster_name cluster_context_3_0 2024-03-26T17:00:36.198 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:35] INFO grpc.py:709: Received request to add bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e to nqn.2016-06.io.spdk:cnode3 with ANA group id 3 using UUID 2cad5054-30eb-42c3-8147-56ca2066bb5e 2024-03-26T17:00:36.198 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:35] INFO grpc.py:732: subsystem_add_ns: 16 2024-03-26T17:00:36.198 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:35] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:00:36.198 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:35] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:00:36.198 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}]}] 2024-03-26T17:00:36.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:00:36 smithi044 ceph-mon[30624]: pgmap v418: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 92 KiB/s rd, 1.4 KiB/s wr, 49 op/s 2024-03-26T17:00:36.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:00:36 smithi064 ceph-mon[34420]: pgmap v418: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 92 KiB/s rd, 1.4 KiB/s wr, 49 op/s 2024-03-26T17:00:36.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:00:36 smithi149 ceph-mon[34678]: pgmap v418: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 92 KiB/s rd, 1.4 KiB/s wr, 49 op/s 2024-03-26T17:00:36.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:00:36 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 2024-03-26T17:00:36.206+0000 7fa707a55700 -1 mon.c@1(peon) e3 get_health_metrics reporting 3 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T17:00:36.647 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:36 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:00:36] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:00:36.647 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:36 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:00:36] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:00:36.647 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:36 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}]}] 2024-03-26T17:00:36.659 INFO:tasks.workunit.client.3.smithi157.stderr:+ (( image_index++ )) 2024-03-26T17:00:36.659 INFO:tasks.workunit.client.3.smithi157.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2024-03-26T17:00:36.660 INFO:tasks.workunit.client.3.smithi157.stderr:+ image=myimage57 2024-03-26T17:00:36.660 INFO:tasks.workunit.client.3.smithi157.stderr:+ sudo podman run -it quay.io/barakda1/nvmeof-cli:qe_ceph_devel_21e59b2 --server-address 172.21.15.44 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode3 --rbd-pool mypool --rbd-image myimage57 --load-balancing-group 1 2024-03-26T17:00:36.756 INFO:tasks.workunit.client.3.smithi157.stderr:time="2024-03-26T17:00:36Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2024-03-26T17:00:37.306 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:36 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:00:36] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:00:37.306 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:00:37] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:00:37.306 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}]}] 2024-03-26T17:00:37.485 INFO:tasks.workunit.client.3.smithi157.stdout:Adding namespace 17 to nqn.2016-06.io.spdk:cnode3, load balancing group 1: Successful 2024-03-26T17:00:37.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:37 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:37] INFO grpc.py:843: Received request to add a namespace to nqn.2016-06.io.spdk:cnode3, context: 2024-03-26T17:00:37.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:37 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:37] INFO grpc.py:299: Received request to create bdev bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f from mypool/myimage57 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-26T17:00:37.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:37 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [2024-03-26 17:00:37.468498] bdev_rbd.c:1278:bdev_rbd_create: *NOTICE*: Add bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f rbd disk to lun 2024-03-26T17:00:37.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:37 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:37] INFO grpc.py:338: bdev_rbd_create: bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f, cluster_name cluster_context_1_0 2024-03-26T17:00:37.766 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:37 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:37] INFO grpc.py:709: Received request to add bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f to nqn.2016-06.io.spdk:cnode3 with ANA group id 1 using UUID c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f 2024-03-26T17:00:37.766 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:37 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:37] INFO grpc.py:732: subsystem_add_ns: 17 2024-03-26T17:00:37.805 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:00:37] INFO grpc.py:843: Received request to add a namespace using NSID 17 and UUID c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f to nqn.2016-06.io.spdk:cnode3, context: None 2024-03-26T17:00:37.805 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:00:37] INFO grpc.py:299: Received request to create bdev bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f from mypool/myimage57 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-26T17:00:37.806 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [2024-03-26 17:00:37.496969] bdev_rbd.c:1278:bdev_rbd_create: *NOTICE*: Add bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f rbd disk to lun 2024-03-26T17:00:37.806 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:00:37] INFO grpc.py:338: bdev_rbd_create: bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f, cluster_name cluster_context_1_0 2024-03-26T17:00:37.806 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:00:37] INFO grpc.py:709: Received request to add bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f to nqn.2016-06.io.spdk:cnode3 with ANA group id 1 using NSID 17 and UUID c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f 2024-03-26T17:00:37.806 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:00:37] INFO grpc.py:732: subsystem_add_ns: 17 2024-03-26T17:00:37.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:37 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:00:37] INFO grpc.py:843: Received request to add a namespace using NSID 17 and UUID c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f to nqn.2016-06.io.spdk:cnode3, context: None 2024-03-26T17:00:37.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:37 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:00:37] INFO grpc.py:299: Received request to create bdev bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f from mypool/myimage57 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-26T17:00:37.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:37 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [2024-03-26 17:00:37.495601] bdev_rbd.c:1278:bdev_rbd_create: *NOTICE*: Add bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f rbd disk to lun 2024-03-26T17:00:37.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:37 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:00:37] INFO grpc.py:338: bdev_rbd_create: bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f, cluster_name cluster_context_1_0 2024-03-26T17:00:37.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:37 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:00:37] INFO grpc.py:709: Received request to add bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f to nqn.2016-06.io.spdk:cnode3 with ANA group id 1 using NSID 17 and UUID c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f 2024-03-26T17:00:37.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:37 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:00:37] INFO grpc.py:732: subsystem_add_ns: 17 2024-03-26T17:00:38.199 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:37 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:37] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:00:38.199 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:37 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:37] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:00:38.199 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:37 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}]}] 2024-03-26T17:00:38.345 INFO:tasks.workunit.client.3.smithi157.stderr:+ (( image_index++ )) 2024-03-26T17:00:38.346 INFO:tasks.workunit.client.3.smithi157.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2024-03-26T17:00:38.346 INFO:tasks.workunit.client.3.smithi157.stderr:+ image=myimage58 2024-03-26T17:00:38.346 INFO:tasks.workunit.client.3.smithi157.stderr:+ sudo podman run -it quay.io/barakda1/nvmeof-cli:qe_ceph_devel_21e59b2 --server-address 172.21.15.44 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode3 --rbd-pool mypool --rbd-image myimage58 --load-balancing-group 2 2024-03-26T17:00:38.419 INFO:tasks.workunit.client.3.smithi157.stderr:time="2024-03-26T17:00:38Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2024-03-26T17:00:38.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:00:38 smithi044 ceph-mon[30624]: pgmap v419: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 102 KiB/s rd, 1.6 KiB/s wr, 60 op/s 2024-03-26T17:00:38.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:00:38 smithi064 ceph-mon[34420]: pgmap v419: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 102 KiB/s rd, 1.6 KiB/s wr, 60 op/s 2024-03-26T17:00:38.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:00:38 smithi149 ceph-mon[34678]: pgmap v419: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 102 KiB/s rd, 1.6 KiB/s wr, 60 op/s 2024-03-26T17:00:38.646 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:38 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:00:38] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:00:38.647 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:38 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:00:38] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:00:38.647 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:38 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}]}] 2024-03-26T17:00:39.152 INFO:tasks.workunit.client.3.smithi157.stdout:Adding namespace 18 to nqn.2016-06.io.spdk:cnode3, load balancing group 2: Successful 2024-03-26T17:00:39.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:00:39 smithi064 ceph-mon[34420]: Health check update: 7 slow ops, oldest one blocked for 133 sec, daemons [mon.b,mon.c] have slow ops. (SLOW_OPS) 2024-03-26T17:00:39.306 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:39 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:00:39] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:00:39.306 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:39 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:00:39] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:00:39.306 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:39 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}]}] 2024-03-26T17:00:39.307 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:39 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:00:39] INFO grpc.py:843: Received request to add a namespace using NSID 18 and UUID 8fab603e-43d8-40fa-a513-509c13e98869 to nqn.2016-06.io.spdk:cnode3, context: None 2024-03-26T17:00:39.307 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:39 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:00:39] INFO grpc.py:299: Received request to create bdev bdev_8fab603e-43d8-40fa-a513-509c13e98869 from mypool/myimage58 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-26T17:00:39.307 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:39 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [2024-03-26 17:00:39.159803] bdev_rbd.c:1278:bdev_rbd_create: *NOTICE*: Add bdev_8fab603e-43d8-40fa-a513-509c13e98869 rbd disk to lun 2024-03-26T17:00:39.307 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:39 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:00:39] INFO grpc.py:338: bdev_rbd_create: bdev_8fab603e-43d8-40fa-a513-509c13e98869, cluster_name cluster_context_2_0 2024-03-26T17:00:39.307 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:39 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:00:39] INFO grpc.py:709: Received request to add bdev_8fab603e-43d8-40fa-a513-509c13e98869 to nqn.2016-06.io.spdk:cnode3 with ANA group id 2 using NSID 18 and UUID 8fab603e-43d8-40fa-a513-509c13e98869 2024-03-26T17:00:39.307 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:39 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:00:39] INFO grpc.py:732: subsystem_add_ns: 18 2024-03-26T17:00:39.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:00:39 smithi044 ceph-mon[30624]: Health check update: 7 slow ops, oldest one blocked for 133 sec, daemons [mon.b,mon.c] have slow ops. (SLOW_OPS) 2024-03-26T17:00:39.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:39 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:39] INFO grpc.py:843: Received request to add a namespace to nqn.2016-06.io.spdk:cnode3, context: 2024-03-26T17:00:39.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:39 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:39] INFO grpc.py:299: Received request to create bdev bdev_8fab603e-43d8-40fa-a513-509c13e98869 from mypool/myimage58 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-26T17:00:39.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:39 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [2024-03-26 17:00:39.135949] bdev_rbd.c:1278:bdev_rbd_create: *NOTICE*: Add bdev_8fab603e-43d8-40fa-a513-509c13e98869 rbd disk to lun 2024-03-26T17:00:39.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:39 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:39] INFO grpc.py:338: bdev_rbd_create: bdev_8fab603e-43d8-40fa-a513-509c13e98869, cluster_name cluster_context_2_0 2024-03-26T17:00:39.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:39 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:39] INFO grpc.py:709: Received request to add bdev_8fab603e-43d8-40fa-a513-509c13e98869 to nqn.2016-06.io.spdk:cnode3 with ANA group id 2 using UUID 8fab603e-43d8-40fa-a513-509c13e98869 2024-03-26T17:00:39.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:39 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:39] INFO grpc.py:732: subsystem_add_ns: 18 2024-03-26T17:00:39.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:00:39 smithi149 ceph-mon[34678]: Health check update: 7 slow ops, oldest one blocked for 133 sec, daemons [mon.b,mon.c] have slow ops. (SLOW_OPS) 2024-03-26T17:00:39.646 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:39 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:00:39] INFO grpc.py:843: Received request to add a namespace using NSID 18 and UUID 8fab603e-43d8-40fa-a513-509c13e98869 to nqn.2016-06.io.spdk:cnode3, context: None 2024-03-26T17:00:39.646 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:39 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:00:39] INFO grpc.py:299: Received request to create bdev bdev_8fab603e-43d8-40fa-a513-509c13e98869 from mypool/myimage58 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-26T17:00:39.646 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:39 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [2024-03-26 17:00:39.164037] bdev_rbd.c:1278:bdev_rbd_create: *NOTICE*: Add bdev_8fab603e-43d8-40fa-a513-509c13e98869 rbd disk to lun 2024-03-26T17:00:39.646 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:39 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:00:39] INFO grpc.py:338: bdev_rbd_create: bdev_8fab603e-43d8-40fa-a513-509c13e98869, cluster_name cluster_context_2_0 2024-03-26T17:00:39.646 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:39 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:00:39] INFO grpc.py:709: Received request to add bdev_8fab603e-43d8-40fa-a513-509c13e98869 to nqn.2016-06.io.spdk:cnode3 with ANA group id 2 using NSID 18 and UUID 8fab603e-43d8-40fa-a513-509c13e98869 2024-03-26T17:00:39.647 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:39 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:00:39] INFO grpc.py:732: subsystem_add_ns: 18 2024-03-26T17:00:39.978 INFO:tasks.workunit.client.3.smithi157.stderr:+ (( image_index++ )) 2024-03-26T17:00:39.979 INFO:tasks.workunit.client.3.smithi157.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2024-03-26T17:00:39.979 INFO:tasks.workunit.client.3.smithi157.stderr:+ image=myimage59 2024-03-26T17:00:39.979 INFO:tasks.workunit.client.3.smithi157.stderr:+ sudo podman run -it quay.io/barakda1/nvmeof-cli:qe_ceph_devel_21e59b2 --server-address 172.21.15.44 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode3 --rbd-pool mypool --rbd-image myimage59 --load-balancing-group 3 2024-03-26T17:00:40.075 INFO:tasks.workunit.client.3.smithi157.stderr:time="2024-03-26T17:00:40Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2024-03-26T17:00:40.204 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:39 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:39] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:00:40.204 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:39 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:39] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:00:40.204 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:39 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}]}] 2024-03-26T17:00:40.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:00:40 smithi044 ceph-mon[30624]: pgmap v420: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 141 KiB/s rd, 2.2 KiB/s wr, 72 op/s 2024-03-26T17:00:40.547 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:00:40 smithi149 ceph-mon[34678]: pgmap v420: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 141 KiB/s rd, 2.2 KiB/s wr, 72 op/s 2024-03-26T17:00:40.547 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:40 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:00:40] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:00:40.548 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:40 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:00:40] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:00:40.548 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:40 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}]}] 2024-03-26T17:00:40.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:00:40 smithi064 ceph-mon[34420]: pgmap v420: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 141 KiB/s rd, 2.2 KiB/s wr, 72 op/s 2024-03-26T17:00:40.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:00:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-b[34416]: 2024-03-26T17:00:40.280+0000 7ff022916700 -1 mon.b@2(peon) e3 get_health_metrics reporting 4 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T17:00:40.806 INFO:tasks.workunit.client.3.smithi157.stdout:Adding namespace 19 to nqn.2016-06.io.spdk:cnode3, load balancing group 3: Successful 2024-03-26T17:00:41.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:40 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:00:40] INFO grpc.py:843: Received request to add a namespace using NSID 19 and UUID d1568c59-1c06-4a94-adf0-389db9d95681 to nqn.2016-06.io.spdk:cnode3, context: None 2024-03-26T17:00:41.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:40 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:00:40] INFO grpc.py:299: Received request to create bdev bdev_d1568c59-1c06-4a94-adf0-389db9d95681 from mypool/myimage59 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-26T17:00:41.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:40 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [2024-03-26 17:00:40.816371] bdev_rbd.c:1278:bdev_rbd_create: *NOTICE*: Add bdev_d1568c59-1c06-4a94-adf0-389db9d95681 rbd disk to lun 2024-03-26T17:00:41.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:40 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:00:40] INFO grpc.py:338: bdev_rbd_create: bdev_d1568c59-1c06-4a94-adf0-389db9d95681, cluster_name cluster_context_3_0 2024-03-26T17:00:41.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:40 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:00:40] INFO grpc.py:709: Received request to add bdev_d1568c59-1c06-4a94-adf0-389db9d95681 to nqn.2016-06.io.spdk:cnode3 with ANA group id 3 using NSID 19 and UUID d1568c59-1c06-4a94-adf0-389db9d95681 2024-03-26T17:00:41.147 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:40 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:00:40] INFO grpc.py:732: subsystem_add_ns: 19 2024-03-26T17:00:41.265 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:40 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:40] INFO grpc.py:843: Received request to add a namespace to nqn.2016-06.io.spdk:cnode3, context: 2024-03-26T17:00:41.265 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:40 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:40] INFO grpc.py:299: Received request to create bdev bdev_d1568c59-1c06-4a94-adf0-389db9d95681 from mypool/myimage59 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-26T17:00:41.265 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:40 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [2024-03-26 17:00:40.789179] bdev_rbd.c:1278:bdev_rbd_create: *NOTICE*: Add bdev_d1568c59-1c06-4a94-adf0-389db9d95681 rbd disk to lun 2024-03-26T17:00:41.265 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:40 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:40] INFO grpc.py:338: bdev_rbd_create: bdev_d1568c59-1c06-4a94-adf0-389db9d95681, cluster_name cluster_context_3_0 2024-03-26T17:00:41.265 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:40 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:40] INFO grpc.py:709: Received request to add bdev_d1568c59-1c06-4a94-adf0-389db9d95681 to nqn.2016-06.io.spdk:cnode3 with ANA group id 3 using UUID d1568c59-1c06-4a94-adf0-389db9d95681 2024-03-26T17:00:41.265 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:40 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:40] INFO grpc.py:732: subsystem_add_ns: 19 2024-03-26T17:00:41.306 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:00:40] INFO grpc.py:843: Received request to add a namespace using NSID 19 and UUID d1568c59-1c06-4a94-adf0-389db9d95681 to nqn.2016-06.io.spdk:cnode3, context: None 2024-03-26T17:00:41.306 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:00:40] INFO grpc.py:299: Received request to create bdev bdev_d1568c59-1c06-4a94-adf0-389db9d95681 from mypool/myimage59 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-26T17:00:41.306 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [2024-03-26 17:00:40.815629] bdev_rbd.c:1278:bdev_rbd_create: *NOTICE*: Add bdev_d1568c59-1c06-4a94-adf0-389db9d95681 rbd disk to lun 2024-03-26T17:00:41.306 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:00:40] INFO grpc.py:338: bdev_rbd_create: bdev_d1568c59-1c06-4a94-adf0-389db9d95681, cluster_name cluster_context_3_0 2024-03-26T17:00:41.306 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:00:40] INFO grpc.py:709: Received request to add bdev_d1568c59-1c06-4a94-adf0-389db9d95681 to nqn.2016-06.io.spdk:cnode3 with ANA group id 3 using NSID 19 and UUID d1568c59-1c06-4a94-adf0-389db9d95681 2024-03-26T17:00:41.306 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:00:40] INFO grpc.py:732: subsystem_add_ns: 19 2024-03-26T17:00:41.307 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:00:41] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:00:41.307 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:00:41] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:00:41.307 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}]}] 2024-03-26T17:00:41.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:00:41 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 2024-03-26T17:00:41.207+0000 7fa707a55700 -1 mon.c@1(peon) e3 get_health_metrics reporting 3 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T17:00:41.732 INFO:tasks.workunit.client.3.smithi157.stderr:+ (( image_index++ )) 2024-03-26T17:00:41.732 INFO:tasks.workunit.client.3.smithi157.stderr:+ for ns in $(seq 1 $NVMEOF_NAMESPACES_COUNT) 2024-03-26T17:00:41.732 INFO:tasks.workunit.client.3.smithi157.stderr:+ image=myimage60 2024-03-26T17:00:41.732 INFO:tasks.workunit.client.3.smithi157.stderr:+ sudo podman run -it quay.io/barakda1/nvmeof-cli:qe_ceph_devel_21e59b2 --server-address 172.21.15.44 --server-port 5500 namespace add --subsystem nqn.2016-06.io.spdk:cnode3 --rbd-pool mypool --rbd-image myimage60 --load-balancing-group 1 2024-03-26T17:00:41.821 INFO:tasks.workunit.client.3.smithi157.stderr:time="2024-03-26T17:00:41Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2024-03-26T17:00:42.167 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:41 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:41] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:00:42.167 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:41 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:41] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:00:42.167 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:41 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}]}] 2024-03-26T17:00:42.469 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:00:42 smithi044 ceph-mon[30624]: pgmap v421: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 100 KiB/s rd, 1.5 KiB/s wr, 54 op/s 2024-03-26T17:00:42.495 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:00:42 smithi064 ceph-mon[34420]: pgmap v421: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 100 KiB/s rd, 1.5 KiB/s wr, 54 op/s 2024-03-26T17:00:42.496 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:00:42 smithi149 ceph-mon[34678]: pgmap v421: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 100 KiB/s rd, 1.5 KiB/s wr, 54 op/s 2024-03-26T17:00:42.497 INFO:tasks.workunit.client.3.smithi157.stdout:Adding namespace 20 to nqn.2016-06.io.spdk:cnode3, load balancing group 1: Successful 2024-03-26T17:00:42.498 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:42 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:00:42] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:00:42.498 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:42 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:00:42] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:00:42.498 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:42 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}]}] 2024-03-26T17:00:42.498 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:42 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:00:42] INFO grpc.py:843: Received request to add a namespace using NSID 20 and UUID 811fc261-889a-479a-9e58-cc5cc9b1fca9 to nqn.2016-06.io.spdk:cnode3, context: None 2024-03-26T17:00:42.498 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:42 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:00:42] INFO grpc.py:299: Received request to create bdev bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9 from mypool/myimage60 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-26T17:00:42.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:42 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:42] INFO grpc.py:843: Received request to add a namespace to nqn.2016-06.io.spdk:cnode3, context: 2024-03-26T17:00:42.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:42 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:42] INFO grpc.py:299: Received request to create bdev bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9 from mypool/myimage60 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-26T17:00:42.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:42 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [2024-03-26 17:00:42.481529] bdev_rbd.c:1278:bdev_rbd_create: *NOTICE*: Add bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9 rbd disk to lun 2024-03-26T17:00:42.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:42 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:42] INFO grpc.py:338: bdev_rbd_create: bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9, cluster_name cluster_context_1_0 2024-03-26T17:00:42.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:42 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:42] INFO grpc.py:709: Received request to add bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9 to nqn.2016-06.io.spdk:cnode3 with ANA group id 1 using UUID 811fc261-889a-479a-9e58-cc5cc9b1fca9 2024-03-26T17:00:42.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:42 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:42] INFO grpc.py:732: subsystem_add_ns: 20 2024-03-26T17:00:42.805 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:00:42] INFO grpc.py:843: Received request to add a namespace using NSID 20 and UUID 811fc261-889a-479a-9e58-cc5cc9b1fca9 to nqn.2016-06.io.spdk:cnode3, context: None 2024-03-26T17:00:42.805 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:00:42] INFO grpc.py:299: Received request to create bdev bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9 from mypool/myimage60 (size 0 MiB) with block size 512, will not create image if doesn't exist 2024-03-26T17:00:42.805 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [2024-03-26 17:00:42.507757] bdev_rbd.c:1278:bdev_rbd_create: *NOTICE*: Add bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9 rbd disk to lun 2024-03-26T17:00:42.805 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:00:42] INFO grpc.py:338: bdev_rbd_create: bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9, cluster_name cluster_context_1_0 2024-03-26T17:00:42.805 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:00:42] INFO grpc.py:709: Received request to add bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9 to nqn.2016-06.io.spdk:cnode3 with ANA group id 1 using NSID 20 and UUID 811fc261-889a-479a-9e58-cc5cc9b1fca9 2024-03-26T17:00:42.806 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:42 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:00:42] INFO grpc.py:732: subsystem_add_ns: 20 2024-03-26T17:00:42.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:42 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [2024-03-26 17:00:42.508680] bdev_rbd.c:1278:bdev_rbd_create: *NOTICE*: Add bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9 rbd disk to lun 2024-03-26T17:00:42.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:42 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:00:42] INFO grpc.py:338: bdev_rbd_create: bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9, cluster_name cluster_context_1_0 2024-03-26T17:00:42.897 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:42 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:00:42] INFO grpc.py:709: Received request to add bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9 to nqn.2016-06.io.spdk:cnode3 with ANA group id 1 using NSID 20 and UUID 811fc261-889a-479a-9e58-cc5cc9b1fca9 2024-03-26T17:00:42.897 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:42 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:00:42] INFO grpc.py:732: subsystem_add_ns: 20 2024-03-26T17:00:43.306 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:43 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:00:43] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:00:43.335 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:43 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:00:43] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:00:43.335 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:43 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:00:43.391 INFO:tasks.workunit.client.3.smithi157.stderr:+ (( image_index++ )) 2024-03-26T17:00:43.391 INFO:tasks.workunit.client.3.smithi157.stderr:+ list_subsystems 2024-03-26T17:00:43.391 INFO:tasks.workunit.client.3.smithi157.stderr:+ for i in "${!gateway_ips[@]}" 2024-03-26T17:00:43.391 INFO:tasks.workunit.client.3.smithi157.stderr:+ ip=172.21.15.44 2024-03-26T17:00:43.391 INFO:tasks.workunit.client.3.smithi157.stderr:+ sudo podman run -it quay.io/barakda1/nvmeof-cli:qe_ceph_devel_21e59b2 --server-address 172.21.15.44 --server-port 5500 --format json subsystem list 2024-03-26T17:00:43.486 INFO:tasks.workunit.client.3.smithi157.stderr:time="2024-03-26T17:00:43Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2024-03-26T17:00:43.896 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:00:43 smithi149 ceph-mon[34678]: Health check update: 7 slow ops, oldest one blocked for 138 sec, daemons [mon.b,mon.c] have slow ops. (SLOW_OPS) 2024-03-26T17:00:43.902 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:00:43 smithi044 ceph-mon[30624]: Health check update: 7 slow ops, oldest one blocked for 138 sec, daemons [mon.b,mon.c] have slow ops. (SLOW_OPS) 2024-03-26T17:00:44.055 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:00:43 smithi064 ceph-mon[34420]: Health check update: 7 slow ops, oldest one blocked for 138 sec, daemons [mon.b,mon.c] have slow ops. (SLOW_OPS) 2024-03-26T17:00:44.167 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:43 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:43] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:00:44.167 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:43 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:43] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:00:44.167 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:43 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:00:44.167 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:44 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:44] INFO grpc.py:2243: Received request to list the subsystem, context: 2024-03-26T17:00:44.176 INFO:tasks.workunit.client.3.smithi157.stdout:{ 2024-03-26T17:00:44.176 INFO:tasks.workunit.client.3.smithi157.stdout: "error_message": "Success", 2024-03-26T17:00:44.177 INFO:tasks.workunit.client.3.smithi157.stdout: "subsystems": [ 2024-03-26T17:00:44.177 INFO:tasks.workunit.client.3.smithi157.stdout: { 2024-03-26T17:00:44.177 INFO:tasks.workunit.client.3.smithi157.stdout: "nqn": "nqn.2016-06.io.spdk:cnode1", 2024-03-26T17:00:44.177 INFO:tasks.workunit.client.3.smithi157.stdout: "enable_ha": true, 2024-03-26T17:00:44.177 INFO:tasks.workunit.client.3.smithi157.stdout: "serial_number": "Ceph14383361503536", 2024-03-26T17:00:44.177 INFO:tasks.workunit.client.3.smithi157.stdout: "model_number": "Ceph bdev Controller", 2024-03-26T17:00:44.177 INFO:tasks.workunit.client.3.smithi157.stdout: "min_cntlid": 4081, 2024-03-26T17:00:44.177 INFO:tasks.workunit.client.3.smithi157.stdout: "max_cntlid": 6120, 2024-03-26T17:00:44.177 INFO:tasks.workunit.client.3.smithi157.stdout: "namespace_count": 20, 2024-03-26T17:00:44.177 INFO:tasks.workunit.client.3.smithi157.stdout: "subtype": "NVMe", 2024-03-26T17:00:44.177 INFO:tasks.workunit.client.3.smithi157.stdout: "max_namespaces": 256 2024-03-26T17:00:44.177 INFO:tasks.workunit.client.3.smithi157.stdout: }, 2024-03-26T17:00:44.177 INFO:tasks.workunit.client.3.smithi157.stdout: { 2024-03-26T17:00:44.177 INFO:tasks.workunit.client.3.smithi157.stdout: "nqn": "nqn.2016-06.io.spdk:cnode2", 2024-03-26T17:00:44.178 INFO:tasks.workunit.client.3.smithi157.stdout: "enable_ha": true, 2024-03-26T17:00:44.178 INFO:tasks.workunit.client.3.smithi157.stdout: "serial_number": "Ceph44698087180525", 2024-03-26T17:00:44.178 INFO:tasks.workunit.client.3.smithi157.stdout: "model_number": "Ceph bdev Controller", 2024-03-26T17:00:44.178 INFO:tasks.workunit.client.3.smithi157.stdout: "min_cntlid": 4081, 2024-03-26T17:00:44.178 INFO:tasks.workunit.client.3.smithi157.stdout: "max_cntlid": 6120, 2024-03-26T17:00:44.178 INFO:tasks.workunit.client.3.smithi157.stdout: "namespace_count": 20, 2024-03-26T17:00:44.178 INFO:tasks.workunit.client.3.smithi157.stdout: "subtype": "NVMe", 2024-03-26T17:00:44.178 INFO:tasks.workunit.client.3.smithi157.stdout: "max_namespaces": 256 2024-03-26T17:00:44.178 INFO:tasks.workunit.client.3.smithi157.stdout: }, 2024-03-26T17:00:44.178 INFO:tasks.workunit.client.3.smithi157.stdout: { 2024-03-26T17:00:44.178 INFO:tasks.workunit.client.3.smithi157.stdout: "nqn": "nqn.2016-06.io.spdk:cnode3", 2024-03-26T17:00:44.178 INFO:tasks.workunit.client.3.smithi157.stdout: "enable_ha": true, 2024-03-26T17:00:44.178 INFO:tasks.workunit.client.3.smithi157.stdout: "serial_number": "Ceph20558982565741", 2024-03-26T17:00:44.178 INFO:tasks.workunit.client.3.smithi157.stdout: "model_number": "Ceph bdev Controller", 2024-03-26T17:00:44.179 INFO:tasks.workunit.client.3.smithi157.stdout: "min_cntlid": 4081, 2024-03-26T17:00:44.179 INFO:tasks.workunit.client.3.smithi157.stdout: "max_cntlid": 6120, 2024-03-26T17:00:44.179 INFO:tasks.workunit.client.3.smithi157.stdout: "namespace_count": 20, 2024-03-26T17:00:44.179 INFO:tasks.workunit.client.3.smithi157.stdout: "subtype": "NVMe", 2024-03-26T17:00:44.179 INFO:tasks.workunit.client.3.smithi157.stdout: "max_namespaces": 256 2024-03-26T17:00:44.179 INFO:tasks.workunit.client.3.smithi157.stdout: } 2024-03-26T17:00:44.179 INFO:tasks.workunit.client.3.smithi157.stdout: ], 2024-03-26T17:00:44.179 INFO:tasks.workunit.client.3.smithi157.stdout: "status": 0 2024-03-26T17:00:44.179 INFO:tasks.workunit.client.3.smithi157.stdout:} 2024-03-26T17:00:44.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:44 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:44] INFO grpc.py:2251: list_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid' 2024-03-26T17:00:44.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:44 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: : 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:00:44.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:44 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:44] INFO grpc.py:1958: Subsystem nqn.2016-06.io.spdk:cnode1 enable_ha: True 2024-03-26T17:00:44.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:44 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:44] INFO grpc.py:1958: Subsystem nqn.2016-06.io.spdk:cnode2 enable_ha: True 2024-03-26T17:00:44.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:44 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:44] INFO grpc.py:1958: Subsystem nqn.2016-06.io.spdk:cnode3 enable_ha: True 2024-03-26T17:00:44.595 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:44 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:00:44] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:00:44.595 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:44 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:00:44] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:00:44.595 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:44 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:00:44.896 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:00:44 smithi149 ceph-mon[34678]: pgmap v422: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 145 KiB/s rd, 2.2 KiB/s wr, 72 op/s 2024-03-26T17:00:45.015 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:00:44 smithi044 ceph-mon[30624]: pgmap v422: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 145 KiB/s rd, 2.2 KiB/s wr, 72 op/s 2024-03-26T17:00:45.041 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:00:44 smithi064 ceph-mon[34420]: pgmap v422: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 145 KiB/s rd, 2.2 KiB/s wr, 72 op/s 2024-03-26T17:00:45.084 INFO:tasks.workunit.client.3.smithi157.stderr:+ for i in "${!gateway_ips[@]}" 2024-03-26T17:00:45.084 INFO:tasks.workunit.client.3.smithi157.stderr:+ ip=172.21.15.64 2024-03-26T17:00:45.084 INFO:tasks.workunit.client.3.smithi157.stderr:+ sudo podman run -it quay.io/barakda1/nvmeof-cli:qe_ceph_devel_21e59b2 --server-address 172.21.15.64 --server-port 5500 --format json subsystem list 2024-03-26T17:00:45.172 INFO:tasks.workunit.client.3.smithi157.stderr:time="2024-03-26T17:00:45Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2024-03-26T17:00:45.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:00:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-b[34416]: 2024-03-26T17:00:45.280+0000 7ff022916700 -1 mon.b@2(peon) e3 get_health_metrics reporting 4 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T17:00:45.306 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:00:45] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:00:45.306 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:00:45] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:00:45.306 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:00:45.867 INFO:tasks.workunit.client.3.smithi157.stdout:{ 2024-03-26T17:00:45.867 INFO:tasks.workunit.client.3.smithi157.stdout: "error_message": "Success", 2024-03-26T17:00:45.867 INFO:tasks.workunit.client.3.smithi157.stdout: "subsystems": [ 2024-03-26T17:00:45.867 INFO:tasks.workunit.client.3.smithi157.stdout: { 2024-03-26T17:00:45.867 INFO:tasks.workunit.client.3.smithi157.stdout: "nqn": "nqn.2016-06.io.spdk:cnode1", 2024-03-26T17:00:45.867 INFO:tasks.workunit.client.3.smithi157.stdout: "enable_ha": true, 2024-03-26T17:00:45.867 INFO:tasks.workunit.client.3.smithi157.stdout: "serial_number": "Ceph14383361503536", 2024-03-26T17:00:45.868 INFO:tasks.workunit.client.3.smithi157.stdout: "model_number": "Ceph bdev Controller", 2024-03-26T17:00:45.868 INFO:tasks.workunit.client.3.smithi157.stdout: "min_cntlid": 2041, 2024-03-26T17:00:45.868 INFO:tasks.workunit.client.3.smithi157.stdout: "max_cntlid": 4080, 2024-03-26T17:00:45.868 INFO:tasks.workunit.client.3.smithi157.stdout: "namespace_count": 20, 2024-03-26T17:00:45.868 INFO:tasks.workunit.client.3.smithi157.stdout: "subtype": "NVMe", 2024-03-26T17:00:45.868 INFO:tasks.workunit.client.3.smithi157.stdout: "max_namespaces": 256 2024-03-26T17:00:45.868 INFO:tasks.workunit.client.3.smithi157.stdout: }, 2024-03-26T17:00:45.868 INFO:tasks.workunit.client.3.smithi157.stdout: { 2024-03-26T17:00:45.868 INFO:tasks.workunit.client.3.smithi157.stdout: "nqn": "nqn.2016-06.io.spdk:cnode2", 2024-03-26T17:00:45.868 INFO:tasks.workunit.client.3.smithi157.stdout: "enable_ha": true, 2024-03-26T17:00:45.868 INFO:tasks.workunit.client.3.smithi157.stdout: "serial_number": "Ceph44698087180525", 2024-03-26T17:00:45.868 INFO:tasks.workunit.client.3.smithi157.stdout: "model_number": "Ceph bdev Controller", 2024-03-26T17:00:45.869 INFO:tasks.workunit.client.3.smithi157.stdout: "min_cntlid": 2041, 2024-03-26T17:00:45.869 INFO:tasks.workunit.client.3.smithi157.stdout: "max_cntlid": 4080, 2024-03-26T17:00:45.869 INFO:tasks.workunit.client.3.smithi157.stdout: "namespace_count": 20, 2024-03-26T17:00:45.869 INFO:tasks.workunit.client.3.smithi157.stdout: "subtype": "NVMe", 2024-03-26T17:00:45.869 INFO:tasks.workunit.client.3.smithi157.stdout: "max_namespaces": 256 2024-03-26T17:00:45.869 INFO:tasks.workunit.client.3.smithi157.stdout: }, 2024-03-26T17:00:45.869 INFO:tasks.workunit.client.3.smithi157.stdout: { 2024-03-26T17:00:45.869 INFO:tasks.workunit.client.3.smithi157.stdout: "nqn": "nqn.2016-06.io.spdk:cnode3", 2024-03-26T17:00:45.869 INFO:tasks.workunit.client.3.smithi157.stdout: "enable_ha": true, 2024-03-26T17:00:45.869 INFO:tasks.workunit.client.3.smithi157.stdout: "serial_number": "Ceph20558982565741", 2024-03-26T17:00:45.869 INFO:tasks.workunit.client.3.smithi157.stdout: "model_number": "Ceph bdev Controller", 2024-03-26T17:00:45.869 INFO:tasks.workunit.client.3.smithi157.stdout: "min_cntlid": 2041, 2024-03-26T17:00:45.869 INFO:tasks.workunit.client.3.smithi157.stdout: "max_cntlid": 4080, 2024-03-26T17:00:45.869 INFO:tasks.workunit.client.3.smithi157.stdout: "namespace_count": 20, 2024-03-26T17:00:45.870 INFO:tasks.workunit.client.3.smithi157.stdout: "subtype": "NVMe", 2024-03-26T17:00:45.870 INFO:tasks.workunit.client.3.smithi157.stdout: "max_namespaces": 256 2024-03-26T17:00:45.870 INFO:tasks.workunit.client.3.smithi157.stdout: } 2024-03-26T17:00:45.870 INFO:tasks.workunit.client.3.smithi157.stdout: ], 2024-03-26T17:00:45.870 INFO:tasks.workunit.client.3.smithi157.stdout: "status": 0 2024-03-26T17:00:45.870 INFO:tasks.workunit.client.3.smithi157.stdout:} 2024-03-26T17:00:46.197 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:45 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:45] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:00:46.198 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:45 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:45] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:00:46.198 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:45 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:00:46.198 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:00:45] INFO grpc.py:2243: Received request to list the subsystem, context: 2024-03-26T17:00:46.199 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:00:45] INFO grpc.py:2251: list_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid' 2024-03-26T17:00:46.199 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: : 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:00:46.199 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:00:45] INFO grpc.py:1958: Subsystem nqn.2016-06.io.spdk:cnode1 enable_ha: True 2024-03-26T17:00:46.199 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:00:45] INFO grpc.py:1958: Subsystem nqn.2016-06.io.spdk:cnode2 enable_ha: True 2024-03-26T17:00:46.199 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:00:45] INFO grpc.py:1958: Subsystem nqn.2016-06.io.spdk:cnode3 enable_ha: True 2024-03-26T17:00:46.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:00:46 smithi044 ceph-mon[30624]: pgmap v423: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 103 KiB/s rd, 1.5 KiB/s wr, 53 op/s 2024-03-26T17:00:46.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:00:46 smithi064 ceph-mon[34420]: pgmap v423: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 103 KiB/s rd, 1.5 KiB/s wr, 53 op/s 2024-03-26T17:00:46.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:00:46 smithi149 ceph-mon[34678]: pgmap v423: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 103 KiB/s rd, 1.5 KiB/s wr, 53 op/s 2024-03-26T17:00:46.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:00:46 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 2024-03-26T17:00:46.207+0000 7fa707a55700 -1 mon.c@1(peon) e3 get_health_metrics reporting 3 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T17:00:46.646 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:46 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:00:46] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:00:46.647 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:46 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:00:46] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:00:46.647 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:46 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:00:46.752 INFO:tasks.workunit.client.3.smithi157.stderr:+ for i in "${!gateway_ips[@]}" 2024-03-26T17:00:46.752 INFO:tasks.workunit.client.3.smithi157.stderr:+ ip=172.21.15.149 2024-03-26T17:00:46.753 INFO:tasks.workunit.client.3.smithi157.stderr:+ sudo podman run -it quay.io/barakda1/nvmeof-cli:qe_ceph_devel_21e59b2 --server-address 172.21.15.149 --server-port 5500 --format json subsystem list 2024-03-26T17:00:46.833 INFO:tasks.workunit.client.3.smithi157.stderr:time="2024-03-26T17:00:46Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2024-03-26T17:00:47.306 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:47 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:00:47] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:00:47.306 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:47 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:00:47] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:00:47.306 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:47 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:00:47.539 INFO:tasks.workunit.client.3.smithi157.stdout:{ 2024-03-26T17:00:47.539 INFO:tasks.workunit.client.3.smithi157.stdout: "error_message": "Success", 2024-03-26T17:00:47.540 INFO:tasks.workunit.client.3.smithi157.stdout: "subsystems": [ 2024-03-26T17:00:47.540 INFO:tasks.workunit.client.3.smithi157.stdout: { 2024-03-26T17:00:47.540 INFO:tasks.workunit.client.3.smithi157.stdout: "nqn": "nqn.2016-06.io.spdk:cnode1", 2024-03-26T17:00:47.540 INFO:tasks.workunit.client.3.smithi157.stdout: "enable_ha": true, 2024-03-26T17:00:47.540 INFO:tasks.workunit.client.3.smithi157.stdout: "serial_number": "Ceph14383361503536", 2024-03-26T17:00:47.540 INFO:tasks.workunit.client.3.smithi157.stdout: "model_number": "Ceph bdev Controller", 2024-03-26T17:00:47.540 INFO:tasks.workunit.client.3.smithi157.stdout: "min_cntlid": 1, 2024-03-26T17:00:47.540 INFO:tasks.workunit.client.3.smithi157.stdout: "max_cntlid": 2040, 2024-03-26T17:00:47.540 INFO:tasks.workunit.client.3.smithi157.stdout: "namespace_count": 20, 2024-03-26T17:00:47.540 INFO:tasks.workunit.client.3.smithi157.stdout: "subtype": "NVMe", 2024-03-26T17:00:47.540 INFO:tasks.workunit.client.3.smithi157.stdout: "max_namespaces": 256 2024-03-26T17:00:47.540 INFO:tasks.workunit.client.3.smithi157.stdout: }, 2024-03-26T17:00:47.540 INFO:tasks.workunit.client.3.smithi157.stdout: { 2024-03-26T17:00:47.540 INFO:tasks.workunit.client.3.smithi157.stdout: "nqn": "nqn.2016-06.io.spdk:cnode2", 2024-03-26T17:00:47.541 INFO:tasks.workunit.client.3.smithi157.stdout: "enable_ha": true, 2024-03-26T17:00:47.541 INFO:tasks.workunit.client.3.smithi157.stdout: "serial_number": "Ceph44698087180525", 2024-03-26T17:00:47.541 INFO:tasks.workunit.client.3.smithi157.stdout: "model_number": "Ceph bdev Controller", 2024-03-26T17:00:47.541 INFO:tasks.workunit.client.3.smithi157.stdout: "min_cntlid": 1, 2024-03-26T17:00:47.541 INFO:tasks.workunit.client.3.smithi157.stdout: "max_cntlid": 2040, 2024-03-26T17:00:47.541 INFO:tasks.workunit.client.3.smithi157.stdout: "namespace_count": 20, 2024-03-26T17:00:47.541 INFO:tasks.workunit.client.3.smithi157.stdout: "subtype": "NVMe", 2024-03-26T17:00:47.541 INFO:tasks.workunit.client.3.smithi157.stdout: "max_namespaces": 256 2024-03-26T17:00:47.541 INFO:tasks.workunit.client.3.smithi157.stdout: }, 2024-03-26T17:00:47.541 INFO:tasks.workunit.client.3.smithi157.stdout: { 2024-03-26T17:00:47.541 INFO:tasks.workunit.client.3.smithi157.stdout: "nqn": "nqn.2016-06.io.spdk:cnode3", 2024-03-26T17:00:47.541 INFO:tasks.workunit.client.3.smithi157.stdout: "enable_ha": true, 2024-03-26T17:00:47.541 INFO:tasks.workunit.client.3.smithi157.stdout: "serial_number": "Ceph20558982565741", 2024-03-26T17:00:47.541 INFO:tasks.workunit.client.3.smithi157.stdout: "model_number": "Ceph bdev Controller", 2024-03-26T17:00:47.541 INFO:tasks.workunit.client.3.smithi157.stdout: "min_cntlid": 1, 2024-03-26T17:00:47.542 INFO:tasks.workunit.client.3.smithi157.stdout: "max_cntlid": 2040, 2024-03-26T17:00:47.542 INFO:tasks.workunit.client.3.smithi157.stdout: "namespace_count": 20, 2024-03-26T17:00:47.542 INFO:tasks.workunit.client.3.smithi157.stdout: "subtype": "NVMe", 2024-03-26T17:00:47.542 INFO:tasks.workunit.client.3.smithi157.stdout: "max_namespaces": 256 2024-03-26T17:00:47.542 INFO:tasks.workunit.client.3.smithi157.stdout: } 2024-03-26T17:00:47.542 INFO:tasks.workunit.client.3.smithi157.stdout: ], 2024-03-26T17:00:47.542 INFO:tasks.workunit.client.3.smithi157.stdout: "status": 0 2024-03-26T17:00:47.542 INFO:tasks.workunit.client.3.smithi157.stdout:} 2024-03-26T17:00:47.897 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:47 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:00:47] INFO grpc.py:2243: Received request to list the subsystem, context: 2024-03-26T17:00:47.897 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:47 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:00:47] INFO grpc.py:2251: list_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f 2024-03-26T17:00:47.897 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:47 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:00:47.897 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:47 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:00:47] INFO grpc.py:1958: Subsystem nqn.2016-06.io.spdk:cnode1 enable_ha: True 2024-03-26T17:00:47.898 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:47 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:00:47] INFO grpc.py:1958: Subsystem nqn.2016-06.io.spdk:cnode2 enable_ha: True 2024-03-26T17:00:47.898 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:47 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:00:47] INFO grpc.py:1958: Subsystem nqn.2016-06.io.spdk:cnode3 enable_ha: True 2024-03-26T17:00:48.197 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:47 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:47] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:00:48.198 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:47 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:47] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:00:48.198 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:47 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:00:48.462 INFO:tasks.workunit.client.3.smithi157.stderr:++ seq 1 3 2024-03-26T17:00:48.463 INFO:tasks.workunit.client.3.smithi157.stderr:+ for i in $(seq 1 $NVMEOF_SUBSYSTEMS_COUNT) 2024-03-26T17:00:48.463 INFO:tasks.workunit.client.3.smithi157.stderr:+ subsystem_nqn=nqn.2016-06.io.spdk:cnode1 2024-03-26T17:00:48.463 INFO:tasks.workunit.client.3.smithi157.stderr:+ sudo podman run -it quay.io/barakda1/nvmeof-cli:qe_ceph_devel_21e59b2 --server-address 172.21.15.44 --server-port 5500 --format plain namespace list --subsystem nqn.2016-06.io.spdk:cnode1 2024-03-26T17:00:48.517 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:00:48 smithi044 ceph-mon[30624]: pgmap v424: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 107 KiB/s rd, 1.6 KiB/s wr, 58 op/s 2024-03-26T17:00:48.544 INFO:tasks.workunit.client.3.smithi157.stderr:time="2024-03-26T17:00:48Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2024-03-26T17:00:48.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:00:48 smithi064 ceph-mon[34420]: pgmap v424: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 107 KiB/s rd, 1.6 KiB/s wr, 58 op/s 2024-03-26T17:00:48.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:00:48 smithi149 ceph-mon[34678]: pgmap v424: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 107 KiB/s rd, 1.6 KiB/s wr, 58 op/s 2024-03-26T17:00:48.646 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:00:48] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:00:48.648 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:00:48] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:00:48.648 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:00:49.418 INFO:tasks.workunit.client.3.smithi157.stdout:Namespaces in subsystem nqn.2016-06.io.spdk:cnode1: 2024-03-26T17:00:49.418 INFO:tasks.workunit.client.3.smithi157.stdout: NSID Bdev RBD RBD Image Block UUID Load R/W IOs R/W MBs Read MBs Write MBs 2024-03-26T17:00:49.418 INFO:tasks.workunit.client.3.smithi157.stdout: Name Pool Image Size Size Balancing per per per per 2024-03-26T17:00:49.418 INFO:tasks.workunit.client.3.smithi157.stdout: Group second second second second 2024-03-26T17:00:49.418 INFO:tasks.workunit.client.3.smithi157.stdout: 1 bdev_da4a4580-2a9d- mypool myimage1 8 GiB 512 B da4a4580-2a9d-4ce8- 2 unlimited unlimited unlimited unlimited 2024-03-26T17:00:49.418 INFO:tasks.workunit.client.3.smithi157.stdout: 4ce8-9740-82cebdee1a5b 9740-82cebdee1a5b 2024-03-26T17:00:49.418 INFO:tasks.workunit.client.3.smithi157.stdout: 2 bdev_a1755742-338c- mypool myimage2 8 GiB 512 B a1755742-338c-47ea- 3 unlimited unlimited unlimited unlimited 2024-03-26T17:00:49.418 INFO:tasks.workunit.client.3.smithi157.stdout: 47ea-8ef2-33f2fc007e14 8ef2-33f2fc007e14 2024-03-26T17:00:49.418 INFO:tasks.workunit.client.3.smithi157.stdout: 3 bdev_7717f2c5-9bb6- mypool myimage3 8 GiB 512 B 7717f2c5-9bb6-4924- 1 unlimited unlimited unlimited unlimited 2024-03-26T17:00:49.419 INFO:tasks.workunit.client.3.smithi157.stdout: 4924-8148-adf5c9e343bf 8148-adf5c9e343bf 2024-03-26T17:00:49.419 INFO:tasks.workunit.client.3.smithi157.stdout: 4 bdev_6060c284-177d- mypool myimage4 8 GiB 512 B 6060c284-177d-4f51- 2 unlimited unlimited unlimited unlimited 2024-03-26T17:00:49.419 INFO:tasks.workunit.client.3.smithi157.stdout: 4f51-aee2-022f2e268fb6 aee2-022f2e268fb6 2024-03-26T17:00:49.419 INFO:tasks.workunit.client.3.smithi157.stdout: 5 bdev_9f5354a4-1a93- mypool myimage5 8 GiB 512 B 9f5354a4-1a93-4270- 3 unlimited unlimited unlimited unlimited 2024-03-26T17:00:49.419 INFO:tasks.workunit.client.3.smithi157.stdout: 4270-b370-63e819567f34 b370-63e819567f34 2024-03-26T17:00:49.419 INFO:tasks.workunit.client.3.smithi157.stdout: 6 bdev_c4744537-f8b3- mypool myimage6 8 GiB 512 B c4744537-f8b3-4b20- 1 unlimited unlimited unlimited unlimited 2024-03-26T17:00:49.419 INFO:tasks.workunit.client.3.smithi157.stdout: 4b20-8574-5fcd7b0891e9 8574-5fcd7b0891e9 2024-03-26T17:00:49.419 INFO:tasks.workunit.client.3.smithi157.stdout: 7 bdev_0fbd24ec-f925- mypool myimage7 8 GiB 512 B 0fbd24ec-f925-4370- 2 unlimited unlimited unlimited unlimited 2024-03-26T17:00:49.419 INFO:tasks.workunit.client.3.smithi157.stdout: 4370-b9a5-5f94bccb6786 b9a5-5f94bccb6786 2024-03-26T17:00:49.419 INFO:tasks.workunit.client.3.smithi157.stdout: 8 bdev_082e5959-2b79- mypool myimage8 8 GiB 512 B 082e5959-2b79-418e- 3 unlimited unlimited unlimited unlimited 2024-03-26T17:00:49.419 INFO:tasks.workunit.client.3.smithi157.stdout: 418e-99dc-c3195cfa988f 99dc-c3195cfa988f 2024-03-26T17:00:49.419 INFO:tasks.workunit.client.3.smithi157.stdout: 9 bdev_534ef0bb-59d3- mypool myimage9 8 GiB 512 B 534ef0bb-59d3-439a- 1 unlimited unlimited unlimited unlimited 2024-03-26T17:00:49.419 INFO:tasks.workunit.client.3.smithi157.stdout: 439a-b8d0-c3542ab84f6c b8d0-c3542ab84f6c 2024-03-26T17:00:49.420 INFO:tasks.workunit.client.3.smithi157.stdout: 10 bdev_a8f5f33b-b8e1- mypool myimage10 8 GiB 512 B a8f5f33b-b8e1-47df- 2 unlimited unlimited unlimited unlimited 2024-03-26T17:00:49.420 INFO:tasks.workunit.client.3.smithi157.stdout: 47df-85bb-973d3baca17a 85bb-973d3baca17a 2024-03-26T17:00:49.420 INFO:tasks.workunit.client.3.smithi157.stdout: 11 bdev_ba551130-b365- mypool myimage11 8 GiB 512 B ba551130-b365-468c- 3 unlimited unlimited unlimited unlimited 2024-03-26T17:00:49.420 INFO:tasks.workunit.client.3.smithi157.stdout: 468c-9ac2-2c5c81e90eda 9ac2-2c5c81e90eda 2024-03-26T17:00:49.420 INFO:tasks.workunit.client.3.smithi157.stdout: 12 bdev_dc39ff28-61dd- mypool myimage12 8 GiB 512 B dc39ff28-61dd-4e08- 1 unlimited unlimited unlimited unlimited 2024-03-26T17:00:49.420 INFO:tasks.workunit.client.3.smithi157.stdout: 4e08-b69e-0a8559ae9feb b69e-0a8559ae9feb 2024-03-26T17:00:49.420 INFO:tasks.workunit.client.3.smithi157.stdout: 13 bdev_9e6e9ccd-76f6- mypool myimage13 8 GiB 512 B 9e6e9ccd-76f6-452d- 2 unlimited unlimited unlimited unlimited 2024-03-26T17:00:49.420 INFO:tasks.workunit.client.3.smithi157.stdout: 452d-b3d7-4bcb00171e17 b3d7-4bcb00171e17 2024-03-26T17:00:49.420 INFO:tasks.workunit.client.3.smithi157.stdout: 14 bdev_89d6e70d-b953- mypool myimage14 8 GiB 512 B 89d6e70d-b953-4551- 3 unlimited unlimited unlimited unlimited 2024-03-26T17:00:49.420 INFO:tasks.workunit.client.3.smithi157.stdout: 4551-9256-1dd8e30b2d0f 9256-1dd8e30b2d0f 2024-03-26T17:00:49.420 INFO:tasks.workunit.client.3.smithi157.stdout: 15 bdev_48c15cff-e791- mypool myimage15 8 GiB 512 B 48c15cff-e791-4341- 1 unlimited unlimited unlimited unlimited 2024-03-26T17:00:49.420 INFO:tasks.workunit.client.3.smithi157.stdout: 4341-9256-88cfb39f6693 9256-88cfb39f6693 2024-03-26T17:00:49.420 INFO:tasks.workunit.client.3.smithi157.stdout: 16 bdev_38e87f8c-e7d9- mypool myimage16 8 GiB 512 B 38e87f8c-e7d9-4d69- 2 unlimited unlimited unlimited unlimited 2024-03-26T17:00:49.420 INFO:tasks.workunit.client.3.smithi157.stdout: 4d69-ab3e-6fea8f4efe47 ab3e-6fea8f4efe47 2024-03-26T17:00:49.421 INFO:tasks.workunit.client.3.smithi157.stdout: 17 bdev_0aaf3983-217a- mypool myimage17 8 GiB 512 B 0aaf3983-217a-4d6b- 3 unlimited unlimited unlimited unlimited 2024-03-26T17:00:49.421 INFO:tasks.workunit.client.3.smithi157.stdout: 4d6b-a3aa-63888b07164a a3aa-63888b07164a 2024-03-26T17:00:49.421 INFO:tasks.workunit.client.3.smithi157.stdout: 18 bdev_c6887013-be71- mypool myimage18 8 GiB 512 B c6887013-be71-4aaf- 1 unlimited unlimited unlimited unlimited 2024-03-26T17:00:49.421 INFO:tasks.workunit.client.3.smithi157.stdout: 4aaf-b084-84236db9e43d b084-84236db9e43d 2024-03-26T17:00:49.421 INFO:tasks.workunit.client.3.smithi157.stdout: 19 bdev_d686ab7c-1ace- mypool myimage19 8 GiB 512 B d686ab7c-1ace-4ff8- 2 unlimited unlimited unlimited unlimited 2024-03-26T17:00:49.421 INFO:tasks.workunit.client.3.smithi157.stdout: 4ff8-aec0-b3b6741b3361 aec0-b3b6741b3361 2024-03-26T17:00:49.421 INFO:tasks.workunit.client.3.smithi157.stdout: 20 bdev_c358261a-15a0- mypool myimage20 8 GiB 512 B c358261a-15a0-4e64- 3 unlimited unlimited unlimited unlimited 2024-03-26T17:00:49.421 INFO:tasks.workunit.client.3.smithi157.stdout: 4e64-8640-7ff4cf1c4b95 8640-7ff4cf1c4b95 2024-03-26T17:00:49.457 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:00:49 smithi064 ceph-mon[34420]: Health check update: 7 slow ops, oldest one blocked for 143 sec, daemons [mon.b,mon.c] have slow ops. (SLOW_OPS) 2024-03-26T17:00:49.457 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:49 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:00:49] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:00:49.457 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:49 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:00:49] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:00:49.457 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:49 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:00:49.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:00:49 smithi044 ceph-mon[30624]: Health check update: 7 slow ops, oldest one blocked for 143 sec, daemons [mon.b,mon.c] have slow ops. (SLOW_OPS) 2024-03-26T17:00:49.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:49 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:49] INFO grpc.py:1134: Received request to list all namespaces for nqn.2016-06.io.spdk:cnode1, context: 2024-03-26T17:00:49.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:49 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:49] INFO grpc.py:1139: list_namespaces: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}] 2024-03-26T17:00:49.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:00:49 smithi149 ceph-mon[34678]: Health check update: 7 slow ops, oldest one blocked for 143 sec, daemons [mon.b,mon.c] have slow ops. (SLOW_OPS) 2024-03-26T17:00:50.202 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:49 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:49] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:00:50.203 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:49 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:49] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:00:50.203 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:49 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:00:50.254 INFO:tasks.workunit.client.3.smithi157.stderr:+ for i in $(seq 1 $NVMEOF_SUBSYSTEMS_COUNT) 2024-03-26T17:00:50.254 INFO:tasks.workunit.client.3.smithi157.stderr:+ subsystem_nqn=nqn.2016-06.io.spdk:cnode2 2024-03-26T17:00:50.254 INFO:tasks.workunit.client.3.smithi157.stderr:+ sudo podman run -it quay.io/barakda1/nvmeof-cli:qe_ceph_devel_21e59b2 --server-address 172.21.15.44 --server-port 5500 --format plain namespace list --subsystem nqn.2016-06.io.spdk:cnode2 2024-03-26T17:00:50.331 INFO:tasks.workunit.client.3.smithi157.stderr:time="2024-03-26T17:00:50Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2024-03-26T17:00:50.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:00:50 smithi044 ceph-mon[30624]: pgmap v425: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 103 KiB/s rd, 1.3 KiB/s wr, 40 op/s 2024-03-26T17:00:50.547 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:00:50 smithi149 ceph-mon[34678]: pgmap v425: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 103 KiB/s rd, 1.3 KiB/s wr, 40 op/s 2024-03-26T17:00:50.548 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:00:50] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:00:50.548 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:00:50] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:00:50.548 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:00:50.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:00:50 smithi064 ceph-mon[34420]: pgmap v425: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 103 KiB/s rd, 1.3 KiB/s wr, 40 op/s 2024-03-26T17:00:50.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:00:50 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-b[34416]: 2024-03-26T17:00:50.281+0000 7ff022916700 -1 mon.b@2(peon) e3 get_health_metrics reporting 4 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T17:00:51.238 INFO:tasks.workunit.client.3.smithi157.stdout:Namespaces in subsystem nqn.2016-06.io.spdk:cnode2: 2024-03-26T17:00:51.238 INFO:tasks.workunit.client.3.smithi157.stdout: NSID Bdev RBD RBD Image Block UUID Load R/W IOs R/W MBs Read MBs Write MBs 2024-03-26T17:00:51.238 INFO:tasks.workunit.client.3.smithi157.stdout: Name Pool Image Size Size Balancing per per per per 2024-03-26T17:00:51.238 INFO:tasks.workunit.client.3.smithi157.stdout: Group second second second second 2024-03-26T17:00:51.238 INFO:tasks.workunit.client.3.smithi157.stdout: 1 bdev_05b2e1a6-3d5a- mypool myimage21 8 GiB 512 B 05b2e1a6-3d5a-4b69- 1 unlimited unlimited unlimited unlimited 2024-03-26T17:00:51.238 INFO:tasks.workunit.client.3.smithi157.stdout: 4b69-871c-1ac01c6d8776 871c-1ac01c6d8776 2024-03-26T17:00:51.238 INFO:tasks.workunit.client.3.smithi157.stdout: 2 bdev_8cb4fb23-ee03- mypool myimage22 8 GiB 512 B 8cb4fb23-ee03-4621- 2 unlimited unlimited unlimited unlimited 2024-03-26T17:00:51.238 INFO:tasks.workunit.client.3.smithi157.stdout: 4621-a45c-b79e612fbaa4 a45c-b79e612fbaa4 2024-03-26T17:00:51.238 INFO:tasks.workunit.client.3.smithi157.stdout: 3 bdev_cdfc396b-4911- mypool myimage23 8 GiB 512 B cdfc396b-4911-47eb- 3 unlimited unlimited unlimited unlimited 2024-03-26T17:00:51.239 INFO:tasks.workunit.client.3.smithi157.stdout: 47eb-a9ea-a3af2ac6cc80 a9ea-a3af2ac6cc80 2024-03-26T17:00:51.239 INFO:tasks.workunit.client.3.smithi157.stdout: 4 bdev_fa7d8c13-5edf- mypool myimage24 8 GiB 512 B fa7d8c13-5edf-4558- 1 unlimited unlimited unlimited unlimited 2024-03-26T17:00:51.239 INFO:tasks.workunit.client.3.smithi157.stdout: 4558-a74d-2c9100ecc792 a74d-2c9100ecc792 2024-03-26T17:00:51.239 INFO:tasks.workunit.client.3.smithi157.stdout: 5 bdev_dbd3d055-7949- mypool myimage25 8 GiB 512 B dbd3d055-7949-4d28- 2 unlimited unlimited unlimited unlimited 2024-03-26T17:00:51.239 INFO:tasks.workunit.client.3.smithi157.stdout: 4d28-88b7-dcced8014e1e 88b7-dcced8014e1e 2024-03-26T17:00:51.239 INFO:tasks.workunit.client.3.smithi157.stdout: 6 bdev_b2a9455c-af18- mypool myimage26 8 GiB 512 B b2a9455c-af18-49f2- 3 unlimited unlimited unlimited unlimited 2024-03-26T17:00:51.239 INFO:tasks.workunit.client.3.smithi157.stdout: 49f2-a3f0-7f6f12f2bb0f a3f0-7f6f12f2bb0f 2024-03-26T17:00:51.239 INFO:tasks.workunit.client.3.smithi157.stdout: 7 bdev_58fe2e66-c15a- mypool myimage27 8 GiB 512 B 58fe2e66-c15a-4e64- 1 unlimited unlimited unlimited unlimited 2024-03-26T17:00:51.239 INFO:tasks.workunit.client.3.smithi157.stdout: 4e64-8a9e-47cc37be9ce9 8a9e-47cc37be9ce9 2024-03-26T17:00:51.239 INFO:tasks.workunit.client.3.smithi157.stdout: 8 bdev_df083c66-8523- mypool myimage28 8 GiB 512 B df083c66-8523-462f- 2 unlimited unlimited unlimited unlimited 2024-03-26T17:00:51.239 INFO:tasks.workunit.client.3.smithi157.stdout: 462f-b725-47c2fbdeb60d b725-47c2fbdeb60d 2024-03-26T17:00:51.239 INFO:tasks.workunit.client.3.smithi157.stdout: 9 bdev_0213ed81-dc60- mypool myimage29 8 GiB 512 B 0213ed81-dc60-4b5e- 3 unlimited unlimited unlimited unlimited 2024-03-26T17:00:51.240 INFO:tasks.workunit.client.3.smithi157.stdout: 4b5e-ac6b-64bdf671f2c3 ac6b-64bdf671f2c3 2024-03-26T17:00:51.240 INFO:tasks.workunit.client.3.smithi157.stdout: 10 bdev_b19dd955-58ce- mypool myimage30 8 GiB 512 B b19dd955-58ce-4f68- 1 unlimited unlimited unlimited unlimited 2024-03-26T17:00:51.240 INFO:tasks.workunit.client.3.smithi157.stdout: 4f68-b8cb-4f2022edf2c8 b8cb-4f2022edf2c8 2024-03-26T17:00:51.240 INFO:tasks.workunit.client.3.smithi157.stdout: 11 bdev_64dd9e25-4738- mypool myimage31 8 GiB 512 B 64dd9e25-4738-44d3- 2 unlimited unlimited unlimited unlimited 2024-03-26T17:00:51.240 INFO:tasks.workunit.client.3.smithi157.stdout: 44d3-b164-38aca4721574 b164-38aca4721574 2024-03-26T17:00:51.240 INFO:tasks.workunit.client.3.smithi157.stdout: 12 bdev_f39c41fc-2f73- mypool myimage32 8 GiB 512 B f39c41fc-2f73-4d4b- 3 unlimited unlimited unlimited unlimited 2024-03-26T17:00:51.240 INFO:tasks.workunit.client.3.smithi157.stdout: 4d4b-9972-e1a944915be2 9972-e1a944915be2 2024-03-26T17:00:51.240 INFO:tasks.workunit.client.3.smithi157.stdout: 13 bdev_b0126702-a889- mypool myimage33 8 GiB 512 B b0126702-a889-4773- 1 unlimited unlimited unlimited unlimited 2024-03-26T17:00:51.240 INFO:tasks.workunit.client.3.smithi157.stdout: 4773-8787-b89b9db99211 8787-b89b9db99211 2024-03-26T17:00:51.240 INFO:tasks.workunit.client.3.smithi157.stdout: 14 bdev_6de556ce-fd3a- mypool myimage34 8 GiB 512 B 6de556ce-fd3a-4e65- 2 unlimited unlimited unlimited unlimited 2024-03-26T17:00:51.240 INFO:tasks.workunit.client.3.smithi157.stdout: 4e65-a5ef-e98b3708c676 a5ef-e98b3708c676 2024-03-26T17:00:51.240 INFO:tasks.workunit.client.3.smithi157.stdout: 15 bdev_3e830603-72e5- mypool myimage35 8 GiB 512 B 3e830603-72e5-456c- 3 unlimited unlimited unlimited unlimited 2024-03-26T17:00:51.240 INFO:tasks.workunit.client.3.smithi157.stdout: 456c-88e5-7bb0898fd4ab 88e5-7bb0898fd4ab 2024-03-26T17:00:51.240 INFO:tasks.workunit.client.3.smithi157.stdout: 16 bdev_b5b1b5ea-d9fa- mypool myimage36 8 GiB 512 B b5b1b5ea-d9fa-48a2- 1 unlimited unlimited unlimited unlimited 2024-03-26T17:00:51.241 INFO:tasks.workunit.client.3.smithi157.stdout: 48a2-a8f8-8e2544c8a27c a8f8-8e2544c8a27c 2024-03-26T17:00:51.241 INFO:tasks.workunit.client.3.smithi157.stdout: 17 bdev_ca27fdbb-df6d- mypool myimage37 8 GiB 512 B ca27fdbb-df6d-4379- 2 unlimited unlimited unlimited unlimited 2024-03-26T17:00:51.241 INFO:tasks.workunit.client.3.smithi157.stdout: 4379-a6b3-8550edf613bb a6b3-8550edf613bb 2024-03-26T17:00:51.241 INFO:tasks.workunit.client.3.smithi157.stdout: 18 bdev_856c7df5-918e- mypool myimage38 8 GiB 512 B 856c7df5-918e-47bc- 3 unlimited unlimited unlimited unlimited 2024-03-26T17:00:51.241 INFO:tasks.workunit.client.3.smithi157.stdout: 47bc-865f-bf945817a40a 865f-bf945817a40a 2024-03-26T17:00:51.241 INFO:tasks.workunit.client.3.smithi157.stdout: 19 bdev_73911108-c449- mypool myimage39 8 GiB 512 B 73911108-c449-4dde- 1 unlimited unlimited unlimited unlimited 2024-03-26T17:00:51.241 INFO:tasks.workunit.client.3.smithi157.stdout: 4dde-9e0b-f3c55fa58540 9e0b-f3c55fa58540 2024-03-26T17:00:51.241 INFO:tasks.workunit.client.3.smithi157.stdout: 20 bdev_10b25a6d-4c83- mypool myimage40 8 GiB 512 B 10b25a6d-4c83-43ac- 2 unlimited unlimited unlimited unlimited 2024-03-26T17:00:51.241 INFO:tasks.workunit.client.3.smithi157.stdout: 43ac-82be-34e5f35e18eb 82be-34e5f35e18eb 2024-03-26T17:00:51.457 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:51 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:00:51] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:00:51.457 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:51 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:00:51] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:00:51.457 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:51 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:00:51.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:51 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:51] INFO grpc.py:1134: Received request to list all namespaces for nqn.2016-06.io.spdk:cnode2, context: 2024-03-26T17:00:51.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:51 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:51] INFO grpc.py:1139: list_namespaces: [{'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}] 2024-03-26T17:00:51.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:00:51 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 2024-03-26T17:00:51.207+0000 7fa707a55700 -1 mon.c@1(peon) e3 get_health_metrics reporting 3 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T17:00:52.106 INFO:tasks.workunit.client.3.smithi157.stderr:+ for i in $(seq 1 $NVMEOF_SUBSYSTEMS_COUNT) 2024-03-26T17:00:52.106 INFO:tasks.workunit.client.3.smithi157.stderr:+ subsystem_nqn=nqn.2016-06.io.spdk:cnode3 2024-03-26T17:00:52.106 INFO:tasks.workunit.client.3.smithi157.stderr:+ sudo podman run -it quay.io/barakda1/nvmeof-cli:qe_ceph_devel_21e59b2 --server-address 172.21.15.44 --server-port 5500 --format plain namespace list --subsystem nqn.2016-06.io.spdk:cnode3 2024-03-26T17:00:52.195 INFO:tasks.workunit.client.3.smithi157.stderr:time="2024-03-26T17:00:52Z" level=warning msg="The input device is not a TTY. The --tty and --interactive flags might not work properly" 2024-03-26T17:00:52.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:00:52 smithi044 ceph-mon[30624]: pgmap v426: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 63 KiB/s rd, 767 B/s wr, 27 op/s 2024-03-26T17:00:52.265 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:51 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:51] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:00:52.265 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:51 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:51] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:00:52.265 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:51 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:00:52.547 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:00:52 smithi149 ceph-mon[34678]: pgmap v426: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 63 KiB/s rd, 767 B/s wr, 27 op/s 2024-03-26T17:00:52.548 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:00:52] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:00:52.548 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:00:52] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:00:52.548 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:00:52.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:00:52 smithi064 ceph-mon[34420]: pgmap v426: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 63 KiB/s rd, 767 B/s wr, 27 op/s 2024-03-26T17:00:53.030 INFO:tasks.workunit.client.3.smithi157.stdout:Namespaces in subsystem nqn.2016-06.io.spdk:cnode3: 2024-03-26T17:00:53.030 INFO:tasks.workunit.client.3.smithi157.stdout: NSID Bdev RBD RBD Image Block UUID Load R/W IOs R/W MBs Read MBs Write MBs 2024-03-26T17:00:53.030 INFO:tasks.workunit.client.3.smithi157.stdout: Name Pool Image Size Size Balancing per per per per 2024-03-26T17:00:53.030 INFO:tasks.workunit.client.3.smithi157.stdout: Group second second second second 2024-03-26T17:00:53.030 INFO:tasks.workunit.client.3.smithi157.stdout: 1 bdev_3c661bbb-5e4a- mypool myimage41 8 GiB 512 B 3c661bbb-5e4a-4c04- 3 unlimited unlimited unlimited unlimited 2024-03-26T17:00:53.030 INFO:tasks.workunit.client.3.smithi157.stdout: 4c04-85a7-f1caf0b1f9be 85a7-f1caf0b1f9be 2024-03-26T17:00:53.031 INFO:tasks.workunit.client.3.smithi157.stdout: 2 bdev_50b4cca3-174e- mypool myimage42 8 GiB 512 B 50b4cca3-174e-43d5- 1 unlimited unlimited unlimited unlimited 2024-03-26T17:00:53.031 INFO:tasks.workunit.client.3.smithi157.stdout: 43d5-9104-42a67f5e6251 9104-42a67f5e6251 2024-03-26T17:00:53.031 INFO:tasks.workunit.client.3.smithi157.stdout: 3 bdev_3b4cd01b-2e99- mypool myimage43 8 GiB 512 B 3b4cd01b-2e99-4652- 2 unlimited unlimited unlimited unlimited 2024-03-26T17:00:53.031 INFO:tasks.workunit.client.3.smithi157.stdout: 4652-88a6-fa90062ddcb2 88a6-fa90062ddcb2 2024-03-26T17:00:53.031 INFO:tasks.workunit.client.3.smithi157.stdout: 4 bdev_207949ff-8335- mypool myimage44 8 GiB 512 B 207949ff-8335-45b5- 3 unlimited unlimited unlimited unlimited 2024-03-26T17:00:53.031 INFO:tasks.workunit.client.3.smithi157.stdout: 45b5-ada4-b479b5c558f0 ada4-b479b5c558f0 2024-03-26T17:00:53.031 INFO:tasks.workunit.client.3.smithi157.stdout: 5 bdev_3c6807e7-6ca5- mypool myimage45 8 GiB 512 B 3c6807e7-6ca5-4091- 1 unlimited unlimited unlimited unlimited 2024-03-26T17:00:53.031 INFO:tasks.workunit.client.3.smithi157.stdout: 4091-97d3-4325dc5c205d 97d3-4325dc5c205d 2024-03-26T17:00:53.031 INFO:tasks.workunit.client.3.smithi157.stdout: 6 bdev_93238733-93e8- mypool myimage46 8 GiB 512 B 93238733-93e8-4537- 2 unlimited unlimited unlimited unlimited 2024-03-26T17:00:53.031 INFO:tasks.workunit.client.3.smithi157.stdout: 4537-9db8-9a632ba1968b 9db8-9a632ba1968b 2024-03-26T17:00:53.031 INFO:tasks.workunit.client.3.smithi157.stdout: 7 bdev_93abae22-a363- mypool myimage47 8 GiB 512 B 93abae22-a363-48f4- 3 unlimited unlimited unlimited unlimited 2024-03-26T17:00:53.031 INFO:tasks.workunit.client.3.smithi157.stdout: 48f4-af52-0cb060c979a9 af52-0cb060c979a9 2024-03-26T17:00:53.031 INFO:tasks.workunit.client.3.smithi157.stdout: 8 bdev_921a1ef8-41d8- mypool myimage48 8 GiB 512 B 921a1ef8-41d8-474b- 1 unlimited unlimited unlimited unlimited 2024-03-26T17:00:53.032 INFO:tasks.workunit.client.3.smithi157.stdout: 474b-93fd-035acb5ad32e 93fd-035acb5ad32e 2024-03-26T17:00:53.032 INFO:tasks.workunit.client.3.smithi157.stdout: 9 bdev_8e461884-8460- mypool myimage49 8 GiB 512 B 8e461884-8460-4c4a- 2 unlimited unlimited unlimited unlimited 2024-03-26T17:00:53.032 INFO:tasks.workunit.client.3.smithi157.stdout: 4c4a-ab6c-8245c6ec1ee9 ab6c-8245c6ec1ee9 2024-03-26T17:00:53.032 INFO:tasks.workunit.client.3.smithi157.stdout: 10 bdev_6dd22a0f-f02e- mypool myimage50 8 GiB 512 B 6dd22a0f-f02e-4022- 3 unlimited unlimited unlimited unlimited 2024-03-26T17:00:53.032 INFO:tasks.workunit.client.3.smithi157.stdout: 4022-b874-77a8c16d2b34 b874-77a8c16d2b34 2024-03-26T17:00:53.032 INFO:tasks.workunit.client.3.smithi157.stdout: 11 bdev_be42afac-1bb1- mypool myimage51 8 GiB 512 B be42afac-1bb1-49d7- 1 unlimited unlimited unlimited unlimited 2024-03-26T17:00:53.032 INFO:tasks.workunit.client.3.smithi157.stdout: 49d7-891e-1520dab96fea 891e-1520dab96fea 2024-03-26T17:00:53.032 INFO:tasks.workunit.client.3.smithi157.stdout: 12 bdev_2d7cae06-634e- mypool myimage52 8 GiB 512 B 2d7cae06-634e-4d4e- 2 unlimited unlimited unlimited unlimited 2024-03-26T17:00:53.032 INFO:tasks.workunit.client.3.smithi157.stdout: 4d4e-84f6-3fd8b256908b 84f6-3fd8b256908b 2024-03-26T17:00:53.032 INFO:tasks.workunit.client.3.smithi157.stdout: 13 bdev_c8bdc24b-3beb- mypool myimage53 8 GiB 512 B c8bdc24b-3beb-4416- 3 unlimited unlimited unlimited unlimited 2024-03-26T17:00:53.032 INFO:tasks.workunit.client.3.smithi157.stdout: 4416-8e5e-29302ab1738e 8e5e-29302ab1738e 2024-03-26T17:00:53.032 INFO:tasks.workunit.client.3.smithi157.stdout: 14 bdev_880553c4-26f3- mypool myimage54 8 GiB 512 B 880553c4-26f3-4feb- 1 unlimited unlimited unlimited unlimited 2024-03-26T17:00:53.032 INFO:tasks.workunit.client.3.smithi157.stdout: 4feb-954f-8823b018602d 954f-8823b018602d 2024-03-26T17:00:53.032 INFO:tasks.workunit.client.3.smithi157.stdout: 15 bdev_6d3b5baf-a7c7- mypool myimage55 8 GiB 512 B 6d3b5baf-a7c7-4ca5- 2 unlimited unlimited unlimited unlimited 2024-03-26T17:00:53.032 INFO:tasks.workunit.client.3.smithi157.stdout: 4ca5-bad0-337b93cbb81d bad0-337b93cbb81d 2024-03-26T17:00:53.032 INFO:tasks.workunit.client.3.smithi157.stdout: 16 bdev_2cad5054-30eb- mypool myimage56 8 GiB 512 B 2cad5054-30eb-42c3- 3 unlimited unlimited unlimited unlimited 2024-03-26T17:00:53.033 INFO:tasks.workunit.client.3.smithi157.stdout: 42c3-8147-56ca2066bb5e 8147-56ca2066bb5e 2024-03-26T17:00:53.033 INFO:tasks.workunit.client.3.smithi157.stdout: 17 bdev_c8d8f248-1a23- mypool myimage57 8 GiB 512 B c8d8f248-1a23-4aa6- 1 unlimited unlimited unlimited unlimited 2024-03-26T17:00:53.033 INFO:tasks.workunit.client.3.smithi157.stdout: 4aa6-b0d6-4ce8bc32fe9f b0d6-4ce8bc32fe9f 2024-03-26T17:00:53.033 INFO:tasks.workunit.client.3.smithi157.stdout: 18 bdev_8fab603e-43d8- mypool myimage58 8 GiB 512 B 8fab603e-43d8-40fa- 2 unlimited unlimited unlimited unlimited 2024-03-26T17:00:53.033 INFO:tasks.workunit.client.3.smithi157.stdout: 40fa-a513-509c13e98869 a513-509c13e98869 2024-03-26T17:00:53.033 INFO:tasks.workunit.client.3.smithi157.stdout: 19 bdev_d1568c59-1c06- mypool myimage59 8 GiB 512 B d1568c59-1c06-4a94- 3 unlimited unlimited unlimited unlimited 2024-03-26T17:00:53.033 INFO:tasks.workunit.client.3.smithi157.stdout: 4a94-adf0-389db9d95681 adf0-389db9d95681 2024-03-26T17:00:53.033 INFO:tasks.workunit.client.3.smithi157.stdout: 20 bdev_811fc261-889a- mypool myimage60 8 GiB 512 B 811fc261-889a-479a- 1 unlimited unlimited unlimited unlimited 2024-03-26T17:00:53.033 INFO:tasks.workunit.client.3.smithi157.stdout: 479a-9e58-cc5cc9b1fca9 9e58-cc5cc9b1fca9 2024-03-26T17:00:53.265 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:52 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:52] INFO grpc.py:1134: Received request to list all namespaces for nqn.2016-06.io.spdk:cnode3, context: 2024-03-26T17:00:53.265 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:52 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:52] INFO grpc.py:1139: list_namespaces: [{'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:00:53.457 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:53 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:00:53] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:00:53.457 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:53 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:00:53] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:00:53.457 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:53 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:00:53.805 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:00:53 smithi064 ceph-mon[34420]: Health check update: 7 slow ops, oldest one blocked for 148 sec, daemons [mon.b,mon.c] have slow ops. (SLOW_OPS) 2024-03-26T17:00:53.873 INFO:tasks.workunit.client.3.smithi157.stderr:+ lscpu 2024-03-26T17:00:53.895 INFO:tasks.workunit.client.3.smithi157.stdout:Architecture: x86_64 2024-03-26T17:00:53.895 INFO:tasks.workunit.client.3.smithi157.stdout:CPU op-mode(s): 32-bit, 64-bit 2024-03-26T17:00:53.895 INFO:tasks.workunit.client.3.smithi157.stdout:Address sizes: 46 bits physical, 48 bits virtual 2024-03-26T17:00:53.895 INFO:tasks.workunit.client.3.smithi157.stdout:Byte Order: Little Endian 2024-03-26T17:00:53.895 INFO:tasks.workunit.client.3.smithi157.stdout:CPU(s): 8 2024-03-26T17:00:53.895 INFO:tasks.workunit.client.3.smithi157.stdout:On-line CPU(s) list: 0-7 2024-03-26T17:00:53.895 INFO:tasks.workunit.client.3.smithi157.stdout:Vendor ID: GenuineIntel 2024-03-26T17:00:53.895 INFO:tasks.workunit.client.3.smithi157.stdout:Model name: Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz 2024-03-26T17:00:53.895 INFO:tasks.workunit.client.3.smithi157.stdout:CPU family: 6 2024-03-26T17:00:53.895 INFO:tasks.workunit.client.3.smithi157.stdout:Model: 79 2024-03-26T17:00:53.896 INFO:tasks.workunit.client.3.smithi157.stdout:Thread(s) per core: 2 2024-03-26T17:00:53.896 INFO:tasks.workunit.client.3.smithi157.stdout:Core(s) per socket: 4 2024-03-26T17:00:53.896 INFO:tasks.workunit.client.3.smithi157.stdout:Socket(s): 1 2024-03-26T17:00:53.896 INFO:tasks.workunit.client.3.smithi157.stdout:Stepping: 1 2024-03-26T17:00:53.896 INFO:tasks.workunit.client.3.smithi157.stdout:CPU max MHz: 3800.0000 2024-03-26T17:00:53.896 INFO:tasks.workunit.client.3.smithi157.stdout:CPU min MHz: 1200.0000 2024-03-26T17:00:53.896 INFO:tasks.workunit.client.3.smithi157.stdout:BogoMIPS: 6999.42 2024-03-26T17:00:53.896 INFO:tasks.workunit.client.3.smithi157.stdout:Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cdp_l3 pti intel_ppin tpr_shadow flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsaveopt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local dtherm ida arat pln pts vnmi 2024-03-26T17:00:53.896 INFO:tasks.workunit.client.3.smithi157.stdout:Virtualization: VT-x 2024-03-26T17:00:53.896 INFO:tasks.workunit.client.3.smithi157.stdout:L1d cache: 128 KiB (4 instances) 2024-03-26T17:00:53.896 INFO:tasks.workunit.client.3.smithi157.stdout:L1i cache: 128 KiB (4 instances) 2024-03-26T17:00:53.896 INFO:tasks.workunit.client.3.smithi157.stdout:L2 cache: 1 MiB (4 instances) 2024-03-26T17:00:53.896 INFO:tasks.workunit.client.3.smithi157.stdout:L3 cache: 10 MiB (1 instance) 2024-03-26T17:00:53.896 INFO:tasks.workunit.client.3.smithi157.stdout:NUMA node(s): 1 2024-03-26T17:00:53.896 INFO:tasks.workunit.client.3.smithi157.stdout:NUMA node0 CPU(s): 0-7 2024-03-26T17:00:53.897 INFO:tasks.workunit.client.3.smithi157.stdout:Vulnerability Gather data sampling: Not affected 2024-03-26T17:00:53.897 INFO:tasks.workunit.client.3.smithi157.stdout:Vulnerability Itlb multihit: KVM: Mitigation: VMX disabled 2024-03-26T17:00:53.897 INFO:tasks.workunit.client.3.smithi157.stdout:Vulnerability L1tf: Mitigation; PTE Inversion; VMX conditional cache flushes, SMT vulnerable 2024-03-26T17:00:53.897 INFO:tasks.workunit.client.3.smithi157.stdout:Vulnerability Mds: Vulnerable: Clear CPU buffers attempted, no microcode; SMT vulnerable 2024-03-26T17:00:53.897 INFO:tasks.workunit.client.3.smithi157.stdout:Vulnerability Meltdown: Mitigation; PTI 2024-03-26T17:00:53.897 INFO:tasks.workunit.client.3.smithi157.stdout:Vulnerability Mmio stale data: Vulnerable: Clear CPU buffers attempted, no microcode; SMT vulnerable 2024-03-26T17:00:53.897 INFO:tasks.workunit.client.3.smithi157.stdout:Vulnerability Retbleed: Not affected 2024-03-26T17:00:53.897 INFO:tasks.workunit.client.3.smithi157.stdout:Vulnerability Spec rstack overflow: Not affected 2024-03-26T17:00:53.897 INFO:tasks.workunit.client.3.smithi157.stdout:Vulnerability Spec store bypass: Vulnerable 2024-03-26T17:00:53.897 INFO:tasks.workunit.client.3.smithi157.stdout:Vulnerability Spectre v1: Mitigation; usercopy/swapgs barriers and __user pointer sanitization 2024-03-26T17:00:53.897 INFO:tasks.workunit.client.3.smithi157.stdout:Vulnerability Spectre v2: Mitigation; Retpolines, STIBP disabled, RSB filling, PBRSB-eIBRS Not affected 2024-03-26T17:00:53.897 INFO:tasks.workunit.client.3.smithi157.stdout:Vulnerability Srbds: Not affected 2024-03-26T17:00:53.897 INFO:tasks.workunit.client.3.smithi157.stdout:Vulnerability Tsx async abort: Vulnerable: Clear CPU buffers attempted, no microcode; SMT vulnerable 2024-03-26T17:00:53.898 INFO:tasks.workunit.client.3.smithi157.stderr:+ free -h 2024-03-26T17:00:53.898 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:00:53 smithi149 ceph-mon[34678]: Health check update: 7 slow ops, oldest one blocked for 148 sec, daemons [mon.b,mon.c] have slow ops. (SLOW_OPS) 2024-03-26T17:00:53.901 INFO:tasks.workunit.client.3.smithi157.stdout: total used free shared buff/cache available 2024-03-26T17:00:53.901 INFO:tasks.workunit.client.3.smithi157.stdout:Mem: 30Gi 862Mi 26Gi 25Mi 4.6Gi 30Gi 2024-03-26T17:00:53.901 INFO:tasks.workunit.client.3.smithi157.stdout:Swap: 0B 0B 0B 2024-03-26T17:00:53.901 INFO:tasks.workunit.client.3.smithi157.stderr:+ echo '[nvmeof] Subsystem setup done' 2024-03-26T17:00:53.902 INFO:tasks.workunit.client.3.smithi157.stdout:[nvmeof] Subsystem setup done 2024-03-26T17:00:53.903 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-03-26T17:00:53.903 DEBUG:teuthology.orchestra.run.smithi157:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.3/client.3/tmp 2024-03-26T17:00:53.962 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:00:53 smithi044 ceph-mon[30624]: Health check update: 7 slow ops, oldest one blocked for 148 sec, daemons [mon.b,mon.c] have slow ops. (SLOW_OPS) 2024-03-26T17:00:53.975 INFO:tasks.workunit:Running workunits matching rbd/nvmeof_basic_tests.sh on client.3... 2024-03-26T17:00:53.976 INFO:tasks.workunit:Running workunit rbd/nvmeof_basic_tests.sh... 2024-03-26T17:00:53.976 DEBUG:teuthology.orchestra.run.smithi157:workunit test rbd/nvmeof_basic_tests.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.3/client.3/tmp && cd -- /home/ubuntu/cephtest/mnt.3/client.3/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=b4c4828f419f1247fc297e8069c1036b1d6151f2 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="3" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.3 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.3 CEPH_MNT=/home/ubuntu/cephtest/mnt.3 RBD_IMAGE_PREFIX=myimage RBD_POOL=mypool timeout 3h /home/ubuntu/cephtest/clone.client.3/qa/workunits/rbd/nvmeof_basic_tests.sh 2024-03-26T17:00:54.032 INFO:tasks.workunit.client.3.smithi157.stderr:+ sudo modprobe nvme-fabrics 2024-03-26T17:00:54.056 INFO:tasks.workunit.client.3.smithi157.stderr:+ sudo modprobe nvme-tcp 2024-03-26T17:00:54.075 INFO:tasks.workunit.client.3.smithi157.stderr:+ sudo dnf install nvme-cli -y 2024-03-26T17:00:54.265 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:53 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:53] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:00:54.265 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:53 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:53] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:00:54.265 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:53 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:00:54.596 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:54 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:00:54] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:00:54.596 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:54 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:00:54] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:00:54.596 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:54 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:00:54.623 INFO:tasks.workunit.client.3.smithi157.stdout:Last metadata expiration check: 0:19:31 ago on Tue 26 Mar 2024 04:41:23 PM UTC. 2024-03-26T17:00:54.720 INFO:tasks.workunit.client.3.smithi157.stdout:Package nvme-cli-2.6-5.el9.x86_64 is already installed. 2024-03-26T17:00:54.773 INFO:tasks.workunit.client.3.smithi157.stdout:Dependencies resolved. 2024-03-26T17:00:54.774 INFO:tasks.workunit.client.3.smithi157.stdout:Nothing to do. 2024-03-26T17:00:54.774 INFO:tasks.workunit.client.3.smithi157.stdout:Complete! 2024-03-26T17:00:54.844 INFO:tasks.workunit.client.3.smithi157.stderr:+ sudo lsmod 2024-03-26T17:00:54.844 INFO:tasks.workunit.client.3.smithi157.stderr:+ grep nvme 2024-03-26T17:00:54.860 INFO:tasks.workunit.client.3.smithi157.stdout:nvme_tcp 49152 0 2024-03-26T17:00:54.860 INFO:tasks.workunit.client.3.smithi157.stdout:nvme_fabrics 40960 1 nvme_tcp 2024-03-26T17:00:54.860 INFO:tasks.workunit.client.3.smithi157.stdout:nvme 65536 5 2024-03-26T17:00:54.860 INFO:tasks.workunit.client.3.smithi157.stdout:nvme_core 221184 8 nvme_tcp,nvme,nvme_fabrics 2024-03-26T17:00:54.860 INFO:tasks.workunit.client.3.smithi157.stdout:nvme_common 24576 1 nvme_core 2024-03-26T17:00:54.860 INFO:tasks.workunit.client.3.smithi157.stdout:t10_pi 24576 2 sd_mod,nvme_core 2024-03-26T17:00:54.861 INFO:tasks.workunit.client.3.smithi157.stderr:+ source /etc/ceph/nvmeof.env 2024-03-26T17:00:54.861 INFO:tasks.workunit.client.3.smithi157.stderr:++ NVMEOF_GATEWAY_IP_ADDRESSES=172.21.15.44,172.21.15.64,172.21.15.149 2024-03-26T17:00:54.861 INFO:tasks.workunit.client.3.smithi157.stderr:++ NVMEOF_GATEWAY_NAMES=smithi044,smithi064,smithi149 2024-03-26T17:00:54.862 INFO:tasks.workunit.client.3.smithi157.stderr:++ NVMEOF_DEFAULT_GATEWAY_IP_ADDRESS=172.21.15.44 2024-03-26T17:00:54.862 INFO:tasks.workunit.client.3.smithi157.stderr:++ NVMEOF_CLI_IMAGE=quay.io/barakda1/nvmeof-cli:qe_ceph_devel_21e59b2 2024-03-26T17:00:54.862 INFO:tasks.workunit.client.3.smithi157.stderr:++ NVMEOF_SUBSYSTEMS_PREFIX=nqn.2016-06.io.spdk:cnode 2024-03-26T17:00:54.862 INFO:tasks.workunit.client.3.smithi157.stderr:++ NVMEOF_SUBSYSTEMS_COUNT=3 2024-03-26T17:00:54.862 INFO:tasks.workunit.client.3.smithi157.stderr:++ NVMEOF_NAMESPACES_COUNT=20 2024-03-26T17:00:54.862 INFO:tasks.workunit.client.3.smithi157.stderr:++ NVMEOF_PORT=4420 2024-03-26T17:00:54.862 INFO:tasks.workunit.client.3.smithi157.stderr:++ NVMEOF_SRPORT=5500 2024-03-26T17:00:54.862 INFO:tasks.workunit.client.3.smithi157.stderr:+ SPDK_CONTROLLER='Ceph bdev Controller' 2024-03-26T17:00:54.862 INFO:tasks.workunit.client.3.smithi157.stderr:+ DISCOVERY_PORT=8009 2024-03-26T17:00:54.862 INFO:tasks.workunit.client.3.smithi157.stderr:+ test_run disconnect_all 2024-03-26T17:00:54.862 INFO:tasks.workunit.client.3.smithi157.stderr:+ echo '[nvmeof] Running test: disconnect_all' 2024-03-26T17:00:54.862 INFO:tasks.workunit.client.3.smithi157.stdout:[nvmeof] Running test: disconnect_all 2024-03-26T17:00:54.863 INFO:tasks.workunit.client.3.smithi157.stderr:+ disconnect_all 2024-03-26T17:00:54.863 INFO:tasks.workunit.client.3.smithi157.stderr:+ sudo nvme disconnect-all 2024-03-26T17:00:54.880 INFO:tasks.workunit.client.3.smithi157.stderr:++ sudo nvme list 2024-03-26T17:00:54.894 INFO:tasks.workunit.client.3.smithi157.stderr:+ output='Node Generic SN Model Namespace Usage Format FW Rev 2024-03-26T17:00:54.894 INFO:tasks.workunit.client.3.smithi157.stderr:--------------------- --------------------- -------------------- ---------------------------------------- ---------- -------------------------- ---------------- -------- 2024-03-26T17:00:54.894 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme0n1 /dev/ng0n1 PHMB7476002V480DGN INTEL SSDPED1D480GA 0x1 480.10 GB / 480.10 GB 512 B + 0 B E2010325' 2024-03-26T17:00:54.894 INFO:tasks.workunit.client.3.smithi157.stderr:+ echo 'Node Generic SN Model Namespace Usage Format FW Rev 2024-03-26T17:00:54.894 INFO:tasks.workunit.client.3.smithi157.stderr:--------------------- --------------------- -------------------- ---------------------------------------- ---------- -------------------------- ---------------- -------- 2024-03-26T17:00:54.894 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme0n1 /dev/ng0n1 PHMB7476002V480DGN INTEL SSDPED1D480GA 0x1 480.10 GB / 480.10 GB 512 B + 0 B E2010325' 2024-03-26T17:00:54.894 INFO:tasks.workunit.client.3.smithi157.stderr:+ grep -q 'Ceph bdev Controller' 2024-03-26T17:00:54.895 INFO:tasks.workunit.client.3.smithi157.stdout:[nvmeof] disconnect_all test passed! 2024-03-26T17:00:54.895 INFO:tasks.workunit.client.3.smithi157.stderr:+ '[' 0 -eq 0 ']' 2024-03-26T17:00:54.895 INFO:tasks.workunit.client.3.smithi157.stderr:+ echo '[nvmeof] disconnect_all test passed!' 2024-03-26T17:00:54.896 INFO:tasks.workunit.client.3.smithi157.stderr:+ test_run discovery 2024-03-26T17:00:54.896 INFO:tasks.workunit.client.3.smithi157.stdout:[nvmeof] Running test: discovery 2024-03-26T17:00:54.896 INFO:tasks.workunit.client.3.smithi157.stderr:+ echo '[nvmeof] Running test: discovery' 2024-03-26T17:00:54.896 INFO:tasks.workunit.client.3.smithi157.stderr:+ discovery 2024-03-26T17:00:54.896 INFO:tasks.workunit.client.3.smithi157.stderr:++ sudo nvme discover -t tcp -a 172.21.15.44 -s 8009 2024-03-26T17:00:54.897 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:00:54 smithi149 ceph-mon[34678]: pgmap v427: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 74 KiB/s rd, 767 B/s wr, 27 op/s 2024-03-26T17:00:54.921 INFO:tasks.workunit.client.3.smithi157.stderr:+ output=' 2024-03-26T17:00:54.921 INFO:tasks.workunit.client.3.smithi157.stderr:Discovery Log Number of Records 9, Generation counter 1 2024-03-26T17:00:54.921 INFO:tasks.workunit.client.3.smithi157.stderr:=====Discovery Log Entry 0====== 2024-03-26T17:00:54.921 INFO:tasks.workunit.client.3.smithi157.stderr:trtype: tcp 2024-03-26T17:00:54.922 INFO:tasks.workunit.client.3.smithi157.stderr:adrfam: ipv4 2024-03-26T17:00:54.922 INFO:tasks.workunit.client.3.smithi157.stderr:subtype: nvme subsystem 2024-03-26T17:00:54.922 INFO:tasks.workunit.client.3.smithi157.stderr:treq: not required 2024-03-26T17:00:54.922 INFO:tasks.workunit.client.3.smithi157.stderr:portid: 0 2024-03-26T17:00:54.922 INFO:tasks.workunit.client.3.smithi157.stderr:trsvcid: 4420 2024-03-26T17:00:54.922 INFO:tasks.workunit.client.3.smithi157.stderr:subnqn: nqn.2016-06.io.spdk:cnode1 2024-03-26T17:00:54.922 INFO:tasks.workunit.client.3.smithi157.stderr:traddr: 172.21.15.44 2024-03-26T17:00:54.922 INFO:tasks.workunit.client.3.smithi157.stderr:eflags: none 2024-03-26T17:00:54.922 INFO:tasks.workunit.client.3.smithi157.stderr:sectype: none 2024-03-26T17:00:54.922 INFO:tasks.workunit.client.3.smithi157.stderr:=====Discovery Log Entry 1====== 2024-03-26T17:00:54.922 INFO:tasks.workunit.client.3.smithi157.stderr:trtype: tcp 2024-03-26T17:00:54.922 INFO:tasks.workunit.client.3.smithi157.stderr:adrfam: ipv4 2024-03-26T17:00:54.923 INFO:tasks.workunit.client.3.smithi157.stderr:subtype: nvme subsystem 2024-03-26T17:00:54.923 INFO:tasks.workunit.client.3.smithi157.stderr:treq: not required 2024-03-26T17:00:54.923 INFO:tasks.workunit.client.3.smithi157.stderr:portid: 1 2024-03-26T17:00:54.923 INFO:tasks.workunit.client.3.smithi157.stderr:trsvcid: 4420 2024-03-26T17:00:54.923 INFO:tasks.workunit.client.3.smithi157.stderr:subnqn: nqn.2016-06.io.spdk:cnode1 2024-03-26T17:00:54.923 INFO:tasks.workunit.client.3.smithi157.stderr:traddr: 172.21.15.64 2024-03-26T17:00:54.923 INFO:tasks.workunit.client.3.smithi157.stderr:eflags: none 2024-03-26T17:00:54.923 INFO:tasks.workunit.client.3.smithi157.stderr:sectype: none 2024-03-26T17:00:54.923 INFO:tasks.workunit.client.3.smithi157.stderr:=====Discovery Log Entry 2====== 2024-03-26T17:00:54.923 INFO:tasks.workunit.client.3.smithi157.stderr:trtype: tcp 2024-03-26T17:00:54.923 INFO:tasks.workunit.client.3.smithi157.stderr:adrfam: ipv4 2024-03-26T17:00:54.923 INFO:tasks.workunit.client.3.smithi157.stderr:subtype: nvme subsystem 2024-03-26T17:00:54.923 INFO:tasks.workunit.client.3.smithi157.stderr:treq: not required 2024-03-26T17:00:54.923 INFO:tasks.workunit.client.3.smithi157.stderr:portid: 2 2024-03-26T17:00:54.923 INFO:tasks.workunit.client.3.smithi157.stderr:trsvcid: 4420 2024-03-26T17:00:54.924 INFO:tasks.workunit.client.3.smithi157.stderr:subnqn: nqn.2016-06.io.spdk:cnode1 2024-03-26T17:00:54.924 INFO:tasks.workunit.client.3.smithi157.stderr:traddr: 172.21.15.149 2024-03-26T17:00:54.924 INFO:tasks.workunit.client.3.smithi157.stderr:eflags: none 2024-03-26T17:00:54.924 INFO:tasks.workunit.client.3.smithi157.stderr:sectype: none 2024-03-26T17:00:54.924 INFO:tasks.workunit.client.3.smithi157.stderr:=====Discovery Log Entry 3====== 2024-03-26T17:00:54.924 INFO:tasks.workunit.client.3.smithi157.stderr:trtype: tcp 2024-03-26T17:00:54.924 INFO:tasks.workunit.client.3.smithi157.stderr:adrfam: ipv4 2024-03-26T17:00:54.924 INFO:tasks.workunit.client.3.smithi157.stderr:subtype: nvme subsystem 2024-03-26T17:00:54.924 INFO:tasks.workunit.client.3.smithi157.stderr:treq: not required 2024-03-26T17:00:54.924 INFO:tasks.workunit.client.3.smithi157.stderr:portid: 3 2024-03-26T17:00:54.924 INFO:tasks.workunit.client.3.smithi157.stderr:trsvcid: 4420 2024-03-26T17:00:54.924 INFO:tasks.workunit.client.3.smithi157.stderr:subnqn: nqn.2016-06.io.spdk:cnode2 2024-03-26T17:00:54.924 INFO:tasks.workunit.client.3.smithi157.stderr:traddr: 172.21.15.44 2024-03-26T17:00:54.924 INFO:tasks.workunit.client.3.smithi157.stderr:eflags: none 2024-03-26T17:00:54.925 INFO:tasks.workunit.client.3.smithi157.stderr:sectype: none 2024-03-26T17:00:54.925 INFO:tasks.workunit.client.3.smithi157.stderr:=====Discovery Log Entry 4====== 2024-03-26T17:00:54.925 INFO:tasks.workunit.client.3.smithi157.stderr:trtype: tcp 2024-03-26T17:00:54.925 INFO:tasks.workunit.client.3.smithi157.stderr:adrfam: ipv4 2024-03-26T17:00:54.925 INFO:tasks.workunit.client.3.smithi157.stderr:subtype: nvme subsystem 2024-03-26T17:00:54.925 INFO:tasks.workunit.client.3.smithi157.stderr:treq: not required 2024-03-26T17:00:54.925 INFO:tasks.workunit.client.3.smithi157.stderr:portid: 4 2024-03-26T17:00:54.925 INFO:tasks.workunit.client.3.smithi157.stderr:trsvcid: 4420 2024-03-26T17:00:54.925 INFO:tasks.workunit.client.3.smithi157.stderr:subnqn: nqn.2016-06.io.spdk:cnode2 2024-03-26T17:00:54.925 INFO:tasks.workunit.client.3.smithi157.stderr:traddr: 172.21.15.64 2024-03-26T17:00:54.925 INFO:tasks.workunit.client.3.smithi157.stderr:eflags: none 2024-03-26T17:00:54.925 INFO:tasks.workunit.client.3.smithi157.stderr:sectype: none 2024-03-26T17:00:54.925 INFO:tasks.workunit.client.3.smithi157.stderr:=====Discovery Log Entry 5====== 2024-03-26T17:00:54.925 INFO:tasks.workunit.client.3.smithi157.stderr:trtype: tcp 2024-03-26T17:00:54.926 INFO:tasks.workunit.client.3.smithi157.stderr:adrfam: ipv4 2024-03-26T17:00:54.926 INFO:tasks.workunit.client.3.smithi157.stderr:subtype: nvme subsystem 2024-03-26T17:00:54.926 INFO:tasks.workunit.client.3.smithi157.stderr:treq: not required 2024-03-26T17:00:54.926 INFO:tasks.workunit.client.3.smithi157.stderr:portid: 5 2024-03-26T17:00:54.926 INFO:tasks.workunit.client.3.smithi157.stderr:trsvcid: 4420 2024-03-26T17:00:54.926 INFO:tasks.workunit.client.3.smithi157.stderr:subnqn: nqn.2016-06.io.spdk:cnode2 2024-03-26T17:00:54.926 INFO:tasks.workunit.client.3.smithi157.stderr:traddr: 172.21.15.149 2024-03-26T17:00:54.926 INFO:tasks.workunit.client.3.smithi157.stderr:eflags: none 2024-03-26T17:00:54.926 INFO:tasks.workunit.client.3.smithi157.stderr:sectype: none 2024-03-26T17:00:54.926 INFO:tasks.workunit.client.3.smithi157.stderr:=====Discovery Log Entry 6====== 2024-03-26T17:00:54.926 INFO:tasks.workunit.client.3.smithi157.stderr:trtype: tcp 2024-03-26T17:00:54.926 INFO:tasks.workunit.client.3.smithi157.stderr:adrfam: ipv4 2024-03-26T17:00:54.926 INFO:tasks.workunit.client.3.smithi157.stderr:subtype: nvme subsystem 2024-03-26T17:00:54.926 INFO:tasks.workunit.client.3.smithi157.stderr:treq: not required 2024-03-26T17:00:54.927 INFO:tasks.workunit.client.3.smithi157.stderr:portid: 6 2024-03-26T17:00:54.927 INFO:tasks.workunit.client.3.smithi157.stderr:trsvcid: 4420 2024-03-26T17:00:54.927 INFO:tasks.workunit.client.3.smithi157.stderr:subnqn: nqn.2016-06.io.spdk:cnode3 2024-03-26T17:00:54.927 INFO:tasks.workunit.client.3.smithi157.stderr:traddr: 172.21.15.44 2024-03-26T17:00:54.927 INFO:tasks.workunit.client.3.smithi157.stderr:eflags: none 2024-03-26T17:00:54.927 INFO:tasks.workunit.client.3.smithi157.stderr:sectype: none 2024-03-26T17:00:54.927 INFO:tasks.workunit.client.3.smithi157.stderr:=====Discovery Log Entry 7====== 2024-03-26T17:00:54.927 INFO:tasks.workunit.client.3.smithi157.stderr:trtype: tcp 2024-03-26T17:00:54.927 INFO:tasks.workunit.client.3.smithi157.stderr:adrfam: ipv4 2024-03-26T17:00:54.927 INFO:tasks.workunit.client.3.smithi157.stderr:subtype: nvme subsystem 2024-03-26T17:00:54.927 INFO:tasks.workunit.client.3.smithi157.stderr:treq: not required 2024-03-26T17:00:54.927 INFO:tasks.workunit.client.3.smithi157.stderr:portid: 7 2024-03-26T17:00:54.927 INFO:tasks.workunit.client.3.smithi157.stderr:trsvcid: 4420 2024-03-26T17:00:54.927 INFO:tasks.workunit.client.3.smithi157.stderr:subnqn: nqn.2016-06.io.spdk:cnode3 2024-03-26T17:00:54.927 INFO:tasks.workunit.client.3.smithi157.stderr:traddr: 172.21.15.64 2024-03-26T17:00:54.928 INFO:tasks.workunit.client.3.smithi157.stderr:eflags: none 2024-03-26T17:00:54.928 INFO:tasks.workunit.client.3.smithi157.stderr:sectype: none 2024-03-26T17:00:54.928 INFO:tasks.workunit.client.3.smithi157.stderr:=====Discovery Log Entry 8====== 2024-03-26T17:00:54.928 INFO:tasks.workunit.client.3.smithi157.stderr:trtype: tcp 2024-03-26T17:00:54.928 INFO:tasks.workunit.client.3.smithi157.stderr:adrfam: ipv4 2024-03-26T17:00:54.928 INFO:tasks.workunit.client.3.smithi157.stderr:subtype: nvme subsystem 2024-03-26T17:00:54.928 INFO:tasks.workunit.client.3.smithi157.stderr:treq: not required 2024-03-26T17:00:54.928 INFO:tasks.workunit.client.3.smithi157.stderr:portid: 8 2024-03-26T17:00:54.928 INFO:tasks.workunit.client.3.smithi157.stderr:trsvcid: 4420 2024-03-26T17:00:54.928 INFO:tasks.workunit.client.3.smithi157.stderr:subnqn: nqn.2016-06.io.spdk:cnode3 2024-03-26T17:00:54.928 INFO:tasks.workunit.client.3.smithi157.stderr:traddr: 172.21.15.149 2024-03-26T17:00:54.928 INFO:tasks.workunit.client.3.smithi157.stderr:eflags: none 2024-03-26T17:00:54.928 INFO:tasks.workunit.client.3.smithi157.stderr:sectype: none' 2024-03-26T17:00:54.928 INFO:tasks.workunit.client.3.smithi157.stderr:+ expected_discovery_stdout='subtype: nvme subsystem' 2024-03-26T17:00:54.928 INFO:tasks.workunit.client.3.smithi157.stderr:+ echo ' 2024-03-26T17:00:54.929 INFO:tasks.workunit.client.3.smithi157.stderr:Discovery Log Number of Records 9, Generation counter 1 2024-03-26T17:00:54.929 INFO:tasks.workunit.client.3.smithi157.stderr:=====Discovery Log Entry 0====== 2024-03-26T17:00:54.929 INFO:tasks.workunit.client.3.smithi157.stderr:trtype: tcp 2024-03-26T17:00:54.929 INFO:tasks.workunit.client.3.smithi157.stderr:adrfam: ipv4 2024-03-26T17:00:54.929 INFO:tasks.workunit.client.3.smithi157.stderr:subtype: nvme subsystem 2024-03-26T17:00:54.929 INFO:tasks.workunit.client.3.smithi157.stderr:treq: not required 2024-03-26T17:00:54.929 INFO:tasks.workunit.client.3.smithi157.stderr:portid: 0 2024-03-26T17:00:54.929 INFO:tasks.workunit.client.3.smithi157.stderr:trsvcid: 4420 2024-03-26T17:00:54.929 INFO:tasks.workunit.client.3.smithi157.stderr:subnqn: nqn.2016-06.io.spdk:cnode1 2024-03-26T17:00:54.929 INFO:tasks.workunit.client.3.smithi157.stderr:traddr: 172.21.15.44 2024-03-26T17:00:54.929 INFO:tasks.workunit.client.3.smithi157.stderr:eflags: none 2024-03-26T17:00:54.929 INFO:tasks.workunit.client.3.smithi157.stderr:sectype: none 2024-03-26T17:00:54.929 INFO:tasks.workunit.client.3.smithi157.stderr:=====Discovery Log Entry 1====== 2024-03-26T17:00:54.929 INFO:tasks.workunit.client.3.smithi157.stderr:trtype: tcp 2024-03-26T17:00:54.929 INFO:tasks.workunit.client.3.smithi157.stderr:adrfam: ipv4 2024-03-26T17:00:54.930 INFO:tasks.workunit.client.3.smithi157.stderr:subtype: nvme subsystem 2024-03-26T17:00:54.930 INFO:tasks.workunit.client.3.smithi157.stderr:treq: not required 2024-03-26T17:00:54.930 INFO:tasks.workunit.client.3.smithi157.stderr:portid: 1 2024-03-26T17:00:54.930 INFO:tasks.workunit.client.3.smithi157.stderr:trsvcid: 4420 2024-03-26T17:00:54.930 INFO:tasks.workunit.client.3.smithi157.stderr:subnqn: nqn.2016-06.io.spdk:cnode1 2024-03-26T17:00:54.930 INFO:tasks.workunit.client.3.smithi157.stderr:traddr: 172.21.15.64 2024-03-26T17:00:54.930 INFO:tasks.workunit.client.3.smithi157.stderr:eflags: none 2024-03-26T17:00:54.930 INFO:tasks.workunit.client.3.smithi157.stderr:sectype: none 2024-03-26T17:00:54.930 INFO:tasks.workunit.client.3.smithi157.stderr:=====Discovery Log Entry 2====== 2024-03-26T17:00:54.930 INFO:tasks.workunit.client.3.smithi157.stderr:trtype: tcp 2024-03-26T17:00:54.930 INFO:tasks.workunit.client.3.smithi157.stderr:adrfam: ipv4 2024-03-26T17:00:54.930 INFO:tasks.workunit.client.3.smithi157.stderr:subtype: nvme subsystem 2024-03-26T17:00:54.930 INFO:tasks.workunit.client.3.smithi157.stderr:treq: not required 2024-03-26T17:00:54.930 INFO:tasks.workunit.client.3.smithi157.stderr:portid: 2 2024-03-26T17:00:54.931 INFO:tasks.workunit.client.3.smithi157.stderr:trsvcid: 4420 2024-03-26T17:00:54.931 INFO:tasks.workunit.client.3.smithi157.stderr:subnqn: nqn.2016-06.io.spdk:cnode1 2024-03-26T17:00:54.931 INFO:tasks.workunit.client.3.smithi157.stderr:traddr: 172.21.15.149 2024-03-26T17:00:54.931 INFO:tasks.workunit.client.3.smithi157.stderr:eflags: none 2024-03-26T17:00:54.931 INFO:tasks.workunit.client.3.smithi157.stderr:sectype: none 2024-03-26T17:00:54.931 INFO:tasks.workunit.client.3.smithi157.stderr:=====Discovery Log Entry 3====== 2024-03-26T17:00:54.931 INFO:tasks.workunit.client.3.smithi157.stderr:trtype: tcp 2024-03-26T17:00:54.931 INFO:tasks.workunit.client.3.smithi157.stderr:adrfam: ipv4 2024-03-26T17:00:54.931 INFO:tasks.workunit.client.3.smithi157.stderr:subtype: nvme subsystem 2024-03-26T17:00:54.931 INFO:tasks.workunit.client.3.smithi157.stderr:treq: not required 2024-03-26T17:00:54.931 INFO:tasks.workunit.client.3.smithi157.stderr:portid: 3 2024-03-26T17:00:54.931 INFO:tasks.workunit.client.3.smithi157.stderr:trsvcid: 4420 2024-03-26T17:00:54.931 INFO:tasks.workunit.client.3.smithi157.stderr:subnqn: nqn.2016-06.io.spdk:cnode2 2024-03-26T17:00:54.931 INFO:tasks.workunit.client.3.smithi157.stderr:traddr: 172.21.15.44 2024-03-26T17:00:54.931 INFO:tasks.workunit.client.3.smithi157.stderr:eflags: none 2024-03-26T17:00:54.932 INFO:tasks.workunit.client.3.smithi157.stderr:sectype: none 2024-03-26T17:00:54.932 INFO:tasks.workunit.client.3.smithi157.stderr:=====Discovery Log Entry 4====== 2024-03-26T17:00:54.932 INFO:tasks.workunit.client.3.smithi157.stderr:trtype: tcp 2024-03-26T17:00:54.932 INFO:tasks.workunit.client.3.smithi157.stderr:adrfam: ipv4 2024-03-26T17:00:54.932 INFO:tasks.workunit.client.3.smithi157.stderr:subtype: nvme subsystem 2024-03-26T17:00:54.932 INFO:tasks.workunit.client.3.smithi157.stderr:treq: not required 2024-03-26T17:00:54.932 INFO:tasks.workunit.client.3.smithi157.stderr:portid: 4 2024-03-26T17:00:54.932 INFO:tasks.workunit.client.3.smithi157.stderr:trsvcid: 4420 2024-03-26T17:00:54.932 INFO:tasks.workunit.client.3.smithi157.stderr:subnqn: nqn.2016-06.io.spdk:cnode2 2024-03-26T17:00:54.932 INFO:tasks.workunit.client.3.smithi157.stderr:traddr: 172.21.15.64 2024-03-26T17:00:54.932 INFO:tasks.workunit.client.3.smithi157.stderr:eflags: none 2024-03-26T17:00:54.932 INFO:tasks.workunit.client.3.smithi157.stderr:sectype: none 2024-03-26T17:00:54.932 INFO:tasks.workunit.client.3.smithi157.stderr:=====Discovery Log Entry 5====== 2024-03-26T17:00:54.932 INFO:tasks.workunit.client.3.smithi157.stderr:trtype: tcp 2024-03-26T17:00:54.933 INFO:tasks.workunit.client.3.smithi157.stderr:adrfam: ipv4 2024-03-26T17:00:54.933 INFO:tasks.workunit.client.3.smithi157.stderr:subtype: nvme subsystem 2024-03-26T17:00:54.933 INFO:tasks.workunit.client.3.smithi157.stderr:treq: not required 2024-03-26T17:00:54.933 INFO:tasks.workunit.client.3.smithi157.stderr:portid: 5 2024-03-26T17:00:54.933 INFO:tasks.workunit.client.3.smithi157.stderr:trsvcid: 4420 2024-03-26T17:00:54.933 INFO:tasks.workunit.client.3.smithi157.stderr:subnqn: nqn.2016-06.io.spdk:cnode2 2024-03-26T17:00:54.933 INFO:tasks.workunit.client.3.smithi157.stderr:traddr: 172.21.15.149 2024-03-26T17:00:54.933 INFO:tasks.workunit.client.3.smithi157.stderr:eflags: none 2024-03-26T17:00:54.933 INFO:tasks.workunit.client.3.smithi157.stderr:sectype: none 2024-03-26T17:00:54.933 INFO:tasks.workunit.client.3.smithi157.stderr:=====Discovery Log Entry 6====== 2024-03-26T17:00:54.933 INFO:tasks.workunit.client.3.smithi157.stderr:trtype: tcp 2024-03-26T17:00:54.933 INFO:tasks.workunit.client.3.smithi157.stderr:adrfam: ipv4 2024-03-26T17:00:54.933 INFO:tasks.workunit.client.3.smithi157.stderr:subtype: nvme subsystem 2024-03-26T17:00:54.933 INFO:tasks.workunit.client.3.smithi157.stderr:treq: not required 2024-03-26T17:00:54.933 INFO:tasks.workunit.client.3.smithi157.stderr:portid: 6 2024-03-26T17:00:54.934 INFO:tasks.workunit.client.3.smithi157.stderr:trsvcid: 4420 2024-03-26T17:00:54.934 INFO:tasks.workunit.client.3.smithi157.stderr:subnqn: nqn.2016-06.io.spdk:cnode3 2024-03-26T17:00:54.934 INFO:tasks.workunit.client.3.smithi157.stderr:traddr: 172.21.15.44 2024-03-26T17:00:54.934 INFO:tasks.workunit.client.3.smithi157.stderr:eflags: none 2024-03-26T17:00:54.934 INFO:tasks.workunit.client.3.smithi157.stderr:sectype: none 2024-03-26T17:00:54.934 INFO:tasks.workunit.client.3.smithi157.stderr:=====Discovery Log Entry 7====== 2024-03-26T17:00:54.934 INFO:tasks.workunit.client.3.smithi157.stderr:trtype: tcp 2024-03-26T17:00:54.934 INFO:tasks.workunit.client.3.smithi157.stderr:adrfam: ipv4 2024-03-26T17:00:54.934 INFO:tasks.workunit.client.3.smithi157.stderr:subtype: nvme subsystem 2024-03-26T17:00:54.934 INFO:tasks.workunit.client.3.smithi157.stderr:treq: not required 2024-03-26T17:00:54.934 INFO:tasks.workunit.client.3.smithi157.stderr:portid: 7 2024-03-26T17:00:54.934 INFO:tasks.workunit.client.3.smithi157.stderr:trsvcid: 4420 2024-03-26T17:00:54.934 INFO:tasks.workunit.client.3.smithi157.stderr:subnqn: nqn.2016-06.io.spdk:cnode3 2024-03-26T17:00:54.934 INFO:tasks.workunit.client.3.smithi157.stderr:traddr: 172.21.15.64 2024-03-26T17:00:54.934 INFO:tasks.workunit.client.3.smithi157.stderr:eflags: none 2024-03-26T17:00:54.935 INFO:tasks.workunit.client.3.smithi157.stderr:sectype: none 2024-03-26T17:00:54.935 INFO:tasks.workunit.client.3.smithi157.stderr:=====Discovery Log Entry 8====== 2024-03-26T17:00:54.935 INFO:tasks.workunit.client.3.smithi157.stderr:trtype: tcp 2024-03-26T17:00:54.935 INFO:tasks.workunit.client.3.smithi157.stderr:adrfam: ipv4 2024-03-26T17:00:54.935 INFO:tasks.workunit.client.3.smithi157.stderr:subtype: nvme subsystem 2024-03-26T17:00:54.935 INFO:tasks.workunit.client.3.smithi157.stderr:treq: not required 2024-03-26T17:00:54.935 INFO:tasks.workunit.client.3.smithi157.stderr:portid: 8 2024-03-26T17:00:54.935 INFO:tasks.workunit.client.3.smithi157.stderr:trsvcid: 4420 2024-03-26T17:00:54.935 INFO:tasks.workunit.client.3.smithi157.stderr:subnqn: nqn.2016-06.io.spdk:cnode3 2024-03-26T17:00:54.935 INFO:tasks.workunit.client.3.smithi157.stderr:traddr: 172.21.15.149 2024-03-26T17:00:54.935 INFO:tasks.workunit.client.3.smithi157.stderr:eflags: none 2024-03-26T17:00:54.935 INFO:tasks.workunit.client.3.smithi157.stderr:sectype: none' 2024-03-26T17:00:54.935 INFO:tasks.workunit.client.3.smithi157.stderr:+ grep -q 'subtype: nvme subsystem' 2024-03-26T17:00:54.936 INFO:tasks.workunit.client.3.smithi157.stderr:+ '[' 0 -eq 0 ']' 2024-03-26T17:00:54.936 INFO:tasks.workunit.client.3.smithi157.stdout:[nvmeof] discovery test passed! 2024-03-26T17:00:54.936 INFO:tasks.workunit.client.3.smithi157.stderr:+ echo '[nvmeof] discovery test passed!' 2024-03-26T17:00:54.936 INFO:tasks.workunit.client.3.smithi157.stderr:+ test_run connect 2024-03-26T17:00:54.937 INFO:tasks.workunit.client.3.smithi157.stdout:[nvmeof] Running test: connect 2024-03-26T17:00:54.937 INFO:tasks.workunit.client.3.smithi157.stderr:+ echo '[nvmeof] Running test: connect' 2024-03-26T17:00:54.937 INFO:tasks.workunit.client.3.smithi157.stderr:+ connect 2024-03-26T17:00:54.937 INFO:tasks.workunit.client.3.smithi157.stderr:+ sudo nvme connect -t tcp --traddr 172.21.15.44 -s 4420 -n nqn.2016-06.io.spdk:cnode1 2024-03-26T17:00:55.015 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:00:54 smithi044 ceph-mon[30624]: pgmap v427: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 74 KiB/s rd, 767 B/s wr, 27 op/s 2024-03-26T17:00:55.020 INFO:tasks.workunit.client.3.smithi157.stderr:++ sudo nvme list 2024-03-26T17:00:55.038 INFO:tasks.workunit.client.3.smithi157.stderr:+ output='Node Generic SN Model Namespace Usage Format FW Rev 2024-03-26T17:00:55.039 INFO:tasks.workunit.client.3.smithi157.stderr:--------------------- --------------------- -------------------- ---------------------------------------- ---------- -------------------------- ---------------- -------- 2024-03-26T17:00:55.039 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme0n1 /dev/ng0n1 PHMB7476002V480DGN INTEL SSDPED1D480GA 0x1 480.10 GB / 480.10 GB 512 B + 0 B E2010325 2024-03-26T17:00:55.039 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme1n11 /dev/ng1n11 Ceph14383361503536 Ceph bdev Controller 0xb 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-26T17:00:55.039 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme1n2 /dev/ng1n2 Ceph14383361503536 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-26T17:00:55.039 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme1n5 /dev/ng1n5 Ceph14383361503536 Ceph bdev Controller 0x5 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-26T17:00:55.039 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme1n8 /dev/ng1n8 Ceph14383361503536 Ceph bdev Controller 0x8 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 ' 2024-03-26T17:00:55.039 INFO:tasks.workunit.client.3.smithi157.stderr:+ echo 'Node Generic SN Model Namespace Usage Format FW Rev 2024-03-26T17:00:55.040 INFO:tasks.workunit.client.3.smithi157.stderr:--------------------- --------------------- -------------------- ---------------------------------------- ---------- -------------------------- ---------------- -------- 2024-03-26T17:00:55.040 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme0n1 /dev/ng0n1 PHMB7476002V480DGN INTEL SSDPED1D480GA 0x1 480.10 GB / 480.10 GB 512 B + 0 B E2010325 2024-03-26T17:00:55.040 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme1n11 /dev/ng1n11 Ceph14383361503536 Ceph bdev Controller 0xb 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-26T17:00:55.040 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme1n2 /dev/ng1n2 Ceph14383361503536 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-26T17:00:55.040 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme1n5 /dev/ng1n5 Ceph14383361503536 Ceph bdev Controller 0x5 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-26T17:00:55.040 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme1n8 /dev/ng1n8 Ceph14383361503536 Ceph bdev Controller 0x8 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 ' 2024-03-26T17:00:55.040 INFO:tasks.workunit.client.3.smithi157.stderr:+ grep -q 'Ceph bdev Controller' 2024-03-26T17:00:55.041 INFO:tasks.workunit.client.3.smithi157.stderr:+ '[' 0 -eq 0 ']' 2024-03-26T17:00:55.042 INFO:tasks.workunit.client.3.smithi157.stdout:[nvmeof] connect test passed! 2024-03-26T17:00:55.042 INFO:tasks.workunit.client.3.smithi157.stderr:+ echo '[nvmeof] connect test passed!' 2024-03-26T17:00:55.042 INFO:tasks.workunit.client.3.smithi157.stderr:+ test_run list_subsys 1 2024-03-26T17:00:55.042 INFO:tasks.workunit.client.3.smithi157.stderr:+ echo '[nvmeof] Running test: list_subsys' 2024-03-26T17:00:55.043 INFO:tasks.workunit.client.3.smithi157.stdout:[nvmeof] Running test: list_subsys 2024-03-26T17:00:55.043 INFO:tasks.workunit.client.3.smithi157.stderr:+ list_subsys 1 2024-03-26T17:00:55.043 INFO:tasks.workunit.client.3.smithi157.stderr:+ expected_count=1 2024-03-26T17:00:55.043 INFO:tasks.workunit.client.3.smithi157.stderr:++ sudo nvme list-subsys --output-format=json 2024-03-26T17:00:55.055 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:00:54 smithi064 ceph-mon[34420]: pgmap v427: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 74 KiB/s rd, 767 B/s wr, 27 op/s 2024-03-26T17:00:55.076 INFO:tasks.workunit.client.3.smithi157.stderr:+ output='[ 2024-03-26T17:00:55.076 INFO:tasks.workunit.client.3.smithi157.stderr: { 2024-03-26T17:00:55.076 INFO:tasks.workunit.client.3.smithi157.stderr: "HostNQN":"nqn.2014-08.org.nvmexpress:uuid:00000000-0000-0000-0000-0cc47a6bf610", 2024-03-26T17:00:55.076 INFO:tasks.workunit.client.3.smithi157.stderr: "HostID":"8ff7e22f-06b9-47ef-9494-f6ca3bbef521", 2024-03-26T17:00:55.076 INFO:tasks.workunit.client.3.smithi157.stderr: "Subsystems":[ 2024-03-26T17:00:55.076 INFO:tasks.workunit.client.3.smithi157.stderr: { 2024-03-26T17:00:55.076 INFO:tasks.workunit.client.3.smithi157.stderr: "Name":"nvme-subsys1", 2024-03-26T17:00:55.076 INFO:tasks.workunit.client.3.smithi157.stderr: "NQN":"nqn.2016-06.io.spdk:cnode1", 2024-03-26T17:00:55.076 INFO:tasks.workunit.client.3.smithi157.stderr: "IOPolicy":"numa", 2024-03-26T17:00:55.077 INFO:tasks.workunit.client.3.smithi157.stderr: "Paths":[ 2024-03-26T17:00:55.077 INFO:tasks.workunit.client.3.smithi157.stderr: { 2024-03-26T17:00:55.077 INFO:tasks.workunit.client.3.smithi157.stderr: "Name":"nvme1", 2024-03-26T17:00:55.077 INFO:tasks.workunit.client.3.smithi157.stderr: "Transport":"tcp", 2024-03-26T17:00:55.077 INFO:tasks.workunit.client.3.smithi157.stderr: "Address":"traddr=172.21.15.44,trsvcid=4420,src_addr=172.21.15.157", 2024-03-26T17:00:55.077 INFO:tasks.workunit.client.3.smithi157.stderr: "State":"live" 2024-03-26T17:00:55.077 INFO:tasks.workunit.client.3.smithi157.stderr: } 2024-03-26T17:00:55.077 INFO:tasks.workunit.client.3.smithi157.stderr: ] 2024-03-26T17:00:55.077 INFO:tasks.workunit.client.3.smithi157.stderr: }, 2024-03-26T17:00:55.077 INFO:tasks.workunit.client.3.smithi157.stderr: { 2024-03-26T17:00:55.077 INFO:tasks.workunit.client.3.smithi157.stderr: "Name":"nvme-subsys0", 2024-03-26T17:00:55.077 INFO:tasks.workunit.client.3.smithi157.stderr: "NQN":"nqn.2014.08.org.nvmexpress:80868086PHMB7476002V480DGN INTEL SSDPED1D480GA", 2024-03-26T17:00:55.077 INFO:tasks.workunit.client.3.smithi157.stderr: "IOPolicy":"numa", 2024-03-26T17:00:55.077 INFO:tasks.workunit.client.3.smithi157.stderr: "Paths":[ 2024-03-26T17:00:55.077 INFO:tasks.workunit.client.3.smithi157.stderr: { 2024-03-26T17:00:55.078 INFO:tasks.workunit.client.3.smithi157.stderr: "Name":"nvme0", 2024-03-26T17:00:55.078 INFO:tasks.workunit.client.3.smithi157.stderr: "Transport":"pcie", 2024-03-26T17:00:55.078 INFO:tasks.workunit.client.3.smithi157.stderr: "Address":"0000:02:00.0", 2024-03-26T17:00:55.078 INFO:tasks.workunit.client.3.smithi157.stderr: "State":"live" 2024-03-26T17:00:55.078 INFO:tasks.workunit.client.3.smithi157.stderr: } 2024-03-26T17:00:55.078 INFO:tasks.workunit.client.3.smithi157.stderr: ] 2024-03-26T17:00:55.078 INFO:tasks.workunit.client.3.smithi157.stderr: } 2024-03-26T17:00:55.078 INFO:tasks.workunit.client.3.smithi157.stderr: ] 2024-03-26T17:00:55.078 INFO:tasks.workunit.client.3.smithi157.stderr: } 2024-03-26T17:00:55.078 INFO:tasks.workunit.client.3.smithi157.stderr:]' 2024-03-26T17:00:55.079 INFO:tasks.workunit.client.3.smithi157.stderr:++ echo '[' '{' '"HostNQN":"nqn.2014-08.org.nvmexpress:uuid:00000000-0000-0000-0000-0cc47a6bf610",' '"HostID":"8ff7e22f-06b9-47ef-9494-f6ca3bbef521",' '"Subsystems":[' '{' '"Name":"nvme-subsys1",' '"NQN":"nqn.2016-06.io.spdk:cnode1",' '"IOPolicy":"numa",' '"Paths":[' '{' '"Name":"nvme1",' '"Transport":"tcp",' '"Address":"traddr=172.21.15.44,trsvcid=4420,src_addr=172.21.15.157",' '"State":"live"' '}' ']' '},' '{' '"Name":"nvme-subsys0",' '"NQN":"nqn.2014.08.org.nvmexpress:80868086PHMB7476002V480DGN' INTEL 'SSDPED1D480GA",' '"IOPolicy":"numa",' '"Paths":[' '{' '"Name":"nvme0",' '"Transport":"pcie",' '"Address":"0000:02:00.0",' '"State":"live"' '}' ']' '}' ']' '}' ']' 2024-03-26T17:00:55.079 INFO:tasks.workunit.client.3.smithi157.stderr:++ grep -o '"tcp"' 2024-03-26T17:00:55.079 INFO:tasks.workunit.client.3.smithi157.stderr:++ wc -l 2024-03-26T17:00:55.079 INFO:tasks.workunit.client.3.smithi157.stderr:+ multipath=1 2024-03-26T17:00:55.079 INFO:tasks.workunit.client.3.smithi157.stderr:+ '[' 1 -ne 1 ']' 2024-03-26T17:00:55.080 INFO:tasks.workunit.client.3.smithi157.stderr:+ '[' 0 -eq 0 ']' 2024-03-26T17:00:55.080 INFO:tasks.workunit.client.3.smithi157.stdout:[nvmeof] list_subsys test passed! 2024-03-26T17:00:55.080 INFO:tasks.workunit.client.3.smithi157.stderr:+ echo '[nvmeof] list_subsys test passed!' 2024-03-26T17:00:55.080 INFO:tasks.workunit.client.3.smithi157.stderr:+ test_run disconnect_all 2024-03-26T17:00:55.080 INFO:tasks.workunit.client.3.smithi157.stderr:+ echo '[nvmeof] Running test: disconnect_all' 2024-03-26T17:00:55.081 INFO:tasks.workunit.client.3.smithi157.stdout:[nvmeof] Running test: disconnect_all 2024-03-26T17:00:55.081 INFO:tasks.workunit.client.3.smithi157.stderr:+ disconnect_all 2024-03-26T17:00:55.081 INFO:tasks.workunit.client.3.smithi157.stderr:+ sudo nvme disconnect-all 2024-03-26T17:00:55.465 INFO:tasks.workunit.client.3.smithi157.stderr:++ sudo nvme list 2024-03-26T17:00:55.480 INFO:tasks.workunit.client.3.smithi157.stderr:+ output='Node Generic SN Model Namespace Usage Format FW Rev 2024-03-26T17:00:55.480 INFO:tasks.workunit.client.3.smithi157.stderr:--------------------- --------------------- -------------------- ---------------------------------------- ---------- -------------------------- ---------------- -------- 2024-03-26T17:00:55.480 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme0n1 /dev/ng0n1 PHMB7476002V480DGN INTEL SSDPED1D480GA 0x1 480.10 GB / 480.10 GB 512 B + 0 B E2010325' 2024-03-26T17:00:55.480 INFO:tasks.workunit.client.3.smithi157.stderr:+ echo 'Node Generic SN Model Namespace Usage Format FW Rev 2024-03-26T17:00:55.480 INFO:tasks.workunit.client.3.smithi157.stderr:--------------------- --------------------- -------------------- ---------------------------------------- ---------- -------------------------- ---------------- -------- 2024-03-26T17:00:55.480 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme0n1 /dev/ng0n1 PHMB7476002V480DGN INTEL SSDPED1D480GA 0x1 480.10 GB / 480.10 GB 512 B + 0 B E2010325' 2024-03-26T17:00:55.481 INFO:tasks.workunit.client.3.smithi157.stderr:+ grep -q 'Ceph bdev Controller' 2024-03-26T17:00:55.481 INFO:tasks.workunit.client.3.smithi157.stderr:+ '[' 0 -eq 0 ']' 2024-03-26T17:00:55.482 INFO:tasks.workunit.client.3.smithi157.stderr:+ echo '[nvmeof] disconnect_all test passed!' 2024-03-26T17:00:55.482 INFO:tasks.workunit.client.3.smithi157.stdout:[nvmeof] disconnect_all test passed! 2024-03-26T17:00:55.482 INFO:tasks.workunit.client.3.smithi157.stderr:+ test_run list_subsys 0 2024-03-26T17:00:55.482 INFO:tasks.workunit.client.3.smithi157.stdout:[nvmeof] Running test: list_subsys 2024-03-26T17:00:55.483 INFO:tasks.workunit.client.3.smithi157.stderr:+ echo '[nvmeof] Running test: list_subsys' 2024-03-26T17:00:55.483 INFO:tasks.workunit.client.3.smithi157.stderr:+ list_subsys 0 2024-03-26T17:00:55.483 INFO:tasks.workunit.client.3.smithi157.stderr:+ expected_count=0 2024-03-26T17:00:55.483 INFO:tasks.workunit.client.3.smithi157.stderr:++ sudo nvme list-subsys --output-format=json 2024-03-26T17:00:55.496 INFO:tasks.workunit.client.3.smithi157.stderr:+ output='[ 2024-03-26T17:00:55.496 INFO:tasks.workunit.client.3.smithi157.stderr: { 2024-03-26T17:00:55.496 INFO:tasks.workunit.client.3.smithi157.stderr: "HostNQN":"nqn.2014-08.org.nvmexpress:uuid:00000000-0000-0000-0000-0cc47a6bf610", 2024-03-26T17:00:55.496 INFO:tasks.workunit.client.3.smithi157.stderr: "HostID":"8ff7e22f-06b9-47ef-9494-f6ca3bbef521", 2024-03-26T17:00:55.496 INFO:tasks.workunit.client.3.smithi157.stderr: "Subsystems":[ 2024-03-26T17:00:55.496 INFO:tasks.workunit.client.3.smithi157.stderr: { 2024-03-26T17:00:55.496 INFO:tasks.workunit.client.3.smithi157.stderr: "Name":"nvme-subsys0", 2024-03-26T17:00:55.496 INFO:tasks.workunit.client.3.smithi157.stderr: "NQN":"nqn.2014.08.org.nvmexpress:80868086PHMB7476002V480DGN INTEL SSDPED1D480GA", 2024-03-26T17:00:55.496 INFO:tasks.workunit.client.3.smithi157.stderr: "IOPolicy":"numa", 2024-03-26T17:00:55.496 INFO:tasks.workunit.client.3.smithi157.stderr: "Paths":[ 2024-03-26T17:00:55.496 INFO:tasks.workunit.client.3.smithi157.stderr: { 2024-03-26T17:00:55.497 INFO:tasks.workunit.client.3.smithi157.stderr: "Name":"nvme0", 2024-03-26T17:00:55.497 INFO:tasks.workunit.client.3.smithi157.stderr: "Transport":"pcie", 2024-03-26T17:00:55.497 INFO:tasks.workunit.client.3.smithi157.stderr: "Address":"0000:02:00.0", 2024-03-26T17:00:55.497 INFO:tasks.workunit.client.3.smithi157.stderr: "State":"live" 2024-03-26T17:00:55.497 INFO:tasks.workunit.client.3.smithi157.stderr: } 2024-03-26T17:00:55.497 INFO:tasks.workunit.client.3.smithi157.stderr: ] 2024-03-26T17:00:55.497 INFO:tasks.workunit.client.3.smithi157.stderr: } 2024-03-26T17:00:55.497 INFO:tasks.workunit.client.3.smithi157.stderr: ] 2024-03-26T17:00:55.497 INFO:tasks.workunit.client.3.smithi157.stderr: } 2024-03-26T17:00:55.497 INFO:tasks.workunit.client.3.smithi157.stderr:]' 2024-03-26T17:00:55.498 INFO:tasks.workunit.client.3.smithi157.stderr:++ echo '[' '{' '"HostNQN":"nqn.2014-08.org.nvmexpress:uuid:00000000-0000-0000-0000-0cc47a6bf610",' '"HostID":"8ff7e22f-06b9-47ef-9494-f6ca3bbef521",' '"Subsystems":[' '{' '"Name":"nvme-subsys0",' '"NQN":"nqn.2014.08.org.nvmexpress:80868086PHMB7476002V480DGN' INTEL 'SSDPED1D480GA",' '"IOPolicy":"numa",' '"Paths":[' '{' '"Name":"nvme0",' '"Transport":"pcie",' '"Address":"0000:02:00.0",' '"State":"live"' '}' ']' '}' ']' '}' ']' 2024-03-26T17:00:55.498 INFO:tasks.workunit.client.3.smithi157.stderr:++ grep -o '"tcp"' 2024-03-26T17:00:55.498 INFO:tasks.workunit.client.3.smithi157.stderr:++ wc -l 2024-03-26T17:00:55.498 INFO:tasks.workunit.client.3.smithi157.stderr:+ multipath=0 2024-03-26T17:00:55.498 INFO:tasks.workunit.client.3.smithi157.stderr:+ '[' 0 -ne 0 ']' 2024-03-26T17:00:55.499 INFO:tasks.workunit.client.3.smithi157.stderr:+ '[' 0 -eq 0 ']' 2024-03-26T17:00:55.499 INFO:tasks.workunit.client.3.smithi157.stdout:[nvmeof] list_subsys test passed! 2024-03-26T17:00:55.499 INFO:tasks.workunit.client.3.smithi157.stderr:+ echo '[nvmeof] list_subsys test passed!' 2024-03-26T17:00:55.499 INFO:tasks.workunit.client.3.smithi157.stderr:+ test_run connect_all 2024-03-26T17:00:55.499 INFO:tasks.workunit.client.3.smithi157.stderr:+ echo '[nvmeof] Running test: connect_all' 2024-03-26T17:00:55.500 INFO:tasks.workunit.client.3.smithi157.stdout:[nvmeof] Running test: connect_all 2024-03-26T17:00:55.500 INFO:tasks.workunit.client.3.smithi157.stderr:+ connect_all 2024-03-26T17:00:55.500 INFO:tasks.workunit.client.3.smithi157.stderr:+ sudo nvme connect-all --traddr=172.21.15.44 --transport=tcp -l 3600 2024-03-26T17:00:55.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:00:55 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-b[34416]: 2024-03-26T17:00:55.281+0000 7ff022916700 -1 mon.b@2(peon) e3 get_health_metrics reporting 4 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T17:00:55.556 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:55 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:00:55] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:00:55.556 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:55 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:00:55] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:00:55.556 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:55 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:00:56.246 INFO:tasks.workunit.client.3.smithi157.stderr:++ sudo nvme list 2024-03-26T17:00:56.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:00:56 smithi044 ceph-mon[30624]: pgmap v428: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 29 KiB/s rd, 170 B/s wr, 8 op/s 2024-03-26T17:00:56.265 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:55 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:55] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:00:56.265 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:55 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:55] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:00:56.265 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:55 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:00:56.275 INFO:tasks.workunit.client.3.smithi157.stderr:+ output='Node Generic SN Model Namespace Usage Format FW Rev 2024-03-26T17:00:56.275 INFO:tasks.workunit.client.3.smithi157.stderr:--------------------- --------------------- -------------------- ---------------------------------------- ---------- -------------------------- ---------------- -------- 2024-03-26T17:00:56.275 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme0n1 /dev/ng0n1 PHMB7476002V480DGN INTEL SSDPED1D480GA 0x1 480.10 GB / 480.10 GB 512 B + 0 B E2010325 2024-03-26T17:00:56.275 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme2n1 /dev/ng2n1 Ceph14383361503536 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-26T17:00:56.276 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme2n10 /dev/ng2n10 Ceph14383361503536 Ceph bdev Controller 0xa 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-26T17:00:56.276 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme2n11 /dev/ng2n11 Ceph14383361503536 Ceph bdev Controller 0xb 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-26T17:00:56.276 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme2n12 /dev/ng2n12 Ceph14383361503536 Ceph bdev Controller 0xc 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-26T17:00:56.276 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme2n13 /dev/ng2n13 Ceph14383361503536 Ceph bdev Controller 0xd 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-26T17:00:56.276 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme2n14 /dev/ng2n14 Ceph14383361503536 Ceph bdev Controller 0xe 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-26T17:00:56.276 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme2n15 /dev/ng2n15 Ceph14383361503536 Ceph bdev Controller 0xf 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-26T17:00:56.276 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme2n16 /dev/ng2n16 Ceph14383361503536 Ceph bdev Controller 0x10 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-26T17:00:56.276 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme2n17 /dev/ng2n17 Ceph14383361503536 Ceph bdev Controller 0x11 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-26T17:00:56.276 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme2n18 /dev/ng2n18 Ceph14383361503536 Ceph bdev Controller 0x12 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-26T17:00:56.276 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme2n19 /dev/ng2n19 Ceph14383361503536 Ceph bdev Controller 0x13 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-26T17:00:56.276 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme2n2 /dev/ng2n2 Ceph14383361503536 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-26T17:00:56.276 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme2n20 /dev/ng2n20 Ceph14383361503536 Ceph bdev Controller 0x14 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-26T17:00:56.276 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme2n3 /dev/ng2n3 Ceph14383361503536 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-26T17:00:56.277 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme2n4 /dev/ng2n4 Ceph14383361503536 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-26T17:00:56.277 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme2n5 /dev/ng2n5 Ceph14383361503536 Ceph bdev Controller 0x5 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-26T17:00:56.277 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme2n6 /dev/ng2n6 Ceph14383361503536 Ceph bdev Controller 0x6 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-26T17:00:56.277 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme2n7 /dev/ng2n7 Ceph14383361503536 Ceph bdev Controller 0x7 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-26T17:00:56.277 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme2n8 /dev/ng2n8 Ceph14383361503536 Ceph bdev Controller 0x8 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-26T17:00:56.277 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme2n9 /dev/ng2n9 Ceph14383361503536 Ceph bdev Controller 0x9 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-26T17:00:56.277 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme5n1 /dev/ng5n1 Ceph44698087180525 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-26T17:00:56.277 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme5n10 /dev/ng5n10 Ceph44698087180525 Ceph bdev Controller 0xa 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-26T17:00:56.277 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme5n11 /dev/ng5n11 Ceph44698087180525 Ceph bdev Controller 0xb 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-26T17:00:56.277 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme5n12 /dev/ng5n12 Ceph44698087180525 Ceph bdev Controller 0xc 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-26T17:00:56.277 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme5n13 /dev/ng5n13 Ceph44698087180525 Ceph bdev Controller 0xd 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-26T17:00:56.277 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme5n14 /dev/ng5n14 Ceph44698087180525 Ceph bdev Controller 0xe 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-26T17:00:56.277 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme5n15 /dev/ng5n15 Ceph44698087180525 Ceph bdev Controller 0xf 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-26T17:00:56.277 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme5n16 /dev/ng5n16 Ceph44698087180525 Ceph bdev Controller 0x10 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-26T17:00:56.278 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme5n17 /dev/ng5n17 Ceph44698087180525 Ceph bdev Controller 0x11 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-26T17:00:56.278 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme5n18 /dev/ng5n18 Ceph44698087180525 Ceph bdev Controller 0x12 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-26T17:00:56.278 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme5n19 /dev/ng5n19 Ceph44698087180525 Ceph bdev Controller 0x13 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-26T17:00:56.278 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme5n2 /dev/ng5n2 Ceph44698087180525 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-26T17:00:56.278 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme5n20 /dev/ng5n20 Ceph44698087180525 Ceph bdev Controller 0x14 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-26T17:00:56.278 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme5n3 /dev/ng5n3 Ceph44698087180525 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-26T17:00:56.279 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme5n4 /dev/ng5n4 Ceph44698087180525 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-26T17:00:56.279 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme5n5 /dev/ng5n5 Ceph44698087180525 Ceph bdev Controller 0x5 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-26T17:00:56.279 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme5n6 /dev/ng5n6 Ceph44698087180525 Ceph bdev Controller 0x6 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-26T17:00:56.279 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme5n7 /dev/ng5n7 Ceph44698087180525 Ceph bdev Controller 0x7 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-26T17:00:56.279 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme5n8 /dev/ng5n8 Ceph44698087180525 Ceph bdev Controller 0x8 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-26T17:00:56.279 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme5n9 /dev/ng5n9 Ceph44698087180525 Ceph bdev Controller 0x9 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-26T17:00:56.279 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme8n1 /dev/ng8n1 Ceph20558982565741 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-26T17:00:56.280 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme8n10 /dev/ng8n10 Ceph20558982565741 Ceph bdev Controller 0xa 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-26T17:00:56.280 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme8n12 /dev/ng8n12 Ceph20558982565741 Ceph bdev Controller 0xc 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-26T17:00:56.280 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme8n13 /dev/ng8n13 Ceph20558982565741 Ceph bdev Controller 0xd 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-26T17:00:56.280 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme8n15 /dev/ng8n15 Ceph20558982565741 Ceph bdev Controller 0xf 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-26T17:00:56.280 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme8n16 /dev/ng8n16 Ceph20558982565741 Ceph bdev Controller 0x10 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-26T17:00:56.280 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme8n18 /dev/ng8n18 Ceph20558982565741 Ceph bdev Controller 0x12 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-26T17:00:56.280 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme8n19 /dev/ng8n19 Ceph20558982565741 Ceph bdev Controller 0x13 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-26T17:00:56.280 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme8n2 /dev/ng8n2 Ceph20558982565741 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-26T17:00:56.281 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme8n3 /dev/ng8n3 Ceph20558982565741 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-26T17:00:56.281 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme8n4 /dev/ng8n4 Ceph20558982565741 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-26T17:00:56.281 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme8n6 /dev/ng8n6 Ceph20558982565741 Ceph bdev Controller 0x6 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-26T17:00:56.281 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme8n7 /dev/ng8n7 Ceph20558982565741 Ceph bdev Controller 0x7 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-26T17:00:56.281 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme8n9 /dev/ng8n9 Ceph20558982565741 Ceph bdev Controller 0x9 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 ' 2024-03-26T17:00:56.281 INFO:tasks.workunit.client.3.smithi157.stderr:+ grep -q 'Ceph bdev Controller' 2024-03-26T17:00:56.281 INFO:tasks.workunit.client.3.smithi157.stderr:+ echo 'Node Generic SN Model Namespace Usage Format FW Rev 2024-03-26T17:00:56.281 INFO:tasks.workunit.client.3.smithi157.stderr:--------------------- --------------------- -------------------- ---------------------------------------- ---------- -------------------------- ---------------- -------- 2024-03-26T17:00:56.281 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme0n1 /dev/ng0n1 PHMB7476002V480DGN INTEL SSDPED1D480GA 0x1 480.10 GB / 480.10 GB 512 B + 0 B E2010325 2024-03-26T17:00:56.281 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme2n1 /dev/ng2n1 Ceph14383361503536 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-26T17:00:56.281 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme2n10 /dev/ng2n10 Ceph14383361503536 Ceph bdev Controller 0xa 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-26T17:00:56.281 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme2n11 /dev/ng2n11 Ceph14383361503536 Ceph bdev Controller 0xb 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-26T17:00:56.281 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme2n12 /dev/ng2n12 Ceph14383361503536 Ceph bdev Controller 0xc 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-26T17:00:56.282 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme2n13 /dev/ng2n13 Ceph14383361503536 Ceph bdev Controller 0xd 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-26T17:00:56.282 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme2n14 /dev/ng2n14 Ceph14383361503536 Ceph bdev Controller 0xe 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-26T17:00:56.282 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme2n15 /dev/ng2n15 Ceph14383361503536 Ceph bdev Controller 0xf 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-26T17:00:56.282 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme2n16 /dev/ng2n16 Ceph14383361503536 Ceph bdev Controller 0x10 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-26T17:00:56.282 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme2n17 /dev/ng2n17 Ceph14383361503536 Ceph bdev Controller 0x11 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-26T17:00:56.282 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme2n18 /dev/ng2n18 Ceph14383361503536 Ceph bdev Controller 0x12 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-26T17:00:56.282 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme2n19 /dev/ng2n19 Ceph14383361503536 Ceph bdev Controller 0x13 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-26T17:00:56.282 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme2n2 /dev/ng2n2 Ceph14383361503536 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-26T17:00:56.282 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme2n20 /dev/ng2n20 Ceph14383361503536 Ceph bdev Controller 0x14 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-26T17:00:56.283 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme2n3 /dev/ng2n3 Ceph14383361503536 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-26T17:00:56.283 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme2n4 /dev/ng2n4 Ceph14383361503536 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-26T17:00:56.283 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme2n5 /dev/ng2n5 Ceph14383361503536 Ceph bdev Controller 0x5 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-26T17:00:56.283 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme2n6 /dev/ng2n6 Ceph14383361503536 Ceph bdev Controller 0x6 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-26T17:00:56.283 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme2n7 /dev/ng2n7 Ceph14383361503536 Ceph bdev Controller 0x7 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-26T17:00:56.283 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme2n8 /dev/ng2n8 Ceph14383361503536 Ceph bdev Controller 0x8 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-26T17:00:56.283 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme2n9 /dev/ng2n9 Ceph14383361503536 Ceph bdev Controller 0x9 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-26T17:00:56.283 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme5n1 /dev/ng5n1 Ceph44698087180525 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-26T17:00:56.284 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme5n10 /dev/ng5n10 Ceph44698087180525 Ceph bdev Controller 0xa 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-26T17:00:56.284 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme5n11 /dev/ng5n11 Ceph44698087180525 Ceph bdev Controller 0xb 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-26T17:00:56.284 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme5n12 /dev/ng5n12 Ceph44698087180525 Ceph bdev Controller 0xc 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-26T17:00:56.284 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme5n13 /dev/ng5n13 Ceph44698087180525 Ceph bdev Controller 0xd 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-26T17:00:56.284 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme5n14 /dev/ng5n14 Ceph44698087180525 Ceph bdev Controller 0xe 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-26T17:00:56.284 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme5n15 /dev/ng5n15 Ceph44698087180525 Ceph bdev Controller 0xf 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-26T17:00:56.284 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme5n16 /dev/ng5n16 Ceph44698087180525 Ceph bdev Controller 0x10 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-26T17:00:56.285 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme5n17 /dev/ng5n17 Ceph44698087180525 Ceph bdev Controller 0x11 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-26T17:00:56.285 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme5n18 /dev/ng5n18 Ceph44698087180525 Ceph bdev Controller 0x12 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-26T17:00:56.285 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme5n19 /dev/ng5n19 Ceph44698087180525 Ceph bdev Controller 0x13 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-26T17:00:56.285 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme5n2 /dev/ng5n2 Ceph44698087180525 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-26T17:00:56.285 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme5n20 /dev/ng5n20 Ceph44698087180525 Ceph bdev Controller 0x14 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-26T17:00:56.285 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme5n3 /dev/ng5n3 Ceph44698087180525 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-26T17:00:56.285 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme5n4 /dev/ng5n4 Ceph44698087180525 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-26T17:00:56.285 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme5n5 /dev/ng5n5 Ceph44698087180525 Ceph bdev Controller 0x5 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-26T17:00:56.286 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme5n6 /dev/ng5n6 Ceph44698087180525 Ceph bdev Controller 0x6 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-26T17:00:56.286 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme5n7 /dev/ng5n7 Ceph44698087180525 Ceph bdev Controller 0x7 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-26T17:00:56.286 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme5n8 /dev/ng5n8 Ceph44698087180525 Ceph bdev Controller 0x8 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-26T17:00:56.286 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme5n9 /dev/ng5n9 Ceph44698087180525 Ceph bdev Controller 0x9 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-26T17:00:56.286 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme8n1 /dev/ng8n1 Ceph20558982565741 Ceph bdev Controller 0x1 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-26T17:00:56.286 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme8n10 /dev/ng8n10 Ceph20558982565741 Ceph bdev Controller 0xa 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-26T17:00:56.286 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme8n12 /dev/ng8n12 Ceph20558982565741 Ceph bdev Controller 0xc 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-26T17:00:56.286 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme8n13 /dev/ng8n13 Ceph20558982565741 Ceph bdev Controller 0xd 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-26T17:00:56.286 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme8n15 /dev/ng8n15 Ceph20558982565741 Ceph bdev Controller 0xf 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-26T17:00:56.287 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme8n16 /dev/ng8n16 Ceph20558982565741 Ceph bdev Controller 0x10 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-26T17:00:56.287 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme8n18 /dev/ng8n18 Ceph20558982565741 Ceph bdev Controller 0x12 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-26T17:00:56.287 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme8n19 /dev/ng8n19 Ceph20558982565741 Ceph bdev Controller 0x13 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-26T17:00:56.287 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme8n2 /dev/ng8n2 Ceph20558982565741 Ceph bdev Controller 0x2 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-26T17:00:56.287 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme8n3 /dev/ng8n3 Ceph20558982565741 Ceph bdev Controller 0x3 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-26T17:00:56.287 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme8n4 /dev/ng8n4 Ceph20558982565741 Ceph bdev Controller 0x4 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-26T17:00:56.287 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme8n6 /dev/ng8n6 Ceph20558982565741 Ceph bdev Controller 0x6 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-26T17:00:56.287 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme8n7 /dev/ng8n7 Ceph20558982565741 Ceph bdev Controller 0x7 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 2024-03-26T17:00:56.287 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme8n9 /dev/ng8n9 Ceph20558982565741 Ceph bdev Controller 0x9 8.59 GB / 8.59 GB 512 B + 0 B 23.01.1 ' 2024-03-26T17:00:56.288 INFO:tasks.workunit.client.3.smithi157.stderr:+ '[' 0 -eq 0 ']' 2024-03-26T17:00:56.288 INFO:tasks.workunit.client.3.smithi157.stderr:+ echo '[nvmeof] connect_all test passed!' 2024-03-26T17:00:56.288 INFO:tasks.workunit.client.3.smithi157.stdout:[nvmeof] connect_all test passed! 2024-03-26T17:00:56.290 INFO:tasks.workunit.client.3.smithi157.stderr:++ echo 172.21.15.44,172.21.15.64,172.21.15.149 2024-03-26T17:00:56.290 INFO:tasks.workunit.client.3.smithi157.stderr:++ tr -cd , 2024-03-26T17:00:56.290 INFO:tasks.workunit.client.3.smithi157.stderr:++ wc -c 2024-03-26T17:00:56.290 INFO:tasks.workunit.client.3.smithi157.stderr:+ gateways_count=3 2024-03-26T17:00:56.290 INFO:tasks.workunit.client.3.smithi157.stderr:+ multipath_count=9 2024-03-26T17:00:56.290 INFO:tasks.workunit.client.3.smithi157.stderr:+ test_run list_subsys 9 2024-03-26T17:00:56.291 INFO:tasks.workunit.client.3.smithi157.stdout:[nvmeof] Running test: list_subsys 2024-03-26T17:00:56.291 INFO:tasks.workunit.client.3.smithi157.stderr:+ echo '[nvmeof] Running test: list_subsys' 2024-03-26T17:00:56.291 INFO:tasks.workunit.client.3.smithi157.stderr:+ list_subsys 9 2024-03-26T17:00:56.292 INFO:tasks.workunit.client.3.smithi157.stderr:+ expected_count=9 2024-03-26T17:00:56.292 INFO:tasks.workunit.client.3.smithi157.stderr:++ sudo nvme list-subsys --output-format=json 2024-03-26T17:00:56.305 INFO:tasks.workunit.client.3.smithi157.stderr:+ output='[ 2024-03-26T17:00:56.305 INFO:tasks.workunit.client.3.smithi157.stderr: { 2024-03-26T17:00:56.305 INFO:tasks.workunit.client.3.smithi157.stderr: "HostNQN":"nqn.2014-08.org.nvmexpress:uuid:00000000-0000-0000-0000-0cc47a6bf610", 2024-03-26T17:00:56.305 INFO:tasks.workunit.client.3.smithi157.stderr: "HostID":"8ff7e22f-06b9-47ef-9494-f6ca3bbef521", 2024-03-26T17:00:56.306 INFO:tasks.workunit.client.3.smithi157.stderr: "Subsystems":[ 2024-03-26T17:00:56.306 INFO:tasks.workunit.client.3.smithi157.stderr: { 2024-03-26T17:00:56.306 INFO:tasks.workunit.client.3.smithi157.stderr: "Name":"nvme-subsys5", 2024-03-26T17:00:56.306 INFO:tasks.workunit.client.3.smithi157.stderr: "NQN":"nqn.2016-06.io.spdk:cnode2", 2024-03-26T17:00:56.306 INFO:tasks.workunit.client.3.smithi157.stderr: "IOPolicy":"numa", 2024-03-26T17:00:56.306 INFO:tasks.workunit.client.3.smithi157.stderr: "Paths":[ 2024-03-26T17:00:56.306 INFO:tasks.workunit.client.3.smithi157.stderr: { 2024-03-26T17:00:56.306 INFO:tasks.workunit.client.3.smithi157.stderr: "Name":"nvme7", 2024-03-26T17:00:56.306 INFO:tasks.workunit.client.3.smithi157.stderr: "Transport":"tcp", 2024-03-26T17:00:56.306 INFO:tasks.workunit.client.3.smithi157.stderr: "Address":"traddr=172.21.15.149,trsvcid=4420,src_addr=172.21.15.157", 2024-03-26T17:00:56.306 INFO:tasks.workunit.client.3.smithi157.stderr: "State":"live" 2024-03-26T17:00:56.306 INFO:tasks.workunit.client.3.smithi157.stderr: }, 2024-03-26T17:00:56.306 INFO:tasks.workunit.client.3.smithi157.stderr: { 2024-03-26T17:00:56.306 INFO:tasks.workunit.client.3.smithi157.stderr: "Name":"nvme6", 2024-03-26T17:00:56.306 INFO:tasks.workunit.client.3.smithi157.stderr: "Transport":"tcp", 2024-03-26T17:00:56.307 INFO:tasks.workunit.client.3.smithi157.stderr: "Address":"traddr=172.21.15.64,trsvcid=4420,src_addr=172.21.15.157", 2024-03-26T17:00:56.307 INFO:tasks.workunit.client.3.smithi157.stderr: "State":"live" 2024-03-26T17:00:56.307 INFO:tasks.workunit.client.3.smithi157.stderr: }, 2024-03-26T17:00:56.307 INFO:tasks.workunit.client.3.smithi157.stderr: { 2024-03-26T17:00:56.307 INFO:tasks.workunit.client.3.smithi157.stderr: "Name":"nvme5", 2024-03-26T17:00:56.307 INFO:tasks.workunit.client.3.smithi157.stderr: "Transport":"tcp", 2024-03-26T17:00:56.307 INFO:tasks.workunit.client.3.smithi157.stderr: "Address":"traddr=172.21.15.44,trsvcid=4420,src_addr=172.21.15.157", 2024-03-26T17:00:56.307 INFO:tasks.workunit.client.3.smithi157.stderr: "State":"live" 2024-03-26T17:00:56.307 INFO:tasks.workunit.client.3.smithi157.stderr: } 2024-03-26T17:00:56.307 INFO:tasks.workunit.client.3.smithi157.stderr: ] 2024-03-26T17:00:56.307 INFO:tasks.workunit.client.3.smithi157.stderr: }, 2024-03-26T17:00:56.307 INFO:tasks.workunit.client.3.smithi157.stderr: { 2024-03-26T17:00:56.307 INFO:tasks.workunit.client.3.smithi157.stderr: "Name":"nvme-subsys2", 2024-03-26T17:00:56.307 INFO:tasks.workunit.client.3.smithi157.stderr: "NQN":"nqn.2016-06.io.spdk:cnode1", 2024-03-26T17:00:56.307 INFO:tasks.workunit.client.3.smithi157.stderr: "IOPolicy":"numa", 2024-03-26T17:00:56.308 INFO:tasks.workunit.client.3.smithi157.stderr: "Paths":[ 2024-03-26T17:00:56.308 INFO:tasks.workunit.client.3.smithi157.stderr: { 2024-03-26T17:00:56.308 INFO:tasks.workunit.client.3.smithi157.stderr: "Name":"nvme4", 2024-03-26T17:00:56.308 INFO:tasks.workunit.client.3.smithi157.stderr: "Transport":"tcp", 2024-03-26T17:00:56.308 INFO:tasks.workunit.client.3.smithi157.stderr: "Address":"traddr=172.21.15.149,trsvcid=4420,src_addr=172.21.15.157", 2024-03-26T17:00:56.308 INFO:tasks.workunit.client.3.smithi157.stderr: "State":"live" 2024-03-26T17:00:56.308 INFO:tasks.workunit.client.3.smithi157.stderr: }, 2024-03-26T17:00:56.308 INFO:tasks.workunit.client.3.smithi157.stderr: { 2024-03-26T17:00:56.308 INFO:tasks.workunit.client.3.smithi157.stderr: "Name":"nvme3", 2024-03-26T17:00:56.308 INFO:tasks.workunit.client.3.smithi157.stderr: "Transport":"tcp", 2024-03-26T17:00:56.308 INFO:tasks.workunit.client.3.smithi157.stderr: "Address":"traddr=172.21.15.64,trsvcid=4420,src_addr=172.21.15.157", 2024-03-26T17:00:56.308 INFO:tasks.workunit.client.3.smithi157.stderr: "State":"live" 2024-03-26T17:00:56.308 INFO:tasks.workunit.client.3.smithi157.stderr: }, 2024-03-26T17:00:56.308 INFO:tasks.workunit.client.3.smithi157.stderr: { 2024-03-26T17:00:56.308 INFO:tasks.workunit.client.3.smithi157.stderr: "Name":"nvme2", 2024-03-26T17:00:56.309 INFO:tasks.workunit.client.3.smithi157.stderr: "Transport":"tcp", 2024-03-26T17:00:56.309 INFO:tasks.workunit.client.3.smithi157.stderr: "Address":"traddr=172.21.15.44,trsvcid=4420,src_addr=172.21.15.157", 2024-03-26T17:00:56.309 INFO:tasks.workunit.client.3.smithi157.stderr: "State":"live" 2024-03-26T17:00:56.309 INFO:tasks.workunit.client.3.smithi157.stderr: } 2024-03-26T17:00:56.309 INFO:tasks.workunit.client.3.smithi157.stderr: ] 2024-03-26T17:00:56.309 INFO:tasks.workunit.client.3.smithi157.stderr: }, 2024-03-26T17:00:56.309 INFO:tasks.workunit.client.3.smithi157.stderr: { 2024-03-26T17:00:56.309 INFO:tasks.workunit.client.3.smithi157.stderr: "Name":"nvme-subsys8", 2024-03-26T17:00:56.309 INFO:tasks.workunit.client.3.smithi157.stderr: "NQN":"nqn.2016-06.io.spdk:cnode3", 2024-03-26T17:00:56.309 INFO:tasks.workunit.client.3.smithi157.stderr: "IOPolicy":"numa", 2024-03-26T17:00:56.309 INFO:tasks.workunit.client.3.smithi157.stderr: "Paths":[ 2024-03-26T17:00:56.309 INFO:tasks.workunit.client.3.smithi157.stderr: { 2024-03-26T17:00:56.309 INFO:tasks.workunit.client.3.smithi157.stderr: "Name":"nvme9", 2024-03-26T17:00:56.309 INFO:tasks.workunit.client.3.smithi157.stderr: "Transport":"tcp", 2024-03-26T17:00:56.309 INFO:tasks.workunit.client.3.smithi157.stderr: "Address":"traddr=172.21.15.64,trsvcid=4420,src_addr=172.21.15.157", 2024-03-26T17:00:56.309 INFO:tasks.workunit.client.3.smithi157.stderr: "State":"live" 2024-03-26T17:00:56.310 INFO:tasks.workunit.client.3.smithi157.stderr: }, 2024-03-26T17:00:56.310 INFO:tasks.workunit.client.3.smithi157.stderr: { 2024-03-26T17:00:56.310 INFO:tasks.workunit.client.3.smithi157.stderr: "Name":"nvme8", 2024-03-26T17:00:56.310 INFO:tasks.workunit.client.3.smithi157.stderr: "Transport":"tcp", 2024-03-26T17:00:56.310 INFO:tasks.workunit.client.3.smithi157.stderr: "Address":"traddr=172.21.15.44,trsvcid=4420,src_addr=172.21.15.157", 2024-03-26T17:00:56.310 INFO:tasks.workunit.client.3.smithi157.stderr: "State":"live" 2024-03-26T17:00:56.310 INFO:tasks.workunit.client.3.smithi157.stderr: }, 2024-03-26T17:00:56.310 INFO:tasks.workunit.client.3.smithi157.stderr: { 2024-03-26T17:00:56.310 INFO:tasks.workunit.client.3.smithi157.stderr: "Name":"nvme10", 2024-03-26T17:00:56.310 INFO:tasks.workunit.client.3.smithi157.stderr: "Transport":"tcp", 2024-03-26T17:00:56.310 INFO:tasks.workunit.client.3.smithi157.stderr: "Address":"traddr=172.21.15.149,trsvcid=4420,src_addr=172.21.15.157", 2024-03-26T17:00:56.310 INFO:tasks.workunit.client.3.smithi157.stderr: "State":"live" 2024-03-26T17:00:56.310 INFO:tasks.workunit.client.3.smithi157.stderr: } 2024-03-26T17:00:56.311 INFO:tasks.workunit.client.3.smithi157.stderr: ] 2024-03-26T17:00:56.311 INFO:tasks.workunit.client.3.smithi157.stderr: }, 2024-03-26T17:00:56.311 INFO:tasks.workunit.client.3.smithi157.stderr: { 2024-03-26T17:00:56.311 INFO:tasks.workunit.client.3.smithi157.stderr: "Name":"nvme-subsys0", 2024-03-26T17:00:56.311 INFO:tasks.workunit.client.3.smithi157.stderr: "NQN":"nqn.2014.08.org.nvmexpress:80868086PHMB7476002V480DGN INTEL SSDPED1D480GA", 2024-03-26T17:00:56.311 INFO:tasks.workunit.client.3.smithi157.stderr: "IOPolicy":"numa", 2024-03-26T17:00:56.311 INFO:tasks.workunit.client.3.smithi157.stderr: "Paths":[ 2024-03-26T17:00:56.311 INFO:tasks.workunit.client.3.smithi157.stderr: { 2024-03-26T17:00:56.311 INFO:tasks.workunit.client.3.smithi157.stderr: "Name":"nvme0", 2024-03-26T17:00:56.311 INFO:tasks.workunit.client.3.smithi157.stderr: "Transport":"pcie", 2024-03-26T17:00:56.311 INFO:tasks.workunit.client.3.smithi157.stderr: "Address":"0000:02:00.0", 2024-03-26T17:00:56.311 INFO:tasks.workunit.client.3.smithi157.stderr: "State":"live" 2024-03-26T17:00:56.311 INFO:tasks.workunit.client.3.smithi157.stderr: } 2024-03-26T17:00:56.311 INFO:tasks.workunit.client.3.smithi157.stderr: ] 2024-03-26T17:00:56.311 INFO:tasks.workunit.client.3.smithi157.stderr: } 2024-03-26T17:00:56.311 INFO:tasks.workunit.client.3.smithi157.stderr: ] 2024-03-26T17:00:56.311 INFO:tasks.workunit.client.3.smithi157.stderr: } 2024-03-26T17:00:56.312 INFO:tasks.workunit.client.3.smithi157.stderr:]' 2024-03-26T17:00:56.312 INFO:tasks.workunit.client.3.smithi157.stderr:++ grep -o '"tcp"' 2024-03-26T17:00:56.313 INFO:tasks.workunit.client.3.smithi157.stderr:++ echo '[' '{' '"HostNQN":"nqn.2014-08.org.nvmexpress:uuid:00000000-0000-0000-0000-0cc47a6bf610",' '"HostID":"8ff7e22f-06b9-47ef-9494-f6ca3bbef521",' '"Subsystems":[' '{' '"Name":"nvme-subsys5",' '"NQN":"nqn.2016-06.io.spdk:cnode2",' '"IOPolicy":"numa",' '"Paths":[' '{' '"Name":"nvme7",' '"Transport":"tcp",' '"Address":"traddr=172.21.15.149,trsvcid=4420,src_addr=172.21.15.157",' '"State":"live"' '},' '{' '"Name":"nvme6",' '"Transport":"tcp",' '"Address":"traddr=172.21.15.64,trsvcid=4420,src_addr=172.21.15.157",' '"State":"live"' '},' '{' '"Name":"nvme5",' '"Transport":"tcp",' '"Address":"traddr=172.21.15.44,trsvcid=4420,src_addr=172.21.15.157",' '"State":"live"' '}' ']' '},' '{' '"Name":"nvme-subsys2",' '"NQN":"nqn.2016-06.io.spdk:cnode1",' '"IOPolicy":"numa",' '"Paths":[' '{' '"Name":"nvme4",' '"Transport":"tcp",' '"Address":"traddr=172.21.15.149,trsvcid=4420,src_addr=172.21.15.157",' '"State":"live"' '},' '{' '"Name":"nvme3",' '"Transport":"tcp",' '"Address":"traddr=172.21.15.64,trsvcid=4420,src_addr=172.21.15.157",' '"State":"live"' '},' '{' '"Name":"nvme2",' '"Transport":"tcp",' '"Address":"traddr=172.21.15.44,trsvcid=4420,src_addr=172.21.15.157",' '"State":"live"' '}' ']' '},' '{' '"Name":"nvme-subsys8",' '"NQN":"nqn.2016-06.io.spdk:cnode3",' '"IOPolicy":"numa",' '"Paths":[' '{' '"Name":"nvme9",' '"Transport":"tcp",' '"Address":"traddr=172.21.15.64,trsvcid=4420,src_addr=172.21.15.157",' '"State":"live"' '},' '{' '"Name":"nvme8",' '"Transport":"tcp",' '"Address":"traddr=172.21.15.44,trsvcid=4420,src_addr=172.21.15.157",' '"State":"live"' '},' '{' '"Name":"nvme10",' '"Transport":"tcp",' '"Address":"traddr=172.21.15.149,trsvcid=4420,src_addr=172.21.15.157",' '"State":"live"' '}' ']' '},' '{' '"Name":"nvme-subsys0",' '"NQN":"nqn.2014.08.org.nvmexpress:80868086PHMB7476002V480DGN' INTEL 'SSDPED1D480GA",' '"IOPolicy":"numa",' '"Paths":[' '{' '"Name":"nvme0",' '"Transport":"pcie",' '"Address":"0000:02:00.0",' '"State":"live"' '}' ']' '}' ']' '}' ']' 2024-03-26T17:00:56.313 INFO:tasks.workunit.client.3.smithi157.stderr:++ wc -l 2024-03-26T17:00:56.313 INFO:tasks.workunit.client.3.smithi157.stderr:+ multipath=9 2024-03-26T17:00:56.313 INFO:tasks.workunit.client.3.smithi157.stderr:+ '[' 9 -ne 9 ']' 2024-03-26T17:00:56.313 INFO:tasks.workunit.client.3.smithi157.stderr:+ '[' 0 -eq 0 ']' 2024-03-26T17:00:56.313 INFO:tasks.workunit.client.3.smithi157.stdout:[nvmeof] list_subsys test passed! 2024-03-26T17:00:56.313 INFO:tasks.workunit.client.3.smithi157.stderr:+ echo '[nvmeof] list_subsys test passed!' 2024-03-26T17:00:56.314 INFO:tasks.workunit.client.3.smithi157.stdout:-------------Test Summary------------- 2024-03-26T17:00:56.314 INFO:tasks.workunit.client.3.smithi157.stderr:+ echo '-------------Test Summary-------------' 2024-03-26T17:00:56.314 INFO:tasks.workunit.client.3.smithi157.stdout:[nvmeof] All nvmeof basic tests passed! 2024-03-26T17:00:56.315 INFO:tasks.workunit.client.3.smithi157.stderr:+ echo '[nvmeof] All nvmeof basic tests passed!' 2024-03-26T17:00:56.315 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-03-26T17:00:56.315 DEBUG:teuthology.orchestra.run.smithi157:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.3/client.3/tmp 2024-03-26T17:00:56.383 INFO:tasks.workunit:Stopping ['rbd/nvmeof_setup_subsystem.sh', 'rbd/nvmeof_basic_tests.sh'] on client.3... 2024-03-26T17:00:56.384 DEBUG:teuthology.orchestra.run.smithi157:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.3 /home/ubuntu/cephtest/clone.client.3 2024-03-26T17:00:56.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:00:56 smithi064 ceph-mon[34420]: pgmap v428: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 29 KiB/s rd, 170 B/s wr, 8 op/s 2024-03-26T17:00:56.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:00:56 smithi149 ceph-mon[34678]: pgmap v428: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 29 KiB/s rd, 170 B/s wr, 8 op/s 2024-03-26T17:00:56.647 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:00:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 2024-03-26T17:00:56.208+0000 7fa707a55700 -1 mon.c@1(peon) e3 get_health_metrics reporting 3 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T17:00:56.647 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:00:56] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:00:56.647 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:00:56] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:00:56.647 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:00:56.697 DEBUG:teuthology.parallel:result is None 2024-03-26T17:00:56.697 DEBUG:teuthology.orchestra.run.smithi157:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.3/client.3 2024-03-26T17:00:56.726 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.3/client.3 2024-03-26T17:00:56.726 DEBUG:teuthology.orchestra.run.smithi157:> rmdir -- /home/ubuntu/cephtest/mnt.3 2024-03-26T17:00:56.793 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.3/client.3 2024-03-26T17:00:56.793 INFO:teuthology.run_tasks:Running task nvmeof.thrash... 2024-03-26T17:00:56.808 DEBUG:teuthology.orchestra.run.smithi157:> sudo nvme list --output-format=json | jq -r '.Devices | sort_by(.NameSpace) | .[] | select(.ModelNumber == "Ceph bdev Controller") | .DevicePath' 2024-03-26T17:00:56.876 INFO:teuthology.orchestra.run.smithi157.stdout:/dev/nvme5n1 2024-03-26T17:00:56.877 INFO:teuthology.orchestra.run.smithi157.stdout:/dev/nvme2n1 2024-03-26T17:00:56.877 INFO:teuthology.orchestra.run.smithi157.stdout:/dev/nvme8n1 2024-03-26T17:00:56.877 INFO:teuthology.orchestra.run.smithi157.stdout:/dev/nvme5n2 2024-03-26T17:00:56.877 INFO:teuthology.orchestra.run.smithi157.stdout:/dev/nvme2n2 2024-03-26T17:00:56.877 INFO:teuthology.orchestra.run.smithi157.stdout:/dev/nvme8n2 2024-03-26T17:00:56.877 INFO:teuthology.orchestra.run.smithi157.stdout:/dev/nvme5n3 2024-03-26T17:00:56.877 INFO:teuthology.orchestra.run.smithi157.stdout:/dev/nvme2n3 2024-03-26T17:00:56.877 INFO:teuthology.orchestra.run.smithi157.stdout:/dev/nvme8n3 2024-03-26T17:00:56.877 INFO:teuthology.orchestra.run.smithi157.stdout:/dev/nvme5n4 2024-03-26T17:00:56.877 INFO:teuthology.orchestra.run.smithi157.stdout:/dev/nvme2n4 2024-03-26T17:00:56.877 INFO:teuthology.orchestra.run.smithi157.stdout:/dev/nvme8n4 2024-03-26T17:00:56.877 INFO:teuthology.orchestra.run.smithi157.stdout:/dev/nvme5n5 2024-03-26T17:00:56.877 INFO:teuthology.orchestra.run.smithi157.stdout:/dev/nvme2n5 2024-03-26T17:00:56.877 INFO:teuthology.orchestra.run.smithi157.stdout:/dev/nvme8n5 2024-03-26T17:00:56.878 INFO:teuthology.orchestra.run.smithi157.stdout:/dev/nvme5n6 2024-03-26T17:00:56.878 INFO:teuthology.orchestra.run.smithi157.stdout:/dev/nvme2n6 2024-03-26T17:00:56.878 INFO:teuthology.orchestra.run.smithi157.stdout:/dev/nvme8n6 2024-03-26T17:00:56.878 INFO:teuthology.orchestra.run.smithi157.stdout:/dev/nvme5n7 2024-03-26T17:00:56.878 INFO:teuthology.orchestra.run.smithi157.stdout:/dev/nvme2n7 2024-03-26T17:00:56.878 INFO:teuthology.orchestra.run.smithi157.stdout:/dev/nvme8n7 2024-03-26T17:00:56.878 INFO:teuthology.orchestra.run.smithi157.stdout:/dev/nvme5n8 2024-03-26T17:00:56.878 INFO:teuthology.orchestra.run.smithi157.stdout:/dev/nvme2n8 2024-03-26T17:00:56.878 INFO:teuthology.orchestra.run.smithi157.stdout:/dev/nvme8n8 2024-03-26T17:00:56.878 INFO:teuthology.orchestra.run.smithi157.stdout:/dev/nvme5n9 2024-03-26T17:00:56.878 INFO:teuthology.orchestra.run.smithi157.stdout:/dev/nvme2n9 2024-03-26T17:00:56.878 INFO:teuthology.orchestra.run.smithi157.stdout:/dev/nvme8n9 2024-03-26T17:00:56.878 INFO:teuthology.orchestra.run.smithi157.stdout:/dev/nvme5n10 2024-03-26T17:00:56.879 INFO:teuthology.orchestra.run.smithi157.stdout:/dev/nvme2n10 2024-03-26T17:00:56.879 INFO:teuthology.orchestra.run.smithi157.stdout:/dev/nvme8n10 2024-03-26T17:00:56.879 INFO:teuthology.orchestra.run.smithi157.stdout:/dev/nvme5n11 2024-03-26T17:00:56.879 INFO:teuthology.orchestra.run.smithi157.stdout:/dev/nvme2n11 2024-03-26T17:00:56.879 INFO:teuthology.orchestra.run.smithi157.stdout:/dev/nvme8n11 2024-03-26T17:00:56.879 INFO:teuthology.orchestra.run.smithi157.stdout:/dev/nvme5n12 2024-03-26T17:00:56.879 INFO:teuthology.orchestra.run.smithi157.stdout:/dev/nvme2n12 2024-03-26T17:00:56.879 INFO:teuthology.orchestra.run.smithi157.stdout:/dev/nvme8n12 2024-03-26T17:00:56.879 INFO:teuthology.orchestra.run.smithi157.stdout:/dev/nvme5n13 2024-03-26T17:00:56.879 INFO:teuthology.orchestra.run.smithi157.stdout:/dev/nvme2n13 2024-03-26T17:00:56.879 INFO:teuthology.orchestra.run.smithi157.stdout:/dev/nvme8n13 2024-03-26T17:00:56.879 INFO:teuthology.orchestra.run.smithi157.stdout:/dev/nvme5n14 2024-03-26T17:00:56.880 INFO:teuthology.orchestra.run.smithi157.stdout:/dev/nvme2n14 2024-03-26T17:00:56.880 INFO:teuthology.orchestra.run.smithi157.stdout:/dev/nvme8n14 2024-03-26T17:00:56.880 INFO:teuthology.orchestra.run.smithi157.stdout:/dev/nvme5n15 2024-03-26T17:00:56.880 INFO:teuthology.orchestra.run.smithi157.stdout:/dev/nvme2n15 2024-03-26T17:00:56.880 INFO:teuthology.orchestra.run.smithi157.stdout:/dev/nvme8n15 2024-03-26T17:00:56.880 INFO:teuthology.orchestra.run.smithi157.stdout:/dev/nvme5n16 2024-03-26T17:00:56.880 INFO:teuthology.orchestra.run.smithi157.stdout:/dev/nvme2n16 2024-03-26T17:00:56.880 INFO:teuthology.orchestra.run.smithi157.stdout:/dev/nvme8n16 2024-03-26T17:00:56.880 INFO:teuthology.orchestra.run.smithi157.stdout:/dev/nvme5n17 2024-03-26T17:00:56.880 INFO:teuthology.orchestra.run.smithi157.stdout:/dev/nvme2n17 2024-03-26T17:00:56.880 INFO:teuthology.orchestra.run.smithi157.stdout:/dev/nvme8n17 2024-03-26T17:00:56.880 INFO:teuthology.orchestra.run.smithi157.stdout:/dev/nvme5n18 2024-03-26T17:00:56.880 INFO:teuthology.orchestra.run.smithi157.stdout:/dev/nvme2n18 2024-03-26T17:00:56.880 INFO:teuthology.orchestra.run.smithi157.stdout:/dev/nvme8n18 2024-03-26T17:00:56.880 INFO:teuthology.orchestra.run.smithi157.stdout:/dev/nvme5n19 2024-03-26T17:00:56.881 INFO:teuthology.orchestra.run.smithi157.stdout:/dev/nvme2n19 2024-03-26T17:00:56.881 INFO:teuthology.orchestra.run.smithi157.stdout:/dev/nvme8n19 2024-03-26T17:00:56.881 INFO:teuthology.orchestra.run.smithi157.stdout:/dev/nvme5n20 2024-03-26T17:00:56.881 INFO:teuthology.orchestra.run.smithi157.stdout:/dev/nvme2n20 2024-03-26T17:00:56.881 INFO:teuthology.orchestra.run.smithi157.stdout:/dev/nvme8n20 2024-03-26T17:00:56.881 INFO:teuthology.run_tasks:Running task workunit... 2024-03-26T17:00:56.890 INFO:tasks.workunit:Pulling workunits from ref b4c4828f419f1247fc297e8069c1036b1d6151f2 2024-03-26T17:00:56.891 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-03-26T17:00:56.891 DEBUG:teuthology.orchestra.run.smithi157:> stat -- /home/ubuntu/cephtest/mnt.3 2024-03-26T17:00:56.891 INFO:tasks.nvmeof.[nvmeof.thrasher]:start thrashing 2024-03-26T17:00:56.891 INFO:tasks.nvmeof.[nvmeof.thrasher]:seed: 1711472456, , max thrash delay: 90, min thrash delay: 60 max revive delay: 10, min revive delay: 0 daemons: 3 2024-03-26T17:00:56.891 INFO:tasks.nvmeof.[nvmeof.thrasher]:waiting for 79 secs before thrashing 2024-03-26T17:00:56.931 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-26T17:00:56.932 INFO:teuthology.orchestra.run.smithi157.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.3': No such file or directory 2024-03-26T17:00:56.932 DEBUG:teuthology.orchestra.run.smithi157:> mkdir -- /home/ubuntu/cephtest/mnt.3 2024-03-26T17:00:56.986 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.3 2024-03-26T17:00:56.986 DEBUG:teuthology.orchestra.run.smithi157:> cd -- /home/ubuntu/cephtest/mnt.3 && mkdir -- client.3 2024-03-26T17:00:57.041 INFO:tasks.workunit:timeout=3h 2024-03-26T17:00:57.041 INFO:tasks.workunit:cleanup=True 2024-03-26T17:00:57.041 DEBUG:teuthology.orchestra.run.smithi157:> rm -rf /home/ubuntu/cephtest/clone.client.3 && git clone https://github.com/vallariag/ceph.git /home/ubuntu/cephtest/clone.client.3 && cd /home/ubuntu/cephtest/clone.client.3 && git checkout b4c4828f419f1247fc297e8069c1036b1d6151f2 2024-03-26T17:00:57.096 INFO:tasks.workunit.client.3.smithi157.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.3'... 2024-03-26T17:00:57.457 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:57 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:00:57] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:00:57.457 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:57 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:00:57] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:00:57.457 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:57 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:00:58.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:00:58 smithi044 ceph-mon[30624]: pgmap v429: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 28 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2024-03-26T17:00:58.265 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:57 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:57] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:00:58.266 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:57 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:57] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:00:58.266 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:57 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:00:58.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:00:58 smithi064 ceph-mon[34420]: pgmap v429: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 28 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2024-03-26T17:00:58.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:00:58 smithi149 ceph-mon[34678]: pgmap v429: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 28 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2024-03-26T17:00:58.646 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:58 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:00:58] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:00:58.647 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:58 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:00:58] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:00:58.647 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:00:58 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:00:59.457 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:00:59 smithi064 ceph-mon[34420]: Health check update: 7 slow ops, oldest one blocked for 153 sec, daemons [mon.b,mon.c] have slow ops. (SLOW_OPS) 2024-03-26T17:00:59.457 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:59 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:00:59] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:00:59.457 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:59 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:00:59] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:00:59.457 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:00:59 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:00:59.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:00:59 smithi044 ceph-mon[30624]: Health check update: 7 slow ops, oldest one blocked for 153 sec, daemons [mon.b,mon.c] have slow ops. (SLOW_OPS) 2024-03-26T17:00:59.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:00:59 smithi149 ceph-mon[34678]: Health check update: 7 slow ops, oldest one blocked for 153 sec, daemons [mon.b,mon.c] have slow ops. (SLOW_OPS) 2024-03-26T17:01:00.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:01:00 smithi044 ceph-mon[30624]: pgmap v430: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 54 KiB/s rd, 2.3 KiB/s wr, 9 op/s 2024-03-26T17:01:00.265 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:00:59 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:00:59] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:01:00.265 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:01:00 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:01:00] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:01:00.266 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:01:00 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:01:00.547 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:01:00 smithi149 ceph-mon[34678]: pgmap v430: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 54 KiB/s rd, 2.3 KiB/s wr, 9 op/s 2024-03-26T17:01:00.548 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:01:00 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:01:00] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:01:00.548 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:01:00 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:01:00] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:01:00.548 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:01:00 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:01:00.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:01:00 smithi064 ceph-mon[34420]: pgmap v430: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 54 KiB/s rd, 2.3 KiB/s wr, 9 op/s 2024-03-26T17:01:00.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:01:00 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-b[34416]: 2024-03-26T17:01:00.281+0000 7ff022916700 -1 mon.b@2(peon) e3 get_health_metrics reporting 4 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T17:01:01.457 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:01:01 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:01:01] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:01:01.457 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:01:01 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:01:01] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:01:01.458 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:01:01 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:01:01.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:01:01 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 2024-03-26T17:01:01.208+0000 7fa707a55700 -1 mon.c@1(peon) e3 get_health_metrics reporting 3 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T17:01:02.201 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:01:02 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:01:02] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:01:02.201 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:01:02 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:01:02] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:01:02.201 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:01:02 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:01:02.343 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:01:02 smithi149 ceph-mon[34678]: pgmap v431: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 42 KiB/s rd, 2.6 KiB/s wr, 8 op/s 2024-03-26T17:01:02.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:01:02 smithi044 ceph-mon[30624]: pgmap v431: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 42 KiB/s rd, 2.6 KiB/s wr, 8 op/s 2024-03-26T17:01:02.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:01:02 smithi064 ceph-mon[34420]: pgmap v431: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 42 KiB/s rd, 2.6 KiB/s wr, 8 op/s 2024-03-26T17:01:02.646 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:01:02 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:01:02] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:01:02.646 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:01:02 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:01:02] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:01:02.646 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:01:02 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:01:03.457 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:01:03 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:01:03] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:01:03.457 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:01:03 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:01:03] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:01:03.457 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:01:03 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:01:03.805 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:01:03 smithi064 ceph-mon[34420]: Health check update: 7 slow ops, oldest one blocked for 158 sec, daemons [mon.b,mon.c] have slow ops. (SLOW_OPS) 2024-03-26T17:01:03.896 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:01:03 smithi149 ceph-mon[34678]: Health check update: 7 slow ops, oldest one blocked for 158 sec, daemons [mon.b,mon.c] have slow ops. (SLOW_OPS) 2024-03-26T17:01:04.015 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:01:03 smithi044 ceph-mon[30624]: Health check update: 7 slow ops, oldest one blocked for 158 sec, daemons [mon.b,mon.c] have slow ops. (SLOW_OPS) 2024-03-26T17:01:04.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:01:04 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:01:04] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:01:04.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:01:04 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:01:04] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:01:04.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:01:04 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:01:04.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:01:04 smithi149 ceph-mon[34678]: pgmap v432: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 54 KiB/s rd, 2.6 KiB/s wr, 9 op/s 2024-03-26T17:01:04.647 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:01:04 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:01:04] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:01:04.647 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:01:04 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:01:04] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:01:04.648 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:01:04 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:01:05.015 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:01:04 smithi044 ceph-mon[30624]: pgmap v432: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 54 KiB/s rd, 2.6 KiB/s wr, 9 op/s 2024-03-26T17:01:05.055 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:01:04 smithi064 ceph-mon[34420]: pgmap v432: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 54 KiB/s rd, 2.6 KiB/s wr, 9 op/s 2024-03-26T17:01:05.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:01:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-b[34416]: 2024-03-26T17:01:05.281+0000 7ff022916700 -1 mon.b@2(peon) e3 get_health_metrics reporting 4 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T17:01:05.556 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:01:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:01:05] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:01:05.556 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:01:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:01:05] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:01:05.556 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:01:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:01:06.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:01:06 smithi044 ceph-mon[30624]: pgmap v433: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 42 KiB/s rd, 2.6 KiB/s wr, 8 op/s 2024-03-26T17:01:06.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:01:06 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:01:06] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:01:06.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:01:06 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:01:06] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:01:06.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:01:06 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:01:06.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:01:06 smithi064 ceph-mon[34420]: pgmap v433: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 42 KiB/s rd, 2.6 KiB/s wr, 8 op/s 2024-03-26T17:01:06.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:01:06 smithi149 ceph-mon[34678]: pgmap v433: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 42 KiB/s rd, 2.6 KiB/s wr, 8 op/s 2024-03-26T17:01:06.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:01:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 2024-03-26T17:01:06.208+0000 7fa707a55700 -1 mon.c@1(peon) e3 get_health_metrics reporting 3 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T17:01:06.647 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:01:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:01:06] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:01:06.647 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:01:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:01:06] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:01:06.647 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:01:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:01:07.457 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:01:07 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:01:07] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:01:07.457 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:01:07 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:01:07] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:01:07.457 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:01:07 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:01:08.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:01:08 smithi044 ceph-mon[30624]: pgmap v434: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 42 KiB/s rd, 2.5 KiB/s wr, 8 op/s 2024-03-26T17:01:08.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:01:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:01:08] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:01:08.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:01:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:01:08] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:01:08.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:01:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:01:08.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:01:08 smithi064 ceph-mon[34420]: pgmap v434: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 42 KiB/s rd, 2.5 KiB/s wr, 8 op/s 2024-03-26T17:01:08.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:01:08 smithi149 ceph-mon[34678]: pgmap v434: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 42 KiB/s rd, 2.5 KiB/s wr, 8 op/s 2024-03-26T17:01:08.646 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:01:08 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:01:08] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:01:08.646 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:01:08 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:01:08] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:01:08.646 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:01:08 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:01:09.457 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:01:09 smithi064 ceph-mon[34420]: Health check update: 7 slow ops, oldest one blocked for 163 sec, daemons [mon.b,mon.c] have slow ops. (SLOW_OPS) 2024-03-26T17:01:09.457 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:01:09 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:01:09] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:01:09.457 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:01:09 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:01:09] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:01:09.457 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:01:09 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:01:09.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:01:09 smithi044 ceph-mon[30624]: Health check update: 7 slow ops, oldest one blocked for 163 sec, daemons [mon.b,mon.c] have slow ops. (SLOW_OPS) 2024-03-26T17:01:09.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:01:09 smithi149 ceph-mon[34678]: Health check update: 7 slow ops, oldest one blocked for 163 sec, daemons [mon.b,mon.c] have slow ops. (SLOW_OPS) 2024-03-26T17:01:10.416 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:01:10 smithi044 ceph-mon[30624]: pgmap v435: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 54 KiB/s rd, 1.5 KiB/s wr, 7 op/s 2024-03-26T17:01:10.417 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:01:10 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:01:10] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:01:10.417 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:01:10 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:01:10] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:01:10.417 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:01:10 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:01:10.547 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:01:10 smithi149 ceph-mon[34678]: pgmap v435: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 54 KiB/s rd, 1.5 KiB/s wr, 7 op/s 2024-03-26T17:01:10.548 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:01:10 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:01:10] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:01:10.548 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:01:10 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:01:10] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:01:10.548 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:01:10 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:01:10.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:01:10 smithi064 ceph-mon[34420]: pgmap v435: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 54 KiB/s rd, 1.5 KiB/s wr, 7 op/s 2024-03-26T17:01:10.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:01:10 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-b[34416]: 2024-03-26T17:01:10.282+0000 7ff022916700 -1 mon.b@2(peon) e3 get_health_metrics reporting 4 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T17:01:11.556 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:01:11 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:01:11] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:01:11.556 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:01:11 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:01:11] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:01:11.556 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:01:11 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:01:11.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:01:11 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 2024-03-26T17:01:11.207+0000 7fa707a55700 -1 mon.c@1(peon) e3 get_health_metrics reporting 3 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T17:01:12.413 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:01:12 smithi149 ceph-mon[34678]: pgmap v436: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 23 KiB/s rd, 255 B/s wr, 2 op/s 2024-03-26T17:01:12.414 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:01:12 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:01:12] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:01:12.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:01:12 smithi044 ceph-mon[30624]: pgmap v436: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 23 KiB/s rd, 255 B/s wr, 2 op/s 2024-03-26T17:01:12.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:01:12 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:01:12] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:01:12.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:01:12 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:01:12] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:01:12.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:01:12 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:01:12.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:01:12 smithi064 ceph-mon[34420]: pgmap v436: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 23 KiB/s rd, 255 B/s wr, 2 op/s 2024-03-26T17:01:12.646 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:01:12 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:01:12] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:01:12.646 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:01:12 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:01:13.556 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:01:13 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:01:13] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:01:13.556 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:01:13 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:01:13] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:01:13.556 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:01:13 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:01:13.896 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:01:13 smithi149 ceph-mon[34678]: Health check update: 7 slow ops, oldest one blocked for 168 sec, daemons [mon.b,mon.c] have slow ops. (SLOW_OPS) 2024-03-26T17:01:14.014 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:01:13 smithi044 ceph-mon[30624]: Health check update: 7 slow ops, oldest one blocked for 168 sec, daemons [mon.b,mon.c] have slow ops. (SLOW_OPS) 2024-03-26T17:01:14.055 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:01:13 smithi064 ceph-mon[34420]: Health check update: 7 slow ops, oldest one blocked for 168 sec, daemons [mon.b,mon.c] have slow ops. (SLOW_OPS) 2024-03-26T17:01:14.094 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:01:14 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:01:14] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:01:14.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:01:14 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:01:14] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:01:14.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:01:14 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:01:14.797 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:01:14 smithi149 ceph-mon[34678]: pgmap v437: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 34 KiB/s rd, 2 op/s 2024-03-26T17:01:14.798 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:01:14 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:01:14] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:01:14.798 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:01:14 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:01:14] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:01:14.798 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:01:14 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:01:15.015 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:01:14 smithi044 ceph-mon[30624]: pgmap v437: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 34 KiB/s rd, 2 op/s 2024-03-26T17:01:15.055 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:01:14 smithi064 ceph-mon[34420]: pgmap v437: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 34 KiB/s rd, 2 op/s 2024-03-26T17:01:15.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:01:15 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-b[34416]: 2024-03-26T17:01:15.282+0000 7ff022916700 -1 mon.b@2(peon) e3 get_health_metrics reporting 4 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T17:01:15.556 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:01:15 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:01:15] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:01:15.556 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:01:15 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:01:15] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:01:15.556 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:01:15 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:01:16.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:01:16 smithi044 ceph-mon[30624]: pgmap v438: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 23 KiB/s rd, 1 op/s 2024-03-26T17:01:16.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:01:16 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:01:16] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:01:16.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:01:16 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:01:16] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:01:16.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:01:16 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:01:16.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:01:16 smithi064 ceph-mon[34420]: pgmap v438: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 23 KiB/s rd, 1 op/s 2024-03-26T17:01:16.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:01:16 smithi149 ceph-mon[34678]: pgmap v438: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 23 KiB/s rd, 1 op/s 2024-03-26T17:01:16.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:01:16 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 2024-03-26T17:01:16.209+0000 7fa707a55700 -1 mon.c@1(peon) e3 get_health_metrics reporting 3 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T17:01:16.646 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:01:16 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:01:16] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:01:16.646 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:01:16 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:01:16] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:01:16.647 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:01:16 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:01:17.556 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:01:17 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:01:17] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:01:17.556 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:01:17 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:01:17] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:01:17.556 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:01:17 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:01:18.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:01:18 smithi044 ceph-mon[30624]: pgmap v439: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 23 KiB/s rd, 1 op/s 2024-03-26T17:01:18.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:01:18 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:01:18] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:01:18.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:01:18 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:01:18] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:01:18.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:01:18 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:01:18.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:01:18 smithi064 ceph-mon[34420]: pgmap v439: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 23 KiB/s rd, 1 op/s 2024-03-26T17:01:18.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:01:18 smithi149 ceph-mon[34678]: pgmap v439: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 23 KiB/s rd, 1 op/s 2024-03-26T17:01:18.646 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:01:18 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:01:18] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:01:18.647 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:01:18 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:01:18] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:01:18.647 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:01:18 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:01:19.457 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:01:19 smithi064 ceph-mon[34420]: Health check update: 7 slow ops, oldest one blocked for 173 sec, daemons [mon.b,mon.c] have slow ops. (SLOW_OPS) 2024-03-26T17:01:19.457 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:01:19 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:01:19] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:01:19.458 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:01:19 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:01:19] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:01:19.458 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:01:19 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:01:19.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:01:19 smithi044 ceph-mon[30624]: Health check update: 7 slow ops, oldest one blocked for 173 sec, daemons [mon.b,mon.c] have slow ops. (SLOW_OPS) 2024-03-26T17:01:19.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:01:19 smithi149 ceph-mon[34678]: Health check update: 7 slow ops, oldest one blocked for 173 sec, daemons [mon.b,mon.c] have slow ops. (SLOW_OPS) 2024-03-26T17:01:20.416 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:01:20 smithi044 ceph-mon[30624]: pgmap v440: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 34 KiB/s rd, 2 op/s 2024-03-26T17:01:20.417 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:01:20 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:01:20] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:01:20.417 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:01:20 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:01:20] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:01:20.417 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:01:20 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:01:20.452 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:01:20 smithi149 ceph-mon[34678]: pgmap v440: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 34 KiB/s rd, 2 op/s 2024-03-26T17:01:20.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:01:20 smithi064 ceph-mon[34420]: pgmap v440: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 34 KiB/s rd, 2 op/s 2024-03-26T17:01:20.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:01:20 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-b[34416]: 2024-03-26T17:01:20.282+0000 7ff022916700 -1 mon.b@2(peon) e3 get_health_metrics reporting 4 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T17:01:20.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:01:20 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:01:20] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:01:20.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:01:20 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:01:20] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:01:20.897 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:01:20 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:01:21.556 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:01:21 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:01:21] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:01:21.556 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:01:21 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:01:21] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:01:21.556 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:01:21 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:01:21.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:01:21 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 2024-03-26T17:01:21.209+0000 7fa707a55700 -1 mon.c@1(peon) e3 get_health_metrics reporting 3 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T17:01:22.464 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:01:22 smithi149 ceph-mon[34678]: pgmap v441: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 23 KiB/s rd, 1 op/s 2024-03-26T17:01:22.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:01:22 smithi044 ceph-mon[30624]: pgmap v441: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 23 KiB/s rd, 1 op/s 2024-03-26T17:01:22.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:01:22 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:01:22] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:01:22.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:01:22 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:01:22] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:01:22.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:01:22 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:01:22.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:01:22 smithi064 ceph-mon[34420]: pgmap v441: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 23 KiB/s rd, 1 op/s 2024-03-26T17:01:22.897 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:01:22 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:01:22] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:01:22.898 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:01:22 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:01:22] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:01:22.898 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:01:22 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:01:23.556 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:01:23 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:01:23] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:01:23.556 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:01:23 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:01:23] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:01:23.556 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:01:23 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:01:23.896 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:01:23 smithi149 ceph-mon[34678]: Health check update: 7 slow ops, oldest one blocked for 178 sec, daemons [mon.b,mon.c] have slow ops. (SLOW_OPS) 2024-03-26T17:01:24.015 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:01:23 smithi044 ceph-mon[30624]: Health check update: 7 slow ops, oldest one blocked for 178 sec, daemons [mon.b,mon.c] have slow ops. (SLOW_OPS) 2024-03-26T17:01:24.055 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:01:23 smithi064 ceph-mon[34420]: Health check update: 7 slow ops, oldest one blocked for 178 sec, daemons [mon.b,mon.c] have slow ops. (SLOW_OPS) 2024-03-26T17:01:24.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:01:24 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:01:24] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:01:24.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:01:24 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:01:24] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:01:24.517 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:01:24 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:01:24.797 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:01:24 smithi149 ceph-mon[34678]: pgmap v442: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 34 KiB/s rd, 2 op/s 2024-03-26T17:01:24.798 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:01:24 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:01:24] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:01:24.798 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:01:24 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:01:24] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:01:24.798 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:01:24 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:01:25.015 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:01:24 smithi044 ceph-mon[30624]: pgmap v442: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 34 KiB/s rd, 2 op/s 2024-03-26T17:01:25.056 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:01:24 smithi064 ceph-mon[34420]: pgmap v442: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 34 KiB/s rd, 2 op/s 2024-03-26T17:01:25.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:01:25 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-b[34416]: 2024-03-26T17:01:25.284+0000 7ff022916700 -1 mon.b@2(peon) e3 get_health_metrics reporting 4 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T17:01:25.556 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:01:25 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:01:25] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:01:25.556 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:01:25 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:01:25] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:01:25.556 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:01:25 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:01:26.488 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:01:26 smithi149 ceph-mon[34678]: pgmap v443: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 23 KiB/s rd, 1 op/s 2024-03-26T17:01:26.489 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:01:26 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 2024-03-26T17:01:26.209+0000 7fa707a55700 -1 mon.c@1(peon) e3 get_health_metrics reporting 3 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T17:01:26.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:01:26 smithi044 ceph-mon[30624]: pgmap v443: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 23 KiB/s rd, 1 op/s 2024-03-26T17:01:26.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:01:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:01:26] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:01:26.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:01:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:01:26] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:01:26.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:01:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:01:26.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:01:26 smithi064 ceph-mon[34420]: pgmap v443: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 23 KiB/s rd, 1 op/s 2024-03-26T17:01:26.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:01:26 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:01:26] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:01:26.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:01:26 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:01:26] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:01:26.897 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:01:26 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:01:27.556 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:01:27 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:01:27] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:01:27.556 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:01:27 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:01:27] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:01:27.556 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:01:27 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:01:28.501 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:01:28 smithi149 ceph-mon[34678]: pgmap v444: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 23 KiB/s rd, 1 op/s 2024-03-26T17:01:28.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:01:28 smithi044 ceph-mon[30624]: pgmap v444: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 23 KiB/s rd, 1 op/s 2024-03-26T17:01:28.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:01:28 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:01:28] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:01:28.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:01:28 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:01:28] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:01:28.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:01:28 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:01:28.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:01:28 smithi064 ceph-mon[34420]: pgmap v444: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 23 KiB/s rd, 1 op/s 2024-03-26T17:01:28.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:01:28 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:01:28] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:01:28.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:01:28 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:01:28] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:01:28.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:01:28 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:01:29.457 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:01:29 smithi064 ceph-mon[34420]: Health check update: 7 slow ops, oldest one blocked for 183 sec, daemons [mon.b,mon.c] have slow ops. (SLOW_OPS) 2024-03-26T17:01:29.457 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:01:29 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:01:29] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:01:29.457 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:01:29 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:01:29] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:01:29.457 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:01:29 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:01:29.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:01:29 smithi044 ceph-mon[30624]: Health check update: 7 slow ops, oldest one blocked for 183 sec, daemons [mon.b,mon.c] have slow ops. (SLOW_OPS) 2024-03-26T17:01:29.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:01:29 smithi149 ceph-mon[34678]: Health check update: 7 slow ops, oldest one blocked for 183 sec, daemons [mon.b,mon.c] have slow ops. (SLOW_OPS) 2024-03-26T17:01:30.513 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:01:30 smithi149 ceph-mon[34678]: pgmap v445: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 34 KiB/s rd, 2 op/s 2024-03-26T17:01:30.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:01:30 smithi044 ceph-mon[30624]: pgmap v445: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 34 KiB/s rd, 2 op/s 2024-03-26T17:01:30.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:01:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:01:30] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:01:30.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:01:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:01:30] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:01:30.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:01:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:01:30.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:01:30 smithi064 ceph-mon[34420]: pgmap v445: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 34 KiB/s rd, 2 op/s 2024-03-26T17:01:30.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:01:30 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-b[34416]: 2024-03-26T17:01:30.283+0000 7ff022916700 -1 mon.b@2(peon) e3 get_health_metrics reporting 4 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T17:01:30.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:01:30 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:01:30] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:01:30.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:01:30 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:01:30] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:01:30.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:01:30 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:01:31.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:01:31 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 2024-03-26T17:01:31.209+0000 7fa707a55700 -1 mon.c@1(peon) e3 get_health_metrics reporting 3 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T17:01:31.806 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:01:31 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:01:31] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:01:31.806 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:01:31 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:01:31] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:01:31.806 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:01:31 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:01:32.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:01:32 smithi044 ceph-mon[30624]: pgmap v446: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 23 KiB/s rd, 1 op/s 2024-03-26T17:01:32.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:01:32 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:01:32] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:01:32.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:01:32 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:01:32] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:01:32.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:01:32 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:01:32.525 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:01:32 smithi149 ceph-mon[34678]: pgmap v446: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 23 KiB/s rd, 1 op/s 2024-03-26T17:01:32.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:01:32 smithi064 ceph-mon[34420]: pgmap v446: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 23 KiB/s rd, 1 op/s 2024-03-26T17:01:32.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:01:32 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:01:32] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:01:32.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:01:32 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:01:32] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:01:32.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:01:32 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:01:33.595 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:01:33 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:01:33] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:01:33.595 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:01:33 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:01:33] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:01:33.596 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:01:33 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:01:33.896 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:01:33 smithi149 ceph-mon[34678]: Health check update: 7 slow ops, oldest one blocked for 188 sec, daemons [mon.b,mon.c] have slow ops. (SLOW_OPS) 2024-03-26T17:01:34.015 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:01:33 smithi044 ceph-mon[30624]: Health check update: 7 slow ops, oldest one blocked for 188 sec, daemons [mon.b,mon.c] have slow ops. (SLOW_OPS) 2024-03-26T17:01:34.055 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:01:33 smithi064 ceph-mon[34420]: Health check update: 7 slow ops, oldest one blocked for 188 sec, daemons [mon.b,mon.c] have slow ops. (SLOW_OPS) 2024-03-26T17:01:34.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:01:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:01:34] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:01:34.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:01:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:01:34] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:01:34.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:01:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:01:34.761 INFO:tasks.workunit.client.3.smithi157.stderr:Note: switching to 'b4c4828f419f1247fc297e8069c1036b1d6151f2'. 2024-03-26T17:01:34.761 INFO:tasks.workunit.client.3.smithi157.stderr: 2024-03-26T17:01:34.761 INFO:tasks.workunit.client.3.smithi157.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-03-26T17:01:34.761 INFO:tasks.workunit.client.3.smithi157.stderr:changes and commit them, and you can discard any commits you make in this 2024-03-26T17:01:34.761 INFO:tasks.workunit.client.3.smithi157.stderr:state without impacting any branches by switching back to a branch. 2024-03-26T17:01:34.761 INFO:tasks.workunit.client.3.smithi157.stderr: 2024-03-26T17:01:34.761 INFO:tasks.workunit.client.3.smithi157.stderr:If you want to create a new branch to retain commits you create, you may 2024-03-26T17:01:34.761 INFO:tasks.workunit.client.3.smithi157.stderr:do so (now or later) by using -c with the switch command. Example: 2024-03-26T17:01:34.761 INFO:tasks.workunit.client.3.smithi157.stderr: 2024-03-26T17:01:34.762 INFO:tasks.workunit.client.3.smithi157.stderr: git switch -c 2024-03-26T17:01:34.762 INFO:tasks.workunit.client.3.smithi157.stderr: 2024-03-26T17:01:34.762 INFO:tasks.workunit.client.3.smithi157.stderr:Or undo this operation with: 2024-03-26T17:01:34.762 INFO:tasks.workunit.client.3.smithi157.stderr: 2024-03-26T17:01:34.762 INFO:tasks.workunit.client.3.smithi157.stderr: git switch - 2024-03-26T17:01:34.762 INFO:tasks.workunit.client.3.smithi157.stderr: 2024-03-26T17:01:34.762 INFO:tasks.workunit.client.3.smithi157.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-03-26T17:01:34.762 INFO:tasks.workunit.client.3.smithi157.stderr: 2024-03-26T17:01:34.762 INFO:tasks.workunit.client.3.smithi157.stderr:HEAD is now at b4c4828f419 use latest build 2024-03-26T17:01:34.766 DEBUG:teuthology.orchestra.run.smithi157:> cd -- /home/ubuntu/cephtest/clone.client.3/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.3 2024-03-26T17:01:34.797 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:01:34 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-26T17:01:34.797 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:01:34 smithi149 ceph-mon[34678]: pgmap v447: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 34 KiB/s rd, 2 op/s 2024-03-26T17:01:34.798 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:01:34 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:01:34] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:01:34.798 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:01:34 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:01:34] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:01:34.798 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:01:34 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:01:34.821 INFO:tasks.workunit.client.3.smithi157.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-03-26T17:01:34.823 INFO:tasks.workunit.client.3.smithi157.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.3/qa/workunits/direct_io' 2024-03-26T17:01:34.823 INFO:tasks.workunit.client.3.smithi157.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-03-26T17:01:34.873 INFO:tasks.workunit.client.3.smithi157.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-03-26T17:01:34.923 INFO:tasks.workunit.client.3.smithi157.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-03-26T17:01:34.964 INFO:tasks.workunit.client.3.smithi157.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.3/qa/workunits/direct_io' 2024-03-26T17:01:34.966 INFO:tasks.workunit.client.3.smithi157.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.3/qa/workunits/fs' 2024-03-26T17:01:34.966 INFO:tasks.workunit.client.3.smithi157.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-03-26T17:01:35.006 INFO:tasks.workunit.client.3.smithi157.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.3/qa/workunits/fs' 2024-03-26T17:01:35.009 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-03-26T17:01:35.009 DEBUG:teuthology.orchestra.run.smithi157:> dd if=/home/ubuntu/cephtest/workunits.list.client.3 of=/dev/stdout 2024-03-26T17:01:35.015 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:01:34 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-26T17:01:35.015 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:01:34 smithi044 ceph-mon[30624]: pgmap v447: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 34 KiB/s rd, 2 op/s 2024-03-26T17:01:35.055 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:01:34 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-26T17:01:35.055 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:01:34 smithi064 ceph-mon[34420]: pgmap v447: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 34 KiB/s rd, 2 op/s 2024-03-26T17:01:35.065 INFO:tasks.workunit:Running workunits matching rbd/nvmeof_fio_test.sh on client.3... 2024-03-26T17:01:35.067 INFO:tasks.workunit:Running workunit rbd/nvmeof_fio_test.sh... 2024-03-26T17:01:35.067 DEBUG:teuthology.orchestra.run.smithi157:workunit test rbd/nvmeof_fio_test.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.3/client.3/tmp && cd -- /home/ubuntu/cephtest/mnt.3/client.3/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=b4c4828f419f1247fc297e8069c1036b1d6151f2 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="3" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.3 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.3 CEPH_MNT=/home/ubuntu/cephtest/mnt.3 IOSTAT_INTERVAL=10 RBD_POOL=mypool RUNTIME=600 timeout 3h /home/ubuntu/cephtest/clone.client.3/qa/workunits/rbd/nvmeof_fio_test.sh --rbd_iostat 2024-03-26T17:01:35.122 INFO:tasks.workunit.client.3.smithi157.stderr:+ sudo yum -y install fio 2024-03-26T17:01:35.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:01:35 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-b[34416]: 2024-03-26T17:01:35.283+0000 7ff022916700 -1 mon.b@2(peon) e3 get_health_metrics reporting 4 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T17:01:35.556 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:01:35 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:01:35] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:01:35.556 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:01:35 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:01:35] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:01:35.557 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:01:35 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:01:35.701 INFO:tasks.workunit.client.3.smithi157.stdout:Last metadata expiration check: 0:20:12 ago on Tue 26 Mar 2024 04:41:23 PM UTC. 2024-03-26T17:01:35.858 INFO:tasks.workunit.client.3.smithi157.stdout:Dependencies resolved. 2024-03-26T17:01:35.858 INFO:tasks.workunit.client.3.smithi157.stdout:================================================================================ 2024-03-26T17:01:35.859 INFO:tasks.workunit.client.3.smithi157.stdout: Package Arch Version Repository Size 2024-03-26T17:01:35.859 INFO:tasks.workunit.client.3.smithi157.stdout:================================================================================ 2024-03-26T17:01:35.859 INFO:tasks.workunit.client.3.smithi157.stdout:Installing: 2024-03-26T17:01:35.859 INFO:tasks.workunit.client.3.smithi157.stdout: fio x86_64 3.35-1.el9 CentOS-AppStream 6.2 M 2024-03-26T17:01:35.859 INFO:tasks.workunit.client.3.smithi157.stdout:Installing dependencies: 2024-03-26T17:01:35.859 INFO:tasks.workunit.client.3.smithi157.stdout: libnbd x86_64 1.18.1-3.el9 appstream 166 k 2024-03-26T17:01:35.859 INFO:tasks.workunit.client.3.smithi157.stdout:Installing weak dependencies: 2024-03-26T17:01:35.859 INFO:tasks.workunit.client.3.smithi157.stdout: fio-engine-http x86_64 3.35-1.el9 CentOS-AppStream 17 k 2024-03-26T17:01:35.859 INFO:tasks.workunit.client.3.smithi157.stdout: fio-engine-libaio x86_64 3.35-1.el9 CentOS-AppStream 14 k 2024-03-26T17:01:35.859 INFO:tasks.workunit.client.3.smithi157.stdout: fio-engine-nbd x86_64 3.35-1.el9 CentOS-AppStream 13 k 2024-03-26T17:01:35.859 INFO:tasks.workunit.client.3.smithi157.stdout: fio-engine-rados x86_64 3.35-1.el9 CentOS-AppStream 15 k 2024-03-26T17:01:35.859 INFO:tasks.workunit.client.3.smithi157.stdout: fio-engine-rbd x86_64 3.35-1.el9 CentOS-AppStream 15 k 2024-03-26T17:01:35.859 INFO:tasks.workunit.client.3.smithi157.stdout: fio-engine-rdma x86_64 3.35-1.el9 CentOS-AppStream 20 k 2024-03-26T17:01:35.860 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:01:35.860 INFO:tasks.workunit.client.3.smithi157.stdout:Transaction Summary 2024-03-26T17:01:35.860 INFO:tasks.workunit.client.3.smithi157.stdout:================================================================================ 2024-03-26T17:01:35.860 INFO:tasks.workunit.client.3.smithi157.stdout:Install 8 Packages 2024-03-26T17:01:35.860 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:01:35.860 INFO:tasks.workunit.client.3.smithi157.stdout:Total download size: 6.5 M 2024-03-26T17:01:35.860 INFO:tasks.workunit.client.3.smithi157.stdout:Installed size: 9.1 M 2024-03-26T17:01:35.861 INFO:tasks.workunit.client.3.smithi157.stdout:Downloading Packages: 2024-03-26T17:01:35.896 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:01:35 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-03-26T17:01:35.896 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:01:35 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-03-26T17:01:35.896 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:01:35 smithi149 ceph-mon[34678]: Adjusting osd_memory_target on smithi044 to 6498M 2024-03-26T17:01:35.896 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:01:35 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T17:01:35.896 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:01:35 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T17:01:35.896 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:01:35 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-26T17:01:35.896 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:01:35 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T17:01:36.015 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:01:35 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-03-26T17:01:36.015 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:01:35 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-03-26T17:01:36.015 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:01:35 smithi044 ceph-mon[30624]: Adjusting osd_memory_target on smithi044 to 6498M 2024-03-26T17:01:36.015 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:01:35 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T17:01:36.015 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:01:35 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T17:01:36.015 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:01:35 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-26T17:01:36.015 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:01:35 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T17:01:36.055 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:01:35 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-03-26T17:01:36.055 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:01:35 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-03-26T17:01:36.055 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:01:35 smithi064 ceph-mon[34420]: Adjusting osd_memory_target on smithi044 to 6498M 2024-03-26T17:01:36.056 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:01:35 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T17:01:36.056 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:01:35 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T17:01:36.056 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:01:35 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-26T17:01:36.056 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:01:35 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T17:01:36.120 INFO:tasks.workunit.client.3.smithi157.stdout:(1/8): fio-engine-http-3.35-1.el9.x86_64.rpm 99 kB/s | 17 kB 00:00 2024-03-26T17:01:36.146 INFO:tasks.workunit.client.3.smithi157.stdout:(2/8): fio-engine-libaio-3.35-1.el9.x86_64.rpm 74 kB/s | 14 kB 00:00 2024-03-26T17:01:36.204 INFO:tasks.workunit.client.3.smithi157.stdout:(3/8): fio-engine-nbd-3.35-1.el9.x86_64.rpm 163 kB/s | 13 kB 00:00 2024-03-26T17:01:36.230 INFO:tasks.workunit.client.3.smithi157.stdout:(4/8): fio-engine-rados-3.35-1.el9.x86_64.rpm 176 kB/s | 15 kB 00:00 2024-03-26T17:01:36.322 INFO:tasks.workunit.client.3.smithi157.stdout:(5/8): fio-3.35-1.el9.x86_64.rpm 17 MB/s | 6.2 MB 00:00 2024-03-26T17:01:36.347 INFO:tasks.workunit.client.3.smithi157.stdout:(6/8): fio-engine-rbd-3.35-1.el9.x86_64.rpm 107 kB/s | 15 kB 00:00 2024-03-26T17:01:36.372 INFO:tasks.workunit.client.3.smithi157.stdout:(7/8): fio-engine-rdma-3.35-1.el9.x86_64.rpm 140 kB/s | 20 kB 00:00 2024-03-26T17:01:36.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:01:36 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:01:36] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:01:36.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:01:36 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:01:36] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:01:36.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:01:36 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:01:36.552 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:01:36 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 2024-03-26T17:01:36.210+0000 7fa707a55700 -1 mon.c@1(peon) e3 get_health_metrics reporting 3 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T17:01:36.896 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:01:36 smithi149 ceph-mon[34678]: pgmap v448: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 23 KiB/s rd, 1 op/s 2024-03-26T17:01:36.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:01:36 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:01:36] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:01:36.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:01:36 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:01:36] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:01:36.897 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:01:36 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:01:37.015 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:01:36 smithi044 ceph-mon[30624]: pgmap v448: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 23 KiB/s rd, 1 op/s 2024-03-26T17:01:37.055 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:01:36 smithi064 ceph-mon[34420]: pgmap v448: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 23 KiB/s rd, 1 op/s 2024-03-26T17:01:37.755 INFO:tasks.workunit.client.3.smithi157.stdout:(8/8): libnbd-1.18.1-3.el9.x86_64.rpm 118 kB/s | 166 kB 00:01 2024-03-26T17:01:37.759 INFO:tasks.workunit.client.3.smithi157.stdout:-------------------------------------------------------------------------------- 2024-03-26T17:01:37.759 INFO:tasks.workunit.client.3.smithi157.stdout:Total 3.4 MB/s | 6.5 MB 00:01 2024-03-26T17:01:37.772 INFO:tasks.workunit.client.3.smithi157.stdout:Running transaction check 2024-03-26T17:01:37.787 INFO:tasks.workunit.client.3.smithi157.stdout:Transaction check succeeded. 2024-03-26T17:01:37.787 INFO:tasks.workunit.client.3.smithi157.stdout:Running transaction test 2024-03-26T17:01:37.806 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:01:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:01:37] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:01:37.806 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:01:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:01:37] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:01:37.806 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:01:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:01:37.895 INFO:tasks.workunit.client.3.smithi157.stdout:Transaction test succeeded. 2024-03-26T17:01:37.895 INFO:tasks.workunit.client.3.smithi157.stdout:Running transaction 2024-03-26T17:01:38.256 INFO:tasks.workunit.client.3.smithi157.stdout: Preparing : 1/1 2024-03-26T17:01:38.325 INFO:tasks.workunit.client.3.smithi157.stdout: Installing : libnbd-1.18.1-3.el9.x86_64 1/8 2024-03-26T17:01:38.350 INFO:tasks.workunit.client.3.smithi157.stdout: Installing : fio-engine-http-3.35-1.el9.x86_64 2/8 2024-03-26T17:01:38.375 INFO:tasks.workunit.client.3.smithi157.stdout: Installing : fio-engine-libaio-3.35-1.el9.x86_64 3/8 2024-03-26T17:01:38.418 INFO:tasks.workunit.client.3.smithi157.stdout: Installing : fio-engine-nbd-3.35-1.el9.x86_64 4/8 2024-03-26T17:01:38.442 INFO:tasks.workunit.client.3.smithi157.stdout: Installing : fio-engine-rados-3.35-1.el9.x86_64 5/8 2024-03-26T17:01:38.468 INFO:tasks.workunit.client.3.smithi157.stdout: Installing : fio-engine-rbd-3.35-1.el9.x86_64 6/8 2024-03-26T17:01:38.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:01:38 smithi044 ceph-mon[30624]: pgmap v449: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 23 KiB/s rd, 1 op/s 2024-03-26T17:01:38.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:01:38 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:01:38] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:01:38.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:01:38 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:01:38] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:01:38.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:01:38 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:01:38.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:01:38 smithi064 ceph-mon[34420]: pgmap v449: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 23 KiB/s rd, 1 op/s 2024-03-26T17:01:38.561 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:01:38 smithi149 ceph-mon[34678]: pgmap v449: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 23 KiB/s rd, 1 op/s 2024-03-26T17:01:38.618 INFO:tasks.workunit.client.3.smithi157.stdout: Installing : fio-engine-rdma-3.35-1.el9.x86_64 7/8 2024-03-26T17:01:38.702 INFO:tasks.workunit.client.3.smithi157.stdout: Installing : fio-3.35-1.el9.x86_64 8/8 2024-03-26T17:01:38.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:01:38 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:01:38] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:01:38.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:01:38 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:01:38] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:01:38.897 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:01:38 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:01:39.457 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:01:39 smithi064 ceph-mon[34420]: Health check update: 7 slow ops, oldest one blocked for 193 sec, daemons [mon.b,mon.c] have slow ops. (SLOW_OPS) 2024-03-26T17:01:39.457 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:01:39 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:01:39] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:01:39.458 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:01:39 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:01:39] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:01:39.458 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:01:39 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:01:39.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:01:39 smithi044 ceph-mon[30624]: Health check update: 7 slow ops, oldest one blocked for 193 sec, daemons [mon.b,mon.c] have slow ops. (SLOW_OPS) 2024-03-26T17:01:39.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:01:39 smithi149 ceph-mon[34678]: Health check update: 7 slow ops, oldest one blocked for 193 sec, daemons [mon.b,mon.c] have slow ops. (SLOW_OPS) 2024-03-26T17:01:40.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:01:40 smithi044 ceph-mon[30624]: pgmap v450: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 34 KiB/s rd, 2 op/s 2024-03-26T17:01:40.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:01:40 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:01:40] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:01:40.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:01:40 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:01:40] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:01:40.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:01:40 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:01:40.547 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:01:40 smithi149 ceph-mon[34678]: pgmap v450: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 34 KiB/s rd, 2 op/s 2024-03-26T17:01:40.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:01:40 smithi064 ceph-mon[34420]: pgmap v450: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 34 KiB/s rd, 2 op/s 2024-03-26T17:01:40.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:01:40 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-b[34416]: 2024-03-26T17:01:40.283+0000 7ff022916700 -1 mon.b@2(peon) e3 get_health_metrics reporting 4 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T17:01:40.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:01:40 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:01:40] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:01:40.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:01:40 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:01:40] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:01:40.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:01:40 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:01:41.409 INFO:tasks.workunit.client.3.smithi157.stdout: Running scriptlet: fio-3.35-1.el9.x86_64 8/8 2024-03-26T17:01:41.410 INFO:tasks.workunit.client.3.smithi157.stdout: Verifying : fio-3.35-1.el9.x86_64 1/8 2024-03-26T17:01:41.410 INFO:tasks.workunit.client.3.smithi157.stdout: Verifying : fio-engine-http-3.35-1.el9.x86_64 2/8 2024-03-26T17:01:41.410 INFO:tasks.workunit.client.3.smithi157.stdout: Verifying : fio-engine-libaio-3.35-1.el9.x86_64 3/8 2024-03-26T17:01:41.410 INFO:tasks.workunit.client.3.smithi157.stdout: Verifying : fio-engine-nbd-3.35-1.el9.x86_64 4/8 2024-03-26T17:01:41.410 INFO:tasks.workunit.client.3.smithi157.stdout: Verifying : fio-engine-rados-3.35-1.el9.x86_64 5/8 2024-03-26T17:01:41.410 INFO:tasks.workunit.client.3.smithi157.stdout: Verifying : fio-engine-rbd-3.35-1.el9.x86_64 6/8 2024-03-26T17:01:41.410 INFO:tasks.workunit.client.3.smithi157.stdout: Verifying : fio-engine-rdma-3.35-1.el9.x86_64 7/8 2024-03-26T17:01:41.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:01:41 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 2024-03-26T17:01:41.210+0000 7fa707a55700 -1 mon.c@1(peon) e3 get_health_metrics reporting 3 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T17:01:41.806 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:01:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:01:41] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:01:41.806 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:01:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:01:41] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:01:41.807 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:01:41 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:01:41.879 INFO:tasks.workunit.client.3.smithi157.stdout: Verifying : libnbd-1.18.1-3.el9.x86_64 8/8 2024-03-26T17:01:41.879 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:01:41.879 INFO:tasks.workunit.client.3.smithi157.stdout:Installed: 2024-03-26T17:01:41.879 INFO:tasks.workunit.client.3.smithi157.stdout: fio-3.35-1.el9.x86_64 fio-engine-http-3.35-1.el9.x86_64 2024-03-26T17:01:41.879 INFO:tasks.workunit.client.3.smithi157.stdout: fio-engine-libaio-3.35-1.el9.x86_64 fio-engine-nbd-3.35-1.el9.x86_64 2024-03-26T17:01:41.879 INFO:tasks.workunit.client.3.smithi157.stdout: fio-engine-rados-3.35-1.el9.x86_64 fio-engine-rbd-3.35-1.el9.x86_64 2024-03-26T17:01:41.879 INFO:tasks.workunit.client.3.smithi157.stdout: fio-engine-rdma-3.35-1.el9.x86_64 libnbd-1.18.1-3.el9.x86_64 2024-03-26T17:01:41.879 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:01:41.880 INFO:tasks.workunit.client.3.smithi157.stdout:Complete! 2024-03-26T17:01:42.206 INFO:tasks.workunit.client.3.smithi157.stderr:+ sudo yum -y install sysstat 2024-03-26T17:01:42.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:01:42 smithi044 ceph-mon[30624]: pgmap v451: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 23 KiB/s rd, 1 op/s 2024-03-26T17:01:42.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:01:42 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:01:42] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:01:42.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:01:42 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:01:42] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:01:42.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:01:42 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:01:42.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:01:42 smithi064 ceph-mon[34420]: pgmap v451: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 23 KiB/s rd, 1 op/s 2024-03-26T17:01:42.585 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:01:42 smithi149 ceph-mon[34678]: pgmap v451: 33 pgs: 33 active+clean; 609 KiB data, 231 MiB used, 715 GiB / 715 GiB avail; 23 KiB/s rd, 1 op/s 2024-03-26T17:01:42.770 INFO:tasks.workunit.client.3.smithi157.stdout:Last metadata expiration check: 0:20:19 ago on Tue 26 Mar 2024 04:41:23 PM UTC. 2024-03-26T17:01:42.867 INFO:tasks.workunit.client.3.smithi157.stdout:Package sysstat-12.5.4-7.el9.x86_64 is already installed. 2024-03-26T17:01:42.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:01:42 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:01:42] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:01:42.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:01:42 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:01:42] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:01:42.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:01:42 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:01:42.920 INFO:tasks.workunit.client.3.smithi157.stdout:Dependencies resolved. 2024-03-26T17:01:42.921 INFO:tasks.workunit.client.3.smithi157.stdout:Nothing to do. 2024-03-26T17:01:42.922 INFO:tasks.workunit.client.3.smithi157.stdout:Complete! 2024-03-26T17:01:42.987 INFO:tasks.workunit.client.3.smithi157.stderr:+ namespace_range_start= 2024-03-26T17:01:42.987 INFO:tasks.workunit.client.3.smithi157.stderr:+ namespace_range_end= 2024-03-26T17:01:42.987 INFO:tasks.workunit.client.3.smithi157.stderr:+ rbd_iostat=false 2024-03-26T17:01:42.987 INFO:tasks.workunit.client.3.smithi157.stderr:+ [[ 1 -gt 0 ]] 2024-03-26T17:01:42.988 INFO:tasks.workunit.client.3.smithi157.stderr:+ case "$1" in 2024-03-26T17:01:42.988 INFO:tasks.workunit.client.3.smithi157.stderr:+ rbd_iostat=true 2024-03-26T17:01:42.988 INFO:tasks.workunit.client.3.smithi157.stderr:+ shift 2024-03-26T17:01:42.988 INFO:tasks.workunit.client.3.smithi157.stderr:+ [[ 0 -gt 0 ]] 2024-03-26T17:01:42.988 INFO:tasks.workunit.client.3.smithi157.stderr:++ mktemp -t nvmeof-fio-XXXX 2024-03-26T17:01:42.988 INFO:tasks.workunit.client.3.smithi157.stderr:+ fio_file=/tmp/nvmeof-fio-nPHQ 2024-03-26T17:01:42.988 INFO:tasks.workunit.client.3.smithi157.stderr:++ sudo nvme list --output-format=json 2024-03-26T17:01:42.989 INFO:tasks.workunit.client.3.smithi157.stderr:++ jq -r '.Devices | sort_by(.NameSpace) | .[] | select(.ModelNumber == "Ceph bdev Controller") | .DevicePath' 2024-03-26T17:01:43.017 INFO:tasks.workunit.client.3.smithi157.stderr:+ all_drives_list='/dev/nvme5n1 2024-03-26T17:01:43.017 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme2n1 2024-03-26T17:01:43.017 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme8n1 2024-03-26T17:01:43.017 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme5n2 2024-03-26T17:01:43.017 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme2n2 2024-03-26T17:01:43.018 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme8n2 2024-03-26T17:01:43.018 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme5n3 2024-03-26T17:01:43.018 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme2n3 2024-03-26T17:01:43.018 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme8n3 2024-03-26T17:01:43.018 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme5n4 2024-03-26T17:01:43.018 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme2n4 2024-03-26T17:01:43.018 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme8n4 2024-03-26T17:01:43.018 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme5n5 2024-03-26T17:01:43.018 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme2n5 2024-03-26T17:01:43.018 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme8n5 2024-03-26T17:01:43.018 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme5n6 2024-03-26T17:01:43.018 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme2n6 2024-03-26T17:01:43.018 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme8n6 2024-03-26T17:01:43.019 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme5n7 2024-03-26T17:01:43.019 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme2n7 2024-03-26T17:01:43.019 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme8n7 2024-03-26T17:01:43.019 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme5n8 2024-03-26T17:01:43.019 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme2n8 2024-03-26T17:01:43.019 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme8n8 2024-03-26T17:01:43.019 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme5n9 2024-03-26T17:01:43.019 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme2n9 2024-03-26T17:01:43.019 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme8n9 2024-03-26T17:01:43.019 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme5n10 2024-03-26T17:01:43.019 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme2n10 2024-03-26T17:01:43.019 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme8n10 2024-03-26T17:01:43.019 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme5n11 2024-03-26T17:01:43.019 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme2n11 2024-03-26T17:01:43.020 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme8n11 2024-03-26T17:01:43.020 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme5n12 2024-03-26T17:01:43.020 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme2n12 2024-03-26T17:01:43.020 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme8n12 2024-03-26T17:01:43.020 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme5n13 2024-03-26T17:01:43.020 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme2n13 2024-03-26T17:01:43.020 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme8n13 2024-03-26T17:01:43.020 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme5n14 2024-03-26T17:01:43.020 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme2n14 2024-03-26T17:01:43.020 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme8n14 2024-03-26T17:01:43.020 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme5n15 2024-03-26T17:01:43.020 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme2n15 2024-03-26T17:01:43.020 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme8n15 2024-03-26T17:01:43.020 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme5n16 2024-03-26T17:01:43.021 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme2n16 2024-03-26T17:01:43.021 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme8n16 2024-03-26T17:01:43.021 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme5n17 2024-03-26T17:01:43.021 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme2n17 2024-03-26T17:01:43.021 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme8n17 2024-03-26T17:01:43.021 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme5n18 2024-03-26T17:01:43.021 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme2n18 2024-03-26T17:01:43.021 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme8n18 2024-03-26T17:01:43.021 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme5n19 2024-03-26T17:01:43.021 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme2n19 2024-03-26T17:01:43.021 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme8n19 2024-03-26T17:01:43.021 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme5n20 2024-03-26T17:01:43.021 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme2n20 2024-03-26T17:01:43.021 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme8n20' 2024-03-26T17:01:43.021 INFO:tasks.workunit.client.3.smithi157.stderr:+ '[' '' ']' 2024-03-26T17:01:43.022 INFO:tasks.workunit.client.3.smithi157.stderr:+ '[' '' ']' 2024-03-26T17:01:43.022 INFO:tasks.workunit.client.3.smithi157.stderr:+ selected_drives='/dev/nvme5n1 2024-03-26T17:01:43.022 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme2n1 2024-03-26T17:01:43.022 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme8n1 2024-03-26T17:01:43.022 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme5n2 2024-03-26T17:01:43.022 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme2n2 2024-03-26T17:01:43.022 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme8n2 2024-03-26T17:01:43.022 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme5n3 2024-03-26T17:01:43.022 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme2n3 2024-03-26T17:01:43.022 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme8n3 2024-03-26T17:01:43.022 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme5n4 2024-03-26T17:01:43.022 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme2n4 2024-03-26T17:01:43.023 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme8n4 2024-03-26T17:01:43.023 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme5n5 2024-03-26T17:01:43.023 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme2n5 2024-03-26T17:01:43.023 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme8n5 2024-03-26T17:01:43.023 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme5n6 2024-03-26T17:01:43.023 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme2n6 2024-03-26T17:01:43.023 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme8n6 2024-03-26T17:01:43.023 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme5n7 2024-03-26T17:01:43.023 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme2n7 2024-03-26T17:01:43.023 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme8n7 2024-03-26T17:01:43.023 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme5n8 2024-03-26T17:01:43.023 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme2n8 2024-03-26T17:01:43.023 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme8n8 2024-03-26T17:01:43.023 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme5n9 2024-03-26T17:01:43.024 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme2n9 2024-03-26T17:01:43.024 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme8n9 2024-03-26T17:01:43.024 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme5n10 2024-03-26T17:01:43.024 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme2n10 2024-03-26T17:01:43.024 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme8n10 2024-03-26T17:01:43.024 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme5n11 2024-03-26T17:01:43.024 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme2n11 2024-03-26T17:01:43.024 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme8n11 2024-03-26T17:01:43.024 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme5n12 2024-03-26T17:01:43.024 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme2n12 2024-03-26T17:01:43.024 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme8n12 2024-03-26T17:01:43.024 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme5n13 2024-03-26T17:01:43.024 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme2n13 2024-03-26T17:01:43.024 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme8n13 2024-03-26T17:01:43.024 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme5n14 2024-03-26T17:01:43.025 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme2n14 2024-03-26T17:01:43.025 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme8n14 2024-03-26T17:01:43.025 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme5n15 2024-03-26T17:01:43.025 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme2n15 2024-03-26T17:01:43.025 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme8n15 2024-03-26T17:01:43.025 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme5n16 2024-03-26T17:01:43.025 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme2n16 2024-03-26T17:01:43.025 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme8n16 2024-03-26T17:01:43.025 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme5n17 2024-03-26T17:01:43.025 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme2n17 2024-03-26T17:01:43.025 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme8n17 2024-03-26T17:01:43.025 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme5n18 2024-03-26T17:01:43.025 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme2n18 2024-03-26T17:01:43.026 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme8n18 2024-03-26T17:01:43.026 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme5n19 2024-03-26T17:01:43.026 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme2n19 2024-03-26T17:01:43.026 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme8n19 2024-03-26T17:01:43.026 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme5n20 2024-03-26T17:01:43.026 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme2n20 2024-03-26T17:01:43.026 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme8n20' 2024-03-26T17:01:43.026 INFO:tasks.workunit.client.3.smithi157.stderr:+ RUNTIME=600 2024-03-26T17:01:43.026 INFO:tasks.workunit.client.3.smithi157.stderr:+ cat 2024-03-26T17:01:43.026 INFO:tasks.workunit.client.3.smithi157.stderr:++ echo '/dev/nvme5n1 2024-03-26T17:01:43.026 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme2n1 2024-03-26T17:01:43.026 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme8n1 2024-03-26T17:01:43.026 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme5n2 2024-03-26T17:01:43.026 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme2n2 2024-03-26T17:01:43.027 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme8n2 2024-03-26T17:01:43.027 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme5n3 2024-03-26T17:01:43.027 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme2n3 2024-03-26T17:01:43.027 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme8n3 2024-03-26T17:01:43.027 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme5n4 2024-03-26T17:01:43.027 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme2n4 2024-03-26T17:01:43.028 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme8n4 2024-03-26T17:01:43.028 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme5n5 2024-03-26T17:01:43.028 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme2n5 2024-03-26T17:01:43.028 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme8n5 2024-03-26T17:01:43.028 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme5n6 2024-03-26T17:01:43.028 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme2n6 2024-03-26T17:01:43.028 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme8n6 2024-03-26T17:01:43.028 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme5n7 2024-03-26T17:01:43.028 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme2n7 2024-03-26T17:01:43.028 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme8n7 2024-03-26T17:01:43.028 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme5n8 2024-03-26T17:01:43.028 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme2n8 2024-03-26T17:01:43.028 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme8n8 2024-03-26T17:01:43.028 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme5n9 2024-03-26T17:01:43.028 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme2n9 2024-03-26T17:01:43.028 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme8n9 2024-03-26T17:01:43.029 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme5n10 2024-03-26T17:01:43.029 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme2n10 2024-03-26T17:01:43.029 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme8n10 2024-03-26T17:01:43.029 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme5n11 2024-03-26T17:01:43.029 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme2n11 2024-03-26T17:01:43.029 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme8n11 2024-03-26T17:01:43.029 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme5n12 2024-03-26T17:01:43.029 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme2n12 2024-03-26T17:01:43.029 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme8n12 2024-03-26T17:01:43.029 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme5n13 2024-03-26T17:01:43.029 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme2n13 2024-03-26T17:01:43.029 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme8n13 2024-03-26T17:01:43.029 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme5n14 2024-03-26T17:01:43.030 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme2n14 2024-03-26T17:01:43.030 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme8n14 2024-03-26T17:01:43.030 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme5n15 2024-03-26T17:01:43.030 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme2n15 2024-03-26T17:01:43.030 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme8n15 2024-03-26T17:01:43.030 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme5n16 2024-03-26T17:01:43.030 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme2n16 2024-03-26T17:01:43.030 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme8n16 2024-03-26T17:01:43.030 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme5n17 2024-03-26T17:01:43.030 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme2n17 2024-03-26T17:01:43.030 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme8n17 2024-03-26T17:01:43.030 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme5n18 2024-03-26T17:01:43.030 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme2n18 2024-03-26T17:01:43.030 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme8n18 2024-03-26T17:01:43.031 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme5n19 2024-03-26T17:01:43.031 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme2n19 2024-03-26T17:01:43.031 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme8n19 2024-03-26T17:01:43.031 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme5n20 2024-03-26T17:01:43.031 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme2n20 2024-03-26T17:01:43.031 INFO:tasks.workunit.client.3.smithi157.stderr:/dev/nvme8n20' 2024-03-26T17:01:43.031 INFO:tasks.workunit.client.3.smithi157.stderr:++ tr '\n' : 2024-03-26T17:01:43.031 INFO:tasks.workunit.client.3.smithi157.stderr:++ sed 's/:$//' 2024-03-26T17:01:43.032 INFO:tasks.workunit.client.3.smithi157.stderr:+ echo '[nvmeof.fio] starting fio test...' 2024-03-26T17:01:43.032 INFO:tasks.workunit.client.3.smithi157.stdout:[nvmeof.fio] starting fio test... 2024-03-26T17:01:43.033 INFO:tasks.workunit.client.3.smithi157.stderr:+ '[' -n 10 ']' 2024-03-26T17:01:43.033 INFO:tasks.workunit.client.3.smithi157.stderr:+ iostat_count=60 2024-03-26T17:01:43.033 INFO:tasks.workunit.client.3.smithi157.stderr:+ '[' true = true ']' 2024-03-26T17:01:43.033 INFO:tasks.workunit.client.3.smithi157.stderr:+ iterations=120 2024-03-26T17:01:43.033 INFO:tasks.workunit.client.3.smithi157.stderr:+ iostat -d -p /dev/nvme5n1 /dev/nvme2n1 /dev/nvme8n1 /dev/nvme5n2 /dev/nvme2n2 /dev/nvme8n2 /dev/nvme5n3 /dev/nvme2n3 /dev/nvme8n3 /dev/nvme5n4 /dev/nvme2n4 /dev/nvme8n4 /dev/nvme5n5 /dev/nvme2n5 /dev/nvme8n5 /dev/nvme5n6 /dev/nvme2n6 /dev/nvme8n6 /dev/nvme5n7 /dev/nvme2n7 /dev/nvme8n7 /dev/nvme5n8 /dev/nvme2n8 /dev/nvme8n8 /dev/nvme5n9 /dev/nvme2n9 /dev/nvme8n9 /dev/nvme5n10 /dev/nvme2n10 /dev/nvme8n10 /dev/nvme5n11 /dev/nvme2n11 /dev/nvme8n11 /dev/nvme5n12 /dev/nvme2n12 /dev/nvme8n12 /dev/nvme5n13 /dev/nvme2n13 /dev/nvme8n13 /dev/nvme5n14 /dev/nvme2n14 /dev/nvme8n14 /dev/nvme5n15 /dev/nvme2n15 /dev/nvme8n15 /dev/nvme5n16 /dev/nvme2n16 /dev/nvme8n16 /dev/nvme5n17 /dev/nvme2n17 /dev/nvme8n17 /dev/nvme5n18 /dev/nvme2n18 /dev/nvme8n18 /dev/nvme5n19 /dev/nvme2n19 /dev/nvme8n19 /dev/nvme5n20 /dev/nvme2n20 /dev/nvme8n20 10 60 -h 2024-03-26T17:01:43.033 INFO:tasks.workunit.client.3.smithi157.stderr:+ fio --showcmd /tmp/nvmeof-fio-nPHQ 2024-03-26T17:01:43.033 INFO:tasks.workunit.client.3.smithi157.stderr:+ rbd perf image iostat mypool --iterations 120 2024-03-26T17:01:43.060 INFO:tasks.workunit.client.3.smithi157.stdout:Linux 5.14.0-432.el9.x86_64 (smithi157) 03/26/2024 _x86_64_ (8 CPU) 2024-03-26T17:01:43.061 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:01:43.070 INFO:tasks.workunit.client.3.smithi157.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2024-03-26T17:01:43.070 INFO:tasks.workunit.client.3.smithi157.stdout: 0.03 0.7k 0.0k 0.0k 1.0M 0.0k 0.0k nvme2n1 2024-03-26T17:01:43.070 INFO:tasks.workunit.client.3.smithi157.stdout: 0.03 0.7k 0.0k 0.0k 1.0M 0.0k 0.0k nvme2n10 2024-03-26T17:01:43.070 INFO:tasks.workunit.client.3.smithi157.stdout: 0.03 0.7k 0.0k 0.0k 1.0M 0.0k 0.0k nvme2n11 2024-03-26T17:01:43.071 INFO:tasks.workunit.client.3.smithi157.stdout: 0.03 0.7k 0.0k 0.0k 1.0M 0.0k 0.0k nvme2n12 2024-03-26T17:01:43.071 INFO:tasks.workunit.client.3.smithi157.stdout: 0.03 0.7k 0.0k 0.0k 1.0M 0.0k 0.0k nvme2n13 2024-03-26T17:01:43.071 INFO:tasks.workunit.client.3.smithi157.stdout: 0.03 0.7k 0.0k 0.0k 1.0M 0.0k 0.0k nvme2n14 2024-03-26T17:01:43.071 INFO:tasks.workunit.client.3.smithi157.stdout: 0.03 0.7k 0.0k 0.0k 1.0M 0.0k 0.0k nvme2n15 2024-03-26T17:01:43.071 INFO:tasks.workunit.client.3.smithi157.stdout: 0.03 0.7k 0.0k 0.0k 1.0M 0.0k 0.0k nvme2n16 2024-03-26T17:01:43.071 INFO:tasks.workunit.client.3.smithi157.stdout: 0.03 0.7k 0.0k 0.0k 1.0M 0.0k 0.0k nvme2n17 2024-03-26T17:01:43.071 INFO:tasks.workunit.client.3.smithi157.stdout: 0.03 0.7k 0.0k 0.0k 1.0M 0.0k 0.0k nvme2n18 2024-03-26T17:01:43.071 INFO:tasks.workunit.client.3.smithi157.stdout: 0.03 0.7k 0.0k 0.0k 1.0M 0.0k 0.0k nvme2n19 2024-03-26T17:01:43.071 INFO:tasks.workunit.client.3.smithi157.stdout: 0.03 0.7k 0.0k 0.0k 1.0M 0.0k 0.0k nvme2n2 2024-03-26T17:01:43.071 INFO:tasks.workunit.client.3.smithi157.stdout: 0.03 0.7k 0.0k 0.0k 1.0M 0.0k 0.0k nvme2n20 2024-03-26T17:01:43.071 INFO:tasks.workunit.client.3.smithi157.stdout: 0.03 0.7k 0.0k 0.0k 1.0M 0.0k 0.0k nvme2n3 2024-03-26T17:01:43.071 INFO:tasks.workunit.client.3.smithi157.stdout: 0.03 0.7k 0.0k 0.0k 1.0M 0.0k 0.0k nvme2n4 2024-03-26T17:01:43.071 INFO:tasks.workunit.client.3.smithi157.stdout: 0.03 0.7k 0.0k 0.0k 1.0M 0.0k 0.0k nvme2n5 2024-03-26T17:01:43.071 INFO:tasks.workunit.client.3.smithi157.stdout: 0.03 0.7k 0.0k 0.0k 1.0M 0.0k 0.0k nvme2n6 2024-03-26T17:01:43.072 INFO:tasks.workunit.client.3.smithi157.stdout: 0.03 0.7k 0.0k 0.0k 1.0M 0.0k 0.0k nvme2n7 2024-03-26T17:01:43.072 INFO:tasks.workunit.client.3.smithi157.stdout: 0.03 0.7k 0.0k 0.0k 1.0M 0.0k 0.0k nvme2n8 2024-03-26T17:01:43.072 INFO:tasks.workunit.client.3.smithi157.stdout: 0.03 0.7k 0.0k 0.0k 1.0M 0.0k 0.0k nvme2n9 2024-03-26T17:01:43.072 INFO:tasks.workunit.client.3.smithi157.stdout: 0.03 0.7k 0.0k 0.0k 1.0M 0.0k 0.0k nvme5n1 2024-03-26T17:01:43.072 INFO:tasks.workunit.client.3.smithi157.stdout: 0.03 0.7k 0.0k 0.0k 1.0M 0.0k 0.0k nvme5n10 2024-03-26T17:01:43.072 INFO:tasks.workunit.client.3.smithi157.stdout: 0.03 0.7k 0.0k 0.0k 1.0M 0.0k 0.0k nvme5n11 2024-03-26T17:01:43.072 INFO:tasks.workunit.client.3.smithi157.stdout: 0.03 0.7k 0.0k 0.0k 1.0M 0.0k 0.0k nvme5n12 2024-03-26T17:01:43.072 INFO:tasks.workunit.client.3.smithi157.stdout: 0.03 0.7k 0.0k 0.0k 1.0M 0.0k 0.0k nvme5n13 2024-03-26T17:01:43.072 INFO:tasks.workunit.client.3.smithi157.stdout: 0.03 0.7k 0.0k 0.0k 1.0M 0.0k 0.0k nvme5n14 2024-03-26T17:01:43.072 INFO:tasks.workunit.client.3.smithi157.stdout: 0.03 0.7k 0.0k 0.0k 1.0M 0.0k 0.0k nvme5n15 2024-03-26T17:01:43.072 INFO:tasks.workunit.client.3.smithi157.stdout: 0.03 0.7k 0.0k 0.0k 1.0M 0.0k 0.0k nvme5n16 2024-03-26T17:01:43.072 INFO:tasks.workunit.client.3.smithi157.stdout: 0.03 0.7k 0.0k 0.0k 1.0M 0.0k 0.0k nvme5n17 2024-03-26T17:01:43.072 INFO:tasks.workunit.client.3.smithi157.stdout: 0.03 0.7k 0.0k 0.0k 1.0M 0.0k 0.0k nvme5n18 2024-03-26T17:01:43.073 INFO:tasks.workunit.client.3.smithi157.stdout: 0.03 0.7k 0.0k 0.0k 1.0M 0.0k 0.0k nvme5n19 2024-03-26T17:01:43.073 INFO:tasks.workunit.client.3.smithi157.stdout: 0.03 0.7k 0.0k 0.0k 1.0M 0.0k 0.0k nvme5n2 2024-03-26T17:01:43.073 INFO:tasks.workunit.client.3.smithi157.stdout: 0.03 0.7k 0.0k 0.0k 1.0M 0.0k 0.0k nvme5n20 2024-03-26T17:01:43.073 INFO:tasks.workunit.client.3.smithi157.stdout: 0.03 0.7k 0.0k 0.0k 1.0M 0.0k 0.0k nvme5n3 2024-03-26T17:01:43.073 INFO:tasks.workunit.client.3.smithi157.stdout: 0.03 0.7k 0.0k 0.0k 1.0M 0.0k 0.0k nvme5n4 2024-03-26T17:01:43.073 INFO:tasks.workunit.client.3.smithi157.stdout: 0.03 0.7k 0.0k 0.0k 1.0M 0.0k 0.0k nvme5n5 2024-03-26T17:01:43.073 INFO:tasks.workunit.client.3.smithi157.stdout: 0.03 0.7k 0.0k 0.0k 1.0M 0.0k 0.0k nvme5n6 2024-03-26T17:01:43.073 INFO:tasks.workunit.client.3.smithi157.stdout: 0.03 0.7k 0.0k 0.0k 1.0M 0.0k 0.0k nvme5n7 2024-03-26T17:01:43.073 INFO:tasks.workunit.client.3.smithi157.stdout: 0.03 0.7k 0.0k 0.0k 1.0M 0.0k 0.0k nvme5n8 2024-03-26T17:01:43.073 INFO:tasks.workunit.client.3.smithi157.stdout: 0.03 0.7k 0.0k 0.0k 1.0M 0.0k 0.0k nvme5n9 2024-03-26T17:01:43.073 INFO:tasks.workunit.client.3.smithi157.stdout: 0.03 0.7k 0.0k 0.0k 1.0M 0.0k 0.0k nvme8n1 2024-03-26T17:01:43.073 INFO:tasks.workunit.client.3.smithi157.stdout: 0.03 0.7k 0.0k 0.0k 1.0M 0.0k 0.0k nvme8n10 2024-03-26T17:01:43.073 INFO:tasks.workunit.client.3.smithi157.stdout: 0.03 0.7k 0.0k 0.0k 1.0M 0.0k 0.0k nvme8n11 2024-03-26T17:01:43.074 INFO:tasks.workunit.client.3.smithi157.stdout: 0.03 0.7k 0.0k 0.0k 1.0M 0.0k 0.0k nvme8n12 2024-03-26T17:01:43.074 INFO:tasks.workunit.client.3.smithi157.stdout: 0.03 0.7k 0.0k 0.0k 1.0M 0.0k 0.0k nvme8n13 2024-03-26T17:01:43.074 INFO:tasks.workunit.client.3.smithi157.stdout: 0.03 0.7k 0.0k 0.0k 1.0M 0.0k 0.0k nvme8n14 2024-03-26T17:01:43.074 INFO:tasks.workunit.client.3.smithi157.stdout: 0.03 0.7k 0.0k 0.0k 1.0M 0.0k 0.0k nvme8n15 2024-03-26T17:01:43.074 INFO:tasks.workunit.client.3.smithi157.stdout: 0.03 0.7k 0.0k 0.0k 1.0M 0.0k 0.0k nvme8n16 2024-03-26T17:01:43.074 INFO:tasks.workunit.client.3.smithi157.stdout: 0.03 0.7k 0.0k 0.0k 1.0M 0.0k 0.0k nvme8n17 2024-03-26T17:01:43.074 INFO:tasks.workunit.client.3.smithi157.stdout: 0.03 0.7k 0.0k 0.0k 1.0M 0.0k 0.0k nvme8n18 2024-03-26T17:01:43.074 INFO:tasks.workunit.client.3.smithi157.stdout: 0.03 0.7k 0.0k 0.0k 1.0M 0.0k 0.0k nvme8n19 2024-03-26T17:01:43.074 INFO:tasks.workunit.client.3.smithi157.stdout: 0.03 0.7k 0.0k 0.0k 1.0M 0.0k 0.0k nvme8n2 2024-03-26T17:01:43.074 INFO:tasks.workunit.client.3.smithi157.stdout: 0.03 0.7k 0.0k 0.0k 1.0M 0.0k 0.0k nvme8n20 2024-03-26T17:01:43.074 INFO:tasks.workunit.client.3.smithi157.stdout: 0.03 0.7k 0.0k 0.0k 1.0M 0.0k 0.0k nvme8n3 2024-03-26T17:01:43.074 INFO:tasks.workunit.client.3.smithi157.stdout: 0.03 0.7k 0.0k 0.0k 1.0M 0.0k 0.0k nvme8n4 2024-03-26T17:01:43.074 INFO:tasks.workunit.client.3.smithi157.stdout: 0.03 0.7k 0.0k 0.0k 1.0M 0.0k 0.0k nvme8n5 2024-03-26T17:01:43.075 INFO:tasks.workunit.client.3.smithi157.stdout: 0.03 0.7k 0.0k 0.0k 1.0M 0.0k 0.0k nvme8n6 2024-03-26T17:01:43.075 INFO:tasks.workunit.client.3.smithi157.stdout: 0.03 0.7k 0.0k 0.0k 1.0M 0.0k 0.0k nvme8n7 2024-03-26T17:01:43.075 INFO:tasks.workunit.client.3.smithi157.stdout: 0.03 0.7k 0.0k 0.0k 1.0M 0.0k 0.0k nvme8n8 2024-03-26T17:01:43.075 INFO:tasks.workunit.client.3.smithi157.stdout: 0.03 0.7k 0.0k 0.0k 1.0M 0.0k 0.0k nvme8n9 2024-03-26T17:01:43.075 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:01:43.094 INFO:tasks.workunit.client.3.smithi157.stderr:rbd: waiting for initial image stats 2024-03-26T17:01:43.094 INFO:tasks.workunit.client.3.smithi157.stderr: 2024-03-26T17:01:43.161 INFO:tasks.workunit.client.3.smithi157.stdout:fio --name=nvmeof-fio-test --ioengine=sync --bsrange=4k-64k --numjobs=1 --size=1G --time_based=1 --runtime=600 --rw=randrw --verify=md5 --verify_fatal=1 --direct=1 --filename=/dev/nvme5n1:/dev/nvme2n1:/dev/nvme8n1:/dev/nvme5n2:/dev/nvme2n2:/dev/nvme8n2:/dev/nvme5n3:/dev/nvme2n3:/dev/nvme8n3:/dev/nvme5n4:/dev/nvme2n4:/dev/nvme8n4:/dev/nvme5n5:/dev/nvme2n5:/dev/nvme8n5:/dev/nvme5n6:/dev/nvme2n6:/dev/nvme8n6:/dev/nvme5n7:/dev/nvme2n7:/dev/nvme8n7:/dev/nvme5n8:/dev/nvme2n8:/dev/nvme8n8:/dev/nvme5n9:/dev/nvme2n9:/dev/nvme8n9:/dev/nvme5n10:/dev/nvme2n10:/dev/nvme8n10:/dev/nvme5n11:/dev/nvme2n11:/dev/nvme8n11:/dev/nvme5n12:/dev/nvme2n12:/dev/nvme8n12:/dev/nvme5n13:/dev/nvme2n13:/dev/nvme8n13:/dev/nvme5n14:/dev/nvme2n14:/dev/nvme8n14:/dev/nvme5n15:/dev/nvme2n15:/dev/nvme8n15:/dev/nvme5n16:/dev/nvme2n16:/dev/nvme8n16:/dev/nvme5n17:/dev/nvme2n17:/dev/nvme8n17:/dev/nvme5n18:/dev/nvme2n18:/dev/nvme8n18:/dev/nvme5n19:/dev/nvme2n19:/dev/nvme8n19:/dev/nvme5n20:/dev/nvme2n20:/dev/nvme8n20 2024-03-26T17:01:43.161 INFO:tasks.workunit.client.3.smithi157.stderr:+ sudo fio /tmp/nvmeof-fio-nPHQ 2024-03-26T17:01:43.310 INFO:tasks.workunit.client.3.smithi157.stdout:nvmeof-fio-test: (g=0): rw=randrw, bs=(R) 4096B-64.0KiB, (W) 4096B-64.0KiB, (T) 4096B-64.0KiB, ioengine=sync, iodepth=1 2024-03-26T17:01:43.310 INFO:tasks.workunit.client.3.smithi157.stdout:fio-3.35 2024-03-26T17:01:43.311 INFO:tasks.workunit.client.3.smithi157.stdout:Starting 1 process 2024-03-26T17:01:43.457 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:01:43 smithi064 ceph-mon[34420]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:01:43.457 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:01:43 smithi064 ceph-mon[34420]: { 2024-03-26T17:01:43.457 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:01:43 smithi064 ceph-mon[34420]: "prefix": "rbd perf image stats", 2024-03-26T17:01:43.457 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:01:43 smithi064 ceph-mon[34420]: "pool_spec": "mypool", 2024-03-26T17:01:43.457 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:01:43 smithi064 ceph-mon[34420]: "sort_by": "write_ops", 2024-03-26T17:01:43.457 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:01:43 smithi064 ceph-mon[34420]: "format": "json" 2024-03-26T17:01:43.457 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:01:43 smithi064 ceph-mon[34420]: }"]: dispatch 2024-03-26T17:01:43.458 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:01:43 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:01:43] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:01:43.458 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:01:43 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:01:43] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:01:43.458 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:01:43 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:01:43.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:01:43 smithi044 ceph-mon[30624]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:01:43.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:01:43 smithi044 ceph-mon[30624]: { 2024-03-26T17:01:43.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:01:43 smithi044 ceph-mon[30624]: "prefix": "rbd perf image stats", 2024-03-26T17:01:43.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:01:43 smithi044 ceph-mon[30624]: "pool_spec": "mypool", 2024-03-26T17:01:43.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:01:43 smithi044 ceph-mon[30624]: "sort_by": "write_ops", 2024-03-26T17:01:43.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:01:43 smithi044 ceph-mon[30624]: "format": "json" 2024-03-26T17:01:43.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:01:43 smithi044 ceph-mon[30624]: }"]: dispatch 2024-03-26T17:01:43.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:01:43 smithi149 ceph-mon[34678]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:01:43.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:01:43 smithi149 ceph-mon[34678]: { 2024-03-26T17:01:43.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:01:43 smithi149 ceph-mon[34678]: "prefix": "rbd perf image stats", 2024-03-26T17:01:43.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:01:43 smithi149 ceph-mon[34678]: "pool_spec": "mypool", 2024-03-26T17:01:43.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:01:43 smithi149 ceph-mon[34678]: "sort_by": "write_ops", 2024-03-26T17:01:43.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:01:43 smithi149 ceph-mon[34678]: "format": "json" 2024-03-26T17:01:43.647 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:01:43 smithi149 ceph-mon[34678]: }"]: dispatch 2024-03-26T17:01:44.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:01:44 smithi044 ceph-mon[30624]: Health check update: 7 slow ops, oldest one blocked for 198 sec, daemons [mon.b,mon.c] have slow ops. (SLOW_OPS) 2024-03-26T17:01:44.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:01:44 smithi044 ceph-mon[30624]: pgmap v452: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 34 KiB/s rd, 255 B/s wr, 3 op/s 2024-03-26T17:01:44.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:01:44 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:01:44] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:01:44.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:01:44 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:01:44] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:01:44.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:01:44 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:01:44.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:01:44 smithi064 ceph-mon[34420]: Health check update: 7 slow ops, oldest one blocked for 198 sec, daemons [mon.b,mon.c] have slow ops. (SLOW_OPS) 2024-03-26T17:01:44.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:01:44 smithi064 ceph-mon[34420]: pgmap v452: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 34 KiB/s rd, 255 B/s wr, 3 op/s 2024-03-26T17:01:44.598 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:01:44 smithi149 ceph-mon[34678]: Health check update: 7 slow ops, oldest one blocked for 198 sec, daemons [mon.b,mon.c] have slow ops. (SLOW_OPS) 2024-03-26T17:01:44.598 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:01:44 smithi149 ceph-mon[34678]: pgmap v452: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 34 KiB/s rd, 255 B/s wr, 3 op/s 2024-03-26T17:01:44.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:01:44 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:01:44] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:01:45.027 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:01:44 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:01:44] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:01:45.027 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:01:44 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:01:45.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:01:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-b[34416]: 2024-03-26T17:01:45.284+0000 7ff022916700 -1 mon.b@2(peon) e3 get_health_metrics reporting 4 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T17:01:45.556 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:01:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:01:45] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:01:45.556 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:01:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:01:45] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:01:45.556 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:01:45 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:01:46.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:01:46 smithi044 ceph-mon[30624]: pgmap v453: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 23 KiB/s rd, 682 B/s wr, 3 op/s 2024-03-26T17:01:46.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:01:46 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:01:46] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:01:46.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:01:46 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:01:46] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:01:46.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:01:46 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:01:46.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:01:46 smithi064 ceph-mon[34420]: pgmap v453: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 23 KiB/s rd, 682 B/s wr, 3 op/s 2024-03-26T17:01:46.610 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:01:46 smithi149 ceph-mon[34678]: pgmap v453: 33 pgs: 33 active+clean; 609 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 23 KiB/s rd, 682 B/s wr, 3 op/s 2024-03-26T17:01:46.610 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:01:46 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 2024-03-26T17:01:46.210+0000 7fa707a55700 -1 mon.c@1(peon) e3 get_health_metrics reporting 3 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T17:01:46.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:01:46 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:01:46] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:01:46.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:01:46 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:01:46] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:01:46.897 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:01:46 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:01:47.806 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:01:47 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:01:47] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:01:47.806 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:01:47 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:01:47] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:01:47.806 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:01:47 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:01:48.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:01:48 smithi044 ceph-mon[30624]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:01:48.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:01:48 smithi044 ceph-mon[30624]: { 2024-03-26T17:01:48.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:01:48 smithi044 ceph-mon[30624]: "prefix": "rbd perf image stats", 2024-03-26T17:01:48.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:01:48 smithi044 ceph-mon[30624]: "pool_spec": "mypool", 2024-03-26T17:01:48.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:01:48 smithi044 ceph-mon[30624]: "sort_by": "write_ops", 2024-03-26T17:01:48.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:01:48 smithi044 ceph-mon[30624]: "format": "json" 2024-03-26T17:01:48.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:01:48 smithi044 ceph-mon[30624]: }"]: dispatch 2024-03-26T17:01:48.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:01:48 smithi044 ceph-mon[30624]: pgmap v454: 33 pgs: 33 active+clean; 50 MiB data, 236 MiB used, 715 GiB / 715 GiB avail; 39 KiB/s rd, 90 KiB/s wr, 36 op/s 2024-03-26T17:01:48.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:01:48 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:01:48] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:01:48.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:01:48 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:01:48] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:01:48.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:01:48 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:01:48.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:01:48 smithi064 ceph-mon[34420]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:01:48.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:01:48 smithi064 ceph-mon[34420]: { 2024-03-26T17:01:48.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:01:48 smithi064 ceph-mon[34420]: "prefix": "rbd perf image stats", 2024-03-26T17:01:48.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:01:48 smithi064 ceph-mon[34420]: "pool_spec": "mypool", 2024-03-26T17:01:48.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:01:48 smithi064 ceph-mon[34420]: "sort_by": "write_ops", 2024-03-26T17:01:48.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:01:48 smithi064 ceph-mon[34420]: "format": "json" 2024-03-26T17:01:48.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:01:48 smithi064 ceph-mon[34420]: }"]: dispatch 2024-03-26T17:01:48.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:01:48 smithi064 ceph-mon[34420]: pgmap v454: 33 pgs: 33 active+clean; 50 MiB data, 236 MiB used, 715 GiB / 715 GiB avail; 39 KiB/s rd, 90 KiB/s wr, 36 op/s 2024-03-26T17:01:48.622 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:01:48 smithi149 ceph-mon[34678]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:01:48.623 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:01:48 smithi149 ceph-mon[34678]: { 2024-03-26T17:01:48.623 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:01:48 smithi149 ceph-mon[34678]: "prefix": "rbd perf image stats", 2024-03-26T17:01:48.623 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:01:48 smithi149 ceph-mon[34678]: "pool_spec": "mypool", 2024-03-26T17:01:48.623 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:01:48 smithi149 ceph-mon[34678]: "sort_by": "write_ops", 2024-03-26T17:01:48.623 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:01:48 smithi149 ceph-mon[34678]: "format": "json" 2024-03-26T17:01:48.623 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:01:48 smithi149 ceph-mon[34678]: }"]: dispatch 2024-03-26T17:01:48.623 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:01:48 smithi149 ceph-mon[34678]: pgmap v454: 33 pgs: 33 active+clean; 50 MiB data, 236 MiB used, 715 GiB / 715 GiB avail; 39 KiB/s rd, 90 KiB/s wr, 36 op/s 2024-03-26T17:01:48.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:01:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:01:48] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:01:48.897 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:01:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:01:48] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:01:48.897 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:01:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:01:49.456 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:01:49 smithi064 ceph-mon[34420]: Health check update: 7 slow ops, oldest one blocked for 203 sec, daemons [mon.b,mon.c] have slow ops. (SLOW_OPS) 2024-03-26T17:01:49.457 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:01:49 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:01:49] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:01:49.457 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:01:49 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:01:49] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:01:49.457 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:01:49 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:01:49.514 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:01:49 smithi044 ceph-mon[30624]: Health check update: 7 slow ops, oldest one blocked for 203 sec, daemons [mon.b,mon.c] have slow ops. (SLOW_OPS) 2024-03-26T17:01:49.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:01:49 smithi149 ceph-mon[34678]: Health check update: 7 slow ops, oldest one blocked for 203 sec, daemons [mon.b,mon.c] have slow ops. (SLOW_OPS) 2024-03-26T17:01:50.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:01:50 smithi044 ceph-mon[30624]: pgmap v455: 33 pgs: 33 active+clean; 407 MiB data, 269 MiB used, 715 GiB / 715 GiB avail; 544 KiB/s rd, 1.3 MiB/s wr, 213 op/s 2024-03-26T17:01:50.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:01:50 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:01:50] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:01:50.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:01:50 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:01:50] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:01:50.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:01:50 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:01:50.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:01:50 smithi064 ceph-mon[34420]: pgmap v455: 33 pgs: 33 active+clean; 407 MiB data, 269 MiB used, 715 GiB / 715 GiB avail; 544 KiB/s rd, 1.3 MiB/s wr, 213 op/s 2024-03-26T17:01:50.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:01:50 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-b[34416]: 2024-03-26T17:01:50.284+0000 7ff022916700 -1 mon.b@2(peon) e3 get_health_metrics reporting 4 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T17:01:50.635 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:01:50 smithi149 ceph-mon[34678]: pgmap v455: 33 pgs: 33 active+clean; 407 MiB data, 269 MiB used, 715 GiB / 715 GiB avail; 544 KiB/s rd, 1.3 MiB/s wr, 213 op/s 2024-03-26T17:01:50.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:01:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:01:50] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:01:50.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:01:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:01:50] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:01:50.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:01:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:01:51.556 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:01:51 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:01:51] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:01:51.556 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:01:51 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:01:51] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:01:51.556 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:01:51 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:01:51.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:01:51 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 2024-03-26T17:01:51.210+0000 7fa707a55700 -1 mon.c@1(peon) e3 get_health_metrics reporting 3 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T17:01:52.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:01:52 smithi044 ceph-mon[30624]: pgmap v456: 33 pgs: 33 active+clean; 592 MiB data, 299 MiB used, 715 GiB / 715 GiB avail; 1.0 MiB/s rd, 2.3 MiB/s wr, 289 op/s 2024-03-26T17:01:52.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:01:52 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:01:52] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:01:52.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:01:52 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:01:52] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:01:52.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:01:52 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:01:52.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:01:52 smithi064 ceph-mon[34420]: pgmap v456: 33 pgs: 33 active+clean; 592 MiB data, 299 MiB used, 715 GiB / 715 GiB avail; 1.0 MiB/s rd, 2.3 MiB/s wr, 289 op/s 2024-03-26T17:01:52.645 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:01:52 smithi149 ceph-mon[34678]: pgmap v456: 33 pgs: 33 active+clean; 592 MiB data, 299 MiB used, 715 GiB / 715 GiB avail; 1.0 MiB/s rd, 2.3 MiB/s wr, 289 op/s 2024-03-26T17:01:53.061 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:01:53.069 INFO:tasks.workunit.client.3.smithi157.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2024-03-26T17:01:53.069 INFO:tasks.workunit.client.3.smithi157.stdout: 13.70 262.8k 140.0k 0.0k 2.6M 1.4M 0.0k nvme2n1 2024-03-26T17:01:53.070 INFO:tasks.workunit.client.3.smithi157.stdout: 13.60 266.4k 117.2k 0.0k 2.6M 1.1M 0.0k nvme2n10 2024-03-26T17:01:53.070 INFO:tasks.workunit.client.3.smithi157.stdout: 13.60 233.6k 136.0k 0.0k 2.3M 1.3M 0.0k nvme2n11 2024-03-26T17:01:53.070 INFO:tasks.workunit.client.3.smithi157.stdout: 13.60 251.2k 131.2k 0.0k 2.5M 1.3M 0.0k nvme2n12 2024-03-26T17:01:53.070 INFO:tasks.workunit.client.3.smithi157.stdout: 13.60 270.0k 109.2k 0.0k 2.6M 1.1M 0.0k nvme2n13 2024-03-26T17:01:53.070 INFO:tasks.workunit.client.3.smithi157.stdout: 13.60 243.2k 136.0k 0.0k 2.4M 1.3M 0.0k nvme2n14 2024-03-26T17:01:53.070 INFO:tasks.workunit.client.3.smithi157.stdout: 13.60 260.4k 108.4k 0.0k 2.5M 1.1M 0.0k nvme2n15 2024-03-26T17:01:53.070 INFO:tasks.workunit.client.3.smithi157.stdout: 13.60 250.4k 115.6k 0.0k 2.4M 1.1M 0.0k nvme2n16 2024-03-26T17:01:53.070 INFO:tasks.workunit.client.3.smithi157.stdout: 13.60 207.2k 148.8k 0.0k 2.0M 1.5M 0.0k nvme2n17 2024-03-26T17:01:53.070 INFO:tasks.workunit.client.3.smithi157.stdout: 13.60 226.8k 150.0k 0.0k 2.2M 1.5M 0.0k nvme2n18 2024-03-26T17:01:53.070 INFO:tasks.workunit.client.3.smithi157.stdout: 13.60 206.8k 180.8k 0.0k 2.0M 1.8M 0.0k nvme2n19 2024-03-26T17:01:53.071 INFO:tasks.workunit.client.3.smithi157.stdout: 13.70 246.4k 136.8k 0.0k 2.4M 1.3M 0.0k nvme2n2 2024-03-26T17:01:53.071 INFO:tasks.workunit.client.3.smithi157.stdout: 13.60 262.8k 114.4k 0.0k 2.6M 1.1M 0.0k nvme2n20 2024-03-26T17:01:53.071 INFO:tasks.workunit.client.3.smithi157.stdout: 13.70 236.0k 132.4k 0.0k 2.3M 1.3M 0.0k nvme2n3 2024-03-26T17:01:53.071 INFO:tasks.workunit.client.3.smithi157.stdout: 13.70 250.4k 139.2k 0.0k 2.4M 1.4M 0.0k nvme2n4 2024-03-26T17:01:53.071 INFO:tasks.workunit.client.3.smithi157.stdout: 13.70 246.4k 117.6k 0.0k 2.4M 1.1M 0.0k nvme2n5 2024-03-26T17:01:53.071 INFO:tasks.workunit.client.3.smithi157.stdout: 13.70 218.8k 169.2k 0.0k 2.1M 1.7M 0.0k nvme2n6 2024-03-26T17:01:53.071 INFO:tasks.workunit.client.3.smithi157.stdout: 13.60 253.2k 129.6k 0.0k 2.5M 1.3M 0.0k nvme2n7 2024-03-26T17:01:53.071 INFO:tasks.workunit.client.3.smithi157.stdout: 13.60 248.0k 117.2k 0.0k 2.4M 1.1M 0.0k nvme2n8 2024-03-26T17:01:53.071 INFO:tasks.workunit.client.3.smithi157.stdout: 13.60 217.6k 172.8k 0.0k 2.1M 1.7M 0.0k nvme2n9 2024-03-26T17:01:53.071 INFO:tasks.workunit.client.3.smithi157.stdout: 13.70 209.6k 154.4k 0.0k 2.0M 1.5M 0.0k nvme5n1 2024-03-26T17:01:53.071 INFO:tasks.workunit.client.3.smithi157.stdout: 13.60 224.8k 150.0k 0.0k 2.2M 1.5M 0.0k nvme5n10 2024-03-26T17:01:53.071 INFO:tasks.workunit.client.3.smithi157.stdout: 13.60 220.0k 135.6k 0.0k 2.1M 1.3M 0.0k nvme5n11 2024-03-26T17:01:53.071 INFO:tasks.workunit.client.3.smithi157.stdout: 13.60 226.0k 126.0k 0.0k 2.2M 1.2M 0.0k nvme5n12 2024-03-26T17:01:53.071 INFO:tasks.workunit.client.3.smithi157.stdout: 13.60 225.6k 159.6k 0.0k 2.2M 1.6M 0.0k nvme5n13 2024-03-26T17:01:53.072 INFO:tasks.workunit.client.3.smithi157.stdout: 13.60 215.2k 134.0k 0.0k 2.1M 1.3M 0.0k nvme5n14 2024-03-26T17:01:53.072 INFO:tasks.workunit.client.3.smithi157.stdout: 13.60 276.8k 124.0k 0.0k 2.7M 1.2M 0.0k nvme5n15 2024-03-26T17:01:53.072 INFO:tasks.workunit.client.3.smithi157.stdout: 13.60 286.8k 132.4k 0.0k 2.8M 1.3M 0.0k nvme5n16 2024-03-26T17:01:53.072 INFO:tasks.workunit.client.3.smithi157.stdout: 13.60 259.2k 130.4k 0.0k 2.5M 1.3M 0.0k nvme5n17 2024-03-26T17:01:53.072 INFO:tasks.workunit.client.3.smithi157.stdout: 13.60 237.2k 142.8k 0.0k 2.3M 1.4M 0.0k nvme5n18 2024-03-26T17:01:53.072 INFO:tasks.workunit.client.3.smithi157.stdout: 13.60 249.2k 141.6k 0.0k 2.4M 1.4M 0.0k nvme5n19 2024-03-26T17:01:53.072 INFO:tasks.workunit.client.3.smithi157.stdout: 13.70 205.6k 169.2k 0.0k 2.0M 1.7M 0.0k nvme5n2 2024-03-26T17:01:53.072 INFO:tasks.workunit.client.3.smithi157.stdout: 13.60 235.2k 137.6k 0.0k 2.3M 1.3M 0.0k nvme5n20 2024-03-26T17:01:53.072 INFO:tasks.workunit.client.3.smithi157.stdout: 13.70 241.2k 106.0k 0.0k 2.4M 1.0M 0.0k nvme5n3 2024-03-26T17:01:53.072 INFO:tasks.workunit.client.3.smithi157.stdout: 13.70 270.8k 112.4k 0.0k 2.6M 1.1M 0.0k nvme5n4 2024-03-26T17:01:53.072 INFO:tasks.workunit.client.3.smithi157.stdout: 13.70 244.4k 134.4k 0.0k 2.4M 1.3M 0.0k nvme5n5 2024-03-26T17:01:53.072 INFO:tasks.workunit.client.3.smithi157.stdout: 13.70 254.8k 140.0k 0.0k 2.5M 1.4M 0.0k nvme5n6 2024-03-26T17:01:53.072 INFO:tasks.workunit.client.3.smithi157.stdout: 13.60 238.4k 146.8k 0.0k 2.3M 1.4M 0.0k nvme5n7 2024-03-26T17:01:53.073 INFO:tasks.workunit.client.3.smithi157.stdout: 13.60 224.0k 155.2k 0.0k 2.2M 1.5M 0.0k nvme5n8 2024-03-26T17:01:53.073 INFO:tasks.workunit.client.3.smithi157.stdout: 13.60 246.8k 153.2k 0.0k 2.4M 1.5M 0.0k nvme5n9 2024-03-26T17:01:53.073 INFO:tasks.workunit.client.3.smithi157.stdout: 13.70 238.4k 111.2k 0.0k 2.3M 1.1M 0.0k nvme8n1 2024-03-26T17:01:53.073 INFO:tasks.workunit.client.3.smithi157.stdout: 13.60 218.0k 142.4k 0.0k 2.1M 1.4M 0.0k nvme8n10 2024-03-26T17:01:53.073 INFO:tasks.workunit.client.3.smithi157.stdout: 13.60 260.4k 144.0k 0.0k 2.5M 1.4M 0.0k nvme8n11 2024-03-26T17:01:53.073 INFO:tasks.workunit.client.3.smithi157.stdout: 13.60 241.6k 140.0k 0.0k 2.4M 1.4M 0.0k nvme8n12 2024-03-26T17:01:53.073 INFO:tasks.workunit.client.3.smithi157.stdout: 13.60 236.4k 114.8k 0.0k 2.3M 1.1M 0.0k nvme8n13 2024-03-26T17:01:53.073 INFO:tasks.workunit.client.3.smithi157.stdout: 13.60 261.6k 165.2k 0.0k 2.6M 1.6M 0.0k nvme8n14 2024-03-26T17:01:53.073 INFO:tasks.workunit.client.3.smithi157.stdout: 13.60 221.2k 133.2k 0.0k 2.2M 1.3M 0.0k nvme8n15 2024-03-26T17:01:53.073 INFO:tasks.workunit.client.3.smithi157.stdout: 13.60 247.6k 155.2k 0.0k 2.4M 1.5M 0.0k nvme8n16 2024-03-26T17:01:53.073 INFO:tasks.workunit.client.3.smithi157.stdout: 13.60 254.4k 150.8k 0.0k 2.5M 1.5M 0.0k nvme8n17 2024-03-26T17:01:53.073 INFO:tasks.workunit.client.3.smithi157.stdout: 13.60 233.6k 170.0k 0.0k 2.3M 1.7M 0.0k nvme8n18 2024-03-26T17:01:53.073 INFO:tasks.workunit.client.3.smithi157.stdout: 13.60 244.8k 126.4k 0.0k 2.4M 1.2M 0.0k nvme8n19 2024-03-26T17:01:53.073 INFO:tasks.workunit.client.3.smithi157.stdout: 13.70 236.8k 141.6k 0.0k 2.3M 1.4M 0.0k nvme8n2 2024-03-26T17:01:53.073 INFO:tasks.workunit.client.3.smithi157.stdout: 13.60 222.8k 152.8k 0.0k 2.2M 1.5M 0.0k nvme8n20 2024-03-26T17:01:53.074 INFO:tasks.workunit.client.3.smithi157.stdout: 13.70 244.4k 170.0k 0.0k 2.4M 1.7M 0.0k nvme8n3 2024-03-26T17:01:53.074 INFO:tasks.workunit.client.3.smithi157.stdout: 13.70 200.4k 153.2k 0.0k 2.0M 1.5M 0.0k nvme8n4 2024-03-26T17:01:53.074 INFO:tasks.workunit.client.3.smithi157.stdout: 13.70 227.2k 167.6k 0.0k 2.2M 1.6M 0.0k nvme8n5 2024-03-26T17:01:53.074 INFO:tasks.workunit.client.3.smithi157.stdout: 13.60 264.4k 114.0k 0.0k 2.6M 1.1M 0.0k nvme8n6 2024-03-26T17:01:53.074 INFO:tasks.workunit.client.3.smithi157.stdout: 13.60 233.2k 150.8k 0.0k 2.3M 1.5M 0.0k nvme8n7 2024-03-26T17:01:53.074 INFO:tasks.workunit.client.3.smithi157.stdout: 13.60 244.0k 142.8k 0.0k 2.4M 1.4M 0.0k nvme8n8 2024-03-26T17:01:53.074 INFO:tasks.workunit.client.3.smithi157.stdout: 13.60 227.6k 132.8k 0.0k 2.2M 1.3M 0.0k nvme8n9 2024-03-26T17:01:53.074 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:01:53.101 INFO:tasks.workunit.client.3.smithi157.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-26T17:01:53.101 INFO:tasks.workunit.client.3.smithi157.stdout:myimage3 7/s 6/s 210 KiB/s 136 KiB/s 920.06 us 153.04 us 2024-03-26T17:01:53.101 INFO:tasks.workunit.client.3.smithi157.stdout:myimage48 6/s 5/s 218 KiB/s 122 KiB/s 932.98 us 154.55 us 2024-03-26T17:01:53.101 INFO:tasks.workunit.client.3.smithi157.stdout:myimage49 6/s 6/s 191 KiB/s 146 KiB/s 946.39 us 165.01 us 2024-03-26T17:01:53.101 INFO:tasks.workunit.client.3.smithi157.stdout:myimage34 6/s 4/s 166 KiB/s 118 KiB/s 895.12 us 153.46 us 2024-03-26T17:01:53.101 INFO:tasks.workunit.client.3.smithi157.stdout:myimage31 5/s 5/s 176 KiB/s 108 KiB/s 925.08 us 149.71 us 2024-03-26T17:01:53.101 INFO:tasks.workunit.client.3.smithi157.stdout:myimage37 5/s 4/s 170 KiB/s 56 KiB/s 966.39 us 154.65 us 2024-03-26T17:01:53.101 INFO:tasks.workunit.client.3.smithi157.stdout:myimage22 5/s 3/s 180 KiB/s 24 KiB/s 968.94 us 165.19 us 2024-03-26T17:01:53.101 INFO:tasks.workunit.client.3.smithi157.stdout:myimage40 5/s 4/s 182 KiB/s 43 KiB/s 917.73 us 159.79 us 2024-03-26T17:01:53.101 INFO:tasks.workunit.client.3.smithi157.stdout:myimage52 5/s 4/s 160 KiB/s 95 KiB/s 960.49 us 151.13 us 2024-03-26T17:01:53.102 INFO:tasks.workunit.client.3.smithi157.stdout:myimage2 5/s 4/s 156 KiB/s 110 KiB/s 939.75 us 154.11 us 2024-03-26T17:01:53.102 INFO:tasks.workunit.client.3.smithi157.stdout:myimage30 5/s 4/s 168 KiB/s 62 KiB/s 964.31 us 158.53 us 2024-03-26T17:01:53.102 INFO:tasks.workunit.client.3.smithi157.stdout:myimage44 5/s 3/s 162 KiB/s 32 KiB/s 920.36 us 152.07 us 2024-03-26T17:01:53.102 INFO:tasks.workunit.client.3.smithi157.stdout:myimage47 5/s 5/s 196 KiB/s 110 KiB/s 950.26 us 162.20 us 2024-03-26T17:01:53.102 INFO:tasks.workunit.client.3.smithi157.stdout:myimage13 4/s 4/s 139 KiB/s 107 KiB/s 899.70 us 161.44 us 2024-03-26T17:01:53.102 INFO:tasks.workunit.client.3.smithi157.stdout:myimage58 4/s 4/s 170 KiB/s 73 KiB/s 941.05 us 155.40 us 2024-03-26T17:01:53.102 INFO:tasks.workunit.client.3.smithi157.stdout:myimage23 4/s 3/s 130 KiB/s 62 KiB/s 917.69 us 149.12 us 2024-03-26T17:01:53.102 INFO:tasks.workunit.client.3.smithi157.stdout:myimage14 4/s 5/s 133 KiB/s 113 KiB/s 942.19 us 155.47 us 2024-03-26T17:01:53.102 INFO:tasks.workunit.client.3.smithi157.stdout:myimage16 4/s 4/s 137 KiB/s 26 KiB/s 905.36 us 150.26 us 2024-03-26T17:01:53.102 INFO:tasks.workunit.client.3.smithi157.stdout:myimage35 4/s 4/s 134 KiB/s 102 KiB/s 912.92 us 152.27 us 2024-03-26T17:01:53.102 INFO:tasks.workunit.client.3.smithi157.stdout:myimage32 4/s 2/s 131 KiB/s 81 KiB/s 971.22 us 154.36 us 2024-03-26T17:01:53.102 INFO:tasks.workunit.client.3.smithi157.stdout:myimage38 4/s 2/s 138 KiB/s 54 KiB/s 966.99 us 159.80 us 2024-03-26T17:01:53.102 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:01:53.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:01:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:01:52] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:01:53.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:01:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:01:52] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:01:53.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:01:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:01:53.456 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:01:53 smithi064 ceph-mon[34420]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:01:53.457 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:01:53 smithi064 ceph-mon[34420]: { 2024-03-26T17:01:53.457 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:01:53 smithi064 ceph-mon[34420]: "prefix": "rbd perf image stats", 2024-03-26T17:01:53.457 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:01:53 smithi064 ceph-mon[34420]: "pool_spec": "mypool", 2024-03-26T17:01:53.457 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:01:53 smithi064 ceph-mon[34420]: "sort_by": "write_ops", 2024-03-26T17:01:53.457 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:01:53 smithi064 ceph-mon[34420]: "format": "json" 2024-03-26T17:01:53.457 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:01:53 smithi064 ceph-mon[34420]: }"]: dispatch 2024-03-26T17:01:53.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:01:53 smithi044 ceph-mon[30624]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:01:53.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:01:53 smithi044 ceph-mon[30624]: { 2024-03-26T17:01:53.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:01:53 smithi044 ceph-mon[30624]: "prefix": "rbd perf image stats", 2024-03-26T17:01:53.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:01:53 smithi044 ceph-mon[30624]: "pool_spec": "mypool", 2024-03-26T17:01:53.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:01:53 smithi044 ceph-mon[30624]: "sort_by": "write_ops", 2024-03-26T17:01:53.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:01:53 smithi044 ceph-mon[30624]: "format": "json" 2024-03-26T17:01:53.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:01:53 smithi044 ceph-mon[30624]: }"]: dispatch 2024-03-26T17:01:53.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:01:53 smithi149 ceph-mon[34678]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:01:53.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:01:53 smithi149 ceph-mon[34678]: { 2024-03-26T17:01:53.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:01:53 smithi149 ceph-mon[34678]: "prefix": "rbd perf image stats", 2024-03-26T17:01:53.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:01:53 smithi149 ceph-mon[34678]: "pool_spec": "mypool", 2024-03-26T17:01:53.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:01:53 smithi149 ceph-mon[34678]: "sort_by": "write_ops", 2024-03-26T17:01:53.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:01:53 smithi149 ceph-mon[34678]: "format": "json" 2024-03-26T17:01:53.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:01:53 smithi149 ceph-mon[34678]: }"]: dispatch 2024-03-26T17:01:53.806 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:01:53 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:01:53] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:01:53.806 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:01:53 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:01:53] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:01:53.806 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:01:53 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:01:54.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:01:54 smithi044 ceph-mon[30624]: Health check update: 7 slow ops, oldest one blocked for 208 sec, daemons [mon.b,mon.c] have slow ops. (SLOW_OPS) 2024-03-26T17:01:54.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:01:54 smithi044 ceph-mon[30624]: pgmap v457: 33 pgs: 33 active+clean; 881 MiB data, 455 MiB used, 715 GiB / 715 GiB avail; 3.4 MiB/s rd, 5.7 MiB/s wr, 580 op/s 2024-03-26T17:01:54.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:01:54 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:01:54] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:01:54.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:01:54 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:01:54] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:01:54.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:01:54 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:01:54.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:01:54 smithi064 ceph-mon[34420]: Health check update: 7 slow ops, oldest one blocked for 208 sec, daemons [mon.b,mon.c] have slow ops. (SLOW_OPS) 2024-03-26T17:01:54.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:01:54 smithi064 ceph-mon[34420]: pgmap v457: 33 pgs: 33 active+clean; 881 MiB data, 455 MiB used, 715 GiB / 715 GiB avail; 3.4 MiB/s rd, 5.7 MiB/s wr, 580 op/s 2024-03-26T17:01:54.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:01:54 smithi149 ceph-mon[34678]: Health check update: 7 slow ops, oldest one blocked for 208 sec, daemons [mon.b,mon.c] have slow ops. (SLOW_OPS) 2024-03-26T17:01:54.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:01:54 smithi149 ceph-mon[34678]: pgmap v457: 33 pgs: 33 active+clean; 881 MiB data, 455 MiB used, 715 GiB / 715 GiB avail; 3.4 MiB/s rd, 5.7 MiB/s wr, 580 op/s 2024-03-26T17:01:55.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:01:54 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:01:54] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:01:55.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:01:54 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:01:54] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:01:55.147 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:01:54 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:01:55.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:01:55 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-b[34416]: 2024-03-26T17:01:55.284+0000 7ff022916700 -1 mon.b@2(peon) e3 get_health_metrics reporting 4 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T17:01:55.556 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:01:55 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:01:55] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:01:55.556 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:01:55 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:01:55] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:01:55.556 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:01:55 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:01:56.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:01:56 smithi044 ceph-mon[30624]: pgmap v458: 33 pgs: 33 active+clean; 928 MiB data, 523 MiB used, 715 GiB / 715 GiB avail; 5.0 MiB/s rd, 7.8 MiB/s wr, 715 op/s 2024-03-26T17:01:56.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:01:56 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:01:56] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:01:56.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:01:56 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:01:56] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:01:56.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:01:56 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:01:56.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:01:56 smithi064 ceph-mon[34420]: pgmap v458: 33 pgs: 33 active+clean; 928 MiB data, 523 MiB used, 715 GiB / 715 GiB avail; 5.0 MiB/s rd, 7.8 MiB/s wr, 715 op/s 2024-03-26T17:01:56.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:01:56 smithi149 ceph-mon[34678]: pgmap v458: 33 pgs: 33 active+clean; 928 MiB data, 523 MiB used, 715 GiB / 715 GiB avail; 5.0 MiB/s rd, 7.8 MiB/s wr, 715 op/s 2024-03-26T17:01:56.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:01:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 2024-03-26T17:01:56.211+0000 7fa707a55700 -1 mon.c@1(peon) e3 get_health_metrics reporting 3 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T17:01:57.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:01:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:01:56] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:01:57.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:01:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:01:56] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:01:57.147 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:01:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:01:57.806 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:01:57 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:01:57] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:01:57.806 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:01:57 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:01:57] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:01:57.806 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:01:57 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:01:58.106 INFO:tasks.workunit.client.3.smithi157.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-26T17:01:58.106 INFO:tasks.workunit.client.3.smithi157.stdout:myimage39 11/s 6/s 333 KiB/s 149 KiB/s 954.34 us 164.83 us 2024-03-26T17:01:58.106 INFO:tasks.workunit.client.3.smithi157.stdout:myimage58 10/s 6/s 318 KiB/s 148 KiB/s 941.64 us 149.56 us 2024-03-26T17:01:58.106 INFO:tasks.workunit.client.3.smithi157.stdout:myimage28 10/s 6/s 316 KiB/s 150 KiB/s 979.32 us 153.55 us 2024-03-26T17:01:58.106 INFO:tasks.workunit.client.3.smithi157.stdout:myimage30 9/s 6/s 247 KiB/s 138 KiB/s 936.73 us 158.15 us 2024-03-26T17:01:58.106 INFO:tasks.workunit.client.3.smithi157.stdout:myimage6 9/s 7/s 278 KiB/s 221 KiB/s 948.25 us 163.83 us 2024-03-26T17:01:58.106 INFO:tasks.workunit.client.3.smithi157.stdout:myimage8 9/s 7/s 296 KiB/s 146 KiB/s 966.99 us 155.28 us 2024-03-26T17:01:58.106 INFO:tasks.workunit.client.3.smithi157.stdout:myimage11 9/s 8/s 302 KiB/s 218 KiB/s 966.42 us 162.91 us 2024-03-26T17:01:58.106 INFO:tasks.workunit.client.3.smithi157.stdout:myimage19 9/s 7/s 336 KiB/s 174 KiB/s 961.25 us 167.35 us 2024-03-26T17:01:58.106 INFO:tasks.workunit.client.3.smithi157.stdout:myimage21 9/s 5/s 286 KiB/s 101 KiB/s 958.97 us 156.22 us 2024-03-26T17:01:58.106 INFO:tasks.workunit.client.3.smithi157.stdout:myimage17 9/s 8/s 272 KiB/s 195 KiB/s 977.24 us 162.63 us 2024-03-26T17:01:58.107 INFO:tasks.workunit.client.3.smithi157.stdout:myimage41 9/s 7/s 225 KiB/s 173 KiB/s 951.70 us 160.48 us 2024-03-26T17:01:58.107 INFO:tasks.workunit.client.3.smithi157.stdout:myimage51 9/s 7/s 278 KiB/s 200 KiB/s 957.93 us 154.51 us 2024-03-26T17:01:58.107 INFO:tasks.workunit.client.3.smithi157.stdout:myimage31 8/s 6/s 252 KiB/s 173 KiB/s 949.84 us 161.74 us 2024-03-26T17:01:58.107 INFO:tasks.workunit.client.3.smithi157.stdout:myimage44 8/s 7/s 299 KiB/s 186 KiB/s 943.70 us 157.41 us 2024-03-26T17:01:58.107 INFO:tasks.workunit.client.3.smithi157.stdout:myimage52 8/s 8/s 278 KiB/s 172 KiB/s 982.70 us 159.39 us 2024-03-26T17:01:58.107 INFO:tasks.workunit.client.3.smithi157.stdout:myimage20 8/s 7/s 270 KiB/s 153 KiB/s 952.25 us 159.62 us 2024-03-26T17:01:58.107 INFO:tasks.workunit.client.3.smithi157.stdout:myimage22 8/s 6/s 241 KiB/s 144 KiB/s 974.33 us 167.15 us 2024-03-26T17:01:58.107 INFO:tasks.workunit.client.3.smithi157.stdout:myimage12 8/s 6/s 254 KiB/s 178 KiB/s 942.90 us 166.42 us 2024-03-26T17:01:58.107 INFO:tasks.workunit.client.3.smithi157.stdout:myimage59 8/s 8/s 273 KiB/s 202 KiB/s 917.68 us 154.14 us 2024-03-26T17:01:58.107 INFO:tasks.workunit.client.3.smithi157.stdout:myimage35 8/s 6/s 262 KiB/s 121 KiB/s 964.13 us 163.94 us 2024-03-26T17:01:58.107 INFO:tasks.workunit.client.3.smithi157.stdout:myimage53 8/s 8/s 238 KiB/s 238 KiB/s 935.91 us 160.16 us 2024-03-26T17:01:58.107 INFO:tasks.workunit.client.3.smithi157.stdout:myimage54 8/s 7/s 262 KiB/s 192 KiB/s 964.74 us 160.80 us 2024-03-26T17:01:58.107 INFO:tasks.workunit.client.3.smithi157.stdout:myimage56 8/s 7/s 273 KiB/s 163 KiB/s 972.81 us 157.38 us 2024-03-26T17:01:58.108 INFO:tasks.workunit.client.3.smithi157.stdout:myimage16 8/s 8/s 226 KiB/s 217 KiB/s 930.78 us 161.18 us 2024-03-26T17:01:58.108 INFO:tasks.workunit.client.3.smithi157.stdout:myimage38 8/s 8/s 252 KiB/s 194 KiB/s 953.78 us 159.83 us 2024-03-26T17:01:58.108 INFO:tasks.workunit.client.3.smithi157.stdout:myimage15 8/s 7/s 248 KiB/s 195 KiB/s 955.33 us 160.04 us 2024-03-26T17:01:58.108 INFO:tasks.workunit.client.3.smithi157.stdout:myimage27 8/s 7/s 262 KiB/s 185 KiB/s 929.10 us 157.01 us 2024-03-26T17:01:58.108 INFO:tasks.workunit.client.3.smithi157.stdout:myimage29 8/s 7/s 264 KiB/s 207 KiB/s 936.74 us 167.66 us 2024-03-26T17:01:58.108 INFO:tasks.workunit.client.3.smithi157.stdout:myimage57 8/s 7/s 238 KiB/s 178 KiB/s 976.53 us 161.36 us 2024-03-26T17:01:58.108 INFO:tasks.workunit.client.3.smithi157.stdout:myimage49 7/s 6/s 245 KiB/s 133 KiB/s 980.84 us 156.76 us 2024-03-26T17:01:58.108 INFO:tasks.workunit.client.3.smithi157.stdout:myimage18 7/s 6/s 305 KiB/s 89 KiB/s 965.00 us 164.27 us 2024-03-26T17:01:58.108 INFO:tasks.workunit.client.3.smithi157.stdout:myimage24 7/s 9/s 175 KiB/s 200 KiB/s 952.18 us 149.96 us 2024-03-26T17:01:58.108 INFO:tasks.workunit.client.3.smithi157.stdout:myimage48 7/s 7/s 219 KiB/s 142 KiB/s 962.67 us 152.18 us 2024-03-26T17:01:58.108 INFO:tasks.workunit.client.3.smithi157.stdout:myimage4 7/s 8/s 220 KiB/s 208 KiB/s 943.80 us 168.63 us 2024-03-26T17:01:58.108 INFO:tasks.workunit.client.3.smithi157.stdout:myimage26 7/s 7/s 208 KiB/s 198 KiB/s 956.58 us 157.47 us 2024-03-26T17:01:58.108 INFO:tasks.workunit.client.3.smithi157.stdout:myimage36 7/s 7/s 245 KiB/s 197 KiB/s 937.45 us 162.77 us 2024-03-26T17:01:58.108 INFO:tasks.workunit.client.3.smithi157.stdout:myimage46 7/s 8/s 210 KiB/s 239 KiB/s 956.11 us 160.51 us 2024-03-26T17:01:58.108 INFO:tasks.workunit.client.3.smithi157.stdout:myimage50 7/s 9/s 235 KiB/s 219 KiB/s 997.26 us 159.97 us 2024-03-26T17:01:58.109 INFO:tasks.workunit.client.3.smithi157.stdout:myimage55 7/s 8/s 213 KiB/s 182 KiB/s 962.34 us 162.89 us 2024-03-26T17:01:58.109 INFO:tasks.workunit.client.3.smithi157.stdout:myimage47 7/s 7/s 218 KiB/s 208 KiB/s 934.93 us 153.34 us 2024-03-26T17:01:58.109 INFO:tasks.workunit.client.3.smithi157.stdout:myimage1 7/s 7/s 255 KiB/s 204 KiB/s 956.46 us 160.69 us 2024-03-26T17:01:58.109 INFO:tasks.workunit.client.3.smithi157.stdout:myimage5 7/s 9/s 218 KiB/s 217 KiB/s 947.19 us 158.75 us 2024-03-26T17:01:58.109 INFO:tasks.workunit.client.3.smithi157.stdout:myimage7 7/s 8/s 255 KiB/s 190 KiB/s 953.33 us 160.71 us 2024-03-26T17:01:58.109 INFO:tasks.workunit.client.3.smithi157.stdout:myimage9 7/s 7/s 248 KiB/s 211 KiB/s 943.85 us 164.61 us 2024-03-26T17:01:58.109 INFO:tasks.workunit.client.3.smithi157.stdout:myimage25 7/s 6/s 207 KiB/s 160 KiB/s 995.50 us 157.95 us 2024-03-26T17:01:58.109 INFO:tasks.workunit.client.3.smithi157.stdout:myimage42 7/s 7/s 231 KiB/s 222 KiB/s 937.45 us 164.47 us 2024-03-26T17:01:58.109 INFO:tasks.workunit.client.3.smithi157.stdout:myimage33 7/s 8/s 244 KiB/s 196 KiB/s 975.53 us 156.05 us 2024-03-26T17:01:58.109 INFO:tasks.workunit.client.3.smithi157.stdout:myimage45 7/s 8/s 246 KiB/s 187 KiB/s 971.99 us 157.65 us 2024-03-26T17:01:58.109 INFO:tasks.workunit.client.3.smithi157.stdout:myimage10 7/s 8/s 230 KiB/s 222 KiB/s 952.41 us 164.76 us 2024-03-26T17:01:58.109 INFO:tasks.workunit.client.3.smithi157.stdout:myimage3 7/s 8/s 219 KiB/s 230 KiB/s 937.89 us 155.09 us 2024-03-26T17:01:58.109 INFO:tasks.workunit.client.3.smithi157.stdout:myimage14 7/s 8/s 242 KiB/s 178 KiB/s 940.89 us 152.55 us 2024-03-26T17:01:58.109 INFO:tasks.workunit.client.3.smithi157.stdout:myimage34 7/s 6/s 224 KiB/s 169 KiB/s 919.95 us 162.49 us 2024-03-26T17:01:58.109 INFO:tasks.workunit.client.3.smithi157.stdout:myimage40 7/s 8/s 200 KiB/s 181 KiB/s 931.00 us 172.25 us 2024-03-26T17:01:58.110 INFO:tasks.workunit.client.3.smithi157.stdout:myimage43 7/s 7/s 217 KiB/s 179 KiB/s 967.04 us 154.02 us 2024-03-26T17:01:58.110 INFO:tasks.workunit.client.3.smithi157.stdout:myimage2 6/s 6/s 191 KiB/s 170 KiB/s 955.25 us 162.52 us 2024-03-26T17:01:58.110 INFO:tasks.workunit.client.3.smithi157.stdout:myimage13 6/s 10/s 185 KiB/s 263 KiB/s 940.96 us 161.46 us 2024-03-26T17:01:58.110 INFO:tasks.workunit.client.3.smithi157.stdout:myimage32 6/s 7/s 175 KiB/s 163 KiB/s 943.80 us 164.31 us 2024-03-26T17:01:58.110 INFO:tasks.workunit.client.3.smithi157.stdout:myimage60 6/s 10/s 199 KiB/s 229 KiB/s 924.83 us 155.99 us 2024-03-26T17:01:58.110 INFO:tasks.workunit.client.3.smithi157.stdout:myimage23 6/s 11/s 168 KiB/s 266 KiB/s 913.50 us 165.75 us 2024-03-26T17:01:58.110 INFO:tasks.workunit.client.3.smithi157.stdout:myimage37 5/s 12/s 179 KiB/s 332 KiB/s 966.04 us 166.09 us 2024-03-26T17:01:58.110 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:01:58.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:01:58 smithi044 ceph-mon[30624]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:01:58.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:01:58 smithi044 ceph-mon[30624]: { 2024-03-26T17:01:58.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:01:58 smithi044 ceph-mon[30624]: "prefix": "rbd perf image stats", 2024-03-26T17:01:58.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:01:58 smithi044 ceph-mon[30624]: "pool_spec": "mypool", 2024-03-26T17:01:58.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:01:58 smithi044 ceph-mon[30624]: "sort_by": "write_ops", 2024-03-26T17:01:58.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:01:58 smithi044 ceph-mon[30624]: "format": "json" 2024-03-26T17:01:58.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:01:58 smithi044 ceph-mon[30624]: }"]: dispatch 2024-03-26T17:01:58.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:01:58 smithi044 ceph-mon[30624]: pgmap v459: 33 pgs: 33 active+clean; 954 MiB data, 612 MiB used, 715 GiB / 715 GiB avail; 6.7 MiB/s rd, 9.8 MiB/s wr, 863 op/s 2024-03-26T17:01:58.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:01:58 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:01:58] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:01:58.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:01:58 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:01:58] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:01:58.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:01:58 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:01:58.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:01:58 smithi064 ceph-mon[34420]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:01:58.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:01:58 smithi064 ceph-mon[34420]: { 2024-03-26T17:01:58.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:01:58 smithi064 ceph-mon[34420]: "prefix": "rbd perf image stats", 2024-03-26T17:01:58.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:01:58 smithi064 ceph-mon[34420]: "pool_spec": "mypool", 2024-03-26T17:01:58.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:01:58 smithi064 ceph-mon[34420]: "sort_by": "write_ops", 2024-03-26T17:01:58.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:01:58 smithi064 ceph-mon[34420]: "format": "json" 2024-03-26T17:01:58.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:01:58 smithi064 ceph-mon[34420]: }"]: dispatch 2024-03-26T17:01:58.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:01:58 smithi064 ceph-mon[34420]: pgmap v459: 33 pgs: 33 active+clean; 954 MiB data, 612 MiB used, 715 GiB / 715 GiB avail; 6.7 MiB/s rd, 9.8 MiB/s wr, 863 op/s 2024-03-26T17:01:58.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:01:58 smithi149 ceph-mon[34678]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:01:58.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:01:58 smithi149 ceph-mon[34678]: { 2024-03-26T17:01:58.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:01:58 smithi149 ceph-mon[34678]: "prefix": "rbd perf image stats", 2024-03-26T17:01:58.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:01:58 smithi149 ceph-mon[34678]: "pool_spec": "mypool", 2024-03-26T17:01:58.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:01:58 smithi149 ceph-mon[34678]: "sort_by": "write_ops", 2024-03-26T17:01:58.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:01:58 smithi149 ceph-mon[34678]: "format": "json" 2024-03-26T17:01:58.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:01:58 smithi149 ceph-mon[34678]: }"]: dispatch 2024-03-26T17:01:58.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:01:58 smithi149 ceph-mon[34678]: pgmap v459: 33 pgs: 33 active+clean; 954 MiB data, 612 MiB used, 715 GiB / 715 GiB avail; 6.7 MiB/s rd, 9.8 MiB/s wr, 863 op/s 2024-03-26T17:01:59.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:01:58 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:01:58] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:01:59.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:01:58 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:01:58] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:01:59.147 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:01:58 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:01:59.493 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:01:59 smithi064 ceph-mon[34420]: Health check update: 7 slow ops, oldest one blocked for 213 sec, daemons [mon.b,mon.c] have slow ops. (SLOW_OPS) 2024-03-26T17:01:59.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:01:59 smithi044 ceph-mon[30624]: Health check update: 7 slow ops, oldest one blocked for 213 sec, daemons [mon.b,mon.c] have slow ops. (SLOW_OPS) 2024-03-26T17:01:59.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:01:59 smithi149 ceph-mon[34678]: Health check update: 7 slow ops, oldest one blocked for 213 sec, daemons [mon.b,mon.c] have slow ops. (SLOW_OPS) 2024-03-26T17:01:59.805 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:01:59 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:01:59] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:01:59.806 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:01:59 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:01:59] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:01:59.806 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:01:59 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:02:00.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:00 smithi044 ceph-mon[30624]: pgmap v460: 33 pgs: 33 active+clean; 972 MiB data, 728 MiB used, 715 GiB / 715 GiB avail; 9.2 MiB/s rd, 13 MiB/s wr, 1.04k op/s 2024-03-26T17:02:00.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:02:00 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:02:00] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:02:00.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:02:00 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:02:00] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:02:00.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:02:00 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:02:00.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:00 smithi064 ceph-mon[34420]: pgmap v460: 33 pgs: 33 active+clean; 972 MiB data, 728 MiB used, 715 GiB / 715 GiB avail; 9.2 MiB/s rd, 13 MiB/s wr, 1.04k op/s 2024-03-26T17:02:00.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:00 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-b[34416]: 2024-03-26T17:02:00.285+0000 7ff022916700 -1 mon.b@2(peon) e3 get_health_metrics reporting 4 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T17:02:00.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:00 smithi149 ceph-mon[34678]: pgmap v460: 33 pgs: 33 active+clean; 972 MiB data, 728 MiB used, 715 GiB / 715 GiB avail; 9.2 MiB/s rd, 13 MiB/s wr, 1.04k op/s 2024-03-26T17:02:01.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:02:00 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:02:00] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:02:01.147 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:02:00 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:02:00] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:02:01.147 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:02:00 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:02:01.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:01 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 2024-03-26T17:02:01.210+0000 7fa707a55700 -1 mon.c@1(peon) e3 get_health_metrics reporting 3 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T17:02:01.806 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:02:01 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:02:01] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:02:01.806 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:02:01 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:02:01] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:02:01.806 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:02:01 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:02:02.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:02 smithi044 ceph-mon[30624]: pgmap v461: 33 pgs: 33 active+clean; 978 MiB data, 771 MiB used, 714 GiB / 715 GiB avail; 9.7 MiB/s rd, 13 MiB/s wr, 947 op/s 2024-03-26T17:02:02.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:02:02 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:02:02] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:02:02.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:02:02 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:02:02] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:02:02.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:02:02 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:02:02.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:02 smithi064 ceph-mon[34420]: pgmap v461: 33 pgs: 33 active+clean; 978 MiB data, 771 MiB used, 714 GiB / 715 GiB avail; 9.7 MiB/s rd, 13 MiB/s wr, 947 op/s 2024-03-26T17:02:02.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:02 smithi149 ceph-mon[34678]: pgmap v461: 33 pgs: 33 active+clean; 978 MiB data, 771 MiB used, 714 GiB / 715 GiB avail; 9.7 MiB/s rd, 13 MiB/s wr, 947 op/s 2024-03-26T17:02:03.061 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:02:03.069 INFO:tasks.workunit.client.3.smithi157.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2024-03-26T17:02:03.069 INFO:tasks.workunit.client.3.smithi157.stdout: 15.80 196.4k 260.8k 0.0k 1.9M 2.5M 0.0k nvme2n1 2024-03-26T17:02:03.069 INFO:tasks.workunit.client.3.smithi157.stdout: 15.80 244.0k 230.8k 0.0k 2.4M 2.3M 0.0k nvme2n10 2024-03-26T17:02:03.070 INFO:tasks.workunit.client.3.smithi157.stdout: 15.80 250.8k 254.0k 0.0k 2.4M 2.5M 0.0k nvme2n11 2024-03-26T17:02:03.070 INFO:tasks.workunit.client.3.smithi157.stdout: 15.80 186.0k 255.2k 0.0k 1.8M 2.5M 0.0k nvme2n12 2024-03-26T17:02:03.070 INFO:tasks.workunit.client.3.smithi157.stdout: 15.80 263.2k 206.0k 0.0k 2.6M 2.0M 0.0k nvme2n13 2024-03-26T17:02:03.070 INFO:tasks.workunit.client.3.smithi157.stdout: 15.80 211.2k 251.6k 0.0k 2.1M 2.5M 0.0k nvme2n14 2024-03-26T17:02:03.070 INFO:tasks.workunit.client.3.smithi157.stdout: 15.80 236.0k 214.0k 0.0k 2.3M 2.1M 0.0k nvme2n15 2024-03-26T17:02:03.070 INFO:tasks.workunit.client.3.smithi157.stdout: 15.80 218.4k 212.4k 0.0k 2.1M 2.1M 0.0k nvme2n16 2024-03-26T17:02:03.070 INFO:tasks.workunit.client.3.smithi157.stdout: 15.80 235.6k 226.0k 0.0k 2.3M 2.2M 0.0k nvme2n17 2024-03-26T17:02:03.070 INFO:tasks.workunit.client.3.smithi157.stdout: 15.80 206.8k 241.6k 0.0k 2.0M 2.4M 0.0k nvme2n18 2024-03-26T17:02:03.070 INFO:tasks.workunit.client.3.smithi157.stdout: 15.80 236.8k 218.4k 0.0k 2.3M 2.1M 0.0k nvme2n19 2024-03-26T17:02:03.070 INFO:tasks.workunit.client.3.smithi157.stdout: 15.80 212.8k 226.8k 0.0k 2.1M 2.2M 0.0k nvme2n2 2024-03-26T17:02:03.070 INFO:tasks.workunit.client.3.smithi157.stdout: 15.80 223.6k 258.0k 0.0k 2.2M 2.5M 0.0k nvme2n20 2024-03-26T17:02:03.070 INFO:tasks.workunit.client.3.smithi157.stdout: 15.80 197.2k 242.4k 0.0k 1.9M 2.4M 0.0k nvme2n3 2024-03-26T17:02:03.070 INFO:tasks.workunit.client.3.smithi157.stdout: 15.70 231.2k 208.8k 0.0k 2.3M 2.0M 0.0k nvme2n4 2024-03-26T17:02:03.071 INFO:tasks.workunit.client.3.smithi157.stdout: 15.70 277.6k 169.6k 0.0k 2.7M 1.7M 0.0k nvme2n5 2024-03-26T17:02:03.071 INFO:tasks.workunit.client.3.smithi157.stdout: 15.70 237.2k 215.6k 0.0k 2.3M 2.1M 0.0k nvme2n6 2024-03-26T17:02:03.071 INFO:tasks.workunit.client.3.smithi157.stdout: 15.80 243.2k 234.0k 0.0k 2.4M 2.3M 0.0k nvme2n7 2024-03-26T17:02:03.071 INFO:tasks.workunit.client.3.smithi157.stdout: 15.80 238.4k 195.6k 0.0k 2.3M 1.9M 0.0k nvme2n8 2024-03-26T17:02:03.071 INFO:tasks.workunit.client.3.smithi157.stdout: 15.80 248.8k 225.2k 0.0k 2.4M 2.2M 0.0k nvme2n9 2024-03-26T17:02:03.071 INFO:tasks.workunit.client.3.smithi157.stdout: 15.80 221.2k 265.6k 0.0k 2.2M 2.6M 0.0k nvme5n1 2024-03-26T17:02:03.071 INFO:tasks.workunit.client.3.smithi157.stdout: 15.80 244.0k 208.8k 0.0k 2.4M 2.0M 0.0k nvme5n10 2024-03-26T17:02:03.071 INFO:tasks.workunit.client.3.smithi157.stdout: 15.80 222.8k 196.8k 0.0k 2.2M 1.9M 0.0k nvme5n11 2024-03-26T17:02:03.071 INFO:tasks.workunit.client.3.smithi157.stdout: 15.80 231.6k 226.0k 0.0k 2.3M 2.2M 0.0k nvme5n12 2024-03-26T17:02:03.071 INFO:tasks.workunit.client.3.smithi157.stdout: 15.80 236.4k 214.8k 0.0k 2.3M 2.1M 0.0k nvme5n13 2024-03-26T17:02:03.071 INFO:tasks.workunit.client.3.smithi157.stdout: 15.80 218.8k 246.8k 0.0k 2.1M 2.4M 0.0k nvme5n14 2024-03-26T17:02:03.071 INFO:tasks.workunit.client.3.smithi157.stdout: 15.80 220.0k 205.2k 0.0k 2.1M 2.0M 0.0k nvme5n15 2024-03-26T17:02:03.071 INFO:tasks.workunit.client.3.smithi157.stdout: 15.80 232.8k 201.2k 0.0k 2.3M 2.0M 0.0k nvme5n16 2024-03-26T17:02:03.072 INFO:tasks.workunit.client.3.smithi157.stdout: 15.80 244.8k 218.8k 0.0k 2.4M 2.1M 0.0k nvme5n17 2024-03-26T17:02:03.072 INFO:tasks.workunit.client.3.smithi157.stdout: 15.80 190.0k 228.4k 0.0k 1.9M 2.2M 0.0k nvme5n18 2024-03-26T17:02:03.072 INFO:tasks.workunit.client.3.smithi157.stdout: 15.80 209.6k 260.4k 0.0k 2.0M 2.5M 0.0k nvme5n19 2024-03-26T17:02:03.072 INFO:tasks.workunit.client.3.smithi157.stdout: 15.80 244.0k 203.2k 0.0k 2.4M 2.0M 0.0k nvme5n2 2024-03-26T17:02:03.072 INFO:tasks.workunit.client.3.smithi157.stdout: 15.80 249.2k 192.0k 0.0k 2.4M 1.9M 0.0k nvme5n20 2024-03-26T17:02:03.072 INFO:tasks.workunit.client.3.smithi157.stdout: 15.80 245.2k 206.0k 0.0k 2.4M 2.0M 0.0k nvme5n3 2024-03-26T17:02:03.072 INFO:tasks.workunit.client.3.smithi157.stdout: 15.70 234.4k 210.4k 0.0k 2.3M 2.1M 0.0k nvme5n4 2024-03-26T17:02:03.072 INFO:tasks.workunit.client.3.smithi157.stdout: 15.70 234.0k 221.2k 0.0k 2.3M 2.2M 0.0k nvme5n5 2024-03-26T17:02:03.072 INFO:tasks.workunit.client.3.smithi157.stdout: 15.70 198.8k 215.2k 0.0k 1.9M 2.1M 0.0k nvme5n6 2024-03-26T17:02:03.072 INFO:tasks.workunit.client.3.smithi157.stdout: 15.80 222.8k 229.2k 0.0k 2.2M 2.2M 0.0k nvme5n7 2024-03-26T17:02:03.072 INFO:tasks.workunit.client.3.smithi157.stdout: 15.80 149.6k 268.0k 0.0k 1.5M 2.6M 0.0k nvme5n8 2024-03-26T17:02:03.072 INFO:tasks.workunit.client.3.smithi157.stdout: 15.80 212.4k 237.6k 0.0k 2.1M 2.3M 0.0k nvme5n9 2024-03-26T17:02:03.072 INFO:tasks.workunit.client.3.smithi157.stdout: 15.80 217.6k 256.0k 0.0k 2.1M 2.5M 0.0k nvme8n1 2024-03-26T17:02:03.072 INFO:tasks.workunit.client.3.smithi157.stdout: 15.80 243.6k 196.4k 0.0k 2.4M 1.9M 0.0k nvme8n10 2024-03-26T17:02:03.073 INFO:tasks.workunit.client.3.smithi157.stdout: 15.80 211.2k 246.4k 0.0k 2.1M 2.4M 0.0k nvme8n11 2024-03-26T17:02:03.073 INFO:tasks.workunit.client.3.smithi157.stdout: 15.80 192.4k 244.4k 0.0k 1.9M 2.4M 0.0k nvme8n12 2024-03-26T17:02:03.073 INFO:tasks.workunit.client.3.smithi157.stdout: 15.80 208.4k 220.4k 0.0k 2.0M 2.2M 0.0k nvme8n13 2024-03-26T17:02:03.073 INFO:tasks.workunit.client.3.smithi157.stdout: 15.80 218.8k 230.8k 0.0k 2.1M 2.3M 0.0k nvme8n14 2024-03-26T17:02:03.073 INFO:tasks.workunit.client.3.smithi157.stdout: 15.80 232.4k 229.2k 0.0k 2.3M 2.2M 0.0k nvme8n15 2024-03-26T17:02:03.073 INFO:tasks.workunit.client.3.smithi157.stdout: 15.80 241.6k 218.4k 0.0k 2.4M 2.1M 0.0k nvme8n16 2024-03-26T17:02:03.073 INFO:tasks.workunit.client.3.smithi157.stdout: 15.80 224.8k 194.8k 0.0k 2.2M 1.9M 0.0k nvme8n17 2024-03-26T17:02:03.073 INFO:tasks.workunit.client.3.smithi157.stdout: 15.80 200.4k 240.0k 0.0k 2.0M 2.3M 0.0k nvme8n18 2024-03-26T17:02:03.073 INFO:tasks.workunit.client.3.smithi157.stdout: 15.80 189.6k 275.6k 0.0k 1.9M 2.7M 0.0k nvme8n19 2024-03-26T17:02:03.073 INFO:tasks.workunit.client.3.smithi157.stdout: 15.80 223.6k 216.8k 0.0k 2.2M 2.1M 0.0k nvme8n2 2024-03-26T17:02:03.073 INFO:tasks.workunit.client.3.smithi157.stdout: 15.80 284.8k 176.4k 0.0k 2.8M 1.7M 0.0k nvme8n20 2024-03-26T17:02:03.073 INFO:tasks.workunit.client.3.smithi157.stdout: 15.80 236.4k 178.8k 0.0k 2.3M 1.7M 0.0k nvme8n3 2024-03-26T17:02:03.073 INFO:tasks.workunit.client.3.smithi157.stdout: 15.70 241.2k 240.0k 0.0k 2.4M 2.3M 0.0k nvme8n4 2024-03-26T17:02:03.073 INFO:tasks.workunit.client.3.smithi157.stdout: 15.70 222.8k 214.4k 0.0k 2.2M 2.1M 0.0k nvme8n5 2024-03-26T17:02:03.073 INFO:tasks.workunit.client.3.smithi157.stdout: 15.80 248.8k 220.4k 0.0k 2.4M 2.2M 0.0k nvme8n6 2024-03-26T17:02:03.073 INFO:tasks.workunit.client.3.smithi157.stdout: 15.80 295.2k 174.8k 0.0k 2.9M 1.7M 0.0k nvme8n7 2024-03-26T17:02:03.074 INFO:tasks.workunit.client.3.smithi157.stdout: 15.80 219.6k 216.8k 0.0k 2.1M 2.1M 0.0k nvme8n8 2024-03-26T17:02:03.074 INFO:tasks.workunit.client.3.smithi157.stdout: 15.80 246.0k 208.0k 0.0k 2.4M 2.0M 0.0k nvme8n9 2024-03-26T17:02:03.074 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:02:03.111 INFO:tasks.workunit.client.3.smithi157.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-26T17:02:03.111 INFO:tasks.workunit.client.3.smithi157.stdout:myimage1 11/s 6/s 317 KiB/s 194 KiB/s 985.96 us 162.86 us 2024-03-26T17:02:03.111 INFO:tasks.workunit.client.3.smithi157.stdout:myimage2 9/s 7/s 295 KiB/s 171 KiB/s 999.04 us 162.58 us 2024-03-26T17:02:03.111 INFO:tasks.workunit.client.3.smithi157.stdout:myimage34 9/s 6/s 275 KiB/s 183 KiB/s 987.53 us 153.09 us 2024-03-26T17:02:03.111 INFO:tasks.workunit.client.3.smithi157.stdout:myimage52 9/s 7/s 250 KiB/s 158 KiB/s 986.72 us 148.84 us 2024-03-26T17:02:03.111 INFO:tasks.workunit.client.3.smithi157.stdout:myimage31 9/s 8/s 198 KiB/s 213 KiB/s 983.27 us 173.15 us 2024-03-26T17:02:03.111 INFO:tasks.workunit.client.3.smithi157.stdout:myimage41 9/s 8/s 321 KiB/s 194 KiB/s 984.94 us 157.47 us 2024-03-26T17:02:03.111 INFO:tasks.workunit.client.3.smithi157.stdout:myimage42 9/s 7/s 253 KiB/s 198 KiB/s 984.22 us 162.55 us 2024-03-26T17:02:03.111 INFO:tasks.workunit.client.3.smithi157.stdout:myimage57 9/s 7/s 214 KiB/s 206 KiB/s 956.00 us 162.09 us 2024-03-26T17:02:03.112 INFO:tasks.workunit.client.3.smithi157.stdout:myimage59 9/s 6/s 269 KiB/s 178 KiB/s 976.24 us 158.66 us 2024-03-26T17:02:03.112 INFO:tasks.workunit.client.3.smithi157.stdout:myimage6 9/s 6/s 241 KiB/s 185 KiB/s 974.86 us 162.77 us 2024-03-26T17:02:03.112 INFO:tasks.workunit.client.3.smithi157.stdout:myimage7 9/s 7/s 242 KiB/s 200 KiB/s 998.05 us 159.36 us 2024-03-26T17:02:03.112 INFO:tasks.workunit.client.3.smithi157.stdout:myimage12 9/s 7/s 274 KiB/s 157 KiB/s 1.00 ms 165.49 us 2024-03-26T17:02:03.112 INFO:tasks.workunit.client.3.smithi157.stdout:myimage37 8/s 6/s 254 KiB/s 165 KiB/s 968.10 us 157.97 us 2024-03-26T17:02:03.112 INFO:tasks.workunit.client.3.smithi157.stdout:myimage18 8/s 7/s 222 KiB/s 203 KiB/s 959.86 us 168.81 us 2024-03-26T17:02:03.112 INFO:tasks.workunit.client.3.smithi157.stdout:myimage25 8/s 8/s 210 KiB/s 278 KiB/s 1.00 ms 169.94 us 2024-03-26T17:02:03.112 INFO:tasks.workunit.client.3.smithi157.stdout:myimage3 8/s 7/s 254 KiB/s 143 KiB/s 950.07 us 151.75 us 2024-03-26T17:02:03.112 INFO:tasks.workunit.client.3.smithi157.stdout:myimage22 8/s 9/s 257 KiB/s 248 KiB/s 1.01 ms 160.75 us 2024-03-26T17:02:03.112 INFO:tasks.workunit.client.3.smithi157.stdout:myimage4 8/s 6/s 261 KiB/s 172 KiB/s 959.84 us 169.92 us 2024-03-26T17:02:03.112 INFO:tasks.workunit.client.3.smithi157.stdout:myimage20 8/s 7/s 240 KiB/s 197 KiB/s 960.20 us 155.00 us 2024-03-26T17:02:03.112 INFO:tasks.workunit.client.3.smithi157.stdout:myimage56 8/s 8/s 267 KiB/s 188 KiB/s 995.16 us 158.59 us 2024-03-26T17:02:03.112 INFO:tasks.workunit.client.3.smithi157.stdout:myimage32 8/s 9/s 282 KiB/s 251 KiB/s 1.16 ms 163.65 us 2024-03-26T17:02:03.112 INFO:tasks.workunit.client.3.smithi157.stdout:myimage28 8/s 6/s 227 KiB/s 115 KiB/s 1.02 ms 169.51 us 2024-03-26T17:02:03.113 INFO:tasks.workunit.client.3.smithi157.stdout:myimage33 8/s 9/s 222 KiB/s 199 KiB/s 994.78 us 157.79 us 2024-03-26T17:02:03.113 INFO:tasks.workunit.client.3.smithi157.stdout:myimage9 8/s 8/s 221 KiB/s 211 KiB/s 979.04 us 156.25 us 2024-03-26T17:02:03.113 INFO:tasks.workunit.client.3.smithi157.stdout:myimage27 8/s 8/s 226 KiB/s 214 KiB/s 945.38 us 165.89 us 2024-03-26T17:02:03.113 INFO:tasks.workunit.client.3.smithi157.stdout:myimage29 8/s 8/s 239 KiB/s 186 KiB/s 972.70 us 164.71 us 2024-03-26T17:02:03.113 INFO:tasks.workunit.client.3.smithi157.stdout:myimage39 8/s 8/s 219 KiB/s 186 KiB/s 986.50 us 163.89 us 2024-03-26T17:02:03.113 INFO:tasks.workunit.client.3.smithi157.stdout:myimage38 7/s 7/s 213 KiB/s 171 KiB/s 957.54 us 158.70 us 2024-03-26T17:02:03.113 INFO:tasks.workunit.client.3.smithi157.stdout:myimage44 7/s 8/s 205 KiB/s 215 KiB/s 989.57 us 164.80 us 2024-03-26T17:02:03.113 INFO:tasks.workunit.client.3.smithi157.stdout:myimage48 7/s 6/s 198 KiB/s 158 KiB/s 950.74 us 158.03 us 2024-03-26T17:02:03.113 INFO:tasks.workunit.client.3.smithi157.stdout:myimage11 7/s 7/s 257 KiB/s 193 KiB/s 993.78 us 156.66 us 2024-03-26T17:02:03.113 INFO:tasks.workunit.client.3.smithi157.stdout:myimage46 7/s 6/s 230 KiB/s 149 KiB/s 1.01 ms 150.40 us 2024-03-26T17:02:03.113 INFO:tasks.workunit.client.3.smithi157.stdout:myimage53 7/s 8/s 234 KiB/s 223 KiB/s 968.43 us 161.21 us 2024-03-26T17:02:03.113 INFO:tasks.workunit.client.3.smithi157.stdout:myimage14 7/s 8/s 199 KiB/s 188 KiB/s 956.84 us 152.36 us 2024-03-26T17:02:03.113 INFO:tasks.workunit.client.3.smithi157.stdout:myimage23 7/s 7/s 208 KiB/s 184 KiB/s 936.36 us 153.09 us 2024-03-26T17:02:03.114 INFO:tasks.workunit.client.3.smithi157.stdout:myimage58 7/s 7/s 216 KiB/s 178 KiB/s 964.76 us 166.31 us 2024-03-26T17:02:03.114 INFO:tasks.workunit.client.3.smithi157.stdout:myimage17 7/s 8/s 237 KiB/s 178 KiB/s 982.20 us 157.62 us 2024-03-26T17:02:03.114 INFO:tasks.workunit.client.3.smithi157.stdout:myimage26 7/s 8/s 202 KiB/s 182 KiB/s 977.08 us 157.71 us 2024-03-26T17:02:03.114 INFO:tasks.workunit.client.3.smithi157.stdout:myimage36 7/s 9/s 200 KiB/s 234 KiB/s 952.74 us 159.59 us 2024-03-26T17:02:03.114 INFO:tasks.workunit.client.3.smithi157.stdout:myimage45 7/s 8/s 221 KiB/s 180 KiB/s 988.21 us 159.92 us 2024-03-26T17:02:03.114 INFO:tasks.workunit.client.3.smithi157.stdout:myimage54 7/s 7/s 230 KiB/s 142 KiB/s 998.16 us 160.53 us 2024-03-26T17:02:03.114 INFO:tasks.workunit.client.3.smithi157.stdout:myimage30 7/s 7/s 201 KiB/s 191 KiB/s 1.03 ms 161.25 us 2024-03-26T17:02:03.114 INFO:tasks.workunit.client.3.smithi157.stdout:myimage24 7/s 8/s 225 KiB/s 163 KiB/s 976.04 us 151.69 us 2024-03-26T17:02:03.114 INFO:tasks.workunit.client.3.smithi157.stdout:myimage50 7/s 7/s 202 KiB/s 206 KiB/s 985.53 us 159.71 us 2024-03-26T17:02:03.114 INFO:tasks.workunit.client.3.smithi157.stdout:myimage16 7/s 9/s 201 KiB/s 233 KiB/s 953.82 us 161.60 us 2024-03-26T17:02:03.114 INFO:tasks.workunit.client.3.smithi157.stdout:myimage35 7/s 8/s 169 KiB/s 173 KiB/s 948.62 us 153.70 us 2024-03-26T17:02:03.114 INFO:tasks.workunit.client.3.smithi157.stdout:myimage40 7/s 9/s 217 KiB/s 231 KiB/s 983.22 us 162.49 us 2024-03-26T17:02:03.114 INFO:tasks.workunit.client.3.smithi157.stdout:myimage15 7/s 7/s 191 KiB/s 179 KiB/s 949.15 us 159.77 us 2024-03-26T17:02:03.114 INFO:tasks.workunit.client.3.smithi157.stdout:myimage43 7/s 9/s 181 KiB/s 219 KiB/s 963.88 us 165.74 us 2024-03-26T17:02:03.115 INFO:tasks.workunit.client.3.smithi157.stdout:myimage55 7/s 8/s 218 KiB/s 209 KiB/s 960.85 us 161.75 us 2024-03-26T17:02:03.115 INFO:tasks.workunit.client.3.smithi157.stdout:myimage5 6/s 8/s 166 KiB/s 218 KiB/s 978.35 us 160.45 us 2024-03-26T17:02:03.115 INFO:tasks.workunit.client.3.smithi157.stdout:myimage10 6/s 7/s 212 KiB/s 236 KiB/s 986.54 us 165.66 us 2024-03-26T17:02:03.115 INFO:tasks.workunit.client.3.smithi157.stdout:myimage13 6/s 9/s 212 KiB/s 222 KiB/s 947.08 us 165.04 us 2024-03-26T17:02:03.115 INFO:tasks.workunit.client.3.smithi157.stdout:myimage51 6/s 8/s 194 KiB/s 195 KiB/s 1.01 ms 161.42 us 2024-03-26T17:02:03.115 INFO:tasks.workunit.client.3.smithi157.stdout:myimage47 6/s 8/s 158 KiB/s 192 KiB/s 966.06 us 162.22 us 2024-03-26T17:02:03.115 INFO:tasks.workunit.client.3.smithi157.stdout:myimage8 6/s 8/s 159 KiB/s 214 KiB/s 973.35 us 163.27 us 2024-03-26T17:02:03.115 INFO:tasks.workunit.client.3.smithi157.stdout:myimage19 6/s 8/s 188 KiB/s 246 KiB/s 973.73 us 157.78 us 2024-03-26T17:02:03.115 INFO:tasks.workunit.client.3.smithi157.stdout:myimage49 6/s 10/s 190 KiB/s 254 KiB/s 993.02 us 154.61 us 2024-03-26T17:02:03.115 INFO:tasks.workunit.client.3.smithi157.stdout:myimage21 6/s 9/s 182 KiB/s 254 KiB/s 978.25 us 167.76 us 2024-03-26T17:02:03.115 INFO:tasks.workunit.client.3.smithi157.stdout:myimage60 5/s 10/s 157 KiB/s 255 KiB/s 980.20 us 164.20 us 2024-03-26T17:02:03.115 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:02:03.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:02:02 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:02:02] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:02:03.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:02:02 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:02:02] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:02:03.147 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:02:02 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:02:03.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:03 smithi044 ceph-mon[30624]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:02:03.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:03 smithi044 ceph-mon[30624]: { 2024-03-26T17:02:03.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:03 smithi044 ceph-mon[30624]: "prefix": "rbd perf image stats", 2024-03-26T17:02:03.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:03 smithi044 ceph-mon[30624]: "pool_spec": "mypool", 2024-03-26T17:02:03.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:03 smithi044 ceph-mon[30624]: "sort_by": "write_ops", 2024-03-26T17:02:03.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:03 smithi044 ceph-mon[30624]: "format": "json" 2024-03-26T17:02:03.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:03 smithi044 ceph-mon[30624]: }"]: dispatch 2024-03-26T17:02:03.517 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:03 smithi064 ceph-mon[34420]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:02:03.517 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:03 smithi064 ceph-mon[34420]: { 2024-03-26T17:02:03.517 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:03 smithi064 ceph-mon[34420]: "prefix": "rbd perf image stats", 2024-03-26T17:02:03.518 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:03 smithi064 ceph-mon[34420]: "pool_spec": "mypool", 2024-03-26T17:02:03.518 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:03 smithi064 ceph-mon[34420]: "sort_by": "write_ops", 2024-03-26T17:02:03.518 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:03 smithi064 ceph-mon[34420]: "format": "json" 2024-03-26T17:02:03.518 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:03 smithi064 ceph-mon[34420]: }"]: dispatch 2024-03-26T17:02:03.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:03 smithi149 ceph-mon[34678]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:02:03.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:03 smithi149 ceph-mon[34678]: { 2024-03-26T17:02:03.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:03 smithi149 ceph-mon[34678]: "prefix": "rbd perf image stats", 2024-03-26T17:02:03.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:03 smithi149 ceph-mon[34678]: "pool_spec": "mypool", 2024-03-26T17:02:03.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:03 smithi149 ceph-mon[34678]: "sort_by": "write_ops", 2024-03-26T17:02:03.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:03 smithi149 ceph-mon[34678]: "format": "json" 2024-03-26T17:02:03.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:03 smithi149 ceph-mon[34678]: }"]: dispatch 2024-03-26T17:02:03.806 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:02:03 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:02:03] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:02:03.806 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:02:03 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:02:03] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:02:03.806 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:02:03 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:02:04.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:04 smithi044 ceph-mon[30624]: Health check update: 7 slow ops, oldest one blocked for 218 sec, daemons [mon.b,mon.c] have slow ops. (SLOW_OPS) 2024-03-26T17:02:04.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:04 smithi044 ceph-mon[30624]: pgmap v462: 33 pgs: 33 active+clean; 990 MiB data, 892 MiB used, 714 GiB / 715 GiB avail; 12 MiB/s rd, 15 MiB/s wr, 1.10k op/s 2024-03-26T17:02:04.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:02:04 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:02:04] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:02:04.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:02:04 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:02:04] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:02:04.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:02:04 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:02:04.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:04 smithi064 ceph-mon[34420]: Health check update: 7 slow ops, oldest one blocked for 218 sec, daemons [mon.b,mon.c] have slow ops. (SLOW_OPS) 2024-03-26T17:02:04.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:04 smithi064 ceph-mon[34420]: pgmap v462: 33 pgs: 33 active+clean; 990 MiB data, 892 MiB used, 714 GiB / 715 GiB avail; 12 MiB/s rd, 15 MiB/s wr, 1.10k op/s 2024-03-26T17:02:04.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:04 smithi149 ceph-mon[34678]: Health check update: 7 slow ops, oldest one blocked for 218 sec, daemons [mon.b,mon.c] have slow ops. (SLOW_OPS) 2024-03-26T17:02:04.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:04 smithi149 ceph-mon[34678]: pgmap v462: 33 pgs: 33 active+clean; 990 MiB data, 892 MiB used, 714 GiB / 715 GiB avail; 12 MiB/s rd, 15 MiB/s wr, 1.10k op/s 2024-03-26T17:02:05.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:02:04 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:02:04] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:02:05.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:02:04 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:02:04] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:02:05.147 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:02:04 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:02:05.537 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-b[34416]: 2024-03-26T17:02:05.285+0000 7ff022916700 -1 mon.b@2(peon) e3 get_health_metrics reporting 4 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T17:02:05.537 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:02:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:02:05] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:02:05.806 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:02:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:02:05] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:02:05.806 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:02:05 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:02:06.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:06 smithi044 ceph-mon[30624]: pgmap v463: 33 pgs: 33 active+clean; 994 MiB data, 927 MiB used, 714 GiB / 715 GiB avail; 11 MiB/s rd, 13 MiB/s wr, 937 op/s 2024-03-26T17:02:06.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:02:06 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:02:06] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:02:06.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:02:06 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:02:06] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:02:06.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:02:06 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:02:06.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:06 smithi064 ceph-mon[34420]: pgmap v463: 33 pgs: 33 active+clean; 994 MiB data, 927 MiB used, 714 GiB / 715 GiB avail; 11 MiB/s rd, 13 MiB/s wr, 937 op/s 2024-03-26T17:02:06.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:06 smithi149 ceph-mon[34678]: pgmap v463: 33 pgs: 33 active+clean; 994 MiB data, 927 MiB used, 714 GiB / 715 GiB avail; 11 MiB/s rd, 13 MiB/s wr, 937 op/s 2024-03-26T17:02:06.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 2024-03-26T17:02:06.211+0000 7fa707a55700 -1 mon.c@1(peon) e3 get_health_metrics reporting 3 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T17:02:07.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:02:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:02:06] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:02:07.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:02:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:02:06] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:02:07.147 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:02:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:02:07.806 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:02:07 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:02:07] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:02:07.806 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:02:07 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:02:07] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:02:07.806 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:02:07 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:02:08.115 INFO:tasks.workunit.client.3.smithi157.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-26T17:02:08.115 INFO:tasks.workunit.client.3.smithi157.stdout:myimage21 11/s 6/s 324 KiB/s 127 KiB/s 1.04 ms 160.65 us 2024-03-26T17:02:08.115 INFO:tasks.workunit.client.3.smithi157.stdout:myimage26 9/s 7/s 268 KiB/s 158 KiB/s 1.00 ms 155.34 us 2024-03-26T17:02:08.115 INFO:tasks.workunit.client.3.smithi157.stdout:myimage28 9/s 7/s 231 KiB/s 182 KiB/s 1.04 ms 166.10 us 2024-03-26T17:02:08.115 INFO:tasks.workunit.client.3.smithi157.stdout:myimage48 9/s 7/s 236 KiB/s 171 KiB/s 994.13 us 161.62 us 2024-03-26T17:02:08.115 INFO:tasks.workunit.client.3.smithi157.stdout:myimage51 9/s 6/s 285 KiB/s 135 KiB/s 1.01 ms 162.22 us 2024-03-26T17:02:08.115 INFO:tasks.workunit.client.3.smithi157.stdout:myimage60 9/s 7/s 234 KiB/s 165 KiB/s 1.52 ms 158.33 us 2024-03-26T17:02:08.115 INFO:tasks.workunit.client.3.smithi157.stdout:myimage38 8/s 5/s 217 KiB/s 125 KiB/s 984.06 us 169.48 us 2024-03-26T17:02:08.115 INFO:tasks.workunit.client.3.smithi157.stdout:myimage29 8/s 7/s 218 KiB/s 167 KiB/s 981.95 us 167.80 us 2024-03-26T17:02:08.116 INFO:tasks.workunit.client.3.smithi157.stdout:myimage55 8/s 6/s 266 KiB/s 136 KiB/s 988.98 us 164.67 us 2024-03-26T17:02:08.116 INFO:tasks.workunit.client.3.smithi157.stdout:myimage10 8/s 7/s 210 KiB/s 196 KiB/s 1.00 ms 159.55 us 2024-03-26T17:02:08.116 INFO:tasks.workunit.client.3.smithi157.stdout:myimage3 8/s 6/s 205 KiB/s 166 KiB/s 987.79 us 160.40 us 2024-03-26T17:02:08.116 INFO:tasks.workunit.client.3.smithi157.stdout:myimage14 8/s 6/s 247 KiB/s 159 KiB/s 1.01 ms 162.20 us 2024-03-26T17:02:08.116 INFO:tasks.workunit.client.3.smithi157.stdout:myimage35 8/s 8/s 221 KiB/s 221 KiB/s 995.84 us 157.17 us 2024-03-26T17:02:08.116 INFO:tasks.workunit.client.3.smithi157.stdout:myimage44 8/s 5/s 224 KiB/s 132 KiB/s 1.00 ms 158.53 us 2024-03-26T17:02:08.116 INFO:tasks.workunit.client.3.smithi157.stdout:myimage12 8/s 6/s 209 KiB/s 158 KiB/s 987.38 us 160.29 us 2024-03-26T17:02:08.116 INFO:tasks.workunit.client.3.smithi157.stdout:myimage18 8/s 7/s 241 KiB/s 200 KiB/s 995.93 us 168.12 us 2024-03-26T17:02:08.116 INFO:tasks.workunit.client.3.smithi157.stdout:myimage52 8/s 7/s 215 KiB/s 161 KiB/s 1.03 ms 154.67 us 2024-03-26T17:02:08.116 INFO:tasks.workunit.client.3.smithi157.stdout:myimage56 8/s 8/s 202 KiB/s 213 KiB/s 1.04 ms 161.20 us 2024-03-26T17:02:08.116 INFO:tasks.workunit.client.3.smithi157.stdout:myimage13 8/s 7/s 211 KiB/s 132 KiB/s 969.95 us 162.26 us 2024-03-26T17:02:08.116 INFO:tasks.workunit.client.3.smithi157.stdout:myimage23 8/s 6/s 223 KiB/s 147 KiB/s 991.23 us 160.75 us 2024-03-26T17:02:08.116 INFO:tasks.workunit.client.3.smithi157.stdout:myimage58 8/s 7/s 205 KiB/s 185 KiB/s 981.98 us 161.89 us 2024-03-26T17:02:08.116 INFO:tasks.workunit.client.3.smithi157.stdout:myimage33 8/s 7/s 210 KiB/s 175 KiB/s 1.01 ms 160.88 us 2024-03-26T17:02:08.116 INFO:tasks.workunit.client.3.smithi157.stdout:myimage30 7/s 7/s 186 KiB/s 210 KiB/s 1.02 ms 160.80 us 2024-03-26T17:02:08.117 INFO:tasks.workunit.client.3.smithi157.stdout:myimage5 7/s 8/s 166 KiB/s 205 KiB/s 968.20 us 155.18 us 2024-03-26T17:02:08.117 INFO:tasks.workunit.client.3.smithi157.stdout:myimage54 7/s 9/s 229 KiB/s 194 KiB/s 1.05 ms 167.68 us 2024-03-26T17:02:08.117 INFO:tasks.workunit.client.3.smithi157.stdout:myimage7 7/s 8/s 206 KiB/s 214 KiB/s 997.17 us 167.59 us 2024-03-26T17:02:08.117 INFO:tasks.workunit.client.3.smithi157.stdout:myimage17 7/s 8/s 156 KiB/s 173 KiB/s 1.14 ms 158.86 us 2024-03-26T17:02:08.117 INFO:tasks.workunit.client.3.smithi157.stdout:myimage25 7/s 7/s 214 KiB/s 174 KiB/s 1.08 ms 154.77 us 2024-03-26T17:02:08.117 INFO:tasks.workunit.client.3.smithi157.stdout:myimage27 7/s 7/s 240 KiB/s 180 KiB/s 958.54 us 155.06 us 2024-03-26T17:02:08.117 INFO:tasks.workunit.client.3.smithi157.stdout:myimage53 7/s 7/s 185 KiB/s 149 KiB/s 993.58 us 159.26 us 2024-03-26T17:02:08.117 INFO:tasks.workunit.client.3.smithi157.stdout:myimage15 7/s 9/s 202 KiB/s 189 KiB/s 990.04 us 161.51 us 2024-03-26T17:02:08.117 INFO:tasks.workunit.client.3.smithi157.stdout:myimage46 7/s 9/s 199 KiB/s 227 KiB/s 1.03 ms 155.20 us 2024-03-26T17:02:08.117 INFO:tasks.workunit.client.3.smithi157.stdout:myimage59 7/s 7/s 219 KiB/s 144 KiB/s 972.94 us 155.58 us 2024-03-26T17:02:08.117 INFO:tasks.workunit.client.3.smithi157.stdout:myimage22 7/s 7/s 182 KiB/s 171 KiB/s 1.02 ms 158.14 us 2024-03-26T17:02:08.117 INFO:tasks.workunit.client.3.smithi157.stdout:myimage32 7/s 8/s 177 KiB/s 148 KiB/s 1.00 ms 165.95 us 2024-03-26T17:02:08.117 INFO:tasks.workunit.client.3.smithi157.stdout:myimage37 7/s 9/s 210 KiB/s 226 KiB/s 1.01 ms 156.95 us 2024-03-26T17:02:08.117 INFO:tasks.workunit.client.3.smithi157.stdout:myimage47 7/s 8/s 181 KiB/s 229 KiB/s 1.01 ms 160.25 us 2024-03-26T17:02:08.117 INFO:tasks.workunit.client.3.smithi157.stdout:myimage2 7/s 7/s 161 KiB/s 153 KiB/s 1.03 ms 160.92 us 2024-03-26T17:02:08.117 INFO:tasks.workunit.client.3.smithi157.stdout:myimage31 7/s 7/s 173 KiB/s 202 KiB/s 1.01 ms 164.61 us 2024-03-26T17:02:08.117 INFO:tasks.workunit.client.3.smithi157.stdout:myimage1 7/s 9/s 200 KiB/s 230 KiB/s 969.96 us 163.65 us 2024-03-26T17:02:08.118 INFO:tasks.workunit.client.3.smithi157.stdout:myimage19 7/s 7/s 138 KiB/s 214 KiB/s 971.68 us 157.74 us 2024-03-26T17:02:08.118 INFO:tasks.workunit.client.3.smithi157.stdout:myimage24 7/s 8/s 213 KiB/s 228 KiB/s 1.01 ms 149.69 us 2024-03-26T17:02:08.118 INFO:tasks.workunit.client.3.smithi157.stdout:myimage49 6/s 10/s 154 KiB/s 202 KiB/s 1.04 ms 151.82 us 2024-03-26T17:02:08.118 INFO:tasks.workunit.client.3.smithi157.stdout:myimage6 6/s 8/s 146 KiB/s 212 KiB/s 1.03 ms 165.75 us 2024-03-26T17:02:08.118 INFO:tasks.workunit.client.3.smithi157.stdout:myimage57 6/s 7/s 155 KiB/s 192 KiB/s 964.34 us 161.79 us 2024-03-26T17:02:08.118 INFO:tasks.workunit.client.3.smithi157.stdout:myimage16 6/s 7/s 175 KiB/s 149 KiB/s 976.11 us 162.57 us 2024-03-26T17:02:08.118 INFO:tasks.workunit.client.3.smithi157.stdout:myimage34 6/s 9/s 194 KiB/s 230 KiB/s 976.57 us 152.84 us 2024-03-26T17:02:08.118 INFO:tasks.workunit.client.3.smithi157.stdout:myimage9 6/s 9/s 188 KiB/s 197 KiB/s 1.01 ms 161.94 us 2024-03-26T17:02:08.118 INFO:tasks.workunit.client.3.smithi157.stdout:myimage39 6/s 7/s 187 KiB/s 180 KiB/s 983.06 us 163.09 us 2024-03-26T17:02:08.118 INFO:tasks.workunit.client.3.smithi157.stdout:myimage20 6/s 8/s 165 KiB/s 198 KiB/s 985.29 us 159.70 us 2024-03-26T17:02:08.118 INFO:tasks.workunit.client.3.smithi157.stdout:myimage36 6/s 6/s 166 KiB/s 209 KiB/s 996.76 us 157.61 us 2024-03-26T17:02:08.118 INFO:tasks.workunit.client.3.smithi157.stdout:myimage42 6/s 8/s 165 KiB/s 203 KiB/s 997.92 us 152.55 us 2024-03-26T17:02:08.118 INFO:tasks.workunit.client.3.smithi157.stdout:myimage43 6/s 8/s 170 KiB/s 151 KiB/s 991.87 us 149.69 us 2024-03-26T17:02:08.118 INFO:tasks.workunit.client.3.smithi157.stdout:myimage50 6/s 7/s 181 KiB/s 226 KiB/s 983.35 us 168.20 us 2024-03-26T17:02:08.118 INFO:tasks.workunit.client.3.smithi157.stdout:myimage40 6/s 8/s 117 KiB/s 175 KiB/s 971.57 us 168.91 us 2024-03-26T17:02:08.118 INFO:tasks.workunit.client.3.smithi157.stdout:myimage8 6/s 9/s 173 KiB/s 189 KiB/s 1.04 ms 157.44 us 2024-03-26T17:02:08.119 INFO:tasks.workunit.client.3.smithi157.stdout:myimage45 6/s 9/s 181 KiB/s 254 KiB/s 1.02 ms 159.57 us 2024-03-26T17:02:08.119 INFO:tasks.workunit.client.3.smithi157.stdout:myimage11 5/s 8/s 154 KiB/s 231 KiB/s 999.22 us 157.25 us 2024-03-26T17:02:08.119 INFO:tasks.workunit.client.3.smithi157.stdout:myimage41 5/s 9/s 104 KiB/s 230 KiB/s 997.73 us 167.04 us 2024-03-26T17:02:08.119 INFO:tasks.workunit.client.3.smithi157.stdout:myimage4 5/s 10/s 129 KiB/s 231 KiB/s 992.89 us 163.93 us 2024-03-26T17:02:08.119 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:02:08.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:08 smithi044 ceph-mon[30624]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:02:08.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:08 smithi044 ceph-mon[30624]: { 2024-03-26T17:02:08.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:08 smithi044 ceph-mon[30624]: "prefix": "rbd perf image stats", 2024-03-26T17:02:08.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:08 smithi044 ceph-mon[30624]: "pool_spec": "mypool", 2024-03-26T17:02:08.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:08 smithi044 ceph-mon[30624]: "sort_by": "write_ops", 2024-03-26T17:02:08.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:08 smithi044 ceph-mon[30624]: "format": "json" 2024-03-26T17:02:08.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:08 smithi044 ceph-mon[30624]: }"]: dispatch 2024-03-26T17:02:08.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:08 smithi044 ceph-mon[30624]: pgmap v464: 33 pgs: 33 active+clean; 997 MiB data, 985 MiB used, 714 GiB / 715 GiB avail; 11 MiB/s rd, 12 MiB/s wr, 938 op/s 2024-03-26T17:02:08.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:02:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:02:08] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:02:08.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:02:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:02:08] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:02:08.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:02:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:02:08.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:08 smithi064 ceph-mon[34420]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:02:08.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:08 smithi064 ceph-mon[34420]: { 2024-03-26T17:02:08.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:08 smithi064 ceph-mon[34420]: "prefix": "rbd perf image stats", 2024-03-26T17:02:08.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:08 smithi064 ceph-mon[34420]: "pool_spec": "mypool", 2024-03-26T17:02:08.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:08 smithi064 ceph-mon[34420]: "sort_by": "write_ops", 2024-03-26T17:02:08.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:08 smithi064 ceph-mon[34420]: "format": "json" 2024-03-26T17:02:08.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:08 smithi064 ceph-mon[34420]: }"]: dispatch 2024-03-26T17:02:08.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:08 smithi064 ceph-mon[34420]: pgmap v464: 33 pgs: 33 active+clean; 997 MiB data, 985 MiB used, 714 GiB / 715 GiB avail; 11 MiB/s rd, 12 MiB/s wr, 938 op/s 2024-03-26T17:02:08.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:08 smithi149 ceph-mon[34678]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:02:08.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:08 smithi149 ceph-mon[34678]: { 2024-03-26T17:02:08.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:08 smithi149 ceph-mon[34678]: "prefix": "rbd perf image stats", 2024-03-26T17:02:08.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:08 smithi149 ceph-mon[34678]: "pool_spec": "mypool", 2024-03-26T17:02:08.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:08 smithi149 ceph-mon[34678]: "sort_by": "write_ops", 2024-03-26T17:02:08.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:08 smithi149 ceph-mon[34678]: "format": "json" 2024-03-26T17:02:08.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:08 smithi149 ceph-mon[34678]: }"]: dispatch 2024-03-26T17:02:08.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:08 smithi149 ceph-mon[34678]: pgmap v464: 33 pgs: 33 active+clean; 997 MiB data, 985 MiB used, 714 GiB / 715 GiB avail; 11 MiB/s rd, 12 MiB/s wr, 938 op/s 2024-03-26T17:02:09.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:02:08 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:02:08] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:02:09.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:02:08 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:02:08] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:02:09.147 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:02:08 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:02:09.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:09 smithi044 ceph-mon[30624]: Health check update: 7 slow ops, oldest one blocked for 223 sec, daemons [mon.b,mon.c] have slow ops. (SLOW_OPS) 2024-03-26T17:02:09.553 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:09 smithi064 ceph-mon[34420]: Health check update: 7 slow ops, oldest one blocked for 223 sec, daemons [mon.b,mon.c] have slow ops. (SLOW_OPS) 2024-03-26T17:02:09.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:09 smithi149 ceph-mon[34678]: Health check update: 7 slow ops, oldest one blocked for 223 sec, daemons [mon.b,mon.c] have slow ops. (SLOW_OPS) 2024-03-26T17:02:09.806 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:02:09 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:02:09] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:02:09.806 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:02:09 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:02:09] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:02:09.806 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:02:09 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:02:10.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:10 smithi044 ceph-mon[30624]: pgmap v465: 33 pgs: 33 active+clean; 1001 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 12 MiB/s rd, 13 MiB/s wr, 988 op/s 2024-03-26T17:02:10.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:02:10 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:02:10] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:02:10.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:02:10 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:02:10] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:02:10.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:02:10 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:02:10.547 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:10 smithi149 ceph-mon[34678]: pgmap v465: 33 pgs: 33 active+clean; 1001 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 12 MiB/s rd, 13 MiB/s wr, 988 op/s 2024-03-26T17:02:10.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:10 smithi064 ceph-mon[34420]: pgmap v465: 33 pgs: 33 active+clean; 1001 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 12 MiB/s rd, 13 MiB/s wr, 988 op/s 2024-03-26T17:02:10.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:10 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-b[34416]: 2024-03-26T17:02:10.285+0000 7ff022916700 -1 mon.b@2(peon) e3 get_health_metrics reporting 4 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T17:02:10.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:02:10 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:02:10] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:02:10.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:02:10 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:02:10] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:02:10.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:02:10 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:02:11.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:11 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 2024-03-26T17:02:11.212+0000 7fa707a55700 -1 mon.c@1(peon) e3 get_health_metrics reporting 3 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T17:02:12.056 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:02:11 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:02:11] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:02:12.056 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:02:11 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:02:11] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:02:12.056 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:02:11 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:02:12.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:12 smithi044 ceph-mon[30624]: pgmap v466: 33 pgs: 33 active+clean; 1002 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 10 MiB/s rd, 11 MiB/s wr, 862 op/s 2024-03-26T17:02:12.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:02:12 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:02:12] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:02:12.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:02:12 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:02:12] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:02:12.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:02:12 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:02:12.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:12 smithi064 ceph-mon[34420]: pgmap v466: 33 pgs: 33 active+clean; 1002 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 10 MiB/s rd, 11 MiB/s wr, 862 op/s 2024-03-26T17:02:12.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:12 smithi149 ceph-mon[34678]: pgmap v466: 33 pgs: 33 active+clean; 1002 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 10 MiB/s rd, 11 MiB/s wr, 862 op/s 2024-03-26T17:02:13.061 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:02:13.071 INFO:tasks.workunit.client.3.smithi157.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2024-03-26T17:02:13.071 INFO:tasks.workunit.client.3.smithi157.stdout: 15.20 192.4k 176.4k 0.0k 1.9M 1.7M 0.0k nvme2n1 2024-03-26T17:02:13.071 INFO:tasks.workunit.client.3.smithi157.stdout: 15.30 163.6k 202.0k 0.0k 1.6M 2.0M 0.0k nvme2n10 2024-03-26T17:02:13.071 INFO:tasks.workunit.client.3.smithi157.stdout: 15.30 233.6k 115.6k 0.0k 2.3M 1.1M 0.0k nvme2n11 2024-03-26T17:02:13.071 INFO:tasks.workunit.client.3.smithi157.stdout: 15.30 187.6k 187.2k 0.0k 1.8M 1.8M 0.0k nvme2n12 2024-03-26T17:02:13.071 INFO:tasks.workunit.client.3.smithi157.stdout: 15.30 186.8k 177.6k 0.0k 1.8M 1.7M 0.0k nvme2n13 2024-03-26T17:02:13.071 INFO:tasks.workunit.client.3.smithi157.stdout: 15.30 230.0k 148.0k 0.0k 2.2M 1.4M 0.0k nvme2n14 2024-03-26T17:02:13.071 INFO:tasks.workunit.client.3.smithi157.stdout: 15.20 163.2k 194.8k 0.0k 1.6M 1.9M 0.0k nvme2n15 2024-03-26T17:02:13.071 INFO:tasks.workunit.client.3.smithi157.stdout: 15.20 170.0k 173.2k 0.0k 1.7M 1.7M 0.0k nvme2n16 2024-03-26T17:02:13.071 INFO:tasks.workunit.client.3.smithi157.stdout: 15.20 194.4k 164.0k 0.0k 1.9M 1.6M 0.0k nvme2n17 2024-03-26T17:02:13.071 INFO:tasks.workunit.client.3.smithi157.stdout: 15.20 202.0k 183.2k 0.0k 2.0M 1.8M 0.0k nvme2n18 2024-03-26T17:02:13.071 INFO:tasks.workunit.client.3.smithi157.stdout: 15.20 169.2k 145.6k 0.0k 1.7M 1.4M 0.0k nvme2n19 2024-03-26T17:02:13.071 INFO:tasks.workunit.client.3.smithi157.stdout: 15.20 241.2k 173.6k 0.0k 2.4M 1.7M 0.0k nvme2n2 2024-03-26T17:02:13.072 INFO:tasks.workunit.client.3.smithi157.stdout: 15.20 195.2k 180.8k 0.0k 1.9M 1.8M 0.0k nvme2n20 2024-03-26T17:02:13.072 INFO:tasks.workunit.client.3.smithi157.stdout: 15.20 162.8k 171.2k 0.0k 1.6M 1.7M 0.0k nvme2n3 2024-03-26T17:02:13.072 INFO:tasks.workunit.client.3.smithi157.stdout: 15.30 175.2k 187.6k 0.0k 1.7M 1.8M 0.0k nvme2n4 2024-03-26T17:02:13.072 INFO:tasks.workunit.client.3.smithi157.stdout: 15.30 206.4k 168.8k 0.0k 2.0M 1.6M 0.0k nvme2n5 2024-03-26T17:02:13.072 INFO:tasks.workunit.client.3.smithi157.stdout: 15.30 204.8k 160.4k 0.0k 2.0M 1.6M 0.0k nvme2n6 2024-03-26T17:02:13.072 INFO:tasks.workunit.client.3.smithi157.stdout: 15.30 156.8k 201.6k 0.0k 1.5M 2.0M 0.0k nvme2n7 2024-03-26T17:02:13.072 INFO:tasks.workunit.client.3.smithi157.stdout: 15.30 208.4k 198.4k 0.0k 2.0M 1.9M 0.0k nvme2n8 2024-03-26T17:02:13.072 INFO:tasks.workunit.client.3.smithi157.stdout: 15.30 216.4k 174.8k 0.0k 2.1M 1.7M 0.0k nvme2n9 2024-03-26T17:02:13.072 INFO:tasks.workunit.client.3.smithi157.stdout: 15.20 180.8k 204.0k 0.0k 1.8M 2.0M 0.0k nvme5n1 2024-03-26T17:02:13.072 INFO:tasks.workunit.client.3.smithi157.stdout: 15.30 159.6k 208.0k 0.0k 1.6M 2.0M 0.0k nvme5n10 2024-03-26T17:02:13.072 INFO:tasks.workunit.client.3.smithi157.stdout: 15.30 177.2k 196.0k 0.0k 1.7M 1.9M 0.0k nvme5n11 2024-03-26T17:02:13.072 INFO:tasks.workunit.client.3.smithi157.stdout: 15.30 152.0k 183.2k 0.0k 1.5M 1.8M 0.0k nvme5n12 2024-03-26T17:02:13.072 INFO:tasks.workunit.client.3.smithi157.stdout: 15.30 160.8k 211.2k 0.0k 1.6M 2.1M 0.0k nvme5n13 2024-03-26T17:02:13.073 INFO:tasks.workunit.client.3.smithi157.stdout: 15.30 180.0k 188.0k 0.0k 1.8M 1.8M 0.0k nvme5n14 2024-03-26T17:02:13.073 INFO:tasks.workunit.client.3.smithi157.stdout: 15.20 179.2k 211.2k 0.0k 1.8M 2.1M 0.0k nvme5n15 2024-03-26T17:02:13.073 INFO:tasks.workunit.client.3.smithi157.stdout: 15.20 178.0k 205.6k 0.0k 1.7M 2.0M 0.0k nvme5n16 2024-03-26T17:02:13.073 INFO:tasks.workunit.client.3.smithi157.stdout: 15.20 211.2k 178.4k 0.0k 2.1M 1.7M 0.0k nvme5n17 2024-03-26T17:02:13.073 INFO:tasks.workunit.client.3.smithi157.stdout: 15.20 185.6k 188.4k 0.0k 1.8M 1.8M 0.0k nvme5n18 2024-03-26T17:02:13.073 INFO:tasks.workunit.client.3.smithi157.stdout: 15.20 185.2k 195.2k 0.0k 1.8M 1.9M 0.0k nvme5n19 2024-03-26T17:02:13.073 INFO:tasks.workunit.client.3.smithi157.stdout: 15.20 160.4k 223.2k 0.0k 1.6M 2.2M 0.0k nvme5n2 2024-03-26T17:02:13.073 INFO:tasks.workunit.client.3.smithi157.stdout: 15.20 184.0k 184.4k 0.0k 1.8M 1.8M 0.0k nvme5n20 2024-03-26T17:02:13.073 INFO:tasks.workunit.client.3.smithi157.stdout: 15.20 204.0k 194.4k 0.0k 2.0M 1.9M 0.0k nvme5n3 2024-03-26T17:02:13.073 INFO:tasks.workunit.client.3.smithi157.stdout: 15.30 198.8k 136.0k 0.0k 1.9M 1.3M 0.0k nvme5n4 2024-03-26T17:02:13.073 INFO:tasks.workunit.client.3.smithi157.stdout: 15.30 174.4k 198.0k 0.0k 1.7M 1.9M 0.0k nvme5n5 2024-03-26T17:02:13.074 INFO:tasks.workunit.client.3.smithi157.stdout: 15.30 161.2k 224.0k 0.0k 1.6M 2.2M 0.0k nvme5n6 2024-03-26T17:02:13.074 INFO:tasks.workunit.client.3.smithi157.stdout: 15.30 155.6k 191.6k 0.0k 1.5M 1.9M 0.0k nvme5n7 2024-03-26T17:02:13.074 INFO:tasks.workunit.client.3.smithi157.stdout: 15.30 175.2k 193.6k 0.0k 1.7M 1.9M 0.0k nvme5n8 2024-03-26T17:02:13.074 INFO:tasks.workunit.client.3.smithi157.stdout: 15.30 169.6k 228.8k 0.0k 1.7M 2.2M 0.0k nvme5n9 2024-03-26T17:02:13.074 INFO:tasks.workunit.client.3.smithi157.stdout: 15.20 196.0k 140.4k 0.0k 1.9M 1.4M 0.0k nvme8n1 2024-03-26T17:02:13.074 INFO:tasks.workunit.client.3.smithi157.stdout: 15.30 196.4k 191.6k 0.0k 1.9M 1.9M 0.0k nvme8n10 2024-03-26T17:02:13.074 INFO:tasks.workunit.client.3.smithi157.stdout: 15.30 156.0k 228.8k 0.0k 1.5M 2.2M 0.0k nvme8n11 2024-03-26T17:02:13.074 INFO:tasks.workunit.client.3.smithi157.stdout: 15.30 174.0k 204.0k 0.0k 1.7M 2.0M 0.0k nvme8n12 2024-03-26T17:02:13.074 INFO:tasks.workunit.client.3.smithi157.stdout: 15.30 197.6k 177.6k 0.0k 1.9M 1.7M 0.0k nvme8n13 2024-03-26T17:02:13.074 INFO:tasks.workunit.client.3.smithi157.stdout: 15.20 168.4k 182.8k 0.0k 1.6M 1.8M 0.0k nvme8n14 2024-03-26T17:02:13.074 INFO:tasks.workunit.client.3.smithi157.stdout: 15.20 175.2k 198.0k 0.0k 1.7M 1.9M 0.0k nvme8n15 2024-03-26T17:02:13.074 INFO:tasks.workunit.client.3.smithi157.stdout: 15.20 204.8k 182.8k 0.0k 2.0M 1.8M 0.0k nvme8n16 2024-03-26T17:02:13.075 INFO:tasks.workunit.client.3.smithi157.stdout: 15.20 196.4k 179.6k 0.0k 1.9M 1.8M 0.0k nvme8n17 2024-03-26T17:02:13.075 INFO:tasks.workunit.client.3.smithi157.stdout: 15.20 194.0k 172.0k 0.0k 1.9M 1.7M 0.0k nvme8n18 2024-03-26T17:02:13.075 INFO:tasks.workunit.client.3.smithi157.stdout: 15.20 196.4k 166.8k 0.0k 1.9M 1.6M 0.0k nvme8n19 2024-03-26T17:02:13.075 INFO:tasks.workunit.client.3.smithi157.stdout: 15.20 188.8k 208.0k 0.0k 1.8M 2.0M 0.0k nvme8n2 2024-03-26T17:02:13.075 INFO:tasks.workunit.client.3.smithi157.stdout: 15.20 158.0k 187.6k 0.0k 1.5M 1.8M 0.0k nvme8n20 2024-03-26T17:02:13.075 INFO:tasks.workunit.client.3.smithi157.stdout: 15.20 179.2k 190.4k 0.0k 1.8M 1.9M 0.0k nvme8n3 2024-03-26T17:02:13.075 INFO:tasks.workunit.client.3.smithi157.stdout: 15.30 158.4k 222.0k 0.0k 1.5M 2.2M 0.0k nvme8n4 2024-03-26T17:02:13.075 INFO:tasks.workunit.client.3.smithi157.stdout: 15.30 211.2k 175.6k 0.0k 2.1M 1.7M 0.0k nvme8n5 2024-03-26T17:02:13.075 INFO:tasks.workunit.client.3.smithi157.stdout: 15.30 159.6k 196.8k 0.0k 1.6M 1.9M 0.0k nvme8n6 2024-03-26T17:02:13.075 INFO:tasks.workunit.client.3.smithi157.stdout: 15.30 212.0k 194.0k 0.0k 2.1M 1.9M 0.0k nvme8n7 2024-03-26T17:02:13.075 INFO:tasks.workunit.client.3.smithi157.stdout: 15.30 215.2k 163.2k 0.0k 2.1M 1.6M 0.0k nvme8n8 2024-03-26T17:02:13.075 INFO:tasks.workunit.client.3.smithi157.stdout: 15.30 195.6k 168.8k 0.0k 1.9M 1.6M 0.0k nvme8n9 2024-03-26T17:02:13.075 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:02:13.120 INFO:tasks.workunit.client.3.smithi157.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-26T17:02:13.120 INFO:tasks.workunit.client.3.smithi157.stdout:myimage40 10/s 7/s 227 KiB/s 185 KiB/s 1.01 ms 159.98 us 2024-03-26T17:02:13.120 INFO:tasks.workunit.client.3.smithi157.stdout:myimage36 9/s 6/s 204 KiB/s 115 KiB/s 1.04 ms 163.69 us 2024-03-26T17:02:13.120 INFO:tasks.workunit.client.3.smithi157.stdout:myimage10 9/s 8/s 260 KiB/s 167 KiB/s 1.06 ms 160.88 us 2024-03-26T17:02:13.120 INFO:tasks.workunit.client.3.smithi157.stdout:myimage22 9/s 6/s 210 KiB/s 114 KiB/s 1.04 ms 156.22 us 2024-03-26T17:02:13.120 INFO:tasks.workunit.client.3.smithi157.stdout:myimage3 8/s 7/s 179 KiB/s 121 KiB/s 969.85 us 150.72 us 2024-03-26T17:02:13.120 INFO:tasks.workunit.client.3.smithi157.stdout:myimage44 8/s 6/s 237 KiB/s 134 KiB/s 1.02 ms 170.89 us 2024-03-26T17:02:13.120 INFO:tasks.workunit.client.3.smithi157.stdout:myimage7 8/s 7/s 207 KiB/s 142 KiB/s 1.04 ms 153.53 us 2024-03-26T17:02:13.120 INFO:tasks.workunit.client.3.smithi157.stdout:myimage18 8/s 7/s 213 KiB/s 185 KiB/s 1.03 ms 157.79 us 2024-03-26T17:02:13.120 INFO:tasks.workunit.client.3.smithi157.stdout:myimage45 8/s 7/s 215 KiB/s 171 KiB/s 1.06 ms 164.68 us 2024-03-26T17:02:13.120 INFO:tasks.workunit.client.3.smithi157.stdout:myimage32 8/s 7/s 191 KiB/s 130 KiB/s 1.03 ms 163.52 us 2024-03-26T17:02:13.120 INFO:tasks.workunit.client.3.smithi157.stdout:myimage27 8/s 8/s 205 KiB/s 168 KiB/s 1.01 ms 164.37 us 2024-03-26T17:02:13.120 INFO:tasks.workunit.client.3.smithi157.stdout:myimage39 8/s 8/s 254 KiB/s 194 KiB/s 1.01 ms 161.73 us 2024-03-26T17:02:13.121 INFO:tasks.workunit.client.3.smithi157.stdout:myimage51 8/s 7/s 226 KiB/s 125 KiB/s 1.07 ms 157.34 us 2024-03-26T17:02:13.121 INFO:tasks.workunit.client.3.smithi157.stdout:myimage31 8/s 6/s 184 KiB/s 174 KiB/s 1.04 ms 160.28 us 2024-03-26T17:02:13.121 INFO:tasks.workunit.client.3.smithi157.stdout:myimage4 8/s 6/s 226 KiB/s 148 KiB/s 1.00 ms 171.99 us 2024-03-26T17:02:13.121 INFO:tasks.workunit.client.3.smithi157.stdout:myimage25 8/s 7/s 222 KiB/s 177 KiB/s 1.08 ms 163.03 us 2024-03-26T17:02:13.121 INFO:tasks.workunit.client.3.smithi157.stdout:myimage53 8/s 7/s 195 KiB/s 173 KiB/s 1.05 ms 157.00 us 2024-03-26T17:02:13.121 INFO:tasks.workunit.client.3.smithi157.stdout:myimage60 8/s 6/s 168 KiB/s 138 KiB/s 999.31 us 160.80 us 2024-03-26T17:02:13.121 INFO:tasks.workunit.client.3.smithi157.stdout:myimage16 8/s 8/s 165 KiB/s 156 KiB/s 1.00 ms 157.83 us 2024-03-26T17:02:13.121 INFO:tasks.workunit.client.3.smithi157.stdout:myimage30 8/s 7/s 198 KiB/s 164 KiB/s 1.06 ms 152.96 us 2024-03-26T17:02:13.121 INFO:tasks.workunit.client.3.smithi157.stdout:myimage1 8/s 7/s 179 KiB/s 183 KiB/s 964.10 us 159.30 us 2024-03-26T17:02:13.121 INFO:tasks.workunit.client.3.smithi157.stdout:myimage12 8/s 7/s 177 KiB/s 166 KiB/s 997.21 us 157.96 us 2024-03-26T17:02:13.121 INFO:tasks.workunit.client.3.smithi157.stdout:myimage15 8/s 6/s 157 KiB/s 154 KiB/s 996.99 us 157.90 us 2024-03-26T17:02:13.121 INFO:tasks.workunit.client.3.smithi157.stdout:myimage26 8/s 7/s 229 KiB/s 170 KiB/s 1.04 ms 165.31 us 2024-03-26T17:02:13.121 INFO:tasks.workunit.client.3.smithi157.stdout:myimage28 8/s 7/s 217 KiB/s 171 KiB/s 1.06 ms 153.60 us 2024-03-26T17:02:13.121 INFO:tasks.workunit.client.3.smithi157.stdout:myimage43 8/s 8/s 233 KiB/s 183 KiB/s 1.06 ms 156.08 us 2024-03-26T17:02:13.121 INFO:tasks.workunit.client.3.smithi157.stdout:myimage14 8/s 9/s 167 KiB/s 227 KiB/s 1.04 ms 156.78 us 2024-03-26T17:02:13.122 INFO:tasks.workunit.client.3.smithi157.stdout:myimage9 8/s 8/s 206 KiB/s 214 KiB/s 1.04 ms 163.51 us 2024-03-26T17:02:13.122 INFO:tasks.workunit.client.3.smithi157.stdout:myimage20 8/s 6/s 196 KiB/s 157 KiB/s 1.05 ms 155.48 us 2024-03-26T17:02:13.122 INFO:tasks.workunit.client.3.smithi157.stdout:myimage21 8/s 7/s 221 KiB/s 154 KiB/s 1.07 ms 163.87 us 2024-03-26T17:02:13.122 INFO:tasks.workunit.client.3.smithi157.stdout:myimage33 8/s 6/s 210 KiB/s 110 KiB/s 1.04 ms 163.72 us 2024-03-26T17:02:13.122 INFO:tasks.workunit.client.3.smithi157.stdout:myimage57 8/s 7/s 186 KiB/s 150 KiB/s 1.02 ms 161.92 us 2024-03-26T17:02:13.122 INFO:tasks.workunit.client.3.smithi157.stdout:myimage34 7/s 7/s 166 KiB/s 154 KiB/s 974.14 us 156.80 us 2024-03-26T17:02:13.122 INFO:tasks.workunit.client.3.smithi157.stdout:myimage38 7/s 8/s 180 KiB/s 147 KiB/s 1.00 ms 168.69 us 2024-03-26T17:02:13.122 INFO:tasks.workunit.client.3.smithi157.stdout:myimage46 7/s 7/s 190 KiB/s 146 KiB/s 1.02 ms 160.67 us 2024-03-26T17:02:13.122 INFO:tasks.workunit.client.3.smithi157.stdout:myimage6 7/s 7/s 162 KiB/s 178 KiB/s 1.04 ms 154.72 us 2024-03-26T17:02:13.122 INFO:tasks.workunit.client.3.smithi157.stdout:myimage50 7/s 9/s 174 KiB/s 202 KiB/s 1.06 ms 160.07 us 2024-03-26T17:02:13.122 INFO:tasks.workunit.client.3.smithi157.stdout:myimage5 7/s 8/s 166 KiB/s 198 KiB/s 1.02 ms 161.20 us 2024-03-26T17:02:13.122 INFO:tasks.workunit.client.3.smithi157.stdout:myimage54 7/s 8/s 181 KiB/s 189 KiB/s 1.02 ms 164.18 us 2024-03-26T17:02:13.122 INFO:tasks.workunit.client.3.smithi157.stdout:myimage56 7/s 7/s 182 KiB/s 177 KiB/s 1.05 ms 153.00 us 2024-03-26T17:02:13.122 INFO:tasks.workunit.client.3.smithi157.stdout:myimage35 7/s 8/s 198 KiB/s 165 KiB/s 1.03 ms 153.83 us 2024-03-26T17:02:13.123 INFO:tasks.workunit.client.3.smithi157.stdout:myimage37 7/s 7/s 167 KiB/s 156 KiB/s 1.05 ms 155.90 us 2024-03-26T17:02:13.123 INFO:tasks.workunit.client.3.smithi157.stdout:myimage17 7/s 7/s 138 KiB/s 165 KiB/s 1.04 ms 159.09 us 2024-03-26T17:02:13.123 INFO:tasks.workunit.client.3.smithi157.stdout:myimage58 7/s 6/s 134 KiB/s 149 KiB/s 985.75 us 155.54 us 2024-03-26T17:02:13.123 INFO:tasks.workunit.client.3.smithi157.stdout:myimage59 7/s 8/s 150 KiB/s 184 KiB/s 1.03 ms 154.26 us 2024-03-26T17:02:13.123 INFO:tasks.workunit.client.3.smithi157.stdout:myimage23 6/s 9/s 190 KiB/s 203 KiB/s 1.01 ms 163.35 us 2024-03-26T17:02:13.123 INFO:tasks.workunit.client.3.smithi157.stdout:myimage47 6/s 9/s 202 KiB/s 218 KiB/s 1.03 ms 164.04 us 2024-03-26T17:02:13.123 INFO:tasks.workunit.client.3.smithi157.stdout:myimage29 6/s 6/s 193 KiB/s 163 KiB/s 1.00 ms 159.83 us 2024-03-26T17:02:13.123 INFO:tasks.workunit.client.3.smithi157.stdout:myimage42 6/s 7/s 179 KiB/s 149 KiB/s 994.50 us 165.95 us 2024-03-26T17:02:13.123 INFO:tasks.workunit.client.3.smithi157.stdout:myimage2 6/s 9/s 158 KiB/s 239 KiB/s 1.04 ms 159.52 us 2024-03-26T17:02:13.123 INFO:tasks.workunit.client.3.smithi157.stdout:myimage11 6/s 10/s 113 KiB/s 274 KiB/s 1.01 ms 151.68 us 2024-03-26T17:02:13.123 INFO:tasks.workunit.client.3.smithi157.stdout:myimage19 6/s 7/s 151 KiB/s 142 KiB/s 1.02 ms 159.51 us 2024-03-26T17:02:13.123 INFO:tasks.workunit.client.3.smithi157.stdout:myimage24 6/s 8/s 128 KiB/s 186 KiB/s 974.17 us 155.98 us 2024-03-26T17:02:13.123 INFO:tasks.workunit.client.3.smithi157.stdout:myimage13 6/s 9/s 180 KiB/s 180 KiB/s 996.03 us 159.10 us 2024-03-26T17:02:13.123 INFO:tasks.workunit.client.3.smithi157.stdout:myimage52 6/s 8/s 161 KiB/s 173 KiB/s 1.05 ms 152.69 us 2024-03-26T17:02:13.124 INFO:tasks.workunit.client.3.smithi157.stdout:myimage8 6/s 8/s 185 KiB/s 202 KiB/s 1.07 ms 153.86 us 2024-03-26T17:02:13.124 INFO:tasks.workunit.client.3.smithi157.stdout:myimage49 6/s 8/s 154 KiB/s 165 KiB/s 1.02 ms 158.42 us 2024-03-26T17:02:13.124 INFO:tasks.workunit.client.3.smithi157.stdout:myimage55 6/s 8/s 153 KiB/s 187 KiB/s 1.01 ms 154.96 us 2024-03-26T17:02:13.124 INFO:tasks.workunit.client.3.smithi157.stdout:myimage41 5/s 9/s 158 KiB/s 178 KiB/s 1.04 ms 153.66 us 2024-03-26T17:02:13.124 INFO:tasks.workunit.client.3.smithi157.stdout:myimage48 4/s 10/s 110 KiB/s 247 KiB/s 1.01 ms 160.20 us 2024-03-26T17:02:13.124 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:02:13.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:02:12 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:02:12] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:02:13.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:02:12 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:02:12] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:02:13.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:02:12 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:02:13.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:13 smithi044 ceph-mon[30624]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:02:13.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:13 smithi044 ceph-mon[30624]: { 2024-03-26T17:02:13.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:13 smithi044 ceph-mon[30624]: "prefix": "rbd perf image stats", 2024-03-26T17:02:13.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:13 smithi044 ceph-mon[30624]: "pool_spec": "mypool", 2024-03-26T17:02:13.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:13 smithi044 ceph-mon[30624]: "sort_by": "write_ops", 2024-03-26T17:02:13.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:13 smithi044 ceph-mon[30624]: "format": "json" 2024-03-26T17:02:13.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:13 smithi044 ceph-mon[30624]: }"]: dispatch 2024-03-26T17:02:13.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:13 smithi064 ceph-mon[34420]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:02:13.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:13 smithi064 ceph-mon[34420]: { 2024-03-26T17:02:13.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:13 smithi064 ceph-mon[34420]: "prefix": "rbd perf image stats", 2024-03-26T17:02:13.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:13 smithi064 ceph-mon[34420]: "pool_spec": "mypool", 2024-03-26T17:02:13.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:13 smithi064 ceph-mon[34420]: "sort_by": "write_ops", 2024-03-26T17:02:13.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:13 smithi064 ceph-mon[34420]: "format": "json" 2024-03-26T17:02:13.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:13 smithi064 ceph-mon[34420]: }"]: dispatch 2024-03-26T17:02:13.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:13 smithi149 ceph-mon[34678]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:02:13.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:13 smithi149 ceph-mon[34678]: { 2024-03-26T17:02:13.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:13 smithi149 ceph-mon[34678]: "prefix": "rbd perf image stats", 2024-03-26T17:02:13.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:13 smithi149 ceph-mon[34678]: "pool_spec": "mypool", 2024-03-26T17:02:13.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:13 smithi149 ceph-mon[34678]: "sort_by": "write_ops", 2024-03-26T17:02:13.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:13 smithi149 ceph-mon[34678]: "format": "json" 2024-03-26T17:02:13.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:13 smithi149 ceph-mon[34678]: }"]: dispatch 2024-03-26T17:02:14.056 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:02:13 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:02:13] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:02:14.056 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:02:13 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:02:13] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:02:14.056 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:02:13 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:02:14.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:14 smithi044 ceph-mon[30624]: Health check update: 7 slow ops, oldest one blocked for 228 sec, daemons [mon.b,mon.c] have slow ops. (SLOW_OPS) 2024-03-26T17:02:14.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:14 smithi044 ceph-mon[30624]: pgmap v467: 33 pgs: 33 active+clean; 1006 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 11 MiB/s rd, 12 MiB/s wr, 1.00k op/s 2024-03-26T17:02:14.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:02:14 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:02:14] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:02:14.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:02:14 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:02:14] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:02:14.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:02:14 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:02:14.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:14 smithi064 ceph-mon[34420]: Health check update: 7 slow ops, oldest one blocked for 228 sec, daemons [mon.b,mon.c] have slow ops. (SLOW_OPS) 2024-03-26T17:02:14.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:14 smithi064 ceph-mon[34420]: pgmap v467: 33 pgs: 33 active+clean; 1006 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 11 MiB/s rd, 12 MiB/s wr, 1.00k op/s 2024-03-26T17:02:14.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:14 smithi149 ceph-mon[34678]: Health check update: 7 slow ops, oldest one blocked for 228 sec, daemons [mon.b,mon.c] have slow ops. (SLOW_OPS) 2024-03-26T17:02:14.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:14 smithi149 ceph-mon[34678]: pgmap v467: 33 pgs: 33 active+clean; 1006 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 11 MiB/s rd, 12 MiB/s wr, 1.00k op/s 2024-03-26T17:02:15.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:02:14 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:02:14] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:02:15.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:02:14 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:02:14] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:02:15.147 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:02:14 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:02:15.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:15 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-b[34416]: 2024-03-26T17:02:15.286+0000 7ff022916700 -1 mon.b@2(peon) e3 get_health_metrics reporting 4 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T17:02:15.892 INFO:tasks.nvmeof.[nvmeof.thrasher]:nvmeof daemons to thrash: 1 2024-03-26T17:02:15.892 INFO:tasks.nvmeof.[nvmeof.thrasher]:kill nvmeof.b 2024-03-26T17:02:15.892 INFO:tasks.nvmeof.ceph.nvmeof.nvmeof.b:Stopping nvmeof.nvmeof.b... 2024-03-26T17:02:15.893 DEBUG:teuthology.orchestra.run.smithi064:> sudo systemctl stop ceph-4394d798-eb90-11ee-95d0-87774f69a715@nvmeof.nvmeof.b 2024-03-26T17:02:15.920 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:02:15 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:02:15] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:02:15.920 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:02:15 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:02:15] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:02:15.920 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:02:15 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:02:16.206 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:02:15 smithi064 systemd[1]: Stopping Ceph nvmeof.nvmeof.b for 4394d798-eb90-11ee-95d0-87774f69a715... 2024-03-26T17:02:16.463 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:16 smithi044 ceph-mon[30624]: pgmap v468: 33 pgs: 33 active+clean; 1007 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 9.8 MiB/s rd, 11 MiB/s wr, 898 op/s 2024-03-26T17:02:16.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:16 smithi064 ceph-mon[34420]: pgmap v468: 33 pgs: 33 active+clean; 1007 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 9.8 MiB/s rd, 11 MiB/s wr, 898 op/s 2024-03-26T17:02:16.556 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:02:16 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:02:16] INFO utils.py:391: Will compress log file /var/log/ceph/nvmeof-client.nvmeof.nvmeof.b/nvmeof-log to /var/log/ceph/nvmeof-client.nvmeof.nvmeof.b/nvmeof-log.gz 2024-03-26T17:02:16.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:16 smithi149 ceph-mon[34678]: pgmap v468: 33 pgs: 33 active+clean; 1007 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 9.8 MiB/s rd, 11 MiB/s wr, 898 op/s 2024-03-26T17:02:16.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:16 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 2024-03-26T17:02:16.212+0000 7fa707a55700 -1 mon.c@1(peon) e3 get_health_metrics reporting 3 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T17:02:16.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:02:16 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:02:16] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:02:16.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:02:16 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:02:16] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:02:16.766 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:02:16 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:02:17.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:02:16 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:02:16] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:02:17.147 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:02:16 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:02:16] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:02:17.147 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:02:16 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:02:18.056 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:02:17 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:02:17] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:02:18.056 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:02:17 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:02:17] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:02:18.056 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:02:17 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:02:18.124 INFO:tasks.workunit.client.3.smithi157.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-26T17:02:18.124 INFO:tasks.workunit.client.3.smithi157.stdout:myimage58 10/s 7/s 245 KiB/s 141 KiB/s 1.03 ms 159.59 us 2024-03-26T17:02:18.124 INFO:tasks.workunit.client.3.smithi157.stdout:myimage52 9/s 6/s 258 KiB/s 125 KiB/s 1.09 ms 165.65 us 2024-03-26T17:02:18.124 INFO:tasks.workunit.client.3.smithi157.stdout:myimage42 9/s 7/s 226 KiB/s 168 KiB/s 1.06 ms 156.67 us 2024-03-26T17:02:18.124 INFO:tasks.workunit.client.3.smithi157.stdout:myimage34 9/s 6/s 230 KiB/s 139 KiB/s 1.07 ms 169.20 us 2024-03-26T17:02:18.124 INFO:tasks.workunit.client.3.smithi157.stdout:myimage40 9/s 6/s 214 KiB/s 145 KiB/s 1.04 ms 162.55 us 2024-03-26T17:02:18.124 INFO:tasks.workunit.client.3.smithi157.stdout:myimage19 9/s 9/s 199 KiB/s 180 KiB/s 1.02 ms 159.82 us 2024-03-26T17:02:18.124 INFO:tasks.workunit.client.3.smithi157.stdout:myimage33 9/s 7/s 230 KiB/s 131 KiB/s 1.07 ms 164.37 us 2024-03-26T17:02:18.124 INFO:tasks.workunit.client.3.smithi157.stdout:myimage46 9/s 7/s 205 KiB/s 170 KiB/s 1.05 ms 168.98 us 2024-03-26T17:02:18.124 INFO:tasks.workunit.client.3.smithi157.stdout:myimage8 9/s 6/s 182 KiB/s 103 KiB/s 1.06 ms 153.79 us 2024-03-26T17:02:18.124 INFO:tasks.workunit.client.3.smithi157.stdout:myimage29 9/s 7/s 250 KiB/s 135 KiB/s 1.01 ms 168.69 us 2024-03-26T17:02:18.124 INFO:tasks.workunit.client.3.smithi157.stdout:myimage15 8/s 6/s 197 KiB/s 122 KiB/s 1.03 ms 158.79 us 2024-03-26T17:02:18.124 INFO:tasks.workunit.client.3.smithi157.stdout:myimage31 8/s 6/s 205 KiB/s 134 KiB/s 1.07 ms 154.04 us 2024-03-26T17:02:18.125 INFO:tasks.workunit.client.3.smithi157.stdout:myimage35 8/s 6/s 182 KiB/s 142 KiB/s 1.05 ms 158.41 us 2024-03-26T17:02:18.125 INFO:tasks.workunit.client.3.smithi157.stdout:myimage37 8/s 6/s 196 KiB/s 170 KiB/s 1.07 ms 159.39 us 2024-03-26T17:02:18.125 INFO:tasks.workunit.client.3.smithi157.stdout:myimage4 8/s 6/s 187 KiB/s 159 KiB/s 1.03 ms 154.91 us 2024-03-26T17:02:18.125 INFO:tasks.workunit.client.3.smithi157.stdout:myimage17 8/s 7/s 193 KiB/s 171 KiB/s 1.05 ms 162.36 us 2024-03-26T17:02:18.125 INFO:tasks.workunit.client.3.smithi157.stdout:myimage25 8/s 7/s 185 KiB/s 162 KiB/s 1.11 ms 157.42 us 2024-03-26T17:02:18.125 INFO:tasks.workunit.client.3.smithi157.stdout:myimage36 8/s 8/s 227 KiB/s 161 KiB/s 1.05 ms 154.13 us 2024-03-26T17:02:18.125 INFO:tasks.workunit.client.3.smithi157.stdout:myimage43 8/s 6/s 209 KiB/s 143 KiB/s 1.07 ms 156.68 us 2024-03-26T17:02:18.125 INFO:tasks.workunit.client.3.smithi157.stdout:myimage23 8/s 7/s 162 KiB/s 132 KiB/s 986.88 us 154.07 us 2024-03-26T17:02:18.125 INFO:tasks.workunit.client.3.smithi157.stdout:myimage30 8/s 6/s 214 KiB/s 126 KiB/s 1.09 ms 157.63 us 2024-03-26T17:02:18.125 INFO:tasks.workunit.client.3.smithi157.stdout:myimage44 8/s 8/s 175 KiB/s 160 KiB/s 1.06 ms 165.34 us 2024-03-26T17:02:18.125 INFO:tasks.workunit.client.3.smithi157.stdout:myimage20 8/s 8/s 190 KiB/s 208 KiB/s 1.06 ms 162.76 us 2024-03-26T17:02:18.125 INFO:tasks.workunit.client.3.smithi157.stdout:myimage50 8/s 5/s 210 KiB/s 105 KiB/s 1.07 ms 154.02 us 2024-03-26T17:02:18.125 INFO:tasks.workunit.client.3.smithi157.stdout:myimage57 8/s 7/s 178 KiB/s 175 KiB/s 1.04 ms 171.24 us 2024-03-26T17:02:18.125 INFO:tasks.workunit.client.3.smithi157.stdout:myimage27 8/s 6/s 183 KiB/s 121 KiB/s 1.03 ms 161.73 us 2024-03-26T17:02:18.125 INFO:tasks.workunit.client.3.smithi157.stdout:myimage3 8/s 6/s 168 KiB/s 166 KiB/s 997.42 us 158.66 us 2024-03-26T17:02:18.126 INFO:tasks.workunit.client.3.smithi157.stdout:myimage49 7/s 6/s 215 KiB/s 146 KiB/s 1.07 ms 162.53 us 2024-03-26T17:02:18.126 INFO:tasks.workunit.client.3.smithi157.stdout:myimage21 7/s 8/s 187 KiB/s 169 KiB/s 1.10 ms 160.55 us 2024-03-26T17:02:18.126 INFO:tasks.workunit.client.3.smithi157.stdout:myimage26 7/s 7/s 182 KiB/s 134 KiB/s 1.06 ms 155.68 us 2024-03-26T17:02:18.126 INFO:tasks.workunit.client.3.smithi157.stdout:myimage54 7/s 6/s 151 KiB/s 152 KiB/s 1.05 ms 172.11 us 2024-03-26T17:02:18.126 INFO:tasks.workunit.client.3.smithi157.stdout:myimage2 7/s 6/s 187 KiB/s 194 KiB/s 1.09 ms 156.01 us 2024-03-26T17:02:18.126 INFO:tasks.workunit.client.3.smithi157.stdout:myimage32 7/s 8/s 162 KiB/s 147 KiB/s 1.05 ms 154.15 us 2024-03-26T17:02:18.126 INFO:tasks.workunit.client.3.smithi157.stdout:myimage6 7/s 8/s 169 KiB/s 202 KiB/s 1.06 ms 163.08 us 2024-03-26T17:02:18.126 INFO:tasks.workunit.client.3.smithi157.stdout:myimage7 7/s 7/s 184 KiB/s 142 KiB/s 1.07 ms 160.77 us 2024-03-26T17:02:18.126 INFO:tasks.workunit.client.3.smithi157.stdout:myimage28 7/s 6/s 119 KiB/s 136 KiB/s 1.08 ms 156.03 us 2024-03-26T17:02:18.126 INFO:tasks.workunit.client.3.smithi157.stdout:myimage39 7/s 6/s 156 KiB/s 138 KiB/s 1.02 ms 170.70 us 2024-03-26T17:02:18.126 INFO:tasks.workunit.client.3.smithi157.stdout:myimage41 7/s 7/s 156 KiB/s 154 KiB/s 1.06 ms 151.88 us 2024-03-26T17:02:18.126 INFO:tasks.workunit.client.3.smithi157.stdout:myimage51 7/s 6/s 179 KiB/s 146 KiB/s 1.09 ms 163.49 us 2024-03-26T17:02:18.126 INFO:tasks.workunit.client.3.smithi157.stdout:myimage55 7/s 8/s 160 KiB/s 206 KiB/s 1.09 ms 165.25 us 2024-03-26T17:02:18.126 INFO:tasks.workunit.client.3.smithi157.stdout:myimage53 7/s 8/s 154 KiB/s 210 KiB/s 1.07 ms 158.82 us 2024-03-26T17:02:18.127 INFO:tasks.workunit.client.3.smithi157.stdout:myimage59 7/s 8/s 215 KiB/s 136 KiB/s 1.04 ms 161.30 us 2024-03-26T17:02:18.127 INFO:tasks.workunit.client.3.smithi157.stdout:myimage22 7/s 8/s 184 KiB/s 155 KiB/s 1.10 ms 172.46 us 2024-03-26T17:02:18.127 INFO:tasks.workunit.client.3.smithi157.stdout:myimage38 7/s 8/s 181 KiB/s 170 KiB/s 1.05 ms 160.84 us 2024-03-26T17:02:18.127 INFO:tasks.workunit.client.3.smithi157.stdout:myimage47 7/s 7/s 182 KiB/s 127 KiB/s 1.04 ms 163.15 us 2024-03-26T17:02:18.127 INFO:tasks.workunit.client.3.smithi157.stdout:myimage9 7/s 7/s 157 KiB/s 174 KiB/s 1.08 ms 158.31 us 2024-03-26T17:02:18.127 INFO:tasks.workunit.client.3.smithi157.stdout:myimage18 7/s 7/s 130 KiB/s 154 KiB/s 1.04 ms 165.56 us 2024-03-26T17:02:18.127 INFO:tasks.workunit.client.3.smithi157.stdout:myimage24 7/s 7/s 161 KiB/s 133 KiB/s 1.04 ms 150.35 us 2024-03-26T17:02:18.127 INFO:tasks.workunit.client.3.smithi157.stdout:myimage5 6/s 7/s 145 KiB/s 152 KiB/s 1.05 ms 154.87 us 2024-03-26T17:02:18.127 INFO:tasks.workunit.client.3.smithi157.stdout:myimage45 6/s 7/s 117 KiB/s 169 KiB/s 1.02 ms 155.66 us 2024-03-26T17:02:18.127 INFO:tasks.workunit.client.3.smithi157.stdout:myimage16 6/s 6/s 147 KiB/s 134 KiB/s 1.06 ms 171.08 us 2024-03-26T17:02:18.127 INFO:tasks.workunit.client.3.smithi157.stdout:myimage48 6/s 7/s 156 KiB/s 161 KiB/s 1.07 ms 157.07 us 2024-03-26T17:02:18.127 INFO:tasks.workunit.client.3.smithi157.stdout:myimage12 6/s 8/s 162 KiB/s 201 KiB/s 1.12 ms 156.26 us 2024-03-26T17:02:18.127 INFO:tasks.workunit.client.3.smithi157.stdout:myimage60 6/s 8/s 168 KiB/s 158 KiB/s 1.06 ms 156.55 us 2024-03-26T17:02:18.127 INFO:tasks.workunit.client.3.smithi157.stdout:myimage10 6/s 7/s 140 KiB/s 134 KiB/s 1.07 ms 155.57 us 2024-03-26T17:02:18.127 INFO:tasks.workunit.client.3.smithi157.stdout:myimage56 6/s 9/s 127 KiB/s 181 KiB/s 1.09 ms 151.55 us 2024-03-26T17:02:18.128 INFO:tasks.workunit.client.3.smithi157.stdout:myimage1 5/s 8/s 138 KiB/s 186 KiB/s 1.01 ms 171.86 us 2024-03-26T17:02:18.128 INFO:tasks.workunit.client.3.smithi157.stdout:myimage14 5/s 8/s 147 KiB/s 170 KiB/s 1.08 ms 154.49 us 2024-03-26T17:02:18.128 INFO:tasks.workunit.client.3.smithi157.stdout:myimage11 5/s 7/s 105 KiB/s 157 KiB/s 1.10 ms 160.37 us 2024-03-26T17:02:18.128 INFO:tasks.workunit.client.3.smithi157.stdout:myimage13 5/s 9/s 128 KiB/s 168 KiB/s 1.03 ms 155.38 us 2024-03-26T17:02:18.128 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:02:18.475 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:18 smithi044 ceph-mon[30624]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:02:18.475 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:18 smithi044 ceph-mon[30624]: { 2024-03-26T17:02:18.475 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:18 smithi044 ceph-mon[30624]: "prefix": "rbd perf image stats", 2024-03-26T17:02:18.475 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:18 smithi044 ceph-mon[30624]: "pool_spec": "mypool", 2024-03-26T17:02:18.475 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:18 smithi044 ceph-mon[30624]: "sort_by": "write_ops", 2024-03-26T17:02:18.475 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:18 smithi044 ceph-mon[30624]: "format": "json" 2024-03-26T17:02:18.475 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:18 smithi044 ceph-mon[30624]: }"]: dispatch 2024-03-26T17:02:18.475 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:18 smithi044 ceph-mon[30624]: pgmap v469: 33 pgs: 33 active+clean; 1009 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 9.5 MiB/s rd, 11 MiB/s wr, 906 op/s 2024-03-26T17:02:18.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:18 smithi064 ceph-mon[34420]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:02:18.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:18 smithi064 ceph-mon[34420]: { 2024-03-26T17:02:18.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:18 smithi064 ceph-mon[34420]: "prefix": "rbd perf image stats", 2024-03-26T17:02:18.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:18 smithi064 ceph-mon[34420]: "pool_spec": "mypool", 2024-03-26T17:02:18.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:18 smithi064 ceph-mon[34420]: "sort_by": "write_ops", 2024-03-26T17:02:18.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:18 smithi064 ceph-mon[34420]: "format": "json" 2024-03-26T17:02:18.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:18 smithi064 ceph-mon[34420]: }"]: dispatch 2024-03-26T17:02:18.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:18 smithi064 ceph-mon[34420]: pgmap v469: 33 pgs: 33 active+clean; 1009 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 9.5 MiB/s rd, 11 MiB/s wr, 906 op/s 2024-03-26T17:02:18.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:18 smithi149 ceph-mon[34678]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:02:18.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:18 smithi149 ceph-mon[34678]: { 2024-03-26T17:02:18.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:18 smithi149 ceph-mon[34678]: "prefix": "rbd perf image stats", 2024-03-26T17:02:18.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:18 smithi149 ceph-mon[34678]: "pool_spec": "mypool", 2024-03-26T17:02:18.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:18 smithi149 ceph-mon[34678]: "sort_by": "write_ops", 2024-03-26T17:02:18.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:18 smithi149 ceph-mon[34678]: "format": "json" 2024-03-26T17:02:18.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:18 smithi149 ceph-mon[34678]: }"]: dispatch 2024-03-26T17:02:18.647 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:18 smithi149 ceph-mon[34678]: pgmap v469: 33 pgs: 33 active+clean; 1009 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 9.5 MiB/s rd, 11 MiB/s wr, 906 op/s 2024-03-26T17:02:18.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:02:18 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:02:18] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:02:18.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:02:18 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:02:18] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:02:18.766 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:02:18 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:02:19.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:02:18 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:02:18] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:02:19.147 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:02:18 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:02:18] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:02:19.147 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:02:18 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:02:19.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:19 smithi044 ceph-mon[30624]: Health check update: 7 slow ops, oldest one blocked for 233 sec, daemons [mon.b,mon.c] have slow ops. (SLOW_OPS) 2024-03-26T17:02:19.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:19 smithi064 ceph-mon[34420]: Health check update: 7 slow ops, oldest one blocked for 233 sec, daemons [mon.b,mon.c] have slow ops. (SLOW_OPS) 2024-03-26T17:02:19.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:19 smithi149 ceph-mon[34678]: Health check update: 7 slow ops, oldest one blocked for 233 sec, daemons [mon.b,mon.c] have slow ops. (SLOW_OPS) 2024-03-26T17:02:20.056 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:02:19 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:02:19] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:02:20.056 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:02:19 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:02:19] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:02:20.056 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:02:19 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:02:20.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:20 smithi044 ceph-mon[30624]: pgmap v470: 33 pgs: 33 active+clean; 1011 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 10 MiB/s rd, 11 MiB/s wr, 963 op/s 2024-03-26T17:02:20.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:20 smithi064 ceph-mon[34420]: pgmap v470: 33 pgs: 33 active+clean; 1011 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 10 MiB/s rd, 11 MiB/s wr, 963 op/s 2024-03-26T17:02:20.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:20 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-b[34416]: 2024-03-26T17:02:20.286+0000 7ff022916700 -1 mon.b@2(peon) e3 get_health_metrics reporting 4 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T17:02:20.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:20 smithi149 ceph-mon[34678]: pgmap v470: 33 pgs: 33 active+clean; 1011 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 10 MiB/s rd, 11 MiB/s wr, 963 op/s 2024-03-26T17:02:20.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:02:20 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:02:20] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:02:20.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:02:20 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:02:20] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:02:20.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:02:20 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:02:21.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:02:20 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:02:20] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:02:21.147 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:02:20 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:02:20] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:02:21.147 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:02:20 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:02:21.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:21 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 2024-03-26T17:02:21.212+0000 7fa707a55700 -1 mon.c@1(peon) e3 get_health_metrics reporting 3 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T17:02:22.056 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:02:21 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:02:21] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:02:22.056 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:02:21 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:02:21] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:02:22.056 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:02:21 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:02:22.499 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:22 smithi044 ceph-mon[30624]: pgmap v471: 33 pgs: 33 active+clean; 1012 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 8.5 MiB/s rd, 9.3 MiB/s wr, 844 op/s 2024-03-26T17:02:22.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:22 smithi064 ceph-mon[34420]: pgmap v471: 33 pgs: 33 active+clean; 1012 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 8.5 MiB/s rd, 9.3 MiB/s wr, 844 op/s 2024-03-26T17:02:22.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:22 smithi149 ceph-mon[34678]: pgmap v471: 33 pgs: 33 active+clean; 1012 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 8.5 MiB/s rd, 9.3 MiB/s wr, 844 op/s 2024-03-26T17:02:22.766 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:02:22 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:02:22] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:02:22.766 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:02:22 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:02:22] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:02:22.766 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:02:22 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:02:23.061 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:02:23.069 INFO:tasks.workunit.client.3.smithi157.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2024-03-26T17:02:23.069 INFO:tasks.workunit.client.3.smithi157.stdout: 15.20 171.2k 158.8k 0.0k 1.7M 1.6M 0.0k nvme2n1 2024-03-26T17:02:23.069 INFO:tasks.workunit.client.3.smithi157.stdout: 15.20 147.6k 152.8k 0.0k 1.4M 1.5M 0.0k nvme2n10 2024-03-26T17:02:23.069 INFO:tasks.workunit.client.3.smithi157.stdout: 15.10 168.4k 155.6k 0.0k 1.6M 1.5M 0.0k nvme2n11 2024-03-26T17:02:23.069 INFO:tasks.workunit.client.3.smithi157.stdout: 15.10 159.6k 158.0k 0.0k 1.6M 1.5M 0.0k nvme2n12 2024-03-26T17:02:23.069 INFO:tasks.workunit.client.3.smithi157.stdout: 15.10 178.0k 133.2k 0.0k 1.7M 1.3M 0.0k nvme2n13 2024-03-26T17:02:23.069 INFO:tasks.workunit.client.3.smithi157.stdout: 15.10 151.2k 163.2k 0.0k 1.5M 1.6M 0.0k nvme2n14 2024-03-26T17:02:23.069 INFO:tasks.workunit.client.3.smithi157.stdout: 15.20 126.8k 164.8k 0.0k 1.2M 1.6M 0.0k nvme2n15 2024-03-26T17:02:23.070 INFO:tasks.workunit.client.3.smithi157.stdout: 15.20 146.4k 162.0k 0.0k 1.4M 1.6M 0.0k nvme2n16 2024-03-26T17:02:23.070 INFO:tasks.workunit.client.3.smithi157.stdout: 15.20 164.4k 172.8k 0.0k 1.6M 1.7M 0.0k nvme2n17 2024-03-26T17:02:23.070 INFO:tasks.workunit.client.3.smithi157.stdout: 15.20 165.2k 162.8k 0.0k 1.6M 1.6M 0.0k nvme2n18 2024-03-26T17:02:23.070 INFO:tasks.workunit.client.3.smithi157.stdout: 15.20 172.0k 156.4k 0.0k 1.7M 1.5M 0.0k nvme2n19 2024-03-26T17:02:23.070 INFO:tasks.workunit.client.3.smithi157.stdout: 15.20 184.4k 139.2k 0.0k 1.8M 1.4M 0.0k nvme2n2 2024-03-26T17:02:23.070 INFO:tasks.workunit.client.3.smithi157.stdout: 15.20 195.6k 151.6k 0.0k 1.9M 1.5M 0.0k nvme2n20 2024-03-26T17:02:23.070 INFO:tasks.workunit.client.3.smithi157.stdout: 15.20 153.6k 194.4k 0.0k 1.5M 1.9M 0.0k nvme2n3 2024-03-26T17:02:23.070 INFO:tasks.workunit.client.3.smithi157.stdout: 15.20 170.4k 176.4k 0.0k 1.7M 1.7M 0.0k nvme2n4 2024-03-26T17:02:23.070 INFO:tasks.workunit.client.3.smithi157.stdout: 15.20 160.8k 172.8k 0.0k 1.6M 1.7M 0.0k nvme2n5 2024-03-26T17:02:23.070 INFO:tasks.workunit.client.3.smithi157.stdout: 15.20 145.6k 169.6k 0.0k 1.4M 1.7M 0.0k nvme2n6 2024-03-26T17:02:23.070 INFO:tasks.workunit.client.3.smithi157.stdout: 15.20 173.6k 159.2k 0.0k 1.7M 1.6M 0.0k nvme2n7 2024-03-26T17:02:23.070 INFO:tasks.workunit.client.3.smithi157.stdout: 15.20 161.6k 141.2k 0.0k 1.6M 1.4M 0.0k nvme2n8 2024-03-26T17:02:23.071 INFO:tasks.workunit.client.3.smithi157.stdout: 15.20 130.4k 193.6k 0.0k 1.3M 1.9M 0.0k nvme2n9 2024-03-26T17:02:23.071 INFO:tasks.workunit.client.3.smithi157.stdout: 15.20 176.0k 159.6k 0.0k 1.7M 1.6M 0.0k nvme5n1 2024-03-26T17:02:23.071 INFO:tasks.workunit.client.3.smithi157.stdout: 15.20 174.0k 143.2k 0.0k 1.7M 1.4M 0.0k nvme5n10 2024-03-26T17:02:23.071 INFO:tasks.workunit.client.3.smithi157.stdout: 15.20 157.2k 183.2k 0.0k 1.5M 1.8M 0.0k nvme5n11 2024-03-26T17:02:23.071 INFO:tasks.workunit.client.3.smithi157.stdout: 15.10 158.0k 174.0k 0.0k 1.5M 1.7M 0.0k nvme5n12 2024-03-26T17:02:23.071 INFO:tasks.workunit.client.3.smithi157.stdout: 15.10 150.8k 172.4k 0.0k 1.5M 1.7M 0.0k nvme5n13 2024-03-26T17:02:23.071 INFO:tasks.workunit.client.3.smithi157.stdout: 15.10 164.8k 167.2k 0.0k 1.6M 1.6M 0.0k nvme5n14 2024-03-26T17:02:23.071 INFO:tasks.workunit.client.3.smithi157.stdout: 15.20 172.4k 141.6k 0.0k 1.7M 1.4M 0.0k nvme5n15 2024-03-26T17:02:23.071 INFO:tasks.workunit.client.3.smithi157.stdout: 15.20 155.6k 175.2k 0.0k 1.5M 1.7M 0.0k nvme5n16 2024-03-26T17:02:23.071 INFO:tasks.workunit.client.3.smithi157.stdout: 15.20 178.8k 144.8k 0.0k 1.7M 1.4M 0.0k nvme5n17 2024-03-26T17:02:23.071 INFO:tasks.workunit.client.3.smithi157.stdout: 15.20 169.6k 157.6k 0.0k 1.7M 1.5M 0.0k nvme5n18 2024-03-26T17:02:23.071 INFO:tasks.workunit.client.3.smithi157.stdout: 15.20 144.4k 180.0k 0.0k 1.4M 1.8M 0.0k nvme5n19 2024-03-26T17:02:23.071 INFO:tasks.workunit.client.3.smithi157.stdout: 15.20 146.4k 160.0k 0.0k 1.4M 1.6M 0.0k nvme5n2 2024-03-26T17:02:23.072 INFO:tasks.workunit.client.3.smithi157.stdout: 15.20 162.0k 161.6k 0.0k 1.6M 1.6M 0.0k nvme5n20 2024-03-26T17:02:23.072 INFO:tasks.workunit.client.3.smithi157.stdout: 15.20 150.0k 142.0k 0.0k 1.5M 1.4M 0.0k nvme5n3 2024-03-26T17:02:23.072 INFO:tasks.workunit.client.3.smithi157.stdout: 15.20 135.2k 170.8k 0.0k 1.3M 1.7M 0.0k nvme5n4 2024-03-26T17:02:23.072 INFO:tasks.workunit.client.3.smithi157.stdout: 15.20 170.8k 157.2k 0.0k 1.7M 1.5M 0.0k nvme5n5 2024-03-26T17:02:23.072 INFO:tasks.workunit.client.3.smithi157.stdout: 15.20 182.8k 151.2k 0.0k 1.8M 1.5M 0.0k nvme5n6 2024-03-26T17:02:23.072 INFO:tasks.workunit.client.3.smithi157.stdout: 15.20 150.4k 174.8k 0.0k 1.5M 1.7M 0.0k nvme5n7 2024-03-26T17:02:23.072 INFO:tasks.workunit.client.3.smithi157.stdout: 15.20 144.0k 150.8k 0.0k 1.4M 1.5M 0.0k nvme5n8 2024-03-26T17:02:23.072 INFO:tasks.workunit.client.3.smithi157.stdout: 15.20 173.6k 163.6k 0.0k 1.7M 1.6M 0.0k nvme5n9 2024-03-26T17:02:23.072 INFO:tasks.workunit.client.3.smithi157.stdout: 15.20 153.2k 189.6k 0.0k 1.5M 1.9M 0.0k nvme8n1 2024-03-26T17:02:23.072 INFO:tasks.workunit.client.3.smithi157.stdout: 15.20 156.4k 189.6k 0.0k 1.5M 1.9M 0.0k nvme8n10 2024-03-26T17:02:23.072 INFO:tasks.workunit.client.3.smithi157.stdout: 15.10 187.6k 158.4k 0.0k 1.8M 1.5M 0.0k nvme8n11 2024-03-26T17:02:23.072 INFO:tasks.workunit.client.3.smithi157.stdout: 15.10 143.2k 182.8k 0.0k 1.4M 1.8M 0.0k nvme8n12 2024-03-26T17:02:23.072 INFO:tasks.workunit.client.3.smithi157.stdout: 15.10 143.6k 194.0k 0.0k 1.4M 1.9M 0.0k nvme8n13 2024-03-26T17:02:23.072 INFO:tasks.workunit.client.3.smithi157.stdout: 15.20 162.0k 170.4k 0.0k 1.6M 1.7M 0.0k nvme8n14 2024-03-26T17:02:23.073 INFO:tasks.workunit.client.3.smithi157.stdout: 15.20 188.0k 158.8k 0.0k 1.8M 1.6M 0.0k nvme8n15 2024-03-26T17:02:23.073 INFO:tasks.workunit.client.3.smithi157.stdout: 15.20 210.8k 146.0k 0.0k 2.1M 1.4M 0.0k nvme8n16 2024-03-26T17:02:23.073 INFO:tasks.workunit.client.3.smithi157.stdout: 15.20 140.0k 158.8k 0.0k 1.4M 1.6M 0.0k nvme8n17 2024-03-26T17:02:23.073 INFO:tasks.workunit.client.3.smithi157.stdout: 15.20 128.8k 170.0k 0.0k 1.3M 1.7M 0.0k nvme8n18 2024-03-26T17:02:23.073 INFO:tasks.workunit.client.3.smithi157.stdout: 15.20 159.2k 188.4k 0.0k 1.6M 1.8M 0.0k nvme8n19 2024-03-26T17:02:23.073 INFO:tasks.workunit.client.3.smithi157.stdout: 15.20 154.8k 169.2k 0.0k 1.5M 1.7M 0.0k nvme8n2 2024-03-26T17:02:23.073 INFO:tasks.workunit.client.3.smithi157.stdout: 15.20 178.4k 154.4k 0.0k 1.7M 1.5M 0.0k nvme8n20 2024-03-26T17:02:23.073 INFO:tasks.workunit.client.3.smithi157.stdout: 15.20 148.8k 180.8k 0.0k 1.5M 1.8M 0.0k nvme8n3 2024-03-26T17:02:23.073 INFO:tasks.workunit.client.3.smithi157.stdout: 15.20 143.2k 184.8k 0.0k 1.4M 1.8M 0.0k nvme8n4 2024-03-26T17:02:23.073 INFO:tasks.workunit.client.3.smithi157.stdout: 15.20 150.0k 170.4k 0.0k 1.5M 1.7M 0.0k nvme8n5 2024-03-26T17:02:23.073 INFO:tasks.workunit.client.3.smithi157.stdout: 15.20 173.6k 151.6k 0.0k 1.7M 1.5M 0.0k nvme8n6 2024-03-26T17:02:23.073 INFO:tasks.workunit.client.3.smithi157.stdout: 15.20 119.2k 182.0k 0.0k 1.2M 1.8M 0.0k nvme8n7 2024-03-26T17:02:23.073 INFO:tasks.workunit.client.3.smithi157.stdout: 15.20 173.6k 150.4k 0.0k 1.7M 1.5M 0.0k nvme8n8 2024-03-26T17:02:23.073 INFO:tasks.workunit.client.3.smithi157.stdout: 15.20 162.4k 170.4k 0.0k 1.6M 1.7M 0.0k nvme8n9 2024-03-26T17:02:23.073 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:02:23.128 INFO:tasks.workunit.client.3.smithi157.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-26T17:02:23.128 INFO:tasks.workunit.client.3.smithi157.stdout:myimage16 8/s 6/s 204 KiB/s 118 KiB/s 1.05 ms 160.68 us 2024-03-26T17:02:23.128 INFO:tasks.workunit.client.3.smithi157.stdout:myimage1 8/s 7/s 171 KiB/s 164 KiB/s 1.04 ms 177.22 us 2024-03-26T17:02:23.128 INFO:tasks.workunit.client.3.smithi157.stdout:myimage39 8/s 7/s 198 KiB/s 145 KiB/s 1.05 ms 157.37 us 2024-03-26T17:02:23.129 INFO:tasks.workunit.client.3.smithi157.stdout:myimage57 8/s 6/s 183 KiB/s 137 KiB/s 1.07 ms 165.11 us 2024-03-26T17:02:23.129 INFO:tasks.workunit.client.3.smithi157.stdout:myimage4 8/s 7/s 188 KiB/s 147 KiB/s 1.08 ms 163.13 us 2024-03-26T17:02:23.129 INFO:tasks.workunit.client.3.smithi157.stdout:myimage11 8/s 8/s 193 KiB/s 172 KiB/s 1.08 ms 155.43 us 2024-03-26T17:02:23.129 INFO:tasks.workunit.client.3.smithi157.stdout:myimage54 8/s 7/s 189 KiB/s 143 KiB/s 1.08 ms 160.80 us 2024-03-26T17:02:23.129 INFO:tasks.workunit.client.3.smithi157.stdout:myimage5 8/s 7/s 210 KiB/s 138 KiB/s 1.08 ms 160.77 us 2024-03-26T17:02:23.129 INFO:tasks.workunit.client.3.smithi157.stdout:myimage24 8/s 7/s 142 KiB/s 121 KiB/s 1.07 ms 155.62 us 2024-03-26T17:02:23.129 INFO:tasks.workunit.client.3.smithi157.stdout:myimage47 8/s 6/s 181 KiB/s 131 KiB/s 1.09 ms 162.89 us 2024-03-26T17:02:23.129 INFO:tasks.workunit.client.3.smithi157.stdout:myimage14 8/s 7/s 164 KiB/s 158 KiB/s 1.08 ms 169.73 us 2024-03-26T17:02:23.129 INFO:tasks.workunit.client.3.smithi157.stdout:myimage49 8/s 7/s 166 KiB/s 158 KiB/s 1.07 ms 153.50 us 2024-03-26T17:02:23.129 INFO:tasks.workunit.client.3.smithi157.stdout:myimage50 8/s 6/s 169 KiB/s 171 KiB/s 1.08 ms 161.71 us 2024-03-26T17:02:23.129 INFO:tasks.workunit.client.3.smithi157.stdout:myimage38 7/s 6/s 162 KiB/s 154 KiB/s 1.06 ms 170.19 us 2024-03-26T17:02:23.129 INFO:tasks.workunit.client.3.smithi157.stdout:myimage44 7/s 7/s 176 KiB/s 130 KiB/s 1.07 ms 165.97 us 2024-03-26T17:02:23.129 INFO:tasks.workunit.client.3.smithi157.stdout:myimage6 7/s 7/s 141 KiB/s 139 KiB/s 1.13 ms 156.52 us 2024-03-26T17:02:23.130 INFO:tasks.workunit.client.3.smithi157.stdout:myimage8 7/s 9/s 158 KiB/s 131 KiB/s 1.10 ms 159.68 us 2024-03-26T17:02:23.130 INFO:tasks.workunit.client.3.smithi157.stdout:myimage46 7/s 7/s 163 KiB/s 178 KiB/s 1.08 ms 168.91 us 2024-03-26T17:02:23.130 INFO:tasks.workunit.client.3.smithi157.stdout:myimage53 7/s 7/s 194 KiB/s 153 KiB/s 1.10 ms 169.25 us 2024-03-26T17:02:23.130 INFO:tasks.workunit.client.3.smithi157.stdout:myimage12 7/s 7/s 141 KiB/s 170 KiB/s 1.07 ms 163.29 us 2024-03-26T17:02:23.130 INFO:tasks.workunit.client.3.smithi157.stdout:myimage28 7/s 7/s 167 KiB/s 131 KiB/s 1.11 ms 155.15 us 2024-03-26T17:02:23.130 INFO:tasks.workunit.client.3.smithi157.stdout:myimage41 7/s 6/s 182 KiB/s 138 KiB/s 1.09 ms 149.53 us 2024-03-26T17:02:23.130 INFO:tasks.workunit.client.3.smithi157.stdout:myimage51 7/s 8/s 166 KiB/s 208 KiB/s 1.10 ms 167.23 us 2024-03-26T17:02:23.130 INFO:tasks.workunit.client.3.smithi157.stdout:myimage3 7/s 7/s 198 KiB/s 148 KiB/s 1.05 ms 163.04 us 2024-03-26T17:02:23.130 INFO:tasks.workunit.client.3.smithi157.stdout:myimage31 7/s 8/s 191 KiB/s 146 KiB/s 1.11 ms 160.08 us 2024-03-26T17:02:23.130 INFO:tasks.workunit.client.3.smithi157.stdout:myimage15 7/s 7/s 140 KiB/s 114 KiB/s 1.07 ms 158.40 us 2024-03-26T17:02:23.130 INFO:tasks.workunit.client.3.smithi157.stdout:myimage27 7/s 8/s 163 KiB/s 174 KiB/s 1.06 ms 161.01 us 2024-03-26T17:02:23.130 INFO:tasks.workunit.client.3.smithi157.stdout:myimage22 7/s 8/s 142 KiB/s 148 KiB/s 1.11 ms 162.10 us 2024-03-26T17:02:23.131 INFO:tasks.workunit.client.3.smithi157.stdout:myimage35 7/s 8/s 144 KiB/s 173 KiB/s 1.08 ms 159.91 us 2024-03-26T17:02:23.131 INFO:tasks.workunit.client.3.smithi157.stdout:myimage48 7/s 8/s 174 KiB/s 152 KiB/s 1.09 ms 166.05 us 2024-03-26T17:02:23.131 INFO:tasks.workunit.client.3.smithi157.stdout:myimage17 7/s 7/s 167 KiB/s 166 KiB/s 1.08 ms 162.81 us 2024-03-26T17:02:23.131 INFO:tasks.workunit.client.3.smithi157.stdout:myimage43 7/s 8/s 165 KiB/s 135 KiB/s 1.11 ms 153.12 us 2024-03-26T17:02:23.131 INFO:tasks.workunit.client.3.smithi157.stdout:myimage55 7/s 7/s 142 KiB/s 182 KiB/s 1.07 ms 156.78 us 2024-03-26T17:02:23.131 INFO:tasks.workunit.client.3.smithi157.stdout:myimage34 7/s 8/s 157 KiB/s 186 KiB/s 1.06 ms 166.62 us 2024-03-26T17:02:23.131 INFO:tasks.workunit.client.3.smithi157.stdout:myimage52 7/s 7/s 141 KiB/s 145 KiB/s 1.11 ms 166.77 us 2024-03-26T17:02:23.131 INFO:tasks.workunit.client.3.smithi157.stdout:myimage9 7/s 8/s 186 KiB/s 138 KiB/s 1.10 ms 164.93 us 2024-03-26T17:02:23.131 INFO:tasks.workunit.client.3.smithi157.stdout:myimage20 7/s 7/s 155 KiB/s 176 KiB/s 1.04 ms 160.97 us 2024-03-26T17:02:23.131 INFO:tasks.workunit.client.3.smithi157.stdout:myimage36 7/s 8/s 153 KiB/s 148 KiB/s 1.05 ms 165.95 us 2024-03-26T17:02:23.131 INFO:tasks.workunit.client.3.smithi157.stdout:myimage42 7/s 8/s 128 KiB/s 149 KiB/s 1.06 ms 165.23 us 2024-03-26T17:02:23.131 INFO:tasks.workunit.client.3.smithi157.stdout:myimage45 7/s 8/s 159 KiB/s 137 KiB/s 1.10 ms 163.61 us 2024-03-26T17:02:23.131 INFO:tasks.workunit.client.3.smithi157.stdout:myimage23 6/s 8/s 146 KiB/s 168 KiB/s 1.06 ms 167.20 us 2024-03-26T17:02:23.131 INFO:tasks.workunit.client.3.smithi157.stdout:myimage30 6/s 8/s 114 KiB/s 139 KiB/s 1.13 ms 159.84 us 2024-03-26T17:02:23.132 INFO:tasks.workunit.client.3.smithi157.stdout:myimage58 6/s 6/s 123 KiB/s 148 KiB/s 1.03 ms 160.69 us 2024-03-26T17:02:23.132 INFO:tasks.workunit.client.3.smithi157.stdout:myimage56 6/s 7/s 134 KiB/s 180 KiB/s 1.13 ms 168.06 us 2024-03-26T17:02:23.132 INFO:tasks.workunit.client.3.smithi157.stdout:myimage10 6/s 8/s 145 KiB/s 132 KiB/s 1.07 ms 172.55 us 2024-03-26T17:02:23.132 INFO:tasks.workunit.client.3.smithi157.stdout:myimage40 6/s 6/s 112 KiB/s 149 KiB/s 1.04 ms 165.42 us 2024-03-26T17:02:23.132 INFO:tasks.workunit.client.3.smithi157.stdout:myimage7 6/s 8/s 162 KiB/s 160 KiB/s 1.08 ms 156.18 us 2024-03-26T17:02:23.132 INFO:tasks.workunit.client.3.smithi157.stdout:myimage18 6/s 7/s 150 KiB/s 144 KiB/s 1.04 ms 176.23 us 2024-03-26T17:02:23.132 INFO:tasks.workunit.client.3.smithi157.stdout:myimage26 6/s 8/s 130 KiB/s 187 KiB/s 1.08 ms 156.23 us 2024-03-26T17:02:23.132 INFO:tasks.workunit.client.3.smithi157.stdout:myimage60 6/s 9/s 162 KiB/s 175 KiB/s 1.07 ms 166.20 us 2024-03-26T17:02:23.132 INFO:tasks.workunit.client.3.smithi157.stdout:myimage59 6/s 7/s 151 KiB/s 160 KiB/s 1.13 ms 158.33 us 2024-03-26T17:02:23.132 INFO:tasks.workunit.client.3.smithi157.stdout:myimage37 6/s 9/s 127 KiB/s 196 KiB/s 1.07 ms 159.92 us 2024-03-26T17:02:23.132 INFO:tasks.workunit.client.3.smithi157.stdout:myimage21 6/s 7/s 147 KiB/s 150 KiB/s 1.12 ms 157.67 us 2024-03-26T17:02:23.132 INFO:tasks.workunit.client.3.smithi157.stdout:myimage29 6/s 7/s 148 KiB/s 156 KiB/s 1.03 ms 159.09 us 2024-03-26T17:02:23.132 INFO:tasks.workunit.client.3.smithi157.stdout:myimage2 6/s 10/s 116 KiB/s 198 KiB/s 1.13 ms 165.34 us 2024-03-26T17:02:23.132 INFO:tasks.workunit.client.3.smithi157.stdout:myimage13 6/s 8/s 106 KiB/s 186 KiB/s 1.04 ms 150.39 us 2024-03-26T17:02:23.133 INFO:tasks.workunit.client.3.smithi157.stdout:myimage25 6/s 6/s 114 KiB/s 147 KiB/s 1.14 ms 161.30 us 2024-03-26T17:02:23.133 INFO:tasks.workunit.client.3.smithi157.stdout:myimage33 6/s 9/s 142 KiB/s 182 KiB/s 1.08 ms 152.05 us 2024-03-26T17:02:23.133 INFO:tasks.workunit.client.3.smithi157.stdout:myimage19 5/s 7/s 139 KiB/s 140 KiB/s 1.08 ms 164.14 us 2024-03-26T17:02:23.133 INFO:tasks.workunit.client.3.smithi157.stdout:myimage32 5/s 7/s 149 KiB/s 163 KiB/s 1.07 ms 156.65 us 2024-03-26T17:02:23.133 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:02:23.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:02:22 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:02:22] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:02:23.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:02:22 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:02:22] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:02:23.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:02:22 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:02:23.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:23 smithi044 ceph-mon[30624]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:02:23.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:23 smithi044 ceph-mon[30624]: { 2024-03-26T17:02:23.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:23 smithi044 ceph-mon[30624]: "prefix": "rbd perf image stats", 2024-03-26T17:02:23.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:23 smithi044 ceph-mon[30624]: "pool_spec": "mypool", 2024-03-26T17:02:23.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:23 smithi044 ceph-mon[30624]: "sort_by": "write_ops", 2024-03-26T17:02:23.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:23 smithi044 ceph-mon[30624]: "format": "json" 2024-03-26T17:02:23.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:23 smithi044 ceph-mon[30624]: }"]: dispatch 2024-03-26T17:02:23.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:23 smithi064 ceph-mon[34420]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:02:23.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:23 smithi064 ceph-mon[34420]: { 2024-03-26T17:02:23.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:23 smithi064 ceph-mon[34420]: "prefix": "rbd perf image stats", 2024-03-26T17:02:23.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:23 smithi064 ceph-mon[34420]: "pool_spec": "mypool", 2024-03-26T17:02:23.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:23 smithi064 ceph-mon[34420]: "sort_by": "write_ops", 2024-03-26T17:02:23.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:23 smithi064 ceph-mon[34420]: "format": "json" 2024-03-26T17:02:23.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:23 smithi064 ceph-mon[34420]: }"]: dispatch 2024-03-26T17:02:23.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:23 smithi149 ceph-mon[34678]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:02:23.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:23 smithi149 ceph-mon[34678]: { 2024-03-26T17:02:23.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:23 smithi149 ceph-mon[34678]: "prefix": "rbd perf image stats", 2024-03-26T17:02:23.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:23 smithi149 ceph-mon[34678]: "pool_spec": "mypool", 2024-03-26T17:02:23.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:23 smithi149 ceph-mon[34678]: "sort_by": "write_ops", 2024-03-26T17:02:23.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:23 smithi149 ceph-mon[34678]: "format": "json" 2024-03-26T17:02:23.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:23 smithi149 ceph-mon[34678]: }"]: dispatch 2024-03-26T17:02:24.056 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:02:23 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:02:23] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:02:24.056 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:02:23 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:02:23] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:02:24.056 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:02:23 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:02:24.511 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:24 smithi044 ceph-mon[30624]: Health check update: 7 slow ops, oldest one blocked for 238 sec, daemons [mon.b,mon.c] have slow ops. (SLOW_OPS) 2024-03-26T17:02:24.512 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:24 smithi044 ceph-mon[30624]: pgmap v472: 33 pgs: 33 active+clean; 1013 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 9.8 MiB/s rd, 11 MiB/s wr, 986 op/s 2024-03-26T17:02:24.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:24 smithi064 ceph-mon[34420]: Health check update: 7 slow ops, oldest one blocked for 238 sec, daemons [mon.b,mon.c] have slow ops. (SLOW_OPS) 2024-03-26T17:02:24.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:24 smithi064 ceph-mon[34420]: pgmap v472: 33 pgs: 33 active+clean; 1013 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 9.8 MiB/s rd, 11 MiB/s wr, 986 op/s 2024-03-26T17:02:24.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:24 smithi149 ceph-mon[34678]: Health check update: 7 slow ops, oldest one blocked for 238 sec, daemons [mon.b,mon.c] have slow ops. (SLOW_OPS) 2024-03-26T17:02:24.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:24 smithi149 ceph-mon[34678]: pgmap v472: 33 pgs: 33 active+clean; 1013 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 9.8 MiB/s rd, 11 MiB/s wr, 986 op/s 2024-03-26T17:02:24.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:02:24 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:02:24] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:02:24.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:02:24 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:02:24] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:02:24.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:02:24 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:02:25.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:02:24 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:02:24] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:02:25.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:02:24 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:02:24] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:02:25.147 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:02:24 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:02:25.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:25 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-b[34416]: 2024-03-26T17:02:25.286+0000 7ff022916700 -1 mon.b@2(peon) e3 get_health_metrics reporting 4 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T17:02:26.056 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:02:25 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:02:25] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:02:26.056 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:02:25 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: [26-Mar-2024 17:02:25] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:02:26.056 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:02:25 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b[54029]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.64', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 2041, 'max_cntlid': 4080, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:02:26.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:26 smithi044 ceph-mon[30624]: pgmap v473: 33 pgs: 33 active+clean; 1014 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 8.8 MiB/s rd, 9.4 MiB/s wr, 893 op/s 2024-03-26T17:02:26.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:26 smithi064 ceph-mon[34420]: pgmap v473: 33 pgs: 33 active+clean; 1014 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 8.8 MiB/s rd, 9.4 MiB/s wr, 893 op/s 2024-03-26T17:02:26.556 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:02:26 smithi064 bash[56313]: time="2024-03-26T17:02:26Z" level=warning msg="StopSignal SIGTERM failed to stop container ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b in 10 seconds, resorting to SIGKILL" 2024-03-26T17:02:26.556 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:02:26 smithi064 podman[56313]: 2024-03-26 17:02:26.245651784 +0000 UTC m=+10.137704707 container died 34da1d0e7c9e89a3be9df8acdb71006b948f66b1e873641283ea62fcbdd76ffa (image=quay.io/barakda1/nvmeof:qe_ceph_devel_21e59b2, name=ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b, io.openshift.tags=ceph,nvme-of,nvme-of gateway,rbd,block storage, io.ceph.url=https://github.com/ceph/ceph-nvmeof, com.redhat.component=ubi9-container, vcs-ref=21e59b2fb3a6ffd41c9aa2b981db0415f3d8768c, io.spdk.version=23.01.1, release=, summary=Ceph NVMe over Fabrics Gateway, io.ceph.git.repo=https://github.com/ceph/ceph-nvmeof, io.buildah.version=1.29.0, vcs-type=git, maintainer=Ceph Developers , org.centos.url=https://mirror.stream.centos.org/9-stream/BaseOS/x86_64/os/Packages/, io.spdk.build.ceph-release=18.2.2, io.ceph.maintainer=Ceph Developers , io.spdk.git.commit=85a10c98e70a1d3bc6c166e2f2939b3e5bae37dc, url=https://github.com/ceph/ceph-nvmeof, io.spdk.build.configure-args=--with-rbd --disable-tests --disable-unit-tests --disable-examples --enable-debug, io.ceph.nvmeof=None, io.spdk.git.repo=https://github.com/ceph/spdk.git, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, io.ceph.summary=Ceph NVMe over Fabrics Gateway, io.ceph.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.ceph.git.branch=devel, io.k8s.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., name=ceph-nvmeof, io.openshift.expose-services=4420/tcp:nvme,5500/tcp:grpc,8009/tcp:nvme-disc,10008/tcp:prom, vendor=Red Hat, Inc., io.spdk.build.target-arch=, io.spdk.build.makeflags=, io.openshift.wants=ceph,rbd, io.ceph.git.commit=21e59b2fb3a6ffd41c9aa2b981db0415f3d8768c, io.spdk.git.branch=ceph-nvmeof, io.spdk.build.pkgdep-args=--rbd, io.ceph.version=1.1.0, architecture=x86_64, distribution-scope=public, description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., build-date=2024-03-26 07:40:14 UTC, io.k8s.display-name=Ceph NVMe over Fabrics Gateway, version=1.1.0, io.ceph.component=ceph-nvmeof, org.centos.version=9.0-21.el9) 2024-03-26T17:02:26.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:26 smithi149 ceph-mon[34678]: pgmap v473: 33 pgs: 33 active+clean; 1014 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 8.8 MiB/s rd, 9.4 MiB/s wr, 893 op/s 2024-03-26T17:02:26.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:26 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 2024-03-26T17:02:26.212+0000 7fa707a55700 -1 mon.c@1(peon) e3 get_health_metrics reporting 3 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T17:02:27.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:02:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:02:26] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:02:27.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:02:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:02:26] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:02:27.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:02:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:02:27.055 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:02:26 smithi064 podman[56313]: 2024-03-26 17:02:26.789791141 +0000 UTC m=+10.681844064 container cleanup 34da1d0e7c9e89a3be9df8acdb71006b948f66b1e873641283ea62fcbdd76ffa (image=quay.io/barakda1/nvmeof:qe_ceph_devel_21e59b2, name=ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b, io.ceph.component=ceph-nvmeof, io.k8s.display-name=Ceph NVMe over Fabrics Gateway, io.spdk.build.makeflags=, io.ceph.url=https://github.com/ceph/ceph-nvmeof, io.ceph.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., vendor=Red Hat, Inc., io.openshift.expose-services=4420/tcp:nvme,5500/tcp:grpc,8009/tcp:nvme-disc,10008/tcp:prom, io.openshift.wants=ceph,rbd, version=1.1.0, io.ceph.git.branch=devel, vcs-ref=21e59b2fb3a6ffd41c9aa2b981db0415f3d8768c, io.ceph.maintainer=Ceph Developers , description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.spdk.git.commit=85a10c98e70a1d3bc6c166e2f2939b3e5bae37dc, io.ceph.summary=Ceph NVMe over Fabrics Gateway, maintainer=Ceph Developers , io.ceph.git.repo=https://github.com/ceph/ceph-nvmeof, url=https://github.com/ceph/ceph-nvmeof, architecture=x86_64, name=ceph-nvmeof, vcs-type=git, io.ceph.nvmeof=None, io.spdk.git.repo=https://github.com/ceph/spdk.git, io.spdk.build.ceph-release=18.2.2, io.spdk.build.pkgdep-args=--rbd, io.spdk.git.branch=ceph-nvmeof, org.centos.url=https://mirror.stream.centos.org/9-stream/BaseOS/x86_64/os/Packages/, io.spdk.build.configure-args=--with-rbd --disable-tests --disable-unit-tests --disable-examples --enable-debug, io.spdk.build.target-arch=, org.centos.version=9.0-21.el9, io.openshift.tags=ceph,nvme-of,nvme-of gateway,rbd,block storage, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, summary=Ceph NVMe over Fabrics Gateway, io.spdk.version=23.01.1, io.ceph.version=1.1.0, io.buildah.version=1.29.0, io.k8s.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., com.redhat.component=ubi9-container, build-date=2024-03-26 07:40:14 UTC, io.ceph.git.commit=21e59b2fb3a6ffd41c9aa2b981db0415f3d8768c, release=, distribution-scope=public) 2024-03-26T17:02:27.055 INFO:journalctl@ceph.nvmeof.nvmeof.b.smithi064.stdout:Mar 26 17:02:26 smithi064 bash[56313]: ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-b 2024-03-26T17:02:27.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:02:26 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:02:26] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:02:27.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:02:26 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:02:26] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:02:27.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:02:26 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:02:27.213 DEBUG:teuthology.orchestra.run.smithi064:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4394d798-eb90-11ee-95d0-87774f69a715@nvmeof.nvmeof.b.service' 2024-03-26T17:02:27.302 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-26T17:02:27.302 INFO:tasks.nvmeof.ceph.nvmeof.nvmeof.b:Stopped nvmeof.nvmeof.b 2024-03-26T17:02:27.302 INFO:tasks.nvmeof.[nvmeof.thrasher]:waiting for 9 secs before reviving 2024-03-26T17:02:28.132 INFO:tasks.workunit.client.3.smithi157.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-26T17:02:28.132 INFO:tasks.workunit.client.3.smithi157.stdout:myimage6 9/s 5/s 206 KiB/s 112 KiB/s 1.12 ms 159.58 us 2024-03-26T17:02:28.132 INFO:tasks.workunit.client.3.smithi157.stdout:myimage47 9/s 5/s 180 KiB/s 107 KiB/s 1.15 ms 155.15 us 2024-03-26T17:02:28.132 INFO:tasks.workunit.client.3.smithi157.stdout:myimage29 9/s 8/s 200 KiB/s 197 KiB/s 1.05 ms 161.60 us 2024-03-26T17:02:28.132 INFO:tasks.workunit.client.3.smithi157.stdout:myimage53 9/s 6/s 226 KiB/s 131 KiB/s 1.12 ms 160.20 us 2024-03-26T17:02:28.132 INFO:tasks.workunit.client.3.smithi157.stdout:myimage32 8/s 7/s 187 KiB/s 157 KiB/s 1.12 ms 167.69 us 2024-03-26T17:02:28.132 INFO:tasks.workunit.client.3.smithi157.stdout:myimage41 8/s 5/s 186 KiB/s 115 KiB/s 1.14 ms 155.65 us 2024-03-26T17:02:28.132 INFO:tasks.workunit.client.3.smithi157.stdout:myimage59 8/s 6/s 203 KiB/s 133 KiB/s 1.09 ms 158.49 us 2024-03-26T17:02:28.132 INFO:tasks.workunit.client.3.smithi157.stdout:myimage13 8/s 5/s 170 KiB/s 110 KiB/s 1.07 ms 160.08 us 2024-03-26T17:02:28.132 INFO:tasks.workunit.client.3.smithi157.stdout:myimage9 8/s 7/s 163 KiB/s 146 KiB/s 1.11 ms 160.28 us 2024-03-26T17:02:28.132 INFO:tasks.workunit.client.3.smithi157.stdout:myimage12 8/s 7/s 182 KiB/s 130 KiB/s 1.10 ms 172.75 us 2024-03-26T17:02:28.133 INFO:tasks.workunit.client.3.smithi157.stdout:myimage25 8/s 7/s 156 KiB/s 142 KiB/s 1.18 ms 155.82 us 2024-03-26T17:02:28.133 INFO:tasks.workunit.client.3.smithi157.stdout:myimage18 8/s 8/s 170 KiB/s 165 KiB/s 1.22 ms 164.02 us 2024-03-26T17:02:28.133 INFO:tasks.workunit.client.3.smithi157.stdout:myimage45 8/s 6/s 174 KiB/s 141 KiB/s 1.10 ms 160.23 us 2024-03-26T17:02:28.133 INFO:tasks.workunit.client.3.smithi157.stdout:myimage30 8/s 7/s 143 KiB/s 145 KiB/s 1.14 ms 166.80 us 2024-03-26T17:02:28.133 INFO:tasks.workunit.client.3.smithi157.stdout:myimage4 8/s 7/s 160 KiB/s 140 KiB/s 1.08 ms 165.03 us 2024-03-26T17:02:28.133 INFO:tasks.workunit.client.3.smithi157.stdout:myimage33 8/s 5/s 134 KiB/s 106 KiB/s 1.05 ms 158.67 us 2024-03-26T17:02:28.133 INFO:tasks.workunit.client.3.smithi157.stdout:myimage58 7/s 7/s 172 KiB/s 130 KiB/s 1.08 ms 164.33 us 2024-03-26T17:02:28.133 INFO:tasks.workunit.client.3.smithi157.stdout:myimage24 7/s 6/s 178 KiB/s 114 KiB/s 1.12 ms 155.39 us 2024-03-26T17:02:28.133 INFO:tasks.workunit.client.3.smithi157.stdout:myimage36 7/s 6/s 137 KiB/s 134 KiB/s 1.10 ms 160.75 us 2024-03-26T17:02:28.133 INFO:tasks.workunit.client.3.smithi157.stdout:myimage38 7/s 8/s 154 KiB/s 167 KiB/s 1.05 ms 167.05 us 2024-03-26T17:02:28.133 INFO:tasks.workunit.client.3.smithi157.stdout:myimage17 7/s 6/s 110 KiB/s 122 KiB/s 1.09 ms 165.33 us 2024-03-26T17:02:28.133 INFO:tasks.workunit.client.3.smithi157.stdout:myimage27 7/s 7/s 114 KiB/s 102 KiB/s 1.07 ms 163.99 us 2024-03-26T17:02:28.133 INFO:tasks.workunit.client.3.smithi157.stdout:myimage42 7/s 7/s 176 KiB/s 122 KiB/s 1.11 ms 162.52 us 2024-03-26T17:02:28.134 INFO:tasks.workunit.client.3.smithi157.stdout:myimage56 7/s 9/s 182 KiB/s 202 KiB/s 1.19 ms 162.38 us 2024-03-26T17:02:28.134 INFO:tasks.workunit.client.3.smithi157.stdout:myimage34 7/s 6/s 138 KiB/s 114 KiB/s 1.06 ms 162.33 us 2024-03-26T17:02:28.134 INFO:tasks.workunit.client.3.smithi157.stdout:myimage52 7/s 6/s 158 KiB/s 100 KiB/s 1.16 ms 162.91 us 2024-03-26T17:02:28.134 INFO:tasks.workunit.client.3.smithi157.stdout:myimage1 7/s 7/s 151 KiB/s 149 KiB/s 1.08 ms 167.44 us 2024-03-26T17:02:28.134 INFO:tasks.workunit.client.3.smithi157.stdout:myimage28 7/s 8/s 122 KiB/s 155 KiB/s 1.16 ms 155.00 us 2024-03-26T17:02:28.134 INFO:tasks.workunit.client.3.smithi157.stdout:myimage50 7/s 6/s 150 KiB/s 148 KiB/s 1.12 ms 157.67 us 2024-03-26T17:02:28.134 INFO:tasks.workunit.client.3.smithi157.stdout:myimage5 7/s 6/s 155 KiB/s 130 KiB/s 1.17 ms 155.73 us 2024-03-26T17:02:28.134 INFO:tasks.workunit.client.3.smithi157.stdout:myimage21 7/s 7/s 144 KiB/s 159 KiB/s 1.15 ms 171.30 us 2024-03-26T17:02:28.134 INFO:tasks.workunit.client.3.smithi157.stdout:myimage40 7/s 6/s 150 KiB/s 127 KiB/s 1.07 ms 164.43 us 2024-03-26T17:02:28.134 INFO:tasks.workunit.client.3.smithi157.stdout:myimage48 7/s 6/s 124 KiB/s 102 KiB/s 1.10 ms 155.09 us 2024-03-26T17:02:28.134 INFO:tasks.workunit.client.3.smithi157.stdout:myimage39 7/s 7/s 136 KiB/s 186 KiB/s 1.11 ms 167.62 us 2024-03-26T17:02:28.134 INFO:tasks.workunit.client.3.smithi157.stdout:myimage55 7/s 6/s 155 KiB/s 114 KiB/s 1.11 ms 165.14 us 2024-03-26T17:02:28.134 INFO:tasks.workunit.client.3.smithi157.stdout:myimage43 6/s 7/s 132 KiB/s 142 KiB/s 1.10 ms 153.22 us 2024-03-26T17:02:28.135 INFO:tasks.workunit.client.3.smithi157.stdout:myimage10 6/s 8/s 119 KiB/s 133 KiB/s 1.12 ms 158.14 us 2024-03-26T17:02:28.135 INFO:tasks.workunit.client.3.smithi157.stdout:myimage2 6/s 6/s 146 KiB/s 142 KiB/s 1.18 ms 160.72 us 2024-03-26T17:02:28.135 INFO:tasks.workunit.client.3.smithi157.stdout:myimage22 6/s 7/s 129 KiB/s 122 KiB/s 1.13 ms 166.19 us 2024-03-26T17:02:28.135 INFO:tasks.workunit.client.3.smithi157.stdout:myimage23 6/s 7/s 148 KiB/s 94 KiB/s 1.09 ms 157.03 us 2024-03-26T17:02:28.135 INFO:tasks.workunit.client.3.smithi157.stdout:myimage44 6/s 7/s 141 KiB/s 130 KiB/s 1.09 ms 160.59 us 2024-03-26T17:02:28.135 INFO:tasks.workunit.client.3.smithi157.stdout:myimage8 6/s 7/s 114 KiB/s 148 KiB/s 1.09 ms 150.92 us 2024-03-26T17:02:28.135 INFO:tasks.workunit.client.3.smithi157.stdout:myimage15 6/s 6/s 157 KiB/s 122 KiB/s 1.06 ms 166.38 us 2024-03-26T17:02:28.135 INFO:tasks.workunit.client.3.smithi157.stdout:myimage60 6/s 7/s 126 KiB/s 130 KiB/s 1.17 ms 156.10 us 2024-03-26T17:02:28.135 INFO:tasks.workunit.client.3.smithi157.stdout:myimage3 6/s 6/s 123 KiB/s 85 KiB/s 1.08 ms 162.59 us 2024-03-26T17:02:28.135 INFO:tasks.workunit.client.3.smithi157.stdout:myimage14 6/s 7/s 150 KiB/s 135 KiB/s 1.16 ms 161.62 us 2024-03-26T17:02:28.135 INFO:tasks.workunit.client.3.smithi157.stdout:myimage16 6/s 7/s 102 KiB/s 138 KiB/s 1.04 ms 167.87 us 2024-03-26T17:02:28.135 INFO:tasks.workunit.client.3.smithi157.stdout:myimage20 6/s 7/s 111 KiB/s 133 KiB/s 1.08 ms 173.63 us 2024-03-26T17:02:28.135 INFO:tasks.workunit.client.3.smithi157.stdout:myimage51 6/s 8/s 149 KiB/s 152 KiB/s 1.12 ms 160.47 us 2024-03-26T17:02:28.135 INFO:tasks.workunit.client.3.smithi157.stdout:myimage54 6/s 7/s 108 KiB/s 126 KiB/s 1.07 ms 160.76 us 2024-03-26T17:02:28.135 INFO:tasks.workunit.client.3.smithi157.stdout:myimage57 6/s 7/s 104 KiB/s 113 KiB/s 1.04 ms 158.42 us 2024-03-26T17:02:28.135 INFO:tasks.workunit.client.3.smithi157.stdout:myimage37 5/s 7/s 87 KiB/s 131 KiB/s 1.11 ms 164.03 us 2024-03-26T17:02:28.136 INFO:tasks.workunit.client.3.smithi157.stdout:myimage11 5/s 7/s 123 KiB/s 140 KiB/s 1.12 ms 154.37 us 2024-03-26T17:02:28.136 INFO:tasks.workunit.client.3.smithi157.stdout:myimage31 5/s 7/s 111 KiB/s 146 KiB/s 1.14 ms 156.65 us 2024-03-26T17:02:28.136 INFO:tasks.workunit.client.3.smithi157.stdout:myimage7 5/s 8/s 109 KiB/s 154 KiB/s 1.10 ms 164.01 us 2024-03-26T17:02:28.136 INFO:tasks.workunit.client.3.smithi157.stdout:myimage26 5/s 8/s 117 KiB/s 160 KiB/s 1.09 ms 159.78 us 2024-03-26T17:02:28.136 INFO:tasks.workunit.client.3.smithi157.stdout:myimage49 5/s 6/s 96 KiB/s 126 KiB/s 1.18 ms 159.18 us 2024-03-26T17:02:28.136 INFO:tasks.workunit.client.3.smithi157.stdout:myimage19 5/s 7/s 109 KiB/s 149 KiB/s 1.08 ms 157.75 us 2024-03-26T17:02:28.136 INFO:tasks.workunit.client.3.smithi157.stdout:myimage46 5/s 7/s 65 KiB/s 134 KiB/s 1.09 ms 159.11 us 2024-03-26T17:02:28.136 INFO:tasks.workunit.client.3.smithi157.stdout:myimage35 4/s 8/s 115 KiB/s 119 KiB/s 1.11 ms 159.45 us 2024-03-26T17:02:28.136 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:02:28.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:28 smithi044 ceph-mon[30624]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:02:28.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:28 smithi044 ceph-mon[30624]: { 2024-03-26T17:02:28.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:28 smithi044 ceph-mon[30624]: "prefix": "rbd perf image stats", 2024-03-26T17:02:28.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:28 smithi044 ceph-mon[30624]: "pool_spec": "mypool", 2024-03-26T17:02:28.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:28 smithi044 ceph-mon[30624]: "sort_by": "write_ops", 2024-03-26T17:02:28.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:28 smithi044 ceph-mon[30624]: "format": "json" 2024-03-26T17:02:28.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:28 smithi044 ceph-mon[30624]: }"]: dispatch 2024-03-26T17:02:28.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:28 smithi044 ceph-mon[30624]: pgmap v474: 33 pgs: 33 active+clean; 1015 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 8.4 MiB/s rd, 8.9 MiB/s wr, 871 op/s 2024-03-26T17:02:28.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:28 smithi064 ceph-mon[34420]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:02:28.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:28 smithi064 ceph-mon[34420]: { 2024-03-26T17:02:28.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:28 smithi064 ceph-mon[34420]: "prefix": "rbd perf image stats", 2024-03-26T17:02:28.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:28 smithi064 ceph-mon[34420]: "pool_spec": "mypool", 2024-03-26T17:02:28.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:28 smithi064 ceph-mon[34420]: "sort_by": "write_ops", 2024-03-26T17:02:28.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:28 smithi064 ceph-mon[34420]: "format": "json" 2024-03-26T17:02:28.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:28 smithi064 ceph-mon[34420]: }"]: dispatch 2024-03-26T17:02:28.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:28 smithi064 ceph-mon[34420]: pgmap v474: 33 pgs: 33 active+clean; 1015 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 8.4 MiB/s rd, 8.9 MiB/s wr, 871 op/s 2024-03-26T17:02:28.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:28 smithi149 ceph-mon[34678]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:02:28.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:28 smithi149 ceph-mon[34678]: { 2024-03-26T17:02:28.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:28 smithi149 ceph-mon[34678]: "prefix": "rbd perf image stats", 2024-03-26T17:02:28.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:28 smithi149 ceph-mon[34678]: "pool_spec": "mypool", 2024-03-26T17:02:28.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:28 smithi149 ceph-mon[34678]: "sort_by": "write_ops", 2024-03-26T17:02:28.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:28 smithi149 ceph-mon[34678]: "format": "json" 2024-03-26T17:02:28.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:28 smithi149 ceph-mon[34678]: }"]: dispatch 2024-03-26T17:02:28.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:28 smithi149 ceph-mon[34678]: pgmap v474: 33 pgs: 33 active+clean; 1015 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 8.4 MiB/s rd, 8.9 MiB/s wr, 871 op/s 2024-03-26T17:02:29.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:02:28 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:02:28] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:02:29.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:02:28 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:02:28] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:02:29.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:02:28 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:02:29.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:02:28 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:02:28] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:02:29.147 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:02:28 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:02:28] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:02:29.147 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:02:28 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:02:29.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:29 smithi044 ceph-mon[30624]: Health check update: 7 slow ops, oldest one blocked for 243 sec, daemons [mon.b,mon.c] have slow ops. (SLOW_OPS) 2024-03-26T17:02:29.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:29 smithi064 ceph-mon[34420]: Health check update: 7 slow ops, oldest one blocked for 243 sec, daemons [mon.b,mon.c] have slow ops. (SLOW_OPS) 2024-03-26T17:02:29.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:29 smithi149 ceph-mon[34678]: Health check update: 7 slow ops, oldest one blocked for 243 sec, daemons [mon.b,mon.c] have slow ops. (SLOW_OPS) 2024-03-26T17:02:30.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:30 smithi044 ceph-mon[30624]: pgmap v475: 33 pgs: 33 active+clean; 1015 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 7.7 MiB/s rd, 8.1 MiB/s wr, 810 op/s 2024-03-26T17:02:30.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:30 smithi064 ceph-mon[34420]: pgmap v475: 33 pgs: 33 active+clean; 1015 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 7.7 MiB/s rd, 8.1 MiB/s wr, 810 op/s 2024-03-26T17:02:30.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:30 smithi149 ceph-mon[34678]: pgmap v475: 33 pgs: 33 active+clean; 1015 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 7.7 MiB/s rd, 8.1 MiB/s wr, 810 op/s 2024-03-26T17:02:31.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:02:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:02:30] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:02:31.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:02:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:02:30] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:02:31.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:02:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:02:31.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:02:30 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:02:30] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:02:31.147 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:02:30 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:02:30] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:02:31.147 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:02:30 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:02:31.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:31 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 2024-03-26T17:02:31.213+0000 7fa707a55700 -1 mon.c@1(peon) e3 get_health_metrics reporting 3 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T17:02:32.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:32 smithi044 ceph-mon[30624]: pgmap v476: 33 pgs: 33 active+clean; 1015 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 5.8 MiB/s rd, 6.2 MiB/s wr, 622 op/s 2024-03-26T17:02:32.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:32 smithi064 ceph-mon[34420]: pgmap v476: 33 pgs: 33 active+clean; 1015 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 5.8 MiB/s rd, 6.2 MiB/s wr, 622 op/s 2024-03-26T17:02:32.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:32 smithi149 ceph-mon[34678]: pgmap v476: 33 pgs: 33 active+clean; 1015 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 5.8 MiB/s rd, 6.2 MiB/s wr, 622 op/s 2024-03-26T17:02:33.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:02:32 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:02:32] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:02:33.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:02:32 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:02:32] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:02:33.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:02:32 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:02:33.061 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:02:33.071 INFO:tasks.workunit.client.3.smithi157.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2024-03-26T17:02:33.071 INFO:tasks.workunit.client.3.smithi157.stdout: 4.90 65.6k 30.0k 0.0k 656.0k 300.0k 0.0k nvme2n1 2024-03-26T17:02:33.071 INFO:tasks.workunit.client.3.smithi157.stdout: 4.80 52.0k 45.2k 0.0k 520.0k 452.0k 0.0k nvme2n10 2024-03-26T17:02:33.071 INFO:tasks.workunit.client.3.smithi157.stdout: 4.90 41.6k 57.2k 0.0k 416.0k 572.0k 0.0k nvme2n11 2024-03-26T17:02:33.071 INFO:tasks.workunit.client.3.smithi157.stdout: 4.90 44.8k 48.4k 0.0k 448.0k 484.0k 0.0k nvme2n12 2024-03-26T17:02:33.071 INFO:tasks.workunit.client.3.smithi157.stdout: 4.90 30.8k 62.0k 0.0k 308.0k 620.0k 0.0k nvme2n13 2024-03-26T17:02:33.071 INFO:tasks.workunit.client.3.smithi157.stdout: 4.90 50.0k 50.0k 0.0k 500.0k 500.0k 0.0k nvme2n14 2024-03-26T17:02:33.071 INFO:tasks.workunit.client.3.smithi157.stdout: 4.90 48.4k 55.6k 0.0k 484.0k 556.0k 0.0k nvme2n15 2024-03-26T17:02:33.071 INFO:tasks.workunit.client.3.smithi157.stdout: 4.90 55.2k 42.8k 0.0k 552.0k 428.0k 0.0k nvme2n16 2024-03-26T17:02:33.072 INFO:tasks.workunit.client.3.smithi157.stdout: 4.90 53.2k 32.4k 0.0k 532.0k 324.0k 0.0k nvme2n17 2024-03-26T17:02:33.072 INFO:tasks.workunit.client.3.smithi157.stdout: 4.90 60.4k 32.8k 0.0k 604.0k 328.0k 0.0k nvme2n18 2024-03-26T17:02:33.072 INFO:tasks.workunit.client.3.smithi157.stdout: 4.90 54.4k 49.2k 0.0k 544.0k 492.0k 0.0k nvme2n19 2024-03-26T17:02:33.072 INFO:tasks.workunit.client.3.smithi157.stdout: 4.90 59.2k 50.8k 0.0k 592.0k 508.0k 0.0k nvme2n2 2024-03-26T17:02:33.072 INFO:tasks.workunit.client.3.smithi157.stdout: 4.90 42.4k 46.4k 0.0k 424.0k 464.0k 0.0k nvme2n20 2024-03-26T17:02:33.072 INFO:tasks.workunit.client.3.smithi157.stdout: 4.90 34.4k 43.2k 0.0k 344.0k 432.0k 0.0k nvme2n3 2024-03-26T17:02:33.072 INFO:tasks.workunit.client.3.smithi157.stdout: 4.90 42.4k 62.0k 0.0k 424.0k 620.0k 0.0k nvme2n4 2024-03-26T17:02:33.072 INFO:tasks.workunit.client.3.smithi157.stdout: 4.90 56.0k 61.6k 0.0k 560.0k 616.0k 0.0k nvme2n5 2024-03-26T17:02:33.072 INFO:tasks.workunit.client.3.smithi157.stdout: 4.90 57.2k 48.4k 0.0k 572.0k 484.0k 0.0k nvme2n6 2024-03-26T17:02:33.072 INFO:tasks.workunit.client.3.smithi157.stdout: 4.90 61.2k 37.2k 0.0k 612.0k 372.0k 0.0k nvme2n7 2024-03-26T17:02:33.072 INFO:tasks.workunit.client.3.smithi157.stdout: 4.80 40.4k 46.4k 0.0k 404.0k 464.0k 0.0k nvme2n8 2024-03-26T17:02:33.072 INFO:tasks.workunit.client.3.smithi157.stdout: 4.80 48.0k 38.0k 0.0k 480.0k 380.0k 0.0k nvme2n9 2024-03-26T17:02:33.072 INFO:tasks.workunit.client.3.smithi157.stdout: 4.90 48.4k 42.4k 0.0k 484.0k 424.0k 0.0k nvme5n1 2024-03-26T17:02:33.072 INFO:tasks.workunit.client.3.smithi157.stdout: 4.80 29.2k 53.6k 0.0k 292.0k 536.0k 0.0k nvme5n10 2024-03-26T17:02:33.072 INFO:tasks.workunit.client.3.smithi157.stdout: 4.80 59.6k 39.6k 0.0k 596.0k 396.0k 0.0k nvme5n11 2024-03-26T17:02:33.073 INFO:tasks.workunit.client.3.smithi157.stdout: 4.90 47.2k 44.4k 0.0k 472.0k 444.0k 0.0k nvme5n12 2024-03-26T17:02:33.073 INFO:tasks.workunit.client.3.smithi157.stdout: 4.90 41.6k 58.8k 0.0k 416.0k 588.0k 0.0k nvme5n13 2024-03-26T17:02:33.073 INFO:tasks.workunit.client.3.smithi157.stdout: 4.90 39.6k 58.0k 0.0k 396.0k 580.0k 0.0k nvme5n14 2024-03-26T17:02:33.073 INFO:tasks.workunit.client.3.smithi157.stdout: 4.90 42.0k 43.2k 0.0k 420.0k 432.0k 0.0k nvme5n15 2024-03-26T17:02:33.073 INFO:tasks.workunit.client.3.smithi157.stdout: 4.90 41.2k 56.0k 0.0k 412.0k 560.0k 0.0k nvme5n16 2024-03-26T17:02:33.073 INFO:tasks.workunit.client.3.smithi157.stdout: 4.90 46.0k 31.2k 0.0k 460.0k 312.0k 0.0k nvme5n17 2024-03-26T17:02:33.073 INFO:tasks.workunit.client.3.smithi157.stdout: 4.90 50.4k 54.0k 0.0k 504.0k 540.0k 0.0k nvme5n18 2024-03-26T17:02:33.073 INFO:tasks.workunit.client.3.smithi157.stdout: 4.90 55.2k 45.6k 0.0k 552.0k 456.0k 0.0k nvme5n19 2024-03-26T17:02:33.073 INFO:tasks.workunit.client.3.smithi157.stdout: 4.90 58.8k 37.2k 0.0k 588.0k 372.0k 0.0k nvme5n2 2024-03-26T17:02:33.073 INFO:tasks.workunit.client.3.smithi157.stdout: 4.90 38.8k 58.4k 0.0k 388.0k 584.0k 0.0k nvme5n20 2024-03-26T17:02:33.074 INFO:tasks.workunit.client.3.smithi157.stdout: 4.90 36.4k 60.0k 0.0k 364.0k 600.0k 0.0k nvme5n3 2024-03-26T17:02:33.074 INFO:tasks.workunit.client.3.smithi157.stdout: 4.90 37.2k 66.8k 0.0k 372.0k 668.0k 0.0k nvme5n4 2024-03-26T17:02:33.074 INFO:tasks.workunit.client.3.smithi157.stdout: 4.90 36.8k 53.2k 0.0k 368.0k 532.0k 0.0k nvme5n5 2024-03-26T17:02:33.074 INFO:tasks.workunit.client.3.smithi157.stdout: 4.90 56.0k 36.0k 0.0k 560.0k 360.0k 0.0k nvme5n6 2024-03-26T17:02:33.074 INFO:tasks.workunit.client.3.smithi157.stdout: 4.90 41.6k 33.6k 0.0k 416.0k 336.0k 0.0k nvme5n7 2024-03-26T17:02:33.074 INFO:tasks.workunit.client.3.smithi157.stdout: 4.90 43.6k 39.2k 0.0k 436.0k 392.0k 0.0k nvme5n8 2024-03-26T17:02:33.074 INFO:tasks.workunit.client.3.smithi157.stdout: 4.80 38.0k 52.4k 0.0k 380.0k 524.0k 0.0k nvme5n9 2024-03-26T17:02:33.074 INFO:tasks.workunit.client.3.smithi157.stdout: 4.90 34.4k 65.6k 0.0k 344.0k 656.0k 0.0k nvme8n1 2024-03-26T17:02:33.074 INFO:tasks.workunit.client.3.smithi157.stdout: 4.80 67.6k 50.4k 0.0k 676.0k 504.0k 0.0k nvme8n10 2024-03-26T17:02:33.074 INFO:tasks.workunit.client.3.smithi157.stdout: 4.90 43.6k 42.0k 0.0k 436.0k 420.0k 0.0k nvme8n11 2024-03-26T17:02:33.074 INFO:tasks.workunit.client.3.smithi157.stdout: 4.90 36.0k 65.2k 0.0k 360.0k 652.0k 0.0k nvme8n12 2024-03-26T17:02:33.074 INFO:tasks.workunit.client.3.smithi157.stdout: 4.90 47.6k 63.2k 0.0k 476.0k 632.0k 0.0k nvme8n13 2024-03-26T17:02:33.074 INFO:tasks.workunit.client.3.smithi157.stdout: 4.90 45.6k 42.4k 0.0k 456.0k 424.0k 0.0k nvme8n14 2024-03-26T17:02:33.074 INFO:tasks.workunit.client.3.smithi157.stdout: 4.90 41.6k 51.2k 0.0k 416.0k 512.0k 0.0k nvme8n15 2024-03-26T17:02:33.075 INFO:tasks.workunit.client.3.smithi157.stdout: 4.90 55.2k 38.8k 0.0k 552.0k 388.0k 0.0k nvme8n16 2024-03-26T17:02:33.075 INFO:tasks.workunit.client.3.smithi157.stdout: 4.90 52.4k 46.8k 0.0k 524.0k 468.0k 0.0k nvme8n17 2024-03-26T17:02:33.075 INFO:tasks.workunit.client.3.smithi157.stdout: 4.90 55.2k 55.2k 0.0k 552.0k 552.0k 0.0k nvme8n18 2024-03-26T17:02:33.075 INFO:tasks.workunit.client.3.smithi157.stdout: 4.90 34.0k 60.8k 0.0k 340.0k 608.0k 0.0k nvme8n19 2024-03-26T17:02:33.075 INFO:tasks.workunit.client.3.smithi157.stdout: 4.90 56.8k 34.4k 0.0k 568.0k 344.0k 0.0k nvme8n2 2024-03-26T17:02:33.075 INFO:tasks.workunit.client.3.smithi157.stdout: 4.90 52.0k 41.6k 0.0k 520.0k 416.0k 0.0k nvme8n20 2024-03-26T17:02:33.075 INFO:tasks.workunit.client.3.smithi157.stdout: 4.90 53.6k 47.2k 0.0k 536.0k 472.0k 0.0k nvme8n3 2024-03-26T17:02:33.075 INFO:tasks.workunit.client.3.smithi157.stdout: 4.90 52.4k 27.6k 0.0k 524.0k 276.0k 0.0k nvme8n4 2024-03-26T17:02:33.075 INFO:tasks.workunit.client.3.smithi157.stdout: 4.90 54.8k 34.4k 0.0k 548.0k 344.0k 0.0k nvme8n5 2024-03-26T17:02:33.075 INFO:tasks.workunit.client.3.smithi157.stdout: 4.90 51.2k 34.4k 0.0k 512.0k 344.0k 0.0k nvme8n6 2024-03-26T17:02:33.075 INFO:tasks.workunit.client.3.smithi157.stdout: 4.90 39.6k 62.4k 0.0k 396.0k 624.0k 0.0k nvme8n7 2024-03-26T17:02:33.075 INFO:tasks.workunit.client.3.smithi157.stdout: 4.80 34.0k 50.0k 0.0k 340.0k 500.0k 0.0k nvme8n8 2024-03-26T17:02:33.075 INFO:tasks.workunit.client.3.smithi157.stdout: 4.80 52.8k 40.0k 0.0k 528.0k 400.0k 0.0k nvme8n9 2024-03-26T17:02:33.075 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:02:33.135 INFO:tasks.workunit.client.3.smithi157.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-26T17:02:33.136 INFO:tasks.workunit.client.3.smithi157.stdout:myimage59 4/s 2/s 90 KiB/s 39 KiB/s 1.10 ms 168.71 us 2024-03-26T17:02:33.136 INFO:tasks.workunit.client.3.smithi157.stdout:myimage4 3/s 2/s 71 KiB/s 64 KiB/s 1.10 ms 157.44 us 2024-03-26T17:02:33.136 INFO:tasks.workunit.client.3.smithi157.stdout:myimage18 3/s 3/s 46 KiB/s 86 KiB/s 1.07 ms 164.43 us 2024-03-26T17:02:33.136 INFO:tasks.workunit.client.3.smithi157.stdout:myimage10 3/s 1/s 74 KiB/s 38 KiB/s 1.06 ms 166.01 us 2024-03-26T17:02:33.136 INFO:tasks.workunit.client.3.smithi157.stdout:myimage27 3/s 2/s 61 KiB/s 51 KiB/s 1.10 ms 171.05 us 2024-03-26T17:02:33.136 INFO:tasks.workunit.client.3.smithi157.stdout:myimage57 3/s 2/s 70 KiB/s 58 KiB/s 1.10 ms 161.64 us 2024-03-26T17:02:33.136 INFO:tasks.workunit.client.3.smithi157.stdout:myimage53 3/s 2/s 58 KiB/s 47 KiB/s 1.11 ms 168.50 us 2024-03-26T17:02:33.136 INFO:tasks.workunit.client.3.smithi157.stdout:myimage19 3/s 3/s 62 KiB/s 64 KiB/s 1.09 ms 162.65 us 2024-03-26T17:02:33.136 INFO:tasks.workunit.client.3.smithi157.stdout:myimage41 3/s 1/s 63 KiB/s 23 KiB/s 1.17 ms 156.58 us 2024-03-26T17:02:33.136 INFO:tasks.workunit.client.3.smithi157.stdout:myimage36 2/s 1/s 62 KiB/s 26 KiB/s 1.09 ms 180.47 us 2024-03-26T17:02:33.136 INFO:tasks.workunit.client.3.smithi157.stdout:myimage11 2/s 0/s 52 KiB/s 9.6 KiB/s 1.18 ms 113.66 us 2024-03-26T17:02:33.136 INFO:tasks.workunit.client.3.smithi157.stdout:myimage16 2/s 2/s 50 KiB/s 54 KiB/s 1.11 ms 177.30 us 2024-03-26T17:02:33.136 INFO:tasks.workunit.client.3.smithi157.stdout:myimage45 2/s 1/s 37 KiB/s 34 KiB/s 1.16 ms 148.82 us 2024-03-26T17:02:33.136 INFO:tasks.workunit.client.3.smithi157.stdout:myimage22 2/s 2/s 50 KiB/s 46 KiB/s 1.15 ms 162.07 us 2024-03-26T17:02:33.137 INFO:tasks.workunit.client.3.smithi157.stdout:myimage32 2/s 1/s 40 KiB/s 30 KiB/s 1.19 ms 169.84 us 2024-03-26T17:02:33.137 INFO:tasks.workunit.client.3.smithi157.stdout:myimage34 2/s 0/s 30 KiB/s 15 KiB/s 1.11 ms 99.63 us 2024-03-26T17:02:33.137 INFO:tasks.workunit.client.3.smithi157.stdout:myimage51 2/s 2/s 35 KiB/s 43 KiB/s 1.13 ms 157.84 us 2024-03-26T17:02:33.137 INFO:tasks.workunit.client.3.smithi157.stdout:myimage30 2/s 0/s 42 KiB/s 10 KiB/s 1.20 ms 127.88 us 2024-03-26T17:02:33.137 INFO:tasks.workunit.client.3.smithi157.stdout:myimage44 2/s 2/s 34 KiB/s 31 KiB/s 1.13 ms 173.45 us 2024-03-26T17:02:33.137 INFO:tasks.workunit.client.3.smithi157.stdout:myimage21 2/s 3/s 33 KiB/s 59 KiB/s 1.16 ms 159.75 us 2024-03-26T17:02:33.137 INFO:tasks.workunit.client.3.smithi157.stdout:myimage29 2/s 1/s 38 KiB/s 11 KiB/s 1.04 ms 160.64 us 2024-03-26T17:02:33.137 INFO:tasks.workunit.client.3.smithi157.stdout:myimage2 1/s 3/s 39 KiB/s 66 KiB/s 1.10 ms 171.40 us 2024-03-26T17:02:33.137 INFO:tasks.workunit.client.3.smithi157.stdout:myimage14 1/s 1/s 34 KiB/s 19 KiB/s 1.17 ms 155.53 us 2024-03-26T17:02:33.137 INFO:tasks.workunit.client.3.smithi157.stdout:myimage38 1/s 2/s 42 KiB/s 38 KiB/s 1.03 ms 163.24 us 2024-03-26T17:02:33.137 INFO:tasks.workunit.client.3.smithi157.stdout:myimage40 1/s 0/s 38 KiB/s 5.6 KiB/s 1.11 ms 84.13 us 2024-03-26T17:02:33.137 INFO:tasks.workunit.client.3.smithi157.stdout:myimage25 1/s 1/s 51 KiB/s 26 KiB/s 1.22 ms 180.45 us 2024-03-26T17:02:33.137 INFO:tasks.workunit.client.3.smithi157.stdout:myimage26 1/s 1/s 34 KiB/s 32 KiB/s 1.14 ms 157.30 us 2024-03-26T17:02:33.137 INFO:tasks.workunit.client.3.smithi157.stdout:myimage42 1/s 1/s 26 KiB/s 40 KiB/s 1.14 ms 171.32 us 2024-03-26T17:02:33.137 INFO:tasks.workunit.client.3.smithi157.stdout:myimage52 1/s 0/s 40 KiB/s 12 KiB/s 1.18 ms 125.54 us 2024-03-26T17:02:33.138 INFO:tasks.workunit.client.3.smithi157.stdout:myimage1 1/s 3/s 30 KiB/s 72 KiB/s 1.07 ms 173.98 us 2024-03-26T17:02:33.138 INFO:tasks.workunit.client.3.smithi157.stdout:myimage12 1/s 1/s 30 KiB/s 30 KiB/s 1.08 ms 147.56 us 2024-03-26T17:02:33.138 INFO:tasks.workunit.client.3.smithi157.stdout:myimage50 1/s 1/s 38 KiB/s 42 KiB/s 1.12 ms 159.39 us 2024-03-26T17:02:33.138 INFO:tasks.workunit.client.3.smithi157.stdout:myimage13 1/s 0/s 36 KiB/s 12 KiB/s 1.04 ms 94.26 us 2024-03-26T17:02:33.138 INFO:tasks.workunit.client.3.smithi157.stdout:myimage35 1/s 1/s 13 KiB/s 18 KiB/s 1.22 ms 156.41 us 2024-03-26T17:02:33.138 INFO:tasks.workunit.client.3.smithi157.stdout:myimage47 1/s 0/s 25 KiB/s 23 KiB/s 1.21 ms 79.59 us 2024-03-26T17:02:33.138 INFO:tasks.workunit.client.3.smithi157.stdout:myimage8 1/s 1/s 30 KiB/s 24 KiB/s 1.22 ms 150.67 us 2024-03-26T17:02:33.138 INFO:tasks.workunit.client.3.smithi157.stdout:myimage9 1/s 1/s 24 KiB/s 20 KiB/s 1.16 ms 144.20 us 2024-03-26T17:02:33.138 INFO:tasks.workunit.client.3.smithi157.stdout:myimage39 1/s 1/s 31 KiB/s 16 KiB/s 1.08 ms 154.72 us 2024-03-26T17:02:33.138 INFO:tasks.workunit.client.3.smithi157.stdout:myimage46 1/s 0/s 29 KiB/s 15 KiB/s 1.05 ms 136.79 us 2024-03-26T17:02:33.138 INFO:tasks.workunit.client.3.smithi157.stdout:myimage58 1/s 1/s 18 KiB/s 27 KiB/s 1.05 ms 154.27 us 2024-03-26T17:02:33.138 INFO:tasks.workunit.client.3.smithi157.stdout:myimage6 1/s 2/s 22 KiB/s 46 KiB/s 1.13 ms 187.97 us 2024-03-26T17:02:33.138 INFO:tasks.workunit.client.3.smithi157.stdout:myimage20 1/s 1/s 29 KiB/s 13 KiB/s 1.12 ms 163.01 us 2024-03-26T17:02:33.138 INFO:tasks.workunit.client.3.smithi157.stdout:myimage33 1/s 0/s 31 KiB/s 12 KiB/s 1.06 ms 52.60 us 2024-03-26T17:02:33.139 INFO:tasks.workunit.client.3.smithi157.stdout:myimage55 1/s 1/s 29 KiB/s 21 KiB/s 1.21 ms 153.63 us 2024-03-26T17:02:33.139 INFO:tasks.workunit.client.3.smithi157.stdout:myimage56 1/s 1/s 24 KiB/s 30 KiB/s 1.14 ms 158.44 us 2024-03-26T17:02:33.139 INFO:tasks.workunit.client.3.smithi157.stdout:myimage23 1/s 1/s 30 KiB/s 15 KiB/s 1.17 ms 152.93 us 2024-03-26T17:02:33.139 INFO:tasks.workunit.client.3.smithi157.stdout:myimage7 1/s 1/s 14 KiB/s 38 KiB/s 1.07 ms 156.61 us 2024-03-26T17:02:33.139 INFO:tasks.workunit.client.3.smithi157.stdout:myimage28 1/s 0/s 21 KiB/s 819 B/s 1.21 ms 30.43 us 2024-03-26T17:02:33.139 INFO:tasks.workunit.client.3.smithi157.stdout:myimage5 0/s 1/s 20 KiB/s 32 KiB/s 870.24 us 140.32 us 2024-03-26T17:02:33.139 INFO:tasks.workunit.client.3.smithi157.stdout:myimage24 0/s 0/s 18 KiB/s 10 KiB/s 969.83 us 61.23 us 2024-03-26T17:02:33.139 INFO:tasks.workunit.client.3.smithi157.stdout:myimage43 0/s 0/s 20 KiB/s 14 KiB/s 854.68 us 96.99 us 2024-03-26T17:02:33.139 INFO:tasks.workunit.client.3.smithi157.stdout:myimage60 0/s 1/s 14 KiB/s 35 KiB/s 961.55 us 157.04 us 2024-03-26T17:02:33.139 INFO:tasks.workunit.client.3.smithi157.stdout:myimage37 0/s 1/s 5.6 KiB/s 26 KiB/s 692.45 us 157.18 us 2024-03-26T17:02:33.139 INFO:tasks.workunit.client.3.smithi157.stdout:myimage48 0/s 0/s 6.4 KiB/s 15 KiB/s 684.63 us 117.55 us 2024-03-26T17:02:33.139 INFO:tasks.workunit.client.3.smithi157.stdout:myimage49 0/s 0/s 14 KiB/s 15 KiB/s 694.47 us 143.47 us 2024-03-26T17:02:33.139 INFO:tasks.workunit.client.3.smithi157.stdout:myimage54 0/s 0/s 17 KiB/s 6.4 KiB/s 664.70 us 137.56 us 2024-03-26T17:02:33.139 INFO:tasks.workunit.client.3.smithi157.stdout:myimage17 0/s 0/s 5.6 KiB/s 8 KiB/s 444.56 us 31.27 us 2024-03-26T17:02:33.140 INFO:tasks.workunit.client.3.smithi157.stdout:myimage31 0/s 0/s 5.6 KiB/s 8.8 KiB/s 274.28 us 125.71 us 2024-03-26T17:02:33.140 INFO:tasks.workunit.client.3.smithi157.stdout:myimage15 0/s 0/s 0 B/s 4 KiB/s 0.00 ns 28.28 us 2024-03-26T17:02:33.140 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:02:33.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:02:32 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:02:32] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:02:33.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:02:32 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:02:32] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:02:33.147 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:02:32 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:02:33.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:33 smithi044 ceph-mon[30624]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:02:33.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:33 smithi044 ceph-mon[30624]: { 2024-03-26T17:02:33.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:33 smithi044 ceph-mon[30624]: "prefix": "rbd perf image stats", 2024-03-26T17:02:33.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:33 smithi044 ceph-mon[30624]: "pool_spec": "mypool", 2024-03-26T17:02:33.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:33 smithi044 ceph-mon[30624]: "sort_by": "write_ops", 2024-03-26T17:02:33.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:33 smithi044 ceph-mon[30624]: "format": "json" 2024-03-26T17:02:33.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:33 smithi044 ceph-mon[30624]: }"]: dispatch 2024-03-26T17:02:33.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:33 smithi064 ceph-mon[34420]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:02:33.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:33 smithi064 ceph-mon[34420]: { 2024-03-26T17:02:33.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:33 smithi064 ceph-mon[34420]: "prefix": "rbd perf image stats", 2024-03-26T17:02:33.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:33 smithi064 ceph-mon[34420]: "pool_spec": "mypool", 2024-03-26T17:02:33.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:33 smithi064 ceph-mon[34420]: "sort_by": "write_ops", 2024-03-26T17:02:33.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:33 smithi064 ceph-mon[34420]: "format": "json" 2024-03-26T17:02:33.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:33 smithi064 ceph-mon[34420]: }"]: dispatch 2024-03-26T17:02:33.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:33 smithi149 ceph-mon[34678]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:02:33.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:33 smithi149 ceph-mon[34678]: { 2024-03-26T17:02:33.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:33 smithi149 ceph-mon[34678]: "prefix": "rbd perf image stats", 2024-03-26T17:02:33.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:33 smithi149 ceph-mon[34678]: "pool_spec": "mypool", 2024-03-26T17:02:33.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:33 smithi149 ceph-mon[34678]: "sort_by": "write_ops", 2024-03-26T17:02:33.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:33 smithi149 ceph-mon[34678]: "format": "json" 2024-03-26T17:02:33.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:33 smithi149 ceph-mon[34678]: }"]: dispatch 2024-03-26T17:02:34.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:34 smithi044 ceph-mon[30624]: Health check update: 7 slow ops, oldest one blocked for 248 sec, daemons [mon.b,mon.c] have slow ops. (SLOW_OPS) 2024-03-26T17:02:34.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:34 smithi044 ceph-mon[30624]: pgmap v477: 33 pgs: 33 active+clean; 1015 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 5.0 MiB/s rd, 5.4 MiB/s wr, 542 op/s 2024-03-26T17:02:34.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:34 smithi064 ceph-mon[34420]: Health check update: 7 slow ops, oldest one blocked for 248 sec, daemons [mon.b,mon.c] have slow ops. (SLOW_OPS) 2024-03-26T17:02:34.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:34 smithi064 ceph-mon[34420]: pgmap v477: 33 pgs: 33 active+clean; 1015 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 5.0 MiB/s rd, 5.4 MiB/s wr, 542 op/s 2024-03-26T17:02:34.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:34 smithi149 ceph-mon[34678]: Health check update: 7 slow ops, oldest one blocked for 248 sec, daemons [mon.b,mon.c] have slow ops. (SLOW_OPS) 2024-03-26T17:02:34.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:34 smithi149 ceph-mon[34678]: pgmap v477: 33 pgs: 33 active+clean; 1015 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 5.0 MiB/s rd, 5.4 MiB/s wr, 542 op/s 2024-03-26T17:02:35.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:02:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:02:34] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:02:35.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:02:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:02:34] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:02:35.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:02:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:02:35.214 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:02:34 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:02:34] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:02:35.214 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:02:34 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:02:34] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:02:35.214 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:02:34 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:02:35.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:35 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-26T17:02:35.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:35 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-26T17:02:35.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:35 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-26T17:02:36.303 DEBUG:teuthology.orchestra.run.smithi157:> ceph orch ls 2024-03-26T17:02:36.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:36 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-03-26T17:02:36.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:36 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-03-26T17:02:36.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:36 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-03-26T17:02:36.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:36 smithi044 ceph-mon[30624]: Adjusting osd_memory_target on smithi064 to 5696M 2024-03-26T17:02:36.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:36 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T17:02:36.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:36 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T17:02:36.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:36 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-26T17:02:36.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:36 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T17:02:36.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:36 smithi044 ceph-mon[30624]: pgmap v478: 33 pgs: 33 active+clean; 1015 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 2.9 MiB/s rd, 3.1 MiB/s wr, 317 op/s 2024-03-26T17:02:36.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:36 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-03-26T17:02:36.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:36 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-03-26T17:02:36.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:36 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-03-26T17:02:36.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:36 smithi064 ceph-mon[34420]: Adjusting osd_memory_target on smithi064 to 5696M 2024-03-26T17:02:36.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:36 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T17:02:36.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:36 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T17:02:36.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:36 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-26T17:02:36.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:36 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T17:02:36.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:36 smithi064 ceph-mon[34420]: pgmap v478: 33 pgs: 33 active+clean; 1015 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 2.9 MiB/s rd, 3.1 MiB/s wr, 317 op/s 2024-03-26T17:02:36.585 INFO:teuthology.orchestra.run.smithi157.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-03-26T17:02:36.586 INFO:teuthology.orchestra.run.smithi157.stdout:mgr 1/1 7m ago 12m smithi044=x;count:1 2024-03-26T17:02:36.586 INFO:teuthology.orchestra.run.smithi157.stdout:mon 3/3 7m ago 13m smithi044:172.21.15.44=a;smithi064:172.21.15.64=b;smithi149:172.21.15.149=c;count:3 2024-03-26T17:02:36.586 INFO:teuthology.orchestra.run.smithi157.stdout:nvmeof.mypool ?:4420,5500,8009 3/3 7m ago 8m smithi044=nvmeof.a;smithi064=nvmeof.b;smithi149=nvmeof.c;count:3 2024-03-26T17:02:36.586 INFO:teuthology.orchestra.run.smithi157.stdout:osd 8 7m ago - 2024-03-26T17:02:36.597 DEBUG:teuthology.orchestra.run.smithi157:> sudo nvme list-subsys / 2024-03-26T17:02:36.625 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-03-26T17:02:36.626 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-26T17:02:36.626 INFO:teuthology.orchestra.run.smithi157.stderr:Invalid device name / 2024-03-26T17:02:36.626 ERROR:tasks.nvmeof.[nvmeof.thrasher]:exception: Traceback (most recent call last): File "/home/teuthworker/src/github.com_vallariag_ceph_b4c4828f419f1247fc297e8069c1036b1d6151f2/qa/tasks/nvmeof.py", line 212, in _run self.do_thrash() File "/home/teuthworker/src/github.com_vallariag_ceph_b4c4828f419f1247fc297e8069c1036b1d6151f2/qa/tasks/nvmeof.py", line 263, in do_thrash self.remote.sh(f'sudo nvme list-subsys {d}') File "/home/teuthworker/src/git.ceph.com_teuthology_7c79d572ca9e89ddbdc2c40bbb7dac4f505c80ce/teuthology/orchestra/remote.py", line 97, in sh proc = self.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_7c79d572ca9e89ddbdc2c40bbb7dac4f505c80ce/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_7c79d572ca9e89ddbdc2c40bbb7dac4f505c80ce/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_7c79d572ca9e89ddbdc2c40bbb7dac4f505c80ce/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_7c79d572ca9e89ddbdc2c40bbb7dac4f505c80ce/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi157 with status 1: 'sudo nvme list-subsys /' 2024-03-26T17:02:36.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:36 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 2024-03-26T17:02:36.213+0000 7fa707a55700 -1 mon.c@1(peon) e3 get_health_metrics reporting 3 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T17:02:36.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:36 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-03-26T17:02:36.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:36 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-03-26T17:02:36.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:36 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-03-26T17:02:36.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:36 smithi149 ceph-mon[34678]: Adjusting osd_memory_target on smithi064 to 5696M 2024-03-26T17:02:36.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:36 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T17:02:36.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:36 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T17:02:36.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:36 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-26T17:02:36.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:36 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T17:02:36.647 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:36 smithi149 ceph-mon[34678]: pgmap v478: 33 pgs: 33 active+clean; 1015 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 2.9 MiB/s rd, 3.1 MiB/s wr, 317 op/s 2024-03-26T17:02:37.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:02:36 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:02:36] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:02:37.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:02:36 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:02:36] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:02:37.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:02:36 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:02:37.396 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:02:36 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:02:36] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:02:37.396 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:02:36 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:02:36] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:02:37.396 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:02:36 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:02:38.138 INFO:tasks.workunit.client.3.smithi157.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-26T17:02:38.138 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:02:38.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:37 smithi044 ceph-mon[30624]: from='client.24889 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-03-26T17:02:38.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:37 smithi064 ceph-mon[34420]: from='client.24889 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-03-26T17:02:38.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:37 smithi149 ceph-mon[34678]: from='client.24889 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-03-26T17:02:38.902 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:02:38 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:02:38] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:02:38.902 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:02:38 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:02:38] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:02:38.902 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:02:38 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:02:38.903 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:02:38 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:02:38] INFO grpc.py:770: Received request to set ana states [nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T17:02:38.903 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:02:38 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: states { 2024-03-26T17:02:38.903 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:02:38 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: grp_id: 2 2024-03-26T17:02:38.903 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:02:38 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: state: OPTIMIZED 2024-03-26T17:02:38.903 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:02:38 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: } 2024-03-26T17:02:38.903 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:02:38 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: , nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T17:02:38.903 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:02:38 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: states { 2024-03-26T17:02:38.904 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:02:38 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: grp_id: 2 2024-03-26T17:02:38.904 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:02:38 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: state: OPTIMIZED 2024-03-26T17:02:38.904 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:02:38 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: } 2024-03-26T17:02:38.904 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:02:38 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: , nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T17:02:38.904 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:02:38 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: states { 2024-03-26T17:02:38.904 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:02:38 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: grp_id: 2 2024-03-26T17:02:38.904 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:02:38 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: state: OPTIMIZED 2024-03-26T17:02:38.904 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:02:38 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: } 2024-03-26T17:02:38.904 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:02:38 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: ] 2024-03-26T17:02:38.904 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:02:38 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:02:38] INFO grpc.py:1958: Subsystem nqn.2016-06.io.spdk:cnode1 enable_ha: True 2024-03-26T17:02:38.904 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:02:38 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:02:38] INFO grpc.py:782: Iterate over nqn='nqn.2016-06.io.spdk:cnode1' prefix='listener_nqn.2016-06.io.spdk:cnode1_smithi044_' listener_keys=['listener_nqn.2016-06.io.spdk:cnode1_smithi044_TCP_172.21.15.44_4420'] 2024-03-26T17:02:38.904 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:02:38 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:02:38] INFO grpc.py:789: listener_key='listener_nqn.2016-06.io.spdk:cnode1_smithi044_TCP_172.21.15.44_4420' listener={'nqn': 'nqn.2016-06.io.spdk:cnode1', 'host_name': 'smithi044', 'traddr': '172.21.15.44', 'adrfam': 'ipv4', 'trsvcid': 4420} 2024-03-26T17:02:38.904 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:02:38 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [2024-03-26 17:02:38.611835] bdev_rbd.c: 874:_bdev_rbd_wait_for_latest_osdmap: *ERROR*: rados_wait_for_latest_osdmap cluster: cluster_context_2_0 elapsed time: 0.000239 seconds 2024-03-26T17:02:38.905 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:02:38 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:02:38] INFO grpc.py:807: set_ana_state bdev_rbd_wait_for_latest_osdmap cluster='cluster_context_2_0' 2024-03-26T17:02:38.905 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:02:38 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:02:38] INFO grpc.py:810: set_ana_state nvmf_subsystem_listener_set_ana_state nqn='nqn.2016-06.io.spdk:cnode1' listener={'nqn': 'nqn.2016-06.io.spdk:cnode1', 'host_name': 'smithi044', 'traddr': '172.21.15.44', 'adrfam': 'ipv4', 'trsvcid': 4420} ana_state='optimized' grp_id=2 2024-03-26T17:02:38.905 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:02:38 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:02:38] INFO grpc.py:822: set_ana_state nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T17:02:38.905 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:02:38 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:02:38] INFO grpc.py:1958: Subsystem nqn.2016-06.io.spdk:cnode2 enable_ha: True 2024-03-26T17:02:38.905 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:02:38 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:02:38] INFO grpc.py:782: Iterate over nqn='nqn.2016-06.io.spdk:cnode2' prefix='listener_nqn.2016-06.io.spdk:cnode2_smithi044_' listener_keys=['listener_nqn.2016-06.io.spdk:cnode2_smithi044_TCP_172.21.15.44_4420'] 2024-03-26T17:02:38.905 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:02:38 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:02:38] INFO grpc.py:789: listener_key='listener_nqn.2016-06.io.spdk:cnode2_smithi044_TCP_172.21.15.44_4420' listener={'nqn': 'nqn.2016-06.io.spdk:cnode2', 'host_name': 'smithi044', 'traddr': '172.21.15.44', 'adrfam': 'ipv4', 'trsvcid': 4420} 2024-03-26T17:02:38.905 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:02:38 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:02:38] INFO grpc.py:810: set_ana_state nvmf_subsystem_listener_set_ana_state nqn='nqn.2016-06.io.spdk:cnode2' listener={'nqn': 'nqn.2016-06.io.spdk:cnode2', 'host_name': 'smithi044', 'traddr': '172.21.15.44', 'adrfam': 'ipv4', 'trsvcid': 4420} ana_state='optimized' grp_id=2 2024-03-26T17:02:38.905 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:02:38 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:02:38] INFO grpc.py:822: set_ana_state nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T17:02:38.905 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:02:38 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:02:38] INFO grpc.py:1958: Subsystem nqn.2016-06.io.spdk:cnode3 enable_ha: True 2024-03-26T17:02:38.905 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:02:38 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:02:38] INFO grpc.py:782: Iterate over nqn='nqn.2016-06.io.spdk:cnode3' prefix='listener_nqn.2016-06.io.spdk:cnode3_smithi044_' listener_keys=['listener_nqn.2016-06.io.spdk:cnode3_smithi044_TCP_172.21.15.44_4420'] 2024-03-26T17:02:38.905 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:02:38 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:02:38] INFO grpc.py:789: listener_key='listener_nqn.2016-06.io.spdk:cnode3_smithi044_TCP_172.21.15.44_4420' listener={'nqn': 'nqn.2016-06.io.spdk:cnode3', 'host_name': 'smithi044', 'traddr': '172.21.15.44', 'adrfam': 'ipv4', 'trsvcid': 4420} 2024-03-26T17:02:38.905 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:02:38 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:02:38] INFO grpc.py:810: set_ana_state nvmf_subsystem_listener_set_ana_state nqn='nqn.2016-06.io.spdk:cnode3' listener={'nqn': 'nqn.2016-06.io.spdk:cnode3', 'host_name': 'smithi044', 'traddr': '172.21.15.44', 'adrfam': 'ipv4', 'trsvcid': 4420} ana_state='optimized' grp_id=2 2024-03-26T17:02:38.905 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:02:38 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:02:38] INFO grpc.py:822: set_ana_state nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T17:02:39.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:38 smithi044 ceph-mon[30624]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:02:39.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:38 smithi044 ceph-mon[30624]: { 2024-03-26T17:02:39.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:38 smithi044 ceph-mon[30624]: "prefix": "rbd perf image stats", 2024-03-26T17:02:39.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:38 smithi044 ceph-mon[30624]: "pool_spec": "mypool", 2024-03-26T17:02:39.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:38 smithi044 ceph-mon[30624]: "sort_by": "write_ops", 2024-03-26T17:02:39.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:38 smithi044 ceph-mon[30624]: "format": "json" 2024-03-26T17:02:39.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:38 smithi044 ceph-mon[30624]: }"]: dispatch 2024-03-26T17:02:39.266 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:38 smithi044 ceph-mon[30624]: pgmap v479: 33 pgs: 33 active+clean; 1015 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 186 op/s 2024-03-26T17:02:39.266 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:38 smithi044 ceph-mon[30624]: Health check update: 3 slow ops, oldest one blocked for 253 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:02:39.266 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:38 smithi044 ceph-mon[30624]: osdmap e60: 8 total, 8 up, 8 in 2024-03-26T17:02:39.266 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:38 smithi044 ceph-mon[30624]: from='client.? 172.21.15.44:0/3241788124' entity='client.nvmeof.nvmeof.a' cmd={"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.64:0/1727848942"} : dispatch 2024-03-26T17:02:39.298 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:38 smithi149 ceph-mon[34678]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:02:39.298 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:38 smithi149 ceph-mon[34678]: { 2024-03-26T17:02:39.298 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:38 smithi149 ceph-mon[34678]: "prefix": "rbd perf image stats", 2024-03-26T17:02:39.298 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:38 smithi149 ceph-mon[34678]: "pool_spec": "mypool", 2024-03-26T17:02:39.298 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:38 smithi149 ceph-mon[34678]: "sort_by": "write_ops", 2024-03-26T17:02:39.298 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:38 smithi149 ceph-mon[34678]: "format": "json" 2024-03-26T17:02:39.298 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:38 smithi149 ceph-mon[34678]: }"]: dispatch 2024-03-26T17:02:39.298 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:38 smithi149 ceph-mon[34678]: pgmap v479: 33 pgs: 33 active+clean; 1015 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 186 op/s 2024-03-26T17:02:39.298 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:38 smithi149 ceph-mon[34678]: Health check update: 3 slow ops, oldest one blocked for 253 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:02:39.298 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:38 smithi149 ceph-mon[34678]: osdmap e60: 8 total, 8 up, 8 in 2024-03-26T17:02:39.298 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:38 smithi149 ceph-mon[34678]: from='client.? 172.21.15.44:0/3241788124' entity='client.nvmeof.nvmeof.a' cmd={"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.64:0/1727848942"} : dispatch 2024-03-26T17:02:39.299 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:02:38 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:02:38] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:02:39.299 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:02:38 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:02:38] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:02:39.299 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:02:38 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:02:39.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:38 smithi064 ceph-mon[34420]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:02:39.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:38 smithi064 ceph-mon[34420]: { 2024-03-26T17:02:39.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:38 smithi064 ceph-mon[34420]: "prefix": "rbd perf image stats", 2024-03-26T17:02:39.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:38 smithi064 ceph-mon[34420]: "pool_spec": "mypool", 2024-03-26T17:02:39.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:38 smithi064 ceph-mon[34420]: "sort_by": "write_ops", 2024-03-26T17:02:39.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:38 smithi064 ceph-mon[34420]: "format": "json" 2024-03-26T17:02:39.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:38 smithi064 ceph-mon[34420]: }"]: dispatch 2024-03-26T17:02:39.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:38 smithi064 ceph-mon[34420]: pgmap v479: 33 pgs: 33 active+clean; 1015 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 186 op/s 2024-03-26T17:02:39.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:38 smithi064 ceph-mon[34420]: Health check update: 3 slow ops, oldest one blocked for 253 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:02:39.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:38 smithi064 ceph-mon[34420]: osdmap e60: 8 total, 8 up, 8 in 2024-03-26T17:02:39.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:38 smithi064 ceph-mon[34420]: from='client.? 172.21.15.44:0/3241788124' entity='client.nvmeof.nvmeof.a' cmd={"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.64:0/1727848942"} : dispatch 2024-03-26T17:02:40.896 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:40 smithi149 ceph-mon[34678]: from='client.? 172.21.15.44:0/3241788124' entity='client.nvmeof.nvmeof.a' cmd='[{"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.64:0/1727848942"}]': finished 2024-03-26T17:02:40.896 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:40 smithi149 ceph-mon[34678]: osdmap e61: 8 total, 8 up, 8 in 2024-03-26T17:02:40.896 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:40 smithi149 ceph-mon[34678]: from='client.? 172.21.15.44:0/3241788124' entity='client.nvmeof.nvmeof.a' cmd={"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.64:0/1727848942"} : dispatch 2024-03-26T17:02:40.896 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:40 smithi149 ceph-mon[34678]: pgmap v482: 33 pgs: 33 active+clean; 1015 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 23 KiB/s rd, 2 op/s 2024-03-26T17:02:41.015 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:40 smithi044 ceph-mon[30624]: from='client.? 172.21.15.44:0/3241788124' entity='client.nvmeof.nvmeof.a' cmd='[{"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.64:0/1727848942"}]': finished 2024-03-26T17:02:41.015 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:40 smithi044 ceph-mon[30624]: osdmap e61: 8 total, 8 up, 8 in 2024-03-26T17:02:41.015 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:40 smithi044 ceph-mon[30624]: from='client.? 172.21.15.44:0/3241788124' entity='client.nvmeof.nvmeof.a' cmd={"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.64:0/1727848942"} : dispatch 2024-03-26T17:02:41.015 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:40 smithi044 ceph-mon[30624]: pgmap v482: 33 pgs: 33 active+clean; 1015 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 23 KiB/s rd, 2 op/s 2024-03-26T17:02:41.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:02:40 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:02:40] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:02:41.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:02:40 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:02:40] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:02:41.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:02:40 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:02:41.055 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:40 smithi064 ceph-mon[34420]: from='client.? 172.21.15.44:0/3241788124' entity='client.nvmeof.nvmeof.a' cmd='[{"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.64:0/1727848942"}]': finished 2024-03-26T17:02:41.055 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:40 smithi064 ceph-mon[34420]: osdmap e61: 8 total, 8 up, 8 in 2024-03-26T17:02:41.055 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:40 smithi064 ceph-mon[34420]: from='client.? 172.21.15.44:0/3241788124' entity='client.nvmeof.nvmeof.a' cmd={"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.64:0/1727848942"} : dispatch 2024-03-26T17:02:41.055 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:40 smithi064 ceph-mon[34420]: pgmap v482: 33 pgs: 33 active+clean; 1015 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 23 KiB/s rd, 2 op/s 2024-03-26T17:02:41.215 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:02:40 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:02:40] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:02:41.215 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:02:40 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:02:40] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:02:41.215 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:02:40 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:02:41.578 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:41 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 2024-03-26T17:02:41.213+0000 7fa707a55700 -1 mon.c@1(peon) e3 get_health_metrics reporting 3 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T17:02:41.805 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:41 smithi064 ceph-mon[34420]: from='client.? 172.21.15.44:0/3241788124' entity='client.nvmeof.nvmeof.a' cmd='[{"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.64:0/1727848942"}]': finished 2024-03-26T17:02:41.806 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:41 smithi064 ceph-mon[34420]: osdmap e62: 8 total, 8 up, 8 in 2024-03-26T17:02:41.806 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:41 smithi064 ceph-mon[34420]: from='client.? 172.21.15.44:0/3241788124' entity='client.nvmeof.nvmeof.a' cmd={"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.64:0/1727848942"} : dispatch 2024-03-26T17:02:41.897 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:41 smithi149 ceph-mon[34678]: from='client.? 172.21.15.44:0/3241788124' entity='client.nvmeof.nvmeof.a' cmd='[{"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.64:0/1727848942"}]': finished 2024-03-26T17:02:41.898 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:41 smithi149 ceph-mon[34678]: osdmap e62: 8 total, 8 up, 8 in 2024-03-26T17:02:41.898 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:41 smithi149 ceph-mon[34678]: from='client.? 172.21.15.44:0/3241788124' entity='client.nvmeof.nvmeof.a' cmd={"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.64:0/1727848942"} : dispatch 2024-03-26T17:02:42.015 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:41 smithi044 ceph-mon[30624]: from='client.? 172.21.15.44:0/3241788124' entity='client.nvmeof.nvmeof.a' cmd='[{"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.64:0/1727848942"}]': finished 2024-03-26T17:02:42.015 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:41 smithi044 ceph-mon[30624]: osdmap e62: 8 total, 8 up, 8 in 2024-03-26T17:02:42.015 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:41 smithi044 ceph-mon[30624]: from='client.? 172.21.15.44:0/3241788124' entity='client.nvmeof.nvmeof.a' cmd={"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.64:0/1727848942"} : dispatch 2024-03-26T17:02:42.896 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:42 smithi149 ceph-mon[34678]: from='client.? 172.21.15.44:0/3241788124' entity='client.nvmeof.nvmeof.a' cmd='[{"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.64:0/1727848942"}]': finished 2024-03-26T17:02:42.896 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:42 smithi149 ceph-mon[34678]: osdmap e63: 8 total, 8 up, 8 in 2024-03-26T17:02:42.896 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:42 smithi149 ceph-mon[34678]: from='client.? 172.21.15.44:0/3241788124' entity='client.nvmeof.nvmeof.a' cmd={"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.64:0/1727848942"} : dispatch 2024-03-26T17:02:42.896 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:42 smithi149 ceph-mon[34678]: pgmap v485: 33 pgs: 33 active+clean; 1015 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 28 KiB/s rd, 9.0 KiB/s wr, 3 op/s 2024-03-26T17:02:42.918 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:42 smithi044 ceph-mon[30624]: from='client.? 172.21.15.44:0/3241788124' entity='client.nvmeof.nvmeof.a' cmd='[{"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.64:0/1727848942"}]': finished 2024-03-26T17:02:42.918 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:42 smithi044 ceph-mon[30624]: osdmap e63: 8 total, 8 up, 8 in 2024-03-26T17:02:42.918 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:42 smithi044 ceph-mon[30624]: from='client.? 172.21.15.44:0/3241788124' entity='client.nvmeof.nvmeof.a' cmd={"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.64:0/1727848942"} : dispatch 2024-03-26T17:02:42.918 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:42 smithi044 ceph-mon[30624]: pgmap v485: 33 pgs: 33 active+clean; 1015 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 28 KiB/s rd, 9.0 KiB/s wr, 3 op/s 2024-03-26T17:02:42.919 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:02:42 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:02:42] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:02:42.919 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:02:42 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:02:42] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:02:42.919 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:02:42 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:02:42.919 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:02:42 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:02:42] INFO grpc.py:770: Received request to set ana states [nqn: "nqn.2016-06.io.spdk:cnode1" 2024-03-26T17:02:42.919 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:02:42 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: states { 2024-03-26T17:02:42.919 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:02:42 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: grp_id: 2 2024-03-26T17:02:42.919 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:02:42 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: state: OPTIMIZED 2024-03-26T17:02:42.919 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:02:42 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: } 2024-03-26T17:02:42.919 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:02:42 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: , nqn: "nqn.2016-06.io.spdk:cnode2" 2024-03-26T17:02:42.920 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:02:42 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: states { 2024-03-26T17:02:42.920 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:02:42 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: grp_id: 2 2024-03-26T17:02:42.920 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:02:42 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: state: OPTIMIZED 2024-03-26T17:02:42.920 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:02:42 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: } 2024-03-26T17:02:42.920 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:02:42 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: , nqn: "nqn.2016-06.io.spdk:cnode3" 2024-03-26T17:02:42.920 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:02:42 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: states { 2024-03-26T17:02:42.920 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:02:42 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: grp_id: 2 2024-03-26T17:02:42.920 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:02:42 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: state: OPTIMIZED 2024-03-26T17:02:42.920 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:02:42 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: } 2024-03-26T17:02:42.920 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:02:42 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: ] 2024-03-26T17:02:42.920 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:02:42 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:02:42] INFO grpc.py:1958: Subsystem nqn.2016-06.io.spdk:cnode1 enable_ha: True 2024-03-26T17:02:42.920 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:02:42 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:02:42] INFO grpc.py:782: Iterate over nqn='nqn.2016-06.io.spdk:cnode1' prefix='listener_nqn.2016-06.io.spdk:cnode1_smithi044_' listener_keys=['listener_nqn.2016-06.io.spdk:cnode1_smithi044_TCP_172.21.15.44_4420'] 2024-03-26T17:02:42.921 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:02:42 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:02:42] INFO grpc.py:789: listener_key='listener_nqn.2016-06.io.spdk:cnode1_smithi044_TCP_172.21.15.44_4420' listener={'nqn': 'nqn.2016-06.io.spdk:cnode1', 'host_name': 'smithi044', 'traddr': '172.21.15.44', 'adrfam': 'ipv4', 'trsvcid': 4420} 2024-03-26T17:02:42.921 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:02:42 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [2024-03-26 17:02:42.636143] bdev_rbd.c: 874:_bdev_rbd_wait_for_latest_osdmap: *ERROR*: rados_wait_for_latest_osdmap cluster: cluster_context_2_0 elapsed time: 0.000234 seconds 2024-03-26T17:02:42.921 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:02:42 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:02:42] INFO grpc.py:807: set_ana_state bdev_rbd_wait_for_latest_osdmap cluster='cluster_context_2_0' 2024-03-26T17:02:42.921 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:02:42 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:02:42] INFO grpc.py:810: set_ana_state nvmf_subsystem_listener_set_ana_state nqn='nqn.2016-06.io.spdk:cnode1' listener={'nqn': 'nqn.2016-06.io.spdk:cnode1', 'host_name': 'smithi044', 'traddr': '172.21.15.44', 'adrfam': 'ipv4', 'trsvcid': 4420} ana_state='optimized' grp_id=2 2024-03-26T17:02:42.921 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:02:42 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:02:42] INFO grpc.py:822: set_ana_state nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T17:02:42.921 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:02:42 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:02:42] INFO grpc.py:1958: Subsystem nqn.2016-06.io.spdk:cnode2 enable_ha: True 2024-03-26T17:02:42.921 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:02:42 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:02:42] INFO grpc.py:782: Iterate over nqn='nqn.2016-06.io.spdk:cnode2' prefix='listener_nqn.2016-06.io.spdk:cnode2_smithi044_' listener_keys=['listener_nqn.2016-06.io.spdk:cnode2_smithi044_TCP_172.21.15.44_4420'] 2024-03-26T17:02:42.921 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:02:42 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:02:42] INFO grpc.py:789: listener_key='listener_nqn.2016-06.io.spdk:cnode2_smithi044_TCP_172.21.15.44_4420' listener={'nqn': 'nqn.2016-06.io.spdk:cnode2', 'host_name': 'smithi044', 'traddr': '172.21.15.44', 'adrfam': 'ipv4', 'trsvcid': 4420} 2024-03-26T17:02:42.921 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:02:42 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:02:42] INFO grpc.py:810: set_ana_state nvmf_subsystem_listener_set_ana_state nqn='nqn.2016-06.io.spdk:cnode2' listener={'nqn': 'nqn.2016-06.io.spdk:cnode2', 'host_name': 'smithi044', 'traddr': '172.21.15.44', 'adrfam': 'ipv4', 'trsvcid': 4420} ana_state='optimized' grp_id=2 2024-03-26T17:02:42.921 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:02:42 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:02:42] INFO grpc.py:822: set_ana_state nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T17:02:42.921 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:02:42 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:02:42] INFO grpc.py:1958: Subsystem nqn.2016-06.io.spdk:cnode3 enable_ha: True 2024-03-26T17:02:42.921 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:02:42 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:02:42] INFO grpc.py:782: Iterate over nqn='nqn.2016-06.io.spdk:cnode3' prefix='listener_nqn.2016-06.io.spdk:cnode3_smithi044_' listener_keys=['listener_nqn.2016-06.io.spdk:cnode3_smithi044_TCP_172.21.15.44_4420'] 2024-03-26T17:02:42.922 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:02:42 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:02:42] INFO grpc.py:789: listener_key='listener_nqn.2016-06.io.spdk:cnode3_smithi044_TCP_172.21.15.44_4420' listener={'nqn': 'nqn.2016-06.io.spdk:cnode3', 'host_name': 'smithi044', 'traddr': '172.21.15.44', 'adrfam': 'ipv4', 'trsvcid': 4420} 2024-03-26T17:02:42.922 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:02:42 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:02:42] INFO grpc.py:810: set_ana_state nvmf_subsystem_listener_set_ana_state nqn='nqn.2016-06.io.spdk:cnode3' listener={'nqn': 'nqn.2016-06.io.spdk:cnode3', 'host_name': 'smithi044', 'traddr': '172.21.15.44', 'adrfam': 'ipv4', 'trsvcid': 4420} ana_state='optimized' grp_id=2 2024-03-26T17:02:42.922 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:02:42 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:02:42] INFO grpc.py:822: set_ana_state nvmf_subsystem_listener_set_ana_state response ret=True 2024-03-26T17:02:43.055 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:42 smithi064 ceph-mon[34420]: from='client.? 172.21.15.44:0/3241788124' entity='client.nvmeof.nvmeof.a' cmd='[{"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.64:0/1727848942"}]': finished 2024-03-26T17:02:43.055 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:42 smithi064 ceph-mon[34420]: osdmap e63: 8 total, 8 up, 8 in 2024-03-26T17:02:43.055 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:42 smithi064 ceph-mon[34420]: from='client.? 172.21.15.44:0/3241788124' entity='client.nvmeof.nvmeof.a' cmd={"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.64:0/1727848942"} : dispatch 2024-03-26T17:02:43.056 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:42 smithi064 ceph-mon[34420]: pgmap v485: 33 pgs: 33 active+clean; 1015 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 28 KiB/s rd, 9.0 KiB/s wr, 3 op/s 2024-03-26T17:02:43.061 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:02:43.070 INFO:tasks.workunit.client.3.smithi157.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2024-03-26T17:02:43.070 INFO:tasks.workunit.client.3.smithi157.stdout: 0.10 1.2k 0.0k 0.0k 12.0k 0.0k 0.0k nvme2n1 2024-03-26T17:02:43.070 INFO:tasks.workunit.client.3.smithi157.stdout: 0.10 0.0k 2.0k 0.0k 0.0k 20.0k 0.0k nvme2n10 2024-03-26T17:02:43.070 INFO:tasks.workunit.client.3.smithi157.stdout: 0.10 0.8k 0.0k 0.0k 8.0k 0.0k 0.0k nvme2n11 2024-03-26T17:02:43.070 INFO:tasks.workunit.client.3.smithi157.stdout: 0.10 3.2k 0.0k 0.0k 32.0k 0.0k 0.0k nvme2n12 2024-03-26T17:02:43.071 INFO:tasks.workunit.client.3.smithi157.stdout: 0.10 1.6k 0.0k 0.0k 16.0k 0.0k 0.0k nvme2n13 2024-03-26T17:02:43.071 INFO:tasks.workunit.client.3.smithi157.stdout: 0.10 0.0k 3.2k 0.0k 0.0k 32.0k 0.0k nvme2n14 2024-03-26T17:02:43.071 INFO:tasks.workunit.client.3.smithi157.stdout: 0.10 0.0k 3.6k 0.0k 0.0k 36.0k 0.0k nvme2n15 2024-03-26T17:02:43.071 INFO:tasks.workunit.client.3.smithi157.stdout: 0.10 2.0k 0.0k 0.0k 20.0k 0.0k 0.0k nvme2n16 2024-03-26T17:02:43.071 INFO:tasks.workunit.client.3.smithi157.stdout: 0.10 0.8k 0.0k 0.0k 8.0k 0.0k 0.0k nvme2n17 2024-03-26T17:02:43.071 INFO:tasks.workunit.client.3.smithi157.stdout: 0.10 0.0k 4.4k 0.0k 0.0k 44.0k 0.0k nvme2n18 2024-03-26T17:02:43.071 INFO:tasks.workunit.client.3.smithi157.stdout: 0.10 0.0k 1.6k 0.0k 0.0k 16.0k 0.0k nvme2n19 2024-03-26T17:02:43.071 INFO:tasks.workunit.client.3.smithi157.stdout: 0.00 0.0k 0.0k 0.0k 0.0k 0.0k 0.0k nvme2n2 2024-03-26T17:02:43.071 INFO:tasks.workunit.client.3.smithi157.stdout: 0.10 0.0k 0.4k 0.0k 0.0k 4.0k 0.0k nvme2n20 2024-03-26T17:02:43.071 INFO:tasks.workunit.client.3.smithi157.stdout: 0.00 0.0k 0.0k 0.0k 0.0k 0.0k 0.0k nvme2n3 2024-03-26T17:02:43.071 INFO:tasks.workunit.client.3.smithi157.stdout: 0.00 0.0k 0.0k 0.0k 0.0k 0.0k 0.0k nvme2n4 2024-03-26T17:02:43.071 INFO:tasks.workunit.client.3.smithi157.stdout: 0.00 0.0k 0.0k 0.0k 0.0k 0.0k 0.0k nvme2n5 2024-03-26T17:02:43.072 INFO:tasks.workunit.client.3.smithi157.stdout: 0.00 0.0k 0.0k 0.0k 0.0k 0.0k 0.0k nvme2n6 2024-03-26T17:02:43.072 INFO:tasks.workunit.client.3.smithi157.stdout: 0.00 0.0k 0.0k 0.0k 0.0k 0.0k 0.0k nvme2n7 2024-03-26T17:02:43.072 INFO:tasks.workunit.client.3.smithi157.stdout: 0.10 1.2k 0.0k 0.0k 12.0k 0.0k 0.0k nvme2n8 2024-03-26T17:02:43.072 INFO:tasks.workunit.client.3.smithi157.stdout: 0.10 0.8k 0.0k 0.0k 8.0k 0.0k 0.0k nvme2n9 2024-03-26T17:02:43.072 INFO:tasks.workunit.client.3.smithi157.stdout: 0.10 0.0k 2.0k 0.0k 0.0k 20.0k 0.0k nvme5n1 2024-03-26T17:02:43.072 INFO:tasks.workunit.client.3.smithi157.stdout: 0.10 0.0k 1.2k 0.0k 0.0k 12.0k 0.0k nvme5n10 2024-03-26T17:02:43.072 INFO:tasks.workunit.client.3.smithi157.stdout: 0.10 0.4k 0.0k 0.0k 4.0k 0.0k 0.0k nvme5n11 2024-03-26T17:02:43.072 INFO:tasks.workunit.client.3.smithi157.stdout: 0.10 0.0k 0.4k 0.0k 0.0k 4.0k 0.0k nvme5n12 2024-03-26T17:02:43.072 INFO:tasks.workunit.client.3.smithi157.stdout: 0.10 0.0k 0.8k 0.0k 0.0k 8.0k 0.0k nvme5n13 2024-03-26T17:02:43.072 INFO:tasks.workunit.client.3.smithi157.stdout: 0.10 2.4k 0.0k 0.0k 24.0k 0.0k 0.0k nvme5n14 2024-03-26T17:02:43.072 INFO:tasks.workunit.client.3.smithi157.stdout: 0.10 1.6k 0.0k 0.0k 16.0k 0.0k 0.0k nvme5n15 2024-03-26T17:02:43.072 INFO:tasks.workunit.client.3.smithi157.stdout: 0.10 0.8k 0.0k 0.0k 8.0k 0.0k 0.0k nvme5n16 2024-03-26T17:02:43.073 INFO:tasks.workunit.client.3.smithi157.stdout: 0.10 4.4k 0.0k 0.0k 44.0k 0.0k 0.0k nvme5n17 2024-03-26T17:02:43.073 INFO:tasks.workunit.client.3.smithi157.stdout: 0.10 2.4k 0.0k 0.0k 24.0k 0.0k 0.0k nvme5n18 2024-03-26T17:02:43.073 INFO:tasks.workunit.client.3.smithi157.stdout: 0.10 0.4k 0.0k 0.0k 4.0k 0.0k 0.0k nvme5n19 2024-03-26T17:02:43.073 INFO:tasks.workunit.client.3.smithi157.stdout: 0.10 0.0k 0.4k 0.0k 0.0k 4.0k 0.0k nvme5n2 2024-03-26T17:02:43.073 INFO:tasks.workunit.client.3.smithi157.stdout: 0.10 0.4k 0.0k 0.0k 4.0k 0.0k 0.0k nvme5n20 2024-03-26T17:02:43.073 INFO:tasks.workunit.client.3.smithi157.stdout: 0.00 0.0k 0.0k 0.0k 0.0k 0.0k 0.0k nvme5n3 2024-03-26T17:02:43.073 INFO:tasks.workunit.client.3.smithi157.stdout: 0.00 0.0k 0.0k 0.0k 0.0k 0.0k 0.0k nvme5n4 2024-03-26T17:02:43.073 INFO:tasks.workunit.client.3.smithi157.stdout: 0.00 0.0k 0.0k 0.0k 0.0k 0.0k 0.0k nvme5n5 2024-03-26T17:02:43.073 INFO:tasks.workunit.client.3.smithi157.stdout: 0.00 0.0k 0.0k 0.0k 0.0k 0.0k 0.0k nvme5n6 2024-03-26T17:02:43.073 INFO:tasks.workunit.client.3.smithi157.stdout: 0.00 0.0k 0.0k 0.0k 0.0k 0.0k 0.0k nvme5n7 2024-03-26T17:02:43.073 INFO:tasks.workunit.client.3.smithi157.stdout: 0.10 0.0k 0.8k 0.0k 0.0k 8.0k 0.0k nvme5n8 2024-03-26T17:02:43.073 INFO:tasks.workunit.client.3.smithi157.stdout: 0.10 2.0k 0.0k 0.0k 20.0k 0.0k 0.0k nvme5n9 2024-03-26T17:02:43.074 INFO:tasks.workunit.client.3.smithi157.stdout: 0.10 2.0k 0.0k 0.0k 20.0k 0.0k 0.0k nvme8n1 2024-03-26T17:02:43.074 INFO:tasks.workunit.client.3.smithi157.stdout: 0.10 0.0k 1.2k 0.0k 0.0k 12.0k 0.0k nvme8n10 2024-03-26T17:02:43.074 INFO:tasks.workunit.client.3.smithi157.stdout: 0.10 4.4k 0.0k 0.0k 44.0k 0.0k 0.0k nvme8n11 2024-03-26T17:02:43.074 INFO:tasks.workunit.client.3.smithi157.stdout: 0.10 2.4k 0.0k 0.0k 24.0k 0.0k 0.0k nvme8n12 2024-03-26T17:02:43.074 INFO:tasks.workunit.client.3.smithi157.stdout: 0.10 6.4k 0.0k 0.0k 64.0k 0.0k 0.0k nvme8n13 2024-03-26T17:02:43.074 INFO:tasks.workunit.client.3.smithi157.stdout: 0.10 0.0k 1.6k 0.0k 0.0k 16.0k 0.0k nvme8n14 2024-03-26T17:02:43.074 INFO:tasks.workunit.client.3.smithi157.stdout: 0.10 4.4k 0.0k 0.0k 44.0k 0.0k 0.0k nvme8n15 2024-03-26T17:02:43.074 INFO:tasks.workunit.client.3.smithi157.stdout: 0.10 0.0k 3.6k 0.0k 0.0k 36.0k 0.0k nvme8n16 2024-03-26T17:02:43.074 INFO:tasks.workunit.client.3.smithi157.stdout: 0.10 0.0k 1.2k 0.0k 0.0k 12.0k 0.0k nvme8n17 2024-03-26T17:02:43.074 INFO:tasks.workunit.client.3.smithi157.stdout: 0.10 2.8k 0.0k 0.0k 28.0k 0.0k 0.0k nvme8n18 2024-03-26T17:02:43.075 INFO:tasks.workunit.client.3.smithi157.stdout: 0.10 0.0k 0.8k 0.0k 0.0k 8.0k 0.0k nvme8n19 2024-03-26T17:02:43.075 INFO:tasks.workunit.client.3.smithi157.stdout: 0.00 0.0k 0.0k 0.0k 0.0k 0.0k 0.0k nvme8n2 2024-03-26T17:02:43.075 INFO:tasks.workunit.client.3.smithi157.stdout: 0.10 0.0k 1.2k 0.0k 0.0k 12.0k 0.0k nvme8n20 2024-03-26T17:02:43.075 INFO:tasks.workunit.client.3.smithi157.stdout: 0.00 0.0k 0.0k 0.0k 0.0k 0.0k 0.0k nvme8n3 2024-03-26T17:02:43.075 INFO:tasks.workunit.client.3.smithi157.stdout: 0.00 0.0k 0.0k 0.0k 0.0k 0.0k 0.0k nvme8n4 2024-03-26T17:02:43.075 INFO:tasks.workunit.client.3.smithi157.stdout: 0.00 0.0k 0.0k 0.0k 0.0k 0.0k 0.0k nvme8n5 2024-03-26T17:02:43.075 INFO:tasks.workunit.client.3.smithi157.stdout: 0.00 0.0k 0.0k 0.0k 0.0k 0.0k 0.0k nvme8n6 2024-03-26T17:02:43.075 INFO:tasks.workunit.client.3.smithi157.stdout: 0.00 0.0k 0.0k 0.0k 0.0k 0.0k 0.0k nvme8n7 2024-03-26T17:02:43.075 INFO:tasks.workunit.client.3.smithi157.stdout: 0.10 0.0k 4.0k 0.0k 0.0k 40.0k 0.0k nvme8n8 2024-03-26T17:02:43.075 INFO:tasks.workunit.client.3.smithi157.stdout: 0.10 0.0k 3.2k 0.0k 0.0k 32.0k 0.0k nvme8n9 2024-03-26T17:02:43.075 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:02:43.142 INFO:tasks.workunit.client.3.smithi157.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-26T17:02:43.142 INFO:tasks.workunit.client.3.smithi157.stdout:myimage48 0/s 0/s 8 KiB/s 0 B/s 236.65 us 0.00 ns 2024-03-26T17:02:43.142 INFO:tasks.workunit.client.3.smithi157.stdout:myimage15 0/s 0/s 7.2 KiB/s 0 B/s 234.92 us 0.00 ns 2024-03-26T17:02:43.142 INFO:tasks.workunit.client.3.smithi157.stdout:myimage28 0/s 0/s 1.6 KiB/s 0 B/s 367.86 us 0.00 ns 2024-03-26T17:02:43.142 INFO:tasks.workunit.client.3.smithi157.stdout:myimage33 0/s 0/s 1.6 KiB/s 0 B/s 233.57 us 0.00 ns 2024-03-26T17:02:43.142 INFO:tasks.workunit.client.3.smithi157.stdout:myimage50 0/s 0/s 2.4 KiB/s 0 B/s 241.72 us 0.00 ns 2024-03-26T17:02:43.142 INFO:tasks.workunit.client.3.smithi157.stdout:myimage54 0/s 0/s 3.2 KiB/s 0 B/s 238.28 us 0.00 ns 2024-03-26T17:02:43.142 INFO:tasks.workunit.client.3.smithi157.stdout:myimage16 0/s 0/s 0 B/s 4 KiB/s 0.00 ns 45.21 us 2024-03-26T17:02:43.142 INFO:tasks.workunit.client.3.smithi157.stdout:myimage31 0/s 0/s 0 B/s 819 B/s 0.00 ns 33.06 us 2024-03-26T17:02:43.142 INFO:tasks.workunit.client.3.smithi157.stdout:myimage37 0/s 0/s 0 B/s 8.8 KiB/s 0.00 ns 26.17 us 2024-03-26T17:02:43.143 INFO:tasks.workunit.client.3.smithi157.stdout:myimage38 0/s 0/s 0 B/s 4.8 KiB/s 0.00 ns 28.24 us 2024-03-26T17:02:43.143 INFO:tasks.workunit.client.3.smithi157.stdout:myimage52 0/s 0/s 0 B/s 4.8 KiB/s 0.00 ns 31.22 us 2024-03-26T17:02:43.143 INFO:tasks.workunit.client.3.smithi157.stdout:myimage8 0/s 0/s 0 B/s 2.4 KiB/s 0.00 ns 57.76 us 2024-03-26T17:02:43.143 INFO:tasks.workunit.client.3.smithi157.stdout:myimage9 0/s 0/s 0 B/s 1.6 KiB/s 0.00 ns 49.78 us 2024-03-26T17:02:43.143 INFO:tasks.workunit.client.3.smithi157.stdout:myimage17 0/s 0/s 0 B/s 1.6 KiB/s 0.00 ns 27.78 us 2024-03-26T17:02:43.143 INFO:tasks.workunit.client.3.smithi157.stdout:myimage41 0/s 0/s 0 B/s 4 KiB/s 0.00 ns 35.79 us 2024-03-26T17:02:43.143 INFO:tasks.workunit.client.3.smithi157.stdout:myimage51 0/s 0/s 0 B/s 8.8 KiB/s 0.00 ns 46.92 us 2024-03-26T17:02:43.143 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:02:43.396 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:02:42 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:02:42] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:02:43.396 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:02:42 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:02:42] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:02:43.396 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:02:42 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:02:43.896 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:43 smithi149 ceph-mon[34678]: from='client.? 172.21.15.44:0/3241788124' entity='client.nvmeof.nvmeof.a' cmd='[{"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.64:0/1727848942"}]': finished 2024-03-26T17:02:43.896 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:43 smithi149 ceph-mon[34678]: osdmap e64: 8 total, 8 up, 8 in 2024-03-26T17:02:43.896 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:43 smithi149 ceph-mon[34678]: from='client.? 172.21.15.44:0/3241788124' entity='client.nvmeof.nvmeof.a' cmd={"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.64:0/1727848942"} : dispatch 2024-03-26T17:02:43.896 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:43 smithi149 ceph-mon[34678]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:02:43.897 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:43 smithi149 ceph-mon[34678]: { 2024-03-26T17:02:43.897 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:43 smithi149 ceph-mon[34678]: "prefix": "rbd perf image stats", 2024-03-26T17:02:43.897 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:43 smithi149 ceph-mon[34678]: "pool_spec": "mypool", 2024-03-26T17:02:43.897 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:43 smithi149 ceph-mon[34678]: "sort_by": "write_ops", 2024-03-26T17:02:43.897 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:43 smithi149 ceph-mon[34678]: "format": "json" 2024-03-26T17:02:43.897 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:43 smithi149 ceph-mon[34678]: }"]: dispatch 2024-03-26T17:02:43.897 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:43 smithi149 ceph-mon[34678]: Health check update: 3 slow ops, oldest one blocked for 258 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:02:44.015 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:43 smithi044 ceph-mon[30624]: from='client.? 172.21.15.44:0/3241788124' entity='client.nvmeof.nvmeof.a' cmd='[{"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.64:0/1727848942"}]': finished 2024-03-26T17:02:44.015 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:43 smithi044 ceph-mon[30624]: osdmap e64: 8 total, 8 up, 8 in 2024-03-26T17:02:44.015 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:43 smithi044 ceph-mon[30624]: from='client.? 172.21.15.44:0/3241788124' entity='client.nvmeof.nvmeof.a' cmd={"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.64:0/1727848942"} : dispatch 2024-03-26T17:02:44.015 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:43 smithi044 ceph-mon[30624]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:02:44.015 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:43 smithi044 ceph-mon[30624]: { 2024-03-26T17:02:44.015 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:43 smithi044 ceph-mon[30624]: "prefix": "rbd perf image stats", 2024-03-26T17:02:44.016 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:43 smithi044 ceph-mon[30624]: "pool_spec": "mypool", 2024-03-26T17:02:44.016 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:43 smithi044 ceph-mon[30624]: "sort_by": "write_ops", 2024-03-26T17:02:44.016 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:43 smithi044 ceph-mon[30624]: "format": "json" 2024-03-26T17:02:44.016 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:43 smithi044 ceph-mon[30624]: }"]: dispatch 2024-03-26T17:02:44.016 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:43 smithi044 ceph-mon[30624]: Health check update: 3 slow ops, oldest one blocked for 258 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:02:44.056 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:43 smithi064 ceph-mon[34420]: from='client.? 172.21.15.44:0/3241788124' entity='client.nvmeof.nvmeof.a' cmd='[{"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.64:0/1727848942"}]': finished 2024-03-26T17:02:44.056 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:43 smithi064 ceph-mon[34420]: osdmap e64: 8 total, 8 up, 8 in 2024-03-26T17:02:44.056 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:43 smithi064 ceph-mon[34420]: from='client.? 172.21.15.44:0/3241788124' entity='client.nvmeof.nvmeof.a' cmd={"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.64:0/1727848942"} : dispatch 2024-03-26T17:02:44.056 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:43 smithi064 ceph-mon[34420]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:02:44.056 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:43 smithi064 ceph-mon[34420]: { 2024-03-26T17:02:44.056 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:43 smithi064 ceph-mon[34420]: "prefix": "rbd perf image stats", 2024-03-26T17:02:44.056 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:43 smithi064 ceph-mon[34420]: "pool_spec": "mypool", 2024-03-26T17:02:44.056 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:43 smithi064 ceph-mon[34420]: "sort_by": "write_ops", 2024-03-26T17:02:44.056 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:43 smithi064 ceph-mon[34420]: "format": "json" 2024-03-26T17:02:44.056 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:43 smithi064 ceph-mon[34420]: }"]: dispatch 2024-03-26T17:02:44.056 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:43 smithi064 ceph-mon[34420]: Health check update: 3 slow ops, oldest one blocked for 258 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:02:44.896 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:44 smithi149 ceph-mon[34678]: from='client.? 172.21.15.44:0/3241788124' entity='client.nvmeof.nvmeof.a' cmd='[{"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.64:0/1727848942"}]': finished 2024-03-26T17:02:44.896 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:44 smithi149 ceph-mon[34678]: osdmap e65: 8 total, 8 up, 8 in 2024-03-26T17:02:44.896 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:44 smithi149 ceph-mon[34678]: from='client.? 172.21.15.44:0/3241788124' entity='client.nvmeof.nvmeof.a' cmd={"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.64:0/1727848942"} : dispatch 2024-03-26T17:02:44.896 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:44 smithi149 ceph-mon[34678]: pgmap v488: 33 pgs: 33 active+clean; 1015 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 117 KiB/s rd, 60 KiB/s wr, 22 op/s 2024-03-26T17:02:44.917 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:44 smithi044 ceph-mon[30624]: from='client.? 172.21.15.44:0/3241788124' entity='client.nvmeof.nvmeof.a' cmd='[{"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.64:0/1727848942"}]': finished 2024-03-26T17:02:44.917 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:44 smithi044 ceph-mon[30624]: osdmap e65: 8 total, 8 up, 8 in 2024-03-26T17:02:44.917 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:44 smithi044 ceph-mon[30624]: from='client.? 172.21.15.44:0/3241788124' entity='client.nvmeof.nvmeof.a' cmd={"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.64:0/1727848942"} : dispatch 2024-03-26T17:02:44.917 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:44 smithi044 ceph-mon[30624]: pgmap v488: 33 pgs: 33 active+clean; 1015 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 117 KiB/s rd, 60 KiB/s wr, 22 op/s 2024-03-26T17:02:44.917 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:02:44 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:02:44] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:02:44.918 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:02:44 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:02:44] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:02:44.918 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:02:44 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:02:45.055 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:44 smithi064 ceph-mon[34420]: from='client.? 172.21.15.44:0/3241788124' entity='client.nvmeof.nvmeof.a' cmd='[{"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.64:0/1727848942"}]': finished 2024-03-26T17:02:45.056 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:44 smithi064 ceph-mon[34420]: osdmap e65: 8 total, 8 up, 8 in 2024-03-26T17:02:45.056 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:44 smithi064 ceph-mon[34420]: from='client.? 172.21.15.44:0/3241788124' entity='client.nvmeof.nvmeof.a' cmd={"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.64:0/1727848942"} : dispatch 2024-03-26T17:02:45.056 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:44 smithi064 ceph-mon[34420]: pgmap v488: 33 pgs: 33 active+clean; 1015 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 117 KiB/s rd, 60 KiB/s wr, 22 op/s 2024-03-26T17:02:45.396 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:02:44 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:02:44] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:02:45.396 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:02:44 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:02:44] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:02:45.397 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:02:44 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:02:45.896 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:45 smithi149 ceph-mon[34678]: from='client.? 172.21.15.44:0/3241788124' entity='client.nvmeof.nvmeof.a' cmd='[{"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.64:0/1727848942"}]': finished 2024-03-26T17:02:45.896 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:45 smithi149 ceph-mon[34678]: osdmap e66: 8 total, 8 up, 8 in 2024-03-26T17:02:45.896 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:45 smithi149 ceph-mon[34678]: from='client.? 172.21.15.44:0/3241788124' entity='client.nvmeof.nvmeof.a' cmd={"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.64:0/1727848942"} : dispatch 2024-03-26T17:02:46.015 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:45 smithi044 ceph-mon[30624]: from='client.? 172.21.15.44:0/3241788124' entity='client.nvmeof.nvmeof.a' cmd='[{"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.64:0/1727848942"}]': finished 2024-03-26T17:02:46.015 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:45 smithi044 ceph-mon[30624]: osdmap e66: 8 total, 8 up, 8 in 2024-03-26T17:02:46.015 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:45 smithi044 ceph-mon[30624]: from='client.? 172.21.15.44:0/3241788124' entity='client.nvmeof.nvmeof.a' cmd={"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.64:0/1727848942"} : dispatch 2024-03-26T17:02:46.055 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:45 smithi064 ceph-mon[34420]: from='client.? 172.21.15.44:0/3241788124' entity='client.nvmeof.nvmeof.a' cmd='[{"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.64:0/1727848942"}]': finished 2024-03-26T17:02:46.055 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:45 smithi064 ceph-mon[34420]: osdmap e66: 8 total, 8 up, 8 in 2024-03-26T17:02:46.056 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:45 smithi064 ceph-mon[34420]: from='client.? 172.21.15.44:0/3241788124' entity='client.nvmeof.nvmeof.a' cmd={"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.64:0/1727848942"} : dispatch 2024-03-26T17:02:46.615 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:46 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 2024-03-26T17:02:46.214+0000 7fa707a55700 -1 mon.c@1(peon) e3 get_health_metrics reporting 3 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T17:02:46.896 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:46 smithi149 ceph-mon[34678]: from='client.? 172.21.15.44:0/3241788124' entity='client.nvmeof.nvmeof.a' cmd='[{"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.64:0/1727848942"}]': finished 2024-03-26T17:02:46.896 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:46 smithi149 ceph-mon[34678]: osdmap e67: 8 total, 8 up, 8 in 2024-03-26T17:02:46.896 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:46 smithi149 ceph-mon[34678]: from='client.? 172.21.15.44:0/3241788124' entity='client.nvmeof.nvmeof.a' cmd={"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.64:0/1727848942"} : dispatch 2024-03-26T17:02:46.896 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:46 smithi149 ceph-mon[34678]: pgmap v491: 33 pgs: 33 active+clean; 1015 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 129 KiB/s rd, 89 KiB/s wr, 29 op/s 2024-03-26T17:02:46.916 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:46 smithi044 ceph-mon[30624]: from='client.? 172.21.15.44:0/3241788124' entity='client.nvmeof.nvmeof.a' cmd='[{"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.64:0/1727848942"}]': finished 2024-03-26T17:02:46.916 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:46 smithi044 ceph-mon[30624]: osdmap e67: 8 total, 8 up, 8 in 2024-03-26T17:02:46.916 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:46 smithi044 ceph-mon[30624]: from='client.? 172.21.15.44:0/3241788124' entity='client.nvmeof.nvmeof.a' cmd={"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.64:0/1727848942"} : dispatch 2024-03-26T17:02:46.916 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:46 smithi044 ceph-mon[30624]: pgmap v491: 33 pgs: 33 active+clean; 1015 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 129 KiB/s rd, 89 KiB/s wr, 29 op/s 2024-03-26T17:02:46.916 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:02:46 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:02:46] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:02:46.916 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:02:46 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:02:46] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:02:46.917 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:02:46 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:02:47.055 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:46 smithi064 ceph-mon[34420]: from='client.? 172.21.15.44:0/3241788124' entity='client.nvmeof.nvmeof.a' cmd='[{"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.64:0/1727848942"}]': finished 2024-03-26T17:02:47.055 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:46 smithi064 ceph-mon[34420]: osdmap e67: 8 total, 8 up, 8 in 2024-03-26T17:02:47.056 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:46 smithi064 ceph-mon[34420]: from='client.? 172.21.15.44:0/3241788124' entity='client.nvmeof.nvmeof.a' cmd={"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.64:0/1727848942"} : dispatch 2024-03-26T17:02:47.056 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:46 smithi064 ceph-mon[34420]: pgmap v491: 33 pgs: 33 active+clean; 1015 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 129 KiB/s rd, 89 KiB/s wr, 29 op/s 2024-03-26T17:02:47.396 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:02:46 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:02:46] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:02:47.396 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:02:46 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:02:46] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:02:47.397 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:02:46 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:02:47.896 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:47 smithi149 ceph-mon[34678]: from='client.? 172.21.15.44:0/3241788124' entity='client.nvmeof.nvmeof.a' cmd='[{"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.64:0/1727848942"}]': finished 2024-03-26T17:02:47.896 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:47 smithi149 ceph-mon[34678]: osdmap e68: 8 total, 8 up, 8 in 2024-03-26T17:02:47.896 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:47 smithi149 ceph-mon[34678]: from='client.? 172.21.15.44:0/3241788124' entity='client.nvmeof.nvmeof.a' cmd={"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.64:0/1727848942"} : dispatch 2024-03-26T17:02:48.015 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:47 smithi044 ceph-mon[30624]: from='client.? 172.21.15.44:0/3241788124' entity='client.nvmeof.nvmeof.a' cmd='[{"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.64:0/1727848942"}]': finished 2024-03-26T17:02:48.015 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:47 smithi044 ceph-mon[30624]: osdmap e68: 8 total, 8 up, 8 in 2024-03-26T17:02:48.015 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:47 smithi044 ceph-mon[30624]: from='client.? 172.21.15.44:0/3241788124' entity='client.nvmeof.nvmeof.a' cmd={"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.64:0/1727848942"} : dispatch 2024-03-26T17:02:48.056 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:47 smithi064 ceph-mon[34420]: from='client.? 172.21.15.44:0/3241788124' entity='client.nvmeof.nvmeof.a' cmd='[{"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.64:0/1727848942"}]': finished 2024-03-26T17:02:48.056 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:47 smithi064 ceph-mon[34420]: osdmap e68: 8 total, 8 up, 8 in 2024-03-26T17:02:48.056 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:47 smithi064 ceph-mon[34420]: from='client.? 172.21.15.44:0/3241788124' entity='client.nvmeof.nvmeof.a' cmd={"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.64:0/1727848942"} : dispatch 2024-03-26T17:02:48.145 INFO:tasks.workunit.client.3.smithi157.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-26T17:02:48.145 INFO:tasks.workunit.client.3.smithi157.stdout:myimage2 0/s 0/s 5.6 KiB/s 0 B/s 276.97 us 0.00 ns 2024-03-26T17:02:48.145 INFO:tasks.workunit.client.3.smithi157.stdout:myimage3 0/s 0/s 819 B/s 0 B/s 188.52 us 0.00 ns 2024-03-26T17:02:48.145 INFO:tasks.workunit.client.3.smithi157.stdout:myimage14 0/s 0/s 6.4 KiB/s 0 B/s 256.82 us 0.00 ns 2024-03-26T17:02:48.146 INFO:tasks.workunit.client.3.smithi157.stdout:myimage22 0/s 0/s 819 B/s 0 B/s 555.45 us 0.00 ns 2024-03-26T17:02:48.146 INFO:tasks.workunit.client.3.smithi157.stdout:myimage23 0/s 0/s 6.4 KiB/s 0 B/s 215.79 us 0.00 ns 2024-03-26T17:02:48.146 INFO:tasks.workunit.client.3.smithi157.stdout:myimage30 0/s 0/s 2.4 KiB/s 0 B/s 264.61 us 0.00 ns 2024-03-26T17:02:48.146 INFO:tasks.workunit.client.3.smithi157.stdout:myimage32 0/s 0/s 819 B/s 0 B/s 229.42 us 0.00 ns 2024-03-26T17:02:48.146 INFO:tasks.workunit.client.3.smithi157.stdout:myimage49 0/s 0/s 6.4 KiB/s 0 B/s 340.37 us 0.00 ns 2024-03-26T17:02:48.146 INFO:tasks.workunit.client.3.smithi157.stdout:myimage5 0/s 0/s 3.2 KiB/s 0 B/s 244.07 us 0.00 ns 2024-03-26T17:02:48.146 INFO:tasks.workunit.client.3.smithi157.stdout:myimage18 0/s 0/s 8.8 KiB/s 0 B/s 246.17 us 0.00 ns 2024-03-26T17:02:48.146 INFO:tasks.workunit.client.3.smithi157.stdout:myimage19 0/s 0/s 3.2 KiB/s 0 B/s 363.35 us 0.00 ns 2024-03-26T17:02:48.146 INFO:tasks.workunit.client.3.smithi157.stdout:myimage20 0/s 0/s 819 B/s 0 B/s 230.61 us 0.00 ns 2024-03-26T17:02:48.146 INFO:tasks.workunit.client.3.smithi157.stdout:myimage21 0/s 0/s 4 KiB/s 0 B/s 245.04 us 0.00 ns 2024-03-26T17:02:48.146 INFO:tasks.workunit.client.3.smithi157.stdout:myimage24 0/s 0/s 5.6 KiB/s 0 B/s 277.47 us 0.00 ns 2024-03-26T17:02:48.146 INFO:tasks.workunit.client.3.smithi157.stdout:myimage43 0/s 0/s 3.2 KiB/s 0 B/s 355.04 us 0.00 ns 2024-03-26T17:02:48.146 INFO:tasks.workunit.client.3.smithi157.stdout:myimage56 0/s 0/s 7.2 KiB/s 0 B/s 243.96 us 0.00 ns 2024-03-26T17:02:48.147 INFO:tasks.workunit.client.3.smithi157.stdout:myimage57 0/s 0/s 2.4 KiB/s 0 B/s 261.76 us 0.00 ns 2024-03-26T17:02:48.147 INFO:tasks.workunit.client.3.smithi157.stdout:myimage60 0/s 0/s 2.4 KiB/s 0 B/s 290.25 us 0.00 ns 2024-03-26T17:02:48.147 INFO:tasks.workunit.client.3.smithi157.stdout:myimage10 0/s 0/s 4 KiB/s 0 B/s 205.05 us 0.00 ns 2024-03-26T17:02:48.147 INFO:tasks.workunit.client.3.smithi157.stdout:myimage59 0/s 0/s 1.6 KiB/s 0 B/s 309.44 us 0.00 ns 2024-03-26T17:02:48.147 INFO:tasks.workunit.client.3.smithi157.stdout:myimage13 0/s 0/s 0 B/s 3.2 KiB/s 0.00 ns 28.02 us 2024-03-26T17:02:48.147 INFO:tasks.workunit.client.3.smithi157.stdout:myimage34 0/s 0/s 0 B/s 4.8 KiB/s 0.00 ns 29.01 us 2024-03-26T17:02:48.147 INFO:tasks.workunit.client.3.smithi157.stdout:myimage35 0/s 0/s 0 B/s 3.2 KiB/s 0.00 ns 31.02 us 2024-03-26T17:02:48.147 INFO:tasks.workunit.client.3.smithi157.stdout:myimage40 0/s 0/s 0 B/s 819 B/s 0.00 ns 42.21 us 2024-03-26T17:02:48.147 INFO:tasks.workunit.client.3.smithi157.stdout:myimage47 0/s 0/s 0 B/s 1.6 KiB/s 0.00 ns 40.17 us 2024-03-26T17:02:48.147 INFO:tasks.workunit.client.3.smithi157.stdout:myimage58 0/s 0/s 0 B/s 5.6 KiB/s 0.00 ns 27.21 us 2024-03-26T17:02:48.147 INFO:tasks.workunit.client.3.smithi157.stdout:myimage1 0/s 0/s 0 B/s 2.4 KiB/s 0.00 ns 30.80 us 2024-03-26T17:02:48.147 INFO:tasks.workunit.client.3.smithi157.stdout:myimage6 0/s 0/s 0 B/s 3.2 KiB/s 0.00 ns 35.86 us 2024-03-26T17:02:48.147 INFO:tasks.workunit.client.3.smithi157.stdout:myimage11 0/s 0/s 0 B/s 1.6 KiB/s 0.00 ns 36.53 us 2024-03-26T17:02:48.147 INFO:tasks.workunit.client.3.smithi157.stdout:myimage12 0/s 0/s 0 B/s 6.4 KiB/s 0.00 ns 25.04 us 2024-03-26T17:02:48.147 INFO:tasks.workunit.client.3.smithi157.stdout:myimage29 0/s 0/s 0 B/s 4 KiB/s 0.00 ns 30.43 us 2024-03-26T17:02:48.148 INFO:tasks.workunit.client.3.smithi157.stdout:myimage36 0/s 0/s 0 B/s 1.6 KiB/s 0.00 ns 32.13 us 2024-03-26T17:02:48.148 INFO:tasks.workunit.client.3.smithi157.stdout:myimage39 0/s 0/s 0 B/s 819 B/s 0.00 ns 28.76 us 2024-03-26T17:02:48.148 INFO:tasks.workunit.client.3.smithi157.stdout:myimage42 0/s 0/s 0 B/s 4 KiB/s 0.00 ns 44.55 us 2024-03-26T17:02:48.148 INFO:tasks.workunit.client.3.smithi157.stdout:myimage53 0/s 0/s 0 B/s 1 B/s 0.00 ns 42.88 us 2024-03-26T17:02:48.148 INFO:tasks.workunit.client.3.smithi157.stdout:myimage55 0/s 0/s 0 B/s 8.8 KiB/s 0.00 ns 28.85 us 2024-03-26T17:02:48.148 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:02:48.896 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:48 smithi149 ceph-mon[34678]: from='client.? 172.21.15.44:0/3241788124' entity='client.nvmeof.nvmeof.a' cmd='[{"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.64:0/1727848942"}]': finished 2024-03-26T17:02:48.896 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:48 smithi149 ceph-mon[34678]: osdmap e69: 8 total, 8 up, 8 in 2024-03-26T17:02:48.896 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:48 smithi149 ceph-mon[34678]: from='client.? 172.21.15.44:0/3241788124' entity='client.nvmeof.nvmeof.a' cmd={"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.64:0/1727848942"} : dispatch 2024-03-26T17:02:48.896 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:48 smithi149 ceph-mon[34678]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:02:48.896 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:48 smithi149 ceph-mon[34678]: { 2024-03-26T17:02:48.896 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:48 smithi149 ceph-mon[34678]: "prefix": "rbd perf image stats", 2024-03-26T17:02:48.897 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:48 smithi149 ceph-mon[34678]: "pool_spec": "mypool", 2024-03-26T17:02:48.897 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:48 smithi149 ceph-mon[34678]: "sort_by": "write_ops", 2024-03-26T17:02:48.897 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:48 smithi149 ceph-mon[34678]: "format": "json" 2024-03-26T17:02:48.897 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:48 smithi149 ceph-mon[34678]: }"]: dispatch 2024-03-26T17:02:48.897 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:48 smithi149 ceph-mon[34678]: pgmap v494: 33 pgs: 33 active+clean; 1015 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 36 KiB/s rd, 69 KiB/s wr, 24 op/s 2024-03-26T17:02:48.897 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:48 smithi149 ceph-mon[34678]: Health check update: 3 slow ops, oldest one blocked for 263 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:02:48.917 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:48 smithi044 ceph-mon[30624]: from='client.? 172.21.15.44:0/3241788124' entity='client.nvmeof.nvmeof.a' cmd='[{"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.64:0/1727848942"}]': finished 2024-03-26T17:02:48.917 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:48 smithi044 ceph-mon[30624]: osdmap e69: 8 total, 8 up, 8 in 2024-03-26T17:02:48.917 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:48 smithi044 ceph-mon[30624]: from='client.? 172.21.15.44:0/3241788124' entity='client.nvmeof.nvmeof.a' cmd={"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.64:0/1727848942"} : dispatch 2024-03-26T17:02:48.917 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:48 smithi044 ceph-mon[30624]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:02:48.917 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:48 smithi044 ceph-mon[30624]: { 2024-03-26T17:02:48.917 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:48 smithi044 ceph-mon[30624]: "prefix": "rbd perf image stats", 2024-03-26T17:02:48.917 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:48 smithi044 ceph-mon[30624]: "pool_spec": "mypool", 2024-03-26T17:02:48.917 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:48 smithi044 ceph-mon[30624]: "sort_by": "write_ops", 2024-03-26T17:02:48.918 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:48 smithi044 ceph-mon[30624]: "format": "json" 2024-03-26T17:02:48.918 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:48 smithi044 ceph-mon[30624]: }"]: dispatch 2024-03-26T17:02:48.918 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:48 smithi044 ceph-mon[30624]: pgmap v494: 33 pgs: 33 active+clean; 1015 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 36 KiB/s rd, 69 KiB/s wr, 24 op/s 2024-03-26T17:02:48.918 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:48 smithi044 ceph-mon[30624]: Health check update: 3 slow ops, oldest one blocked for 263 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:02:48.918 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:02:48 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:02:48] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:02:48.918 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:02:48 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:02:48] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:02:48.919 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:02:48 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:02:49.055 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:48 smithi064 ceph-mon[34420]: from='client.? 172.21.15.44:0/3241788124' entity='client.nvmeof.nvmeof.a' cmd='[{"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.64:0/1727848942"}]': finished 2024-03-26T17:02:49.056 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:48 smithi064 ceph-mon[34420]: osdmap e69: 8 total, 8 up, 8 in 2024-03-26T17:02:49.056 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:48 smithi064 ceph-mon[34420]: from='client.? 172.21.15.44:0/3241788124' entity='client.nvmeof.nvmeof.a' cmd={"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.64:0/1727848942"} : dispatch 2024-03-26T17:02:49.056 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:48 smithi064 ceph-mon[34420]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:02:49.056 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:48 smithi064 ceph-mon[34420]: { 2024-03-26T17:02:49.056 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:48 smithi064 ceph-mon[34420]: "prefix": "rbd perf image stats", 2024-03-26T17:02:49.056 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:48 smithi064 ceph-mon[34420]: "pool_spec": "mypool", 2024-03-26T17:02:49.056 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:48 smithi064 ceph-mon[34420]: "sort_by": "write_ops", 2024-03-26T17:02:49.056 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:48 smithi064 ceph-mon[34420]: "format": "json" 2024-03-26T17:02:49.056 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:48 smithi064 ceph-mon[34420]: }"]: dispatch 2024-03-26T17:02:49.056 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:48 smithi064 ceph-mon[34420]: pgmap v494: 33 pgs: 33 active+clean; 1015 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 36 KiB/s rd, 69 KiB/s wr, 24 op/s 2024-03-26T17:02:49.056 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:48 smithi064 ceph-mon[34420]: Health check update: 3 slow ops, oldest one blocked for 263 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:02:49.396 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:02:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:02:48] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:02:49.396 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:02:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:02:48] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:02:49.396 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:02:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:02:49.896 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:49 smithi149 ceph-mon[34678]: from='client.? 172.21.15.44:0/3241788124' entity='client.nvmeof.nvmeof.a' cmd='[{"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.64:0/1727848942"}]': finished 2024-03-26T17:02:49.896 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:49 smithi149 ceph-mon[34678]: osdmap e70: 8 total, 8 up, 8 in 2024-03-26T17:02:49.896 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:49 smithi149 ceph-mon[34678]: from='client.? 172.21.15.44:0/3241788124' entity='client.nvmeof.nvmeof.a' cmd={"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.64:0/1727848942"} : dispatch 2024-03-26T17:02:50.015 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:49 smithi044 ceph-mon[30624]: from='client.? 172.21.15.44:0/3241788124' entity='client.nvmeof.nvmeof.a' cmd='[{"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.64:0/1727848942"}]': finished 2024-03-26T17:02:50.015 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:49 smithi044 ceph-mon[30624]: osdmap e70: 8 total, 8 up, 8 in 2024-03-26T17:02:50.015 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:49 smithi044 ceph-mon[30624]: from='client.? 172.21.15.44:0/3241788124' entity='client.nvmeof.nvmeof.a' cmd={"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.64:0/1727848942"} : dispatch 2024-03-26T17:02:50.055 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:49 smithi064 ceph-mon[34420]: from='client.? 172.21.15.44:0/3241788124' entity='client.nvmeof.nvmeof.a' cmd='[{"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.64:0/1727848942"}]': finished 2024-03-26T17:02:50.056 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:49 smithi064 ceph-mon[34420]: osdmap e70: 8 total, 8 up, 8 in 2024-03-26T17:02:50.056 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:49 smithi064 ceph-mon[34420]: from='client.? 172.21.15.44:0/3241788124' entity='client.nvmeof.nvmeof.a' cmd={"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.64:0/1727848942"} : dispatch 2024-03-26T17:02:50.896 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:50 smithi149 ceph-mon[34678]: from='client.? 172.21.15.44:0/3241788124' entity='client.nvmeof.nvmeof.a' cmd='[{"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.64:0/1727848942"}]': finished 2024-03-26T17:02:50.896 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:50 smithi149 ceph-mon[34678]: osdmap e71: 8 total, 8 up, 8 in 2024-03-26T17:02:50.896 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:50 smithi149 ceph-mon[34678]: from='client.? 172.21.15.44:0/3241788124' entity='client.nvmeof.nvmeof.a' cmd={"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.64:0/1727848942"} : dispatch 2024-03-26T17:02:50.896 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:50 smithi149 ceph-mon[34678]: pgmap v497: 33 pgs: 33 active+clean; 1015 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 88 KiB/s rd, 82 KiB/s wr, 33 op/s 2024-03-26T17:02:50.916 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:50 smithi044 ceph-mon[30624]: from='client.? 172.21.15.44:0/3241788124' entity='client.nvmeof.nvmeof.a' cmd='[{"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.64:0/1727848942"}]': finished 2024-03-26T17:02:50.917 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:50 smithi044 ceph-mon[30624]: osdmap e71: 8 total, 8 up, 8 in 2024-03-26T17:02:50.917 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:50 smithi044 ceph-mon[30624]: from='client.? 172.21.15.44:0/3241788124' entity='client.nvmeof.nvmeof.a' cmd={"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.64:0/1727848942"} : dispatch 2024-03-26T17:02:50.917 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:50 smithi044 ceph-mon[30624]: pgmap v497: 33 pgs: 33 active+clean; 1015 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 88 KiB/s rd, 82 KiB/s wr, 33 op/s 2024-03-26T17:02:50.917 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:02:50 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:02:50] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:02:50.917 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:02:50 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:02:50] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:02:50.917 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:02:50 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:02:51.055 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:50 smithi064 ceph-mon[34420]: from='client.? 172.21.15.44:0/3241788124' entity='client.nvmeof.nvmeof.a' cmd='[{"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.64:0/1727848942"}]': finished 2024-03-26T17:02:51.055 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:50 smithi064 ceph-mon[34420]: osdmap e71: 8 total, 8 up, 8 in 2024-03-26T17:02:51.056 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:50 smithi064 ceph-mon[34420]: from='client.? 172.21.15.44:0/3241788124' entity='client.nvmeof.nvmeof.a' cmd={"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.64:0/1727848942"} : dispatch 2024-03-26T17:02:51.056 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:50 smithi064 ceph-mon[34420]: pgmap v497: 33 pgs: 33 active+clean; 1015 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 88 KiB/s rd, 82 KiB/s wr, 33 op/s 2024-03-26T17:02:51.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:51 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 2024-03-26T17:02:51.213+0000 7fa707a55700 -1 mon.c@1(peon) e3 get_health_metrics reporting 3 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T17:02:51.397 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:02:51 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:02:51] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:02:51.397 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:02:51 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:02:51] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:02:51.397 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:02:51 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:02:52.015 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:51 smithi044 ceph-mon[30624]: from='client.? 172.21.15.44:0/3241788124' entity='client.nvmeof.nvmeof.a' cmd='[{"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.64:0/1727848942"}]': finished 2024-03-26T17:02:52.015 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:51 smithi044 ceph-mon[30624]: osdmap e72: 8 total, 8 up, 8 in 2024-03-26T17:02:52.015 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:51 smithi044 ceph-mon[30624]: from='client.? 172.21.15.44:0/3241788124' entity='client.nvmeof.nvmeof.a' cmd={"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.64:0/1727848942"} : dispatch 2024-03-26T17:02:52.055 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:51 smithi064 ceph-mon[34420]: from='client.? 172.21.15.44:0/3241788124' entity='client.nvmeof.nvmeof.a' cmd='[{"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.64:0/1727848942"}]': finished 2024-03-26T17:02:52.055 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:51 smithi064 ceph-mon[34420]: osdmap e72: 8 total, 8 up, 8 in 2024-03-26T17:02:52.055 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:51 smithi064 ceph-mon[34420]: from='client.? 172.21.15.44:0/3241788124' entity='client.nvmeof.nvmeof.a' cmd={"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.64:0/1727848942"} : dispatch 2024-03-26T17:02:52.146 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:51 smithi149 ceph-mon[34678]: from='client.? 172.21.15.44:0/3241788124' entity='client.nvmeof.nvmeof.a' cmd='[{"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.64:0/1727848942"}]': finished 2024-03-26T17:02:52.146 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:51 smithi149 ceph-mon[34678]: osdmap e72: 8 total, 8 up, 8 in 2024-03-26T17:02:52.146 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:51 smithi149 ceph-mon[34678]: from='client.? 172.21.15.44:0/3241788124' entity='client.nvmeof.nvmeof.a' cmd={"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.64:0/1727848942"} : dispatch 2024-03-26T17:02:52.917 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:52 smithi044 ceph-mon[30624]: from='client.? 172.21.15.44:0/3241788124' entity='client.nvmeof.nvmeof.a' cmd='[{"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.64:0/1727848942"}]': finished 2024-03-26T17:02:52.917 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:52 smithi044 ceph-mon[30624]: osdmap e73: 8 total, 8 up, 8 in 2024-03-26T17:02:52.917 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:52 smithi044 ceph-mon[30624]: from='client.? 172.21.15.44:0/3241788124' entity='client.nvmeof.nvmeof.a' cmd={"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.64:0/1727848942"} : dispatch 2024-03-26T17:02:52.917 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:52 smithi044 ceph-mon[30624]: pgmap v500: 33 pgs: 33 active+clean; 1015 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 80 KiB/s rd, 72 KiB/s wr, 19 op/s 2024-03-26T17:02:52.917 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:02:52 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:02:52] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:02:52.918 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:02:52 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:02:52] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:02:52.918 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:02:52 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:02:53.013 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:52 smithi149 ceph-mon[34678]: from='client.? 172.21.15.44:0/3241788124' entity='client.nvmeof.nvmeof.a' cmd='[{"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.64:0/1727848942"}]': finished 2024-03-26T17:02:53.013 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:52 smithi149 ceph-mon[34678]: osdmap e73: 8 total, 8 up, 8 in 2024-03-26T17:02:53.013 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:52 smithi149 ceph-mon[34678]: from='client.? 172.21.15.44:0/3241788124' entity='client.nvmeof.nvmeof.a' cmd={"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.64:0/1727848942"} : dispatch 2024-03-26T17:02:53.013 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:52 smithi149 ceph-mon[34678]: pgmap v500: 33 pgs: 33 active+clean; 1015 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 80 KiB/s rd, 72 KiB/s wr, 19 op/s 2024-03-26T17:02:53.055 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:52 smithi064 ceph-mon[34420]: from='client.? 172.21.15.44:0/3241788124' entity='client.nvmeof.nvmeof.a' cmd='[{"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.64:0/1727848942"}]': finished 2024-03-26T17:02:53.056 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:52 smithi064 ceph-mon[34420]: osdmap e73: 8 total, 8 up, 8 in 2024-03-26T17:02:53.056 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:52 smithi064 ceph-mon[34420]: from='client.? 172.21.15.44:0/3241788124' entity='client.nvmeof.nvmeof.a' cmd={"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.64:0/1727848942"} : dispatch 2024-03-26T17:02:53.056 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:52 smithi064 ceph-mon[34420]: pgmap v500: 33 pgs: 33 active+clean; 1015 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 80 KiB/s rd, 72 KiB/s wr, 19 op/s 2024-03-26T17:02:53.061 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:02:53.070 INFO:tasks.workunit.client.3.smithi157.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2024-03-26T17:02:53.071 INFO:tasks.workunit.client.3.smithi157.stdout: 0.10 3.6k 0.0k 0.0k 36.0k 0.0k 0.0k nvme2n1 2024-03-26T17:02:53.071 INFO:tasks.workunit.client.3.smithi157.stdout: 0.20 3.6k 2.4k 0.0k 36.0k 24.0k 0.0k nvme2n10 2024-03-26T17:02:53.071 INFO:tasks.workunit.client.3.smithi157.stdout: 0.10 0.0k 2.4k 0.0k 0.0k 24.0k 0.0k nvme2n11 2024-03-26T17:02:53.071 INFO:tasks.workunit.client.3.smithi157.stdout: 0.10 0.8k 0.0k 0.0k 8.0k 0.0k 0.0k nvme2n12 2024-03-26T17:02:53.071 INFO:tasks.workunit.client.3.smithi157.stdout: 0.10 0.0k 0.4k 0.0k 0.0k 4.0k 0.0k nvme2n13 2024-03-26T17:02:53.071 INFO:tasks.workunit.client.3.smithi157.stdout: 0.10 0.0k 4.8k 0.0k 0.0k 48.0k 0.0k nvme2n14 2024-03-26T17:02:53.071 INFO:tasks.workunit.client.3.smithi157.stdout: 0.10 0.0k 1.2k 0.0k 0.0k 12.0k 0.0k nvme2n15 2024-03-26T17:02:53.071 INFO:tasks.workunit.client.3.smithi157.stdout: 0.10 3.6k 0.0k 0.0k 36.0k 0.0k 0.0k nvme2n16 2024-03-26T17:02:53.071 INFO:tasks.workunit.client.3.smithi157.stdout: 0.10 0.8k 0.0k 0.0k 8.0k 0.0k 0.0k nvme2n17 2024-03-26T17:02:53.071 INFO:tasks.workunit.client.3.smithi157.stdout: 0.10 0.0k 3.2k 0.0k 0.0k 32.0k 0.0k nvme2n18 2024-03-26T17:02:53.071 INFO:tasks.workunit.client.3.smithi157.stdout: 0.10 4.8k 0.0k 0.0k 48.0k 0.0k 0.0k nvme2n19 2024-03-26T17:02:53.071 INFO:tasks.workunit.client.3.smithi157.stdout: 0.20 0.0k 3.2k 0.0k 0.0k 32.0k 0.0k nvme2n2 2024-03-26T17:02:53.071 INFO:tasks.workunit.client.3.smithi157.stdout: 0.10 2.4k 0.0k 0.0k 24.0k 0.0k 0.0k nvme2n20 2024-03-26T17:02:53.072 INFO:tasks.workunit.client.3.smithi157.stdout: 0.20 0.0k 1.2k 0.0k 0.0k 12.0k 0.0k nvme2n3 2024-03-26T17:02:53.072 INFO:tasks.workunit.client.3.smithi157.stdout: 0.20 3.6k 0.0k 0.0k 36.0k 0.0k 0.0k nvme2n4 2024-03-26T17:02:53.072 INFO:tasks.workunit.client.3.smithi157.stdout: 0.20 2.0k 1.6k 0.0k 20.0k 16.0k 0.0k nvme2n5 2024-03-26T17:02:53.072 INFO:tasks.workunit.client.3.smithi157.stdout: 0.20 1.6k 0.4k 0.0k 16.0k 4.0k 0.0k nvme2n6 2024-03-26T17:02:53.072 INFO:tasks.workunit.client.3.smithi157.stdout: 0.20 0.0k 1.6k 0.0k 0.0k 16.0k 0.0k nvme2n7 2024-03-26T17:02:53.072 INFO:tasks.workunit.client.3.smithi157.stdout: 0.20 2.0k 2.4k 0.0k 20.0k 24.0k 0.0k nvme2n8 2024-03-26T17:02:53.072 INFO:tasks.workunit.client.3.smithi157.stdout: 0.20 6.4k 0.0k 0.0k 64.0k 0.0k 0.0k nvme2n9 2024-03-26T17:02:53.072 INFO:tasks.workunit.client.3.smithi157.stdout: 0.10 0.0k 3.2k 0.0k 0.0k 32.0k 0.0k nvme5n1 2024-03-26T17:02:53.072 INFO:tasks.workunit.client.3.smithi157.stdout: 0.20 1.6k 0.8k 0.0k 16.0k 8.0k 0.0k nvme5n10 2024-03-26T17:02:53.072 INFO:tasks.workunit.client.3.smithi157.stdout: 0.20 4.4k 0.8k 0.0k 44.0k 8.0k 0.0k nvme5n11 2024-03-26T17:02:53.072 INFO:tasks.workunit.client.3.smithi157.stdout: 0.10 0.0k 2.4k 0.0k 0.0k 24.0k 0.0k nvme5n12 2024-03-26T17:02:53.072 INFO:tasks.workunit.client.3.smithi157.stdout: 0.10 0.0k 4.4k 0.0k 0.0k 44.0k 0.0k nvme5n13 2024-03-26T17:02:53.072 INFO:tasks.workunit.client.3.smithi157.stdout: 0.10 2.4k 0.0k 0.0k 24.0k 0.0k 0.0k nvme5n14 2024-03-26T17:02:53.072 INFO:tasks.workunit.client.3.smithi157.stdout: 0.10 0.0k 1.2k 0.0k 0.0k 12.0k 0.0k nvme5n15 2024-03-26T17:02:53.073 INFO:tasks.workunit.client.3.smithi157.stdout: 0.10 0.0k 1.2k 0.0k 0.0k 12.0k 0.0k nvme5n16 2024-03-26T17:02:53.073 INFO:tasks.workunit.client.3.smithi157.stdout: 0.10 0.0k 2.0k 0.0k 0.0k 20.0k 0.0k nvme5n17 2024-03-26T17:02:53.073 INFO:tasks.workunit.client.3.smithi157.stdout: 0.10 0.0k 2.0k 0.0k 0.0k 20.0k 0.0k nvme5n18 2024-03-26T17:02:53.073 INFO:tasks.workunit.client.3.smithi157.stdout: 0.10 0.4k 0.0k 0.0k 4.0k 0.0k 0.0k nvme5n19 2024-03-26T17:02:53.073 INFO:tasks.workunit.client.3.smithi157.stdout: 0.10 0.0k 1.2k 0.0k 0.0k 12.0k 0.0k nvme5n2 2024-03-26T17:02:53.073 INFO:tasks.workunit.client.3.smithi157.stdout: 0.10 0.0k 0.4k 0.0k 0.0k 4.0k 0.0k nvme5n20 2024-03-26T17:02:53.073 INFO:tasks.workunit.client.3.smithi157.stdout: 0.20 0.8k 3.2k 0.0k 8.0k 32.0k 0.0k nvme5n3 2024-03-26T17:02:53.073 INFO:tasks.workunit.client.3.smithi157.stdout: 0.20 4.4k 2.8k 0.0k 44.0k 28.0k 0.0k nvme5n4 2024-03-26T17:02:53.073 INFO:tasks.workunit.client.3.smithi157.stdout: 0.20 0.0k 1.6k 0.0k 0.0k 16.0k 0.0k nvme5n5 2024-03-26T17:02:53.073 INFO:tasks.workunit.client.3.smithi157.stdout: 0.20 0.0k 2.0k 0.0k 0.0k 20.0k 0.0k nvme5n6 2024-03-26T17:02:53.073 INFO:tasks.workunit.client.3.smithi157.stdout: 0.20 4.8k 0.0k 0.0k 48.0k 0.0k 0.0k nvme5n7 2024-03-26T17:02:53.073 INFO:tasks.workunit.client.3.smithi157.stdout: 0.20 4.8k 2.4k 0.0k 48.0k 24.0k 0.0k nvme5n8 2024-03-26T17:02:53.073 INFO:tasks.workunit.client.3.smithi157.stdout: 0.20 2.0k 0.0k 0.0k 20.0k 0.0k 0.0k nvme5n9 2024-03-26T17:02:53.073 INFO:tasks.workunit.client.3.smithi157.stdout: 0.10 0.0k 4.4k 0.0k 0.0k 44.0k 0.0k nvme8n1 2024-03-26T17:02:53.074 INFO:tasks.workunit.client.3.smithi157.stdout: 0.20 4.8k 2.0k 0.0k 48.0k 20.0k 0.0k nvme8n10 2024-03-26T17:02:53.074 INFO:tasks.workunit.client.3.smithi157.stdout: 0.10 0.0k 3.2k 0.0k 0.0k 32.0k 0.0k nvme8n11 2024-03-26T17:02:53.074 INFO:tasks.workunit.client.3.smithi157.stdout: 0.10 0.0k 0.8k 0.0k 0.0k 8.0k 0.0k nvme8n12 2024-03-26T17:02:53.074 INFO:tasks.workunit.client.3.smithi157.stdout: 0.10 0.0k 0.4k 0.0k 0.0k 4.0k 0.0k nvme8n13 2024-03-26T17:02:53.074 INFO:tasks.workunit.client.3.smithi157.stdout: 0.10 0.0k 5.2k 0.0k 0.0k 52.0k 0.0k nvme8n14 2024-03-26T17:02:53.074 INFO:tasks.workunit.client.3.smithi157.stdout: 0.10 2.0k 0.0k 0.0k 20.0k 0.0k 0.0k nvme8n15 2024-03-26T17:02:53.074 INFO:tasks.workunit.client.3.smithi157.stdout: 0.10 1.2k 0.0k 0.0k 12.0k 0.0k 0.0k nvme8n16 2024-03-26T17:02:53.074 INFO:tasks.workunit.client.3.smithi157.stdout: 0.10 3.6k 0.0k 0.0k 36.0k 0.0k 0.0k nvme8n17 2024-03-26T17:02:53.074 INFO:tasks.workunit.client.3.smithi157.stdout: 0.10 0.0k 4.4k 0.0k 0.0k 44.0k 0.0k nvme8n18 2024-03-26T17:02:53.074 INFO:tasks.workunit.client.3.smithi157.stdout: 0.10 0.4k 0.0k 0.0k 4.0k 0.0k 0.0k nvme8n19 2024-03-26T17:02:53.074 INFO:tasks.workunit.client.3.smithi157.stdout: 0.20 3.2k 0.0k 0.0k 32.0k 0.0k 0.0k nvme8n2 2024-03-26T17:02:53.074 INFO:tasks.workunit.client.3.smithi157.stdout: 0.10 0.0k 2.0k 0.0k 0.0k 20.0k 0.0k nvme8n20 2024-03-26T17:02:53.075 INFO:tasks.workunit.client.3.smithi157.stdout: 0.20 0.4k 1.6k 0.0k 4.0k 16.0k 0.0k nvme8n3 2024-03-26T17:02:53.075 INFO:tasks.workunit.client.3.smithi157.stdout: 0.20 0.0k 4.8k 0.0k 0.0k 48.0k 0.0k nvme8n4 2024-03-26T17:02:53.075 INFO:tasks.workunit.client.3.smithi157.stdout: 0.20 1.2k 3.6k 0.0k 12.0k 36.0k 0.0k nvme8n5 2024-03-26T17:02:53.075 INFO:tasks.workunit.client.3.smithi157.stdout: 0.20 0.0k 8.0k 0.0k 0.0k 80.0k 0.0k nvme8n6 2024-03-26T17:02:53.075 INFO:tasks.workunit.client.3.smithi157.stdout: 0.20 0.8k 1.2k 0.0k 8.0k 12.0k 0.0k nvme8n7 2024-03-26T17:02:53.075 INFO:tasks.workunit.client.3.smithi157.stdout: 0.20 1.6k 0.0k 0.0k 16.0k 0.0k 0.0k nvme8n8 2024-03-26T17:02:53.075 INFO:tasks.workunit.client.3.smithi157.stdout: 0.20 0.0k 2.0k 0.0k 0.0k 20.0k 0.0k nvme8n9 2024-03-26T17:02:53.075 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:02:53.149 INFO:tasks.workunit.client.3.smithi157.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-26T17:02:53.149 INFO:tasks.workunit.client.3.smithi157.stdout:myimage49 0/s 0/s 4 KiB/s 0 B/s 506.31 us 0.00 ns 2024-03-26T17:02:53.149 INFO:tasks.workunit.client.3.smithi157.stdout:myimage2 0/s 0/s 819 B/s 0 B/s 264.39 us 0.00 ns 2024-03-26T17:02:53.149 INFO:tasks.workunit.client.3.smithi157.stdout:myimage13 0/s 0/s 819 B/s 0 B/s 316.14 us 0.00 ns 2024-03-26T17:02:53.149 INFO:tasks.workunit.client.3.smithi157.stdout:myimage30 0/s 0/s 1.6 KiB/s 3.2 KiB/s 266.48 us 29.65 us 2024-03-26T17:02:53.150 INFO:tasks.workunit.client.3.smithi157.stdout:myimage32 0/s 0/s 4.8 KiB/s 0 B/s 279.97 us 0.00 ns 2024-03-26T17:02:53.150 INFO:tasks.workunit.client.3.smithi157.stdout:myimage37 0/s 0/s 4 KiB/s 0 B/s 557.33 us 0.00 ns 2024-03-26T17:02:53.150 INFO:tasks.workunit.client.3.smithi157.stdout:myimage44 0/s 0/s 8.8 KiB/s 0 B/s 335.96 us 0.00 ns 2024-03-26T17:02:53.150 INFO:tasks.workunit.client.3.smithi157.stdout:myimage47 0/s 0/s 2.4 KiB/s 0 B/s 229.23 us 0.00 ns 2024-03-26T17:02:53.150 INFO:tasks.workunit.client.3.smithi157.stdout:myimage52 0/s 0/s 1.6 KiB/s 0 B/s 370.75 us 0.00 ns 2024-03-26T17:02:53.150 INFO:tasks.workunit.client.3.smithi157.stdout:myimage58 0/s 0/s 8.8 KiB/s 0 B/s 320.49 us 0.00 ns 2024-03-26T17:02:53.150 INFO:tasks.workunit.client.3.smithi157.stdout:myimage7 0/s 0/s 1.6 KiB/s 0 B/s 566.32 us 0.00 ns 2024-03-26T17:02:53.150 INFO:tasks.workunit.client.3.smithi157.stdout:myimage8 0/s 0/s 4.8 KiB/s 0 B/s 284.31 us 0.00 ns 2024-03-26T17:02:53.150 INFO:tasks.workunit.client.3.smithi157.stdout:myimage11 0/s 0/s 4.8 KiB/s 0 B/s 242.73 us 0.00 ns 2024-03-26T17:02:53.150 INFO:tasks.workunit.client.3.smithi157.stdout:myimage15 0/s 0/s 2.4 KiB/s 0 B/s 280.77 us 0.00 ns 2024-03-26T17:02:53.150 INFO:tasks.workunit.client.3.smithi157.stdout:myimage25 0/s 0/s 819 B/s 0 B/s 404.23 us 0.00 ns 2024-03-26T17:02:53.150 INFO:tasks.workunit.client.3.smithi157.stdout:myimage26 0/s 0/s 1.6 KiB/s 0 B/s 224.36 us 0.00 ns 2024-03-26T17:02:53.150 INFO:tasks.workunit.client.3.smithi157.stdout:myimage33 0/s 0/s 8.8 KiB/s 0 B/s 283.48 us 0.00 ns 2024-03-26T17:02:53.150 INFO:tasks.workunit.client.3.smithi157.stdout:myimage45 0/s 0/s 7.2 KiB/s 0 B/s 303.54 us 0.00 ns 2024-03-26T17:02:53.151 INFO:tasks.workunit.client.3.smithi157.stdout:myimage46 0/s 0/s 4 KiB/s 0 B/s 359.90 us 0.00 ns 2024-03-26T17:02:53.151 INFO:tasks.workunit.client.3.smithi157.stdout:myimage50 0/s 0/s 4 KiB/s 0 B/s 227.55 us 0.00 ns 2024-03-26T17:02:53.151 INFO:tasks.workunit.client.3.smithi157.stdout:myimage51 0/s 0/s 6.4 KiB/s 0 B/s 310.58 us 0.00 ns 2024-03-26T17:02:53.151 INFO:tasks.workunit.client.3.smithi157.stdout:myimage53 0/s 0/s 819 B/s 0 B/s 341.09 us 0.00 ns 2024-03-26T17:02:53.151 INFO:tasks.workunit.client.3.smithi157.stdout:myimage54 0/s 0/s 10 KiB/s 0 B/s 326.71 us 0.00 ns 2024-03-26T17:02:53.151 INFO:tasks.workunit.client.3.smithi157.stdout:myimage60 0/s 0/s 4 KiB/s 0 B/s 249.62 us 0.00 ns 2024-03-26T17:02:53.151 INFO:tasks.workunit.client.3.smithi157.stdout:myimage10 0/s 0/s 4.8 KiB/s 0 B/s 263.34 us 0.00 ns 2024-03-26T17:02:53.151 INFO:tasks.workunit.client.3.smithi157.stdout:myimage31 0/s 0/s 0 B/s 8.8 KiB/s 0.00 ns 34.93 us 2024-03-26T17:02:53.151 INFO:tasks.workunit.client.3.smithi157.stdout:myimage48 0/s 0/s 0 B/s 819 B/s 0.00 ns 45.35 us 2024-03-26T17:02:53.151 INFO:tasks.workunit.client.3.smithi157.stdout:myimage4 0/s 0/s 0 B/s 7.2 KiB/s 0.00 ns 59.76 us 2024-03-26T17:02:53.151 INFO:tasks.workunit.client.3.smithi157.stdout:myimage9 0/s 0/s 0 B/s 3.2 KiB/s 0.00 ns 32.44 us 2024-03-26T17:02:53.152 INFO:tasks.workunit.client.3.smithi157.stdout:myimage12 0/s 0/s 0 B/s 1.6 KiB/s 0.00 ns 33.14 us 2024-03-26T17:02:53.152 INFO:tasks.workunit.client.3.smithi157.stdout:myimage17 0/s 0/s 0 B/s 1.6 KiB/s 0.00 ns 66.81 us 2024-03-26T17:02:53.152 INFO:tasks.workunit.client.3.smithi157.stdout:myimage27 0/s 0/s 0 B/s 8.8 KiB/s 0.00 ns 35.08 us 2024-03-26T17:02:53.152 INFO:tasks.workunit.client.3.smithi157.stdout:myimage28 0/s 0/s 0 B/s 9.6 KiB/s 0.00 ns 34.59 us 2024-03-26T17:02:53.152 INFO:tasks.workunit.client.3.smithi157.stdout:myimage29 0/s 0/s 0 B/s 819 B/s 0.00 ns 45.75 us 2024-03-26T17:02:53.152 INFO:tasks.workunit.client.3.smithi157.stdout:myimage39 0/s 0/s 0 B/s 819 B/s 0.00 ns 158.10 us 2024-03-26T17:02:53.152 INFO:tasks.workunit.client.3.smithi157.stdout:myimage55 0/s 0/s 0 B/s 4 KiB/s 0.00 ns 36.84 us 2024-03-26T17:02:53.152 INFO:tasks.workunit.client.3.smithi157.stdout:myimage56 0/s 0/s 0 B/s 2.4 KiB/s 0.00 ns 82.74 us 2024-03-26T17:02:53.152 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:02:53.396 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:02:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:02:53] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:02:53.397 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:02:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:02:53] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:02:53.397 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:02:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:02:54.015 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:53 smithi044 ceph-mon[30624]: from='client.? 172.21.15.44:0/3241788124' entity='client.nvmeof.nvmeof.a' cmd='[{"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.64:0/1727848942"}]': finished 2024-03-26T17:02:54.015 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:53 smithi044 ceph-mon[30624]: osdmap e74: 8 total, 8 up, 8 in 2024-03-26T17:02:54.015 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:53 smithi044 ceph-mon[30624]: from='client.? 172.21.15.44:0/3241788124' entity='client.nvmeof.nvmeof.a' cmd={"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.64:0/1727848942"} : dispatch 2024-03-26T17:02:54.016 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:53 smithi044 ceph-mon[30624]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:02:54.016 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:53 smithi044 ceph-mon[30624]: { 2024-03-26T17:02:54.016 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:53 smithi044 ceph-mon[30624]: "prefix": "rbd perf image stats", 2024-03-26T17:02:54.016 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:53 smithi044 ceph-mon[30624]: "pool_spec": "mypool", 2024-03-26T17:02:54.016 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:53 smithi044 ceph-mon[30624]: "sort_by": "write_ops", 2024-03-26T17:02:54.016 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:53 smithi044 ceph-mon[30624]: "format": "json" 2024-03-26T17:02:54.016 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:53 smithi044 ceph-mon[30624]: }"]: dispatch 2024-03-26T17:02:54.016 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:53 smithi044 ceph-mon[30624]: Health check update: 3 slow ops, oldest one blocked for 268 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:02:54.055 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:53 smithi064 ceph-mon[34420]: from='client.? 172.21.15.44:0/3241788124' entity='client.nvmeof.nvmeof.a' cmd='[{"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.64:0/1727848942"}]': finished 2024-03-26T17:02:54.055 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:53 smithi064 ceph-mon[34420]: osdmap e74: 8 total, 8 up, 8 in 2024-03-26T17:02:54.055 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:53 smithi064 ceph-mon[34420]: from='client.? 172.21.15.44:0/3241788124' entity='client.nvmeof.nvmeof.a' cmd={"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.64:0/1727848942"} : dispatch 2024-03-26T17:02:54.055 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:53 smithi064 ceph-mon[34420]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:02:54.056 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:53 smithi064 ceph-mon[34420]: { 2024-03-26T17:02:54.056 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:53 smithi064 ceph-mon[34420]: "prefix": "rbd perf image stats", 2024-03-26T17:02:54.056 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:53 smithi064 ceph-mon[34420]: "pool_spec": "mypool", 2024-03-26T17:02:54.056 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:53 smithi064 ceph-mon[34420]: "sort_by": "write_ops", 2024-03-26T17:02:54.056 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:53 smithi064 ceph-mon[34420]: "format": "json" 2024-03-26T17:02:54.056 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:53 smithi064 ceph-mon[34420]: }"]: dispatch 2024-03-26T17:02:54.056 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:53 smithi064 ceph-mon[34420]: Health check update: 3 slow ops, oldest one blocked for 268 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:02:54.146 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:53 smithi149 ceph-mon[34678]: from='client.? 172.21.15.44:0/3241788124' entity='client.nvmeof.nvmeof.a' cmd='[{"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.64:0/1727848942"}]': finished 2024-03-26T17:02:54.146 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:53 smithi149 ceph-mon[34678]: osdmap e74: 8 total, 8 up, 8 in 2024-03-26T17:02:54.146 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:53 smithi149 ceph-mon[34678]: from='client.? 172.21.15.44:0/3241788124' entity='client.nvmeof.nvmeof.a' cmd={"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.64:0/1727848942"} : dispatch 2024-03-26T17:02:54.146 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:53 smithi149 ceph-mon[34678]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:02:54.147 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:53 smithi149 ceph-mon[34678]: { 2024-03-26T17:02:54.147 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:53 smithi149 ceph-mon[34678]: "prefix": "rbd perf image stats", 2024-03-26T17:02:54.147 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:53 smithi149 ceph-mon[34678]: "pool_spec": "mypool", 2024-03-26T17:02:54.147 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:53 smithi149 ceph-mon[34678]: "sort_by": "write_ops", 2024-03-26T17:02:54.147 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:53 smithi149 ceph-mon[34678]: "format": "json" 2024-03-26T17:02:54.147 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:53 smithi149 ceph-mon[34678]: }"]: dispatch 2024-03-26T17:02:54.147 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:53 smithi149 ceph-mon[34678]: Health check update: 3 slow ops, oldest one blocked for 268 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:02:55.015 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:54 smithi044 ceph-mon[30624]: from='client.? 172.21.15.44:0/3241788124' entity='client.nvmeof.nvmeof.a' cmd='[{"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.64:0/1727848942"}]': finished 2024-03-26T17:02:55.015 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:54 smithi044 ceph-mon[30624]: osdmap e75: 8 total, 8 up, 8 in 2024-03-26T17:02:55.015 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:54 smithi044 ceph-mon[30624]: from='client.? 172.21.15.44:0/3241788124' entity='client.nvmeof.nvmeof.a' cmd={"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.64:0/1727848942"} : dispatch 2024-03-26T17:02:55.015 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:54 smithi044 ceph-mon[30624]: pgmap v503: 33 pgs: 33 active+clean; 1015 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 117 KiB/s rd, 180 KiB/s wr, 39 op/s 2024-03-26T17:02:55.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:02:54 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:02:54] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:02:55.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:02:54 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:02:54] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:02:55.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:02:54 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:02:55.025 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:54 smithi149 ceph-mon[34678]: from='client.? 172.21.15.44:0/3241788124' entity='client.nvmeof.nvmeof.a' cmd='[{"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.64:0/1727848942"}]': finished 2024-03-26T17:02:55.025 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:54 smithi149 ceph-mon[34678]: osdmap e75: 8 total, 8 up, 8 in 2024-03-26T17:02:55.025 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:54 smithi149 ceph-mon[34678]: from='client.? 172.21.15.44:0/3241788124' entity='client.nvmeof.nvmeof.a' cmd={"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.64:0/1727848942"} : dispatch 2024-03-26T17:02:55.025 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:54 smithi149 ceph-mon[34678]: pgmap v503: 33 pgs: 33 active+clean; 1015 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 117 KiB/s rd, 180 KiB/s wr, 39 op/s 2024-03-26T17:02:55.055 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:54 smithi064 ceph-mon[34420]: from='client.? 172.21.15.44:0/3241788124' entity='client.nvmeof.nvmeof.a' cmd='[{"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.64:0/1727848942"}]': finished 2024-03-26T17:02:55.055 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:54 smithi064 ceph-mon[34420]: osdmap e75: 8 total, 8 up, 8 in 2024-03-26T17:02:55.055 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:54 smithi064 ceph-mon[34420]: from='client.? 172.21.15.44:0/3241788124' entity='client.nvmeof.nvmeof.a' cmd={"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.64:0/1727848942"} : dispatch 2024-03-26T17:02:55.055 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:54 smithi064 ceph-mon[34420]: pgmap v503: 33 pgs: 33 active+clean; 1015 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 117 KiB/s rd, 180 KiB/s wr, 39 op/s 2024-03-26T17:02:55.396 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:02:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:02:55] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:02:55.396 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:02:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:02:55] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:02:55.396 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:02:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:02:56.015 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:55 smithi044 ceph-mon[30624]: from='client.? 172.21.15.44:0/3241788124' entity='client.nvmeof.nvmeof.a' cmd='[{"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.64:0/1727848942"}]': finished 2024-03-26T17:02:56.015 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:55 smithi044 ceph-mon[30624]: osdmap e76: 8 total, 8 up, 8 in 2024-03-26T17:02:56.015 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:55 smithi044 ceph-mon[30624]: from='client.? 172.21.15.44:0/3241788124' entity='client.nvmeof.nvmeof.a' cmd={"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.64:0/1727848942"} : dispatch 2024-03-26T17:02:56.055 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:55 smithi064 ceph-mon[34420]: from='client.? 172.21.15.44:0/3241788124' entity='client.nvmeof.nvmeof.a' cmd='[{"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.64:0/1727848942"}]': finished 2024-03-26T17:02:56.055 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:55 smithi064 ceph-mon[34420]: osdmap e76: 8 total, 8 up, 8 in 2024-03-26T17:02:56.055 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:55 smithi064 ceph-mon[34420]: from='client.? 172.21.15.44:0/3241788124' entity='client.nvmeof.nvmeof.a' cmd={"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.64:0/1727848942"} : dispatch 2024-03-26T17:02:56.146 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:55 smithi149 ceph-mon[34678]: from='client.? 172.21.15.44:0/3241788124' entity='client.nvmeof.nvmeof.a' cmd='[{"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.64:0/1727848942"}]': finished 2024-03-26T17:02:56.146 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:55 smithi149 ceph-mon[34678]: osdmap e76: 8 total, 8 up, 8 in 2024-03-26T17:02:56.146 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:55 smithi149 ceph-mon[34678]: from='client.? 172.21.15.44:0/3241788124' entity='client.nvmeof.nvmeof.a' cmd={"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.64:0/1727848942"} : dispatch 2024-03-26T17:02:56.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 2024-03-26T17:02:56.214+0000 7fa707a55700 -1 mon.c@1(peon) e3 get_health_metrics reporting 3 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T17:02:57.015 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:56 smithi044 ceph-mon[30624]: from='client.? 172.21.15.44:0/3241788124' entity='client.nvmeof.nvmeof.a' cmd='[{"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.64:0/1727848942"}]': finished 2024-03-26T17:02:57.015 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:56 smithi044 ceph-mon[30624]: osdmap e77: 8 total, 8 up, 8 in 2024-03-26T17:02:57.015 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:56 smithi044 ceph-mon[30624]: from='client.? 172.21.15.44:0/3241788124' entity='client.nvmeof.nvmeof.a' cmd={"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.64:0/1727848942"} : dispatch 2024-03-26T17:02:57.015 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:56 smithi044 ceph-mon[30624]: pgmap v506: 33 pgs: 33 active+clean; 1015 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 215 KiB/s rd, 230 KiB/s wr, 58 op/s 2024-03-26T17:02:57.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:02:56 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:02:56] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:02:57.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:02:56 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:02:56] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:02:57.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:02:56 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:02:57.037 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:56 smithi149 ceph-mon[34678]: from='client.? 172.21.15.44:0/3241788124' entity='client.nvmeof.nvmeof.a' cmd='[{"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.64:0/1727848942"}]': finished 2024-03-26T17:02:57.037 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:56 smithi149 ceph-mon[34678]: osdmap e77: 8 total, 8 up, 8 in 2024-03-26T17:02:57.037 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:56 smithi149 ceph-mon[34678]: from='client.? 172.21.15.44:0/3241788124' entity='client.nvmeof.nvmeof.a' cmd={"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.64:0/1727848942"} : dispatch 2024-03-26T17:02:57.037 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:56 smithi149 ceph-mon[34678]: pgmap v506: 33 pgs: 33 active+clean; 1015 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 215 KiB/s rd, 230 KiB/s wr, 58 op/s 2024-03-26T17:02:57.055 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:56 smithi064 ceph-mon[34420]: from='client.? 172.21.15.44:0/3241788124' entity='client.nvmeof.nvmeof.a' cmd='[{"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.64:0/1727848942"}]': finished 2024-03-26T17:02:57.055 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:56 smithi064 ceph-mon[34420]: osdmap e77: 8 total, 8 up, 8 in 2024-03-26T17:02:57.055 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:56 smithi064 ceph-mon[34420]: from='client.? 172.21.15.44:0/3241788124' entity='client.nvmeof.nvmeof.a' cmd={"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.64:0/1727848942"} : dispatch 2024-03-26T17:02:57.055 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:56 smithi064 ceph-mon[34420]: pgmap v506: 33 pgs: 33 active+clean; 1015 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 215 KiB/s rd, 230 KiB/s wr, 58 op/s 2024-03-26T17:02:57.396 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:02:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:02:57] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:02:57.397 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:02:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:02:57] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:02:57.397 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:02:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:02:58.015 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:57 smithi044 ceph-mon[30624]: from='client.? 172.21.15.44:0/3241788124' entity='client.nvmeof.nvmeof.a' cmd='[{"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.64:0/1727848942"}]': finished 2024-03-26T17:02:58.015 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:57 smithi044 ceph-mon[30624]: osdmap e78: 8 total, 8 up, 8 in 2024-03-26T17:02:58.015 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:57 smithi044 ceph-mon[30624]: from='client.? 172.21.15.44:0/3241788124' entity='client.nvmeof.nvmeof.a' cmd={"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.64:0/1727848942"} : dispatch 2024-03-26T17:02:58.055 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:57 smithi064 ceph-mon[34420]: from='client.? 172.21.15.44:0/3241788124' entity='client.nvmeof.nvmeof.a' cmd='[{"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.64:0/1727848942"}]': finished 2024-03-26T17:02:58.055 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:57 smithi064 ceph-mon[34420]: osdmap e78: 8 total, 8 up, 8 in 2024-03-26T17:02:58.056 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:57 smithi064 ceph-mon[34420]: from='client.? 172.21.15.44:0/3241788124' entity='client.nvmeof.nvmeof.a' cmd={"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.64:0/1727848942"} : dispatch 2024-03-26T17:02:58.146 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:57 smithi149 ceph-mon[34678]: from='client.? 172.21.15.44:0/3241788124' entity='client.nvmeof.nvmeof.a' cmd='[{"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.64:0/1727848942"}]': finished 2024-03-26T17:02:58.146 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:57 smithi149 ceph-mon[34678]: osdmap e78: 8 total, 8 up, 8 in 2024-03-26T17:02:58.146 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:57 smithi149 ceph-mon[34678]: from='client.? 172.21.15.44:0/3241788124' entity='client.nvmeof.nvmeof.a' cmd={"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.64:0/1727848942"} : dispatch 2024-03-26T17:02:58.153 INFO:tasks.workunit.client.3.smithi157.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-26T17:02:58.153 INFO:tasks.workunit.client.3.smithi157.stdout:myimage3 0/s 0/s 17 KiB/s 0 B/s 826.46 us 0.00 ns 2024-03-26T17:02:58.153 INFO:tasks.workunit.client.3.smithi157.stdout:myimage14 0/s 0/s 19 KiB/s 0 B/s 879.99 us 0.00 ns 2024-03-26T17:02:58.153 INFO:tasks.workunit.client.3.smithi157.stdout:myimage40 0/s 0/s 5.6 KiB/s 0 B/s 713.68 us 0.00 ns 2024-03-26T17:02:58.153 INFO:tasks.workunit.client.3.smithi157.stdout:myimage22 0/s 0/s 9.6 KiB/s 0 B/s 457.64 us 0.00 ns 2024-03-26T17:02:58.153 INFO:tasks.workunit.client.3.smithi157.stdout:myimage31 0/s 0/s 4 KiB/s 0 B/s 517.19 us 0.00 ns 2024-03-26T17:02:58.153 INFO:tasks.workunit.client.3.smithi157.stdout:myimage38 0/s 0/s 12 KiB/s 0 B/s 528.89 us 0.00 ns 2024-03-26T17:02:58.154 INFO:tasks.workunit.client.3.smithi157.stdout:myimage7 0/s 0/s 4 KiB/s 0 B/s 503.99 us 0.00 ns 2024-03-26T17:02:58.154 INFO:tasks.workunit.client.3.smithi157.stdout:myimage25 0/s 0/s 3.2 KiB/s 0 B/s 566.94 us 0.00 ns 2024-03-26T17:02:58.154 INFO:tasks.workunit.client.3.smithi157.stdout:myimage26 0/s 0/s 8 KiB/s 0 B/s 560.16 us 0.00 ns 2024-03-26T17:02:58.154 INFO:tasks.workunit.client.3.smithi157.stdout:myimage28 0/s 0/s 8 KiB/s 0 B/s 625.25 us 0.00 ns 2024-03-26T17:02:58.154 INFO:tasks.workunit.client.3.smithi157.stdout:myimage33 0/s 0/s 7.2 KiB/s 0 B/s 586.40 us 0.00 ns 2024-03-26T17:02:58.154 INFO:tasks.workunit.client.3.smithi157.stdout:myimage36 0/s 0/s 4.8 KiB/s 0 B/s 548.68 us 0.00 ns 2024-03-26T17:02:58.154 INFO:tasks.workunit.client.3.smithi157.stdout:myimage46 0/s 0/s 18 KiB/s 0 B/s 583.98 us 0.00 ns 2024-03-26T17:02:58.154 INFO:tasks.workunit.client.3.smithi157.stdout:myimage16 0/s 0/s 4 KiB/s 7.2 KiB/s 604.58 us 43.61 us 2024-03-26T17:02:58.154 INFO:tasks.workunit.client.3.smithi157.stdout:myimage23 0/s 0/s 1.6 KiB/s 4.8 KiB/s 254.68 us 59.45 us 2024-03-26T17:02:58.154 INFO:tasks.workunit.client.3.smithi157.stdout:myimage32 0/s 0/s 8.8 KiB/s 0 B/s 285.35 us 0.00 ns 2024-03-26T17:02:58.154 INFO:tasks.workunit.client.3.smithi157.stdout:myimage35 0/s 0/s 2.4 KiB/s 6.4 KiB/s 287.16 us 74.26 us 2024-03-26T17:02:58.154 INFO:tasks.workunit.client.3.smithi157.stdout:myimage44 0/s 0/s 819 B/s 4.8 KiB/s 240.28 us 62.98 us 2024-03-26T17:02:58.155 INFO:tasks.workunit.client.3.smithi157.stdout:myimage47 0/s 0/s 819 B/s 0 B/s 223.73 us 0.00 ns 2024-03-26T17:02:58.155 INFO:tasks.workunit.client.3.smithi157.stdout:myimage52 0/s 0/s 2.4 KiB/s 0 B/s 261.00 us 0.00 ns 2024-03-26T17:02:58.155 INFO:tasks.workunit.client.3.smithi157.stdout:myimage58 0/s 0/s 1.6 KiB/s 3.2 KiB/s 224.21 us 26.68 us 2024-03-26T17:02:58.155 INFO:tasks.workunit.client.3.smithi157.stdout:myimage6 0/s 0/s 819 B/s 0 B/s 212.56 us 0.00 ns 2024-03-26T17:02:58.155 INFO:tasks.workunit.client.3.smithi157.stdout:myimage8 0/s 0/s 3.2 KiB/s 4 KiB/s 230.39 us 34.54 us 2024-03-26T17:02:58.155 INFO:tasks.workunit.client.3.smithi157.stdout:myimage9 0/s 0/s 4 KiB/s 9.6 KiB/s 258.77 us 46.65 us 2024-03-26T17:02:58.155 INFO:tasks.workunit.client.3.smithi157.stdout:myimage12 0/s 0/s 819 B/s 2.4 KiB/s 246.29 us 36.93 us 2024-03-26T17:02:58.155 INFO:tasks.workunit.client.3.smithi157.stdout:myimage17 0/s 0/s 3.2 KiB/s 0 B/s 275.96 us 0.00 ns 2024-03-26T17:02:58.155 INFO:tasks.workunit.client.3.smithi157.stdout:myimage18 0/s 0/s 6.4 KiB/s 0 B/s 226.43 us 0.00 ns 2024-03-26T17:02:58.155 INFO:tasks.workunit.client.3.smithi157.stdout:myimage19 0/s 0/s 819 B/s 9.6 KiB/s 229.13 us 31.76 us 2024-03-26T17:02:58.155 INFO:tasks.workunit.client.3.smithi157.stdout:myimage21 0/s 0/s 6.4 KiB/s 819 B/s 307.73 us 42.05 us 2024-03-26T17:02:58.155 INFO:tasks.workunit.client.3.smithi157.stdout:myimage39 0/s 0/s 1.6 KiB/s 819 B/s 397.76 us 41.48 us 2024-03-26T17:02:58.155 INFO:tasks.workunit.client.3.smithi157.stdout:myimage41 0/s 0/s 8.8 KiB/s 1.6 KiB/s 385.19 us 28.71 us 2024-03-26T17:02:58.156 INFO:tasks.workunit.client.3.smithi157.stdout:myimage50 0/s 0/s 8.8 KiB/s 9.6 KiB/s 301.85 us 25.53 us 2024-03-26T17:02:58.156 INFO:tasks.workunit.client.3.smithi157.stdout:myimage51 0/s 0/s 2.4 KiB/s 12 KiB/s 287.84 us 32.84 us 2024-03-26T17:02:58.156 INFO:tasks.workunit.client.3.smithi157.stdout:myimage54 0/s 0/s 4 KiB/s 3.2 KiB/s 227.13 us 44.47 us 2024-03-26T17:02:58.156 INFO:tasks.workunit.client.3.smithi157.stdout:myimage56 0/s 0/s 4 KiB/s 0 B/s 274.36 us 0.00 ns 2024-03-26T17:02:58.156 INFO:tasks.workunit.client.3.smithi157.stdout:myimage57 0/s 0/s 1.6 KiB/s 7.2 KiB/s 236.22 us 56.23 us 2024-03-26T17:02:58.156 INFO:tasks.workunit.client.3.smithi157.stdout:myimage10 0/s 0/s 819 B/s 7.2 KiB/s 231.48 us 130.46 us 2024-03-26T17:02:58.156 INFO:tasks.workunit.client.3.smithi157.stdout:myimage13 0/s 0/s 0 B/s 9.6 KiB/s 0.00 ns 73.30 us 2024-03-26T17:02:58.156 INFO:tasks.workunit.client.3.smithi157.stdout:myimage30 0/s 0/s 0 B/s 5.6 KiB/s 0.00 ns 56.18 us 2024-03-26T17:02:58.156 INFO:tasks.workunit.client.3.smithi157.stdout:myimage34 0/s 0/s 0 B/s 7.2 KiB/s 0.00 ns 64.76 us 2024-03-26T17:02:58.156 INFO:tasks.workunit.client.3.smithi157.stdout:myimage37 0/s 0/s 0 B/s 7.2 KiB/s 0.00 ns 35.30 us 2024-03-26T17:02:58.156 INFO:tasks.workunit.client.3.smithi157.stdout:myimage48 0/s 0/s 0 B/s 11 KiB/s 0.00 ns 85.77 us 2024-03-26T17:02:58.156 INFO:tasks.workunit.client.3.smithi157.stdout:myimage49 0/s 0/s 0 B/s 5.6 KiB/s 0.00 ns 38.01 us 2024-03-26T17:02:58.156 INFO:tasks.workunit.client.3.smithi157.stdout:myimage1 0/s 0/s 0 B/s 11 KiB/s 0.00 ns 64.65 us 2024-03-26T17:02:58.156 INFO:tasks.workunit.client.3.smithi157.stdout:myimage4 0/s 0/s 0 B/s 2.4 KiB/s 0.00 ns 45.34 us 2024-03-26T17:02:58.156 INFO:tasks.workunit.client.3.smithi157.stdout:myimage5 0/s 0/s 0 B/s 8 KiB/s 0.00 ns 60.69 us 2024-03-26T17:02:58.157 INFO:tasks.workunit.client.3.smithi157.stdout:myimage11 0/s 0/s 0 B/s 8.8 KiB/s 0.00 ns 63.13 us 2024-03-26T17:02:58.157 INFO:tasks.workunit.client.3.smithi157.stdout:myimage15 0/s 0/s 0 B/s 13 KiB/s 0.00 ns 117.13 us 2024-03-26T17:02:58.157 INFO:tasks.workunit.client.3.smithi157.stdout:myimage20 0/s 0/s 0 B/s 4.8 KiB/s 0.00 ns 37.36 us 2024-03-26T17:02:58.157 INFO:tasks.workunit.client.3.smithi157.stdout:myimage24 0/s 0/s 0 B/s 18 KiB/s 0.00 ns 66.22 us 2024-03-26T17:02:58.157 INFO:tasks.workunit.client.3.smithi157.stdout:myimage27 0/s 0/s 0 B/s 819 B/s 0.00 ns 24.52 us 2024-03-26T17:02:58.157 INFO:tasks.workunit.client.3.smithi157.stdout:myimage29 0/s 0/s 0 B/s 3.2 KiB/s 0.00 ns 31.64 us 2024-03-26T17:02:58.157 INFO:tasks.workunit.client.3.smithi157.stdout:myimage42 0/s 0/s 0 B/s 2.4 KiB/s 0.00 ns 36.76 us 2024-03-26T17:02:58.157 INFO:tasks.workunit.client.3.smithi157.stdout:myimage43 0/s 0/s 0 B/s 1.6 KiB/s 0.00 ns 119.44 us 2024-03-26T17:02:58.157 INFO:tasks.workunit.client.3.smithi157.stdout:myimage45 0/s 0/s 0 B/s 4 KiB/s 0.00 ns 67.75 us 2024-03-26T17:02:58.157 INFO:tasks.workunit.client.3.smithi157.stdout:myimage53 0/s 0/s 0 B/s 7.2 KiB/s 0.00 ns 34.73 us 2024-03-26T17:02:58.157 INFO:tasks.workunit.client.3.smithi157.stdout:myimage55 0/s 0/s 0 B/s 1 B/s 0.00 ns 37.59 us 2024-03-26T17:02:58.157 INFO:tasks.workunit.client.3.smithi157.stdout:myimage60 0/s 0/s 0 B/s 4.8 KiB/s 0.00 ns 125.32 us 2024-03-26T17:02:58.157 INFO:tasks.workunit.client.3.smithi157.stdout:myimage59 0/s 0/s 0 B/s 4 KiB/s 0.00 ns 75.69 us 2024-03-26T17:02:58.157 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:02:59.015 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:58 smithi044 ceph-mon[30624]: from='client.? 172.21.15.44:0/3241788124' entity='client.nvmeof.nvmeof.a' cmd='[{"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.64:0/1727848942"}]': finished 2024-03-26T17:02:59.015 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:58 smithi044 ceph-mon[30624]: osdmap e79: 8 total, 8 up, 8 in 2024-03-26T17:02:59.015 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:58 smithi044 ceph-mon[30624]: from='client.? 172.21.15.44:0/3241788124' entity='client.nvmeof.nvmeof.a' cmd={"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.64:0/1727848942"} : dispatch 2024-03-26T17:02:59.015 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:58 smithi044 ceph-mon[30624]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:02:59.015 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:58 smithi044 ceph-mon[30624]: { 2024-03-26T17:02:59.016 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:58 smithi044 ceph-mon[30624]: "prefix": "rbd perf image stats", 2024-03-26T17:02:59.016 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:58 smithi044 ceph-mon[30624]: "pool_spec": "mypool", 2024-03-26T17:02:59.016 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:58 smithi044 ceph-mon[30624]: "sort_by": "write_ops", 2024-03-26T17:02:59.016 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:58 smithi044 ceph-mon[30624]: "format": "json" 2024-03-26T17:02:59.016 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:58 smithi044 ceph-mon[30624]: }"]: dispatch 2024-03-26T17:02:59.016 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:58 smithi044 ceph-mon[30624]: pgmap v509: 33 pgs: 33 active+clean; 1015 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 238 KiB/s rd, 165 KiB/s wr, 48 op/s 2024-03-26T17:02:59.016 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:58 smithi044 ceph-mon[30624]: Health check update: 3 slow ops, oldest one blocked for 273 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:02:59.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:02:58 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:02:58] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:02:59.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:02:58 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:02:58] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:02:59.017 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:02:58 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:02:59.049 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:58 smithi149 ceph-mon[34678]: from='client.? 172.21.15.44:0/3241788124' entity='client.nvmeof.nvmeof.a' cmd='[{"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.64:0/1727848942"}]': finished 2024-03-26T17:02:59.049 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:58 smithi149 ceph-mon[34678]: osdmap e79: 8 total, 8 up, 8 in 2024-03-26T17:02:59.049 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:58 smithi149 ceph-mon[34678]: from='client.? 172.21.15.44:0/3241788124' entity='client.nvmeof.nvmeof.a' cmd={"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.64:0/1727848942"} : dispatch 2024-03-26T17:02:59.050 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:58 smithi149 ceph-mon[34678]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:02:59.050 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:58 smithi149 ceph-mon[34678]: { 2024-03-26T17:02:59.050 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:58 smithi149 ceph-mon[34678]: "prefix": "rbd perf image stats", 2024-03-26T17:02:59.050 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:58 smithi149 ceph-mon[34678]: "pool_spec": "mypool", 2024-03-26T17:02:59.050 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:58 smithi149 ceph-mon[34678]: "sort_by": "write_ops", 2024-03-26T17:02:59.050 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:58 smithi149 ceph-mon[34678]: "format": "json" 2024-03-26T17:02:59.050 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:58 smithi149 ceph-mon[34678]: }"]: dispatch 2024-03-26T17:02:59.050 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:58 smithi149 ceph-mon[34678]: pgmap v509: 33 pgs: 33 active+clean; 1015 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 238 KiB/s rd, 165 KiB/s wr, 48 op/s 2024-03-26T17:02:59.053 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:58 smithi149 ceph-mon[34678]: Health check update: 3 slow ops, oldest one blocked for 273 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:02:59.055 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:58 smithi064 ceph-mon[34420]: from='client.? 172.21.15.44:0/3241788124' entity='client.nvmeof.nvmeof.a' cmd='[{"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.64:0/1727848942"}]': finished 2024-03-26T17:02:59.055 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:58 smithi064 ceph-mon[34420]: osdmap e79: 8 total, 8 up, 8 in 2024-03-26T17:02:59.055 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:58 smithi064 ceph-mon[34420]: from='client.? 172.21.15.44:0/3241788124' entity='client.nvmeof.nvmeof.a' cmd={"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.64:0/1727848942"} : dispatch 2024-03-26T17:02:59.055 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:58 smithi064 ceph-mon[34420]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:02:59.055 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:58 smithi064 ceph-mon[34420]: { 2024-03-26T17:02:59.056 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:58 smithi064 ceph-mon[34420]: "prefix": "rbd perf image stats", 2024-03-26T17:02:59.056 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:58 smithi064 ceph-mon[34420]: "pool_spec": "mypool", 2024-03-26T17:02:59.056 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:58 smithi064 ceph-mon[34420]: "sort_by": "write_ops", 2024-03-26T17:02:59.056 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:58 smithi064 ceph-mon[34420]: "format": "json" 2024-03-26T17:02:59.056 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:58 smithi064 ceph-mon[34420]: }"]: dispatch 2024-03-26T17:02:59.056 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:58 smithi064 ceph-mon[34420]: pgmap v509: 33 pgs: 33 active+clean; 1015 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 238 KiB/s rd, 165 KiB/s wr, 48 op/s 2024-03-26T17:02:59.056 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:58 smithi064 ceph-mon[34420]: Health check update: 3 slow ops, oldest one blocked for 273 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:02:59.396 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:02:59 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:02:59] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:02:59.397 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:02:59 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:02:59] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:02:59.397 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:02:59 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:03:00.015 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:59 smithi044 ceph-mon[30624]: from='client.? 172.21.15.44:0/3241788124' entity='client.nvmeof.nvmeof.a' cmd='[{"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.64:0/1727848942"}]': finished 2024-03-26T17:03:00.015 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:02:59 smithi044 ceph-mon[30624]: osdmap e80: 8 total, 8 up, 8 in 2024-03-26T17:03:00.055 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:59 smithi064 ceph-mon[34420]: from='client.? 172.21.15.44:0/3241788124' entity='client.nvmeof.nvmeof.a' cmd='[{"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.64:0/1727848942"}]': finished 2024-03-26T17:03:00.055 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:02:59 smithi064 ceph-mon[34420]: osdmap e80: 8 total, 8 up, 8 in 2024-03-26T17:03:00.146 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:59 smithi149 ceph-mon[34678]: from='client.? 172.21.15.44:0/3241788124' entity='client.nvmeof.nvmeof.a' cmd='[{"prefix": "osd blocklist", "blocklistop": "add", "addr": "172.21.15.64:0/1727848942"}]': finished 2024-03-26T17:03:00.146 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:02:59 smithi149 ceph-mon[34678]: osdmap e80: 8 total, 8 up, 8 in 2024-03-26T17:03:01.015 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:03:00 smithi044 ceph-mon[30624]: pgmap v511: 33 pgs: 33 active+clean; 1016 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 782 KiB/s rd, 921 KiB/s wr, 122 op/s 2024-03-26T17:03:01.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:03:00 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:03:00] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:03:01.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:03:00 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:03:00] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:03:01.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:03:00 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:03:01.055 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:03:00 smithi064 ceph-mon[34420]: pgmap v511: 33 pgs: 33 active+clean; 1016 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 782 KiB/s rd, 921 KiB/s wr, 122 op/s 2024-03-26T17:03:01.061 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:03:00 smithi149 ceph-mon[34678]: pgmap v511: 33 pgs: 33 active+clean; 1016 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 782 KiB/s rd, 921 KiB/s wr, 122 op/s 2024-03-26T17:03:01.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:03:01 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 2024-03-26T17:03:01.214+0000 7fa707a55700 -1 mon.c@1(peon) e3 get_health_metrics reporting 3 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T17:03:01.396 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:03:01 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:03:01] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:03:01.397 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:03:01 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:03:01] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:03:01.397 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:03:01 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:03:02.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:03:02 smithi044 ceph-mon[30624]: pgmap v512: 33 pgs: 33 active+clean; 1016 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 183 op/s 2024-03-26T17:03:02.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:03:02 smithi064 ceph-mon[34420]: pgmap v512: 33 pgs: 33 active+clean; 1016 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 183 op/s 2024-03-26T17:03:02.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:03:02 smithi149 ceph-mon[34678]: pgmap v512: 33 pgs: 33 active+clean; 1016 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 183 op/s 2024-03-26T17:03:03.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:03:02 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:03:02] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:03:03.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:03:02 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:03:02] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:03:03.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:03:02 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:03:03.061 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:03:03.070 INFO:tasks.workunit.client.3.smithi157.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2024-03-26T17:03:03.070 INFO:tasks.workunit.client.3.smithi157.stdout: 6.70 65.6k 56.8k 0.0k 656.0k 568.0k 0.0k nvme2n1 2024-03-26T17:03:03.070 INFO:tasks.workunit.client.3.smithi157.stdout: 6.70 70.8k 72.0k 0.0k 708.0k 720.0k 0.0k nvme2n10 2024-03-26T17:03:03.070 INFO:tasks.workunit.client.3.smithi157.stdout: 6.80 64.0k 71.6k 0.0k 640.0k 716.0k 0.0k nvme2n11 2024-03-26T17:03:03.070 INFO:tasks.workunit.client.3.smithi157.stdout: 6.80 81.2k 70.8k 0.0k 812.0k 708.0k 0.0k nvme2n12 2024-03-26T17:03:03.070 INFO:tasks.workunit.client.3.smithi157.stdout: 6.80 61.2k 61.2k 0.0k 612.0k 612.0k 0.0k nvme2n13 2024-03-26T17:03:03.071 INFO:tasks.workunit.client.3.smithi157.stdout: 6.80 64.0k 59.6k 0.0k 640.0k 596.0k 0.0k nvme2n14 2024-03-26T17:03:03.071 INFO:tasks.workunit.client.3.smithi157.stdout: 6.80 82.0k 49.2k 0.0k 820.0k 492.0k 0.0k nvme2n15 2024-03-26T17:03:03.071 INFO:tasks.workunit.client.3.smithi157.stdout: 6.80 77.2k 77.6k 0.0k 772.0k 776.0k 0.0k nvme2n16 2024-03-26T17:03:03.071 INFO:tasks.workunit.client.3.smithi157.stdout: 6.70 54.4k 75.2k 0.0k 544.0k 752.0k 0.0k nvme2n17 2024-03-26T17:03:03.071 INFO:tasks.workunit.client.3.smithi157.stdout: 6.70 88.0k 52.0k 0.0k 880.0k 520.0k 0.0k nvme2n18 2024-03-26T17:03:03.071 INFO:tasks.workunit.client.3.smithi157.stdout: 6.70 86.4k 54.4k 0.0k 864.0k 544.0k 0.0k nvme2n19 2024-03-26T17:03:03.071 INFO:tasks.workunit.client.3.smithi157.stdout: 6.70 47.6k 62.4k 0.0k 476.0k 624.0k 0.0k nvme2n2 2024-03-26T17:03:03.071 INFO:tasks.workunit.client.3.smithi157.stdout: 6.70 46.4k 77.6k 0.0k 464.0k 776.0k 0.0k nvme2n20 2024-03-26T17:03:03.071 INFO:tasks.workunit.client.3.smithi157.stdout: 6.70 77.2k 68.0k 0.0k 772.0k 680.0k 0.0k nvme2n3 2024-03-26T17:03:03.071 INFO:tasks.workunit.client.3.smithi157.stdout: 6.70 48.8k 74.8k 0.0k 488.0k 748.0k 0.0k nvme2n4 2024-03-26T17:03:03.071 INFO:tasks.workunit.client.3.smithi157.stdout: 6.70 64.4k 70.8k 0.0k 644.0k 708.0k 0.0k nvme2n5 2024-03-26T17:03:03.071 INFO:tasks.workunit.client.3.smithi157.stdout: 6.70 68.4k 54.0k 0.0k 684.0k 540.0k 0.0k nvme2n6 2024-03-26T17:03:03.071 INFO:tasks.workunit.client.3.smithi157.stdout: 6.70 58.4k 50.8k 0.0k 584.0k 508.0k 0.0k nvme2n7 2024-03-26T17:03:03.071 INFO:tasks.workunit.client.3.smithi157.stdout: 6.70 52.0k 63.6k 0.0k 520.0k 636.0k 0.0k nvme2n8 2024-03-26T17:03:03.071 INFO:tasks.workunit.client.3.smithi157.stdout: 6.70 56.8k 52.8k 0.0k 568.0k 528.0k 0.0k nvme2n9 2024-03-26T17:03:03.072 INFO:tasks.workunit.client.3.smithi157.stdout: 6.70 61.6k 62.0k 0.0k 616.0k 620.0k 0.0k nvme5n1 2024-03-26T17:03:03.072 INFO:tasks.workunit.client.3.smithi157.stdout: 6.70 58.0k 63.6k 0.0k 580.0k 636.0k 0.0k nvme5n10 2024-03-26T17:03:03.072 INFO:tasks.workunit.client.3.smithi157.stdout: 6.70 64.8k 94.0k 0.0k 648.0k 940.0k 0.0k nvme5n11 2024-03-26T17:03:03.072 INFO:tasks.workunit.client.3.smithi157.stdout: 6.80 49.6k 64.0k 0.0k 496.0k 640.0k 0.0k nvme5n12 2024-03-26T17:03:03.072 INFO:tasks.workunit.client.3.smithi157.stdout: 6.80 75.2k 60.0k 0.0k 752.0k 600.0k 0.0k nvme5n13 2024-03-26T17:03:03.072 INFO:tasks.workunit.client.3.smithi157.stdout: 6.80 71.6k 58.8k 0.0k 716.0k 588.0k 0.0k nvme5n14 2024-03-26T17:03:03.072 INFO:tasks.workunit.client.3.smithi157.stdout: 6.80 53.6k 66.8k 0.0k 536.0k 668.0k 0.0k nvme5n15 2024-03-26T17:03:03.072 INFO:tasks.workunit.client.3.smithi157.stdout: 6.80 60.4k 71.6k 0.0k 604.0k 716.0k 0.0k nvme5n16 2024-03-26T17:03:03.072 INFO:tasks.workunit.client.3.smithi157.stdout: 6.70 74.8k 76.0k 0.0k 748.0k 760.0k 0.0k nvme5n17 2024-03-26T17:03:03.072 INFO:tasks.workunit.client.3.smithi157.stdout: 6.70 47.2k 62.4k 0.0k 472.0k 624.0k 0.0k nvme5n18 2024-03-26T17:03:03.072 INFO:tasks.workunit.client.3.smithi157.stdout: 6.70 75.6k 55.6k 0.0k 756.0k 556.0k 0.0k nvme5n19 2024-03-26T17:03:03.072 INFO:tasks.workunit.client.3.smithi157.stdout: 6.70 64.0k 60.8k 0.0k 640.0k 608.0k 0.0k nvme5n2 2024-03-26T17:03:03.072 INFO:tasks.workunit.client.3.smithi157.stdout: 6.70 59.2k 56.8k 0.0k 592.0k 568.0k 0.0k nvme5n20 2024-03-26T17:03:03.072 INFO:tasks.workunit.client.3.smithi157.stdout: 6.70 59.6k 61.6k 0.0k 596.0k 616.0k 0.0k nvme5n3 2024-03-26T17:03:03.073 INFO:tasks.workunit.client.3.smithi157.stdout: 6.70 64.8k 70.0k 0.0k 648.0k 700.0k 0.0k nvme5n4 2024-03-26T17:03:03.073 INFO:tasks.workunit.client.3.smithi157.stdout: 6.70 63.2k 75.6k 0.0k 632.0k 756.0k 0.0k nvme5n5 2024-03-26T17:03:03.073 INFO:tasks.workunit.client.3.smithi157.stdout: 6.70 55.6k 75.6k 0.0k 556.0k 756.0k 0.0k nvme5n6 2024-03-26T17:03:03.073 INFO:tasks.workunit.client.3.smithi157.stdout: 6.70 82.0k 71.6k 0.0k 820.0k 716.0k 0.0k nvme5n7 2024-03-26T17:03:03.073 INFO:tasks.workunit.client.3.smithi157.stdout: 6.70 53.2k 62.4k 0.0k 532.0k 624.0k 0.0k nvme5n8 2024-03-26T17:03:03.073 INFO:tasks.workunit.client.3.smithi157.stdout: 6.70 70.0k 44.0k 0.0k 700.0k 440.0k 0.0k nvme5n9 2024-03-26T17:03:03.073 INFO:tasks.workunit.client.3.smithi157.stdout: 6.70 66.8k 58.4k 0.0k 668.0k 584.0k 0.0k nvme8n1 2024-03-26T17:03:03.073 INFO:tasks.workunit.client.3.smithi157.stdout: 6.70 52.8k 85.2k 0.0k 528.0k 852.0k 0.0k nvme8n10 2024-03-26T17:03:03.073 INFO:tasks.workunit.client.3.smithi157.stdout: 6.80 86.4k 67.2k 0.0k 864.0k 672.0k 0.0k nvme8n11 2024-03-26T17:03:03.073 INFO:tasks.workunit.client.3.smithi157.stdout: 6.80 59.2k 56.0k 0.0k 592.0k 560.0k 0.0k nvme8n12 2024-03-26T17:03:03.073 INFO:tasks.workunit.client.3.smithi157.stdout: 6.80 83.6k 60.4k 0.0k 836.0k 604.0k 0.0k nvme8n13 2024-03-26T17:03:03.073 INFO:tasks.workunit.client.3.smithi157.stdout: 6.80 56.8k 70.0k 0.0k 568.0k 700.0k 0.0k nvme8n14 2024-03-26T17:03:03.073 INFO:tasks.workunit.client.3.smithi157.stdout: 6.80 56.4k 79.2k 0.0k 564.0k 792.0k 0.0k nvme8n15 2024-03-26T17:03:03.073 INFO:tasks.workunit.client.3.smithi157.stdout: 6.70 57.2k 60.0k 0.0k 572.0k 600.0k 0.0k nvme8n16 2024-03-26T17:03:03.073 INFO:tasks.workunit.client.3.smithi157.stdout: 6.70 53.6k 81.6k 0.0k 536.0k 816.0k 0.0k nvme8n17 2024-03-26T17:03:03.074 INFO:tasks.workunit.client.3.smithi157.stdout: 6.70 66.4k 48.8k 0.0k 664.0k 488.0k 0.0k nvme8n18 2024-03-26T17:03:03.074 INFO:tasks.workunit.client.3.smithi157.stdout: 6.70 58.8k 54.4k 0.0k 588.0k 544.0k 0.0k nvme8n19 2024-03-26T17:03:03.074 INFO:tasks.workunit.client.3.smithi157.stdout: 6.70 63.2k 55.2k 0.0k 632.0k 552.0k 0.0k nvme8n2 2024-03-26T17:03:03.074 INFO:tasks.workunit.client.3.smithi157.stdout: 6.70 91.2k 59.2k 0.0k 912.0k 592.0k 0.0k nvme8n20 2024-03-26T17:03:03.074 INFO:tasks.workunit.client.3.smithi157.stdout: 6.70 95.6k 50.4k 0.0k 956.0k 504.0k 0.0k nvme8n3 2024-03-26T17:03:03.074 INFO:tasks.workunit.client.3.smithi157.stdout: 6.70 55.6k 53.6k 0.0k 556.0k 536.0k 0.0k nvme8n4 2024-03-26T17:03:03.074 INFO:tasks.workunit.client.3.smithi157.stdout: 6.70 67.2k 53.6k 0.0k 672.0k 536.0k 0.0k nvme8n5 2024-03-26T17:03:03.074 INFO:tasks.workunit.client.3.smithi157.stdout: 6.70 71.2k 67.6k 0.0k 712.0k 676.0k 0.0k nvme8n6 2024-03-26T17:03:03.074 INFO:tasks.workunit.client.3.smithi157.stdout: 6.70 65.2k 65.6k 0.0k 652.0k 656.0k 0.0k nvme8n7 2024-03-26T17:03:03.074 INFO:tasks.workunit.client.3.smithi157.stdout: 6.70 66.0k 56.8k 0.0k 660.0k 568.0k 0.0k nvme8n8 2024-03-26T17:03:03.074 INFO:tasks.workunit.client.3.smithi157.stdout: 6.70 59.2k 61.2k 0.0k 592.0k 612.0k 0.0k nvme8n9 2024-03-26T17:03:03.074 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:03:03.158 INFO:tasks.workunit.client.3.smithi157.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-26T17:03:03.158 INFO:tasks.workunit.client.3.smithi157.stdout:myimage3 5/s 5/s 100 KiB/s 120 KiB/s 1.14 ms 166.35 us 2024-03-26T17:03:03.158 INFO:tasks.workunit.client.3.smithi157.stdout:myimage54 5/s 4/s 99 KiB/s 82 KiB/s 1.12 ms 184.46 us 2024-03-26T17:03:03.158 INFO:tasks.workunit.client.3.smithi157.stdout:myimage48 4/s 3/s 85 KiB/s 62 KiB/s 1.11 ms 150.24 us 2024-03-26T17:03:03.158 INFO:tasks.workunit.client.3.smithi157.stdout:myimage15 4/s 6/s 69 KiB/s 91 KiB/s 1.09 ms 165.87 us 2024-03-26T17:03:03.158 INFO:tasks.workunit.client.3.smithi157.stdout:myimage13 4/s 3/s 64 KiB/s 64 KiB/s 1.13 ms 197.31 us 2024-03-26T17:03:03.158 INFO:tasks.workunit.client.3.smithi157.stdout:myimage37 4/s 3/s 107 KiB/s 67 KiB/s 1.22 ms 164.67 us 2024-03-26T17:03:03.158 INFO:tasks.workunit.client.3.smithi157.stdout:myimage58 4/s 5/s 78 KiB/s 106 KiB/s 1.14 ms 169.29 us 2024-03-26T17:03:03.158 INFO:tasks.workunit.client.3.smithi157.stdout:myimage46 4/s 4/s 96 KiB/s 86 KiB/s 1.12 ms 155.16 us 2024-03-26T17:03:03.158 INFO:tasks.workunit.client.3.smithi157.stdout:myimage35 4/s 3/s 84 KiB/s 38 KiB/s 1.11 ms 181.20 us 2024-03-26T17:03:03.159 INFO:tasks.workunit.client.3.smithi157.stdout:myimage42 4/s 3/s 88 KiB/s 61 KiB/s 1.19 ms 170.49 us 2024-03-26T17:03:03.159 INFO:tasks.workunit.client.3.smithi157.stdout:myimage17 4/s 5/s 110 KiB/s 84 KiB/s 1.21 ms 182.36 us 2024-03-26T17:03:03.159 INFO:tasks.workunit.client.3.smithi157.stdout:myimage39 4/s 3/s 66 KiB/s 65 KiB/s 1.06 ms 182.24 us 2024-03-26T17:03:03.159 INFO:tasks.workunit.client.3.smithi157.stdout:myimage43 4/s 5/s 77 KiB/s 106 KiB/s 1.15 ms 171.54 us 2024-03-26T17:03:03.159 INFO:tasks.workunit.client.3.smithi157.stdout:myimage50 4/s 2/s 79 KiB/s 55 KiB/s 1.19 ms 172.76 us 2024-03-26T17:03:03.159 INFO:tasks.workunit.client.3.smithi157.stdout:myimage55 4/s 4/s 87 KiB/s 70 KiB/s 1.26 ms 185.38 us 2024-03-26T17:03:03.159 INFO:tasks.workunit.client.3.smithi157.stdout:myimage20 4/s 4/s 72 KiB/s 66 KiB/s 1.18 ms 169.93 us 2024-03-26T17:03:03.159 INFO:tasks.workunit.client.3.smithi157.stdout:myimage49 3/s 4/s 67 KiB/s 74 KiB/s 1.14 ms 161.70 us 2024-03-26T17:03:03.159 INFO:tasks.workunit.client.3.smithi157.stdout:myimage5 3/s 3/s 59 KiB/s 68 KiB/s 1.11 ms 195.23 us 2024-03-26T17:03:03.159 INFO:tasks.workunit.client.3.smithi157.stdout:myimage28 3/s 3/s 75 KiB/s 56 KiB/s 1.17 ms 151.63 us 2024-03-26T17:03:03.159 INFO:tasks.workunit.client.3.smithi157.stdout:myimage47 3/s 4/s 68 KiB/s 69 KiB/s 1.16 ms 170.03 us 2024-03-26T17:03:03.159 INFO:tasks.workunit.client.3.smithi157.stdout:myimage11 3/s 3/s 62 KiB/s 51 KiB/s 1.14 ms 143.18 us 2024-03-26T17:03:03.159 INFO:tasks.workunit.client.3.smithi157.stdout:myimage26 3/s 2/s 55 KiB/s 46 KiB/s 1.18 ms 277.52 us 2024-03-26T17:03:03.159 INFO:tasks.workunit.client.3.smithi157.stdout:myimage2 3/s 2/s 42 KiB/s 42 KiB/s 1.10 ms 159.58 us 2024-03-26T17:03:03.159 INFO:tasks.workunit.client.3.smithi157.stdout:myimage30 3/s 2/s 82 KiB/s 34 KiB/s 1.18 ms 148.08 us 2024-03-26T17:03:03.159 INFO:tasks.workunit.client.3.smithi157.stdout:myimage31 3/s 3/s 86 KiB/s 66 KiB/s 1.18 ms 163.43 us 2024-03-26T17:03:03.160 INFO:tasks.workunit.client.3.smithi157.stdout:myimage34 3/s 3/s 66 KiB/s 50 KiB/s 1.12 ms 151.60 us 2024-03-26T17:03:03.160 INFO:tasks.workunit.client.3.smithi157.stdout:myimage52 3/s 3/s 69 KiB/s 65 KiB/s 1.29 ms 153.10 us 2024-03-26T17:03:03.160 INFO:tasks.workunit.client.3.smithi157.stdout:myimage51 3/s 4/s 79 KiB/s 106 KiB/s 1.16 ms 168.59 us 2024-03-26T17:03:03.160 INFO:tasks.workunit.client.3.smithi157.stdout:myimage40 3/s 3/s 35 KiB/s 69 KiB/s 1.08 ms 160.98 us 2024-03-26T17:03:03.160 INFO:tasks.workunit.client.3.smithi157.stdout:myimage8 3/s 3/s 66 KiB/s 63 KiB/s 1.11 ms 158.80 us 2024-03-26T17:03:03.160 INFO:tasks.workunit.client.3.smithi157.stdout:myimage9 3/s 2/s 45 KiB/s 24 KiB/s 1.09 ms 151.49 us 2024-03-26T17:03:03.160 INFO:tasks.workunit.client.3.smithi157.stdout:myimage24 3/s 3/s 96 KiB/s 74 KiB/s 1.22 ms 156.32 us 2024-03-26T17:03:03.160 INFO:tasks.workunit.client.3.smithi157.stdout:myimage41 3/s 3/s 58 KiB/s 52 KiB/s 1.17 ms 156.03 us 2024-03-26T17:03:03.160 INFO:tasks.workunit.client.3.smithi157.stdout:myimage44 3/s 1/s 69 KiB/s 21 KiB/s 1.13 ms 152.08 us 2024-03-26T17:03:03.160 INFO:tasks.workunit.client.3.smithi157.stdout:myimage60 3/s 4/s 70 KiB/s 85 KiB/s 1.18 ms 169.68 us 2024-03-26T17:03:03.160 INFO:tasks.workunit.client.3.smithi157.stdout:myimage25 2/s 2/s 66 KiB/s 46 KiB/s 1.33 ms 290.63 us 2024-03-26T17:03:03.160 INFO:tasks.workunit.client.3.smithi157.stdout:myimage38 2/s 3/s 30 KiB/s 62 KiB/s 1.10 ms 162.71 us 2024-03-26T17:03:03.160 INFO:tasks.workunit.client.3.smithi157.stdout:myimage33 2/s 4/s 41 KiB/s 77 KiB/s 1.10 ms 183.04 us 2024-03-26T17:03:03.160 INFO:tasks.workunit.client.3.smithi157.stdout:myimage56 2/s 2/s 46 KiB/s 34 KiB/s 1.25 ms 174.50 us 2024-03-26T17:03:03.160 INFO:tasks.workunit.client.3.smithi157.stdout:myimage14 2/s 3/s 47 KiB/s 61 KiB/s 1.21 ms 191.99 us 2024-03-26T17:03:03.160 INFO:tasks.workunit.client.3.smithi157.stdout:myimage22 2/s 2/s 40 KiB/s 51 KiB/s 1.17 ms 172.44 us 2024-03-26T17:03:03.161 INFO:tasks.workunit.client.3.smithi157.stdout:myimage23 2/s 1/s 32 KiB/s 30 KiB/s 1.05 ms 151.23 us 2024-03-26T17:03:03.161 INFO:tasks.workunit.client.3.smithi157.stdout:myimage7 2/s 3/s 56 KiB/s 42 KiB/s 1.15 ms 190.75 us 2024-03-26T17:03:03.161 INFO:tasks.workunit.client.3.smithi157.stdout:myimage12 2/s 2/s 51 KiB/s 62 KiB/s 1.15 ms 201.44 us 2024-03-26T17:03:03.161 INFO:tasks.workunit.client.3.smithi157.stdout:myimage19 2/s 2/s 43 KiB/s 50 KiB/s 1.18 ms 190.10 us 2024-03-26T17:03:03.161 INFO:tasks.workunit.client.3.smithi157.stdout:myimage36 2/s 2/s 38 KiB/s 46 KiB/s 1.16 ms 166.83 us 2024-03-26T17:03:03.161 INFO:tasks.workunit.client.3.smithi157.stdout:myimage29 2/s 2/s 31 KiB/s 52 KiB/s 1.11 ms 170.16 us 2024-03-26T17:03:03.161 INFO:tasks.workunit.client.3.smithi157.stdout:myimage32 2/s 1/s 36 KiB/s 31 KiB/s 1.14 ms 184.87 us 2024-03-26T17:03:03.161 INFO:tasks.workunit.client.3.smithi157.stdout:myimage16 1/s 2/s 50 KiB/s 68 KiB/s 1.11 ms 170.15 us 2024-03-26T17:03:03.161 INFO:tasks.workunit.client.3.smithi157.stdout:myimage4 1/s 0/s 11 KiB/s 10 KiB/s 1.03 ms 117.91 us 2024-03-26T17:03:03.161 INFO:tasks.workunit.client.3.smithi157.stdout:myimage6 1/s 3/s 33 KiB/s 46 KiB/s 1.15 ms 169.78 us 2024-03-26T17:03:03.161 INFO:tasks.workunit.client.3.smithi157.stdout:myimage21 1/s 2/s 28 KiB/s 36 KiB/s 1.25 ms 176.45 us 2024-03-26T17:03:03.161 INFO:tasks.workunit.client.3.smithi157.stdout:myimage45 1/s 1/s 20 KiB/s 20 KiB/s 1.08 ms 166.67 us 2024-03-26T17:03:03.161 INFO:tasks.workunit.client.3.smithi157.stdout:myimage27 1/s 1/s 38 KiB/s 39 KiB/s 1.11 ms 177.07 us 2024-03-26T17:03:03.161 INFO:tasks.workunit.client.3.smithi157.stdout:myimage57 1/s 2/s 20 KiB/s 26 KiB/s 1.02 ms 173.79 us 2024-03-26T17:03:03.162 INFO:tasks.workunit.client.3.smithi157.stdout:myimage59 1/s 2/s 8 KiB/s 33 KiB/s 1.19 ms 148.60 us 2024-03-26T17:03:03.162 INFO:tasks.workunit.client.3.smithi157.stdout:myimage53 0/s 1/s 19 KiB/s 19 KiB/s 950.45 us 171.94 us 2024-03-26T17:03:03.162 INFO:tasks.workunit.client.3.smithi157.stdout:myimage10 0/s 1/s 22 KiB/s 34 KiB/s 957.28 us 154.18 us 2024-03-26T17:03:03.162 INFO:tasks.workunit.client.3.smithi157.stdout:myimage1 0/s 0/s 9.6 KiB/s 819 B/s 782.81 us 53.83 us 2024-03-26T17:03:03.162 INFO:tasks.workunit.client.3.smithi157.stdout:myimage18 0/s 0/s 10 KiB/s 15 KiB/s 234.79 us 115.70 us 2024-03-26T17:03:03.162 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:03:03.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:03:03 smithi149 ceph-mon[34678]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:03:03.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:03:03 smithi149 ceph-mon[34678]: { 2024-03-26T17:03:03.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:03:03 smithi149 ceph-mon[34678]: "prefix": "rbd perf image stats", 2024-03-26T17:03:03.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:03:03 smithi149 ceph-mon[34678]: "pool_spec": "mypool", 2024-03-26T17:03:03.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:03:03 smithi149 ceph-mon[34678]: "sort_by": "write_ops", 2024-03-26T17:03:03.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:03:03 smithi149 ceph-mon[34678]: "format": "json" 2024-03-26T17:03:03.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:03:03 smithi149 ceph-mon[34678]: }"]: dispatch 2024-03-26T17:03:03.397 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:03:03 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:03:03] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:03:03.397 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:03:03 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:03:03] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:03:03.397 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:03:03 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:03:03.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:03:03 smithi044 ceph-mon[30624]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:03:03.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:03:03 smithi044 ceph-mon[30624]: { 2024-03-26T17:03:03.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:03:03 smithi044 ceph-mon[30624]: "prefix": "rbd perf image stats", 2024-03-26T17:03:03.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:03:03 smithi044 ceph-mon[30624]: "pool_spec": "mypool", 2024-03-26T17:03:03.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:03:03 smithi044 ceph-mon[30624]: "sort_by": "write_ops", 2024-03-26T17:03:03.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:03:03 smithi044 ceph-mon[30624]: "format": "json" 2024-03-26T17:03:03.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:03:03 smithi044 ceph-mon[30624]: }"]: dispatch 2024-03-26T17:03:03.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:03:03 smithi064 ceph-mon[34420]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:03:03.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:03:03 smithi064 ceph-mon[34420]: { 2024-03-26T17:03:03.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:03:03 smithi064 ceph-mon[34420]: "prefix": "rbd perf image stats", 2024-03-26T17:03:03.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:03:03 smithi064 ceph-mon[34420]: "pool_spec": "mypool", 2024-03-26T17:03:03.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:03:03 smithi064 ceph-mon[34420]: "sort_by": "write_ops", 2024-03-26T17:03:03.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:03:03 smithi064 ceph-mon[34420]: "format": "json" 2024-03-26T17:03:03.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:03:03 smithi064 ceph-mon[34420]: }"]: dispatch 2024-03-26T17:03:04.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:03:04 smithi044 ceph-mon[30624]: Health check update: 3 slow ops, oldest one blocked for 278 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:03:04.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:03:04 smithi044 ceph-mon[30624]: pgmap v513: 33 pgs: 33 active+clean; 1017 MiB data, 1.7 GiB used, 713 GiB / 715 GiB avail; 3.9 MiB/s rd, 3.9 MiB/s wr, 455 op/s 2024-03-26T17:03:04.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:03:04 smithi064 ceph-mon[34420]: Health check update: 3 slow ops, oldest one blocked for 278 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:03:04.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:03:04 smithi064 ceph-mon[34420]: pgmap v513: 33 pgs: 33 active+clean; 1017 MiB data, 1.7 GiB used, 713 GiB / 715 GiB avail; 3.9 MiB/s rd, 3.9 MiB/s wr, 455 op/s 2024-03-26T17:03:04.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:03:04 smithi149 ceph-mon[34678]: Health check update: 3 slow ops, oldest one blocked for 278 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:03:04.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:03:04 smithi149 ceph-mon[34678]: pgmap v513: 33 pgs: 33 active+clean; 1017 MiB data, 1.7 GiB used, 713 GiB / 715 GiB avail; 3.9 MiB/s rd, 3.9 MiB/s wr, 455 op/s 2024-03-26T17:03:05.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:03:04 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:03:04] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:03:05.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:03:04 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:03:04] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:03:05.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:03:04 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:03:05.397 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:03:05 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:03:05] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:03:05.397 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:03:05 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:03:05] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:03:05.397 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:03:05 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:03:06.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:03:06 smithi044 ceph-mon[30624]: pgmap v514: 33 pgs: 33 active+clean; 1018 MiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 4.9 MiB/s rd, 5.0 MiB/s wr, 559 op/s 2024-03-26T17:03:06.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:03:06 smithi064 ceph-mon[34420]: pgmap v514: 33 pgs: 33 active+clean; 1018 MiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 4.9 MiB/s rd, 5.0 MiB/s wr, 559 op/s 2024-03-26T17:03:06.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:03:06 smithi149 ceph-mon[34678]: pgmap v514: 33 pgs: 33 active+clean; 1018 MiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 4.9 MiB/s rd, 5.0 MiB/s wr, 559 op/s 2024-03-26T17:03:06.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:03:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 2024-03-26T17:03:06.215+0000 7fa707a55700 -1 mon.c@1(peon) e3 get_health_metrics reporting 3 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T17:03:07.265 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:03:06 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:03:06] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:03:07.265 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:03:06 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:03:06] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:03:07.265 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:03:06 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:03:07.396 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:03:07 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:03:07] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:03:07.396 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:03:07 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:03:07] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:03:07.396 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:03:07 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:03:08.162 INFO:tasks.workunit.client.3.smithi157.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-26T17:03:08.162 INFO:tasks.workunit.client.3.smithi157.stdout:myimage31 10/s 7/s 230 KiB/s 147 KiB/s 1.18 ms 168.40 us 2024-03-26T17:03:08.162 INFO:tasks.workunit.client.3.smithi157.stdout:myimage57 9/s 7/s 191 KiB/s 129 KiB/s 1.12 ms 178.14 us 2024-03-26T17:03:08.162 INFO:tasks.workunit.client.3.smithi157.stdout:myimage26 9/s 6/s 188 KiB/s 124 KiB/s 1.17 ms 185.85 us 2024-03-26T17:03:08.162 INFO:tasks.workunit.client.3.smithi157.stdout:myimage36 9/s 7/s 217 KiB/s 148 KiB/s 1.17 ms 187.41 us 2024-03-26T17:03:08.162 INFO:tasks.workunit.client.3.smithi157.stdout:myimage23 9/s 10/s 171 KiB/s 191 KiB/s 1.09 ms 168.80 us 2024-03-26T17:03:08.162 INFO:tasks.workunit.client.3.smithi157.stdout:myimage27 9/s 8/s 178 KiB/s 167 KiB/s 1.14 ms 168.08 us 2024-03-26T17:03:08.163 INFO:tasks.workunit.client.3.smithi157.stdout:myimage32 9/s 8/s 150 KiB/s 129 KiB/s 1.16 ms 174.72 us 2024-03-26T17:03:08.163 INFO:tasks.workunit.client.3.smithi157.stdout:myimage59 9/s 7/s 166 KiB/s 142 KiB/s 1.19 ms 167.92 us 2024-03-26T17:03:08.163 INFO:tasks.workunit.client.3.smithi157.stdout:myimage34 8/s 9/s 154 KiB/s 177 KiB/s 1.13 ms 175.08 us 2024-03-26T17:03:08.163 INFO:tasks.workunit.client.3.smithi157.stdout:myimage40 8/s 8/s 157 KiB/s 145 KiB/s 1.19 ms 168.16 us 2024-03-26T17:03:08.163 INFO:tasks.workunit.client.3.smithi157.stdout:myimage44 8/s 9/s 166 KiB/s 144 KiB/s 1.20 ms 163.35 us 2024-03-26T17:03:08.163 INFO:tasks.workunit.client.3.smithi157.stdout:myimage55 8/s 7/s 197 KiB/s 137 KiB/s 1.16 ms 201.35 us 2024-03-26T17:03:08.163 INFO:tasks.workunit.client.3.smithi157.stdout:myimage19 8/s 9/s 150 KiB/s 233 KiB/s 1.20 ms 181.20 us 2024-03-26T17:03:08.163 INFO:tasks.workunit.client.3.smithi157.stdout:myimage38 8/s 5/s 146 KiB/s 72 KiB/s 1.17 ms 163.37 us 2024-03-26T17:03:08.163 INFO:tasks.workunit.client.3.smithi157.stdout:myimage7 8/s 8/s 131 KiB/s 146 KiB/s 1.16 ms 153.96 us 2024-03-26T17:03:08.163 INFO:tasks.workunit.client.3.smithi157.stdout:myimage9 8/s 7/s 177 KiB/s 131 KiB/s 1.19 ms 182.34 us 2024-03-26T17:03:08.163 INFO:tasks.workunit.client.3.smithi157.stdout:myimage2 8/s 4/s 138 KiB/s 87 KiB/s 1.16 ms 177.56 us 2024-03-26T17:03:08.163 INFO:tasks.workunit.client.3.smithi157.stdout:myimage49 8/s 8/s 137 KiB/s 91 KiB/s 1.23 ms 187.75 us 2024-03-26T17:03:08.164 INFO:tasks.workunit.client.3.smithi157.stdout:myimage17 8/s 7/s 165 KiB/s 136 KiB/s 1.28 ms 159.81 us 2024-03-26T17:03:08.164 INFO:tasks.workunit.client.3.smithi157.stdout:myimage50 8/s 6/s 164 KiB/s 150 KiB/s 1.20 ms 221.58 us 2024-03-26T17:03:08.164 INFO:tasks.workunit.client.3.smithi157.stdout:myimage20 7/s 6/s 194 KiB/s 157 KiB/s 1.18 ms 213.20 us 2024-03-26T17:03:08.164 INFO:tasks.workunit.client.3.smithi157.stdout:myimage21 7/s 8/s 165 KiB/s 162 KiB/s 1.30 ms 204.31 us 2024-03-26T17:03:08.164 INFO:tasks.workunit.client.3.smithi157.stdout:myimage28 7/s 6/s 126 KiB/s 125 KiB/s 1.23 ms 178.93 us 2024-03-26T17:03:08.164 INFO:tasks.workunit.client.3.smithi157.stdout:myimage10 7/s 5/s 152 KiB/s 116 KiB/s 1.17 ms 165.78 us 2024-03-26T17:03:08.164 INFO:tasks.workunit.client.3.smithi157.stdout:myimage14 7/s 8/s 135 KiB/s 127 KiB/s 1.18 ms 194.71 us 2024-03-26T17:03:08.164 INFO:tasks.workunit.client.3.smithi157.stdout:myimage8 7/s 7/s 140 KiB/s 105 KiB/s 1.18 ms 157.16 us 2024-03-26T17:03:08.164 INFO:tasks.workunit.client.3.smithi157.stdout:myimage13 7/s 10/s 139 KiB/s 170 KiB/s 1.14 ms 155.67 us 2024-03-26T17:03:08.164 INFO:tasks.workunit.client.3.smithi157.stdout:myimage16 7/s 8/s 149 KiB/s 113 KiB/s 1.18 ms 167.48 us 2024-03-26T17:03:08.164 INFO:tasks.workunit.client.3.smithi157.stdout:myimage37 7/s 6/s 172 KiB/s 142 KiB/s 1.22 ms 217.51 us 2024-03-26T17:03:08.164 INFO:tasks.workunit.client.3.smithi157.stdout:myimage24 7/s 9/s 106 KiB/s 154 KiB/s 1.22 ms 167.15 us 2024-03-26T17:03:08.164 INFO:tasks.workunit.client.3.smithi157.stdout:myimage46 7/s 8/s 140 KiB/s 174 KiB/s 1.22 ms 196.76 us 2024-03-26T17:03:08.164 INFO:tasks.workunit.client.3.smithi157.stdout:myimage11 7/s 6/s 145 KiB/s 136 KiB/s 1.18 ms 183.19 us 2024-03-26T17:03:08.165 INFO:tasks.workunit.client.3.smithi157.stdout:myimage33 7/s 6/s 142 KiB/s 178 KiB/s 1.15 ms 210.32 us 2024-03-26T17:03:08.165 INFO:tasks.workunit.client.3.smithi157.stdout:myimage1 6/s 8/s 125 KiB/s 113 KiB/s 1.10 ms 163.09 us 2024-03-26T17:03:08.165 INFO:tasks.workunit.client.3.smithi157.stdout:myimage4 6/s 6/s 156 KiB/s 115 KiB/s 1.06 ms 168.35 us 2024-03-26T17:03:08.165 INFO:tasks.workunit.client.3.smithi157.stdout:myimage18 6/s 8/s 104 KiB/s 147 KiB/s 1.10 ms 164.72 us 2024-03-26T17:03:08.165 INFO:tasks.workunit.client.3.smithi157.stdout:myimage41 6/s 6/s 118 KiB/s 107 KiB/s 1.20 ms 164.32 us 2024-03-26T17:03:08.165 INFO:tasks.workunit.client.3.smithi157.stdout:myimage45 6/s 8/s 134 KiB/s 142 KiB/s 1.15 ms 175.73 us 2024-03-26T17:03:08.165 INFO:tasks.workunit.client.3.smithi157.stdout:myimage53 6/s 8/s 130 KiB/s 186 KiB/s 1.18 ms 171.50 us 2024-03-26T17:03:08.165 INFO:tasks.workunit.client.3.smithi157.stdout:myimage30 6/s 9/s 94 KiB/s 184 KiB/s 1.25 ms 161.33 us 2024-03-26T17:03:08.165 INFO:tasks.workunit.client.3.smithi157.stdout:myimage47 6/s 6/s 121 KiB/s 137 KiB/s 1.16 ms 187.74 us 2024-03-26T17:03:08.165 INFO:tasks.workunit.client.3.smithi157.stdout:myimage56 6/s 6/s 123 KiB/s 114 KiB/s 1.25 ms 183.44 us 2024-03-26T17:03:08.165 INFO:tasks.workunit.client.3.smithi157.stdout:myimage5 6/s 7/s 134 KiB/s 119 KiB/s 1.14 ms 166.52 us 2024-03-26T17:03:08.165 INFO:tasks.workunit.client.3.smithi157.stdout:myimage12 6/s 7/s 122 KiB/s 139 KiB/s 1.15 ms 176.53 us 2024-03-26T17:03:08.165 INFO:tasks.workunit.client.3.smithi157.stdout:myimage25 6/s 5/s 131 KiB/s 127 KiB/s 1.30 ms 176.51 us 2024-03-26T17:03:08.165 INFO:tasks.workunit.client.3.smithi157.stdout:myimage54 6/s 6/s 162 KiB/s 140 KiB/s 1.13 ms 186.74 us 2024-03-26T17:03:08.165 INFO:tasks.workunit.client.3.smithi157.stdout:myimage58 6/s 6/s 100 KiB/s 139 KiB/s 1.16 ms 188.73 us 2024-03-26T17:03:08.166 INFO:tasks.workunit.client.3.smithi157.stdout:myimage22 6/s 6/s 113 KiB/s 112 KiB/s 1.18 ms 175.11 us 2024-03-26T17:03:08.166 INFO:tasks.workunit.client.3.smithi157.stdout:myimage52 6/s 7/s 108 KiB/s 130 KiB/s 1.20 ms 169.70 us 2024-03-26T17:03:08.166 INFO:tasks.workunit.client.3.smithi157.stdout:myimage6 6/s 6/s 106 KiB/s 146 KiB/s 1.16 ms 164.42 us 2024-03-26T17:03:08.166 INFO:tasks.workunit.client.3.smithi157.stdout:myimage3 5/s 8/s 106 KiB/s 186 KiB/s 1.10 ms 159.35 us 2024-03-26T17:03:08.166 INFO:tasks.workunit.client.3.smithi157.stdout:myimage60 5/s 7/s 113 KiB/s 177 KiB/s 1.19 ms 179.27 us 2024-03-26T17:03:08.166 INFO:tasks.workunit.client.3.smithi157.stdout:myimage29 5/s 8/s 99 KiB/s 152 KiB/s 1.16 ms 187.47 us 2024-03-26T17:03:08.166 INFO:tasks.workunit.client.3.smithi157.stdout:myimage42 5/s 8/s 114 KiB/s 177 KiB/s 1.25 ms 211.71 us 2024-03-26T17:03:08.166 INFO:tasks.workunit.client.3.smithi157.stdout:myimage48 5/s 7/s 108 KiB/s 148 KiB/s 1.19 ms 182.28 us 2024-03-26T17:03:08.166 INFO:tasks.workunit.client.3.smithi157.stdout:myimage51 5/s 5/s 146 KiB/s 92 KiB/s 1.16 ms 176.18 us 2024-03-26T17:03:08.166 INFO:tasks.workunit.client.3.smithi157.stdout:myimage35 5/s 5/s 107 KiB/s 68 KiB/s 1.16 ms 152.00 us 2024-03-26T17:03:08.166 INFO:tasks.workunit.client.3.smithi157.stdout:myimage39 5/s 6/s 126 KiB/s 133 KiB/s 1.14 ms 192.99 us 2024-03-26T17:03:08.166 INFO:tasks.workunit.client.3.smithi157.stdout:myimage43 5/s 7/s 97 KiB/s 152 KiB/s 1.24 ms 201.80 us 2024-03-26T17:03:08.166 INFO:tasks.workunit.client.3.smithi157.stdout:myimage15 4/s 6/s 64 KiB/s 135 KiB/s 1.19 ms 175.46 us 2024-03-26T17:03:08.166 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:03:08.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:03:08 smithi044 ceph-mon[30624]: pgmap v515: 33 pgs: 33 active+clean; 1019 MiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 5.7 MiB/s rd, 5.8 MiB/s wr, 640 op/s 2024-03-26T17:03:08.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:03:08 smithi044 ceph-mon[30624]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:03:08.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:03:08 smithi044 ceph-mon[30624]: { 2024-03-26T17:03:08.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:03:08 smithi044 ceph-mon[30624]: "prefix": "rbd perf image stats", 2024-03-26T17:03:08.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:03:08 smithi044 ceph-mon[30624]: "pool_spec": "mypool", 2024-03-26T17:03:08.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:03:08 smithi044 ceph-mon[30624]: "sort_by": "write_ops", 2024-03-26T17:03:08.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:03:08 smithi044 ceph-mon[30624]: "format": "json" 2024-03-26T17:03:08.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:03:08 smithi044 ceph-mon[30624]: }"]: dispatch 2024-03-26T17:03:08.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:03:08 smithi064 ceph-mon[34420]: pgmap v515: 33 pgs: 33 active+clean; 1019 MiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 5.7 MiB/s rd, 5.8 MiB/s wr, 640 op/s 2024-03-26T17:03:08.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:03:08 smithi064 ceph-mon[34420]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:03:08.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:03:08 smithi064 ceph-mon[34420]: { 2024-03-26T17:03:08.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:03:08 smithi064 ceph-mon[34420]: "prefix": "rbd perf image stats", 2024-03-26T17:03:08.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:03:08 smithi064 ceph-mon[34420]: "pool_spec": "mypool", 2024-03-26T17:03:08.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:03:08 smithi064 ceph-mon[34420]: "sort_by": "write_ops", 2024-03-26T17:03:08.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:03:08 smithi064 ceph-mon[34420]: "format": "json" 2024-03-26T17:03:08.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:03:08 smithi064 ceph-mon[34420]: }"]: dispatch 2024-03-26T17:03:08.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:03:08 smithi149 ceph-mon[34678]: pgmap v515: 33 pgs: 33 active+clean; 1019 MiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 5.7 MiB/s rd, 5.8 MiB/s wr, 640 op/s 2024-03-26T17:03:08.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:03:08 smithi149 ceph-mon[34678]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:03:08.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:03:08 smithi149 ceph-mon[34678]: { 2024-03-26T17:03:08.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:03:08 smithi149 ceph-mon[34678]: "prefix": "rbd perf image stats", 2024-03-26T17:03:08.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:03:08 smithi149 ceph-mon[34678]: "pool_spec": "mypool", 2024-03-26T17:03:08.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:03:08 smithi149 ceph-mon[34678]: "sort_by": "write_ops", 2024-03-26T17:03:08.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:03:08 smithi149 ceph-mon[34678]: "format": "json" 2024-03-26T17:03:08.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:03:08 smithi149 ceph-mon[34678]: }"]: dispatch 2024-03-26T17:03:09.212 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:03:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:03:08] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:03:09.213 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:03:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:03:08] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:03:09.213 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:03:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:03:09.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:03:09 smithi149 ceph-mon[34678]: Health check update: 3 slow ops, oldest one blocked for 283 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:03:09.397 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:03:09 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:03:09] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:03:09.397 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:03:09 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:03:09] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:03:09.397 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:03:09 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:03:09.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:03:09 smithi044 ceph-mon[30624]: Health check update: 3 slow ops, oldest one blocked for 283 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:03:09.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:03:09 smithi064 ceph-mon[34420]: Health check update: 3 slow ops, oldest one blocked for 283 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:03:10.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:03:10 smithi044 ceph-mon[30624]: pgmap v516: 33 pgs: 33 active+clean; 1019 MiB data, 1.9 GiB used, 713 GiB / 715 GiB avail; 7.1 MiB/s rd, 7.2 MiB/s wr, 734 op/s 2024-03-26T17:03:10.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:03:10 smithi064 ceph-mon[34420]: pgmap v516: 33 pgs: 33 active+clean; 1019 MiB data, 1.9 GiB used, 713 GiB / 715 GiB avail; 7.1 MiB/s rd, 7.2 MiB/s wr, 734 op/s 2024-03-26T17:03:10.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:03:10 smithi149 ceph-mon[34678]: pgmap v516: 33 pgs: 33 active+clean; 1019 MiB data, 1.9 GiB used, 713 GiB / 715 GiB avail; 7.1 MiB/s rd, 7.2 MiB/s wr, 734 op/s 2024-03-26T17:03:11.265 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:03:10 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:03:10] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:03:11.265 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:03:10 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:03:10] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:03:11.266 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:03:10 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:03:11.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:03:11 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 2024-03-26T17:03:11.215+0000 7fa707a55700 -1 mon.c@1(peon) e3 get_health_metrics reporting 3 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T17:03:11.397 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:03:11 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:03:11] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:03:11.397 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:03:11 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:03:11] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:03:11.397 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:03:11 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:03:12.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:03:12 smithi044 ceph-mon[30624]: pgmap v517: 33 pgs: 33 active+clean; 1019 MiB data, 1.9 GiB used, 713 GiB / 715 GiB avail; 7.7 MiB/s rd, 7.5 MiB/s wr, 736 op/s 2024-03-26T17:03:12.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:03:12 smithi064 ceph-mon[34420]: pgmap v517: 33 pgs: 33 active+clean; 1019 MiB data, 1.9 GiB used, 713 GiB / 715 GiB avail; 7.7 MiB/s rd, 7.5 MiB/s wr, 736 op/s 2024-03-26T17:03:12.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:03:12 smithi149 ceph-mon[34678]: pgmap v517: 33 pgs: 33 active+clean; 1019 MiB data, 1.9 GiB used, 713 GiB / 715 GiB avail; 7.7 MiB/s rd, 7.5 MiB/s wr, 736 op/s 2024-03-26T17:03:13.061 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:03:13.069 INFO:tasks.workunit.client.3.smithi157.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2024-03-26T17:03:13.069 INFO:tasks.workunit.client.3.smithi157.stdout: 13.40 179.2k 205.2k 0.0k 1.8M 2.0M 0.0k nvme2n1 2024-03-26T17:03:13.069 INFO:tasks.workunit.client.3.smithi157.stdout: 13.30 159.2k 216.0k 0.0k 1.6M 2.1M 0.0k nvme2n10 2024-03-26T17:03:13.069 INFO:tasks.workunit.client.3.smithi157.stdout: 13.30 202.4k 181.6k 0.0k 2.0M 1.8M 0.0k nvme2n11 2024-03-26T17:03:13.069 INFO:tasks.workunit.client.3.smithi157.stdout: 13.30 200.0k 166.4k 0.0k 2.0M 1.6M 0.0k nvme2n12 2024-03-26T17:03:13.069 INFO:tasks.workunit.client.3.smithi157.stdout: 13.30 207.2k 138.0k 0.0k 2.0M 1.3M 0.0k nvme2n13 2024-03-26T17:03:13.069 INFO:tasks.workunit.client.3.smithi157.stdout: 13.30 165.6k 131.2k 0.0k 1.6M 1.3M 0.0k nvme2n14 2024-03-26T17:03:13.069 INFO:tasks.workunit.client.3.smithi157.stdout: 13.30 178.4k 172.4k 0.0k 1.7M 1.7M 0.0k nvme2n15 2024-03-26T17:03:13.069 INFO:tasks.workunit.client.3.smithi157.stdout: 13.30 173.2k 154.0k 0.0k 1.7M 1.5M 0.0k nvme2n16 2024-03-26T17:03:13.069 INFO:tasks.workunit.client.3.smithi157.stdout: 13.40 161.6k 179.2k 0.0k 1.6M 1.8M 0.0k nvme2n17 2024-03-26T17:03:13.069 INFO:tasks.workunit.client.3.smithi157.stdout: 13.40 182.8k 163.6k 0.0k 1.8M 1.6M 0.0k nvme2n18 2024-03-26T17:03:13.069 INFO:tasks.workunit.client.3.smithi157.stdout: 13.40 190.4k 165.6k 0.0k 1.9M 1.6M 0.0k nvme2n19 2024-03-26T17:03:13.070 INFO:tasks.workunit.client.3.smithi157.stdout: 13.30 207.2k 192.8k 0.0k 2.0M 1.9M 0.0k nvme2n2 2024-03-26T17:03:13.070 INFO:tasks.workunit.client.3.smithi157.stdout: 13.40 203.6k 203.2k 0.0k 2.0M 2.0M 0.0k nvme2n20 2024-03-26T17:03:13.070 INFO:tasks.workunit.client.3.smithi157.stdout: 13.30 205.6k 166.0k 0.0k 2.0M 1.6M 0.0k nvme2n3 2024-03-26T17:03:13.070 INFO:tasks.workunit.client.3.smithi157.stdout: 13.30 172.4k 185.6k 0.0k 1.7M 1.8M 0.0k nvme2n4 2024-03-26T17:03:13.070 INFO:tasks.workunit.client.3.smithi157.stdout: 13.30 162.0k 203.2k 0.0k 1.6M 2.0M 0.0k nvme2n5 2024-03-26T17:03:13.070 INFO:tasks.workunit.client.3.smithi157.stdout: 13.30 224.8k 149.2k 0.0k 2.2M 1.5M 0.0k nvme2n6 2024-03-26T17:03:13.070 INFO:tasks.workunit.client.3.smithi157.stdout: 13.30 175.2k 172.0k 0.0k 1.7M 1.7M 0.0k nvme2n7 2024-03-26T17:03:13.070 INFO:tasks.workunit.client.3.smithi157.stdout: 13.30 152.0k 146.8k 0.0k 1.5M 1.4M 0.0k nvme2n8 2024-03-26T17:03:13.070 INFO:tasks.workunit.client.3.smithi157.stdout: 13.30 180.4k 188.8k 0.0k 1.8M 1.8M 0.0k nvme2n9 2024-03-26T17:03:13.070 INFO:tasks.workunit.client.3.smithi157.stdout: 13.40 220.8k 188.8k 0.0k 2.2M 1.8M 0.0k nvme5n1 2024-03-26T17:03:13.070 INFO:tasks.workunit.client.3.smithi157.stdout: 13.30 195.6k 122.8k 0.0k 1.9M 1.2M 0.0k nvme5n10 2024-03-26T17:03:13.071 INFO:tasks.workunit.client.3.smithi157.stdout: 13.30 141.2k 225.6k 0.0k 1.4M 2.2M 0.0k nvme5n11 2024-03-26T17:03:13.071 INFO:tasks.workunit.client.3.smithi157.stdout: 13.30 144.8k 156.0k 0.0k 1.4M 1.5M 0.0k nvme5n12 2024-03-26T17:03:13.071 INFO:tasks.workunit.client.3.smithi157.stdout: 13.30 185.2k 207.6k 0.0k 1.8M 2.0M 0.0k nvme5n13 2024-03-26T17:03:13.071 INFO:tasks.workunit.client.3.smithi157.stdout: 13.30 161.2k 169.6k 0.0k 1.6M 1.7M 0.0k nvme5n14 2024-03-26T17:03:13.071 INFO:tasks.workunit.client.3.smithi157.stdout: 13.30 178.0k 162.4k 0.0k 1.7M 1.6M 0.0k nvme5n15 2024-03-26T17:03:13.071 INFO:tasks.workunit.client.3.smithi157.stdout: 13.30 213.2k 178.4k 0.0k 2.1M 1.7M 0.0k nvme5n16 2024-03-26T17:03:13.071 INFO:tasks.workunit.client.3.smithi157.stdout: 13.40 190.0k 208.4k 0.0k 1.9M 2.0M 0.0k nvme5n17 2024-03-26T17:03:13.071 INFO:tasks.workunit.client.3.smithi157.stdout: 13.40 159.2k 146.8k 0.0k 1.6M 1.4M 0.0k nvme5n18 2024-03-26T17:03:13.071 INFO:tasks.workunit.client.3.smithi157.stdout: 13.40 170.8k 211.2k 0.0k 1.7M 2.1M 0.0k nvme5n19 2024-03-26T17:03:13.071 INFO:tasks.workunit.client.3.smithi157.stdout: 13.30 134.0k 187.2k 0.0k 1.3M 1.8M 0.0k nvme5n2 2024-03-26T17:03:13.071 INFO:tasks.workunit.client.3.smithi157.stdout: 13.40 160.8k 152.4k 0.0k 1.6M 1.5M 0.0k nvme5n20 2024-03-26T17:03:13.071 INFO:tasks.workunit.client.3.smithi157.stdout: 13.30 140.0k 144.0k 0.0k 1.4M 1.4M 0.0k nvme5n3 2024-03-26T17:03:13.071 INFO:tasks.workunit.client.3.smithi157.stdout: 13.30 159.6k 135.2k 0.0k 1.6M 1.3M 0.0k nvme5n4 2024-03-26T17:03:13.071 INFO:tasks.workunit.client.3.smithi157.stdout: 13.30 195.6k 168.8k 0.0k 1.9M 1.6M 0.0k nvme5n5 2024-03-26T17:03:13.071 INFO:tasks.workunit.client.3.smithi157.stdout: 13.30 180.0k 179.2k 0.0k 1.8M 1.8M 0.0k nvme5n6 2024-03-26T17:03:13.072 INFO:tasks.workunit.client.3.smithi157.stdout: 13.30 209.6k 151.6k 0.0k 2.0M 1.5M 0.0k nvme5n7 2024-03-26T17:03:13.072 INFO:tasks.workunit.client.3.smithi157.stdout: 13.30 154.0k 146.4k 0.0k 1.5M 1.4M 0.0k nvme5n8 2024-03-26T17:03:13.072 INFO:tasks.workunit.client.3.smithi157.stdout: 13.30 177.2k 207.2k 0.0k 1.7M 2.0M 0.0k nvme5n9 2024-03-26T17:03:13.072 INFO:tasks.workunit.client.3.smithi157.stdout: 13.40 170.8k 177.6k 0.0k 1.7M 1.7M 0.0k nvme8n1 2024-03-26T17:03:13.072 INFO:tasks.workunit.client.3.smithi157.stdout: 13.30 216.8k 185.2k 0.0k 2.1M 1.8M 0.0k nvme8n10 2024-03-26T17:03:13.072 INFO:tasks.workunit.client.3.smithi157.stdout: 13.30 196.4k 223.6k 0.0k 1.9M 2.2M 0.0k nvme8n11 2024-03-26T17:03:13.072 INFO:tasks.workunit.client.3.smithi157.stdout: 13.30 178.4k 163.2k 0.0k 1.7M 1.6M 0.0k nvme8n12 2024-03-26T17:03:13.072 INFO:tasks.workunit.client.3.smithi157.stdout: 13.30 181.6k 158.0k 0.0k 1.8M 1.5M 0.0k nvme8n13 2024-03-26T17:03:13.072 INFO:tasks.workunit.client.3.smithi157.stdout: 13.30 214.0k 202.0k 0.0k 2.1M 2.0M 0.0k nvme8n14 2024-03-26T17:03:13.072 INFO:tasks.workunit.client.3.smithi157.stdout: 13.30 145.2k 210.4k 0.0k 1.4M 2.1M 0.0k nvme8n15 2024-03-26T17:03:13.072 INFO:tasks.workunit.client.3.smithi157.stdout: 13.40 173.6k 197.6k 0.0k 1.7M 1.9M 0.0k nvme8n16 2024-03-26T17:03:13.072 INFO:tasks.workunit.client.3.smithi157.stdout: 13.40 209.6k 143.2k 0.0k 2.0M 1.4M 0.0k nvme8n17 2024-03-26T17:03:13.072 INFO:tasks.workunit.client.3.smithi157.stdout: 13.40 192.8k 181.2k 0.0k 1.9M 1.8M 0.0k nvme8n18 2024-03-26T17:03:13.072 INFO:tasks.workunit.client.3.smithi157.stdout: 13.40 134.4k 235.2k 0.0k 1.3M 2.3M 0.0k nvme8n19 2024-03-26T17:03:13.072 INFO:tasks.workunit.client.3.smithi157.stdout: 13.30 254.4k 153.6k 0.0k 2.5M 1.5M 0.0k nvme8n2 2024-03-26T17:03:13.073 INFO:tasks.workunit.client.3.smithi157.stdout: 13.40 166.4k 174.0k 0.0k 1.6M 1.7M 0.0k nvme8n20 2024-03-26T17:03:13.073 INFO:tasks.workunit.client.3.smithi157.stdout: 13.30 168.8k 180.0k 0.0k 1.6M 1.8M 0.0k nvme8n3 2024-03-26T17:03:13.073 INFO:tasks.workunit.client.3.smithi157.stdout: 13.30 198.0k 184.4k 0.0k 1.9M 1.8M 0.0k nvme8n4 2024-03-26T17:03:13.073 INFO:tasks.workunit.client.3.smithi157.stdout: 13.30 158.8k 180.0k 0.0k 1.6M 1.8M 0.0k nvme8n5 2024-03-26T17:03:13.073 INFO:tasks.workunit.client.3.smithi157.stdout: 13.30 173.6k 183.2k 0.0k 1.7M 1.8M 0.0k nvme8n6 2024-03-26T17:03:13.073 INFO:tasks.workunit.client.3.smithi157.stdout: 13.30 196.4k 176.4k 0.0k 1.9M 1.7M 0.0k nvme8n7 2024-03-26T17:03:13.073 INFO:tasks.workunit.client.3.smithi157.stdout: 13.30 223.2k 188.4k 0.0k 2.2M 1.8M 0.0k nvme8n8 2024-03-26T17:03:13.073 INFO:tasks.workunit.client.3.smithi157.stdout: 13.30 156.0k 139.6k 0.0k 1.5M 1.4M 0.0k nvme8n9 2024-03-26T17:03:13.073 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:03:13.166 INFO:tasks.workunit.client.3.smithi157.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-26T17:03:13.166 INFO:tasks.workunit.client.3.smithi157.stdout:myimage22 9/s 7/s 183 KiB/s 164 KiB/s 1.30 ms 232.71 us 2024-03-26T17:03:13.166 INFO:tasks.workunit.client.3.smithi157.stdout:myimage10 8/s 7/s 264 KiB/s 210 KiB/s 1.20 ms 245.25 us 2024-03-26T17:03:13.166 INFO:tasks.workunit.client.3.smithi157.stdout:myimage15 8/s 7/s 251 KiB/s 214 KiB/s 1.29 ms 260.48 us 2024-03-26T17:03:13.166 INFO:tasks.workunit.client.3.smithi157.stdout:myimage43 8/s 6/s 226 KiB/s 186 KiB/s 1.27 ms 369.59 us 2024-03-26T17:03:13.166 INFO:tasks.workunit.client.3.smithi157.stdout:myimage1 8/s 6/s 250 KiB/s 171 KiB/s 1.16 ms 249.13 us 2024-03-26T17:03:13.166 INFO:tasks.workunit.client.3.smithi157.stdout:myimage4 8/s 7/s 183 KiB/s 225 KiB/s 1.19 ms 247.14 us 2024-03-26T17:03:13.166 INFO:tasks.workunit.client.3.smithi157.stdout:myimage2 8/s 7/s 243 KiB/s 218 KiB/s 1.29 ms 305.38 us 2024-03-26T17:03:13.166 INFO:tasks.workunit.client.3.smithi157.stdout:myimage59 8/s 4/s 218 KiB/s 117 KiB/s 1.20 ms 261.65 us 2024-03-26T17:03:13.166 INFO:tasks.workunit.client.3.smithi157.stdout:myimage5 7/s 6/s 226 KiB/s 198 KiB/s 1.18 ms 246.30 us 2024-03-26T17:03:13.167 INFO:tasks.workunit.client.3.smithi157.stdout:myimage12 7/s 6/s 200 KiB/s 214 KiB/s 1.18 ms 326.32 us 2024-03-26T17:03:13.167 INFO:tasks.workunit.client.3.smithi157.stdout:myimage51 7/s 6/s 253 KiB/s 182 KiB/s 1.23 ms 342.10 us 2024-03-26T17:03:13.167 INFO:tasks.workunit.client.3.smithi157.stdout:myimage16 7/s 7/s 187 KiB/s 169 KiB/s 1.25 ms 224.26 us 2024-03-26T17:03:13.167 INFO:tasks.workunit.client.3.smithi157.stdout:myimage38 7/s 5/s 138 KiB/s 110 KiB/s 1.17 ms 213.45 us 2024-03-26T17:03:13.167 INFO:tasks.workunit.client.3.smithi157.stdout:myimage29 7/s 5/s 245 KiB/s 133 KiB/s 1.17 ms 294.30 us 2024-03-26T17:03:13.167 INFO:tasks.workunit.client.3.smithi157.stdout:myimage45 7/s 6/s 201 KiB/s 169 KiB/s 1.22 ms 223.82 us 2024-03-26T17:03:13.167 INFO:tasks.workunit.client.3.smithi157.stdout:myimage41 7/s 8/s 217 KiB/s 206 KiB/s 1.25 ms 207.23 us 2024-03-26T17:03:13.167 INFO:tasks.workunit.client.3.smithi157.stdout:myimage35 7/s 10/s 227 KiB/s 218 KiB/s 1.19 ms 229.24 us 2024-03-26T17:03:13.167 INFO:tasks.workunit.client.3.smithi157.stdout:myimage33 7/s 6/s 233 KiB/s 186 KiB/s 1.24 ms 262.14 us 2024-03-26T17:03:13.167 INFO:tasks.workunit.client.3.smithi157.stdout:myimage49 6/s 6/s 168 KiB/s 141 KiB/s 1.19 ms 256.12 us 2024-03-26T17:03:13.167 INFO:tasks.workunit.client.3.smithi157.stdout:myimage58 6/s 6/s 211 KiB/s 178 KiB/s 1.20 ms 250.68 us 2024-03-26T17:03:13.167 INFO:tasks.workunit.client.3.smithi157.stdout:myimage18 6/s 7/s 198 KiB/s 170 KiB/s 1.23 ms 256.48 us 2024-03-26T17:03:13.167 INFO:tasks.workunit.client.3.smithi157.stdout:myimage56 6/s 7/s 226 KiB/s 202 KiB/s 1.21 ms 310.03 us 2024-03-26T17:03:13.167 INFO:tasks.workunit.client.3.smithi157.stdout:myimage60 6/s 6/s 189 KiB/s 150 KiB/s 1.25 ms 237.43 us 2024-03-26T17:03:13.167 INFO:tasks.workunit.client.3.smithi157.stdout:myimage40 6/s 5/s 155 KiB/s 142 KiB/s 1.16 ms 331.41 us 2024-03-26T17:03:13.168 INFO:tasks.workunit.client.3.smithi157.stdout:myimage47 6/s 7/s 198 KiB/s 209 KiB/s 1.23 ms 263.25 us 2024-03-26T17:03:13.168 INFO:tasks.workunit.client.3.smithi157.stdout:myimage20 6/s 6/s 210 KiB/s 187 KiB/s 1.22 ms 281.80 us 2024-03-26T17:03:13.168 INFO:tasks.workunit.client.3.smithi157.stdout:myimage25 6/s 8/s 168 KiB/s 208 KiB/s 1.30 ms 228.36 us 2024-03-26T17:03:13.168 INFO:tasks.workunit.client.3.smithi157.stdout:myimage3 6/s 6/s 204 KiB/s 219 KiB/s 1.31 ms 332.28 us 2024-03-26T17:03:13.168 INFO:tasks.workunit.client.3.smithi157.stdout:myimage37 6/s 7/s 212 KiB/s 184 KiB/s 1.32 ms 341.74 us 2024-03-26T17:03:13.168 INFO:tasks.workunit.client.3.smithi157.stdout:myimage17 6/s 6/s 200 KiB/s 170 KiB/s 1.26 ms 260.98 us 2024-03-26T17:03:13.168 INFO:tasks.workunit.client.3.smithi157.stdout:myimage24 6/s 5/s 160 KiB/s 121 KiB/s 1.19 ms 239.95 us 2024-03-26T17:03:13.168 INFO:tasks.workunit.client.3.smithi157.stdout:myimage46 6/s 4/s 198 KiB/s 158 KiB/s 1.25 ms 346.86 us 2024-03-26T17:03:13.168 INFO:tasks.workunit.client.3.smithi157.stdout:myimage48 6/s 7/s 236 KiB/s 235 KiB/s 1.30 ms 339.53 us 2024-03-26T17:03:13.168 INFO:tasks.workunit.client.3.smithi157.stdout:myimage52 6/s 8/s 147 KiB/s 224 KiB/s 1.30 ms 242.70 us 2024-03-26T17:03:13.168 INFO:tasks.workunit.client.3.smithi157.stdout:myimage11 6/s 7/s 197 KiB/s 218 KiB/s 1.29 ms 272.66 us 2024-03-26T17:03:13.168 INFO:tasks.workunit.client.3.smithi157.stdout:myimage53 6/s 7/s 146 KiB/s 173 KiB/s 1.24 ms 252.77 us 2024-03-26T17:03:13.169 INFO:tasks.workunit.client.3.smithi157.stdout:myimage7 5/s 5/s 160 KiB/s 146 KiB/s 1.21 ms 328.15 us 2024-03-26T17:03:13.169 INFO:tasks.workunit.client.3.smithi157.stdout:myimage8 5/s 6/s 96 KiB/s 144 KiB/s 1.23 ms 209.02 us 2024-03-26T17:03:13.169 INFO:tasks.workunit.client.3.smithi157.stdout:myimage50 5/s 7/s 200 KiB/s 189 KiB/s 1.34 ms 276.33 us 2024-03-26T17:03:13.169 INFO:tasks.workunit.client.3.smithi157.stdout:myimage54 5/s 6/s 208 KiB/s 220 KiB/s 1.26 ms 270.06 us 2024-03-26T17:03:13.170 INFO:tasks.workunit.client.3.smithi157.stdout:myimage36 5/s 5/s 158 KiB/s 210 KiB/s 1.18 ms 397.16 us 2024-03-26T17:03:13.170 INFO:tasks.workunit.client.3.smithi157.stdout:myimage39 5/s 9/s 202 KiB/s 216 KiB/s 1.21 ms 298.55 us 2024-03-26T17:03:13.170 INFO:tasks.workunit.client.3.smithi157.stdout:myimage55 5/s 5/s 199 KiB/s 121 KiB/s 1.25 ms 310.08 us 2024-03-26T17:03:13.170 INFO:tasks.workunit.client.3.smithi157.stdout:myimage13 5/s 5/s 158 KiB/s 153 KiB/s 1.21 ms 301.79 us 2024-03-26T17:03:13.170 INFO:tasks.workunit.client.3.smithi157.stdout:myimage31 5/s 4/s 205 KiB/s 108 KiB/s 1.26 ms 265.95 us 2024-03-26T17:03:13.170 INFO:tasks.workunit.client.3.smithi157.stdout:myimage32 5/s 7/s 124 KiB/s 139 KiB/s 1.28 ms 194.74 us 2024-03-26T17:03:13.171 INFO:tasks.workunit.client.3.smithi157.stdout:myimage26 5/s 6/s 175 KiB/s 181 KiB/s 1.27 ms 285.40 us 2024-03-26T17:03:13.171 INFO:tasks.workunit.client.3.smithi157.stdout:myimage21 5/s 7/s 163 KiB/s 202 KiB/s 1.30 ms 354.12 us 2024-03-26T17:03:13.171 INFO:tasks.workunit.client.3.smithi157.stdout:myimage23 5/s 5/s 105 KiB/s 103 KiB/s 1.14 ms 211.47 us 2024-03-26T17:03:13.171 INFO:tasks.workunit.client.3.smithi157.stdout:myimage34 5/s 4/s 114 KiB/s 129 KiB/s 1.18 ms 319.28 us 2024-03-26T17:03:13.171 INFO:tasks.workunit.client.3.smithi157.stdout:myimage9 5/s 6/s 149 KiB/s 182 KiB/s 1.25 ms 356.44 us 2024-03-26T17:03:13.171 INFO:tasks.workunit.client.3.smithi157.stdout:myimage14 4/s 8/s 123 KiB/s 166 KiB/s 1.28 ms 287.56 us 2024-03-26T17:03:13.171 INFO:tasks.workunit.client.3.smithi157.stdout:myimage30 4/s 7/s 98 KiB/s 147 KiB/s 1.33 ms 225.22 us 2024-03-26T17:03:13.171 INFO:tasks.workunit.client.3.smithi157.stdout:myimage19 4/s 5/s 117 KiB/s 155 KiB/s 1.25 ms 247.43 us 2024-03-26T17:03:13.171 INFO:tasks.workunit.client.3.smithi157.stdout:myimage44 4/s 6/s 136 KiB/s 193 KiB/s 1.27 ms 248.99 us 2024-03-26T17:03:13.171 INFO:tasks.workunit.client.3.smithi157.stdout:myimage6 4/s 10/s 150 KiB/s 262 KiB/s 1.27 ms 219.58 us 2024-03-26T17:03:13.171 INFO:tasks.workunit.client.3.smithi157.stdout:myimage28 4/s 8/s 109 KiB/s 188 KiB/s 1.28 ms 176.35 us 2024-03-26T17:03:13.171 INFO:tasks.workunit.client.3.smithi157.stdout:myimage57 4/s 6/s 100 KiB/s 211 KiB/s 1.20 ms 297.09 us 2024-03-26T17:03:13.171 INFO:tasks.workunit.client.3.smithi157.stdout:myimage42 4/s 6/s 120 KiB/s 241 KiB/s 1.54 ms 346.37 us 2024-03-26T17:03:13.171 INFO:tasks.workunit.client.3.smithi157.stdout:myimage27 3/s 6/s 110 KiB/s 162 KiB/s 1.18 ms 312.46 us 2024-03-26T17:03:13.171 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:03:13.265 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:03:12 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:03:12] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:03:13.265 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:03:12 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:03:12] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:03:13.266 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:03:12 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:03:13.397 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:03:13 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:03:13] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:03:13.397 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:03:13 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:03:13] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:03:13.398 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:03:13 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:03:13.896 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:03:13 smithi149 ceph-mon[34678]: Health check update: 3 slow ops, oldest one blocked for 288 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:03:14.015 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:03:13 smithi044 ceph-mon[30624]: Health check update: 3 slow ops, oldest one blocked for 288 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:03:14.055 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:03:13 smithi064 ceph-mon[34420]: Health check update: 3 slow ops, oldest one blocked for 288 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:03:14.896 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:03:14 smithi149 ceph-mon[34678]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:03:14.896 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:03:14 smithi149 ceph-mon[34678]: { 2024-03-26T17:03:14.896 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:03:14 smithi149 ceph-mon[34678]: "prefix": "rbd perf image stats", 2024-03-26T17:03:14.896 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:03:14 smithi149 ceph-mon[34678]: "pool_spec": "mypool", 2024-03-26T17:03:14.896 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:03:14 smithi149 ceph-mon[34678]: "sort_by": "write_ops", 2024-03-26T17:03:14.896 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:03:14 smithi149 ceph-mon[34678]: "format": "json" 2024-03-26T17:03:14.896 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:03:14 smithi149 ceph-mon[34678]: }"]: dispatch 2024-03-26T17:03:14.896 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:03:14 smithi149 ceph-mon[34678]: pgmap v518: 33 pgs: 33 active+clean; 1020 MiB data, 1.9 GiB used, 713 GiB / 715 GiB avail; 9.9 MiB/s rd, 10 MiB/s wr, 875 op/s 2024-03-26T17:03:14.916 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:03:14 smithi044 ceph-mon[30624]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:03:14.916 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:03:14 smithi044 ceph-mon[30624]: { 2024-03-26T17:03:14.917 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:03:14 smithi044 ceph-mon[30624]: "prefix": "rbd perf image stats", 2024-03-26T17:03:14.917 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:03:14 smithi044 ceph-mon[30624]: "pool_spec": "mypool", 2024-03-26T17:03:14.917 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:03:14 smithi044 ceph-mon[30624]: "sort_by": "write_ops", 2024-03-26T17:03:14.917 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:03:14 smithi044 ceph-mon[30624]: "format": "json" 2024-03-26T17:03:14.917 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:03:14 smithi044 ceph-mon[30624]: }"]: dispatch 2024-03-26T17:03:14.917 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:03:14 smithi044 ceph-mon[30624]: pgmap v518: 33 pgs: 33 active+clean; 1020 MiB data, 1.9 GiB used, 713 GiB / 715 GiB avail; 9.9 MiB/s rd, 10 MiB/s wr, 875 op/s 2024-03-26T17:03:14.917 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:03:14 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:03:14] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:03:14.917 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:03:14 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:03:14] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:03:14.918 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:03:14 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:03:15.055 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:03:14 smithi064 ceph-mon[34420]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:03:15.055 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:03:14 smithi064 ceph-mon[34420]: { 2024-03-26T17:03:15.055 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:03:14 smithi064 ceph-mon[34420]: "prefix": "rbd perf image stats", 2024-03-26T17:03:15.056 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:03:14 smithi064 ceph-mon[34420]: "pool_spec": "mypool", 2024-03-26T17:03:15.056 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:03:14 smithi064 ceph-mon[34420]: "sort_by": "write_ops", 2024-03-26T17:03:15.056 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:03:14 smithi064 ceph-mon[34420]: "format": "json" 2024-03-26T17:03:15.056 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:03:14 smithi064 ceph-mon[34420]: }"]: dispatch 2024-03-26T17:03:15.056 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:03:14 smithi064 ceph-mon[34420]: pgmap v518: 33 pgs: 33 active+clean; 1020 MiB data, 1.9 GiB used, 713 GiB / 715 GiB avail; 9.9 MiB/s rd, 10 MiB/s wr, 875 op/s 2024-03-26T17:03:15.646 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:03:15 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:03:15] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:03:15.647 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:03:15 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:03:15] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:03:15.647 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:03:15 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:03:16.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:03:16 smithi044 ceph-mon[30624]: pgmap v519: 33 pgs: 33 active+clean; 1020 MiB data, 1.9 GiB used, 713 GiB / 715 GiB avail; 9.6 MiB/s rd, 9.9 MiB/s wr, 786 op/s 2024-03-26T17:03:16.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:03:16 smithi064 ceph-mon[34420]: pgmap v519: 33 pgs: 33 active+clean; 1020 MiB data, 1.9 GiB used, 713 GiB / 715 GiB avail; 9.6 MiB/s rd, 9.9 MiB/s wr, 786 op/s 2024-03-26T17:03:16.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:03:16 smithi149 ceph-mon[34678]: pgmap v519: 33 pgs: 33 active+clean; 1020 MiB data, 1.9 GiB used, 713 GiB / 715 GiB avail; 9.6 MiB/s rd, 9.9 MiB/s wr, 786 op/s 2024-03-26T17:03:16.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:03:16 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 2024-03-26T17:03:16.215+0000 7fa707a55700 -1 mon.c@1(peon) e3 get_health_metrics reporting 3 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T17:03:17.265 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:03:16 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:03:16] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:03:17.266 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:03:16 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:03:16] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:03:17.266 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:03:16 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:03:17.547 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:03:17 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:03:17] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:03:17.548 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:03:17 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:03:17] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:03:17.548 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:03:17 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:03:18.170 INFO:tasks.workunit.client.3.smithi157.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-26T17:03:18.170 INFO:tasks.workunit.client.3.smithi157.stdout:myimage33 8/s 3/s 230 KiB/s 122 KiB/s 1.25 ms 342.40 us 2024-03-26T17:03:18.170 INFO:tasks.workunit.client.3.smithi157.stdout:myimage2 7/s 6/s 214 KiB/s 192 KiB/s 1.34 ms 355.04 us 2024-03-26T17:03:18.171 INFO:tasks.workunit.client.3.smithi157.stdout:myimage52 7/s 3/s 217 KiB/s 114 KiB/s 1.42 ms 310.18 us 2024-03-26T17:03:18.171 INFO:tasks.workunit.client.3.smithi157.stdout:myimage5 7/s 5/s 286 KiB/s 153 KiB/s 1.26 ms 355.06 us 2024-03-26T17:03:18.171 INFO:tasks.workunit.client.3.smithi157.stdout:myimage22 7/s 5/s 264 KiB/s 150 KiB/s 1.32 ms 339.94 us 2024-03-26T17:03:18.171 INFO:tasks.workunit.client.3.smithi157.stdout:myimage8 7/s 5/s 242 KiB/s 174 KiB/s 1.21 ms 351.50 us 2024-03-26T17:03:18.171 INFO:tasks.workunit.client.3.smithi157.stdout:myimage23 7/s 4/s 229 KiB/s 172 KiB/s 1.22 ms 285.79 us 2024-03-26T17:03:18.171 INFO:tasks.workunit.client.3.smithi157.stdout:myimage30 7/s 5/s 208 KiB/s 186 KiB/s 1.40 ms 281.79 us 2024-03-26T17:03:18.172 INFO:tasks.workunit.client.3.smithi157.stdout:myimage9 7/s 6/s 190 KiB/s 211 KiB/s 1.26 ms 350.39 us 2024-03-26T17:03:18.172 INFO:tasks.workunit.client.3.smithi157.stdout:myimage15 7/s 5/s 251 KiB/s 215 KiB/s 1.28 ms 285.23 us 2024-03-26T17:03:18.172 INFO:tasks.workunit.client.3.smithi157.stdout:myimage42 7/s 6/s 218 KiB/s 230 KiB/s 1.24 ms 314.62 us 2024-03-26T17:03:18.172 INFO:tasks.workunit.client.3.smithi157.stdout:myimage59 7/s 4/s 230 KiB/s 87 KiB/s 1.23 ms 294.87 us 2024-03-26T17:03:18.172 INFO:tasks.workunit.client.3.smithi157.stdout:myimage31 7/s 6/s 253 KiB/s 182 KiB/s 1.36 ms 298.24 us 2024-03-26T17:03:18.172 INFO:tasks.workunit.client.3.smithi157.stdout:myimage6 7/s 5/s 207 KiB/s 192 KiB/s 1.25 ms 257.91 us 2024-03-26T17:03:18.173 INFO:tasks.workunit.client.3.smithi157.stdout:myimage12 7/s 5/s 218 KiB/s 164 KiB/s 1.34 ms 339.41 us 2024-03-26T17:03:18.173 INFO:tasks.workunit.client.3.smithi157.stdout:myimage20 7/s 5/s 198 KiB/s 138 KiB/s 1.26 ms 299.77 us 2024-03-26T17:03:18.173 INFO:tasks.workunit.client.3.smithi157.stdout:myimage55 7/s 5/s 203 KiB/s 134 KiB/s 1.29 ms 284.78 us 2024-03-26T17:03:18.173 INFO:tasks.workunit.client.3.smithi157.stdout:myimage37 6/s 5/s 228 KiB/s 185 KiB/s 1.31 ms 331.56 us 2024-03-26T17:03:18.173 INFO:tasks.workunit.client.3.smithi157.stdout:myimage24 6/s 5/s 185 KiB/s 145 KiB/s 1.28 ms 285.98 us 2024-03-26T17:03:18.174 INFO:tasks.workunit.client.3.smithi157.stdout:myimage29 6/s 5/s 182 KiB/s 162 KiB/s 1.17 ms 285.08 us 2024-03-26T17:03:18.174 INFO:tasks.workunit.client.3.smithi157.stdout:myimage36 6/s 6/s 186 KiB/s 180 KiB/s 1.23 ms 362.57 us 2024-03-26T17:03:18.174 INFO:tasks.workunit.client.3.smithi157.stdout:myimage39 6/s 5/s 209 KiB/s 154 KiB/s 1.22 ms 343.47 us 2024-03-26T17:03:18.174 INFO:tasks.workunit.client.3.smithi157.stdout:myimage57 6/s 5/s 218 KiB/s 174 KiB/s 1.24 ms 256.23 us 2024-03-26T17:03:18.174 INFO:tasks.workunit.client.3.smithi157.stdout:myimage3 6/s 6/s 190 KiB/s 190 KiB/s 1.23 ms 326.84 us 2024-03-26T17:03:18.174 INFO:tasks.workunit.client.3.smithi157.stdout:myimage44 6/s 6/s 215 KiB/s 200 KiB/s 1.30 ms 315.18 us 2024-03-26T17:03:18.175 INFO:tasks.workunit.client.3.smithi157.stdout:myimage11 6/s 5/s 198 KiB/s 143 KiB/s 1.34 ms 283.71 us 2024-03-26T17:03:18.175 INFO:tasks.workunit.client.3.smithi157.stdout:myimage17 6/s 5/s 180 KiB/s 174 KiB/s 1.27 ms 285.13 us 2024-03-26T17:03:18.175 INFO:tasks.workunit.client.3.smithi157.stdout:myimage21 6/s 5/s 232 KiB/s 192 KiB/s 1.38 ms 298.08 us 2024-03-26T17:03:18.175 INFO:tasks.workunit.client.3.smithi157.stdout:myimage28 6/s 4/s 214 KiB/s 119 KiB/s 1.40 ms 346.87 us 2024-03-26T17:03:18.175 INFO:tasks.workunit.client.3.smithi157.stdout:myimage10 6/s 5/s 193 KiB/s 142 KiB/s 1.24 ms 348.50 us 2024-03-26T17:03:18.176 INFO:tasks.workunit.client.3.smithi157.stdout:myimage58 6/s 5/s 165 KiB/s 148 KiB/s 1.21 ms 280.05 us 2024-03-26T17:03:18.176 INFO:tasks.workunit.client.3.smithi157.stdout:myimage4 6/s 5/s 186 KiB/s 117 KiB/s 1.21 ms 396.45 us 2024-03-26T17:03:18.176 INFO:tasks.workunit.client.3.smithi157.stdout:myimage45 6/s 6/s 204 KiB/s 148 KiB/s 1.35 ms 287.72 us 2024-03-26T17:03:18.176 INFO:tasks.workunit.client.3.smithi157.stdout:myimage53 6/s 5/s 175 KiB/s 149 KiB/s 1.24 ms 360.46 us 2024-03-26T17:03:18.176 INFO:tasks.workunit.client.3.smithi157.stdout:myimage60 6/s 6/s 206 KiB/s 198 KiB/s 1.29 ms 355.23 us 2024-03-26T17:03:18.176 INFO:tasks.workunit.client.3.smithi157.stdout:myimage32 6/s 5/s 186 KiB/s 155 KiB/s 1.33 ms 460.64 us 2024-03-26T17:03:18.177 INFO:tasks.workunit.client.3.smithi157.stdout:myimage34 6/s 7/s 183 KiB/s 196 KiB/s 1.24 ms 306.58 us 2024-03-26T17:03:18.177 INFO:tasks.workunit.client.3.smithi157.stdout:myimage48 6/s 7/s 162 KiB/s 244 KiB/s 1.35 ms 277.36 us 2024-03-26T17:03:18.177 INFO:tasks.workunit.client.3.smithi157.stdout:myimage18 6/s 6/s 170 KiB/s 193 KiB/s 1.23 ms 305.33 us 2024-03-26T17:03:18.178 INFO:tasks.workunit.client.3.smithi157.stdout:myimage41 6/s 4/s 196 KiB/s 143 KiB/s 1.27 ms 311.37 us 2024-03-26T17:03:18.178 INFO:tasks.workunit.client.3.smithi157.stdout:myimage56 6/s 6/s 169 KiB/s 163 KiB/s 1.35 ms 303.38 us 2024-03-26T17:03:18.178 INFO:tasks.workunit.client.3.smithi157.stdout:myimage19 5/s 6/s 176 KiB/s 154 KiB/s 1.31 ms 304.89 us 2024-03-26T17:03:18.178 INFO:tasks.workunit.client.3.smithi157.stdout:myimage46 5/s 8/s 170 KiB/s 207 KiB/s 1.25 ms 304.98 us 2024-03-26T17:03:18.178 INFO:tasks.workunit.client.3.smithi157.stdout:myimage47 5/s 5/s 186 KiB/s 139 KiB/s 1.27 ms 279.19 us 2024-03-26T17:03:18.179 INFO:tasks.workunit.client.3.smithi157.stdout:myimage1 5/s 7/s 184 KiB/s 220 KiB/s 1.18 ms 293.33 us 2024-03-26T17:03:18.179 INFO:tasks.workunit.client.3.smithi157.stdout:myimage26 5/s 6/s 158 KiB/s 208 KiB/s 1.28 ms 341.81 us 2024-03-26T17:03:18.179 INFO:tasks.workunit.client.3.smithi157.stdout:myimage40 5/s 5/s 142 KiB/s 157 KiB/s 1.27 ms 391.85 us 2024-03-26T17:03:18.179 INFO:tasks.workunit.client.3.smithi157.stdout:myimage7 5/s 7/s 192 KiB/s 238 KiB/s 1.29 ms 325.51 us 2024-03-26T17:03:18.179 INFO:tasks.workunit.client.3.smithi157.stdout:myimage25 5/s 7/s 163 KiB/s 210 KiB/s 1.38 ms 291.61 us 2024-03-26T17:03:18.180 INFO:tasks.workunit.client.3.smithi157.stdout:myimage50 5/s 7/s 157 KiB/s 215 KiB/s 1.32 ms 284.66 us 2024-03-26T17:03:18.180 INFO:tasks.workunit.client.3.smithi157.stdout:myimage51 5/s 7/s 144 KiB/s 195 KiB/s 1.32 ms 314.94 us 2024-03-26T17:03:18.180 INFO:tasks.workunit.client.3.smithi157.stdout:myimage13 5/s 6/s 168 KiB/s 237 KiB/s 1.22 ms 313.51 us 2024-03-26T17:03:18.180 INFO:tasks.workunit.client.3.smithi157.stdout:myimage27 5/s 6/s 171 KiB/s 193 KiB/s 1.20 ms 285.11 us 2024-03-26T17:03:18.180 INFO:tasks.workunit.client.3.smithi157.stdout:myimage14 5/s 6/s 146 KiB/s 164 KiB/s 1.36 ms 269.42 us 2024-03-26T17:03:18.180 INFO:tasks.workunit.client.3.smithi157.stdout:myimage16 5/s 8/s 160 KiB/s 219 KiB/s 1.23 ms 283.34 us 2024-03-26T17:03:18.181 INFO:tasks.workunit.client.3.smithi157.stdout:myimage49 5/s 7/s 181 KiB/s 208 KiB/s 1.34 ms 327.76 us 2024-03-26T17:03:18.181 INFO:tasks.workunit.client.3.smithi157.stdout:myimage43 5/s 6/s 150 KiB/s 166 KiB/s 1.29 ms 390.15 us 2024-03-26T17:03:18.181 INFO:tasks.workunit.client.3.smithi157.stdout:myimage54 5/s 8/s 147 KiB/s 219 KiB/s 1.26 ms 334.81 us 2024-03-26T17:03:18.181 INFO:tasks.workunit.client.3.smithi157.stdout:myimage35 4/s 8/s 122 KiB/s 240 KiB/s 1.23 ms 291.49 us 2024-03-26T17:03:18.181 INFO:tasks.workunit.client.3.smithi157.stdout:myimage38 4/s 8/s 163 KiB/s 245 KiB/s 1.23 ms 298.36 us 2024-03-26T17:03:18.182 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:03:18.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:03:18 smithi044 ceph-mon[30624]: pgmap v520: 33 pgs: 33 active+clean; 1020 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 10 MiB/s rd, 10 MiB/s wr, 778 op/s 2024-03-26T17:03:18.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:03:18 smithi064 ceph-mon[34420]: pgmap v520: 33 pgs: 33 active+clean; 1020 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 10 MiB/s rd, 10 MiB/s wr, 778 op/s 2024-03-26T17:03:18.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:03:18 smithi149 ceph-mon[34678]: pgmap v520: 33 pgs: 33 active+clean; 1020 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 10 MiB/s rd, 10 MiB/s wr, 778 op/s 2024-03-26T17:03:19.215 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:03:18 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:03:18] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:03:19.215 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:03:18 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:03:18] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:03:19.215 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:03:18 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:03:19.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:03:19 smithi044 ceph-mon[30624]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:03:19.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:03:19 smithi044 ceph-mon[30624]: { 2024-03-26T17:03:19.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:03:19 smithi044 ceph-mon[30624]: "prefix": "rbd perf image stats", 2024-03-26T17:03:19.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:03:19 smithi044 ceph-mon[30624]: "pool_spec": "mypool", 2024-03-26T17:03:19.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:03:19 smithi044 ceph-mon[30624]: "sort_by": "write_ops", 2024-03-26T17:03:19.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:03:19 smithi044 ceph-mon[30624]: "format": "json" 2024-03-26T17:03:19.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:03:19 smithi044 ceph-mon[30624]: }"]: dispatch 2024-03-26T17:03:19.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:03:19 smithi044 ceph-mon[30624]: Health check update: 3 slow ops, oldest one blocked for 293 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:03:19.547 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:03:19 smithi149 ceph-mon[34678]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:03:19.547 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:03:19 smithi149 ceph-mon[34678]: { 2024-03-26T17:03:19.547 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:03:19 smithi149 ceph-mon[34678]: "prefix": "rbd perf image stats", 2024-03-26T17:03:19.547 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:03:19 smithi149 ceph-mon[34678]: "pool_spec": "mypool", 2024-03-26T17:03:19.548 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:03:19 smithi149 ceph-mon[34678]: "sort_by": "write_ops", 2024-03-26T17:03:19.548 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:03:19 smithi149 ceph-mon[34678]: "format": "json" 2024-03-26T17:03:19.548 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:03:19 smithi149 ceph-mon[34678]: }"]: dispatch 2024-03-26T17:03:19.548 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:03:19 smithi149 ceph-mon[34678]: Health check update: 3 slow ops, oldest one blocked for 293 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:03:19.548 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:03:19 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:03:19] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:03:19.548 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:03:19 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:03:19] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:03:19.549 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:03:19 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:03:19.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:03:19 smithi064 ceph-mon[34420]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:03:19.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:03:19 smithi064 ceph-mon[34420]: { 2024-03-26T17:03:19.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:03:19 smithi064 ceph-mon[34420]: "prefix": "rbd perf image stats", 2024-03-26T17:03:19.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:03:19 smithi064 ceph-mon[34420]: "pool_spec": "mypool", 2024-03-26T17:03:19.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:03:19 smithi064 ceph-mon[34420]: "sort_by": "write_ops", 2024-03-26T17:03:19.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:03:19 smithi064 ceph-mon[34420]: "format": "json" 2024-03-26T17:03:19.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:03:19 smithi064 ceph-mon[34420]: }"]: dispatch 2024-03-26T17:03:19.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:03:19 smithi064 ceph-mon[34420]: Health check update: 3 slow ops, oldest one blocked for 293 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:03:20.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:03:20 smithi044 ceph-mon[30624]: pgmap v521: 33 pgs: 33 active+clean; 1020 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 11 MiB/s rd, 11 MiB/s wr, 800 op/s 2024-03-26T17:03:20.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:03:20 smithi064 ceph-mon[34420]: pgmap v521: 33 pgs: 33 active+clean; 1020 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 11 MiB/s rd, 11 MiB/s wr, 800 op/s 2024-03-26T17:03:20.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:03:20 smithi149 ceph-mon[34678]: pgmap v521: 33 pgs: 33 active+clean; 1020 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 11 MiB/s rd, 11 MiB/s wr, 800 op/s 2024-03-26T17:03:21.265 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:03:20 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:03:20] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:03:21.266 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:03:20 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:03:20] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:03:21.266 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:03:20 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:03:21.547 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:03:21 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 2024-03-26T17:03:21.216+0000 7fa707a55700 -1 mon.c@1(peon) e3 get_health_metrics reporting 3 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T17:03:21.547 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:03:21 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:03:21] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:03:21.548 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:03:21 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:03:21] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:03:21.548 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:03:21 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:03:22.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:03:22 smithi044 ceph-mon[30624]: pgmap v522: 33 pgs: 33 active+clean; 1020 MiB data, 2.1 GiB used, 713 GiB / 715 GiB avail; 9.6 MiB/s rd, 10 MiB/s wr, 691 op/s 2024-03-26T17:03:22.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:03:22 smithi064 ceph-mon[34420]: pgmap v522: 33 pgs: 33 active+clean; 1020 MiB data, 2.1 GiB used, 713 GiB / 715 GiB avail; 9.6 MiB/s rd, 10 MiB/s wr, 691 op/s 2024-03-26T17:03:22.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:03:22 smithi149 ceph-mon[34678]: pgmap v522: 33 pgs: 33 active+clean; 1020 MiB data, 2.1 GiB used, 713 GiB / 715 GiB avail; 9.6 MiB/s rd, 10 MiB/s wr, 691 op/s 2024-03-26T17:03:23.061 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:03:23.068 INFO:tasks.workunit.client.3.smithi157.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2024-03-26T17:03:23.068 INFO:tasks.workunit.client.3.smithi157.stdout: 12.30 160.4k 192.4k 0.0k 1.6M 1.9M 0.0k nvme2n1 2024-03-26T17:03:23.068 INFO:tasks.workunit.client.3.smithi157.stdout: 12.40 181.2k 167.2k 0.0k 1.8M 1.6M 0.0k nvme2n10 2024-03-26T17:03:23.068 INFO:tasks.workunit.client.3.smithi157.stdout: 12.40 161.2k 180.8k 0.0k 1.6M 1.8M 0.0k nvme2n11 2024-03-26T17:03:23.069 INFO:tasks.workunit.client.3.smithi157.stdout: 12.40 151.6k 212.4k 0.0k 1.5M 2.1M 0.0k nvme2n12 2024-03-26T17:03:23.069 INFO:tasks.workunit.client.3.smithi157.stdout: 12.40 184.4k 204.4k 0.0k 1.8M 2.0M 0.0k nvme2n13 2024-03-26T17:03:23.069 INFO:tasks.workunit.client.3.smithi157.stdout: 12.40 175.6k 165.6k 0.0k 1.7M 1.6M 0.0k nvme2n14 2024-03-26T17:03:23.069 INFO:tasks.workunit.client.3.smithi157.stdout: 12.40 192.0k 199.2k 0.0k 1.9M 1.9M 0.0k nvme2n15 2024-03-26T17:03:23.069 INFO:tasks.workunit.client.3.smithi157.stdout: 12.30 187.6k 155.6k 0.0k 1.8M 1.5M 0.0k nvme2n16 2024-03-26T17:03:23.069 INFO:tasks.workunit.client.3.smithi157.stdout: 12.30 187.6k 199.2k 0.0k 1.8M 1.9M 0.0k nvme2n17 2024-03-26T17:03:23.069 INFO:tasks.workunit.client.3.smithi157.stdout: 12.30 168.0k 181.2k 0.0k 1.6M 1.8M 0.0k nvme2n18 2024-03-26T17:03:23.069 INFO:tasks.workunit.client.3.smithi157.stdout: 12.30 154.8k 156.0k 0.0k 1.5M 1.5M 0.0k nvme2n19 2024-03-26T17:03:23.069 INFO:tasks.workunit.client.3.smithi157.stdout: 12.40 147.6k 186.0k 0.0k 1.4M 1.8M 0.0k nvme2n2 2024-03-26T17:03:23.069 INFO:tasks.workunit.client.3.smithi157.stdout: 12.30 159.6k 165.2k 0.0k 1.6M 1.6M 0.0k nvme2n20 2024-03-26T17:03:23.069 INFO:tasks.workunit.client.3.smithi157.stdout: 12.40 163.6k 189.6k 0.0k 1.6M 1.9M 0.0k nvme2n3 2024-03-26T17:03:23.069 INFO:tasks.workunit.client.3.smithi157.stdout: 12.40 157.6k 153.2k 0.0k 1.5M 1.5M 0.0k nvme2n4 2024-03-26T17:03:23.069 INFO:tasks.workunit.client.3.smithi157.stdout: 12.40 160.4k 204.0k 0.0k 1.6M 2.0M 0.0k nvme2n5 2024-03-26T17:03:23.069 INFO:tasks.workunit.client.3.smithi157.stdout: 12.40 160.4k 202.8k 0.0k 1.6M 2.0M 0.0k nvme2n6 2024-03-26T17:03:23.070 INFO:tasks.workunit.client.3.smithi157.stdout: 12.40 219.2k 164.4k 0.0k 2.1M 1.6M 0.0k nvme2n7 2024-03-26T17:03:23.070 INFO:tasks.workunit.client.3.smithi157.stdout: 12.40 167.6k 231.6k 0.0k 1.6M 2.3M 0.0k nvme2n8 2024-03-26T17:03:23.070 INFO:tasks.workunit.client.3.smithi157.stdout: 12.40 221.6k 135.2k 0.0k 2.2M 1.3M 0.0k nvme2n9 2024-03-26T17:03:23.070 INFO:tasks.workunit.client.3.smithi157.stdout: 12.30 158.0k 156.8k 0.0k 1.5M 1.5M 0.0k nvme5n1 2024-03-26T17:03:23.070 INFO:tasks.workunit.client.3.smithi157.stdout: 12.40 168.8k 184.8k 0.0k 1.6M 1.8M 0.0k nvme5n10 2024-03-26T17:03:23.070 INFO:tasks.workunit.client.3.smithi157.stdout: 12.40 149.6k 200.8k 0.0k 1.5M 2.0M 0.0k nvme5n11 2024-03-26T17:03:23.070 INFO:tasks.workunit.client.3.smithi157.stdout: 12.40 197.6k 178.4k 0.0k 1.9M 1.7M 0.0k nvme5n12 2024-03-26T17:03:23.070 INFO:tasks.workunit.client.3.smithi157.stdout: 12.40 149.2k 202.8k 0.0k 1.5M 2.0M 0.0k nvme5n13 2024-03-26T17:03:23.070 INFO:tasks.workunit.client.3.smithi157.stdout: 12.40 172.0k 161.2k 0.0k 1.7M 1.6M 0.0k nvme5n14 2024-03-26T17:03:23.070 INFO:tasks.workunit.client.3.smithi157.stdout: 12.40 189.6k 153.2k 0.0k 1.9M 1.5M 0.0k nvme5n15 2024-03-26T17:03:23.070 INFO:tasks.workunit.client.3.smithi157.stdout: 12.30 170.4k 160.8k 0.0k 1.7M 1.6M 0.0k nvme5n16 2024-03-26T17:03:23.070 INFO:tasks.workunit.client.3.smithi157.stdout: 12.30 148.8k 214.4k 0.0k 1.5M 2.1M 0.0k nvme5n17 2024-03-26T17:03:23.071 INFO:tasks.workunit.client.3.smithi157.stdout: 12.30 192.4k 198.4k 0.0k 1.9M 1.9M 0.0k nvme5n18 2024-03-26T17:03:23.071 INFO:tasks.workunit.client.3.smithi157.stdout: 12.30 162.4k 148.4k 0.0k 1.6M 1.4M 0.0k nvme5n19 2024-03-26T17:03:23.071 INFO:tasks.workunit.client.3.smithi157.stdout: 12.40 179.6k 205.2k 0.0k 1.8M 2.0M 0.0k nvme5n2 2024-03-26T17:03:23.071 INFO:tasks.workunit.client.3.smithi157.stdout: 12.30 174.4k 182.8k 0.0k 1.7M 1.8M 0.0k nvme5n20 2024-03-26T17:03:23.071 INFO:tasks.workunit.client.3.smithi157.stdout: 12.40 211.2k 176.4k 0.0k 2.1M 1.7M 0.0k nvme5n3 2024-03-26T17:03:23.071 INFO:tasks.workunit.client.3.smithi157.stdout: 12.40 184.0k 205.2k 0.0k 1.8M 2.0M 0.0k nvme5n4 2024-03-26T17:03:23.071 INFO:tasks.workunit.client.3.smithi157.stdout: 12.40 176.4k 159.2k 0.0k 1.7M 1.6M 0.0k nvme5n5 2024-03-26T17:03:23.071 INFO:tasks.workunit.client.3.smithi157.stdout: 12.40 205.6k 161.6k 0.0k 2.0M 1.6M 0.0k nvme5n6 2024-03-26T17:03:23.071 INFO:tasks.workunit.client.3.smithi157.stdout: 12.40 186.8k 164.0k 0.0k 1.8M 1.6M 0.0k nvme5n7 2024-03-26T17:03:23.071 INFO:tasks.workunit.client.3.smithi157.stdout: 12.40 177.2k 185.6k 0.0k 1.7M 1.8M 0.0k nvme5n8 2024-03-26T17:03:23.071 INFO:tasks.workunit.client.3.smithi157.stdout: 12.40 174.8k 182.0k 0.0k 1.7M 1.8M 0.0k nvme5n9 2024-03-26T17:03:23.071 INFO:tasks.workunit.client.3.smithi157.stdout: 12.30 165.2k 202.4k 0.0k 1.6M 2.0M 0.0k nvme8n1 2024-03-26T17:03:23.071 INFO:tasks.workunit.client.3.smithi157.stdout: 12.40 207.2k 145.6k 0.0k 2.0M 1.4M 0.0k nvme8n10 2024-03-26T17:03:23.071 INFO:tasks.workunit.client.3.smithi157.stdout: 12.40 160.8k 177.6k 0.0k 1.6M 1.7M 0.0k nvme8n11 2024-03-26T17:03:23.072 INFO:tasks.workunit.client.3.smithi157.stdout: 12.40 148.8k 204.0k 0.0k 1.5M 2.0M 0.0k nvme8n12 2024-03-26T17:03:23.072 INFO:tasks.workunit.client.3.smithi157.stdout: 12.40 153.6k 178.0k 0.0k 1.5M 1.7M 0.0k nvme8n13 2024-03-26T17:03:23.072 INFO:tasks.workunit.client.3.smithi157.stdout: 12.40 230.8k 133.6k 0.0k 2.3M 1.3M 0.0k nvme8n14 2024-03-26T17:03:23.072 INFO:tasks.workunit.client.3.smithi157.stdout: 12.30 149.6k 164.8k 0.0k 1.5M 1.6M 0.0k nvme8n15 2024-03-26T17:03:23.072 INFO:tasks.workunit.client.3.smithi157.stdout: 12.30 165.6k 185.2k 0.0k 1.6M 1.8M 0.0k nvme8n16 2024-03-26T17:03:23.072 INFO:tasks.workunit.client.3.smithi157.stdout: 12.30 177.6k 178.4k 0.0k 1.7M 1.7M 0.0k nvme8n17 2024-03-26T17:03:23.072 INFO:tasks.workunit.client.3.smithi157.stdout: 12.30 167.2k 187.6k 0.0k 1.6M 1.8M 0.0k nvme8n18 2024-03-26T17:03:23.072 INFO:tasks.workunit.client.3.smithi157.stdout: 12.30 179.2k 149.6k 0.0k 1.8M 1.5M 0.0k nvme8n19 2024-03-26T17:03:23.072 INFO:tasks.workunit.client.3.smithi157.stdout: 12.40 165.2k 190.8k 0.0k 1.6M 1.9M 0.0k nvme8n2 2024-03-26T17:03:23.072 INFO:tasks.workunit.client.3.smithi157.stdout: 12.30 186.0k 179.6k 0.0k 1.8M 1.8M 0.0k nvme8n20 2024-03-26T17:03:23.072 INFO:tasks.workunit.client.3.smithi157.stdout: 12.40 184.4k 179.2k 0.0k 1.8M 1.8M 0.0k nvme8n3 2024-03-26T17:03:23.072 INFO:tasks.workunit.client.3.smithi157.stdout: 12.40 134.8k 191.2k 0.0k 1.3M 1.9M 0.0k nvme8n4 2024-03-26T17:03:23.072 INFO:tasks.workunit.client.3.smithi157.stdout: 12.40 169.2k 197.6k 0.0k 1.7M 1.9M 0.0k nvme8n5 2024-03-26T17:03:23.073 INFO:tasks.workunit.client.3.smithi157.stdout: 12.40 176.4k 176.8k 0.0k 1.7M 1.7M 0.0k nvme8n6 2024-03-26T17:03:23.073 INFO:tasks.workunit.client.3.smithi157.stdout: 12.40 148.0k 158.4k 0.0k 1.4M 1.5M 0.0k nvme8n7 2024-03-26T17:03:23.073 INFO:tasks.workunit.client.3.smithi157.stdout: 12.40 210.8k 177.6k 0.0k 2.1M 1.7M 0.0k nvme8n8 2024-03-26T17:03:23.073 INFO:tasks.workunit.client.3.smithi157.stdout: 12.40 225.6k 166.4k 0.0k 2.2M 1.6M 0.0k nvme8n9 2024-03-26T17:03:23.073 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:03:23.173 INFO:tasks.workunit.client.3.smithi157.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-26T17:03:23.173 INFO:tasks.workunit.client.3.smithi157.stdout:myimage31 8/s 5/s 222 KiB/s 128 KiB/s 1.32 ms 309.25 us 2024-03-26T17:03:23.173 INFO:tasks.workunit.client.3.smithi157.stdout:myimage13 7/s 5/s 232 KiB/s 182 KiB/s 1.22 ms 296.45 us 2024-03-26T17:03:23.174 INFO:tasks.workunit.client.3.smithi157.stdout:myimage52 7/s 5/s 235 KiB/s 150 KiB/s 1.36 ms 288.66 us 2024-03-26T17:03:23.174 INFO:tasks.workunit.client.3.smithi157.stdout:myimage37 7/s 4/s 225 KiB/s 142 KiB/s 1.37 ms 345.76 us 2024-03-26T17:03:23.174 INFO:tasks.workunit.client.3.smithi157.stdout:myimage33 7/s 6/s 212 KiB/s 175 KiB/s 1.32 ms 310.97 us 2024-03-26T17:03:23.174 INFO:tasks.workunit.client.3.smithi157.stdout:myimage60 7/s 6/s 182 KiB/s 178 KiB/s 1.25 ms 293.54 us 2024-03-26T17:03:23.174 INFO:tasks.workunit.client.3.smithi157.stdout:myimage14 7/s 6/s 195 KiB/s 171 KiB/s 1.38 ms 287.59 us 2024-03-26T17:03:23.174 INFO:tasks.workunit.client.3.smithi157.stdout:myimage1 7/s 4/s 210 KiB/s 131 KiB/s 1.20 ms 288.64 us 2024-03-26T17:03:23.174 INFO:tasks.workunit.client.3.smithi157.stdout:myimage39 7/s 5/s 181 KiB/s 154 KiB/s 1.19 ms 385.37 us 2024-03-26T17:03:23.174 INFO:tasks.workunit.client.3.smithi157.stdout:myimage57 7/s 5/s 190 KiB/s 143 KiB/s 1.24 ms 301.67 us 2024-03-26T17:03:23.174 INFO:tasks.workunit.client.3.smithi157.stdout:myimage5 7/s 5/s 194 KiB/s 133 KiB/s 1.25 ms 297.14 us 2024-03-26T17:03:23.174 INFO:tasks.workunit.client.3.smithi157.stdout:myimage15 7/s 5/s 187 KiB/s 166 KiB/s 1.23 ms 315.58 us 2024-03-26T17:03:23.174 INFO:tasks.workunit.client.3.smithi157.stdout:myimage45 7/s 6/s 222 KiB/s 166 KiB/s 1.30 ms 279.53 us 2024-03-26T17:03:23.174 INFO:tasks.workunit.client.3.smithi157.stdout:myimage7 7/s 5/s 182 KiB/s 161 KiB/s 1.36 ms 294.97 us 2024-03-26T17:03:23.174 INFO:tasks.workunit.client.3.smithi157.stdout:myimage8 7/s 5/s 237 KiB/s 150 KiB/s 1.32 ms 274.55 us 2024-03-26T17:03:23.175 INFO:tasks.workunit.client.3.smithi157.stdout:myimage17 7/s 5/s 222 KiB/s 167 KiB/s 1.27 ms 363.12 us 2024-03-26T17:03:23.175 INFO:tasks.workunit.client.3.smithi157.stdout:myimage47 6/s 6/s 152 KiB/s 179 KiB/s 1.26 ms 264.19 us 2024-03-26T17:03:23.175 INFO:tasks.workunit.client.3.smithi157.stdout:myimage4 6/s 6/s 171 KiB/s 157 KiB/s 1.23 ms 298.32 us 2024-03-26T17:03:23.175 INFO:tasks.workunit.client.3.smithi157.stdout:myimage46 6/s 5/s 189 KiB/s 138 KiB/s 1.27 ms 279.55 us 2024-03-26T17:03:23.175 INFO:tasks.workunit.client.3.smithi157.stdout:myimage53 6/s 5/s 194 KiB/s 140 KiB/s 1.24 ms 258.45 us 2024-03-26T17:03:23.175 INFO:tasks.workunit.client.3.smithi157.stdout:myimage3 6/s 5/s 188 KiB/s 116 KiB/s 1.21 ms 338.82 us 2024-03-26T17:03:23.175 INFO:tasks.workunit.client.3.smithi157.stdout:myimage35 6/s 5/s 176 KiB/s 161 KiB/s 1.32 ms 332.97 us 2024-03-26T17:03:23.175 INFO:tasks.workunit.client.3.smithi157.stdout:myimage21 6/s 5/s 147 KiB/s 168 KiB/s 1.42 ms 366.57 us 2024-03-26T17:03:23.175 INFO:tasks.workunit.client.3.smithi157.stdout:myimage56 6/s 5/s 190 KiB/s 138 KiB/s 1.35 ms 280.53 us 2024-03-26T17:03:23.175 INFO:tasks.workunit.client.3.smithi157.stdout:myimage38 6/s 5/s 210 KiB/s 176 KiB/s 1.25 ms 294.43 us 2024-03-26T17:03:23.175 INFO:tasks.workunit.client.3.smithi157.stdout:myimage44 6/s 6/s 170 KiB/s 108 KiB/s 1.31 ms 341.89 us 2024-03-26T17:03:23.175 INFO:tasks.workunit.client.3.smithi157.stdout:myimage11 6/s 5/s 174 KiB/s 119 KiB/s 1.39 ms 294.76 us 2024-03-26T17:03:23.175 INFO:tasks.workunit.client.3.smithi157.stdout:myimage26 6/s 6/s 180 KiB/s 187 KiB/s 1.36 ms 316.53 us 2024-03-26T17:03:23.175 INFO:tasks.workunit.client.3.smithi157.stdout:myimage50 6/s 6/s 170 KiB/s 173 KiB/s 1.31 ms 354.34 us 2024-03-26T17:03:23.175 INFO:tasks.workunit.client.3.smithi157.stdout:myimage55 6/s 5/s 176 KiB/s 137 KiB/s 1.33 ms 286.11 us 2024-03-26T17:03:23.175 INFO:tasks.workunit.client.3.smithi157.stdout:myimage10 6/s 6/s 173 KiB/s 192 KiB/s 1.25 ms 288.27 us 2024-03-26T17:03:23.176 INFO:tasks.workunit.client.3.smithi157.stdout:myimage30 6/s 6/s 180 KiB/s 182 KiB/s 1.44 ms 356.29 us 2024-03-26T17:03:23.176 INFO:tasks.workunit.client.3.smithi157.stdout:myimage40 6/s 6/s 207 KiB/s 161 KiB/s 1.27 ms 292.67 us 2024-03-26T17:03:23.176 INFO:tasks.workunit.client.3.smithi157.stdout:myimage6 6/s 6/s 177 KiB/s 157 KiB/s 1.33 ms 391.60 us 2024-03-26T17:03:23.176 INFO:tasks.workunit.client.3.smithi157.stdout:myimage19 6/s 6/s 154 KiB/s 125 KiB/s 1.34 ms 302.10 us 2024-03-26T17:03:23.176 INFO:tasks.workunit.client.3.smithi157.stdout:myimage25 6/s 5/s 198 KiB/s 158 KiB/s 1.42 ms 352.71 us 2024-03-26T17:03:23.176 INFO:tasks.workunit.client.3.smithi157.stdout:myimage28 6/s 6/s 189 KiB/s 150 KiB/s 1.44 ms 284.91 us 2024-03-26T17:03:23.176 INFO:tasks.workunit.client.3.smithi157.stdout:myimage43 6/s 7/s 202 KiB/s 183 KiB/s 1.33 ms 319.75 us 2024-03-26T17:03:23.176 INFO:tasks.workunit.client.3.smithi157.stdout:myimage23 6/s 6/s 186 KiB/s 202 KiB/s 1.21 ms 323.86 us 2024-03-26T17:03:23.176 INFO:tasks.workunit.client.3.smithi157.stdout:myimage34 6/s 6/s 150 KiB/s 166 KiB/s 1.21 ms 290.93 us 2024-03-26T17:03:23.176 INFO:tasks.workunit.client.3.smithi157.stdout:myimage18 6/s 6/s 168 KiB/s 171 KiB/s 1.28 ms 394.68 us 2024-03-26T17:03:23.176 INFO:tasks.workunit.client.3.smithi157.stdout:myimage29 6/s 6/s 163 KiB/s 180 KiB/s 1.19 ms 317.31 us 2024-03-26T17:03:23.176 INFO:tasks.workunit.client.3.smithi157.stdout:myimage32 5/s 7/s 184 KiB/s 199 KiB/s 1.32 ms 342.34 us 2024-03-26T17:03:23.176 INFO:tasks.workunit.client.3.smithi157.stdout:myimage58 5/s 6/s 206 KiB/s 198 KiB/s 1.25 ms 296.33 us 2024-03-26T17:03:23.176 INFO:tasks.workunit.client.3.smithi157.stdout:myimage24 5/s 6/s 187 KiB/s 206 KiB/s 1.30 ms 332.26 us 2024-03-26T17:03:23.176 INFO:tasks.workunit.client.3.smithi157.stdout:myimage27 5/s 6/s 162 KiB/s 193 KiB/s 1.21 ms 318.45 us 2024-03-26T17:03:23.177 INFO:tasks.workunit.client.3.smithi157.stdout:myimage51 5/s 6/s 170 KiB/s 146 KiB/s 1.38 ms 303.35 us 2024-03-26T17:03:23.177 INFO:tasks.workunit.client.3.smithi157.stdout:myimage22 5/s 5/s 163 KiB/s 160 KiB/s 1.29 ms 369.99 us 2024-03-26T17:03:23.177 INFO:tasks.workunit.client.3.smithi157.stdout:myimage12 5/s 6/s 169 KiB/s 175 KiB/s 1.27 ms 273.16 us 2024-03-26T17:03:23.177 INFO:tasks.workunit.client.3.smithi157.stdout:myimage42 5/s 6/s 148 KiB/s 177 KiB/s 1.26 ms 334.64 us 2024-03-26T17:03:23.177 INFO:tasks.workunit.client.3.smithi157.stdout:myimage59 5/s 6/s 141 KiB/s 188 KiB/s 1.19 ms 328.95 us 2024-03-26T17:03:23.177 INFO:tasks.workunit.client.3.smithi157.stdout:myimage48 5/s 6/s 155 KiB/s 178 KiB/s 1.31 ms 283.79 us 2024-03-26T17:03:23.177 INFO:tasks.workunit.client.3.smithi157.stdout:myimage41 5/s 8/s 202 KiB/s 190 KiB/s 1.33 ms 327.55 us 2024-03-26T17:03:23.177 INFO:tasks.workunit.client.3.smithi157.stdout:myimage20 5/s 6/s 164 KiB/s 160 KiB/s 1.27 ms 288.01 us 2024-03-26T17:03:23.177 INFO:tasks.workunit.client.3.smithi157.stdout:myimage2 5/s 5/s 169 KiB/s 138 KiB/s 1.28 ms 297.33 us 2024-03-26T17:03:23.177 INFO:tasks.workunit.client.3.smithi157.stdout:myimage49 5/s 7/s 121 KiB/s 238 KiB/s 1.31 ms 359.42 us 2024-03-26T17:03:23.178 INFO:tasks.workunit.client.3.smithi157.stdout:myimage16 4/s 7/s 127 KiB/s 198 KiB/s 1.30 ms 276.78 us 2024-03-26T17:03:23.178 INFO:tasks.workunit.client.3.smithi157.stdout:myimage9 4/s 8/s 134 KiB/s 213 KiB/s 1.32 ms 328.66 us 2024-03-26T17:03:23.178 INFO:tasks.workunit.client.3.smithi157.stdout:myimage36 4/s 6/s 126 KiB/s 166 KiB/s 1.27 ms 286.74 us 2024-03-26T17:03:23.178 INFO:tasks.workunit.client.3.smithi157.stdout:myimage54 4/s 8/s 137 KiB/s 251 KiB/s 1.28 ms 368.58 us 2024-03-26T17:03:23.178 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:03:23.265 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:03:22 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:03:22] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:03:23.265 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:03:22 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:03:22] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:03:23.265 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:03:22 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:03:23.548 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:03:23 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:03:23] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:03:23.548 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:03:23 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:03:23] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:03:23.549 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:03:23 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:03:23.896 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:03:23 smithi149 ceph-mon[34678]: Health check update: 3 slow ops, oldest one blocked for 298 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:03:24.015 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:03:23 smithi044 ceph-mon[30624]: Health check update: 3 slow ops, oldest one blocked for 298 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:03:24.055 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:03:23 smithi064 ceph-mon[34420]: Health check update: 3 slow ops, oldest one blocked for 298 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:03:24.878 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:03:24 smithi044 ceph-mon[30624]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:03:24.878 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:03:24 smithi044 ceph-mon[30624]: { 2024-03-26T17:03:24.878 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:03:24 smithi044 ceph-mon[30624]: "prefix": "rbd perf image stats", 2024-03-26T17:03:24.878 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:03:24 smithi044 ceph-mon[30624]: "pool_spec": "mypool", 2024-03-26T17:03:24.878 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:03:24 smithi044 ceph-mon[30624]: "sort_by": "write_ops", 2024-03-26T17:03:24.878 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:03:24 smithi044 ceph-mon[30624]: "format": "json" 2024-03-26T17:03:24.878 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:03:24 smithi044 ceph-mon[30624]: }"]: dispatch 2024-03-26T17:03:24.878 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:03:24 smithi044 ceph-mon[30624]: pgmap v523: 33 pgs: 33 active+clean; 1020 MiB data, 2.1 GiB used, 713 GiB / 715 GiB avail; 11 MiB/s rd, 12 MiB/s wr, 808 op/s 2024-03-26T17:03:24.896 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:03:24 smithi149 ceph-mon[34678]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:03:24.896 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:03:24 smithi149 ceph-mon[34678]: { 2024-03-26T17:03:24.896 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:03:24 smithi149 ceph-mon[34678]: "prefix": "rbd perf image stats", 2024-03-26T17:03:24.896 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:03:24 smithi149 ceph-mon[34678]: "pool_spec": "mypool", 2024-03-26T17:03:24.896 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:03:24 smithi149 ceph-mon[34678]: "sort_by": "write_ops", 2024-03-26T17:03:24.896 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:03:24 smithi149 ceph-mon[34678]: "format": "json" 2024-03-26T17:03:24.896 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:03:24 smithi149 ceph-mon[34678]: }"]: dispatch 2024-03-26T17:03:24.896 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:03:24 smithi149 ceph-mon[34678]: pgmap v523: 33 pgs: 33 active+clean; 1020 MiB data, 2.1 GiB used, 713 GiB / 715 GiB avail; 11 MiB/s rd, 12 MiB/s wr, 808 op/s 2024-03-26T17:03:25.055 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:03:24 smithi064 ceph-mon[34420]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:03:25.056 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:03:24 smithi064 ceph-mon[34420]: { 2024-03-26T17:03:25.056 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:03:24 smithi064 ceph-mon[34420]: "prefix": "rbd perf image stats", 2024-03-26T17:03:25.056 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:03:24 smithi064 ceph-mon[34420]: "pool_spec": "mypool", 2024-03-26T17:03:25.056 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:03:24 smithi064 ceph-mon[34420]: "sort_by": "write_ops", 2024-03-26T17:03:25.056 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:03:24 smithi064 ceph-mon[34420]: "format": "json" 2024-03-26T17:03:25.056 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:03:24 smithi064 ceph-mon[34420]: }"]: dispatch 2024-03-26T17:03:25.056 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:03:24 smithi064 ceph-mon[34420]: pgmap v523: 33 pgs: 33 active+clean; 1020 MiB data, 2.1 GiB used, 713 GiB / 715 GiB avail; 11 MiB/s rd, 12 MiB/s wr, 808 op/s 2024-03-26T17:03:25.265 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:03:24 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:03:24] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:03:25.266 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:03:24 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:03:24] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:03:25.266 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:03:24 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:03:25.646 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:03:25 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:03:25] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:03:25.646 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:03:25 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:03:25] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:03:25.647 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:03:25 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:03:26.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:03:26 smithi044 ceph-mon[30624]: pgmap v524: 33 pgs: 33 active+clean; 1021 MiB data, 2.1 GiB used, 713 GiB / 715 GiB avail; 9.6 MiB/s rd, 10 MiB/s wr, 725 op/s 2024-03-26T17:03:26.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:03:26 smithi064 ceph-mon[34420]: pgmap v524: 33 pgs: 33 active+clean; 1021 MiB data, 2.1 GiB used, 713 GiB / 715 GiB avail; 9.6 MiB/s rd, 10 MiB/s wr, 725 op/s 2024-03-26T17:03:26.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:03:26 smithi149 ceph-mon[34678]: pgmap v524: 33 pgs: 33 active+clean; 1021 MiB data, 2.1 GiB used, 713 GiB / 715 GiB avail; 9.6 MiB/s rd, 10 MiB/s wr, 725 op/s 2024-03-26T17:03:26.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:03:26 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 2024-03-26T17:03:26.216+0000 7fa707a55700 -1 mon.c@1(peon) e3 get_health_metrics reporting 3 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T17:03:27.265 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:03:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:03:26] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:03:27.265 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:03:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:03:26] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:03:27.265 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:03:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:03:27.548 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:03:27 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:03:27] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:03:27.548 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:03:27 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:03:27] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:03:27.548 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:03:27 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:03:28.177 INFO:tasks.workunit.client.3.smithi157.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-26T17:03:28.177 INFO:tasks.workunit.client.3.smithi157.stdout:myimage19 8/s 6/s 222 KiB/s 162 KiB/s 1.28 ms 279.46 us 2024-03-26T17:03:28.177 INFO:tasks.workunit.client.3.smithi157.stdout:myimage52 7/s 5/s 179 KiB/s 184 KiB/s 1.40 ms 322.24 us 2024-03-26T17:03:28.178 INFO:tasks.workunit.client.3.smithi157.stdout:myimage12 7/s 5/s 223 KiB/s 121 KiB/s 1.30 ms 368.74 us 2024-03-26T17:03:28.178 INFO:tasks.workunit.client.3.smithi157.stdout:myimage24 7/s 5/s 180 KiB/s 151 KiB/s 1.37 ms 306.98 us 2024-03-26T17:03:28.178 INFO:tasks.workunit.client.3.smithi157.stdout:myimage36 7/s 6/s 212 KiB/s 166 KiB/s 1.26 ms 336.50 us 2024-03-26T17:03:28.178 INFO:tasks.workunit.client.3.smithi157.stdout:myimage51 7/s 5/s 230 KiB/s 127 KiB/s 1.34 ms 286.20 us 2024-03-26T17:03:28.178 INFO:tasks.workunit.client.3.smithi157.stdout:myimage31 7/s 4/s 169 KiB/s 91 KiB/s 1.40 ms 293.07 us 2024-03-26T17:03:28.178 INFO:tasks.workunit.client.3.smithi157.stdout:myimage58 7/s 6/s 171 KiB/s 176 KiB/s 1.31 ms 368.01 us 2024-03-26T17:03:28.178 INFO:tasks.workunit.client.3.smithi157.stdout:myimage34 7/s 5/s 181 KiB/s 122 KiB/s 1.29 ms 268.33 us 2024-03-26T17:03:28.178 INFO:tasks.workunit.client.3.smithi157.stdout:myimage8 7/s 5/s 206 KiB/s 117 KiB/s 1.36 ms 280.03 us 2024-03-26T17:03:28.178 INFO:tasks.workunit.client.3.smithi157.stdout:myimage29 7/s 6/s 202 KiB/s 178 KiB/s 1.42 ms 444.48 us 2024-03-26T17:03:28.178 INFO:tasks.workunit.client.3.smithi157.stdout:myimage1 6/s 7/s 178 KiB/s 192 KiB/s 1.20 ms 350.04 us 2024-03-26T17:03:28.178 INFO:tasks.workunit.client.3.smithi157.stdout:myimage15 6/s 4/s 158 KiB/s 84 KiB/s 1.28 ms 401.70 us 2024-03-26T17:03:28.178 INFO:tasks.workunit.client.3.smithi157.stdout:myimage42 6/s 5/s 199 KiB/s 133 KiB/s 1.29 ms 363.31 us 2024-03-26T17:03:28.179 INFO:tasks.workunit.client.3.smithi157.stdout:myimage59 6/s 6/s 177 KiB/s 168 KiB/s 1.26 ms 330.79 us 2024-03-26T17:03:28.179 INFO:tasks.workunit.client.3.smithi157.stdout:myimage3 6/s 5/s 186 KiB/s 146 KiB/s 1.26 ms 346.70 us 2024-03-26T17:03:28.179 INFO:tasks.workunit.client.3.smithi157.stdout:myimage16 6/s 5/s 191 KiB/s 142 KiB/s 1.29 ms 270.18 us 2024-03-26T17:03:28.179 INFO:tasks.workunit.client.3.smithi157.stdout:myimage38 6/s 5/s 215 KiB/s 153 KiB/s 1.25 ms 288.57 us 2024-03-26T17:03:28.179 INFO:tasks.workunit.client.3.smithi157.stdout:myimage47 6/s 5/s 159 KiB/s 176 KiB/s 1.29 ms 367.88 us 2024-03-26T17:03:28.179 INFO:tasks.workunit.client.3.smithi157.stdout:myimage56 6/s 6/s 196 KiB/s 161 KiB/s 1.36 ms 323.02 us 2024-03-26T17:03:28.179 INFO:tasks.workunit.client.3.smithi157.stdout:myimage18 6/s 5/s 169 KiB/s 153 KiB/s 1.27 ms 296.68 us 2024-03-26T17:03:28.179 INFO:tasks.workunit.client.3.smithi157.stdout:myimage21 6/s 6/s 163 KiB/s 162 KiB/s 1.38 ms 322.92 us 2024-03-26T17:03:28.179 INFO:tasks.workunit.client.3.smithi157.stdout:myimage25 6/s 5/s 182 KiB/s 135 KiB/s 1.45 ms 351.92 us 2024-03-26T17:03:28.179 INFO:tasks.workunit.client.3.smithi157.stdout:myimage41 6/s 5/s 161 KiB/s 161 KiB/s 1.29 ms 271.16 us 2024-03-26T17:03:28.179 INFO:tasks.workunit.client.3.smithi157.stdout:myimage60 6/s 5/s 183 KiB/s 174 KiB/s 1.33 ms 266.30 us 2024-03-26T17:03:28.180 INFO:tasks.workunit.client.3.smithi157.stdout:myimage10 6/s 5/s 169 KiB/s 130 KiB/s 1.28 ms 400.17 us 2024-03-26T17:03:28.180 INFO:tasks.workunit.client.3.smithi157.stdout:myimage22 6/s 5/s 223 KiB/s 165 KiB/s 1.32 ms 405.78 us 2024-03-26T17:03:28.180 INFO:tasks.workunit.client.3.smithi157.stdout:myimage44 6/s 7/s 186 KiB/s 176 KiB/s 1.31 ms 275.72 us 2024-03-26T17:03:28.180 INFO:tasks.workunit.client.3.smithi157.stdout:myimage4 6/s 6/s 178 KiB/s 142 KiB/s 1.26 ms 237.26 us 2024-03-26T17:03:28.180 INFO:tasks.workunit.client.3.smithi157.stdout:myimage54 6/s 6/s 178 KiB/s 170 KiB/s 1.29 ms 291.74 us 2024-03-26T17:03:28.180 INFO:tasks.workunit.client.3.smithi157.stdout:myimage55 6/s 5/s 134 KiB/s 127 KiB/s 1.33 ms 271.99 us 2024-03-26T17:03:28.180 INFO:tasks.workunit.client.3.smithi157.stdout:myimage2 6/s 6/s 150 KiB/s 154 KiB/s 1.35 ms 328.96 us 2024-03-26T17:03:28.180 INFO:tasks.workunit.client.3.smithi157.stdout:myimage13 6/s 6/s 167 KiB/s 168 KiB/s 1.27 ms 298.56 us 2024-03-26T17:03:28.180 INFO:tasks.workunit.client.3.smithi157.stdout:myimage37 6/s 6/s 158 KiB/s 138 KiB/s 1.30 ms 383.53 us 2024-03-26T17:03:28.180 INFO:tasks.workunit.client.3.smithi157.stdout:myimage40 6/s 5/s 191 KiB/s 171 KiB/s 1.29 ms 331.23 us 2024-03-26T17:03:28.180 INFO:tasks.workunit.client.3.smithi157.stdout:myimage48 6/s 6/s 214 KiB/s 182 KiB/s 1.34 ms 276.95 us 2024-03-26T17:03:28.180 INFO:tasks.workunit.client.3.smithi157.stdout:myimage49 6/s 5/s 191 KiB/s 122 KiB/s 1.34 ms 334.78 us 2024-03-26T17:03:28.180 INFO:tasks.workunit.client.3.smithi157.stdout:myimage6 6/s 6/s 177 KiB/s 155 KiB/s 1.31 ms 325.40 us 2024-03-26T17:03:28.180 INFO:tasks.workunit.client.3.smithi157.stdout:myimage33 6/s 5/s 169 KiB/s 152 KiB/s 1.33 ms 322.31 us 2024-03-26T17:03:28.181 INFO:tasks.workunit.client.3.smithi157.stdout:myimage43 6/s 4/s 157 KiB/s 115 KiB/s 1.34 ms 341.61 us 2024-03-26T17:03:28.181 INFO:tasks.workunit.client.3.smithi157.stdout:myimage53 6/s 6/s 161 KiB/s 142 KiB/s 1.32 ms 281.03 us 2024-03-26T17:03:28.181 INFO:tasks.workunit.client.3.smithi157.stdout:myimage30 5/s 7/s 160 KiB/s 188 KiB/s 1.47 ms 270.40 us 2024-03-26T17:03:28.181 INFO:tasks.workunit.client.3.smithi157.stdout:myimage5 5/s 5/s 126 KiB/s 139 KiB/s 1.33 ms 293.04 us 2024-03-26T17:03:28.181 INFO:tasks.workunit.client.3.smithi157.stdout:myimage11 5/s 7/s 175 KiB/s 189 KiB/s 1.39 ms 287.01 us 2024-03-26T17:03:28.181 INFO:tasks.workunit.client.3.smithi157.stdout:myimage28 5/s 7/s 179 KiB/s 170 KiB/s 1.47 ms 346.14 us 2024-03-26T17:03:28.181 INFO:tasks.workunit.client.3.smithi157.stdout:myimage39 5/s 5/s 116 KiB/s 111 KiB/s 1.31 ms 316.55 us 2024-03-26T17:03:28.181 INFO:tasks.workunit.client.3.smithi157.stdout:myimage32 5/s 6/s 142 KiB/s 190 KiB/s 1.28 ms 330.18 us 2024-03-26T17:03:28.181 INFO:tasks.workunit.client.3.smithi157.stdout:myimage35 5/s 5/s 126 KiB/s 154 KiB/s 1.31 ms 241.82 us 2024-03-26T17:03:28.181 INFO:tasks.workunit.client.3.smithi157.stdout:myimage9 5/s 6/s 160 KiB/s 182 KiB/s 1.39 ms 323.99 us 2024-03-26T17:03:28.181 INFO:tasks.workunit.client.3.smithi157.stdout:myimage46 5/s 5/s 171 KiB/s 171 KiB/s 1.32 ms 364.30 us 2024-03-26T17:03:28.181 INFO:tasks.workunit.client.3.smithi157.stdout:myimage57 5/s 7/s 156 KiB/s 190 KiB/s 1.29 ms 307.32 us 2024-03-26T17:03:28.181 INFO:tasks.workunit.client.3.smithi157.stdout:myimage23 5/s 6/s 140 KiB/s 165 KiB/s 1.22 ms 351.03 us 2024-03-26T17:03:28.182 INFO:tasks.workunit.client.3.smithi157.stdout:myimage45 5/s 6/s 124 KiB/s 197 KiB/s 1.32 ms 307.21 us 2024-03-26T17:03:28.182 INFO:tasks.workunit.client.3.smithi157.stdout:myimage20 5/s 7/s 138 KiB/s 198 KiB/s 1.32 ms 272.12 us 2024-03-26T17:03:28.182 INFO:tasks.workunit.client.3.smithi157.stdout:myimage50 5/s 7/s 125 KiB/s 196 KiB/s 2.84 ms 354.96 us 2024-03-26T17:03:28.182 INFO:tasks.workunit.client.3.smithi157.stdout:myimage26 5/s 6/s 131 KiB/s 142 KiB/s 1.32 ms 448.72 us 2024-03-26T17:03:28.182 INFO:tasks.workunit.client.3.smithi157.stdout:myimage17 4/s 7/s 113 KiB/s 158 KiB/s 1.38 ms 294.40 us 2024-03-26T17:03:28.182 INFO:tasks.workunit.client.3.smithi157.stdout:myimage7 4/s 7/s 120 KiB/s 234 KiB/s 1.36 ms 332.48 us 2024-03-26T17:03:28.182 INFO:tasks.workunit.client.3.smithi157.stdout:myimage14 4/s 6/s 98 KiB/s 178 KiB/s 1.37 ms 466.02 us 2024-03-26T17:03:28.182 INFO:tasks.workunit.client.3.smithi157.stdout:myimage27 4/s 8/s 131 KiB/s 218 KiB/s 1.24 ms 274.05 us 2024-03-26T17:03:28.182 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:03:28.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:03:28 smithi044 ceph-mon[30624]: pgmap v525: 33 pgs: 33 active+clean; 1021 MiB data, 2.2 GiB used, 713 GiB / 715 GiB avail; 9.5 MiB/s rd, 10 MiB/s wr, 730 op/s 2024-03-26T17:03:28.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:03:28 smithi064 ceph-mon[34420]: pgmap v525: 33 pgs: 33 active+clean; 1021 MiB data, 2.2 GiB used, 713 GiB / 715 GiB avail; 9.5 MiB/s rd, 10 MiB/s wr, 730 op/s 2024-03-26T17:03:28.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:03:28 smithi149 ceph-mon[34678]: pgmap v525: 33 pgs: 33 active+clean; 1021 MiB data, 2.2 GiB used, 713 GiB / 715 GiB avail; 9.5 MiB/s rd, 10 MiB/s wr, 730 op/s 2024-03-26T17:03:29.216 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:03:28 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:03:28] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:03:29.217 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:03:28 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:03:28] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:03:29.217 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:03:28 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:03:29.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:03:29 smithi044 ceph-mon[30624]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:03:29.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:03:29 smithi044 ceph-mon[30624]: { 2024-03-26T17:03:29.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:03:29 smithi044 ceph-mon[30624]: "prefix": "rbd perf image stats", 2024-03-26T17:03:29.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:03:29 smithi044 ceph-mon[30624]: "pool_spec": "mypool", 2024-03-26T17:03:29.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:03:29 smithi044 ceph-mon[30624]: "sort_by": "write_ops", 2024-03-26T17:03:29.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:03:29 smithi044 ceph-mon[30624]: "format": "json" 2024-03-26T17:03:29.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:03:29 smithi044 ceph-mon[30624]: }"]: dispatch 2024-03-26T17:03:29.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:03:29 smithi044 ceph-mon[30624]: Health check update: 3 slow ops, oldest one blocked for 303 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:03:29.548 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:03:29 smithi149 ceph-mon[34678]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:03:29.548 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:03:29 smithi149 ceph-mon[34678]: { 2024-03-26T17:03:29.548 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:03:29 smithi149 ceph-mon[34678]: "prefix": "rbd perf image stats", 2024-03-26T17:03:29.548 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:03:29 smithi149 ceph-mon[34678]: "pool_spec": "mypool", 2024-03-26T17:03:29.548 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:03:29 smithi149 ceph-mon[34678]: "sort_by": "write_ops", 2024-03-26T17:03:29.548 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:03:29 smithi149 ceph-mon[34678]: "format": "json" 2024-03-26T17:03:29.548 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:03:29 smithi149 ceph-mon[34678]: }"]: dispatch 2024-03-26T17:03:29.548 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:03:29 smithi149 ceph-mon[34678]: Health check update: 3 slow ops, oldest one blocked for 303 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:03:29.549 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:03:29 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:03:29] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:03:29.549 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:03:29 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:03:29] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:03:29.549 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:03:29 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:03:29.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:03:29 smithi064 ceph-mon[34420]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:03:29.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:03:29 smithi064 ceph-mon[34420]: { 2024-03-26T17:03:29.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:03:29 smithi064 ceph-mon[34420]: "prefix": "rbd perf image stats", 2024-03-26T17:03:29.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:03:29 smithi064 ceph-mon[34420]: "pool_spec": "mypool", 2024-03-26T17:03:29.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:03:29 smithi064 ceph-mon[34420]: "sort_by": "write_ops", 2024-03-26T17:03:29.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:03:29 smithi064 ceph-mon[34420]: "format": "json" 2024-03-26T17:03:29.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:03:29 smithi064 ceph-mon[34420]: }"]: dispatch 2024-03-26T17:03:29.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:03:29 smithi064 ceph-mon[34420]: Health check update: 3 slow ops, oldest one blocked for 303 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:03:30.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:03:30 smithi044 ceph-mon[30624]: pgmap v526: 33 pgs: 33 active+clean; 1021 MiB data, 2.2 GiB used, 713 GiB / 715 GiB avail; 9.8 MiB/s rd, 11 MiB/s wr, 779 op/s 2024-03-26T17:03:30.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:03:30 smithi064 ceph-mon[34420]: pgmap v526: 33 pgs: 33 active+clean; 1021 MiB data, 2.2 GiB used, 713 GiB / 715 GiB avail; 9.8 MiB/s rd, 11 MiB/s wr, 779 op/s 2024-03-26T17:03:30.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:03:30 smithi149 ceph-mon[34678]: pgmap v526: 33 pgs: 33 active+clean; 1021 MiB data, 2.2 GiB used, 713 GiB / 715 GiB avail; 9.8 MiB/s rd, 11 MiB/s wr, 779 op/s 2024-03-26T17:03:31.265 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:03:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:03:30] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:03:31.266 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:03:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:03:30] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:03:31.266 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:03:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:03:31.547 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:03:31 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 2024-03-26T17:03:31.216+0000 7fa707a55700 -1 mon.c@1(peon) e3 get_health_metrics reporting 3 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T17:03:31.548 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:03:31 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:03:31] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:03:31.548 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:03:31 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:03:31] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:03:31.548 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:03:31 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:03:32.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:03:32 smithi044 ceph-mon[30624]: pgmap v527: 33 pgs: 33 active+clean; 1021 MiB data, 2.2 GiB used, 713 GiB / 715 GiB avail; 8.5 MiB/s rd, 9.0 MiB/s wr, 677 op/s 2024-03-26T17:03:32.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:03:32 smithi064 ceph-mon[34420]: pgmap v527: 33 pgs: 33 active+clean; 1021 MiB data, 2.2 GiB used, 713 GiB / 715 GiB avail; 8.5 MiB/s rd, 9.0 MiB/s wr, 677 op/s 2024-03-26T17:03:32.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:03:32 smithi149 ceph-mon[34678]: pgmap v527: 33 pgs: 33 active+clean; 1021 MiB data, 2.2 GiB used, 713 GiB / 715 GiB avail; 8.5 MiB/s rd, 9.0 MiB/s wr, 677 op/s 2024-03-26T17:03:33.061 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:03:33.069 INFO:tasks.workunit.client.3.smithi157.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2024-03-26T17:03:33.069 INFO:tasks.workunit.client.3.smithi157.stdout: 12.20 159.6k 173.6k 0.0k 1.6M 1.7M 0.0k nvme2n1 2024-03-26T17:03:33.069 INFO:tasks.workunit.client.3.smithi157.stdout: 12.10 152.0k 137.2k 0.0k 1.5M 1.3M 0.0k nvme2n10 2024-03-26T17:03:33.069 INFO:tasks.workunit.client.3.smithi157.stdout: 12.10 154.4k 166.4k 0.0k 1.5M 1.6M 0.0k nvme2n11 2024-03-26T17:03:33.069 INFO:tasks.workunit.client.3.smithi157.stdout: 12.10 136.8k 164.4k 0.0k 1.3M 1.6M 0.0k nvme2n12 2024-03-26T17:03:33.069 INFO:tasks.workunit.client.3.smithi157.stdout: 12.10 176.4k 130.0k 0.0k 1.7M 1.3M 0.0k nvme2n13 2024-03-26T17:03:33.069 INFO:tasks.workunit.client.3.smithi157.stdout: 12.10 172.0k 142.4k 0.0k 1.7M 1.4M 0.0k nvme2n14 2024-03-26T17:03:33.070 INFO:tasks.workunit.client.3.smithi157.stdout: 12.10 144.4k 142.0k 0.0k 1.4M 1.4M 0.0k nvme2n15 2024-03-26T17:03:33.070 INFO:tasks.workunit.client.3.smithi157.stdout: 12.20 163.6k 143.2k 0.0k 1.6M 1.4M 0.0k nvme2n16 2024-03-26T17:03:33.070 INFO:tasks.workunit.client.3.smithi157.stdout: 12.20 174.0k 113.2k 0.0k 1.7M 1.1M 0.0k nvme2n17 2024-03-26T17:03:33.070 INFO:tasks.workunit.client.3.smithi157.stdout: 12.20 134.0k 183.6k 0.0k 1.3M 1.8M 0.0k nvme2n18 2024-03-26T17:03:33.070 INFO:tasks.workunit.client.3.smithi157.stdout: 12.20 138.8k 173.6k 0.0k 1.4M 1.7M 0.0k nvme2n19 2024-03-26T17:03:33.070 INFO:tasks.workunit.client.3.smithi157.stdout: 12.20 170.0k 152.8k 0.0k 1.7M 1.5M 0.0k nvme2n2 2024-03-26T17:03:33.070 INFO:tasks.workunit.client.3.smithi157.stdout: 12.20 171.2k 166.4k 0.0k 1.7M 1.6M 0.0k nvme2n20 2024-03-26T17:03:33.070 INFO:tasks.workunit.client.3.smithi157.stdout: 12.20 171.2k 142.4k 0.0k 1.7M 1.4M 0.0k nvme2n3 2024-03-26T17:03:33.070 INFO:tasks.workunit.client.3.smithi157.stdout: 12.20 118.0k 214.8k 0.0k 1.2M 2.1M 0.0k nvme2n4 2024-03-26T17:03:33.070 INFO:tasks.workunit.client.3.smithi157.stdout: 12.20 152.0k 156.8k 0.0k 1.5M 1.5M 0.0k nvme2n5 2024-03-26T17:03:33.070 INFO:tasks.workunit.client.3.smithi157.stdout: 12.20 182.8k 132.4k 0.0k 1.8M 1.3M 0.0k nvme2n6 2024-03-26T17:03:33.070 INFO:tasks.workunit.client.3.smithi157.stdout: 12.20 167.2k 137.6k 0.0k 1.6M 1.3M 0.0k nvme2n7 2024-03-26T17:03:33.070 INFO:tasks.workunit.client.3.smithi157.stdout: 12.10 158.0k 175.2k 0.0k 1.5M 1.7M 0.0k nvme2n8 2024-03-26T17:03:33.071 INFO:tasks.workunit.client.3.smithi157.stdout: 12.10 154.0k 159.6k 0.0k 1.5M 1.6M 0.0k nvme2n9 2024-03-26T17:03:33.071 INFO:tasks.workunit.client.3.smithi157.stdout: 12.20 162.4k 176.8k 0.0k 1.6M 1.7M 0.0k nvme5n1 2024-03-26T17:03:33.071 INFO:tasks.workunit.client.3.smithi157.stdout: 12.10 157.6k 141.2k 0.0k 1.5M 1.4M 0.0k nvme5n10 2024-03-26T17:03:33.071 INFO:tasks.workunit.client.3.smithi157.stdout: 12.10 154.0k 175.6k 0.0k 1.5M 1.7M 0.0k nvme5n11 2024-03-26T17:03:33.071 INFO:tasks.workunit.client.3.smithi157.stdout: 12.10 173.6k 148.8k 0.0k 1.7M 1.5M 0.0k nvme5n12 2024-03-26T17:03:33.071 INFO:tasks.workunit.client.3.smithi157.stdout: 12.10 182.0k 148.4k 0.0k 1.8M 1.4M 0.0k nvme5n13 2024-03-26T17:03:33.071 INFO:tasks.workunit.client.3.smithi157.stdout: 12.10 174.8k 144.0k 0.0k 1.7M 1.4M 0.0k nvme5n14 2024-03-26T17:03:33.071 INFO:tasks.workunit.client.3.smithi157.stdout: 12.10 185.2k 145.2k 0.0k 1.8M 1.4M 0.0k nvme5n15 2024-03-26T17:03:33.071 INFO:tasks.workunit.client.3.smithi157.stdout: 12.20 139.6k 178.8k 0.0k 1.4M 1.7M 0.0k nvme5n16 2024-03-26T17:03:33.071 INFO:tasks.workunit.client.3.smithi157.stdout: 12.20 171.6k 141.6k 0.0k 1.7M 1.4M 0.0k nvme5n17 2024-03-26T17:03:33.071 INFO:tasks.workunit.client.3.smithi157.stdout: 12.20 145.2k 178.0k 0.0k 1.4M 1.7M 0.0k nvme5n18 2024-03-26T17:03:33.071 INFO:tasks.workunit.client.3.smithi157.stdout: 12.20 130.0k 150.8k 0.0k 1.3M 1.5M 0.0k nvme5n19 2024-03-26T17:03:33.071 INFO:tasks.workunit.client.3.smithi157.stdout: 12.20 173.2k 166.0k 0.0k 1.7M 1.6M 0.0k nvme5n2 2024-03-26T17:03:33.071 INFO:tasks.workunit.client.3.smithi157.stdout: 12.20 150.0k 149.2k 0.0k 1.5M 1.5M 0.0k nvme5n20 2024-03-26T17:03:33.072 INFO:tasks.workunit.client.3.smithi157.stdout: 12.20 164.4k 167.6k 0.0k 1.6M 1.6M 0.0k nvme5n3 2024-03-26T17:03:33.072 INFO:tasks.workunit.client.3.smithi157.stdout: 12.20 166.8k 151.2k 0.0k 1.6M 1.5M 0.0k nvme5n4 2024-03-26T17:03:33.072 INFO:tasks.workunit.client.3.smithi157.stdout: 12.20 167.6k 152.0k 0.0k 1.6M 1.5M 0.0k nvme5n5 2024-03-26T17:03:33.072 INFO:tasks.workunit.client.3.smithi157.stdout: 12.20 146.8k 133.2k 0.0k 1.4M 1.3M 0.0k nvme5n6 2024-03-26T17:03:33.072 INFO:tasks.workunit.client.3.smithi157.stdout: 12.20 175.6k 159.2k 0.0k 1.7M 1.6M 0.0k nvme5n7 2024-03-26T17:03:33.072 INFO:tasks.workunit.client.3.smithi157.stdout: 12.20 122.8k 215.2k 0.0k 1.2M 2.1M 0.0k nvme5n8 2024-03-26T17:03:33.072 INFO:tasks.workunit.client.3.smithi157.stdout: 12.10 158.0k 158.8k 0.0k 1.5M 1.6M 0.0k nvme5n9 2024-03-26T17:03:33.072 INFO:tasks.workunit.client.3.smithi157.stdout: 12.20 116.0k 199.6k 0.0k 1.1M 1.9M 0.0k nvme8n1 2024-03-26T17:03:33.072 INFO:tasks.workunit.client.3.smithi157.stdout: 12.10 168.0k 139.2k 0.0k 1.6M 1.4M 0.0k nvme8n10 2024-03-26T17:03:33.072 INFO:tasks.workunit.client.3.smithi157.stdout: 12.10 111.2k 183.2k 0.0k 1.1M 1.8M 0.0k nvme8n11 2024-03-26T17:03:33.072 INFO:tasks.workunit.client.3.smithi157.stdout: 12.10 157.2k 154.0k 0.0k 1.5M 1.5M 0.0k nvme8n12 2024-03-26T17:03:33.072 INFO:tasks.workunit.client.3.smithi157.stdout: 12.10 122.0k 154.0k 0.0k 1.2M 1.5M 0.0k nvme8n13 2024-03-26T17:03:33.072 INFO:tasks.workunit.client.3.smithi157.stdout: 12.10 178.8k 142.8k 0.0k 1.7M 1.4M 0.0k nvme8n14 2024-03-26T17:03:33.072 INFO:tasks.workunit.client.3.smithi157.stdout: 12.20 159.2k 151.6k 0.0k 1.6M 1.5M 0.0k nvme8n15 2024-03-26T17:03:33.072 INFO:tasks.workunit.client.3.smithi157.stdout: 12.20 130.8k 180.0k 0.0k 1.3M 1.8M 0.0k nvme8n16 2024-03-26T17:03:33.073 INFO:tasks.workunit.client.3.smithi157.stdout: 12.20 162.4k 146.0k 0.0k 1.6M 1.4M 0.0k nvme8n17 2024-03-26T17:03:33.073 INFO:tasks.workunit.client.3.smithi157.stdout: 12.20 145.6k 167.6k 0.0k 1.4M 1.6M 0.0k nvme8n18 2024-03-26T17:03:33.073 INFO:tasks.workunit.client.3.smithi157.stdout: 12.20 154.4k 148.4k 0.0k 1.5M 1.4M 0.0k nvme8n19 2024-03-26T17:03:33.073 INFO:tasks.workunit.client.3.smithi157.stdout: 12.20 170.0k 124.8k 0.0k 1.7M 1.2M 0.0k nvme8n2 2024-03-26T17:03:33.073 INFO:tasks.workunit.client.3.smithi157.stdout: 12.20 162.4k 152.8k 0.0k 1.6M 1.5M 0.0k nvme8n20 2024-03-26T17:03:33.073 INFO:tasks.workunit.client.3.smithi157.stdout: 12.20 156.8k 138.4k 0.0k 1.5M 1.4M 0.0k nvme8n3 2024-03-26T17:03:33.073 INFO:tasks.workunit.client.3.smithi157.stdout: 12.20 160.8k 160.4k 0.0k 1.6M 1.6M 0.0k nvme8n4 2024-03-26T17:03:33.073 INFO:tasks.workunit.client.3.smithi157.stdout: 12.20 183.2k 150.0k 0.0k 1.8M 1.5M 0.0k nvme8n5 2024-03-26T17:03:33.073 INFO:tasks.workunit.client.3.smithi157.stdout: 12.20 152.8k 184.8k 0.0k 1.5M 1.8M 0.0k nvme8n6 2024-03-26T17:03:33.073 INFO:tasks.workunit.client.3.smithi157.stdout: 12.20 148.8k 162.8k 0.0k 1.5M 1.6M 0.0k nvme8n7 2024-03-26T17:03:33.073 INFO:tasks.workunit.client.3.smithi157.stdout: 12.10 196.8k 156.0k 0.0k 1.9M 1.5M 0.0k nvme8n8 2024-03-26T17:03:33.073 INFO:tasks.workunit.client.3.smithi157.stdout: 12.10 141.6k 150.0k 0.0k 1.4M 1.5M 0.0k nvme8n9 2024-03-26T17:03:33.073 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:03:33.181 INFO:tasks.workunit.client.3.smithi157.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-26T17:03:33.181 INFO:tasks.workunit.client.3.smithi157.stdout:myimage27 7/s 5/s 203 KiB/s 136 KiB/s 1.38 ms 314.13 us 2024-03-26T17:03:33.182 INFO:tasks.workunit.client.3.smithi157.stdout:myimage58 7/s 5/s 184 KiB/s 124 KiB/s 1.31 ms 254.76 us 2024-03-26T17:03:33.182 INFO:tasks.workunit.client.3.smithi157.stdout:myimage18 7/s 5/s 188 KiB/s 146 KiB/s 1.30 ms 391.70 us 2024-03-26T17:03:33.182 INFO:tasks.workunit.client.3.smithi157.stdout:myimage55 7/s 6/s 186 KiB/s 164 KiB/s 1.30 ms 268.53 us 2024-03-26T17:03:33.182 INFO:tasks.workunit.client.3.smithi157.stdout:myimage34 7/s 5/s 188 KiB/s 114 KiB/s 1.29 ms 288.70 us 2024-03-26T17:03:33.182 INFO:tasks.workunit.client.3.smithi157.stdout:myimage41 7/s 4/s 186 KiB/s 86 KiB/s 1.31 ms 293.23 us 2024-03-26T17:03:33.182 INFO:tasks.workunit.client.3.smithi157.stdout:myimage4 6/s 4/s 175 KiB/s 131 KiB/s 1.27 ms 307.91 us 2024-03-26T17:03:33.182 INFO:tasks.workunit.client.3.smithi157.stdout:myimage5 6/s 6/s 189 KiB/s 181 KiB/s 1.35 ms 276.97 us 2024-03-26T17:03:33.182 INFO:tasks.workunit.client.3.smithi157.stdout:myimage7 6/s 5/s 164 KiB/s 147 KiB/s 1.34 ms 263.32 us 2024-03-26T17:03:33.182 INFO:tasks.workunit.client.3.smithi157.stdout:myimage20 6/s 6/s 218 KiB/s 134 KiB/s 1.33 ms 307.52 us 2024-03-26T17:03:33.182 INFO:tasks.workunit.client.3.smithi157.stdout:myimage28 6/s 6/s 192 KiB/s 146 KiB/s 1.46 ms 288.50 us 2024-03-26T17:03:33.182 INFO:tasks.workunit.client.3.smithi157.stdout:myimage51 6/s 4/s 143 KiB/s 90 KiB/s 1.35 ms 269.98 us 2024-03-26T17:03:33.182 INFO:tasks.workunit.client.3.smithi157.stdout:myimage10 6/s 5/s 134 KiB/s 123 KiB/s 1.30 ms 250.34 us 2024-03-26T17:03:33.183 INFO:tasks.workunit.client.3.smithi157.stdout:myimage40 6/s 6/s 141 KiB/s 135 KiB/s 1.25 ms 277.59 us 2024-03-26T17:03:33.183 INFO:tasks.workunit.client.3.smithi157.stdout:myimage11 6/s 5/s 185 KiB/s 137 KiB/s 1.38 ms 272.96 us 2024-03-26T17:03:33.183 INFO:tasks.workunit.client.3.smithi157.stdout:myimage45 6/s 5/s 178 KiB/s 173 KiB/s 1.33 ms 351.46 us 2024-03-26T17:03:33.183 INFO:tasks.workunit.client.3.smithi157.stdout:myimage50 6/s 5/s 169 KiB/s 162 KiB/s 1.36 ms 330.95 us 2024-03-26T17:03:33.183 INFO:tasks.workunit.client.3.smithi157.stdout:myimage35 6/s 6/s 166 KiB/s 194 KiB/s 1.35 ms 379.91 us 2024-03-26T17:03:33.183 INFO:tasks.workunit.client.3.smithi157.stdout:myimage38 6/s 6/s 174 KiB/s 161 KiB/s 1.27 ms 332.97 us 2024-03-26T17:03:33.183 INFO:tasks.workunit.client.3.smithi157.stdout:myimage48 6/s 6/s 177 KiB/s 154 KiB/s 1.40 ms 277.30 us 2024-03-26T17:03:33.183 INFO:tasks.workunit.client.3.smithi157.stdout:myimage1 6/s 6/s 205 KiB/s 162 KiB/s 1.28 ms 315.14 us 2024-03-26T17:03:33.183 INFO:tasks.workunit.client.3.smithi157.stdout:myimage26 6/s 6/s 137 KiB/s 150 KiB/s 1.32 ms 305.39 us 2024-03-26T17:03:33.183 INFO:tasks.workunit.client.3.smithi157.stdout:myimage43 6/s 7/s 132 KiB/s 174 KiB/s 1.37 ms 355.56 us 2024-03-26T17:03:33.183 INFO:tasks.workunit.client.3.smithi157.stdout:myimage14 6/s 6/s 147 KiB/s 166 KiB/s 1.35 ms 361.53 us 2024-03-26T17:03:33.183 INFO:tasks.workunit.client.3.smithi157.stdout:myimage22 6/s 6/s 170 KiB/s 165 KiB/s 1.39 ms 273.45 us 2024-03-26T17:03:33.183 INFO:tasks.workunit.client.3.smithi157.stdout:myimage23 6/s 6/s 138 KiB/s 154 KiB/s 1.23 ms 229.37 us 2024-03-26T17:03:33.183 INFO:tasks.workunit.client.3.smithi157.stdout:myimage8 6/s 5/s 145 KiB/s 143 KiB/s 1.32 ms 289.92 us 2024-03-26T17:03:33.184 INFO:tasks.workunit.client.3.smithi157.stdout:myimage9 6/s 6/s 157 KiB/s 145 KiB/s 1.37 ms 315.43 us 2024-03-26T17:03:33.184 INFO:tasks.workunit.client.3.smithi157.stdout:myimage21 6/s 5/s 167 KiB/s 188 KiB/s 1.48 ms 336.56 us 2024-03-26T17:03:33.184 INFO:tasks.workunit.client.3.smithi157.stdout:myimage36 6/s 5/s 158 KiB/s 129 KiB/s 1.28 ms 310.28 us 2024-03-26T17:03:33.184 INFO:tasks.workunit.client.3.smithi157.stdout:myimage44 6/s 5/s 167 KiB/s 142 KiB/s 1.36 ms 304.94 us 2024-03-26T17:03:33.184 INFO:tasks.workunit.client.3.smithi157.stdout:myimage17 6/s 5/s 104 KiB/s 159 KiB/s 1.32 ms 287.26 us 2024-03-26T17:03:33.184 INFO:tasks.workunit.client.3.smithi157.stdout:myimage24 6/s 5/s 152 KiB/s 163 KiB/s 1.26 ms 358.17 us 2024-03-26T17:03:33.184 INFO:tasks.workunit.client.3.smithi157.stdout:myimage39 6/s 7/s 138 KiB/s 165 KiB/s 1.30 ms 306.78 us 2024-03-26T17:03:33.184 INFO:tasks.workunit.client.3.smithi157.stdout:myimage42 6/s 6/s 114 KiB/s 146 KiB/s 1.28 ms 290.39 us 2024-03-26T17:03:33.184 INFO:tasks.workunit.client.3.smithi157.stdout:myimage46 6/s 6/s 178 KiB/s 143 KiB/s 1.35 ms 251.03 us 2024-03-26T17:03:33.184 INFO:tasks.workunit.client.3.smithi157.stdout:myimage60 6/s 5/s 141 KiB/s 111 KiB/s 1.35 ms 272.04 us 2024-03-26T17:03:33.184 INFO:tasks.workunit.client.3.smithi157.stdout:myimage2 5/s 6/s 154 KiB/s 179 KiB/s 1.34 ms 298.72 us 2024-03-26T17:03:33.184 INFO:tasks.workunit.client.3.smithi157.stdout:myimage32 5/s 7/s 182 KiB/s 149 KiB/s 1.36 ms 265.14 us 2024-03-26T17:03:33.184 INFO:tasks.workunit.client.3.smithi157.stdout:myimage37 5/s 6/s 154 KiB/s 170 KiB/s 1.41 ms 296.93 us 2024-03-26T17:03:33.184 INFO:tasks.workunit.client.3.smithi157.stdout:myimage47 5/s 6/s 150 KiB/s 150 KiB/s 1.34 ms 309.99 us 2024-03-26T17:03:33.185 INFO:tasks.workunit.client.3.smithi157.stdout:myimage49 5/s 6/s 150 KiB/s 128 KiB/s 1.32 ms 318.67 us 2024-03-26T17:03:33.185 INFO:tasks.workunit.client.3.smithi157.stdout:myimage12 5/s 6/s 141 KiB/s 169 KiB/s 1.34 ms 322.73 us 2024-03-26T17:03:33.185 INFO:tasks.workunit.client.3.smithi157.stdout:myimage19 5/s 4/s 149 KiB/s 100 KiB/s 1.34 ms 331.88 us 2024-03-26T17:03:33.185 INFO:tasks.workunit.client.3.smithi157.stdout:myimage30 5/s 6/s 151 KiB/s 130 KiB/s 1.50 ms 272.45 us 2024-03-26T17:03:33.185 INFO:tasks.workunit.client.3.smithi157.stdout:myimage52 5/s 6/s 132 KiB/s 171 KiB/s 1.41 ms 290.23 us 2024-03-26T17:03:33.185 INFO:tasks.workunit.client.3.smithi157.stdout:myimage59 5/s 6/s 116 KiB/s 133 KiB/s 1.32 ms 329.78 us 2024-03-26T17:03:33.185 INFO:tasks.workunit.client.3.smithi157.stdout:myimage29 5/s 7/s 130 KiB/s 153 KiB/s 1.23 ms 302.50 us 2024-03-26T17:03:33.185 INFO:tasks.workunit.client.3.smithi157.stdout:myimage54 5/s 5/s 124 KiB/s 166 KiB/s 1.33 ms 357.43 us 2024-03-26T17:03:33.185 INFO:tasks.workunit.client.3.smithi157.stdout:myimage16 5/s 5/s 127 KiB/s 134 KiB/s 1.32 ms 268.58 us 2024-03-26T17:03:33.185 INFO:tasks.workunit.client.3.smithi157.stdout:myimage6 5/s 6/s 121 KiB/s 166 KiB/s 1.33 ms 338.58 us 2024-03-26T17:03:33.185 INFO:tasks.workunit.client.3.smithi157.stdout:myimage33 5/s 6/s 114 KiB/s 184 KiB/s 1.35 ms 300.13 us 2024-03-26T17:03:33.185 INFO:tasks.workunit.client.3.smithi157.stdout:myimage53 5/s 7/s 142 KiB/s 159 KiB/s 1.31 ms 263.93 us 2024-03-26T17:03:33.185 INFO:tasks.workunit.client.3.smithi157.stdout:myimage57 5/s 7/s 131 KiB/s 193 KiB/s 1.28 ms 259.30 us 2024-03-26T17:03:33.185 INFO:tasks.workunit.client.3.smithi157.stdout:myimage3 4/s 7/s 111 KiB/s 177 KiB/s 1.26 ms 264.84 us 2024-03-26T17:03:33.186 INFO:tasks.workunit.client.3.smithi157.stdout:myimage31 4/s 7/s 158 KiB/s 180 KiB/s 1.41 ms 329.39 us 2024-03-26T17:03:33.186 INFO:tasks.workunit.client.3.smithi157.stdout:myimage15 4/s 6/s 110 KiB/s 150 KiB/s 1.31 ms 315.99 us 2024-03-26T17:03:33.186 INFO:tasks.workunit.client.3.smithi157.stdout:myimage25 4/s 8/s 132 KiB/s 190 KiB/s 1.54 ms 329.87 us 2024-03-26T17:03:33.186 INFO:tasks.workunit.client.3.smithi157.stdout:myimage56 4/s 7/s 142 KiB/s 149 KiB/s 1.33 ms 282.93 us 2024-03-26T17:03:33.186 INFO:tasks.workunit.client.3.smithi157.stdout:myimage13 4/s 7/s 93 KiB/s 190 KiB/s 1.28 ms 274.90 us 2024-03-26T17:03:33.186 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:03:33.265 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:03:32 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:03:32] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:03:33.265 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:03:32 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:03:32] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:03:33.265 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:03:32 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:03:33.547 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:03:33 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:03:33] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:03:33.548 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:03:33 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:03:33] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:03:33.548 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:03:33 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:03:33.896 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:03:33 smithi149 ceph-mon[34678]: Health check update: 3 slow ops, oldest one blocked for 308 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:03:34.015 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:03:33 smithi044 ceph-mon[30624]: Health check update: 3 slow ops, oldest one blocked for 308 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:03:34.055 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:03:33 smithi064 ceph-mon[34420]: Health check update: 3 slow ops, oldest one blocked for 308 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:03:34.896 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:03:34 smithi149 ceph-mon[34678]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:03:34.896 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:03:34 smithi149 ceph-mon[34678]: { 2024-03-26T17:03:34.896 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:03:34 smithi149 ceph-mon[34678]: "prefix": "rbd perf image stats", 2024-03-26T17:03:34.896 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:03:34 smithi149 ceph-mon[34678]: "pool_spec": "mypool", 2024-03-26T17:03:34.896 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:03:34 smithi149 ceph-mon[34678]: "sort_by": "write_ops", 2024-03-26T17:03:34.896 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:03:34 smithi149 ceph-mon[34678]: "format": "json" 2024-03-26T17:03:34.896 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:03:34 smithi149 ceph-mon[34678]: }"]: dispatch 2024-03-26T17:03:34.897 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:03:34 smithi149 ceph-mon[34678]: pgmap v528: 33 pgs: 33 active+clean; 1021 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 9.8 MiB/s rd, 10 MiB/s wr, 792 op/s 2024-03-26T17:03:34.938 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:03:34 smithi044 ceph-mon[30624]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:03:34.939 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:03:34 smithi044 ceph-mon[30624]: { 2024-03-26T17:03:34.939 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:03:34 smithi044 ceph-mon[30624]: "prefix": "rbd perf image stats", 2024-03-26T17:03:34.939 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:03:34 smithi044 ceph-mon[30624]: "pool_spec": "mypool", 2024-03-26T17:03:34.939 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:03:34 smithi044 ceph-mon[30624]: "sort_by": "write_ops", 2024-03-26T17:03:34.939 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:03:34 smithi044 ceph-mon[30624]: "format": "json" 2024-03-26T17:03:34.939 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:03:34 smithi044 ceph-mon[30624]: }"]: dispatch 2024-03-26T17:03:34.939 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:03:34 smithi044 ceph-mon[30624]: pgmap v528: 33 pgs: 33 active+clean; 1021 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 9.8 MiB/s rd, 10 MiB/s wr, 792 op/s 2024-03-26T17:03:35.057 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:03:34 smithi064 ceph-mon[34420]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:03:35.057 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:03:34 smithi064 ceph-mon[34420]: { 2024-03-26T17:03:35.058 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:03:34 smithi064 ceph-mon[34420]: "prefix": "rbd perf image stats", 2024-03-26T17:03:35.058 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:03:34 smithi064 ceph-mon[34420]: "pool_spec": "mypool", 2024-03-26T17:03:35.058 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:03:34 smithi064 ceph-mon[34420]: "sort_by": "write_ops", 2024-03-26T17:03:35.058 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:03:34 smithi064 ceph-mon[34420]: "format": "json" 2024-03-26T17:03:35.058 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:03:34 smithi064 ceph-mon[34420]: }"]: dispatch 2024-03-26T17:03:35.058 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:03:34 smithi064 ceph-mon[34420]: pgmap v528: 33 pgs: 33 active+clean; 1021 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 9.8 MiB/s rd, 10 MiB/s wr, 792 op/s 2024-03-26T17:03:35.266 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:03:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:03:34] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:03:35.266 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:03:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:03:34] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:03:35.267 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:03:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:03:35.646 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:03:35 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:03:35] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:03:35.646 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:03:35 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:03:35] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:03:35.647 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:03:35 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:03:36.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:03:36 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-26T17:03:36.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:03:36 smithi044 ceph-mon[30624]: pgmap v529: 33 pgs: 33 active+clean; 1021 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 8.5 MiB/s rd, 8.9 MiB/s wr, 710 op/s 2024-03-26T17:03:36.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:03:36 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-26T17:03:36.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:03:36 smithi064 ceph-mon[34420]: pgmap v529: 33 pgs: 33 active+clean; 1021 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 8.5 MiB/s rd, 8.9 MiB/s wr, 710 op/s 2024-03-26T17:03:36.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:03:36 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-26T17:03:36.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:03:36 smithi149 ceph-mon[34678]: pgmap v529: 33 pgs: 33 active+clean; 1021 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 8.5 MiB/s rd, 8.9 MiB/s wr, 710 op/s 2024-03-26T17:03:36.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:03:36 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 2024-03-26T17:03:36.217+0000 7fa707a55700 -1 mon.c@1(peon) e3 get_health_metrics reporting 3 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T17:03:37.215 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:03:36 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:03:36] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:03:37.215 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:03:36 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:03:36] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:03:37.215 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:03:36 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:03:37.519 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:03:37 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-03-26T17:03:37.519 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:03:37 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-03-26T17:03:37.519 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:03:37 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-03-26T17:03:37.519 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:03:37 smithi044 ceph-mon[30624]: Adjusting osd_memory_target on smithi149 to 1938M 2024-03-26T17:03:37.519 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:03:37 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T17:03:37.519 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:03:37 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T17:03:37.519 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:03:37 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-26T17:03:37.520 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:03:37 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T17:03:37.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:03:37 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-03-26T17:03:37.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:03:37 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-03-26T17:03:37.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:03:37 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-03-26T17:03:37.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:03:37 smithi064 ceph-mon[34420]: Adjusting osd_memory_target on smithi149 to 1938M 2024-03-26T17:03:37.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:03:37 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T17:03:37.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:03:37 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T17:03:37.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:03:37 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-26T17:03:37.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:03:37 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T17:03:37.559 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:03:37 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-03-26T17:03:37.559 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:03:37 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-03-26T17:03:37.559 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:03:37 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-03-26T17:03:37.559 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:03:37 smithi149 ceph-mon[34678]: Adjusting osd_memory_target on smithi149 to 1938M 2024-03-26T17:03:37.560 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:03:37 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T17:03:37.560 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:03:37 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T17:03:37.560 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:03:37 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-26T17:03:37.560 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:03:37 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T17:03:37.560 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:03:37 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:03:37] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:03:37.560 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:03:37 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:03:37] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:03:37.560 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:03:37 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:03:38.186 INFO:tasks.workunit.client.3.smithi157.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-26T17:03:38.186 INFO:tasks.workunit.client.3.smithi157.stdout:myimage41 8/s 4/s 216 KiB/s 119 KiB/s 1.40 ms 281.97 us 2024-03-26T17:03:38.186 INFO:tasks.workunit.client.3.smithi157.stdout:myimage4 8/s 5/s 230 KiB/s 104 KiB/s 1.32 ms 261.77 us 2024-03-26T17:03:38.186 INFO:tasks.workunit.client.3.smithi157.stdout:myimage47 8/s 5/s 177 KiB/s 110 KiB/s 1.35 ms 344.39 us 2024-03-26T17:03:38.186 INFO:tasks.workunit.client.3.smithi157.stdout:myimage24 7/s 6/s 174 KiB/s 155 KiB/s 1.35 ms 349.74 us 2024-03-26T17:03:38.186 INFO:tasks.workunit.client.3.smithi157.stdout:myimage36 7/s 5/s 152 KiB/s 121 KiB/s 1.32 ms 393.96 us 2024-03-26T17:03:38.186 INFO:tasks.workunit.client.3.smithi157.stdout:myimage23 7/s 5/s 203 KiB/s 128 KiB/s 1.32 ms 278.08 us 2024-03-26T17:03:38.186 INFO:tasks.workunit.client.3.smithi157.stdout:myimage33 7/s 4/s 174 KiB/s 111 KiB/s 1.41 ms 461.45 us 2024-03-26T17:03:38.187 INFO:tasks.workunit.client.3.smithi157.stdout:myimage53 7/s 4/s 144 KiB/s 100 KiB/s 1.30 ms 291.95 us 2024-03-26T17:03:38.187 INFO:tasks.workunit.client.3.smithi157.stdout:myimage54 7/s 5/s 144 KiB/s 130 KiB/s 1.35 ms 356.87 us 2024-03-26T17:03:38.187 INFO:tasks.workunit.client.3.smithi157.stdout:myimage31 7/s 5/s 173 KiB/s 156 KiB/s 1.42 ms 357.06 us 2024-03-26T17:03:38.187 INFO:tasks.workunit.client.3.smithi157.stdout:myimage28 7/s 4/s 206 KiB/s 120 KiB/s 1.57 ms 295.73 us 2024-03-26T17:03:38.187 INFO:tasks.workunit.client.3.smithi157.stdout:myimage56 7/s 4/s 208 KiB/s 93 KiB/s 1.45 ms 264.96 us 2024-03-26T17:03:38.187 INFO:tasks.workunit.client.3.smithi157.stdout:myimage40 7/s 5/s 161 KiB/s 149 KiB/s 1.30 ms 315.03 us 2024-03-26T17:03:38.187 INFO:tasks.workunit.client.3.smithi157.stdout:myimage29 7/s 5/s 182 KiB/s 146 KiB/s 1.27 ms 304.13 us 2024-03-26T17:03:38.187 INFO:tasks.workunit.client.3.smithi157.stdout:myimage7 6/s 5/s 156 KiB/s 122 KiB/s 1.37 ms 320.76 us 2024-03-26T17:03:38.187 INFO:tasks.workunit.client.3.smithi157.stdout:myimage46 6/s 5/s 178 KiB/s 115 KiB/s 1.32 ms 272.69 us 2024-03-26T17:03:38.187 INFO:tasks.workunit.client.3.smithi157.stdout:myimage38 6/s 6/s 177 KiB/s 126 KiB/s 1.31 ms 314.94 us 2024-03-26T17:03:38.187 INFO:tasks.workunit.client.3.smithi157.stdout:myimage52 6/s 6/s 154 KiB/s 130 KiB/s 1.51 ms 299.72 us 2024-03-26T17:03:38.187 INFO:tasks.workunit.client.3.smithi157.stdout:myimage26 6/s 5/s 130 KiB/s 122 KiB/s 1.37 ms 312.47 us 2024-03-26T17:03:38.187 INFO:tasks.workunit.client.3.smithi157.stdout:myimage57 6/s 5/s 139 KiB/s 106 KiB/s 1.36 ms 317.76 us 2024-03-26T17:03:38.187 INFO:tasks.workunit.client.3.smithi157.stdout:myimage6 6/s 7/s 178 KiB/s 165 KiB/s 1.42 ms 261.76 us 2024-03-26T17:03:38.188 INFO:tasks.workunit.client.3.smithi157.stdout:myimage15 6/s 6/s 171 KiB/s 164 KiB/s 1.37 ms 267.55 us 2024-03-26T17:03:38.188 INFO:tasks.workunit.client.3.smithi157.stdout:myimage51 6/s 7/s 183 KiB/s 158 KiB/s 1.47 ms 279.19 us 2024-03-26T17:03:38.188 INFO:tasks.workunit.client.3.smithi157.stdout:myimage14 6/s 5/s 159 KiB/s 133 KiB/s 1.40 ms 294.95 us 2024-03-26T17:03:38.188 INFO:tasks.workunit.client.3.smithi157.stdout:myimage49 6/s 5/s 127 KiB/s 120 KiB/s 1.43 ms 298.17 us 2024-03-26T17:03:38.188 INFO:tasks.workunit.client.3.smithi157.stdout:myimage58 6/s 5/s 174 KiB/s 130 KiB/s 1.32 ms 274.10 us 2024-03-26T17:03:38.188 INFO:tasks.workunit.client.3.smithi157.stdout:myimage12 6/s 5/s 131 KiB/s 118 KiB/s 1.32 ms 406.72 us 2024-03-26T17:03:38.188 INFO:tasks.workunit.client.3.smithi157.stdout:myimage42 6/s 5/s 138 KiB/s 162 KiB/s 1.31 ms 280.32 us 2024-03-26T17:03:38.188 INFO:tasks.workunit.client.3.smithi157.stdout:myimage45 6/s 5/s 139 KiB/s 169 KiB/s 1.33 ms 275.38 us 2024-03-26T17:03:38.188 INFO:tasks.workunit.client.3.smithi157.stdout:myimage3 6/s 5/s 166 KiB/s 132 KiB/s 1.37 ms 302.29 us 2024-03-26T17:03:38.188 INFO:tasks.workunit.client.3.smithi157.stdout:myimage1 6/s 5/s 142 KiB/s 130 KiB/s 1.27 ms 293.49 us 2024-03-26T17:03:38.188 INFO:tasks.workunit.client.3.smithi157.stdout:myimage18 6/s 6/s 164 KiB/s 126 KiB/s 1.30 ms 330.32 us 2024-03-26T17:03:38.188 INFO:tasks.workunit.client.3.smithi157.stdout:myimage19 6/s 6/s 128 KiB/s 193 KiB/s 1.39 ms 317.25 us 2024-03-26T17:03:38.188 INFO:tasks.workunit.client.3.smithi157.stdout:myimage25 6/s 6/s 155 KiB/s 129 KiB/s 1.58 ms 290.22 us 2024-03-26T17:03:38.188 INFO:tasks.workunit.client.3.smithi157.stdout:myimage39 6/s 6/s 154 KiB/s 141 KiB/s 1.34 ms 293.84 us 2024-03-26T17:03:38.188 INFO:tasks.workunit.client.3.smithi157.stdout:myimage59 6/s 5/s 174 KiB/s 150 KiB/s 1.57 ms 281.34 us 2024-03-26T17:03:38.189 INFO:tasks.workunit.client.3.smithi157.stdout:myimage2 5/s 6/s 126 KiB/s 159 KiB/s 1.39 ms 276.72 us 2024-03-26T17:03:38.189 INFO:tasks.workunit.client.3.smithi157.stdout:myimage22 5/s 6/s 167 KiB/s 136 KiB/s 1.42 ms 291.31 us 2024-03-26T17:03:38.189 INFO:tasks.workunit.client.3.smithi157.stdout:myimage32 5/s 6/s 134 KiB/s 154 KiB/s 1.37 ms 271.73 us 2024-03-26T17:03:38.189 INFO:tasks.workunit.client.3.smithi157.stdout:myimage37 5/s 6/s 126 KiB/s 174 KiB/s 1.37 ms 338.28 us 2024-03-26T17:03:38.189 INFO:tasks.workunit.client.3.smithi157.stdout:myimage5 5/s 6/s 140 KiB/s 137 KiB/s 1.37 ms 306.59 us 2024-03-26T17:03:38.189 INFO:tasks.workunit.client.3.smithi157.stdout:myimage8 5/s 6/s 165 KiB/s 172 KiB/s 1.33 ms 351.75 us 2024-03-26T17:03:38.189 INFO:tasks.workunit.client.3.smithi157.stdout:myimage21 5/s 5/s 160 KiB/s 106 KiB/s 1.53 ms 276.54 us 2024-03-26T17:03:38.189 INFO:tasks.workunit.client.3.smithi157.stdout:myimage27 5/s 6/s 160 KiB/s 169 KiB/s 1.30 ms 303.79 us 2024-03-26T17:03:38.189 INFO:tasks.workunit.client.3.smithi157.stdout:myimage43 5/s 6/s 154 KiB/s 176 KiB/s 1.41 ms 282.26 us 2024-03-26T17:03:38.189 INFO:tasks.workunit.client.3.smithi157.stdout:myimage30 5/s 5/s 123 KiB/s 121 KiB/s 1.47 ms 350.09 us 2024-03-26T17:03:38.189 INFO:tasks.workunit.client.3.smithi157.stdout:myimage44 5/s 7/s 133 KiB/s 170 KiB/s 1.37 ms 312.44 us 2024-03-26T17:03:38.189 INFO:tasks.workunit.client.3.smithi157.stdout:myimage55 5/s 6/s 134 KiB/s 172 KiB/s 1.33 ms 410.87 us 2024-03-26T17:03:38.189 INFO:tasks.workunit.client.3.smithi157.stdout:myimage10 5/s 7/s 122 KiB/s 176 KiB/s 1.32 ms 262.76 us 2024-03-26T17:03:38.189 INFO:tasks.workunit.client.3.smithi157.stdout:myimage9 5/s 4/s 103 KiB/s 129 KiB/s 1.41 ms 292.37 us 2024-03-26T17:03:38.190 INFO:tasks.workunit.client.3.smithi157.stdout:myimage11 5/s 6/s 129 KiB/s 147 KiB/s 1.40 ms 274.28 us 2024-03-26T17:03:38.190 INFO:tasks.workunit.client.3.smithi157.stdout:myimage17 5/s 7/s 117 KiB/s 193 KiB/s 1.40 ms 301.66 us 2024-03-26T17:03:38.190 INFO:tasks.workunit.client.3.smithi157.stdout:myimage20 5/s 6/s 121 KiB/s 158 KiB/s 1.43 ms 315.04 us 2024-03-26T17:03:38.190 INFO:tasks.workunit.client.3.smithi157.stdout:myimage50 5/s 6/s 105 KiB/s 164 KiB/s 1.43 ms 294.94 us 2024-03-26T17:03:38.190 INFO:tasks.workunit.client.3.smithi157.stdout:myimage35 5/s 6/s 131 KiB/s 152 KiB/s 1.32 ms 280.13 us 2024-03-26T17:03:38.190 INFO:tasks.workunit.client.3.smithi157.stdout:myimage13 5/s 6/s 138 KiB/s 165 KiB/s 1.32 ms 254.09 us 2024-03-26T17:03:38.190 INFO:tasks.workunit.client.3.smithi157.stdout:myimage16 5/s 8/s 102 KiB/s 173 KiB/s 1.34 ms 301.35 us 2024-03-26T17:03:38.190 INFO:tasks.workunit.client.3.smithi157.stdout:myimage48 4/s 7/s 94 KiB/s 182 KiB/s 1.34 ms 257.69 us 2024-03-26T17:03:38.190 INFO:tasks.workunit.client.3.smithi157.stdout:myimage60 4/s 8/s 116 KiB/s 215 KiB/s 1.44 ms 253.96 us 2024-03-26T17:03:38.190 INFO:tasks.workunit.client.3.smithi157.stdout:myimage34 4/s 7/s 81 KiB/s 216 KiB/s 1.26 ms 281.65 us 2024-03-26T17:03:38.190 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:03:38.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:03:38 smithi044 ceph-mon[30624]: pgmap v530: 33 pgs: 33 active+clean; 1022 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 8.6 MiB/s rd, 8.9 MiB/s wr, 721 op/s 2024-03-26T17:03:38.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:03:38 smithi064 ceph-mon[34420]: pgmap v530: 33 pgs: 33 active+clean; 1022 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 8.6 MiB/s rd, 8.9 MiB/s wr, 721 op/s 2024-03-26T17:03:38.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:03:38 smithi149 ceph-mon[34678]: pgmap v530: 33 pgs: 33 active+clean; 1022 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 8.6 MiB/s rd, 8.9 MiB/s wr, 721 op/s 2024-03-26T17:03:39.222 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:03:38 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:03:38] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:03:39.222 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:03:38 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:03:38] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:03:39.222 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:03:38 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:03:39.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:03:39 smithi044 ceph-mon[30624]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:03:39.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:03:39 smithi044 ceph-mon[30624]: { 2024-03-26T17:03:39.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:03:39 smithi044 ceph-mon[30624]: "prefix": "rbd perf image stats", 2024-03-26T17:03:39.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:03:39 smithi044 ceph-mon[30624]: "pool_spec": "mypool", 2024-03-26T17:03:39.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:03:39 smithi044 ceph-mon[30624]: "sort_by": "write_ops", 2024-03-26T17:03:39.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:03:39 smithi044 ceph-mon[30624]: "format": "json" 2024-03-26T17:03:39.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:03:39 smithi044 ceph-mon[30624]: }"]: dispatch 2024-03-26T17:03:39.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:03:39 smithi044 ceph-mon[30624]: Health check update: 3 slow ops, oldest one blocked for 313 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:03:39.547 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:03:39 smithi149 ceph-mon[34678]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:03:39.547 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:03:39 smithi149 ceph-mon[34678]: { 2024-03-26T17:03:39.548 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:03:39 smithi149 ceph-mon[34678]: "prefix": "rbd perf image stats", 2024-03-26T17:03:39.548 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:03:39 smithi149 ceph-mon[34678]: "pool_spec": "mypool", 2024-03-26T17:03:39.548 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:03:39 smithi149 ceph-mon[34678]: "sort_by": "write_ops", 2024-03-26T17:03:39.548 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:03:39 smithi149 ceph-mon[34678]: "format": "json" 2024-03-26T17:03:39.548 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:03:39 smithi149 ceph-mon[34678]: }"]: dispatch 2024-03-26T17:03:39.548 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:03:39 smithi149 ceph-mon[34678]: Health check update: 3 slow ops, oldest one blocked for 313 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:03:39.548 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:03:39 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:03:39] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:03:39.548 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:03:39 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:03:39] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:03:39.549 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:03:39 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:03:39.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:03:39 smithi064 ceph-mon[34420]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:03:39.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:03:39 smithi064 ceph-mon[34420]: { 2024-03-26T17:03:39.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:03:39 smithi064 ceph-mon[34420]: "prefix": "rbd perf image stats", 2024-03-26T17:03:39.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:03:39 smithi064 ceph-mon[34420]: "pool_spec": "mypool", 2024-03-26T17:03:39.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:03:39 smithi064 ceph-mon[34420]: "sort_by": "write_ops", 2024-03-26T17:03:39.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:03:39 smithi064 ceph-mon[34420]: "format": "json" 2024-03-26T17:03:39.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:03:39 smithi064 ceph-mon[34420]: }"]: dispatch 2024-03-26T17:03:39.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:03:39 smithi064 ceph-mon[34420]: Health check update: 3 slow ops, oldest one blocked for 313 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:03:40.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:03:40 smithi044 ceph-mon[30624]: pgmap v531: 33 pgs: 33 active+clean; 1022 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 9.0 MiB/s rd, 9.2 MiB/s wr, 775 op/s 2024-03-26T17:03:40.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:03:40 smithi064 ceph-mon[34420]: pgmap v531: 33 pgs: 33 active+clean; 1022 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 9.0 MiB/s rd, 9.2 MiB/s wr, 775 op/s 2024-03-26T17:03:40.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:03:40 smithi149 ceph-mon[34678]: pgmap v531: 33 pgs: 33 active+clean; 1022 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 9.0 MiB/s rd, 9.2 MiB/s wr, 775 op/s 2024-03-26T17:03:41.265 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:03:40 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:03:40] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:03:41.265 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:03:40 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:03:40] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:03:41.266 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:03:40 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:03:41.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:03:41 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 2024-03-26T17:03:41.216+0000 7fa707a55700 -1 mon.c@1(peon) e3 get_health_metrics reporting 3 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T17:03:41.646 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:03:41 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:03:41] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:03:41.647 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:03:41 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:03:41] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:03:41.647 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:03:41 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:03:42.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:03:42 smithi044 ceph-mon[30624]: pgmap v532: 33 pgs: 33 active+clean; 1022 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 7.8 MiB/s rd, 7.9 MiB/s wr, 680 op/s 2024-03-26T17:03:42.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:03:42 smithi064 ceph-mon[34420]: pgmap v532: 33 pgs: 33 active+clean; 1022 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 7.8 MiB/s rd, 7.9 MiB/s wr, 680 op/s 2024-03-26T17:03:42.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:03:42 smithi149 ceph-mon[34678]: pgmap v532: 33 pgs: 33 active+clean; 1022 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 7.8 MiB/s rd, 7.9 MiB/s wr, 680 op/s 2024-03-26T17:03:43.061 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:03:43.069 INFO:tasks.workunit.client.3.smithi157.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2024-03-26T17:03:43.069 INFO:tasks.workunit.client.3.smithi157.stdout: 12.30 131.2k 164.8k 0.0k 1.3M 1.6M 0.0k nvme2n1 2024-03-26T17:03:43.069 INFO:tasks.workunit.client.3.smithi157.stdout: 12.30 146.4k 156.8k 0.0k 1.4M 1.5M 0.0k nvme2n10 2024-03-26T17:03:43.069 INFO:tasks.workunit.client.3.smithi157.stdout: 12.30 148.0k 112.0k 0.0k 1.4M 1.1M 0.0k nvme2n11 2024-03-26T17:03:43.070 INFO:tasks.workunit.client.3.smithi157.stdout: 12.30 150.8k 110.4k 0.0k 1.5M 1.1M 0.0k nvme2n12 2024-03-26T17:03:43.070 INFO:tasks.workunit.client.3.smithi157.stdout: 12.30 171.2k 138.8k 0.0k 1.7M 1.4M 0.0k nvme2n13 2024-03-26T17:03:43.070 INFO:tasks.workunit.client.3.smithi157.stdout: 12.30 179.2k 142.4k 0.0k 1.8M 1.4M 0.0k nvme2n14 2024-03-26T17:03:43.070 INFO:tasks.workunit.client.3.smithi157.stdout: 12.30 167.2k 128.8k 0.0k 1.6M 1.3M 0.0k nvme2n15 2024-03-26T17:03:43.070 INFO:tasks.workunit.client.3.smithi157.stdout: 12.30 150.4k 150.0k 0.0k 1.5M 1.5M 0.0k nvme2n16 2024-03-26T17:03:43.070 INFO:tasks.workunit.client.3.smithi157.stdout: 12.30 158.8k 135.6k 0.0k 1.6M 1.3M 0.0k nvme2n17 2024-03-26T17:03:43.070 INFO:tasks.workunit.client.3.smithi157.stdout: 12.30 141.6k 119.2k 0.0k 1.4M 1.2M 0.0k nvme2n18 2024-03-26T17:03:43.070 INFO:tasks.workunit.client.3.smithi157.stdout: 12.30 148.4k 114.4k 0.0k 1.4M 1.1M 0.0k nvme2n19 2024-03-26T17:03:43.070 INFO:tasks.workunit.client.3.smithi157.stdout: 12.30 150.8k 105.2k 0.0k 1.5M 1.0M 0.0k nvme2n2 2024-03-26T17:03:43.070 INFO:tasks.workunit.client.3.smithi157.stdout: 12.30 161.2k 123.6k 0.0k 1.6M 1.2M 0.0k nvme2n20 2024-03-26T17:03:43.070 INFO:tasks.workunit.client.3.smithi157.stdout: 12.30 149.6k 131.6k 0.0k 1.5M 1.3M 0.0k nvme2n3 2024-03-26T17:03:43.070 INFO:tasks.workunit.client.3.smithi157.stdout: 12.30 168.4k 132.0k 0.0k 1.6M 1.3M 0.0k nvme2n4 2024-03-26T17:03:43.070 INFO:tasks.workunit.client.3.smithi157.stdout: 12.30 134.8k 159.6k 0.0k 1.3M 1.6M 0.0k nvme2n5 2024-03-26T17:03:43.070 INFO:tasks.workunit.client.3.smithi157.stdout: 12.30 155.2k 139.2k 0.0k 1.5M 1.4M 0.0k nvme2n6 2024-03-26T17:03:43.070 INFO:tasks.workunit.client.3.smithi157.stdout: 12.30 142.8k 141.6k 0.0k 1.4M 1.4M 0.0k nvme2n7 2024-03-26T17:03:43.071 INFO:tasks.workunit.client.3.smithi157.stdout: 12.30 148.4k 150.8k 0.0k 1.4M 1.5M 0.0k nvme2n8 2024-03-26T17:03:43.071 INFO:tasks.workunit.client.3.smithi157.stdout: 12.30 130.8k 125.6k 0.0k 1.3M 1.2M 0.0k nvme2n9 2024-03-26T17:03:43.071 INFO:tasks.workunit.client.3.smithi157.stdout: 12.30 114.8k 183.6k 0.0k 1.1M 1.8M 0.0k nvme5n1 2024-03-26T17:03:43.071 INFO:tasks.workunit.client.3.smithi157.stdout: 12.30 131.6k 148.4k 0.0k 1.3M 1.4M 0.0k nvme5n10 2024-03-26T17:03:43.071 INFO:tasks.workunit.client.3.smithi157.stdout: 12.30 138.0k 154.0k 0.0k 1.3M 1.5M 0.0k nvme5n11 2024-03-26T17:03:43.071 INFO:tasks.workunit.client.3.smithi157.stdout: 12.30 130.0k 123.6k 0.0k 1.3M 1.2M 0.0k nvme5n12 2024-03-26T17:03:43.071 INFO:tasks.workunit.client.3.smithi157.stdout: 12.30 132.0k 147.6k 0.0k 1.3M 1.4M 0.0k nvme5n13 2024-03-26T17:03:43.071 INFO:tasks.workunit.client.3.smithi157.stdout: 12.30 162.8k 146.0k 0.0k 1.6M 1.4M 0.0k nvme5n14 2024-03-26T17:03:43.071 INFO:tasks.workunit.client.3.smithi157.stdout: 12.30 138.0k 130.0k 0.0k 1.3M 1.3M 0.0k nvme5n15 2024-03-26T17:03:43.071 INFO:tasks.workunit.client.3.smithi157.stdout: 12.30 129.2k 152.0k 0.0k 1.3M 1.5M 0.0k nvme5n16 2024-03-26T17:03:43.071 INFO:tasks.workunit.client.3.smithi157.stdout: 12.30 168.8k 144.0k 0.0k 1.6M 1.4M 0.0k nvme5n17 2024-03-26T17:03:43.071 INFO:tasks.workunit.client.3.smithi157.stdout: 12.30 146.4k 152.8k 0.0k 1.4M 1.5M 0.0k nvme5n18 2024-03-26T17:03:43.071 INFO:tasks.workunit.client.3.smithi157.stdout: 12.30 133.2k 153.2k 0.0k 1.3M 1.5M 0.0k nvme5n19 2024-03-26T17:03:43.071 INFO:tasks.workunit.client.3.smithi157.stdout: 12.30 154.8k 137.2k 0.0k 1.5M 1.3M 0.0k nvme5n2 2024-03-26T17:03:43.072 INFO:tasks.workunit.client.3.smithi157.stdout: 12.30 117.2k 162.8k 0.0k 1.1M 1.6M 0.0k nvme5n20 2024-03-26T17:03:43.072 INFO:tasks.workunit.client.3.smithi157.stdout: 12.30 133.6k 157.2k 0.0k 1.3M 1.5M 0.0k nvme5n3 2024-03-26T17:03:43.072 INFO:tasks.workunit.client.3.smithi157.stdout: 12.30 154.4k 129.6k 0.0k 1.5M 1.3M 0.0k nvme5n4 2024-03-26T17:03:43.072 INFO:tasks.workunit.client.3.smithi157.stdout: 12.30 121.6k 155.2k 0.0k 1.2M 1.5M 0.0k nvme5n5 2024-03-26T17:03:43.072 INFO:tasks.workunit.client.3.smithi157.stdout: 12.30 161.6k 119.2k 0.0k 1.6M 1.2M 0.0k nvme5n6 2024-03-26T17:03:43.072 INFO:tasks.workunit.client.3.smithi157.stdout: 12.30 166.8k 150.8k 0.0k 1.6M 1.5M 0.0k nvme5n7 2024-03-26T17:03:43.072 INFO:tasks.workunit.client.3.smithi157.stdout: 12.30 145.2k 162.0k 0.0k 1.4M 1.6M 0.0k nvme5n8 2024-03-26T17:03:43.072 INFO:tasks.workunit.client.3.smithi157.stdout: 12.30 139.6k 172.4k 0.0k 1.4M 1.7M 0.0k nvme5n9 2024-03-26T17:03:43.072 INFO:tasks.workunit.client.3.smithi157.stdout: 12.30 136.0k 142.0k 0.0k 1.3M 1.4M 0.0k nvme8n1 2024-03-26T17:03:43.072 INFO:tasks.workunit.client.3.smithi157.stdout: 12.30 148.8k 139.2k 0.0k 1.5M 1.4M 0.0k nvme8n10 2024-03-26T17:03:43.072 INFO:tasks.workunit.client.3.smithi157.stdout: 12.30 137.6k 147.6k 0.0k 1.3M 1.4M 0.0k nvme8n11 2024-03-26T17:03:43.072 INFO:tasks.workunit.client.3.smithi157.stdout: 12.30 152.4k 119.6k 0.0k 1.5M 1.2M 0.0k nvme8n12 2024-03-26T17:03:43.072 INFO:tasks.workunit.client.3.smithi157.stdout: 12.30 143.2k 150.8k 0.0k 1.4M 1.5M 0.0k nvme8n13 2024-03-26T17:03:43.072 INFO:tasks.workunit.client.3.smithi157.stdout: 12.30 134.8k 111.6k 0.0k 1.3M 1.1M 0.0k nvme8n14 2024-03-26T17:03:43.072 INFO:tasks.workunit.client.3.smithi157.stdout: 12.30 160.4k 147.6k 0.0k 1.6M 1.4M 0.0k nvme8n15 2024-03-26T17:03:43.073 INFO:tasks.workunit.client.3.smithi157.stdout: 12.30 111.2k 174.4k 0.0k 1.1M 1.7M 0.0k nvme8n16 2024-03-26T17:03:43.073 INFO:tasks.workunit.client.3.smithi157.stdout: 12.30 137.2k 130.4k 0.0k 1.3M 1.3M 0.0k nvme8n17 2024-03-26T17:03:43.073 INFO:tasks.workunit.client.3.smithi157.stdout: 12.30 148.0k 152.0k 0.0k 1.4M 1.5M 0.0k nvme8n18 2024-03-26T17:03:43.073 INFO:tasks.workunit.client.3.smithi157.stdout: 12.30 88.4k 187.6k 0.0k 884.0k 1.8M 0.0k nvme8n19 2024-03-26T17:03:43.073 INFO:tasks.workunit.client.3.smithi157.stdout: 12.30 141.2k 140.0k 0.0k 1.4M 1.4M 0.0k nvme8n2 2024-03-26T17:03:43.073 INFO:tasks.workunit.client.3.smithi157.stdout: 12.30 161.2k 148.0k 0.0k 1.6M 1.4M 0.0k nvme8n20 2024-03-26T17:03:43.073 INFO:tasks.workunit.client.3.smithi157.stdout: 12.30 136.8k 131.2k 0.0k 1.3M 1.3M 0.0k nvme8n3 2024-03-26T17:03:43.073 INFO:tasks.workunit.client.3.smithi157.stdout: 12.30 126.0k 145.6k 0.0k 1.2M 1.4M 0.0k nvme8n4 2024-03-26T17:03:43.073 INFO:tasks.workunit.client.3.smithi157.stdout: 12.30 160.8k 113.6k 0.0k 1.6M 1.1M 0.0k nvme8n5 2024-03-26T17:03:43.073 INFO:tasks.workunit.client.3.smithi157.stdout: 12.30 116.8k 165.2k 0.0k 1.1M 1.6M 0.0k nvme8n6 2024-03-26T17:03:43.073 INFO:tasks.workunit.client.3.smithi157.stdout: 12.30 124.8k 143.6k 0.0k 1.2M 1.4M 0.0k nvme8n7 2024-03-26T17:03:43.073 INFO:tasks.workunit.client.3.smithi157.stdout: 12.30 155.2k 109.2k 0.0k 1.5M 1.1M 0.0k nvme8n8 2024-03-26T17:03:43.073 INFO:tasks.workunit.client.3.smithi157.stdout: 12.30 150.4k 148.8k 0.0k 1.5M 1.5M 0.0k nvme8n9 2024-03-26T17:03:43.073 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:03:43.189 INFO:tasks.workunit.client.3.smithi157.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-26T17:03:43.189 INFO:tasks.workunit.client.3.smithi157.stdout:myimage21 7/s 5/s 200 KiB/s 121 KiB/s 1.59 ms 312.39 us 2024-03-26T17:03:43.189 INFO:tasks.workunit.client.3.smithi157.stdout:myimage13 7/s 5/s 150 KiB/s 166 KiB/s 1.30 ms 264.98 us 2024-03-26T17:03:43.189 INFO:tasks.workunit.client.3.smithi157.stdout:myimage9 7/s 6/s 163 KiB/s 138 KiB/s 1.42 ms 268.99 us 2024-03-26T17:03:43.189 INFO:tasks.workunit.client.3.smithi157.stdout:myimage33 7/s 7/s 161 KiB/s 158 KiB/s 1.39 ms 277.28 us 2024-03-26T17:03:43.189 INFO:tasks.workunit.client.3.smithi157.stdout:myimage60 7/s 5/s 192 KiB/s 142 KiB/s 1.38 ms 302.34 us 2024-03-26T17:03:43.190 INFO:tasks.workunit.client.3.smithi157.stdout:myimage59 7/s 5/s 172 KiB/s 90 KiB/s 1.42 ms 281.29 us 2024-03-26T17:03:43.190 INFO:tasks.workunit.client.3.smithi157.stdout:myimage23 7/s 5/s 182 KiB/s 125 KiB/s 1.29 ms 285.55 us 2024-03-26T17:03:43.190 INFO:tasks.workunit.client.3.smithi157.stdout:myimage31 7/s 5/s 148 KiB/s 156 KiB/s 1.43 ms 280.20 us 2024-03-26T17:03:43.190 INFO:tasks.workunit.client.3.smithi157.stdout:myimage30 7/s 5/s 180 KiB/s 116 KiB/s 1.52 ms 297.02 us 2024-03-26T17:03:43.190 INFO:tasks.workunit.client.3.smithi157.stdout:myimage28 7/s 6/s 182 KiB/s 151 KiB/s 1.56 ms 311.29 us 2024-03-26T17:03:43.190 INFO:tasks.workunit.client.3.smithi157.stdout:myimage56 7/s 6/s 190 KiB/s 113 KiB/s 1.49 ms 322.32 us 2024-03-26T17:03:43.190 INFO:tasks.workunit.client.3.smithi157.stdout:myimage49 7/s 6/s 162 KiB/s 138 KiB/s 1.36 ms 330.64 us 2024-03-26T17:03:43.190 INFO:tasks.workunit.client.3.smithi157.stdout:myimage5 7/s 5/s 191 KiB/s 115 KiB/s 1.33 ms 303.94 us 2024-03-26T17:03:43.190 INFO:tasks.workunit.client.3.smithi157.stdout:myimage39 7/s 6/s 174 KiB/s 122 KiB/s 1.35 ms 287.09 us 2024-03-26T17:03:43.190 INFO:tasks.workunit.client.3.smithi157.stdout:myimage42 7/s 5/s 152 KiB/s 148 KiB/s 1.34 ms 270.33 us 2024-03-26T17:03:43.190 INFO:tasks.workunit.client.3.smithi157.stdout:myimage34 6/s 6/s 189 KiB/s 174 KiB/s 1.35 ms 289.76 us 2024-03-26T17:03:43.190 INFO:tasks.workunit.client.3.smithi157.stdout:myimage47 6/s 4/s 156 KiB/s 90 KiB/s 1.40 ms 245.87 us 2024-03-26T17:03:43.190 INFO:tasks.workunit.client.3.smithi157.stdout:myimage51 6/s 5/s 163 KiB/s 119 KiB/s 1.40 ms 299.59 us 2024-03-26T17:03:43.190 INFO:tasks.workunit.client.3.smithi157.stdout:myimage40 6/s 5/s 166 KiB/s 110 KiB/s 1.32 ms 270.90 us 2024-03-26T17:03:43.191 INFO:tasks.workunit.client.3.smithi157.stdout:myimage1 6/s 5/s 171 KiB/s 133 KiB/s 1.27 ms 305.88 us 2024-03-26T17:03:43.191 INFO:tasks.workunit.client.3.smithi157.stdout:myimage7 6/s 6/s 153 KiB/s 138 KiB/s 1.36 ms 293.41 us 2024-03-26T17:03:43.191 INFO:tasks.workunit.client.3.smithi157.stdout:myimage8 6/s 5/s 154 KiB/s 144 KiB/s 1.45 ms 389.02 us 2024-03-26T17:03:43.191 INFO:tasks.workunit.client.3.smithi157.stdout:myimage17 6/s 6/s 159 KiB/s 139 KiB/s 1.40 ms 277.68 us 2024-03-26T17:03:43.191 INFO:tasks.workunit.client.3.smithi157.stdout:myimage25 6/s 5/s 150 KiB/s 95 KiB/s 1.67 ms 268.80 us 2024-03-26T17:03:43.191 INFO:tasks.workunit.client.3.smithi157.stdout:myimage29 6/s 5/s 179 KiB/s 135 KiB/s 1.30 ms 284.78 us 2024-03-26T17:03:43.191 INFO:tasks.workunit.client.3.smithi157.stdout:myimage43 6/s 5/s 115 KiB/s 104 KiB/s 1.43 ms 330.18 us 2024-03-26T17:03:43.191 INFO:tasks.workunit.client.3.smithi157.stdout:myimage14 6/s 7/s 149 KiB/s 177 KiB/s 1.44 ms 337.15 us 2024-03-26T17:03:43.191 INFO:tasks.workunit.client.3.smithi157.stdout:myimage36 6/s 5/s 150 KiB/s 98 KiB/s 1.30 ms 286.63 us 2024-03-26T17:03:43.191 INFO:tasks.workunit.client.3.smithi157.stdout:myimage10 6/s 5/s 200 KiB/s 129 KiB/s 1.36 ms 281.91 us 2024-03-26T17:03:43.191 INFO:tasks.workunit.client.3.smithi157.stdout:myimage2 6/s 6/s 102 KiB/s 170 KiB/s 1.40 ms 268.15 us 2024-03-26T17:03:43.191 INFO:tasks.workunit.client.3.smithi157.stdout:myimage16 6/s 6/s 148 KiB/s 149 KiB/s 1.43 ms 335.98 us 2024-03-26T17:03:43.191 INFO:tasks.workunit.client.3.smithi157.stdout:myimage18 6/s 5/s 120 KiB/s 146 KiB/s 1.38 ms 299.50 us 2024-03-26T17:03:43.191 INFO:tasks.workunit.client.3.smithi157.stdout:myimage50 6/s 7/s 138 KiB/s 151 KiB/s 1.32 ms 357.38 us 2024-03-26T17:03:43.191 INFO:tasks.workunit.client.3.smithi157.stdout:myimage54 6/s 5/s 90 KiB/s 122 KiB/s 1.32 ms 329.07 us 2024-03-26T17:03:43.192 INFO:tasks.workunit.client.3.smithi157.stdout:myimage44 6/s 6/s 132 KiB/s 94 KiB/s 1.42 ms 253.09 us 2024-03-26T17:03:43.192 INFO:tasks.workunit.client.3.smithi157.stdout:myimage46 6/s 6/s 165 KiB/s 137 KiB/s 1.38 ms 264.10 us 2024-03-26T17:03:43.192 INFO:tasks.workunit.client.3.smithi157.stdout:myimage11 5/s 6/s 116 KiB/s 115 KiB/s 1.46 ms 280.98 us 2024-03-26T17:03:43.192 INFO:tasks.workunit.client.3.smithi157.stdout:myimage12 5/s 6/s 134 KiB/s 134 KiB/s 1.39 ms 302.98 us 2024-03-26T17:03:43.192 INFO:tasks.workunit.client.3.smithi157.stdout:myimage41 5/s 5/s 136 KiB/s 110 KiB/s 1.38 ms 244.94 us 2024-03-26T17:03:43.192 INFO:tasks.workunit.client.3.smithi157.stdout:myimage53 5/s 7/s 146 KiB/s 140 KiB/s 1.34 ms 314.67 us 2024-03-26T17:03:43.192 INFO:tasks.workunit.client.3.smithi157.stdout:myimage57 5/s 5/s 88 KiB/s 134 KiB/s 1.34 ms 311.38 us 2024-03-26T17:03:43.192 INFO:tasks.workunit.client.3.smithi157.stdout:myimage3 5/s 7/s 115 KiB/s 158 KiB/s 1.28 ms 350.11 us 2024-03-26T17:03:43.192 INFO:tasks.workunit.client.3.smithi157.stdout:myimage32 5/s 6/s 106 KiB/s 146 KiB/s 1.37 ms 271.45 us 2024-03-26T17:03:43.192 INFO:tasks.workunit.client.3.smithi157.stdout:myimage48 5/s 7/s 125 KiB/s 149 KiB/s 1.32 ms 321.27 us 2024-03-26T17:03:43.192 INFO:tasks.workunit.client.3.smithi157.stdout:myimage52 5/s 6/s 116 KiB/s 139 KiB/s 1.46 ms 242.04 us 2024-03-26T17:03:43.192 INFO:tasks.workunit.client.3.smithi157.stdout:myimage55 5/s 6/s 130 KiB/s 150 KiB/s 1.44 ms 331.97 us 2024-03-26T17:03:43.192 INFO:tasks.workunit.client.3.smithi157.stdout:myimage22 5/s 6/s 92 KiB/s 160 KiB/s 1.41 ms 355.13 us 2024-03-26T17:03:43.192 INFO:tasks.workunit.client.3.smithi157.stdout:myimage35 5/s 7/s 104 KiB/s 141 KiB/s 1.38 ms 311.61 us 2024-03-26T17:03:43.193 INFO:tasks.workunit.client.3.smithi157.stdout:myimage37 5/s 6/s 131 KiB/s 144 KiB/s 1.42 ms 300.66 us 2024-03-26T17:03:43.193 INFO:tasks.workunit.client.3.smithi157.stdout:myimage19 5/s 6/s 118 KiB/s 126 KiB/s 1.35 ms 247.28 us 2024-03-26T17:03:43.193 INFO:tasks.workunit.client.3.smithi157.stdout:myimage45 5/s 6/s 87 KiB/s 158 KiB/s 1.40 ms 284.44 us 2024-03-26T17:03:43.193 INFO:tasks.workunit.client.3.smithi157.stdout:myimage4 5/s 7/s 130 KiB/s 166 KiB/s 1.35 ms 264.48 us 2024-03-26T17:03:43.193 INFO:tasks.workunit.client.3.smithi157.stdout:myimage24 5/s 4/s 102 KiB/s 104 KiB/s 1.34 ms 234.46 us 2024-03-26T17:03:43.193 INFO:tasks.workunit.client.3.smithi157.stdout:myimage26 5/s 7/s 131 KiB/s 172 KiB/s 1.44 ms 307.80 us 2024-03-26T17:03:43.193 INFO:tasks.workunit.client.3.smithi157.stdout:myimage27 5/s 6/s 124 KiB/s 154 KiB/s 1.32 ms 295.03 us 2024-03-26T17:03:43.193 INFO:tasks.workunit.client.3.smithi157.stdout:myimage38 5/s 6/s 118 KiB/s 164 KiB/s 1.28 ms 359.24 us 2024-03-26T17:03:43.193 INFO:tasks.workunit.client.3.smithi157.stdout:myimage58 5/s 6/s 108 KiB/s 150 KiB/s 1.35 ms 276.93 us 2024-03-26T17:03:43.193 INFO:tasks.workunit.client.3.smithi157.stdout:myimage15 5/s 7/s 113 KiB/s 177 KiB/s 1.27 ms 366.03 us 2024-03-26T17:03:43.193 INFO:tasks.workunit.client.3.smithi157.stdout:myimage6 4/s 6/s 82 KiB/s 149 KiB/s 1.45 ms 250.28 us 2024-03-26T17:03:43.193 INFO:tasks.workunit.client.3.smithi157.stdout:myimage20 4/s 7/s 105 KiB/s 154 KiB/s 1.46 ms 276.70 us 2024-03-26T17:03:43.193 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:03:43.265 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:03:42 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:03:42] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:03:43.265 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:03:42 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:03:42] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:03:43.265 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:03:42 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:03:43.607 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:03:43 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:03:43] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:03:43.607 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:03:43 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:03:43] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:03:43.607 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:03:43 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:03:43.896 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:03:43 smithi149 ceph-mon[34678]: Health check update: 3 slow ops, oldest one blocked for 318 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:03:44.015 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:03:43 smithi044 ceph-mon[30624]: Health check update: 3 slow ops, oldest one blocked for 318 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:03:44.057 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:03:43 smithi064 ceph-mon[34420]: Health check update: 3 slow ops, oldest one blocked for 318 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:03:44.896 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:03:44 smithi149 ceph-mon[34678]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:03:44.896 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:03:44 smithi149 ceph-mon[34678]: { 2024-03-26T17:03:44.897 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:03:44 smithi149 ceph-mon[34678]: "prefix": "rbd perf image stats", 2024-03-26T17:03:44.897 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:03:44 smithi149 ceph-mon[34678]: "pool_spec": "mypool", 2024-03-26T17:03:44.897 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:03:44 smithi149 ceph-mon[34678]: "sort_by": "write_ops", 2024-03-26T17:03:44.897 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:03:44 smithi149 ceph-mon[34678]: "format": "json" 2024-03-26T17:03:44.897 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:03:44 smithi149 ceph-mon[34678]: }"]: dispatch 2024-03-26T17:03:44.897 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:03:44 smithi149 ceph-mon[34678]: pgmap v533: 33 pgs: 33 active+clean; 1022 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 8.9 MiB/s rd, 9.2 MiB/s wr, 798 op/s 2024-03-26T17:03:45.003 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:03:44 smithi044 ceph-mon[30624]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:03:45.004 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:03:44 smithi044 ceph-mon[30624]: { 2024-03-26T17:03:45.004 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:03:44 smithi044 ceph-mon[30624]: "prefix": "rbd perf image stats", 2024-03-26T17:03:45.004 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:03:44 smithi044 ceph-mon[30624]: "pool_spec": "mypool", 2024-03-26T17:03:45.004 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:03:44 smithi044 ceph-mon[30624]: "sort_by": "write_ops", 2024-03-26T17:03:45.004 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:03:44 smithi044 ceph-mon[30624]: "format": "json" 2024-03-26T17:03:45.004 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:03:44 smithi044 ceph-mon[30624]: }"]: dispatch 2024-03-26T17:03:45.004 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:03:44 smithi044 ceph-mon[30624]: pgmap v533: 33 pgs: 33 active+clean; 1022 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 8.9 MiB/s rd, 9.2 MiB/s wr, 798 op/s 2024-03-26T17:03:45.055 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:03:44 smithi064 ceph-mon[34420]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:03:45.055 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:03:44 smithi064 ceph-mon[34420]: { 2024-03-26T17:03:45.055 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:03:44 smithi064 ceph-mon[34420]: "prefix": "rbd perf image stats", 2024-03-26T17:03:45.055 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:03:44 smithi064 ceph-mon[34420]: "pool_spec": "mypool", 2024-03-26T17:03:45.055 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:03:44 smithi064 ceph-mon[34420]: "sort_by": "write_ops", 2024-03-26T17:03:45.056 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:03:44 smithi064 ceph-mon[34420]: "format": "json" 2024-03-26T17:03:45.056 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:03:44 smithi064 ceph-mon[34420]: }"]: dispatch 2024-03-26T17:03:45.056 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:03:44 smithi064 ceph-mon[34420]: pgmap v533: 33 pgs: 33 active+clean; 1022 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 8.9 MiB/s rd, 9.2 MiB/s wr, 798 op/s 2024-03-26T17:03:45.265 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:03:45 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:03:45] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:03:45.265 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:03:45 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:03:45] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:03:45.266 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:03:45 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:03:45.646 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:03:45 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:03:45] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:03:45.647 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:03:45 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:03:45] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:03:45.647 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:03:45 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:03:46.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:03:46 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 2024-03-26T17:03:46.217+0000 7fa707a55700 -1 mon.c@1(peon) e3 get_health_metrics reporting 3 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T17:03:47.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:03:47 smithi044 ceph-mon[30624]: pgmap v534: 33 pgs: 33 active+clean; 1022 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 8.0 MiB/s rd, 8.1 MiB/s wr, 727 op/s 2024-03-26T17:03:47.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:03:47 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:03:47] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:03:47.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:03:47 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:03:47] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:03:47.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:03:47 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:03:47.547 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:03:47 smithi149 ceph-mon[34678]: pgmap v534: 33 pgs: 33 active+clean; 1022 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 8.0 MiB/s rd, 8.1 MiB/s wr, 727 op/s 2024-03-26T17:03:47.548 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:03:47 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:03:47] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:03:47.548 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:03:47 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:03:47] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:03:47.549 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:03:47 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:03:47.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:03:47 smithi064 ceph-mon[34420]: pgmap v534: 33 pgs: 33 active+clean; 1022 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 8.0 MiB/s rd, 8.1 MiB/s wr, 727 op/s 2024-03-26T17:03:48.194 INFO:tasks.workunit.client.3.smithi157.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-26T17:03:48.194 INFO:tasks.workunit.client.3.smithi157.stdout:myimage27 8/s 6/s 182 KiB/s 146 KiB/s 1.31 ms 295.82 us 2024-03-26T17:03:48.194 INFO:tasks.workunit.client.3.smithi157.stdout:myimage33 8/s 4/s 146 KiB/s 74 KiB/s 1.36 ms 247.32 us 2024-03-26T17:03:48.194 INFO:tasks.workunit.client.3.smithi157.stdout:myimage59 8/s 5/s 198 KiB/s 95 KiB/s 1.41 ms 269.50 us 2024-03-26T17:03:48.194 INFO:tasks.workunit.client.3.smithi157.stdout:myimage56 7/s 4/s 142 KiB/s 97 KiB/s 1.45 ms 285.17 us 2024-03-26T17:03:48.194 INFO:tasks.workunit.client.3.smithi157.stdout:myimage8 7/s 5/s 181 KiB/s 130 KiB/s 1.35 ms 280.12 us 2024-03-26T17:03:48.194 INFO:tasks.workunit.client.3.smithi157.stdout:myimage2 7/s 4/s 134 KiB/s 103 KiB/s 1.48 ms 358.43 us 2024-03-26T17:03:48.194 INFO:tasks.workunit.client.3.smithi157.stdout:myimage25 7/s 5/s 185 KiB/s 117 KiB/s 1.54 ms 365.18 us 2024-03-26T17:03:48.194 INFO:tasks.workunit.client.3.smithi157.stdout:myimage6 7/s 5/s 182 KiB/s 150 KiB/s 1.44 ms 261.72 us 2024-03-26T17:03:48.194 INFO:tasks.workunit.client.3.smithi157.stdout:myimage17 7/s 4/s 121 KiB/s 73 KiB/s 1.41 ms 288.22 us 2024-03-26T17:03:48.194 INFO:tasks.workunit.client.3.smithi157.stdout:myimage21 7/s 4/s 162 KiB/s 107 KiB/s 1.52 ms 316.87 us 2024-03-26T17:03:48.195 INFO:tasks.workunit.client.3.smithi157.stdout:myimage16 6/s 5/s 177 KiB/s 142 KiB/s 1.32 ms 362.47 us 2024-03-26T17:03:48.195 INFO:tasks.workunit.client.3.smithi157.stdout:myimage58 6/s 6/s 146 KiB/s 128 KiB/s 1.36 ms 271.76 us 2024-03-26T17:03:48.195 INFO:tasks.workunit.client.3.smithi157.stdout:myimage29 6/s 6/s 180 KiB/s 126 KiB/s 1.34 ms 280.85 us 2024-03-26T17:03:48.195 INFO:tasks.workunit.client.3.smithi157.stdout:myimage39 6/s 5/s 150 KiB/s 86 KiB/s 1.36 ms 273.03 us 2024-03-26T17:03:48.195 INFO:tasks.workunit.client.3.smithi157.stdout:myimage53 6/s 5/s 171 KiB/s 130 KiB/s 1.36 ms 300.18 us 2024-03-26T17:03:48.195 INFO:tasks.workunit.client.3.smithi157.stdout:myimage41 6/s 6/s 131 KiB/s 162 KiB/s 1.41 ms 306.90 us 2024-03-26T17:03:48.195 INFO:tasks.workunit.client.3.smithi157.stdout:myimage10 6/s 6/s 135 KiB/s 139 KiB/s 1.35 ms 274.83 us 2024-03-26T17:03:48.195 INFO:tasks.workunit.client.3.smithi157.stdout:myimage38 6/s 5/s 146 KiB/s 116 KiB/s 1.28 ms 263.18 us 2024-03-26T17:03:48.195 INFO:tasks.workunit.client.3.smithi157.stdout:myimage48 6/s 6/s 114 KiB/s 129 KiB/s 1.38 ms 359.26 us 2024-03-26T17:03:48.195 INFO:tasks.workunit.client.3.smithi157.stdout:myimage18 6/s 6/s 154 KiB/s 112 KiB/s 1.36 ms 252.53 us 2024-03-26T17:03:48.195 INFO:tasks.workunit.client.3.smithi157.stdout:myimage19 6/s 7/s 126 KiB/s 121 KiB/s 1.35 ms 240.55 us 2024-03-26T17:03:48.195 INFO:tasks.workunit.client.3.smithi157.stdout:myimage45 6/s 6/s 130 KiB/s 140 KiB/s 1.43 ms 317.62 us 2024-03-26T17:03:48.195 INFO:tasks.workunit.client.3.smithi157.stdout:myimage46 6/s 6/s 130 KiB/s 113 KiB/s 1.44 ms 302.30 us 2024-03-26T17:03:48.196 INFO:tasks.workunit.client.3.smithi157.stdout:myimage57 6/s 6/s 133 KiB/s 122 KiB/s 1.36 ms 278.37 us 2024-03-26T17:03:48.196 INFO:tasks.workunit.client.3.smithi157.stdout:myimage32 6/s 6/s 138 KiB/s 129 KiB/s 1.41 ms 370.53 us 2024-03-26T17:03:48.196 INFO:tasks.workunit.client.3.smithi157.stdout:myimage44 6/s 4/s 160 KiB/s 104 KiB/s 1.45 ms 275.60 us 2024-03-26T17:03:48.196 INFO:tasks.workunit.client.3.smithi157.stdout:myimage1 6/s 6/s 173 KiB/s 106 KiB/s 1.34 ms 285.75 us 2024-03-26T17:03:48.196 INFO:tasks.workunit.client.3.smithi157.stdout:myimage12 6/s 5/s 105 KiB/s 141 KiB/s 1.38 ms 401.21 us 2024-03-26T17:03:48.196 INFO:tasks.workunit.client.3.smithi157.stdout:myimage15 6/s 6/s 152 KiB/s 132 KiB/s 1.25 ms 343.04 us 2024-03-26T17:03:48.196 INFO:tasks.workunit.client.3.smithi157.stdout:myimage36 6/s 7/s 177 KiB/s 152 KiB/s 1.39 ms 355.82 us 2024-03-26T17:03:48.196 INFO:tasks.workunit.client.3.smithi157.stdout:myimage50 6/s 5/s 152 KiB/s 146 KiB/s 1.44 ms 310.67 us 2024-03-26T17:03:48.196 INFO:tasks.workunit.client.3.smithi157.stdout:myimage34 6/s 6/s 127 KiB/s 102 KiB/s 1.31 ms 282.94 us 2024-03-26T17:03:48.196 INFO:tasks.workunit.client.3.smithi157.stdout:myimage35 6/s 6/s 128 KiB/s 128 KiB/s 1.41 ms 268.80 us 2024-03-26T17:03:48.196 INFO:tasks.workunit.client.3.smithi157.stdout:myimage40 6/s 6/s 101 KiB/s 137 KiB/s 1.33 ms 307.39 us 2024-03-26T17:03:48.196 INFO:tasks.workunit.client.3.smithi157.stdout:myimage43 6/s 5/s 137 KiB/s 105 KiB/s 1.40 ms 297.21 us 2024-03-26T17:03:48.196 INFO:tasks.workunit.client.3.smithi157.stdout:myimage31 5/s 5/s 131 KiB/s 93 KiB/s 1.42 ms 277.25 us 2024-03-26T17:03:48.196 INFO:tasks.workunit.client.3.smithi157.stdout:myimage4 5/s 7/s 131 KiB/s 191 KiB/s 1.37 ms 289.47 us 2024-03-26T17:03:48.197 INFO:tasks.workunit.client.3.smithi157.stdout:myimage24 5/s 7/s 110 KiB/s 166 KiB/s 1.36 ms 259.44 us 2024-03-26T17:03:48.197 INFO:tasks.workunit.client.3.smithi157.stdout:myimage26 5/s 6/s 108 KiB/s 106 KiB/s 1.33 ms 330.52 us 2024-03-26T17:03:48.197 INFO:tasks.workunit.client.3.smithi157.stdout:myimage28 5/s 6/s 161 KiB/s 121 KiB/s 1.56 ms 279.72 us 2024-03-26T17:03:48.197 INFO:tasks.workunit.client.3.smithi157.stdout:myimage49 5/s 6/s 110 KiB/s 108 KiB/s 1.34 ms 247.89 us 2024-03-26T17:03:48.197 INFO:tasks.workunit.client.3.smithi157.stdout:myimage11 5/s 7/s 126 KiB/s 143 KiB/s 1.39 ms 244.19 us 2024-03-26T17:03:48.197 INFO:tasks.workunit.client.3.smithi157.stdout:myimage42 5/s 6/s 96 KiB/s 157 KiB/s 1.34 ms 262.70 us 2024-03-26T17:03:48.197 INFO:tasks.workunit.client.3.smithi157.stdout:myimage51 5/s 6/s 150 KiB/s 110 KiB/s 1.42 ms 254.02 us 2024-03-26T17:03:48.197 INFO:tasks.workunit.client.3.smithi157.stdout:myimage54 5/s 8/s 125 KiB/s 162 KiB/s 1.42 ms 298.60 us 2024-03-26T17:03:48.197 INFO:tasks.workunit.client.3.smithi157.stdout:myimage30 5/s 6/s 131 KiB/s 152 KiB/s 1.56 ms 282.65 us 2024-03-26T17:03:48.197 INFO:tasks.workunit.client.3.smithi157.stdout:myimage20 5/s 6/s 90 KiB/s 149 KiB/s 1.42 ms 301.05 us 2024-03-26T17:03:48.197 INFO:tasks.workunit.client.3.smithi157.stdout:myimage55 5/s 5/s 132 KiB/s 114 KiB/s 1.41 ms 324.47 us 2024-03-26T17:03:48.197 INFO:tasks.workunit.client.3.smithi157.stdout:myimage23 5/s 8/s 111 KiB/s 158 KiB/s 1.27 ms 271.14 us 2024-03-26T17:03:48.197 INFO:tasks.workunit.client.3.smithi157.stdout:myimage14 5/s 5/s 120 KiB/s 148 KiB/s 1.46 ms 291.05 us 2024-03-26T17:03:48.197 INFO:tasks.workunit.client.3.smithi157.stdout:myimage37 5/s 7/s 109 KiB/s 179 KiB/s 1.40 ms 306.11 us 2024-03-26T17:03:48.198 INFO:tasks.workunit.client.3.smithi157.stdout:myimage47 5/s 7/s 82 KiB/s 134 KiB/s 1.46 ms 278.15 us 2024-03-26T17:03:48.198 INFO:tasks.workunit.client.3.smithi157.stdout:myimage60 5/s 7/s 100 KiB/s 158 KiB/s 1.46 ms 252.87 us 2024-03-26T17:03:48.198 INFO:tasks.workunit.client.3.smithi157.stdout:myimage3 4/s 7/s 86 KiB/s 159 KiB/s 1.36 ms 235.13 us 2024-03-26T17:03:48.198 INFO:tasks.workunit.client.3.smithi157.stdout:myimage13 4/s 6/s 95 KiB/s 117 KiB/s 1.33 ms 331.84 us 2024-03-26T17:03:48.198 INFO:tasks.workunit.client.3.smithi157.stdout:myimage22 4/s 7/s 138 KiB/s 158 KiB/s 1.42 ms 292.96 us 2024-03-26T17:03:48.198 INFO:tasks.workunit.client.3.smithi157.stdout:myimage52 4/s 7/s 80 KiB/s 170 KiB/s 1.65 ms 285.76 us 2024-03-26T17:03:48.198 INFO:tasks.workunit.client.3.smithi157.stdout:myimage7 4/s 8/s 82 KiB/s 190 KiB/s 1.32 ms 335.14 us 2024-03-26T17:03:48.198 INFO:tasks.workunit.client.3.smithi157.stdout:myimage9 4/s 7/s 73 KiB/s 139 KiB/s 1.50 ms 256.77 us 2024-03-26T17:03:48.198 INFO:tasks.workunit.client.3.smithi157.stdout:myimage5 3/s 7/s 70 KiB/s 134 KiB/s 1.37 ms 325.94 us 2024-03-26T17:03:48.198 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:03:49.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:03:49 smithi044 ceph-mon[30624]: pgmap v535: 33 pgs: 33 active+clean; 1022 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 7.9 MiB/s rd, 8.0 MiB/s wr, 735 op/s 2024-03-26T17:03:49.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:03:49 smithi044 ceph-mon[30624]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:03:49.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:03:49 smithi044 ceph-mon[30624]: { 2024-03-26T17:03:49.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:03:49 smithi044 ceph-mon[30624]: "prefix": "rbd perf image stats", 2024-03-26T17:03:49.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:03:49 smithi044 ceph-mon[30624]: "pool_spec": "mypool", 2024-03-26T17:03:49.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:03:49 smithi044 ceph-mon[30624]: "sort_by": "write_ops", 2024-03-26T17:03:49.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:03:49 smithi044 ceph-mon[30624]: "format": "json" 2024-03-26T17:03:49.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:03:49 smithi044 ceph-mon[30624]: }"]: dispatch 2024-03-26T17:03:49.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:03:49 smithi044 ceph-mon[30624]: Health check update: 3 slow ops, oldest one blocked for 323 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:03:49.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:03:49 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:03:49] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:03:49.517 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:03:49 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:03:49] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:03:49.517 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:03:49 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:03:49.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:03:49 smithi064 ceph-mon[34420]: pgmap v535: 33 pgs: 33 active+clean; 1022 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 7.9 MiB/s rd, 8.0 MiB/s wr, 735 op/s 2024-03-26T17:03:49.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:03:49 smithi064 ceph-mon[34420]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:03:49.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:03:49 smithi064 ceph-mon[34420]: { 2024-03-26T17:03:49.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:03:49 smithi064 ceph-mon[34420]: "prefix": "rbd perf image stats", 2024-03-26T17:03:49.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:03:49 smithi064 ceph-mon[34420]: "pool_spec": "mypool", 2024-03-26T17:03:49.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:03:49 smithi064 ceph-mon[34420]: "sort_by": "write_ops", 2024-03-26T17:03:49.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:03:49 smithi064 ceph-mon[34420]: "format": "json" 2024-03-26T17:03:49.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:03:49 smithi064 ceph-mon[34420]: }"]: dispatch 2024-03-26T17:03:49.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:03:49 smithi064 ceph-mon[34420]: Health check update: 3 slow ops, oldest one blocked for 323 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:03:49.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:03:49 smithi149 ceph-mon[34678]: pgmap v535: 33 pgs: 33 active+clean; 1022 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 7.9 MiB/s rd, 8.0 MiB/s wr, 735 op/s 2024-03-26T17:03:49.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:03:49 smithi149 ceph-mon[34678]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:03:49.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:03:49 smithi149 ceph-mon[34678]: { 2024-03-26T17:03:49.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:03:49 smithi149 ceph-mon[34678]: "prefix": "rbd perf image stats", 2024-03-26T17:03:49.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:03:49 smithi149 ceph-mon[34678]: "pool_spec": "mypool", 2024-03-26T17:03:49.647 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:03:49 smithi149 ceph-mon[34678]: "sort_by": "write_ops", 2024-03-26T17:03:49.647 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:03:49 smithi149 ceph-mon[34678]: "format": "json" 2024-03-26T17:03:49.647 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:03:49 smithi149 ceph-mon[34678]: }"]: dispatch 2024-03-26T17:03:49.647 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:03:49 smithi149 ceph-mon[34678]: Health check update: 3 slow ops, oldest one blocked for 323 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:03:49.647 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:03:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:03:49] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:03:49.648 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:03:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:03:49] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:03:49.648 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:03:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:03:51.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:03:51 smithi044 ceph-mon[30624]: pgmap v536: 33 pgs: 33 active+clean; 1022 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 8.2 MiB/s rd, 8.3 MiB/s wr, 783 op/s 2024-03-26T17:03:51.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:03:51 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:03:51] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:03:51.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:03:51 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:03:51] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:03:51.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:03:51 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:03:51.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:03:51 smithi064 ceph-mon[34420]: pgmap v536: 33 pgs: 33 active+clean; 1022 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 8.2 MiB/s rd, 8.3 MiB/s wr, 783 op/s 2024-03-26T17:03:51.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:03:51 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 2024-03-26T17:03:51.217+0000 7fa707a55700 -1 mon.c@1(peon) e3 get_health_metrics reporting 3 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T17:03:51.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:03:51 smithi149 ceph-mon[34678]: pgmap v536: 33 pgs: 33 active+clean; 1022 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 8.2 MiB/s rd, 8.3 MiB/s wr, 783 op/s 2024-03-26T17:03:51.647 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:03:51 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:03:51] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:03:51.647 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:03:51 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:03:51] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:03:51.647 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:03:51 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:03:53.062 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:03:53.070 INFO:tasks.workunit.client.3.smithi157.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2024-03-26T17:03:53.071 INFO:tasks.workunit.client.3.smithi157.stdout: 12.30 112.8k 158.4k 0.0k 1.1M 1.5M 0.0k nvme2n1 2024-03-26T17:03:53.071 INFO:tasks.workunit.client.3.smithi157.stdout: 12.40 108.4k 152.0k 0.0k 1.1M 1.5M 0.0k nvme2n10 2024-03-26T17:03:53.071 INFO:tasks.workunit.client.3.smithi157.stdout: 12.40 113.2k 133.6k 0.0k 1.1M 1.3M 0.0k nvme2n11 2024-03-26T17:03:53.071 INFO:tasks.workunit.client.3.smithi157.stdout: 12.40 138.8k 103.6k 0.0k 1.4M 1.0M 0.0k nvme2n12 2024-03-26T17:03:53.071 INFO:tasks.workunit.client.3.smithi157.stdout: 12.40 117.6k 119.6k 0.0k 1.1M 1.2M 0.0k nvme2n13 2024-03-26T17:03:53.071 INFO:tasks.workunit.client.3.smithi157.stdout: 12.40 133.2k 123.2k 0.0k 1.3M 1.2M 0.0k nvme2n14 2024-03-26T17:03:53.071 INFO:tasks.workunit.client.3.smithi157.stdout: 12.40 124.0k 135.2k 0.0k 1.2M 1.3M 0.0k nvme2n15 2024-03-26T17:03:53.071 INFO:tasks.workunit.client.3.smithi157.stdout: 12.30 158.4k 109.6k 0.0k 1.5M 1.1M 0.0k nvme2n16 2024-03-26T17:03:53.071 INFO:tasks.workunit.client.3.smithi157.stdout: 12.30 122.8k 105.6k 0.0k 1.2M 1.0M 0.0k nvme2n17 2024-03-26T17:03:53.072 INFO:tasks.workunit.client.3.smithi157.stdout: 12.30 132.4k 152.8k 0.0k 1.3M 1.5M 0.0k nvme2n18 2024-03-26T17:03:53.072 INFO:tasks.workunit.client.3.smithi157.stdout: 12.30 116.4k 121.2k 0.0k 1.1M 1.2M 0.0k nvme2n19 2024-03-26T17:03:53.072 INFO:tasks.workunit.client.3.smithi157.stdout: 12.30 149.6k 129.2k 0.0k 1.5M 1.3M 0.0k nvme2n2 2024-03-26T17:03:53.072 INFO:tasks.workunit.client.3.smithi157.stdout: 12.30 135.2k 113.6k 0.0k 1.3M 1.1M 0.0k nvme2n20 2024-03-26T17:03:53.072 INFO:tasks.workunit.client.3.smithi157.stdout: 12.30 131.6k 115.2k 0.0k 1.3M 1.1M 0.0k nvme2n3 2024-03-26T17:03:53.072 INFO:tasks.workunit.client.3.smithi157.stdout: 12.30 126.0k 106.4k 0.0k 1.2M 1.0M 0.0k nvme2n4 2024-03-26T17:03:53.072 INFO:tasks.workunit.client.3.smithi157.stdout: 12.30 150.0k 99.6k 0.0k 1.5M 996.0k 0.0k nvme2n5 2024-03-26T17:03:53.072 INFO:tasks.workunit.client.3.smithi157.stdout: 12.30 128.4k 114.8k 0.0k 1.3M 1.1M 0.0k nvme2n6 2024-03-26T17:03:53.072 INFO:tasks.workunit.client.3.smithi157.stdout: 12.30 146.8k 130.4k 0.0k 1.4M 1.3M 0.0k nvme2n7 2024-03-26T17:03:53.072 INFO:tasks.workunit.client.3.smithi157.stdout: 12.40 142.8k 164.0k 0.0k 1.4M 1.6M 0.0k nvme2n8 2024-03-26T17:03:53.072 INFO:tasks.workunit.client.3.smithi157.stdout: 12.40 130.0k 123.6k 0.0k 1.3M 1.2M 0.0k nvme2n9 2024-03-26T17:03:53.073 INFO:tasks.workunit.client.3.smithi157.stdout: 12.30 98.4k 140.4k 0.0k 984.0k 1.4M 0.0k nvme5n1 2024-03-26T17:03:53.073 INFO:tasks.workunit.client.3.smithi157.stdout: 12.40 162.0k 122.0k 0.0k 1.6M 1.2M 0.0k nvme5n10 2024-03-26T17:03:53.073 INFO:tasks.workunit.client.3.smithi157.stdout: 12.40 124.8k 136.8k 0.0k 1.2M 1.3M 0.0k nvme5n11 2024-03-26T17:03:53.073 INFO:tasks.workunit.client.3.smithi157.stdout: 12.40 145.2k 143.6k 0.0k 1.4M 1.4M 0.0k nvme5n12 2024-03-26T17:03:53.073 INFO:tasks.workunit.client.3.smithi157.stdout: 12.40 98.4k 120.4k 0.0k 984.0k 1.2M 0.0k nvme5n13 2024-03-26T17:03:53.073 INFO:tasks.workunit.client.3.smithi157.stdout: 12.40 118.8k 114.8k 0.0k 1.2M 1.1M 0.0k nvme5n14 2024-03-26T17:03:53.073 INFO:tasks.workunit.client.3.smithi157.stdout: 12.40 149.2k 118.8k 0.0k 1.5M 1.2M 0.0k nvme5n15 2024-03-26T17:03:53.073 INFO:tasks.workunit.client.3.smithi157.stdout: 12.40 122.0k 118.8k 0.0k 1.2M 1.2M 0.0k nvme5n16 2024-03-26T17:03:53.073 INFO:tasks.workunit.client.3.smithi157.stdout: 12.30 110.0k 127.6k 0.0k 1.1M 1.2M 0.0k nvme5n17 2024-03-26T17:03:53.073 INFO:tasks.workunit.client.3.smithi157.stdout: 12.30 138.8k 121.2k 0.0k 1.4M 1.2M 0.0k nvme5n18 2024-03-26T17:03:53.074 INFO:tasks.workunit.client.3.smithi157.stdout: 12.30 104.8k 125.6k 0.0k 1.0M 1.2M 0.0k nvme5n19 2024-03-26T17:03:53.074 INFO:tasks.workunit.client.3.smithi157.stdout: 12.30 127.6k 138.8k 0.0k 1.2M 1.4M 0.0k nvme5n2 2024-03-26T17:03:53.074 INFO:tasks.workunit.client.3.smithi157.stdout: 12.30 116.8k 172.4k 0.0k 1.1M 1.7M 0.0k nvme5n20 2024-03-26T17:03:53.074 INFO:tasks.workunit.client.3.smithi157.stdout: 12.30 148.4k 109.2k 0.0k 1.4M 1.1M 0.0k nvme5n3 2024-03-26T17:03:53.074 INFO:tasks.workunit.client.3.smithi157.stdout: 12.30 132.0k 111.6k 0.0k 1.3M 1.1M 0.0k nvme5n4 2024-03-26T17:03:53.074 INFO:tasks.workunit.client.3.smithi157.stdout: 12.30 138.0k 144.0k 0.0k 1.3M 1.4M 0.0k nvme5n5 2024-03-26T17:03:53.074 INFO:tasks.workunit.client.3.smithi157.stdout: 12.30 99.6k 145.2k 0.0k 996.0k 1.4M 0.0k nvme5n6 2024-03-26T17:03:53.074 INFO:tasks.workunit.client.3.smithi157.stdout: 12.30 120.0k 128.4k 0.0k 1.2M 1.3M 0.0k nvme5n7 2024-03-26T17:03:53.074 INFO:tasks.workunit.client.3.smithi157.stdout: 12.30 143.6k 136.4k 0.0k 1.4M 1.3M 0.0k nvme5n8 2024-03-26T17:03:53.074 INFO:tasks.workunit.client.3.smithi157.stdout: 12.40 123.6k 134.0k 0.0k 1.2M 1.3M 0.0k nvme5n9 2024-03-26T17:03:53.074 INFO:tasks.workunit.client.3.smithi157.stdout: 12.30 128.4k 136.0k 0.0k 1.3M 1.3M 0.0k nvme8n1 2024-03-26T17:03:53.075 INFO:tasks.workunit.client.3.smithi157.stdout: 12.40 131.2k 122.0k 0.0k 1.3M 1.2M 0.0k nvme8n10 2024-03-26T17:03:53.075 INFO:tasks.workunit.client.3.smithi157.stdout: 12.40 131.6k 110.4k 0.0k 1.3M 1.1M 0.0k nvme8n11 2024-03-26T17:03:53.075 INFO:tasks.workunit.client.3.smithi157.stdout: 12.40 158.0k 84.8k 0.0k 1.5M 848.0k 0.0k nvme8n12 2024-03-26T17:03:53.075 INFO:tasks.workunit.client.3.smithi157.stdout: 12.40 123.6k 115.6k 0.0k 1.2M 1.1M 0.0k nvme8n13 2024-03-26T17:03:53.075 INFO:tasks.workunit.client.3.smithi157.stdout: 12.40 119.6k 146.8k 0.0k 1.2M 1.4M 0.0k nvme8n14 2024-03-26T17:03:53.075 INFO:tasks.workunit.client.3.smithi157.stdout: 12.40 104.0k 158.4k 0.0k 1.0M 1.5M 0.0k nvme8n15 2024-03-26T17:03:53.075 INFO:tasks.workunit.client.3.smithi157.stdout: 12.30 106.4k 122.8k 0.0k 1.0M 1.2M 0.0k nvme8n16 2024-03-26T17:03:53.076 INFO:tasks.workunit.client.3.smithi157.stdout: 12.30 146.4k 86.0k 0.0k 1.4M 860.0k 0.0k nvme8n17 2024-03-26T17:03:53.076 INFO:tasks.workunit.client.3.smithi157.stdout: 12.30 120.4k 133.2k 0.0k 1.2M 1.3M 0.0k nvme8n18 2024-03-26T17:03:53.076 INFO:tasks.workunit.client.3.smithi157.stdout: 12.30 149.2k 135.2k 0.0k 1.5M 1.3M 0.0k nvme8n19 2024-03-26T17:03:53.076 INFO:tasks.workunit.client.3.smithi157.stdout: 12.30 167.2k 95.2k 0.0k 1.6M 952.0k 0.0k nvme8n2 2024-03-26T17:03:53.076 INFO:tasks.workunit.client.3.smithi157.stdout: 12.30 133.6k 122.8k 0.0k 1.3M 1.2M 0.0k nvme8n20 2024-03-26T17:03:53.076 INFO:tasks.workunit.client.3.smithi157.stdout: 12.30 98.0k 120.8k 0.0k 980.0k 1.2M 0.0k nvme8n3 2024-03-26T17:03:53.076 INFO:tasks.workunit.client.3.smithi157.stdout: 12.30 136.8k 105.2k 0.0k 1.3M 1.0M 0.0k nvme8n4 2024-03-26T17:03:53.076 INFO:tasks.workunit.client.3.smithi157.stdout: 12.30 119.2k 122.4k 0.0k 1.2M 1.2M 0.0k nvme8n5 2024-03-26T17:03:53.076 INFO:tasks.workunit.client.3.smithi157.stdout: 12.30 130.4k 112.0k 0.0k 1.3M 1.1M 0.0k nvme8n6 2024-03-26T17:03:53.076 INFO:tasks.workunit.client.3.smithi157.stdout: 12.30 121.2k 127.2k 0.0k 1.2M 1.2M 0.0k nvme8n7 2024-03-26T17:03:53.076 INFO:tasks.workunit.client.3.smithi157.stdout: 12.40 101.2k 144.0k 0.0k 1012.0k 1.4M 0.0k nvme8n8 2024-03-26T17:03:53.076 INFO:tasks.workunit.client.3.smithi157.stdout: 12.40 130.0k 105.2k 0.0k 1.3M 1.0M 0.0k nvme8n9 2024-03-26T17:03:53.076 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:03:53.198 INFO:tasks.workunit.client.3.smithi157.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-26T17:03:53.198 INFO:tasks.workunit.client.3.smithi157.stdout:myimage37 8/s 4/s 155 KiB/s 98 KiB/s 1.37 ms 280.67 us 2024-03-26T17:03:53.198 INFO:tasks.workunit.client.3.smithi157.stdout:myimage40 8/s 4/s 213 KiB/s 92 KiB/s 1.36 ms 381.10 us 2024-03-26T17:03:53.198 INFO:tasks.workunit.client.3.smithi157.stdout:myimage13 8/s 6/s 144 KiB/s 120 KiB/s 1.29 ms 298.49 us 2024-03-26T17:03:53.198 INFO:tasks.workunit.client.3.smithi157.stdout:myimage55 8/s 6/s 173 KiB/s 118 KiB/s 1.45 ms 384.22 us 2024-03-26T17:03:53.198 INFO:tasks.workunit.client.3.smithi157.stdout:myimage3 7/s 5/s 150 KiB/s 101 KiB/s 1.29 ms 265.82 us 2024-03-26T17:03:53.199 INFO:tasks.workunit.client.3.smithi157.stdout:myimage47 7/s 5/s 160 KiB/s 96 KiB/s 1.48 ms 239.16 us 2024-03-26T17:03:53.199 INFO:tasks.workunit.client.3.smithi157.stdout:myimage26 7/s 5/s 182 KiB/s 123 KiB/s 1.39 ms 283.27 us 2024-03-26T17:03:53.199 INFO:tasks.workunit.client.3.smithi157.stdout:myimage46 7/s 4/s 130 KiB/s 108 KiB/s 1.41 ms 215.43 us 2024-03-26T17:03:53.199 INFO:tasks.workunit.client.3.smithi157.stdout:myimage56 7/s 5/s 134 KiB/s 98 KiB/s 1.57 ms 344.08 us 2024-03-26T17:03:53.199 INFO:tasks.workunit.client.3.smithi157.stdout:myimage32 7/s 4/s 168 KiB/s 88 KiB/s 1.48 ms 284.08 us 2024-03-26T17:03:53.199 INFO:tasks.workunit.client.3.smithi157.stdout:myimage35 7/s 5/s 135 KiB/s 145 KiB/s 1.41 ms 270.92 us 2024-03-26T17:03:53.199 INFO:tasks.workunit.client.3.smithi157.stdout:myimage31 6/s 5/s 145 KiB/s 113 KiB/s 1.51 ms 337.44 us 2024-03-26T17:03:53.199 INFO:tasks.workunit.client.3.smithi157.stdout:myimage58 6/s 5/s 165 KiB/s 102 KiB/s 1.38 ms 240.64 us 2024-03-26T17:03:53.199 INFO:tasks.workunit.client.3.smithi157.stdout:myimage20 6/s 5/s 125 KiB/s 143 KiB/s 1.41 ms 306.65 us 2024-03-26T17:03:53.199 INFO:tasks.workunit.client.3.smithi157.stdout:myimage21 6/s 5/s 146 KiB/s 84 KiB/s 1.61 ms 261.90 us 2024-03-26T17:03:53.199 INFO:tasks.workunit.client.3.smithi157.stdout:myimage45 6/s 6/s 132 KiB/s 140 KiB/s 1.40 ms 327.46 us 2024-03-26T17:03:53.199 INFO:tasks.workunit.client.3.smithi157.stdout:myimage2 6/s 5/s 143 KiB/s 124 KiB/s 1.40 ms 279.77 us 2024-03-26T17:03:53.199 INFO:tasks.workunit.client.3.smithi157.stdout:myimage22 6/s 6/s 148 KiB/s 142 KiB/s 1.42 ms 354.56 us 2024-03-26T17:03:53.200 INFO:tasks.workunit.client.3.smithi157.stdout:myimage44 6/s 7/s 110 KiB/s 126 KiB/s 1.43 ms 274.23 us 2024-03-26T17:03:53.200 INFO:tasks.workunit.client.3.smithi157.stdout:myimage7 6/s 6/s 150 KiB/s 143 KiB/s 1.39 ms 308.86 us 2024-03-26T17:03:53.200 INFO:tasks.workunit.client.3.smithi157.stdout:myimage54 6/s 5/s 157 KiB/s 107 KiB/s 1.34 ms 335.96 us 2024-03-26T17:03:53.200 INFO:tasks.workunit.client.3.smithi157.stdout:myimage27 6/s 5/s 121 KiB/s 107 KiB/s 1.36 ms 302.05 us 2024-03-26T17:03:53.200 INFO:tasks.workunit.client.3.smithi157.stdout:myimage29 6/s 6/s 145 KiB/s 129 KiB/s 1.36 ms 292.06 us 2024-03-26T17:03:53.200 INFO:tasks.workunit.client.3.smithi157.stdout:myimage43 6/s 7/s 101 KiB/s 126 KiB/s 1.45 ms 293.96 us 2024-03-26T17:03:53.200 INFO:tasks.workunit.client.3.smithi157.stdout:myimage14 6/s 6/s 159 KiB/s 118 KiB/s 1.49 ms 307.97 us 2024-03-26T17:03:53.200 INFO:tasks.workunit.client.3.smithi157.stdout:myimage34 6/s 6/s 112 KiB/s 128 KiB/s 1.37 ms 272.99 us 2024-03-26T17:03:53.200 INFO:tasks.workunit.client.3.smithi157.stdout:myimage48 6/s 4/s 152 KiB/s 70 KiB/s 1.39 ms 243.31 us 2024-03-26T17:03:53.200 INFO:tasks.workunit.client.3.smithi157.stdout:myimage5 6/s 7/s 129 KiB/s 158 KiB/s 1.38 ms 278.78 us 2024-03-26T17:03:53.200 INFO:tasks.workunit.client.3.smithi157.stdout:myimage6 6/s 7/s 110 KiB/s 145 KiB/s 1.48 ms 341.27 us 2024-03-26T17:03:53.200 INFO:tasks.workunit.client.3.smithi157.stdout:myimage8 6/s 6/s 158 KiB/s 151 KiB/s 1.43 ms 290.48 us 2024-03-26T17:03:53.201 INFO:tasks.workunit.client.3.smithi157.stdout:myimage11 6/s 6/s 126 KiB/s 123 KiB/s 1.55 ms 320.94 us 2024-03-26T17:03:53.201 INFO:tasks.workunit.client.3.smithi157.stdout:myimage41 6/s 5/s 145 KiB/s 135 KiB/s 1.46 ms 259.95 us 2024-03-26T17:03:53.201 INFO:tasks.workunit.client.3.smithi157.stdout:myimage9 6/s 6/s 102 KiB/s 97 KiB/s 1.51 ms 260.91 us 2024-03-26T17:03:53.201 INFO:tasks.workunit.client.3.smithi157.stdout:myimage36 6/s 5/s 98 KiB/s 98 KiB/s 1.37 ms 300.40 us 2024-03-26T17:03:53.201 INFO:tasks.workunit.client.3.smithi157.stdout:myimage10 6/s 5/s 166 KiB/s 104 KiB/s 1.45 ms 270.39 us 2024-03-26T17:03:53.201 INFO:tasks.workunit.client.3.smithi157.stdout:myimage16 5/s 7/s 102 KiB/s 140 KiB/s 1.38 ms 289.95 us 2024-03-26T17:03:53.201 INFO:tasks.workunit.client.3.smithi157.stdout:myimage24 5/s 6/s 114 KiB/s 151 KiB/s 1.38 ms 249.94 us 2024-03-26T17:03:53.201 INFO:tasks.workunit.client.3.smithi157.stdout:myimage39 5/s 5/s 107 KiB/s 102 KiB/s 1.36 ms 258.11 us 2024-03-26T17:03:53.201 INFO:tasks.workunit.client.3.smithi157.stdout:myimage50 5/s 5/s 109 KiB/s 111 KiB/s 1.39 ms 271.81 us 2024-03-26T17:03:53.201 INFO:tasks.workunit.client.3.smithi157.stdout:myimage53 5/s 7/s 123 KiB/s 128 KiB/s 1.50 ms 253.91 us 2024-03-26T17:03:53.201 INFO:tasks.workunit.client.3.smithi157.stdout:myimage60 5/s 6/s 135 KiB/s 101 KiB/s 1.46 ms 265.28 us 2024-03-26T17:03:53.201 INFO:tasks.workunit.client.3.smithi157.stdout:myimage59 5/s 5/s 142 KiB/s 134 KiB/s 1.45 ms 316.95 us 2024-03-26T17:03:53.201 INFO:tasks.workunit.client.3.smithi157.stdout:myimage38 5/s 8/s 109 KiB/s 161 KiB/s 1.27 ms 285.04 us 2024-03-26T17:03:53.201 INFO:tasks.workunit.client.3.smithi157.stdout:myimage1 5/s 6/s 130 KiB/s 138 KiB/s 1.30 ms 271.42 us 2024-03-26T17:03:53.202 INFO:tasks.workunit.client.3.smithi157.stdout:myimage19 5/s 5/s 117 KiB/s 107 KiB/s 1.48 ms 312.45 us 2024-03-26T17:03:53.202 INFO:tasks.workunit.client.3.smithi157.stdout:myimage28 5/s 6/s 132 KiB/s 153 KiB/s 1.62 ms 362.30 us 2024-03-26T17:03:53.202 INFO:tasks.workunit.client.3.smithi157.stdout:myimage33 5/s 5/s 109 KiB/s 95 KiB/s 1.39 ms 269.54 us 2024-03-26T17:03:53.202 INFO:tasks.workunit.client.3.smithi157.stdout:myimage4 5/s 6/s 110 KiB/s 118 KiB/s 1.30 ms 257.67 us 2024-03-26T17:03:53.202 INFO:tasks.workunit.client.3.smithi157.stdout:myimage57 5/s 7/s 122 KiB/s 156 KiB/s 1.30 ms 263.35 us 2024-03-26T17:03:53.202 INFO:tasks.workunit.client.3.smithi157.stdout:myimage49 5/s 7/s 103 KiB/s 128 KiB/s 1.43 ms 256.09 us 2024-03-26T17:03:53.202 INFO:tasks.workunit.client.3.smithi157.stdout:myimage12 5/s 7/s 114 KiB/s 149 KiB/s 1.41 ms 281.02 us 2024-03-26T17:03:53.202 INFO:tasks.workunit.client.3.smithi157.stdout:myimage18 5/s 7/s 131 KiB/s 142 KiB/s 1.39 ms 369.50 us 2024-03-26T17:03:53.202 INFO:tasks.workunit.client.3.smithi157.stdout:myimage25 5/s 6/s 113 KiB/s 164 KiB/s 1.53 ms 331.84 us 2024-03-26T17:03:53.202 INFO:tasks.workunit.client.3.smithi157.stdout:myimage51 5/s 7/s 106 KiB/s 132 KiB/s 1.51 ms 269.86 us 2024-03-26T17:03:53.202 INFO:tasks.workunit.client.3.smithi157.stdout:myimage23 5/s 7/s 94 KiB/s 158 KiB/s 1.31 ms 286.20 us 2024-03-26T17:03:53.202 INFO:tasks.workunit.client.3.smithi157.stdout:myimage15 5/s 6/s 91 KiB/s 126 KiB/s 1.43 ms 341.32 us 2024-03-26T17:03:53.202 INFO:tasks.workunit.client.3.smithi157.stdout:myimage17 5/s 7/s 89 KiB/s 162 KiB/s 1.45 ms 279.64 us 2024-03-26T17:03:53.203 INFO:tasks.workunit.client.3.smithi157.stdout:myimage30 4/s 6/s 90 KiB/s 149 KiB/s 1.54 ms 291.32 us 2024-03-26T17:03:53.203 INFO:tasks.workunit.client.3.smithi157.stdout:myimage52 4/s 7/s 90 KiB/s 139 KiB/s 1.50 ms 313.66 us 2024-03-26T17:03:53.203 INFO:tasks.workunit.client.3.smithi157.stdout:myimage42 4/s 6/s 70 KiB/s 143 KiB/s 1.34 ms 370.36 us 2024-03-26T17:03:53.203 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:03:53.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:03:53 smithi044 ceph-mon[30624]: pgmap v537: 33 pgs: 33 active+clean; 1022 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 7.1 MiB/s rd, 7.2 MiB/s wr, 683 op/s 2024-03-26T17:03:53.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:03:53 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:03:53] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:03:53.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:03:53 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:03:53] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:03:53.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:03:53 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:03:53.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:03:53 smithi064 ceph-mon[34420]: pgmap v537: 33 pgs: 33 active+clean; 1022 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 7.1 MiB/s rd, 7.2 MiB/s wr, 683 op/s 2024-03-26T17:03:53.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:03:53 smithi149 ceph-mon[34678]: pgmap v537: 33 pgs: 33 active+clean; 1022 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 7.1 MiB/s rd, 7.2 MiB/s wr, 683 op/s 2024-03-26T17:03:53.646 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:03:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:03:53] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:03:53.646 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:03:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:03:53] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:03:53.647 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:03:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:03:54.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:03:54 smithi044 ceph-mon[30624]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:03:54.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:03:54 smithi044 ceph-mon[30624]: { 2024-03-26T17:03:54.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:03:54 smithi044 ceph-mon[30624]: "prefix": "rbd perf image stats", 2024-03-26T17:03:54.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:03:54 smithi044 ceph-mon[30624]: "pool_spec": "mypool", 2024-03-26T17:03:54.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:03:54 smithi044 ceph-mon[30624]: "sort_by": "write_ops", 2024-03-26T17:03:54.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:03:54 smithi044 ceph-mon[30624]: "format": "json" 2024-03-26T17:03:54.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:03:54 smithi044 ceph-mon[30624]: }"]: dispatch 2024-03-26T17:03:54.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:03:54 smithi044 ceph-mon[30624]: Health check update: 3 slow ops, oldest one blocked for 328 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:03:54.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:03:54 smithi064 ceph-mon[34420]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:03:54.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:03:54 smithi064 ceph-mon[34420]: { 2024-03-26T17:03:54.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:03:54 smithi064 ceph-mon[34420]: "prefix": "rbd perf image stats", 2024-03-26T17:03:54.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:03:54 smithi064 ceph-mon[34420]: "pool_spec": "mypool", 2024-03-26T17:03:54.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:03:54 smithi064 ceph-mon[34420]: "sort_by": "write_ops", 2024-03-26T17:03:54.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:03:54 smithi064 ceph-mon[34420]: "format": "json" 2024-03-26T17:03:54.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:03:54 smithi064 ceph-mon[34420]: }"]: dispatch 2024-03-26T17:03:54.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:03:54 smithi064 ceph-mon[34420]: Health check update: 3 slow ops, oldest one blocked for 328 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:03:54.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:03:54 smithi149 ceph-mon[34678]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:03:54.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:03:54 smithi149 ceph-mon[34678]: { 2024-03-26T17:03:54.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:03:54 smithi149 ceph-mon[34678]: "prefix": "rbd perf image stats", 2024-03-26T17:03:54.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:03:54 smithi149 ceph-mon[34678]: "pool_spec": "mypool", 2024-03-26T17:03:54.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:03:54 smithi149 ceph-mon[34678]: "sort_by": "write_ops", 2024-03-26T17:03:54.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:03:54 smithi149 ceph-mon[34678]: "format": "json" 2024-03-26T17:03:54.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:03:54 smithi149 ceph-mon[34678]: }"]: dispatch 2024-03-26T17:03:54.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:03:54 smithi149 ceph-mon[34678]: Health check update: 3 slow ops, oldest one blocked for 328 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:03:55.417 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:03:55 smithi044 ceph-mon[30624]: pgmap v538: 33 pgs: 33 active+clean; 1023 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 8.3 MiB/s rd, 8.2 MiB/s wr, 810 op/s 2024-03-26T17:03:55.417 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:03:55 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:03:55] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:03:55.417 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:03:55 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:03:55] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:03:55.418 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:03:55 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:03:55.547 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:03:55 smithi149 ceph-mon[34678]: pgmap v538: 33 pgs: 33 active+clean; 1023 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 8.3 MiB/s rd, 8.2 MiB/s wr, 810 op/s 2024-03-26T17:03:55.548 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:03:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:03:55] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:03:55.548 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:03:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:03:55] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:03:55.548 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:03:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:03:55.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:03:55 smithi064 ceph-mon[34420]: pgmap v538: 33 pgs: 33 active+clean; 1023 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 8.3 MiB/s rd, 8.2 MiB/s wr, 810 op/s 2024-03-26T17:03:56.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:03:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 2024-03-26T17:03:56.218+0000 7fa707a55700 -1 mon.c@1(peon) e3 get_health_metrics reporting 3 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T17:03:57.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:03:57 smithi044 ceph-mon[30624]: pgmap v539: 33 pgs: 33 active+clean; 1023 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 7.4 MiB/s rd, 7.1 MiB/s wr, 737 op/s 2024-03-26T17:03:57.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:03:57 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:03:57] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:03:57.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:03:57 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:03:57] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:03:57.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:03:57 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:03:57.547 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:03:57 smithi149 ceph-mon[34678]: pgmap v539: 33 pgs: 33 active+clean; 1023 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 7.4 MiB/s rd, 7.1 MiB/s wr, 737 op/s 2024-03-26T17:03:57.547 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:03:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:03:57] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:03:57.548 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:03:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:03:57] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:03:57.548 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:03:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:03:57.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:03:57 smithi064 ceph-mon[34420]: pgmap v539: 33 pgs: 33 active+clean; 1023 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 7.4 MiB/s rd, 7.1 MiB/s wr, 737 op/s 2024-03-26T17:03:58.202 INFO:tasks.workunit.client.3.smithi157.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-26T17:03:58.202 INFO:tasks.workunit.client.3.smithi157.stdout:myimage26 8/s 4/s 197 KiB/s 70 KiB/s 1.43 ms 287.95 us 2024-03-26T17:03:58.202 INFO:tasks.workunit.client.3.smithi157.stdout:myimage11 7/s 5/s 126 KiB/s 102 KiB/s 1.46 ms 293.23 us 2024-03-26T17:03:58.202 INFO:tasks.workunit.client.3.smithi157.stdout:myimage21 7/s 7/s 141 KiB/s 137 KiB/s 1.63 ms 317.64 us 2024-03-26T17:03:58.202 INFO:tasks.workunit.client.3.smithi157.stdout:myimage40 7/s 6/s 167 KiB/s 114 KiB/s 1.38 ms 280.90 us 2024-03-26T17:03:58.202 INFO:tasks.workunit.client.3.smithi157.stdout:myimage18 7/s 6/s 171 KiB/s 118 KiB/s 1.35 ms 260.03 us 2024-03-26T17:03:58.203 INFO:tasks.workunit.client.3.smithi157.stdout:myimage9 7/s 5/s 162 KiB/s 118 KiB/s 1.53 ms 290.97 us 2024-03-26T17:03:58.203 INFO:tasks.workunit.client.3.smithi157.stdout:myimage45 7/s 4/s 134 KiB/s 86 KiB/s 1.46 ms 265.56 us 2024-03-26T17:03:58.203 INFO:tasks.workunit.client.3.smithi157.stdout:myimage1 7/s 5/s 160 KiB/s 103 KiB/s 1.30 ms 275.40 us 2024-03-26T17:03:58.203 INFO:tasks.workunit.client.3.smithi157.stdout:myimage22 6/s 4/s 146 KiB/s 67 KiB/s 1.59 ms 295.89 us 2024-03-26T17:03:58.203 INFO:tasks.workunit.client.3.smithi157.stdout:myimage31 6/s 5/s 101 KiB/s 108 KiB/s 1.55 ms 275.71 us 2024-03-26T17:03:58.203 INFO:tasks.workunit.client.3.smithi157.stdout:myimage47 6/s 7/s 138 KiB/s 150 KiB/s 1.52 ms 315.26 us 2024-03-26T17:03:58.203 INFO:tasks.workunit.client.3.smithi157.stdout:myimage48 6/s 6/s 132 KiB/s 119 KiB/s 1.40 ms 279.76 us 2024-03-26T17:03:58.203 INFO:tasks.workunit.client.3.smithi157.stdout:myimage58 6/s 5/s 116 KiB/s 128 KiB/s 1.42 ms 291.45 us 2024-03-26T17:03:58.203 INFO:tasks.workunit.client.3.smithi157.stdout:myimage5 6/s 6/s 163 KiB/s 118 KiB/s 1.37 ms 247.45 us 2024-03-26T17:03:58.203 INFO:tasks.workunit.client.3.smithi157.stdout:myimage55 6/s 5/s 150 KiB/s 122 KiB/s 1.49 ms 301.41 us 2024-03-26T17:03:58.203 INFO:tasks.workunit.client.3.smithi157.stdout:myimage14 6/s 7/s 114 KiB/s 144 KiB/s 1.53 ms 332.33 us 2024-03-26T17:03:58.203 INFO:tasks.workunit.client.3.smithi157.stdout:myimage19 6/s 6/s 145 KiB/s 145 KiB/s 1.43 ms 326.51 us 2024-03-26T17:03:58.203 INFO:tasks.workunit.client.3.smithi157.stdout:myimage50 6/s 6/s 108 KiB/s 152 KiB/s 1.49 ms 356.99 us 2024-03-26T17:03:58.203 INFO:tasks.workunit.client.3.smithi157.stdout:myimage54 6/s 6/s 112 KiB/s 132 KiB/s 1.36 ms 286.03 us 2024-03-26T17:03:58.203 INFO:tasks.workunit.client.3.smithi157.stdout:myimage32 6/s 7/s 136 KiB/s 182 KiB/s 1.44 ms 231.77 us 2024-03-26T17:03:58.204 INFO:tasks.workunit.client.3.smithi157.stdout:myimage37 6/s 5/s 101 KiB/s 118 KiB/s 1.55 ms 283.55 us 2024-03-26T17:03:58.204 INFO:tasks.workunit.client.3.smithi157.stdout:myimage36 6/s 7/s 108 KiB/s 138 KiB/s 1.40 ms 315.33 us 2024-03-26T17:03:58.204 INFO:tasks.workunit.client.3.smithi157.stdout:myimage39 6/s 6/s 114 KiB/s 118 KiB/s 1.34 ms 268.76 us 2024-03-26T17:03:58.204 INFO:tasks.workunit.client.3.smithi157.stdout:myimage10 6/s 5/s 122 KiB/s 93 KiB/s 1.40 ms 263.31 us 2024-03-26T17:03:58.204 INFO:tasks.workunit.client.3.smithi157.stdout:myimage3 6/s 6/s 95 KiB/s 114 KiB/s 1.28 ms 232.16 us 2024-03-26T17:03:58.204 INFO:tasks.workunit.client.3.smithi157.stdout:myimage27 6/s 5/s 119 KiB/s 122 KiB/s 1.34 ms 319.44 us 2024-03-26T17:03:58.204 INFO:tasks.workunit.client.3.smithi157.stdout:myimage33 6/s 6/s 112 KiB/s 118 KiB/s 1.49 ms 278.75 us 2024-03-26T17:03:58.204 INFO:tasks.workunit.client.3.smithi157.stdout:myimage43 6/s 5/s 109 KiB/s 98 KiB/s 1.50 ms 378.83 us 2024-03-26T17:03:58.204 INFO:tasks.workunit.client.3.smithi157.stdout:myimage46 6/s 7/s 133 KiB/s 128 KiB/s 1.39 ms 371.79 us 2024-03-26T17:03:58.204 INFO:tasks.workunit.client.3.smithi157.stdout:myimage51 6/s 7/s 99 KiB/s 134 KiB/s 1.41 ms 276.66 us 2024-03-26T17:03:58.204 INFO:tasks.workunit.client.3.smithi157.stdout:myimage53 6/s 5/s 126 KiB/s 107 KiB/s 1.43 ms 328.67 us 2024-03-26T17:03:58.204 INFO:tasks.workunit.client.3.smithi157.stdout:myimage60 6/s 6/s 126 KiB/s 128 KiB/s 1.49 ms 268.62 us 2024-03-26T17:03:58.204 INFO:tasks.workunit.client.3.smithi157.stdout:myimage16 6/s 6/s 104 KiB/s 127 KiB/s 1.35 ms 336.02 us 2024-03-26T17:03:58.204 INFO:tasks.workunit.client.3.smithi157.stdout:myimage49 6/s 7/s 106 KiB/s 145 KiB/s 1.34 ms 254.66 us 2024-03-26T17:03:58.204 INFO:tasks.workunit.client.3.smithi157.stdout:myimage20 6/s 6/s 119 KiB/s 150 KiB/s 1.47 ms 291.98 us 2024-03-26T17:03:58.205 INFO:tasks.workunit.client.3.smithi157.stdout:myimage42 6/s 7/s 110 KiB/s 153 KiB/s 1.36 ms 283.74 us 2024-03-26T17:03:58.205 INFO:tasks.workunit.client.3.smithi157.stdout:myimage59 6/s 6/s 121 KiB/s 144 KiB/s 1.51 ms 296.25 us 2024-03-26T17:03:58.205 INFO:tasks.workunit.client.3.smithi157.stdout:myimage38 5/s 5/s 126 KiB/s 110 KiB/s 1.33 ms 283.21 us 2024-03-26T17:03:58.205 INFO:tasks.workunit.client.3.smithi157.stdout:myimage8 5/s 7/s 130 KiB/s 142 KiB/s 1.40 ms 292.21 us 2024-03-26T17:03:58.205 INFO:tasks.workunit.client.3.smithi157.stdout:myimage24 5/s 7/s 94 KiB/s 147 KiB/s 1.43 ms 284.83 us 2024-03-26T17:03:58.205 INFO:tasks.workunit.client.3.smithi157.stdout:myimage12 5/s 7/s 118 KiB/s 157 KiB/s 1.44 ms 280.10 us 2024-03-26T17:03:58.205 INFO:tasks.workunit.client.3.smithi157.stdout:myimage28 5/s 7/s 141 KiB/s 114 KiB/s 1.76 ms 268.47 us 2024-03-26T17:03:58.205 INFO:tasks.workunit.client.3.smithi157.stdout:myimage57 5/s 7/s 83 KiB/s 126 KiB/s 1.40 ms 250.72 us 2024-03-26T17:03:58.205 INFO:tasks.workunit.client.3.smithi157.stdout:myimage52 5/s 8/s 105 KiB/s 154 KiB/s 1.50 ms 330.45 us 2024-03-26T17:03:58.205 INFO:tasks.workunit.client.3.smithi157.stdout:myimage4 5/s 6/s 105 KiB/s 118 KiB/s 1.34 ms 285.37 us 2024-03-26T17:03:58.205 INFO:tasks.workunit.client.3.smithi157.stdout:myimage15 5/s 6/s 126 KiB/s 124 KiB/s 1.40 ms 320.48 us 2024-03-26T17:03:58.205 INFO:tasks.workunit.client.3.smithi157.stdout:myimage29 5/s 6/s 93 KiB/s 123 KiB/s 1.33 ms 332.54 us 2024-03-26T17:03:58.205 INFO:tasks.workunit.client.3.smithi157.stdout:myimage41 5/s 6/s 102 KiB/s 124 KiB/s 1.44 ms 256.08 us 2024-03-26T17:03:58.205 INFO:tasks.workunit.client.3.smithi157.stdout:myimage23 5/s 7/s 124 KiB/s 116 KiB/s 1.30 ms 261.87 us 2024-03-26T17:03:58.205 INFO:tasks.workunit.client.3.smithi157.stdout:myimage6 5/s 6/s 82 KiB/s 109 KiB/s 1.44 ms 331.22 us 2024-03-26T17:03:58.205 INFO:tasks.workunit.client.3.smithi157.stdout:myimage17 5/s 8/s 91 KiB/s 148 KiB/s 1.42 ms 271.72 us 2024-03-26T17:03:58.206 INFO:tasks.workunit.client.3.smithi157.stdout:myimage30 5/s 7/s 120 KiB/s 155 KiB/s 1.57 ms 255.26 us 2024-03-26T17:03:58.206 INFO:tasks.workunit.client.3.smithi157.stdout:myimage35 5/s 7/s 108 KiB/s 149 KiB/s 1.45 ms 269.42 us 2024-03-26T17:03:58.206 INFO:tasks.workunit.client.3.smithi157.stdout:myimage44 5/s 6/s 91 KiB/s 127 KiB/s 1.47 ms 285.22 us 2024-03-26T17:03:58.206 INFO:tasks.workunit.client.3.smithi157.stdout:myimage25 5/s 5/s 97 KiB/s 105 KiB/s 1.69 ms 286.13 us 2024-03-26T17:03:58.206 INFO:tasks.workunit.client.3.smithi157.stdout:myimage56 5/s 6/s 97 KiB/s 110 KiB/s 1.55 ms 261.35 us 2024-03-26T17:03:58.206 INFO:tasks.workunit.client.3.smithi157.stdout:myimage34 4/s 7/s 108 KiB/s 142 KiB/s 1.43 ms 229.97 us 2024-03-26T17:03:58.206 INFO:tasks.workunit.client.3.smithi157.stdout:myimage13 4/s 6/s 78 KiB/s 134 KiB/s 1.38 ms 254.98 us 2024-03-26T17:03:58.206 INFO:tasks.workunit.client.3.smithi157.stdout:myimage7 4/s 6/s 114 KiB/s 117 KiB/s 1.54 ms 365.48 us 2024-03-26T17:03:58.206 INFO:tasks.workunit.client.3.smithi157.stdout:myimage2 4/s 8/s 69 KiB/s 165 KiB/s 1.43 ms 253.07 us 2024-03-26T17:03:58.206 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:03:59.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:03:59 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:03:59] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:03:59.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:03:59 smithi044 ceph-mon[30624]: pgmap v540: 33 pgs: 33 active+clean; 1023 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 7.2 MiB/s rd, 7.2 MiB/s wr, 746 op/s 2024-03-26T17:03:59.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:03:59 smithi044 ceph-mon[30624]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:03:59.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:03:59 smithi044 ceph-mon[30624]: { 2024-03-26T17:03:59.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:03:59 smithi044 ceph-mon[30624]: "prefix": "rbd perf image stats", 2024-03-26T17:03:59.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:03:59 smithi044 ceph-mon[30624]: "pool_spec": "mypool", 2024-03-26T17:03:59.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:03:59 smithi044 ceph-mon[30624]: "sort_by": "write_ops", 2024-03-26T17:03:59.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:03:59 smithi044 ceph-mon[30624]: "format": "json" 2024-03-26T17:03:59.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:03:59 smithi044 ceph-mon[30624]: }"]: dispatch 2024-03-26T17:03:59.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:03:59 smithi044 ceph-mon[30624]: Health check update: 3 slow ops, oldest one blocked for 333 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:03:59.517 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:03:59 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:03:59] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:03:59.517 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:03:59 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:03:59.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:03:59 smithi064 ceph-mon[34420]: pgmap v540: 33 pgs: 33 active+clean; 1023 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 7.2 MiB/s rd, 7.2 MiB/s wr, 746 op/s 2024-03-26T17:03:59.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:03:59 smithi064 ceph-mon[34420]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:03:59.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:03:59 smithi064 ceph-mon[34420]: { 2024-03-26T17:03:59.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:03:59 smithi064 ceph-mon[34420]: "prefix": "rbd perf image stats", 2024-03-26T17:03:59.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:03:59 smithi064 ceph-mon[34420]: "pool_spec": "mypool", 2024-03-26T17:03:59.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:03:59 smithi064 ceph-mon[34420]: "sort_by": "write_ops", 2024-03-26T17:03:59.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:03:59 smithi064 ceph-mon[34420]: "format": "json" 2024-03-26T17:03:59.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:03:59 smithi064 ceph-mon[34420]: }"]: dispatch 2024-03-26T17:03:59.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:03:59 smithi064 ceph-mon[34420]: Health check update: 3 slow ops, oldest one blocked for 333 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:03:59.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:03:59 smithi149 ceph-mon[34678]: pgmap v540: 33 pgs: 33 active+clean; 1023 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 7.2 MiB/s rd, 7.2 MiB/s wr, 746 op/s 2024-03-26T17:03:59.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:03:59 smithi149 ceph-mon[34678]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:03:59.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:03:59 smithi149 ceph-mon[34678]: { 2024-03-26T17:03:59.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:03:59 smithi149 ceph-mon[34678]: "prefix": "rbd perf image stats", 2024-03-26T17:03:59.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:03:59 smithi149 ceph-mon[34678]: "pool_spec": "mypool", 2024-03-26T17:03:59.647 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:03:59 smithi149 ceph-mon[34678]: "sort_by": "write_ops", 2024-03-26T17:03:59.647 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:03:59 smithi149 ceph-mon[34678]: "format": "json" 2024-03-26T17:03:59.647 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:03:59 smithi149 ceph-mon[34678]: }"]: dispatch 2024-03-26T17:03:59.647 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:03:59 smithi149 ceph-mon[34678]: Health check update: 3 slow ops, oldest one blocked for 333 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:03:59.647 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:03:59 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:03:59] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:03:59.647 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:03:59 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:03:59] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:03:59.647 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:03:59 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:04:01.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:04:01 smithi044 ceph-mon[30624]: pgmap v541: 33 pgs: 33 active+clean; 1023 MiB data, 2.7 GiB used, 713 GiB / 715 GiB avail; 7.8 MiB/s rd, 7.7 MiB/s wr, 814 op/s 2024-03-26T17:04:01.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:04:01 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:04:01] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:04:01.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:04:01 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:04:01] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:04:01.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:04:01 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:04:01.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:04:01 smithi064 ceph-mon[34420]: pgmap v541: 33 pgs: 33 active+clean; 1023 MiB data, 2.7 GiB used, 713 GiB / 715 GiB avail; 7.8 MiB/s rd, 7.7 MiB/s wr, 814 op/s 2024-03-26T17:04:01.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:04:01 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 2024-03-26T17:04:01.218+0000 7fa707a55700 -1 mon.c@1(peon) e3 get_health_metrics reporting 3 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T17:04:01.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:04:01 smithi149 ceph-mon[34678]: pgmap v541: 33 pgs: 33 active+clean; 1023 MiB data, 2.7 GiB used, 713 GiB / 715 GiB avail; 7.8 MiB/s rd, 7.7 MiB/s wr, 814 op/s 2024-03-26T17:04:01.647 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:04:01 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:04:01] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:04:01.647 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:04:01 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:04:01] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:04:01.647 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:04:01 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:04:03.061 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:04:03.070 INFO:tasks.workunit.client.3.smithi157.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2024-03-26T17:04:03.070 INFO:tasks.workunit.client.3.smithi157.stdout: 12.70 126.0k 129.6k 0.0k 1.2M 1.3M 0.0k nvme2n1 2024-03-26T17:04:03.070 INFO:tasks.workunit.client.3.smithi157.stdout: 12.70 102.4k 128.8k 0.0k 1.0M 1.3M 0.0k nvme2n10 2024-03-26T17:04:03.070 INFO:tasks.workunit.client.3.smithi157.stdout: 12.70 111.6k 97.2k 0.0k 1.1M 972.0k 0.0k nvme2n11 2024-03-26T17:04:03.070 INFO:tasks.workunit.client.3.smithi157.stdout: 12.70 129.2k 119.6k 0.0k 1.3M 1.2M 0.0k nvme2n12 2024-03-26T17:04:03.070 INFO:tasks.workunit.client.3.smithi157.stdout: 12.70 129.2k 116.4k 0.0k 1.3M 1.1M 0.0k nvme2n13 2024-03-26T17:04:03.070 INFO:tasks.workunit.client.3.smithi157.stdout: 12.70 98.0k 115.6k 0.0k 980.0k 1.1M 0.0k nvme2n14 2024-03-26T17:04:03.070 INFO:tasks.workunit.client.3.smithi157.stdout: 12.70 143.2k 125.6k 0.0k 1.4M 1.2M 0.0k nvme2n15 2024-03-26T17:04:03.070 INFO:tasks.workunit.client.3.smithi157.stdout: 12.70 118.0k 122.0k 0.0k 1.2M 1.2M 0.0k nvme2n16 2024-03-26T17:04:03.071 INFO:tasks.workunit.client.3.smithi157.stdout: 12.70 134.0k 108.8k 0.0k 1.3M 1.1M 0.0k nvme2n17 2024-03-26T17:04:03.071 INFO:tasks.workunit.client.3.smithi157.stdout: 12.70 130.0k 118.8k 0.0k 1.3M 1.2M 0.0k nvme2n18 2024-03-26T17:04:03.071 INFO:tasks.workunit.client.3.smithi157.stdout: 12.70 122.8k 141.6k 0.0k 1.2M 1.4M 0.0k nvme2n19 2024-03-26T17:04:03.071 INFO:tasks.workunit.client.3.smithi157.stdout: 12.70 124.4k 130.4k 0.0k 1.2M 1.3M 0.0k nvme2n2 2024-03-26T17:04:03.071 INFO:tasks.workunit.client.3.smithi157.stdout: 12.70 162.0k 143.2k 0.0k 1.6M 1.4M 0.0k nvme2n20 2024-03-26T17:04:03.071 INFO:tasks.workunit.client.3.smithi157.stdout: 12.70 136.0k 87.2k 0.0k 1.3M 872.0k 0.0k nvme2n3 2024-03-26T17:04:03.071 INFO:tasks.workunit.client.3.smithi157.stdout: 12.70 128.4k 124.4k 0.0k 1.3M 1.2M 0.0k nvme2n4 2024-03-26T17:04:03.071 INFO:tasks.workunit.client.3.smithi157.stdout: 12.70 124.4k 137.2k 0.0k 1.2M 1.3M 0.0k nvme2n5 2024-03-26T17:04:03.071 INFO:tasks.workunit.client.3.smithi157.stdout: 12.70 116.4k 114.8k 0.0k 1.1M 1.1M 0.0k nvme2n6 2024-03-26T17:04:03.071 INFO:tasks.workunit.client.3.smithi157.stdout: 12.70 148.4k 106.8k 0.0k 1.4M 1.0M 0.0k nvme2n7 2024-03-26T17:04:03.071 INFO:tasks.workunit.client.3.smithi157.stdout: 12.70 114.8k 129.6k 0.0k 1.1M 1.3M 0.0k nvme2n8 2024-03-26T17:04:03.071 INFO:tasks.workunit.client.3.smithi157.stdout: 12.70 116.0k 123.6k 0.0k 1.1M 1.2M 0.0k nvme2n9 2024-03-26T17:04:03.071 INFO:tasks.workunit.client.3.smithi157.stdout: 12.70 138.0k 117.2k 0.0k 1.3M 1.1M 0.0k nvme5n1 2024-03-26T17:04:03.071 INFO:tasks.workunit.client.3.smithi157.stdout: 12.70 121.6k 128.8k 0.0k 1.2M 1.3M 0.0k nvme5n10 2024-03-26T17:04:03.072 INFO:tasks.workunit.client.3.smithi157.stdout: 12.70 128.0k 100.8k 0.0k 1.2M 1008.0k 0.0k nvme5n11 2024-03-26T17:04:03.072 INFO:tasks.workunit.client.3.smithi157.stdout: 12.70 120.8k 126.4k 0.0k 1.2M 1.2M 0.0k nvme5n12 2024-03-26T17:04:03.072 INFO:tasks.workunit.client.3.smithi157.stdout: 12.70 119.6k 126.0k 0.0k 1.2M 1.2M 0.0k nvme5n13 2024-03-26T17:04:03.072 INFO:tasks.workunit.client.3.smithi157.stdout: 12.70 134.0k 113.2k 0.0k 1.3M 1.1M 0.0k nvme5n14 2024-03-26T17:04:03.072 INFO:tasks.workunit.client.3.smithi157.stdout: 12.70 103.6k 124.4k 0.0k 1.0M 1.2M 0.0k nvme5n15 2024-03-26T17:04:03.072 INFO:tasks.workunit.client.3.smithi157.stdout: 12.70 120.0k 102.8k 0.0k 1.2M 1.0M 0.0k nvme5n16 2024-03-26T17:04:03.072 INFO:tasks.workunit.client.3.smithi157.stdout: 12.70 118.8k 133.2k 0.0k 1.2M 1.3M 0.0k nvme5n17 2024-03-26T17:04:03.072 INFO:tasks.workunit.client.3.smithi157.stdout: 12.70 120.4k 104.4k 0.0k 1.2M 1.0M 0.0k nvme5n18 2024-03-26T17:04:03.072 INFO:tasks.workunit.client.3.smithi157.stdout: 12.70 103.6k 125.2k 0.0k 1.0M 1.2M 0.0k nvme5n19 2024-03-26T17:04:03.073 INFO:tasks.workunit.client.3.smithi157.stdout: 12.70 134.4k 118.4k 0.0k 1.3M 1.2M 0.0k nvme5n2 2024-03-26T17:04:03.073 INFO:tasks.workunit.client.3.smithi157.stdout: 12.70 118.4k 132.4k 0.0k 1.2M 1.3M 0.0k nvme5n20 2024-03-26T17:04:03.073 INFO:tasks.workunit.client.3.smithi157.stdout: 12.70 113.2k 110.4k 0.0k 1.1M 1.1M 0.0k nvme5n3 2024-03-26T17:04:03.073 INFO:tasks.workunit.client.3.smithi157.stdout: 12.70 130.0k 114.4k 0.0k 1.3M 1.1M 0.0k nvme5n4 2024-03-26T17:04:03.073 INFO:tasks.workunit.client.3.smithi157.stdout: 12.70 128.4k 125.6k 0.0k 1.3M 1.2M 0.0k nvme5n5 2024-03-26T17:04:03.073 INFO:tasks.workunit.client.3.smithi157.stdout: 12.70 110.0k 130.4k 0.0k 1.1M 1.3M 0.0k nvme5n6 2024-03-26T17:04:03.073 INFO:tasks.workunit.client.3.smithi157.stdout: 12.70 148.8k 91.6k 0.0k 1.5M 916.0k 0.0k nvme5n7 2024-03-26T17:04:03.073 INFO:tasks.workunit.client.3.smithi157.stdout: 12.70 114.8k 120.8k 0.0k 1.1M 1.2M 0.0k nvme5n8 2024-03-26T17:04:03.073 INFO:tasks.workunit.client.3.smithi157.stdout: 12.70 148.8k 137.6k 0.0k 1.5M 1.3M 0.0k nvme5n9 2024-03-26T17:04:03.073 INFO:tasks.workunit.client.3.smithi157.stdout: 12.70 128.8k 122.0k 0.0k 1.3M 1.2M 0.0k nvme8n1 2024-03-26T17:04:03.073 INFO:tasks.workunit.client.3.smithi157.stdout: 12.70 143.2k 128.8k 0.0k 1.4M 1.3M 0.0k nvme8n10 2024-03-26T17:04:03.073 INFO:tasks.workunit.client.3.smithi157.stdout: 12.70 156.0k 102.8k 0.0k 1.5M 1.0M 0.0k nvme8n11 2024-03-26T17:04:03.073 INFO:tasks.workunit.client.3.smithi157.stdout: 12.70 134.4k 107.2k 0.0k 1.3M 1.0M 0.0k nvme8n12 2024-03-26T17:04:03.073 INFO:tasks.workunit.client.3.smithi157.stdout: 12.70 142.0k 106.8k 0.0k 1.4M 1.0M 0.0k nvme8n13 2024-03-26T17:04:03.074 INFO:tasks.workunit.client.3.smithi157.stdout: 12.70 142.8k 134.4k 0.0k 1.4M 1.3M 0.0k nvme8n14 2024-03-26T17:04:03.074 INFO:tasks.workunit.client.3.smithi157.stdout: 12.70 138.4k 98.0k 0.0k 1.4M 980.0k 0.0k nvme8n15 2024-03-26T17:04:03.074 INFO:tasks.workunit.client.3.smithi157.stdout: 12.70 130.8k 135.6k 0.0k 1.3M 1.3M 0.0k nvme8n16 2024-03-26T17:04:03.074 INFO:tasks.workunit.client.3.smithi157.stdout: 12.70 124.8k 112.4k 0.0k 1.2M 1.1M 0.0k nvme8n17 2024-03-26T17:04:03.074 INFO:tasks.workunit.client.3.smithi157.stdout: 12.70 113.6k 126.8k 0.0k 1.1M 1.2M 0.0k nvme8n18 2024-03-26T17:04:03.074 INFO:tasks.workunit.client.3.smithi157.stdout: 12.70 111.6k 134.4k 0.0k 1.1M 1.3M 0.0k nvme8n19 2024-03-26T17:04:03.074 INFO:tasks.workunit.client.3.smithi157.stdout: 12.70 119.6k 96.8k 0.0k 1.2M 968.0k 0.0k nvme8n2 2024-03-26T17:04:03.074 INFO:tasks.workunit.client.3.smithi157.stdout: 12.70 117.2k 141.6k 0.0k 1.1M 1.4M 0.0k nvme8n20 2024-03-26T17:04:03.074 INFO:tasks.workunit.client.3.smithi157.stdout: 12.70 116.0k 96.0k 0.0k 1.1M 960.0k 0.0k nvme8n3 2024-03-26T17:04:03.074 INFO:tasks.workunit.client.3.smithi157.stdout: 12.70 122.0k 108.8k 0.0k 1.2M 1.1M 0.0k nvme8n4 2024-03-26T17:04:03.074 INFO:tasks.workunit.client.3.smithi157.stdout: 12.70 120.0k 121.6k 0.0k 1.2M 1.2M 0.0k nvme8n5 2024-03-26T17:04:03.074 INFO:tasks.workunit.client.3.smithi157.stdout: 12.70 116.4k 122.8k 0.0k 1.1M 1.2M 0.0k nvme8n6 2024-03-26T17:04:03.074 INFO:tasks.workunit.client.3.smithi157.stdout: 12.70 110.8k 144.0k 0.0k 1.1M 1.4M 0.0k nvme8n7 2024-03-26T17:04:03.074 INFO:tasks.workunit.client.3.smithi157.stdout: 12.70 162.0k 136.0k 0.0k 1.6M 1.3M 0.0k nvme8n8 2024-03-26T17:04:03.075 INFO:tasks.workunit.client.3.smithi157.stdout: 12.70 132.4k 103.2k 0.0k 1.3M 1.0M 0.0k nvme8n9 2024-03-26T17:04:03.075 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:04:03.206 INFO:tasks.workunit.client.3.smithi157.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-26T17:04:03.206 INFO:tasks.workunit.client.3.smithi157.stdout:myimage6 8/s 7/s 154 KiB/s 130 KiB/s 1.35 ms 271.95 us 2024-03-26T17:04:03.206 INFO:tasks.workunit.client.3.smithi157.stdout:myimage35 8/s 6/s 145 KiB/s 106 KiB/s 1.40 ms 254.02 us 2024-03-26T17:04:03.206 INFO:tasks.workunit.client.3.smithi157.stdout:myimage29 8/s 5/s 140 KiB/s 129 KiB/s 1.37 ms 244.34 us 2024-03-26T17:04:03.206 INFO:tasks.workunit.client.3.smithi157.stdout:myimage12 7/s 5/s 144 KiB/s 82 KiB/s 1.47 ms 319.83 us 2024-03-26T17:04:03.206 INFO:tasks.workunit.client.3.smithi157.stdout:myimage59 7/s 6/s 160 KiB/s 114 KiB/s 1.55 ms 326.88 us 2024-03-26T17:04:03.206 INFO:tasks.workunit.client.3.smithi157.stdout:myimage39 7/s 5/s 126 KiB/s 86 KiB/s 1.40 ms 341.66 us 2024-03-26T17:04:03.206 INFO:tasks.workunit.client.3.smithi157.stdout:myimage38 7/s 6/s 118 KiB/s 131 KiB/s 1.33 ms 251.46 us 2024-03-26T17:04:03.206 INFO:tasks.workunit.client.3.smithi157.stdout:myimage40 7/s 7/s 151 KiB/s 157 KiB/s 1.42 ms 279.35 us 2024-03-26T17:04:03.206 INFO:tasks.workunit.client.3.smithi157.stdout:myimage4 7/s 7/s 134 KiB/s 181 KiB/s 1.40 ms 288.41 us 2024-03-26T17:04:03.207 INFO:tasks.workunit.client.3.smithi157.stdout:myimage8 7/s 5/s 156 KiB/s 89 KiB/s 1.48 ms 214.43 us 2024-03-26T17:04:03.207 INFO:tasks.workunit.client.3.smithi157.stdout:myimage15 7/s 7/s 151 KiB/s 151 KiB/s 1.46 ms 291.91 us 2024-03-26T17:04:03.207 INFO:tasks.workunit.client.3.smithi157.stdout:myimage10 7/s 7/s 142 KiB/s 126 KiB/s 1.40 ms 265.53 us 2024-03-26T17:04:03.207 INFO:tasks.workunit.client.3.smithi157.stdout:myimage19 7/s 6/s 145 KiB/s 115 KiB/s 1.47 ms 360.70 us 2024-03-26T17:04:03.207 INFO:tasks.workunit.client.3.smithi157.stdout:myimage56 7/s 7/s 167 KiB/s 143 KiB/s 1.56 ms 270.33 us 2024-03-26T17:04:03.207 INFO:tasks.workunit.client.3.smithi157.stdout:myimage14 7/s 5/s 105 KiB/s 90 KiB/s 1.53 ms 302.81 us 2024-03-26T17:04:03.207 INFO:tasks.workunit.client.3.smithi157.stdout:myimage37 7/s 5/s 163 KiB/s 79 KiB/s 1.45 ms 287.70 us 2024-03-26T17:04:03.207 INFO:tasks.workunit.client.3.smithi157.stdout:myimage9 7/s 7/s 147 KiB/s 141 KiB/s 1.51 ms 260.48 us 2024-03-26T17:04:03.207 INFO:tasks.workunit.client.3.smithi157.stdout:myimage20 7/s 7/s 166 KiB/s 158 KiB/s 1.31 ms 270.90 us 2024-03-26T17:04:03.207 INFO:tasks.workunit.client.3.smithi157.stdout:myimage25 7/s 7/s 157 KiB/s 127 KiB/s 1.65 ms 304.87 us 2024-03-26T17:04:03.207 INFO:tasks.workunit.client.3.smithi157.stdout:myimage33 7/s 7/s 147 KiB/s 110 KiB/s 1.42 ms 270.16 us 2024-03-26T17:04:03.207 INFO:tasks.workunit.client.3.smithi157.stdout:myimage45 7/s 6/s 122 KiB/s 152 KiB/s 1.44 ms 266.75 us 2024-03-26T17:04:03.207 INFO:tasks.workunit.client.3.smithi157.stdout:myimage57 7/s 6/s 134 KiB/s 116 KiB/s 1.41 ms 246.83 us 2024-03-26T17:04:03.207 INFO:tasks.workunit.client.3.smithi157.stdout:myimage48 6/s 7/s 151 KiB/s 187 KiB/s 1.49 ms 339.41 us 2024-03-26T17:04:03.208 INFO:tasks.workunit.client.3.smithi157.stdout:myimage1 6/s 5/s 116 KiB/s 102 KiB/s 1.26 ms 287.82 us 2024-03-26T17:04:03.208 INFO:tasks.workunit.client.3.smithi157.stdout:myimage36 6/s 8/s 101 KiB/s 138 KiB/s 1.38 ms 283.41 us 2024-03-26T17:04:03.208 INFO:tasks.workunit.client.3.smithi157.stdout:myimage41 6/s 8/s 146 KiB/s 154 KiB/s 1.52 ms 246.99 us 2024-03-26T17:04:03.208 INFO:tasks.workunit.client.3.smithi157.stdout:myimage30 6/s 6/s 138 KiB/s 127 KiB/s 1.66 ms 272.84 us 2024-03-26T17:04:03.208 INFO:tasks.workunit.client.3.smithi157.stdout:myimage52 6/s 7/s 114 KiB/s 146 KiB/s 1.50 ms 261.92 us 2024-03-26T17:04:03.208 INFO:tasks.workunit.client.3.smithi157.stdout:myimage7 6/s 8/s 105 KiB/s 188 KiB/s 1.52 ms 257.60 us 2024-03-26T17:04:03.208 INFO:tasks.workunit.client.3.smithi157.stdout:myimage54 6/s 7/s 135 KiB/s 123 KiB/s 1.43 ms 287.17 us 2024-03-26T17:04:03.208 INFO:tasks.workunit.client.3.smithi157.stdout:myimage32 6/s 6/s 130 KiB/s 119 KiB/s 1.44 ms 384.13 us 2024-03-26T17:04:03.208 INFO:tasks.workunit.client.3.smithi157.stdout:myimage5 6/s 7/s 114 KiB/s 164 KiB/s 1.51 ms 268.26 us 2024-03-26T17:04:03.208 INFO:tasks.workunit.client.3.smithi157.stdout:myimage43 6/s 7/s 105 KiB/s 126 KiB/s 1.50 ms 310.46 us 2024-03-26T17:04:03.208 INFO:tasks.workunit.client.3.smithi157.stdout:myimage2 6/s 7/s 130 KiB/s 137 KiB/s 1.42 ms 262.80 us 2024-03-26T17:04:03.208 INFO:tasks.workunit.client.3.smithi157.stdout:myimage31 6/s 6/s 124 KiB/s 125 KiB/s 1.63 ms 268.14 us 2024-03-26T17:04:03.208 INFO:tasks.workunit.client.3.smithi157.stdout:myimage47 6/s 5/s 155 KiB/s 93 KiB/s 1.54 ms 280.60 us 2024-03-26T17:04:03.208 INFO:tasks.workunit.client.3.smithi157.stdout:myimage18 6/s 4/s 109 KiB/s 83 KiB/s 1.37 ms 263.32 us 2024-03-26T17:04:03.209 INFO:tasks.workunit.client.3.smithi157.stdout:myimage24 6/s 7/s 134 KiB/s 109 KiB/s 1.49 ms 260.51 us 2024-03-26T17:04:03.209 INFO:tasks.workunit.client.3.smithi157.stdout:myimage13 6/s 5/s 136 KiB/s 85 KiB/s 1.37 ms 273.10 us 2024-03-26T17:04:03.209 INFO:tasks.workunit.client.3.smithi157.stdout:myimage22 6/s 7/s 106 KiB/s 134 KiB/s 1.45 ms 357.63 us 2024-03-26T17:04:03.209 INFO:tasks.workunit.client.3.smithi157.stdout:myimage34 6/s 5/s 90 KiB/s 106 KiB/s 1.37 ms 340.70 us 2024-03-26T17:04:03.209 INFO:tasks.workunit.client.3.smithi157.stdout:myimage44 6/s 8/s 121 KiB/s 176 KiB/s 1.43 ms 306.07 us 2024-03-26T17:04:03.209 INFO:tasks.workunit.client.3.smithi157.stdout:myimage17 6/s 6/s 123 KiB/s 137 KiB/s 1.65 ms 265.05 us 2024-03-26T17:04:03.209 INFO:tasks.workunit.client.3.smithi157.stdout:myimage16 5/s 6/s 130 KiB/s 129 KiB/s 1.53 ms 241.13 us 2024-03-26T17:04:03.209 INFO:tasks.workunit.client.3.smithi157.stdout:myimage28 5/s 6/s 110 KiB/s 116 KiB/s 1.62 ms 259.02 us 2024-03-26T17:04:03.209 INFO:tasks.workunit.client.3.smithi157.stdout:myimage50 5/s 8/s 138 KiB/s 155 KiB/s 1.71 ms 314.29 us 2024-03-26T17:04:03.209 INFO:tasks.workunit.client.3.smithi157.stdout:myimage55 5/s 6/s 94 KiB/s 120 KiB/s 1.51 ms 304.89 us 2024-03-26T17:04:03.209 INFO:tasks.workunit.client.3.smithi157.stdout:myimage11 5/s 6/s 85 KiB/s 123 KiB/s 1.59 ms 329.03 us 2024-03-26T17:04:03.209 INFO:tasks.workunit.client.3.smithi157.stdout:myimage42 5/s 5/s 94 KiB/s 101 KiB/s 1.45 ms 299.41 us 2024-03-26T17:04:03.209 INFO:tasks.workunit.client.3.smithi157.stdout:myimage23 5/s 6/s 78 KiB/s 100 KiB/s 1.40 ms 272.83 us 2024-03-26T17:04:03.209 INFO:tasks.workunit.client.3.smithi157.stdout:myimage58 4/s 4/s 93 KiB/s 94 KiB/s 1.29 ms 270.38 us 2024-03-26T17:04:03.209 INFO:tasks.workunit.client.3.smithi157.stdout:myimage21 4/s 4/s 84 KiB/s 81 KiB/s 1.62 ms 283.94 us 2024-03-26T17:04:03.210 INFO:tasks.workunit.client.3.smithi157.stdout:myimage27 4/s 8/s 60 KiB/s 181 KiB/s 1.38 ms 331.56 us 2024-03-26T17:04:03.210 INFO:tasks.workunit.client.3.smithi157.stdout:myimage60 4/s 4/s 113 KiB/s 69 KiB/s 1.46 ms 242.11 us 2024-03-26T17:04:03.210 INFO:tasks.workunit.client.3.smithi157.stdout:myimage51 4/s 7/s 91 KiB/s 124 KiB/s 1.62 ms 238.51 us 2024-03-26T17:04:03.210 INFO:tasks.workunit.client.3.smithi157.stdout:myimage3 4/s 8/s 80 KiB/s 128 KiB/s 1.40 ms 286.58 us 2024-03-26T17:04:03.210 INFO:tasks.workunit.client.3.smithi157.stdout:myimage49 4/s 7/s 90 KiB/s 134 KiB/s 1.50 ms 286.66 us 2024-03-26T17:04:03.210 INFO:tasks.workunit.client.3.smithi157.stdout:myimage26 4/s 7/s 69 KiB/s 134 KiB/s 1.48 ms 306.19 us 2024-03-26T17:04:03.210 INFO:tasks.workunit.client.3.smithi157.stdout:myimage46 4/s 5/s 90 KiB/s 90 KiB/s 1.40 ms 366.53 us 2024-03-26T17:04:03.210 INFO:tasks.workunit.client.3.smithi157.stdout:myimage53 3/s 9/s 73 KiB/s 185 KiB/s 1.39 ms 297.94 us 2024-03-26T17:04:03.210 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:04:03.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:04:03 smithi044 ceph-mon[30624]: pgmap v542: 33 pgs: 33 active+clean; 1023 MiB data, 2.7 GiB used, 713 GiB / 715 GiB avail; 6.8 MiB/s rd, 6.8 MiB/s wr, 727 op/s 2024-03-26T17:04:03.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:04:03 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:04:03] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:04:03.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:04:03 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:04:03] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:04:03.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:04:03 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:04:03.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:04:03 smithi064 ceph-mon[34420]: pgmap v542: 33 pgs: 33 active+clean; 1023 MiB data, 2.7 GiB used, 713 GiB / 715 GiB avail; 6.8 MiB/s rd, 6.8 MiB/s wr, 727 op/s 2024-03-26T17:04:03.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:04:03 smithi149 ceph-mon[34678]: pgmap v542: 33 pgs: 33 active+clean; 1023 MiB data, 2.7 GiB used, 713 GiB / 715 GiB avail; 6.8 MiB/s rd, 6.8 MiB/s wr, 727 op/s 2024-03-26T17:04:03.646 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:04:03 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:04:03] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:04:03.647 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:04:03 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:04:03] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:04:03.647 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:04:03 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:04:04.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:04:04 smithi044 ceph-mon[30624]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:04:04.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:04:04 smithi044 ceph-mon[30624]: { 2024-03-26T17:04:04.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:04:04 smithi044 ceph-mon[30624]: "prefix": "rbd perf image stats", 2024-03-26T17:04:04.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:04:04 smithi044 ceph-mon[30624]: "pool_spec": "mypool", 2024-03-26T17:04:04.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:04:04 smithi044 ceph-mon[30624]: "sort_by": "write_ops", 2024-03-26T17:04:04.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:04:04 smithi044 ceph-mon[30624]: "format": "json" 2024-03-26T17:04:04.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:04:04 smithi044 ceph-mon[30624]: }"]: dispatch 2024-03-26T17:04:04.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:04:04 smithi044 ceph-mon[30624]: Health check update: 3 slow ops, oldest one blocked for 338 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:04:04.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:04:04 smithi064 ceph-mon[34420]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:04:04.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:04:04 smithi064 ceph-mon[34420]: { 2024-03-26T17:04:04.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:04:04 smithi064 ceph-mon[34420]: "prefix": "rbd perf image stats", 2024-03-26T17:04:04.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:04:04 smithi064 ceph-mon[34420]: "pool_spec": "mypool", 2024-03-26T17:04:04.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:04:04 smithi064 ceph-mon[34420]: "sort_by": "write_ops", 2024-03-26T17:04:04.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:04:04 smithi064 ceph-mon[34420]: "format": "json" 2024-03-26T17:04:04.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:04:04 smithi064 ceph-mon[34420]: }"]: dispatch 2024-03-26T17:04:04.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:04:04 smithi064 ceph-mon[34420]: Health check update: 3 slow ops, oldest one blocked for 338 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:04:04.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:04:04 smithi149 ceph-mon[34678]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:04:04.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:04:04 smithi149 ceph-mon[34678]: { 2024-03-26T17:04:04.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:04:04 smithi149 ceph-mon[34678]: "prefix": "rbd perf image stats", 2024-03-26T17:04:04.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:04:04 smithi149 ceph-mon[34678]: "pool_spec": "mypool", 2024-03-26T17:04:04.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:04:04 smithi149 ceph-mon[34678]: "sort_by": "write_ops", 2024-03-26T17:04:04.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:04:04 smithi149 ceph-mon[34678]: "format": "json" 2024-03-26T17:04:04.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:04:04 smithi149 ceph-mon[34678]: }"]: dispatch 2024-03-26T17:04:04.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:04:04 smithi149 ceph-mon[34678]: Health check update: 3 slow ops, oldest one blocked for 338 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:04:05.416 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:04:05 smithi044 ceph-mon[30624]: pgmap v543: 33 pgs: 33 active+clean; 1023 MiB data, 2.7 GiB used, 713 GiB / 715 GiB avail; 7.9 MiB/s rd, 7.6 MiB/s wr, 836 op/s 2024-03-26T17:04:05.417 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:04:05 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:04:05] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:04:05.417 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:04:05 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:04:05] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:04:05.417 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:04:05 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:04:05.547 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:04:05 smithi149 ceph-mon[34678]: pgmap v543: 33 pgs: 33 active+clean; 1023 MiB data, 2.7 GiB used, 713 GiB / 715 GiB avail; 7.9 MiB/s rd, 7.6 MiB/s wr, 836 op/s 2024-03-26T17:04:05.548 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:04:05 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:04:05] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:04:05.548 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:04:05 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:04:05] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:04:05.548 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:04:05 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:04:05.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:04:05 smithi064 ceph-mon[34420]: pgmap v543: 33 pgs: 33 active+clean; 1023 MiB data, 2.7 GiB used, 713 GiB / 715 GiB avail; 7.9 MiB/s rd, 7.6 MiB/s wr, 836 op/s 2024-03-26T17:04:06.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:04:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 2024-03-26T17:04:06.218+0000 7fa707a55700 -1 mon.c@1(peon) e3 get_health_metrics reporting 3 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T17:04:07.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:04:07 smithi044 ceph-mon[30624]: pgmap v544: 33 pgs: 33 active+clean; 1023 MiB data, 2.7 GiB used, 713 GiB / 715 GiB avail; 7.3 MiB/s rd, 6.9 MiB/s wr, 756 op/s 2024-03-26T17:04:07.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:04:07 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:04:07] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:04:07.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:04:07 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:04:07] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:04:07.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:04:07 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:04:07.547 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:04:07 smithi149 ceph-mon[34678]: pgmap v544: 33 pgs: 33 active+clean; 1023 MiB data, 2.7 GiB used, 713 GiB / 715 GiB avail; 7.3 MiB/s rd, 6.9 MiB/s wr, 756 op/s 2024-03-26T17:04:07.548 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:04:07 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:04:07] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:04:07.548 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:04:07 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:04:07] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:04:07.548 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:04:07 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:04:07.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:04:07 smithi064 ceph-mon[34420]: pgmap v544: 33 pgs: 33 active+clean; 1023 MiB data, 2.7 GiB used, 713 GiB / 715 GiB avail; 7.3 MiB/s rd, 6.9 MiB/s wr, 756 op/s 2024-03-26T17:04:08.210 INFO:tasks.workunit.client.3.smithi157.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-26T17:04:08.210 INFO:tasks.workunit.client.3.smithi157.stdout:myimage34 8/s 7/s 165 KiB/s 108 KiB/s 1.37 ms 267.56 us 2024-03-26T17:04:08.210 INFO:tasks.workunit.client.3.smithi157.stdout:myimage23 8/s 5/s 135 KiB/s 109 KiB/s 1.33 ms 280.92 us 2024-03-26T17:04:08.210 INFO:tasks.workunit.client.3.smithi157.stdout:myimage60 8/s 8/s 175 KiB/s 255 KiB/s 1.56 ms 392.65 us 2024-03-26T17:04:08.210 INFO:tasks.workunit.client.3.smithi157.stdout:myimage46 8/s 7/s 204 KiB/s 163 KiB/s 1.38 ms 270.27 us 2024-03-26T17:04:08.210 INFO:tasks.workunit.client.3.smithi157.stdout:myimage37 7/s 6/s 211 KiB/s 203 KiB/s 1.52 ms 343.04 us 2024-03-26T17:04:08.210 INFO:tasks.workunit.client.3.smithi157.stdout:myimage13 7/s 7/s 198 KiB/s 192 KiB/s 1.42 ms 344.16 us 2024-03-26T17:04:08.210 INFO:tasks.workunit.client.3.smithi157.stdout:myimage35 7/s 7/s 159 KiB/s 135 KiB/s 1.35 ms 272.64 us 2024-03-26T17:04:08.210 INFO:tasks.workunit.client.3.smithi157.stdout:myimage42 7/s 7/s 158 KiB/s 174 KiB/s 1.39 ms 303.70 us 2024-03-26T17:04:08.211 INFO:tasks.workunit.client.3.smithi157.stdout:myimage14 7/s 5/s 102 KiB/s 108 KiB/s 1.57 ms 266.32 us 2024-03-26T17:04:08.211 INFO:tasks.workunit.client.3.smithi157.stdout:myimage1 7/s 6/s 150 KiB/s 174 KiB/s 1.34 ms 298.92 us 2024-03-26T17:04:08.211 INFO:tasks.workunit.client.3.smithi157.stdout:myimage19 7/s 5/s 142 KiB/s 117 KiB/s 1.53 ms 293.65 us 2024-03-26T17:04:08.211 INFO:tasks.workunit.client.3.smithi157.stdout:myimage43 7/s 6/s 130 KiB/s 122 KiB/s 1.55 ms 302.17 us 2024-03-26T17:04:08.211 INFO:tasks.workunit.client.3.smithi157.stdout:myimage30 6/s 5/s 124 KiB/s 82 KiB/s 1.65 ms 263.48 us 2024-03-26T17:04:08.211 INFO:tasks.workunit.client.3.smithi157.stdout:myimage49 6/s 5/s 143 KiB/s 90 KiB/s 1.54 ms 270.68 us 2024-03-26T17:04:08.211 INFO:tasks.workunit.client.3.smithi157.stdout:myimage4 6/s 4/s 112 KiB/s 84 KiB/s 1.29 ms 270.41 us 2024-03-26T17:04:08.211 INFO:tasks.workunit.client.3.smithi157.stdout:myimage26 6/s 6/s 126 KiB/s 105 KiB/s 1.47 ms 245.39 us 2024-03-26T17:04:08.211 INFO:tasks.workunit.client.3.smithi157.stdout:myimage33 6/s 5/s 175 KiB/s 127 KiB/s 1.42 ms 288.28 us 2024-03-26T17:04:08.211 INFO:tasks.workunit.client.3.smithi157.stdout:myimage16 6/s 5/s 100 KiB/s 92 KiB/s 1.46 ms 262.31 us 2024-03-26T17:04:08.211 INFO:tasks.workunit.client.3.smithi157.stdout:myimage38 6/s 7/s 114 KiB/s 162 KiB/s 1.41 ms 288.68 us 2024-03-26T17:04:08.211 INFO:tasks.workunit.client.3.smithi157.stdout:myimage48 6/s 5/s 204 KiB/s 178 KiB/s 1.44 ms 310.82 us 2024-03-26T17:04:08.211 INFO:tasks.workunit.client.3.smithi157.stdout:myimage58 6/s 9/s 187 KiB/s 182 KiB/s 1.42 ms 349.94 us 2024-03-26T17:04:08.211 INFO:tasks.workunit.client.3.smithi157.stdout:myimage25 6/s 7/s 146 KiB/s 202 KiB/s 1.80 ms 314.72 us 2024-03-26T17:04:08.212 INFO:tasks.workunit.client.3.smithi157.stdout:myimage41 6/s 5/s 140 KiB/s 151 KiB/s 1.47 ms 308.01 us 2024-03-26T17:04:08.212 INFO:tasks.workunit.client.3.smithi157.stdout:myimage3 6/s 6/s 126 KiB/s 120 KiB/s 1.37 ms 258.05 us 2024-03-26T17:04:08.212 INFO:tasks.workunit.client.3.smithi157.stdout:myimage11 6/s 5/s 93 KiB/s 111 KiB/s 1.57 ms 364.82 us 2024-03-26T17:04:08.212 INFO:tasks.workunit.client.3.smithi157.stdout:myimage15 6/s 6/s 161 KiB/s 150 KiB/s 1.33 ms 313.59 us 2024-03-26T17:04:08.212 INFO:tasks.workunit.client.3.smithi157.stdout:myimage53 6/s 7/s 124 KiB/s 114 KiB/s 1.60 ms 276.01 us 2024-03-26T17:04:08.212 INFO:tasks.workunit.client.3.smithi157.stdout:myimage55 6/s 7/s 150 KiB/s 150 KiB/s 1.52 ms 368.35 us 2024-03-26T17:04:08.212 INFO:tasks.workunit.client.3.smithi157.stdout:myimage2 6/s 7/s 215 KiB/s 191 KiB/s 1.61 ms 308.59 us 2024-03-26T17:04:08.212 INFO:tasks.workunit.client.3.smithi157.stdout:myimage32 6/s 6/s 92 KiB/s 100 KiB/s 1.56 ms 283.80 us 2024-03-26T17:04:08.212 INFO:tasks.workunit.client.3.smithi157.stdout:myimage17 6/s 7/s 120 KiB/s 155 KiB/s 1.50 ms 457.58 us 2024-03-26T17:04:08.212 INFO:tasks.workunit.client.3.smithi157.stdout:myimage20 6/s 4/s 201 KiB/s 142 KiB/s 1.50 ms 301.13 us 2024-03-26T17:04:08.212 INFO:tasks.workunit.client.3.smithi157.stdout:myimage24 6/s 7/s 112 KiB/s 144 KiB/s 1.51 ms 270.36 us 2024-03-26T17:04:08.212 INFO:tasks.workunit.client.3.smithi157.stdout:myimage10 6/s 6/s 117 KiB/s 153 KiB/s 1.55 ms 270.11 us 2024-03-26T17:04:08.212 INFO:tasks.workunit.client.3.smithi157.stdout:myimage8 6/s 6/s 150 KiB/s 164 KiB/s 1.63 ms 313.07 us 2024-03-26T17:04:08.212 INFO:tasks.workunit.client.3.smithi157.stdout:myimage22 5/s 7/s 130 KiB/s 172 KiB/s 1.47 ms 280.35 us 2024-03-26T17:04:08.213 INFO:tasks.workunit.client.3.smithi157.stdout:myimage9 5/s 5/s 150 KiB/s 115 KiB/s 1.58 ms 289.63 us 2024-03-26T17:04:08.213 INFO:tasks.workunit.client.3.smithi157.stdout:myimage18 5/s 7/s 108 KiB/s 154 KiB/s 1.46 ms 289.05 us 2024-03-26T17:04:08.213 INFO:tasks.workunit.client.3.smithi157.stdout:myimage28 5/s 5/s 98 KiB/s 100 KiB/s 1.83 ms 335.83 us 2024-03-26T17:04:08.213 INFO:tasks.workunit.client.3.smithi157.stdout:myimage29 5/s 6/s 173 KiB/s 198 KiB/s 1.38 ms 329.46 us 2024-03-26T17:04:08.213 INFO:tasks.workunit.client.3.smithi157.stdout:myimage47 5/s 6/s 113 KiB/s 146 KiB/s 1.68 ms 267.47 us 2024-03-26T17:04:08.213 INFO:tasks.workunit.client.3.smithi157.stdout:myimage57 5/s 6/s 87 KiB/s 127 KiB/s 1.51 ms 347.55 us 2024-03-26T17:04:08.213 INFO:tasks.workunit.client.3.smithi157.stdout:myimage7 5/s 5/s 153 KiB/s 165 KiB/s 1.48 ms 369.62 us 2024-03-26T17:04:08.213 INFO:tasks.workunit.client.3.smithi157.stdout:myimage12 5/s 8/s 83 KiB/s 154 KiB/s 1.51 ms 289.75 us 2024-03-26T17:04:08.213 INFO:tasks.workunit.client.3.smithi157.stdout:myimage50 5/s 6/s 173 KiB/s 184 KiB/s 1.63 ms 355.40 us 2024-03-26T17:04:08.213 INFO:tasks.workunit.client.3.smithi157.stdout:myimage54 5/s 4/s 186 KiB/s 145 KiB/s 1.54 ms 281.67 us 2024-03-26T17:04:08.213 INFO:tasks.workunit.client.3.smithi157.stdout:myimage31 5/s 7/s 132 KiB/s 180 KiB/s 1.56 ms 345.03 us 2024-03-26T17:04:08.213 INFO:tasks.workunit.client.3.smithi157.stdout:myimage40 5/s 5/s 88 KiB/s 112 KiB/s 1.45 ms 294.52 us 2024-03-26T17:04:08.213 INFO:tasks.workunit.client.3.smithi157.stdout:myimage59 5/s 8/s 125 KiB/s 180 KiB/s 1.49 ms 297.42 us 2024-03-26T17:04:08.213 INFO:tasks.workunit.client.3.smithi157.stdout:myimage21 5/s 9/s 147 KiB/s 220 KiB/s 1.61 ms 358.88 us 2024-03-26T17:04:08.214 INFO:tasks.workunit.client.3.smithi157.stdout:myimage36 5/s 5/s 92 KiB/s 129 KiB/s 1.76 ms 463.40 us 2024-03-26T17:04:08.214 INFO:tasks.workunit.client.3.smithi157.stdout:myimage44 4/s 7/s 94 KiB/s 106 KiB/s 1.50 ms 258.71 us 2024-03-26T17:04:08.214 INFO:tasks.workunit.client.3.smithi157.stdout:myimage6 4/s 5/s 107 KiB/s 137 KiB/s 1.62 ms 306.09 us 2024-03-26T17:04:08.214 INFO:tasks.workunit.client.3.smithi157.stdout:myimage27 4/s 7/s 114 KiB/s 150 KiB/s 1.39 ms 347.21 us 2024-03-26T17:04:08.214 INFO:tasks.workunit.client.3.smithi157.stdout:myimage39 4/s 5/s 99 KiB/s 94 KiB/s 1.45 ms 253.88 us 2024-03-26T17:04:08.214 INFO:tasks.workunit.client.3.smithi157.stdout:myimage45 4/s 4/s 61 KiB/s 89 KiB/s 1.56 ms 256.82 us 2024-03-26T17:04:08.214 INFO:tasks.workunit.client.3.smithi157.stdout:myimage56 4/s 6/s 161 KiB/s 165 KiB/s 1.61 ms 290.88 us 2024-03-26T17:04:08.214 INFO:tasks.workunit.client.3.smithi157.stdout:myimage52 4/s 4/s 62 KiB/s 83 KiB/s 1.67 ms 231.85 us 2024-03-26T17:04:08.214 INFO:tasks.workunit.client.3.smithi157.stdout:myimage5 4/s 5/s 144 KiB/s 158 KiB/s 1.42 ms 301.95 us 2024-03-26T17:04:08.214 INFO:tasks.workunit.client.3.smithi157.stdout:myimage51 4/s 8/s 116 KiB/s 264 KiB/s 1.58 ms 280.83 us 2024-03-26T17:04:08.214 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:04:09.494 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:04:09 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:04:09] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:04:09.495 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:04:09 smithi149 ceph-mon[34678]: pgmap v545: 33 pgs: 33 active+clean; 1023 MiB data, 2.7 GiB used, 712 GiB / 715 GiB avail; 7.7 MiB/s rd, 7.3 MiB/s wr, 763 op/s 2024-03-26T17:04:09.495 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:04:09 smithi149 ceph-mon[34678]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:04:09.495 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:04:09 smithi149 ceph-mon[34678]: { 2024-03-26T17:04:09.495 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:04:09 smithi149 ceph-mon[34678]: "prefix": "rbd perf image stats", 2024-03-26T17:04:09.495 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:04:09 smithi149 ceph-mon[34678]: "pool_spec": "mypool", 2024-03-26T17:04:09.495 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:04:09 smithi149 ceph-mon[34678]: "sort_by": "write_ops", 2024-03-26T17:04:09.495 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:04:09 smithi149 ceph-mon[34678]: "format": "json" 2024-03-26T17:04:09.495 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:04:09 smithi149 ceph-mon[34678]: }"]: dispatch 2024-03-26T17:04:09.495 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:04:09 smithi149 ceph-mon[34678]: Health check update: 3 slow ops, oldest one blocked for 343 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:04:09.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:04:09 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:04:09] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:04:09.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:04:09 smithi044 ceph-mon[30624]: pgmap v545: 33 pgs: 33 active+clean; 1023 MiB data, 2.7 GiB used, 712 GiB / 715 GiB avail; 7.7 MiB/s rd, 7.3 MiB/s wr, 763 op/s 2024-03-26T17:04:09.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:04:09 smithi044 ceph-mon[30624]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:04:09.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:04:09 smithi044 ceph-mon[30624]: { 2024-03-26T17:04:09.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:04:09 smithi044 ceph-mon[30624]: "prefix": "rbd perf image stats", 2024-03-26T17:04:09.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:04:09 smithi044 ceph-mon[30624]: "pool_spec": "mypool", 2024-03-26T17:04:09.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:04:09 smithi044 ceph-mon[30624]: "sort_by": "write_ops", 2024-03-26T17:04:09.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:04:09 smithi044 ceph-mon[30624]: "format": "json" 2024-03-26T17:04:09.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:04:09 smithi044 ceph-mon[30624]: }"]: dispatch 2024-03-26T17:04:09.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:04:09 smithi044 ceph-mon[30624]: Health check update: 3 slow ops, oldest one blocked for 343 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:04:09.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:04:09 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:04:09] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:04:09.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:04:09 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:04:09.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:04:09 smithi064 ceph-mon[34420]: pgmap v545: 33 pgs: 33 active+clean; 1023 MiB data, 2.7 GiB used, 712 GiB / 715 GiB avail; 7.7 MiB/s rd, 7.3 MiB/s wr, 763 op/s 2024-03-26T17:04:09.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:04:09 smithi064 ceph-mon[34420]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:04:09.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:04:09 smithi064 ceph-mon[34420]: { 2024-03-26T17:04:09.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:04:09 smithi064 ceph-mon[34420]: "prefix": "rbd perf image stats", 2024-03-26T17:04:09.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:04:09 smithi064 ceph-mon[34420]: "pool_spec": "mypool", 2024-03-26T17:04:09.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:04:09 smithi064 ceph-mon[34420]: "sort_by": "write_ops", 2024-03-26T17:04:09.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:04:09 smithi064 ceph-mon[34420]: "format": "json" 2024-03-26T17:04:09.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:04:09 smithi064 ceph-mon[34420]: }"]: dispatch 2024-03-26T17:04:09.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:04:09 smithi064 ceph-mon[34420]: Health check update: 3 slow ops, oldest one blocked for 343 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:04:09.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:04:09 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:04:09] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:04:09.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:04:09 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:04:11.501 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:04:11 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 2024-03-26T17:04:11.219+0000 7fa707a55700 -1 mon.c@1(peon) e3 get_health_metrics reporting 3 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T17:04:11.501 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:04:11 smithi149 ceph-mon[34678]: pgmap v546: 33 pgs: 33 active+clean; 1023 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 8.6 MiB/s rd, 8.3 MiB/s wr, 795 op/s 2024-03-26T17:04:11.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:04:11 smithi044 ceph-mon[30624]: pgmap v546: 33 pgs: 33 active+clean; 1023 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 8.6 MiB/s rd, 8.3 MiB/s wr, 795 op/s 2024-03-26T17:04:11.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:04:11 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:04:11] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:04:11.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:04:11 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:04:11] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:04:11.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:04:11 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:04:11.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:04:11 smithi064 ceph-mon[34420]: pgmap v546: 33 pgs: 33 active+clean; 1023 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 8.6 MiB/s rd, 8.3 MiB/s wr, 795 op/s 2024-03-26T17:04:11.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:04:11 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:04:11] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:04:11.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:04:11 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:04:11] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:04:11.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:04:11 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:04:13.062 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:04:13.075 INFO:tasks.workunit.client.3.smithi157.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2024-03-26T17:04:13.075 INFO:tasks.workunit.client.3.smithi157.stdout: 11.80 155.6k 210.4k 0.0k 1.5M 2.1M 0.0k nvme2n1 2024-03-26T17:04:13.075 INFO:tasks.workunit.client.3.smithi157.stdout: 11.70 223.6k 170.4k 0.0k 2.2M 1.7M 0.0k nvme2n10 2024-03-26T17:04:13.075 INFO:tasks.workunit.client.3.smithi157.stdout: 11.70 171.6k 165.2k 0.0k 1.7M 1.6M 0.0k nvme2n11 2024-03-26T17:04:13.075 INFO:tasks.workunit.client.3.smithi157.stdout: 11.70 168.8k 162.8k 0.0k 1.6M 1.6M 0.0k nvme2n12 2024-03-26T17:04:13.075 INFO:tasks.workunit.client.3.smithi157.stdout: 11.70 175.6k 186.4k 0.0k 1.7M 1.8M 0.0k nvme2n13 2024-03-26T17:04:13.075 INFO:tasks.workunit.client.3.smithi157.stdout: 11.70 148.4k 133.2k 0.0k 1.4M 1.3M 0.0k nvme2n14 2024-03-26T17:04:13.075 INFO:tasks.workunit.client.3.smithi157.stdout: 11.70 142.0k 196.0k 0.0k 1.4M 1.9M 0.0k nvme2n15 2024-03-26T17:04:13.075 INFO:tasks.workunit.client.3.smithi157.stdout: 11.80 148.8k 170.8k 0.0k 1.5M 1.7M 0.0k nvme2n16 2024-03-26T17:04:13.075 INFO:tasks.workunit.client.3.smithi157.stdout: 11.80 162.4k 174.4k 0.0k 1.6M 1.7M 0.0k nvme2n17 2024-03-26T17:04:13.076 INFO:tasks.workunit.client.3.smithi157.stdout: 11.80 162.8k 188.0k 0.0k 1.6M 1.8M 0.0k nvme2n18 2024-03-26T17:04:13.076 INFO:tasks.workunit.client.3.smithi157.stdout: 11.80 160.8k 147.2k 0.0k 1.6M 1.4M 0.0k nvme2n19 2024-03-26T17:04:13.076 INFO:tasks.workunit.client.3.smithi157.stdout: 11.80 190.4k 148.8k 0.0k 1.9M 1.5M 0.0k nvme2n2 2024-03-26T17:04:13.076 INFO:tasks.workunit.client.3.smithi157.stdout: 11.80 192.0k 192.0k 0.0k 1.9M 1.9M 0.0k nvme2n20 2024-03-26T17:04:13.076 INFO:tasks.workunit.client.3.smithi157.stdout: 11.80 154.8k 164.4k 0.0k 1.5M 1.6M 0.0k nvme2n3 2024-03-26T17:04:13.076 INFO:tasks.workunit.client.3.smithi157.stdout: 11.80 200.0k 154.4k 0.0k 2.0M 1.5M 0.0k nvme2n4 2024-03-26T17:04:13.076 INFO:tasks.workunit.client.3.smithi157.stdout: 11.80 186.8k 158.4k 0.0k 1.8M 1.5M 0.0k nvme2n5 2024-03-26T17:04:13.076 INFO:tasks.workunit.client.3.smithi157.stdout: 11.80 198.0k 185.2k 0.0k 1.9M 1.8M 0.0k nvme2n6 2024-03-26T17:04:13.076 INFO:tasks.workunit.client.3.smithi157.stdout: 11.80 176.0k 191.6k 0.0k 1.7M 1.9M 0.0k nvme2n7 2024-03-26T17:04:13.076 INFO:tasks.workunit.client.3.smithi157.stdout: 11.80 220.4k 184.8k 0.0k 2.2M 1.8M 0.0k nvme2n8 2024-03-26T17:04:13.076 INFO:tasks.workunit.client.3.smithi157.stdout: 11.80 212.4k 162.0k 0.0k 2.1M 1.6M 0.0k nvme2n9 2024-03-26T17:04:13.076 INFO:tasks.workunit.client.3.smithi157.stdout: 11.80 187.6k 170.0k 0.0k 1.8M 1.7M 0.0k nvme5n1 2024-03-26T17:04:13.077 INFO:tasks.workunit.client.3.smithi157.stdout: 11.80 136.8k 182.0k 0.0k 1.3M 1.8M 0.0k nvme5n10 2024-03-26T17:04:13.077 INFO:tasks.workunit.client.3.smithi157.stdout: 11.70 179.2k 184.8k 0.0k 1.8M 1.8M 0.0k nvme5n11 2024-03-26T17:04:13.077 INFO:tasks.workunit.client.3.smithi157.stdout: 11.70 126.4k 162.8k 0.0k 1.2M 1.6M 0.0k nvme5n12 2024-03-26T17:04:13.077 INFO:tasks.workunit.client.3.smithi157.stdout: 11.70 175.6k 188.4k 0.0k 1.7M 1.8M 0.0k nvme5n13 2024-03-26T17:04:13.077 INFO:tasks.workunit.client.3.smithi157.stdout: 11.70 125.6k 157.2k 0.0k 1.2M 1.5M 0.0k nvme5n14 2024-03-26T17:04:13.077 INFO:tasks.workunit.client.3.smithi157.stdout: 11.70 146.0k 157.2k 0.0k 1.4M 1.5M 0.0k nvme5n15 2024-03-26T17:04:13.077 INFO:tasks.workunit.client.3.smithi157.stdout: 11.70 190.4k 173.2k 0.0k 1.9M 1.7M 0.0k nvme5n16 2024-03-26T17:04:13.077 INFO:tasks.workunit.client.3.smithi157.stdout: 11.80 191.2k 182.4k 0.0k 1.9M 1.8M 0.0k nvme5n17 2024-03-26T17:04:13.077 INFO:tasks.workunit.client.3.smithi157.stdout: 11.80 161.6k 174.0k 0.0k 1.6M 1.7M 0.0k nvme5n18 2024-03-26T17:04:13.077 INFO:tasks.workunit.client.3.smithi157.stdout: 11.80 146.8k 160.4k 0.0k 1.4M 1.6M 0.0k nvme5n19 2024-03-26T17:04:13.077 INFO:tasks.workunit.client.3.smithi157.stdout: 11.80 235.6k 128.0k 0.0k 2.3M 1.2M 0.0k nvme5n2 2024-03-26T17:04:13.077 INFO:tasks.workunit.client.3.smithi157.stdout: 11.80 177.2k 151.2k 0.0k 1.7M 1.5M 0.0k nvme5n20 2024-03-26T17:04:13.078 INFO:tasks.workunit.client.3.smithi157.stdout: 11.80 145.6k 128.4k 0.0k 1.4M 1.3M 0.0k nvme5n3 2024-03-26T17:04:13.078 INFO:tasks.workunit.client.3.smithi157.stdout: 11.80 144.8k 155.6k 0.0k 1.4M 1.5M 0.0k nvme5n4 2024-03-26T17:04:13.078 INFO:tasks.workunit.client.3.smithi157.stdout: 11.80 219.6k 172.0k 0.0k 2.1M 1.7M 0.0k nvme5n5 2024-03-26T17:04:13.078 INFO:tasks.workunit.client.3.smithi157.stdout: 11.80 166.4k 176.8k 0.0k 1.6M 1.7M 0.0k nvme5n6 2024-03-26T17:04:13.078 INFO:tasks.workunit.client.3.smithi157.stdout: 11.80 186.4k 185.2k 0.0k 1.8M 1.8M 0.0k nvme5n7 2024-03-26T17:04:13.079 INFO:tasks.workunit.client.3.smithi157.stdout: 11.80 119.2k 191.2k 0.0k 1.2M 1.9M 0.0k nvme5n8 2024-03-26T17:04:13.079 INFO:tasks.workunit.client.3.smithi157.stdout: 11.80 167.6k 182.0k 0.0k 1.6M 1.8M 0.0k nvme5n9 2024-03-26T17:04:13.079 INFO:tasks.workunit.client.3.smithi157.stdout: 11.80 204.4k 146.4k 0.0k 2.0M 1.4M 0.0k nvme8n1 2024-03-26T17:04:13.079 INFO:tasks.workunit.client.3.smithi157.stdout: 11.70 188.0k 204.8k 0.0k 1.8M 2.0M 0.0k nvme8n10 2024-03-26T17:04:13.079 INFO:tasks.workunit.client.3.smithi157.stdout: 11.70 223.6k 156.4k 0.0k 2.2M 1.5M 0.0k nvme8n11 2024-03-26T17:04:13.079 INFO:tasks.workunit.client.3.smithi157.stdout: 11.70 169.6k 159.6k 0.0k 1.7M 1.6M 0.0k nvme8n12 2024-03-26T17:04:13.079 INFO:tasks.workunit.client.3.smithi157.stdout: 11.70 107.6k 199.2k 0.0k 1.1M 1.9M 0.0k nvme8n13 2024-03-26T17:04:13.079 INFO:tasks.workunit.client.3.smithi157.stdout: 11.70 171.2k 185.6k 0.0k 1.7M 1.8M 0.0k nvme8n14 2024-03-26T17:04:13.079 INFO:tasks.workunit.client.3.smithi157.stdout: 11.70 138.8k 195.2k 0.0k 1.4M 1.9M 0.0k nvme8n15 2024-03-26T17:04:13.079 INFO:tasks.workunit.client.3.smithi157.stdout: 11.80 196.0k 225.2k 0.0k 1.9M 2.2M 0.0k nvme8n16 2024-03-26T17:04:13.080 INFO:tasks.workunit.client.3.smithi157.stdout: 11.80 138.4k 146.4k 0.0k 1.4M 1.4M 0.0k nvme8n17 2024-03-26T17:04:13.080 INFO:tasks.workunit.client.3.smithi157.stdout: 11.80 174.4k 180.8k 0.0k 1.7M 1.8M 0.0k nvme8n18 2024-03-26T17:04:13.080 INFO:tasks.workunit.client.3.smithi157.stdout: 11.80 177.2k 167.2k 0.0k 1.7M 1.6M 0.0k nvme8n19 2024-03-26T17:04:13.080 INFO:tasks.workunit.client.3.smithi157.stdout: 11.80 146.8k 212.0k 0.0k 1.4M 2.1M 0.0k nvme8n2 2024-03-26T17:04:13.080 INFO:tasks.workunit.client.3.smithi157.stdout: 11.80 232.0k 137.6k 0.0k 2.3M 1.3M 0.0k nvme8n20 2024-03-26T17:04:13.080 INFO:tasks.workunit.client.3.smithi157.stdout: 11.80 132.8k 180.8k 0.0k 1.3M 1.8M 0.0k nvme8n3 2024-03-26T17:04:13.080 INFO:tasks.workunit.client.3.smithi157.stdout: 11.80 176.8k 140.4k 0.0k 1.7M 1.4M 0.0k nvme8n4 2024-03-26T17:04:13.080 INFO:tasks.workunit.client.3.smithi157.stdout: 11.80 179.2k 156.8k 0.0k 1.8M 1.5M 0.0k nvme8n5 2024-03-26T17:04:13.080 INFO:tasks.workunit.client.3.smithi157.stdout: 11.80 166.8k 168.8k 0.0k 1.6M 1.6M 0.0k nvme8n6 2024-03-26T17:04:13.080 INFO:tasks.workunit.client.3.smithi157.stdout: 11.80 167.2k 168.8k 0.0k 1.6M 1.6M 0.0k nvme8n7 2024-03-26T17:04:13.080 INFO:tasks.workunit.client.3.smithi157.stdout: 11.80 158.8k 191.2k 0.0k 1.6M 1.9M 0.0k nvme8n8 2024-03-26T17:04:13.080 INFO:tasks.workunit.client.3.smithi157.stdout: 11.80 118.8k 138.8k 0.0k 1.2M 1.4M 0.0k nvme8n9 2024-03-26T17:04:13.080 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:04:13.214 INFO:tasks.workunit.client.3.smithi157.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-26T17:04:13.214 INFO:tasks.workunit.client.3.smithi157.stdout:myimage28 8/s 4/s 214 KiB/s 108 KiB/s 1.72 ms 272.60 us 2024-03-26T17:04:13.214 INFO:tasks.workunit.client.3.smithi157.stdout:myimage16 7/s 7/s 215 KiB/s 173 KiB/s 1.41 ms 261.26 us 2024-03-26T17:04:13.214 INFO:tasks.workunit.client.3.smithi157.stdout:myimage39 7/s 6/s 171 KiB/s 153 KiB/s 1.37 ms 296.39 us 2024-03-26T17:04:13.214 INFO:tasks.workunit.client.3.smithi157.stdout:myimage53 7/s 4/s 183 KiB/s 94 KiB/s 1.44 ms 293.53 us 2024-03-26T17:04:13.214 INFO:tasks.workunit.client.3.smithi157.stdout:myimage30 6/s 5/s 196 KiB/s 135 KiB/s 1.72 ms 282.83 us 2024-03-26T17:04:13.214 INFO:tasks.workunit.client.3.smithi157.stdout:myimage58 6/s 4/s 214 KiB/s 143 KiB/s 1.49 ms 371.00 us 2024-03-26T17:04:13.215 INFO:tasks.workunit.client.3.smithi157.stdout:myimage36 6/s 6/s 226 KiB/s 193 KiB/s 1.52 ms 342.66 us 2024-03-26T17:04:13.215 INFO:tasks.workunit.client.3.smithi157.stdout:myimage31 6/s 6/s 199 KiB/s 193 KiB/s 1.67 ms 307.42 us 2024-03-26T17:04:13.215 INFO:tasks.workunit.client.3.smithi157.stdout:myimage47 6/s 5/s 194 KiB/s 145 KiB/s 1.63 ms 303.24 us 2024-03-26T17:04:13.215 INFO:tasks.workunit.client.3.smithi157.stdout:myimage15 6/s 4/s 199 KiB/s 142 KiB/s 1.43 ms 418.71 us 2024-03-26T17:04:13.215 INFO:tasks.workunit.client.3.smithi157.stdout:myimage18 6/s 7/s 193 KiB/s 195 KiB/s 1.51 ms 293.76 us 2024-03-26T17:04:13.215 INFO:tasks.workunit.client.3.smithi157.stdout:myimage45 6/s 6/s 153 KiB/s 162 KiB/s 1.68 ms 378.62 us 2024-03-26T17:04:13.215 INFO:tasks.workunit.client.3.smithi157.stdout:myimage56 6/s 5/s 220 KiB/s 188 KiB/s 1.72 ms 467.72 us 2024-03-26T17:04:13.215 INFO:tasks.workunit.client.3.smithi157.stdout:myimage13 6/s 6/s 170 KiB/s 174 KiB/s 1.41 ms 410.14 us 2024-03-26T17:04:13.215 INFO:tasks.workunit.client.3.smithi157.stdout:myimage23 6/s 5/s 119 KiB/s 118 KiB/s 1.34 ms 332.65 us 2024-03-26T17:04:13.215 INFO:tasks.workunit.client.3.smithi157.stdout:myimage52 6/s 7/s 206 KiB/s 177 KiB/s 1.66 ms 300.56 us 2024-03-26T17:04:13.215 INFO:tasks.workunit.client.3.smithi157.stdout:myimage11 6/s 5/s 190 KiB/s 179 KiB/s 1.42 ms 317.07 us 2024-03-26T17:04:13.215 INFO:tasks.workunit.client.3.smithi157.stdout:myimage17 6/s 4/s 224 KiB/s 136 KiB/s 1.57 ms 308.99 us 2024-03-26T17:04:13.215 INFO:tasks.workunit.client.3.smithi157.stdout:myimage46 6/s 5/s 154 KiB/s 153 KiB/s 1.44 ms 316.37 us 2024-03-26T17:04:13.215 INFO:tasks.workunit.client.3.smithi157.stdout:myimage1 6/s 5/s 201 KiB/s 144 KiB/s 1.36 ms 270.87 us 2024-03-26T17:04:13.216 INFO:tasks.workunit.client.3.smithi157.stdout:myimage50 6/s 4/s 233 KiB/s 138 KiB/s 1.60 ms 417.84 us 2024-03-26T17:04:13.216 INFO:tasks.workunit.client.3.smithi157.stdout:myimage54 6/s 6/s 196 KiB/s 198 KiB/s 1.49 ms 355.66 us 2024-03-26T17:04:13.216 INFO:tasks.workunit.client.3.smithi157.stdout:myimage55 6/s 5/s 182 KiB/s 158 KiB/s 1.61 ms 365.71 us 2024-03-26T17:04:13.216 INFO:tasks.workunit.client.3.smithi157.stdout:myimage5 6/s 5/s 177 KiB/s 147 KiB/s 1.52 ms 340.46 us 2024-03-26T17:04:13.216 INFO:tasks.workunit.client.3.smithi157.stdout:myimage42 6/s 5/s 198 KiB/s 149 KiB/s 1.53 ms 289.41 us 2024-03-26T17:04:13.216 INFO:tasks.workunit.client.3.smithi157.stdout:myimage32 5/s 5/s 136 KiB/s 103 KiB/s 1.45 ms 325.41 us 2024-03-26T17:04:13.216 INFO:tasks.workunit.client.3.smithi157.stdout:myimage49 5/s 4/s 134 KiB/s 130 KiB/s 1.55 ms 427.21 us 2024-03-26T17:04:13.216 INFO:tasks.workunit.client.3.smithi157.stdout:myimage4 5/s 6/s 155 KiB/s 215 KiB/s 1.47 ms 316.07 us 2024-03-26T17:04:13.216 INFO:tasks.workunit.client.3.smithi157.stdout:myimage8 5/s 5/s 216 KiB/s 190 KiB/s 1.62 ms 307.14 us 2024-03-26T17:04:13.216 INFO:tasks.workunit.client.3.smithi157.stdout:myimage9 5/s 7/s 174 KiB/s 226 KiB/s 1.61 ms 335.78 us 2024-03-26T17:04:13.216 INFO:tasks.workunit.client.3.smithi157.stdout:myimage21 5/s 5/s 186 KiB/s 177 KiB/s 1.83 ms 301.44 us 2024-03-26T17:04:13.216 INFO:tasks.workunit.client.3.smithi157.stdout:myimage26 5/s 5/s 190 KiB/s 180 KiB/s 1.63 ms 363.13 us 2024-03-26T17:04:13.216 INFO:tasks.workunit.client.3.smithi157.stdout:myimage43 5/s 5/s 179 KiB/s 133 KiB/s 1.57 ms 299.67 us 2024-03-26T17:04:13.217 INFO:tasks.workunit.client.3.smithi157.stdout:myimage57 5/s 5/s 136 KiB/s 116 KiB/s 1.45 ms 288.82 us 2024-03-26T17:04:13.217 INFO:tasks.workunit.client.3.smithi157.stdout:myimage48 5/s 4/s 123 KiB/s 157 KiB/s 1.55 ms 300.63 us 2024-03-26T17:04:13.217 INFO:tasks.workunit.client.3.smithi157.stdout:myimage24 5/s 4/s 173 KiB/s 142 KiB/s 1.53 ms 318.70 us 2024-03-26T17:04:13.217 INFO:tasks.workunit.client.3.smithi157.stdout:myimage29 5/s 5/s 165 KiB/s 146 KiB/s 1.39 ms 283.47 us 2024-03-26T17:04:13.217 INFO:tasks.workunit.client.3.smithi157.stdout:myimage2 5/s 4/s 114 KiB/s 132 KiB/s 1.61 ms 373.81 us 2024-03-26T17:04:13.217 INFO:tasks.workunit.client.3.smithi157.stdout:myimage14 5/s 6/s 160 KiB/s 162 KiB/s 1.60 ms 325.96 us 2024-03-26T17:04:13.217 INFO:tasks.workunit.client.3.smithi157.stdout:myimage34 5/s 3/s 156 KiB/s 90 KiB/s 1.36 ms 271.22 us 2024-03-26T17:04:13.217 INFO:tasks.workunit.client.3.smithi157.stdout:myimage6 5/s 6/s 204 KiB/s 222 KiB/s 1.67 ms 387.58 us 2024-03-26T17:04:13.217 INFO:tasks.workunit.client.3.smithi157.stdout:myimage27 5/s 5/s 169 KiB/s 202 KiB/s 1.46 ms 312.14 us 2024-03-26T17:04:13.217 INFO:tasks.workunit.client.3.smithi157.stdout:myimage3 5/s 5/s 167 KiB/s 176 KiB/s 1.45 ms 421.35 us 2024-03-26T17:04:13.217 INFO:tasks.workunit.client.3.smithi157.stdout:myimage40 5/s 4/s 163 KiB/s 134 KiB/s 1.48 ms 309.42 us 2024-03-26T17:04:13.218 INFO:tasks.workunit.client.3.smithi157.stdout:myimage25 5/s 7/s 147 KiB/s 247 KiB/s 1.77 ms 341.21 us 2024-03-26T17:04:13.218 INFO:tasks.workunit.client.3.smithi157.stdout:myimage33 5/s 4/s 146 KiB/s 163 KiB/s 1.53 ms 326.40 us 2024-03-26T17:04:13.218 INFO:tasks.workunit.client.3.smithi157.stdout:myimage41 5/s 6/s 158 KiB/s 195 KiB/s 1.45 ms 332.75 us 2024-03-26T17:04:13.218 INFO:tasks.workunit.client.3.smithi157.stdout:myimage44 5/s 6/s 118 KiB/s 183 KiB/s 1.52 ms 297.28 us 2024-03-26T17:04:13.218 INFO:tasks.workunit.client.3.smithi157.stdout:myimage7 5/s 6/s 134 KiB/s 158 KiB/s 1.53 ms 326.12 us 2024-03-26T17:04:13.218 INFO:tasks.workunit.client.3.smithi157.stdout:myimage51 5/s 7/s 170 KiB/s 218 KiB/s 1.67 ms 305.54 us 2024-03-26T17:04:13.218 INFO:tasks.workunit.client.3.smithi157.stdout:myimage59 5/s 6/s 145 KiB/s 166 KiB/s 1.57 ms 295.47 us 2024-03-26T17:04:13.218 INFO:tasks.workunit.client.3.smithi157.stdout:myimage38 4/s 4/s 146 KiB/s 146 KiB/s 1.45 ms 351.41 us 2024-03-26T17:04:13.218 INFO:tasks.workunit.client.3.smithi157.stdout:myimage19 4/s 6/s 88 KiB/s 138 KiB/s 1.63 ms 318.07 us 2024-03-26T17:04:13.218 INFO:tasks.workunit.client.3.smithi157.stdout:myimage20 4/s 7/s 166 KiB/s 187 KiB/s 1.55 ms 374.83 us 2024-03-26T17:04:13.218 INFO:tasks.workunit.client.3.smithi157.stdout:myimage60 4/s 5/s 118 KiB/s 171 KiB/s 1.50 ms 309.77 us 2024-03-26T17:04:13.218 INFO:tasks.workunit.client.3.smithi157.stdout:myimage37 4/s 6/s 146 KiB/s 167 KiB/s 1.57 ms 384.65 us 2024-03-26T17:04:13.218 INFO:tasks.workunit.client.3.smithi157.stdout:myimage35 4/s 4/s 104 KiB/s 117 KiB/s 1.43 ms 305.45 us 2024-03-26T17:04:13.218 INFO:tasks.workunit.client.3.smithi157.stdout:myimage10 4/s 7/s 142 KiB/s 233 KiB/s 1.53 ms 301.32 us 2024-03-26T17:04:13.219 INFO:tasks.workunit.client.3.smithi157.stdout:myimage12 3/s 7/s 131 KiB/s 228 KiB/s 1.58 ms 364.47 us 2024-03-26T17:04:13.219 INFO:tasks.workunit.client.3.smithi157.stdout:myimage22 2/s 7/s 110 KiB/s 229 KiB/s 1.53 ms 316.11 us 2024-03-26T17:04:13.219 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:04:13.515 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:04:13 smithi149 ceph-mon[34678]: pgmap v547: 33 pgs: 33 active+clean; 1023 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 7.9 MiB/s rd, 7.6 MiB/s wr, 680 op/s 2024-03-26T17:04:13.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:04:13 smithi044 ceph-mon[30624]: pgmap v547: 33 pgs: 33 active+clean; 1023 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 7.9 MiB/s rd, 7.6 MiB/s wr, 680 op/s 2024-03-26T17:04:13.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:04:13 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:04:13] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:04:13.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:04:13 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:04:13] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:04:13.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:04:13 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:04:13.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:04:13 smithi064 ceph-mon[34420]: pgmap v547: 33 pgs: 33 active+clean; 1023 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 7.9 MiB/s rd, 7.6 MiB/s wr, 680 op/s 2024-03-26T17:04:13.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:04:13 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:04:13] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:04:13.897 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:04:13 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:04:13] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:04:13.897 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:04:13 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:04:14.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:04:14 smithi044 ceph-mon[30624]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:04:14.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:04:14 smithi044 ceph-mon[30624]: { 2024-03-26T17:04:14.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:04:14 smithi044 ceph-mon[30624]: "prefix": "rbd perf image stats", 2024-03-26T17:04:14.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:04:14 smithi044 ceph-mon[30624]: "pool_spec": "mypool", 2024-03-26T17:04:14.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:04:14 smithi044 ceph-mon[30624]: "sort_by": "write_ops", 2024-03-26T17:04:14.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:04:14 smithi044 ceph-mon[30624]: "format": "json" 2024-03-26T17:04:14.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:04:14 smithi044 ceph-mon[30624]: }"]: dispatch 2024-03-26T17:04:14.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:04:14 smithi044 ceph-mon[30624]: Health check update: 3 slow ops, oldest one blocked for 348 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:04:14.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:04:14 smithi064 ceph-mon[34420]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:04:14.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:04:14 smithi064 ceph-mon[34420]: { 2024-03-26T17:04:14.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:04:14 smithi064 ceph-mon[34420]: "prefix": "rbd perf image stats", 2024-03-26T17:04:14.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:04:14 smithi064 ceph-mon[34420]: "pool_spec": "mypool", 2024-03-26T17:04:14.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:04:14 smithi064 ceph-mon[34420]: "sort_by": "write_ops", 2024-03-26T17:04:14.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:04:14 smithi064 ceph-mon[34420]: "format": "json" 2024-03-26T17:04:14.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:04:14 smithi064 ceph-mon[34420]: }"]: dispatch 2024-03-26T17:04:14.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:04:14 smithi064 ceph-mon[34420]: Health check update: 3 slow ops, oldest one blocked for 348 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:04:14.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:04:14 smithi149 ceph-mon[34678]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:04:14.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:04:14 smithi149 ceph-mon[34678]: { 2024-03-26T17:04:14.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:04:14 smithi149 ceph-mon[34678]: "prefix": "rbd perf image stats", 2024-03-26T17:04:14.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:04:14 smithi149 ceph-mon[34678]: "pool_spec": "mypool", 2024-03-26T17:04:14.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:04:14 smithi149 ceph-mon[34678]: "sort_by": "write_ops", 2024-03-26T17:04:14.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:04:14 smithi149 ceph-mon[34678]: "format": "json" 2024-03-26T17:04:14.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:04:14 smithi149 ceph-mon[34678]: }"]: dispatch 2024-03-26T17:04:14.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:04:14 smithi149 ceph-mon[34678]: Health check update: 3 slow ops, oldest one blocked for 348 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:04:15.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:04:15 smithi044 ceph-mon[30624]: pgmap v548: 33 pgs: 33 active+clean; 1023 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 9.7 MiB/s rd, 9.5 MiB/s wr, 775 op/s 2024-03-26T17:04:15.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:04:15 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:04:15] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:04:15.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:04:15 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:04:15] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:04:15.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:04:15 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:04:15.526 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:04:15 smithi149 ceph-mon[34678]: pgmap v548: 33 pgs: 33 active+clean; 1023 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 9.7 MiB/s rd, 9.5 MiB/s wr, 775 op/s 2024-03-26T17:04:15.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:04:15 smithi064 ceph-mon[34420]: pgmap v548: 33 pgs: 33 active+clean; 1023 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 9.7 MiB/s rd, 9.5 MiB/s wr, 775 op/s 2024-03-26T17:04:15.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:04:15 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:04:15] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:04:15.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:04:15 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:04:15] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:04:15.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:04:15 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:04:16.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:04:16 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 2024-03-26T17:04:16.219+0000 7fa707a55700 -1 mon.c@1(peon) e3 get_health_metrics reporting 3 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T17:04:17.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:04:17 smithi044 ceph-mon[30624]: pgmap v549: 33 pgs: 33 active+clean; 1023 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 9.5 MiB/s rd, 9.4 MiB/s wr, 698 op/s 2024-03-26T17:04:17.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:04:17 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:04:17] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:04:17.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:04:17 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:04:17] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:04:17.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:04:17 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:04:17.539 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:04:17 smithi149 ceph-mon[34678]: pgmap v549: 33 pgs: 33 active+clean; 1023 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 9.5 MiB/s rd, 9.4 MiB/s wr, 698 op/s 2024-03-26T17:04:17.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:04:17 smithi064 ceph-mon[34420]: pgmap v549: 33 pgs: 33 active+clean; 1023 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 9.5 MiB/s rd, 9.4 MiB/s wr, 698 op/s 2024-03-26T17:04:17.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:04:17 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:04:17] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:04:17.897 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:04:17 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:04:17] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:04:17.897 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:04:17 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:04:18.218 INFO:tasks.workunit.client.3.smithi157.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-26T17:04:18.218 INFO:tasks.workunit.client.3.smithi157.stdout:myimage39 8/s 5/s 254 KiB/s 154 KiB/s 1.44 ms 405.43 us 2024-03-26T17:04:18.218 INFO:tasks.workunit.client.3.smithi157.stdout:myimage7 7/s 4/s 254 KiB/s 156 KiB/s 1.58 ms 323.46 us 2024-03-26T17:04:18.218 INFO:tasks.workunit.client.3.smithi157.stdout:myimage32 7/s 5/s 252 KiB/s 161 KiB/s 1.61 ms 309.24 us 2024-03-26T17:04:18.218 INFO:tasks.workunit.client.3.smithi157.stdout:myimage37 7/s 4/s 229 KiB/s 136 KiB/s 1.54 ms 396.23 us 2024-03-26T17:04:18.218 INFO:tasks.workunit.client.3.smithi157.stdout:myimage12 7/s 4/s 195 KiB/s 151 KiB/s 1.60 ms 342.48 us 2024-03-26T17:04:18.218 INFO:tasks.workunit.client.3.smithi157.stdout:myimage1 7/s 4/s 215 KiB/s 174 KiB/s 1.38 ms 326.72 us 2024-03-26T17:04:18.218 INFO:tasks.workunit.client.3.smithi157.stdout:myimage27 7/s 6/s 218 KiB/s 154 KiB/s 1.45 ms 293.13 us 2024-03-26T17:04:18.219 INFO:tasks.workunit.client.3.smithi157.stdout:myimage24 6/s 4/s 185 KiB/s 141 KiB/s 1.49 ms 417.92 us 2024-03-26T17:04:18.219 INFO:tasks.workunit.client.3.smithi157.stdout:myimage49 6/s 6/s 174 KiB/s 210 KiB/s 1.54 ms 363.97 us 2024-03-26T17:04:18.219 INFO:tasks.workunit.client.3.smithi157.stdout:myimage45 6/s 6/s 232 KiB/s 216 KiB/s 1.51 ms 311.12 us 2024-03-26T17:04:18.219 INFO:tasks.workunit.client.3.smithi157.stdout:myimage10 6/s 6/s 203 KiB/s 192 KiB/s 1.52 ms 345.02 us 2024-03-26T17:04:18.219 INFO:tasks.workunit.client.3.smithi157.stdout:myimage3 6/s 5/s 225 KiB/s 166 KiB/s 1.39 ms 301.68 us 2024-03-26T17:04:18.219 INFO:tasks.workunit.client.3.smithi157.stdout:myimage30 6/s 5/s 180 KiB/s 175 KiB/s 1.74 ms 316.16 us 2024-03-26T17:04:18.219 INFO:tasks.workunit.client.3.smithi157.stdout:myimage35 6/s 6/s 162 KiB/s 167 KiB/s 1.63 ms 266.80 us 2024-03-26T17:04:18.219 INFO:tasks.workunit.client.3.smithi157.stdout:myimage48 6/s 6/s 199 KiB/s 182 KiB/s 1.48 ms 369.99 us 2024-03-26T17:04:18.219 INFO:tasks.workunit.client.3.smithi157.stdout:myimage15 6/s 5/s 214 KiB/s 146 KiB/s 1.43 ms 317.33 us 2024-03-26T17:04:18.219 INFO:tasks.workunit.client.3.smithi157.stdout:myimage17 6/s 4/s 211 KiB/s 95 KiB/s 1.56 ms 314.86 us 2024-03-26T17:04:18.219 INFO:tasks.workunit.client.3.smithi157.stdout:myimage19 6/s 6/s 214 KiB/s 199 KiB/s 1.51 ms 366.52 us 2024-03-26T17:04:18.219 INFO:tasks.workunit.client.3.smithi157.stdout:myimage20 6/s 6/s 179 KiB/s 212 KiB/s 1.50 ms 361.68 us 2024-03-26T17:04:18.219 INFO:tasks.workunit.client.3.smithi157.stdout:myimage42 6/s 4/s 179 KiB/s 143 KiB/s 1.50 ms 381.46 us 2024-03-26T17:04:18.219 INFO:tasks.workunit.client.3.smithi157.stdout:myimage53 6/s 5/s 226 KiB/s 126 KiB/s 1.52 ms 273.44 us 2024-03-26T17:04:18.220 INFO:tasks.workunit.client.3.smithi157.stdout:myimage55 6/s 6/s 199 KiB/s 148 KiB/s 1.59 ms 323.79 us 2024-03-26T17:04:18.220 INFO:tasks.workunit.client.3.smithi157.stdout:myimage23 6/s 6/s 174 KiB/s 205 KiB/s 1.43 ms 363.42 us 2024-03-26T17:04:18.220 INFO:tasks.workunit.client.3.smithi157.stdout:myimage52 6/s 6/s 190 KiB/s 209 KiB/s 1.66 ms 310.73 us 2024-03-26T17:04:18.220 INFO:tasks.workunit.client.3.smithi157.stdout:myimage56 6/s 6/s 200 KiB/s 164 KiB/s 1.73 ms 362.07 us 2024-03-26T17:04:18.220 INFO:tasks.workunit.client.3.smithi157.stdout:myimage59 6/s 5/s 182 KiB/s 156 KiB/s 1.58 ms 330.66 us 2024-03-26T17:04:18.220 INFO:tasks.workunit.client.3.smithi157.stdout:myimage6 6/s 4/s 201 KiB/s 134 KiB/s 1.62 ms 332.96 us 2024-03-26T17:04:18.220 INFO:tasks.workunit.client.3.smithi157.stdout:myimage43 6/s 4/s 181 KiB/s 129 KiB/s 1.62 ms 361.25 us 2024-03-26T17:04:18.220 INFO:tasks.workunit.client.3.smithi157.stdout:myimage51 6/s 6/s 160 KiB/s 188 KiB/s 1.56 ms 404.24 us 2024-03-26T17:04:18.220 INFO:tasks.workunit.client.3.smithi157.stdout:myimage57 6/s 5/s 159 KiB/s 181 KiB/s 1.53 ms 291.05 us 2024-03-26T17:04:18.220 INFO:tasks.workunit.client.3.smithi157.stdout:myimage2 5/s 7/s 133 KiB/s 230 KiB/s 1.63 ms 420.68 us 2024-03-26T17:04:18.220 INFO:tasks.workunit.client.3.smithi157.stdout:myimage13 5/s 4/s 181 KiB/s 159 KiB/s 1.47 ms 359.75 us 2024-03-26T17:04:18.220 INFO:tasks.workunit.client.3.smithi157.stdout:myimage44 5/s 6/s 232 KiB/s 192 KiB/s 1.63 ms 325.68 us 2024-03-26T17:04:18.220 INFO:tasks.workunit.client.3.smithi157.stdout:myimage58 5/s 5/s 166 KiB/s 158 KiB/s 1.52 ms 298.04 us 2024-03-26T17:04:18.221 INFO:tasks.workunit.client.3.smithi157.stdout:myimage21 5/s 6/s 178 KiB/s 184 KiB/s 1.78 ms 324.34 us 2024-03-26T17:04:18.221 INFO:tasks.workunit.client.3.smithi157.stdout:myimage26 5/s 6/s 158 KiB/s 188 KiB/s 1.60 ms 373.28 us 2024-03-26T17:04:18.221 INFO:tasks.workunit.client.3.smithi157.stdout:myimage28 5/s 6/s 226 KiB/s 200 KiB/s 1.72 ms 324.92 us 2024-03-26T17:04:18.221 INFO:tasks.workunit.client.3.smithi157.stdout:myimage29 5/s 5/s 188 KiB/s 147 KiB/s 1.46 ms 316.69 us 2024-03-26T17:04:18.221 INFO:tasks.workunit.client.3.smithi157.stdout:myimage54 5/s 5/s 162 KiB/s 182 KiB/s 1.51 ms 446.62 us 2024-03-26T17:04:18.221 INFO:tasks.workunit.client.3.smithi157.stdout:myimage60 5/s 5/s 174 KiB/s 177 KiB/s 1.59 ms 380.59 us 2024-03-26T17:04:18.221 INFO:tasks.workunit.client.3.smithi157.stdout:myimage16 5/s 5/s 163 KiB/s 140 KiB/s 1.52 ms 304.20 us 2024-03-26T17:04:18.221 INFO:tasks.workunit.client.3.smithi157.stdout:myimage38 5/s 4/s 198 KiB/s 129 KiB/s 1.40 ms 289.31 us 2024-03-26T17:04:18.221 INFO:tasks.workunit.client.3.smithi157.stdout:myimage18 5/s 5/s 184 KiB/s 149 KiB/s 1.56 ms 321.44 us 2024-03-26T17:04:18.221 INFO:tasks.workunit.client.3.smithi157.stdout:myimage46 5/s 6/s 194 KiB/s 178 KiB/s 1.53 ms 354.49 us 2024-03-26T17:04:18.221 INFO:tasks.workunit.client.3.smithi157.stdout:myimage14 5/s 6/s 170 KiB/s 167 KiB/s 1.63 ms 316.62 us 2024-03-26T17:04:18.221 INFO:tasks.workunit.client.3.smithi157.stdout:myimage31 5/s 5/s 195 KiB/s 188 KiB/s 1.53 ms 326.05 us 2024-03-26T17:04:18.221 INFO:tasks.workunit.client.3.smithi157.stdout:myimage40 5/s 7/s 164 KiB/s 256 KiB/s 1.47 ms 397.90 us 2024-03-26T17:04:18.221 INFO:tasks.workunit.client.3.smithi157.stdout:myimage11 5/s 6/s 151 KiB/s 159 KiB/s 1.46 ms 292.02 us 2024-03-26T17:04:18.222 INFO:tasks.workunit.client.3.smithi157.stdout:myimage25 5/s 6/s 167 KiB/s 172 KiB/s 1.81 ms 396.30 us 2024-03-26T17:04:18.222 INFO:tasks.workunit.client.3.smithi157.stdout:myimage22 5/s 7/s 158 KiB/s 212 KiB/s 1.50 ms 305.96 us 2024-03-26T17:04:18.222 INFO:tasks.workunit.client.3.smithi157.stdout:myimage5 5/s 5/s 146 KiB/s 138 KiB/s 1.48 ms 277.34 us 2024-03-26T17:04:18.222 INFO:tasks.workunit.client.3.smithi157.stdout:myimage4 4/s 6/s 152 KiB/s 182 KiB/s 1.49 ms 291.28 us 2024-03-26T17:04:18.222 INFO:tasks.workunit.client.3.smithi157.stdout:myimage36 4/s 5/s 162 KiB/s 163 KiB/s 1.54 ms 309.74 us 2024-03-26T17:04:18.222 INFO:tasks.workunit.client.3.smithi157.stdout:myimage41 4/s 6/s 117 KiB/s 220 KiB/s 1.53 ms 364.35 us 2024-03-26T17:04:18.222 INFO:tasks.workunit.client.3.smithi157.stdout:myimage50 4/s 7/s 166 KiB/s 208 KiB/s 1.67 ms 337.77 us 2024-03-26T17:04:18.222 INFO:tasks.workunit.client.3.smithi157.stdout:myimage33 4/s 8/s 138 KiB/s 210 KiB/s 1.50 ms 297.67 us 2024-03-26T17:04:18.222 INFO:tasks.workunit.client.3.smithi157.stdout:myimage34 4/s 7/s 134 KiB/s 224 KiB/s 1.52 ms 324.72 us 2024-03-26T17:04:18.222 INFO:tasks.workunit.client.3.smithi157.stdout:myimage47 4/s 7/s 145 KiB/s 213 KiB/s 1.71 ms 336.58 us 2024-03-26T17:04:18.222 INFO:tasks.workunit.client.3.smithi157.stdout:myimage8 4/s 8/s 129 KiB/s 258 KiB/s 1.59 ms 368.30 us 2024-03-26T17:04:18.222 INFO:tasks.workunit.client.3.smithi157.stdout:myimage9 3/s 7/s 104 KiB/s 203 KiB/s 1.55 ms 272.19 us 2024-03-26T17:04:18.222 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:04:19.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:04:19 smithi044 ceph-mon[30624]: pgmap v550: 33 pgs: 33 active+clean; 1023 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 9.7 MiB/s rd, 9.9 MiB/s wr, 697 op/s 2024-03-26T17:04:19.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:04:19 smithi044 ceph-mon[30624]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:04:19.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:04:19 smithi044 ceph-mon[30624]: { 2024-03-26T17:04:19.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:04:19 smithi044 ceph-mon[30624]: "prefix": "rbd perf image stats", 2024-03-26T17:04:19.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:04:19 smithi044 ceph-mon[30624]: "pool_spec": "mypool", 2024-03-26T17:04:19.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:04:19 smithi044 ceph-mon[30624]: "sort_by": "write_ops", 2024-03-26T17:04:19.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:04:19 smithi044 ceph-mon[30624]: "format": "json" 2024-03-26T17:04:19.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:04:19 smithi044 ceph-mon[30624]: }"]: dispatch 2024-03-26T17:04:19.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:04:19 smithi044 ceph-mon[30624]: Health check update: 3 slow ops, oldest one blocked for 353 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:04:19.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:04:19 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:04:19] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:04:19.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:04:19 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:04:19] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:04:19.517 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:04:19 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:04:19.551 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:04:19 smithi149 ceph-mon[34678]: pgmap v550: 33 pgs: 33 active+clean; 1023 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 9.7 MiB/s rd, 9.9 MiB/s wr, 697 op/s 2024-03-26T17:04:19.551 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:04:19 smithi149 ceph-mon[34678]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:04:19.551 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:04:19 smithi149 ceph-mon[34678]: { 2024-03-26T17:04:19.551 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:04:19 smithi149 ceph-mon[34678]: "prefix": "rbd perf image stats", 2024-03-26T17:04:19.551 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:04:19 smithi149 ceph-mon[34678]: "pool_spec": "mypool", 2024-03-26T17:04:19.551 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:04:19 smithi149 ceph-mon[34678]: "sort_by": "write_ops", 2024-03-26T17:04:19.551 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:04:19 smithi149 ceph-mon[34678]: "format": "json" 2024-03-26T17:04:19.552 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:04:19 smithi149 ceph-mon[34678]: }"]: dispatch 2024-03-26T17:04:19.552 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:04:19 smithi149 ceph-mon[34678]: Health check update: 3 slow ops, oldest one blocked for 353 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:04:19.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:04:19 smithi064 ceph-mon[34420]: pgmap v550: 33 pgs: 33 active+clean; 1023 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 9.7 MiB/s rd, 9.9 MiB/s wr, 697 op/s 2024-03-26T17:04:19.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:04:19 smithi064 ceph-mon[34420]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:04:19.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:04:19 smithi064 ceph-mon[34420]: { 2024-03-26T17:04:19.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:04:19 smithi064 ceph-mon[34420]: "prefix": "rbd perf image stats", 2024-03-26T17:04:19.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:04:19 smithi064 ceph-mon[34420]: "pool_spec": "mypool", 2024-03-26T17:04:19.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:04:19 smithi064 ceph-mon[34420]: "sort_by": "write_ops", 2024-03-26T17:04:19.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:04:19 smithi064 ceph-mon[34420]: "format": "json" 2024-03-26T17:04:19.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:04:19 smithi064 ceph-mon[34420]: }"]: dispatch 2024-03-26T17:04:19.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:04:19 smithi064 ceph-mon[34420]: Health check update: 3 slow ops, oldest one blocked for 353 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:04:19.897 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:04:19 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:04:19] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:04:19.897 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:04:19 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:04:19] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:04:19.897 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:04:19 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:04:21.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:04:21 smithi044 ceph-mon[30624]: pgmap v551: 33 pgs: 33 active+clean; 1023 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 10 MiB/s rd, 11 MiB/s wr, 734 op/s 2024-03-26T17:04:21.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:04:21 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:04:21] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:04:21.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:04:21 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:04:21] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:04:21.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:04:21 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:04:21.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:04:21 smithi064 ceph-mon[34420]: pgmap v551: 33 pgs: 33 active+clean; 1023 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 10 MiB/s rd, 11 MiB/s wr, 734 op/s 2024-03-26T17:04:21.566 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:04:21 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 2024-03-26T17:04:21.219+0000 7fa707a55700 -1 mon.c@1(peon) e3 get_health_metrics reporting 3 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T17:04:21.566 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:04:21 smithi149 ceph-mon[34678]: pgmap v551: 33 pgs: 33 active+clean; 1023 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 10 MiB/s rd, 11 MiB/s wr, 734 op/s 2024-03-26T17:04:21.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:04:21 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:04:21] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:04:21.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:04:21 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:04:21] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:04:21.897 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:04:21 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:04:23.061 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:04:23.069 INFO:tasks.workunit.client.3.smithi157.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2024-03-26T17:04:23.069 INFO:tasks.workunit.client.3.smithi157.stdout: 11.50 212.8k 108.4k 0.0k 2.1M 1.1M 0.0k nvme2n1 2024-03-26T17:04:23.069 INFO:tasks.workunit.client.3.smithi157.stdout: 11.60 194.8k 141.2k 0.0k 1.9M 1.4M 0.0k nvme2n10 2024-03-26T17:04:23.069 INFO:tasks.workunit.client.3.smithi157.stdout: 11.50 141.6k 158.0k 0.0k 1.4M 1.5M 0.0k nvme2n11 2024-03-26T17:04:23.069 INFO:tasks.workunit.client.3.smithi157.stdout: 11.50 165.2k 152.4k 0.0k 1.6M 1.5M 0.0k nvme2n12 2024-03-26T17:04:23.069 INFO:tasks.workunit.client.3.smithi157.stdout: 11.50 156.8k 197.6k 0.0k 1.5M 1.9M 0.0k nvme2n13 2024-03-26T17:04:23.069 INFO:tasks.workunit.client.3.smithi157.stdout: 11.50 150.8k 164.8k 0.0k 1.5M 1.6M 0.0k nvme2n14 2024-03-26T17:04:23.069 INFO:tasks.workunit.client.3.smithi157.stdout: 11.50 178.0k 174.0k 0.0k 1.7M 1.7M 0.0k nvme2n15 2024-03-26T17:04:23.070 INFO:tasks.workunit.client.3.smithi157.stdout: 11.50 182.8k 137.6k 0.0k 1.8M 1.3M 0.0k nvme2n16 2024-03-26T17:04:23.070 INFO:tasks.workunit.client.3.smithi157.stdout: 11.50 136.0k 200.8k 0.0k 1.3M 2.0M 0.0k nvme2n17 2024-03-26T17:04:23.070 INFO:tasks.workunit.client.3.smithi157.stdout: 11.50 164.0k 149.6k 0.0k 1.6M 1.5M 0.0k nvme2n18 2024-03-26T17:04:23.070 INFO:tasks.workunit.client.3.smithi157.stdout: 11.50 164.0k 187.6k 0.0k 1.6M 1.8M 0.0k nvme2n19 2024-03-26T17:04:23.070 INFO:tasks.workunit.client.3.smithi157.stdout: 11.50 144.8k 166.8k 0.0k 1.4M 1.6M 0.0k nvme2n2 2024-03-26T17:04:23.070 INFO:tasks.workunit.client.3.smithi157.stdout: 11.50 146.8k 156.4k 0.0k 1.4M 1.5M 0.0k nvme2n20 2024-03-26T17:04:23.070 INFO:tasks.workunit.client.3.smithi157.stdout: 11.50 171.6k 179.2k 0.0k 1.7M 1.8M 0.0k nvme2n3 2024-03-26T17:04:23.070 INFO:tasks.workunit.client.3.smithi157.stdout: 11.50 156.4k 179.6k 0.0k 1.5M 1.8M 0.0k nvme2n4 2024-03-26T17:04:23.070 INFO:tasks.workunit.client.3.smithi157.stdout: 11.50 154.8k 165.6k 0.0k 1.5M 1.6M 0.0k nvme2n5 2024-03-26T17:04:23.070 INFO:tasks.workunit.client.3.smithi157.stdout: 11.50 178.0k 185.6k 0.0k 1.7M 1.8M 0.0k nvme2n6 2024-03-26T17:04:23.070 INFO:tasks.workunit.client.3.smithi157.stdout: 11.50 144.8k 210.0k 0.0k 1.4M 2.1M 0.0k nvme2n7 2024-03-26T17:04:23.070 INFO:tasks.workunit.client.3.smithi157.stdout: 11.50 190.8k 160.4k 0.0k 1.9M 1.6M 0.0k nvme2n8 2024-03-26T17:04:23.070 INFO:tasks.workunit.client.3.smithi157.stdout: 11.50 178.4k 156.4k 0.0k 1.7M 1.5M 0.0k nvme2n9 2024-03-26T17:04:23.070 INFO:tasks.workunit.client.3.smithi157.stdout: 11.50 178.4k 150.8k 0.0k 1.7M 1.5M 0.0k nvme5n1 2024-03-26T17:04:23.071 INFO:tasks.workunit.client.3.smithi157.stdout: 11.50 183.2k 173.2k 0.0k 1.8M 1.7M 0.0k nvme5n10 2024-03-26T17:04:23.071 INFO:tasks.workunit.client.3.smithi157.stdout: 11.50 185.2k 172.8k 0.0k 1.8M 1.7M 0.0k nvme5n11 2024-03-26T17:04:23.071 INFO:tasks.workunit.client.3.smithi157.stdout: 11.50 137.2k 207.2k 0.0k 1.3M 2.0M 0.0k nvme5n12 2024-03-26T17:04:23.071 INFO:tasks.workunit.client.3.smithi157.stdout: 11.50 169.6k 140.4k 0.0k 1.7M 1.4M 0.0k nvme5n13 2024-03-26T17:04:23.071 INFO:tasks.workunit.client.3.smithi157.stdout: 11.50 196.8k 128.8k 0.0k 1.9M 1.3M 0.0k nvme5n14 2024-03-26T17:04:23.071 INFO:tasks.workunit.client.3.smithi157.stdout: 11.50 155.2k 147.2k 0.0k 1.5M 1.4M 0.0k nvme5n15 2024-03-26T17:04:23.071 INFO:tasks.workunit.client.3.smithi157.stdout: 11.50 158.0k 189.6k 0.0k 1.5M 1.9M 0.0k nvme5n16 2024-03-26T17:04:23.071 INFO:tasks.workunit.client.3.smithi157.stdout: 11.50 140.0k 198.0k 0.0k 1.4M 1.9M 0.0k nvme5n17 2024-03-26T17:04:23.071 INFO:tasks.workunit.client.3.smithi157.stdout: 11.50 183.6k 170.4k 0.0k 1.8M 1.7M 0.0k nvme5n18 2024-03-26T17:04:23.071 INFO:tasks.workunit.client.3.smithi157.stdout: 11.50 158.8k 184.8k 0.0k 1.6M 1.8M 0.0k nvme5n19 2024-03-26T17:04:23.071 INFO:tasks.workunit.client.3.smithi157.stdout: 11.50 166.4k 145.6k 0.0k 1.6M 1.4M 0.0k nvme5n2 2024-03-26T17:04:23.071 INFO:tasks.workunit.client.3.smithi157.stdout: 11.50 156.0k 200.4k 0.0k 1.5M 2.0M 0.0k nvme5n20 2024-03-26T17:04:23.072 INFO:tasks.workunit.client.3.smithi157.stdout: 11.50 183.6k 146.8k 0.0k 1.8M 1.4M 0.0k nvme5n3 2024-03-26T17:04:23.072 INFO:tasks.workunit.client.3.smithi157.stdout: 11.50 148.8k 181.2k 0.0k 1.5M 1.8M 0.0k nvme5n4 2024-03-26T17:04:23.072 INFO:tasks.workunit.client.3.smithi157.stdout: 11.50 171.2k 139.6k 0.0k 1.7M 1.4M 0.0k nvme5n5 2024-03-26T17:04:23.072 INFO:tasks.workunit.client.3.smithi157.stdout: 11.50 160.8k 129.6k 0.0k 1.6M 1.3M 0.0k nvme5n6 2024-03-26T17:04:23.072 INFO:tasks.workunit.client.3.smithi157.stdout: 11.50 173.6k 162.0k 0.0k 1.7M 1.6M 0.0k nvme5n7 2024-03-26T17:04:23.072 INFO:tasks.workunit.client.3.smithi157.stdout: 11.50 152.0k 168.4k 0.0k 1.5M 1.6M 0.0k nvme5n8 2024-03-26T17:04:23.072 INFO:tasks.workunit.client.3.smithi157.stdout: 11.50 177.2k 160.4k 0.0k 1.7M 1.6M 0.0k nvme5n9 2024-03-26T17:04:23.072 INFO:tasks.workunit.client.3.smithi157.stdout: 11.50 179.2k 157.2k 0.0k 1.8M 1.5M 0.0k nvme8n1 2024-03-26T17:04:23.072 INFO:tasks.workunit.client.3.smithi157.stdout: 11.60 151.2k 174.4k 0.0k 1.5M 1.7M 0.0k nvme8n10 2024-03-26T17:04:23.072 INFO:tasks.workunit.client.3.smithi157.stdout: 11.50 141.6k 172.8k 0.0k 1.4M 1.7M 0.0k nvme8n11 2024-03-26T17:04:23.072 INFO:tasks.workunit.client.3.smithi157.stdout: 11.50 204.0k 158.4k 0.0k 2.0M 1.5M 0.0k nvme8n12 2024-03-26T17:04:23.072 INFO:tasks.workunit.client.3.smithi157.stdout: 11.50 168.8k 172.4k 0.0k 1.6M 1.7M 0.0k nvme8n13 2024-03-26T17:04:23.072 INFO:tasks.workunit.client.3.smithi157.stdout: 11.50 192.0k 143.2k 0.0k 1.9M 1.4M 0.0k nvme8n14 2024-03-26T17:04:23.072 INFO:tasks.workunit.client.3.smithi157.stdout: 11.50 170.4k 145.2k 0.0k 1.7M 1.4M 0.0k nvme8n15 2024-03-26T17:04:23.072 INFO:tasks.workunit.client.3.smithi157.stdout: 11.50 165.6k 128.4k 0.0k 1.6M 1.3M 0.0k nvme8n16 2024-03-26T17:04:23.073 INFO:tasks.workunit.client.3.smithi157.stdout: 11.50 189.2k 158.0k 0.0k 1.8M 1.5M 0.0k nvme8n17 2024-03-26T17:04:23.073 INFO:tasks.workunit.client.3.smithi157.stdout: 11.50 133.6k 173.6k 0.0k 1.3M 1.7M 0.0k nvme8n18 2024-03-26T17:04:23.073 INFO:tasks.workunit.client.3.smithi157.stdout: 11.50 152.0k 165.6k 0.0k 1.5M 1.6M 0.0k nvme8n19 2024-03-26T17:04:23.073 INFO:tasks.workunit.client.3.smithi157.stdout: 11.50 136.0k 181.2k 0.0k 1.3M 1.8M 0.0k nvme8n2 2024-03-26T17:04:23.073 INFO:tasks.workunit.client.3.smithi157.stdout: 11.50 184.4k 144.0k 0.0k 1.8M 1.4M 0.0k nvme8n20 2024-03-26T17:04:23.073 INFO:tasks.workunit.client.3.smithi157.stdout: 11.50 180.4k 147.6k 0.0k 1.8M 1.4M 0.0k nvme8n3 2024-03-26T17:04:23.073 INFO:tasks.workunit.client.3.smithi157.stdout: 11.50 178.0k 185.2k 0.0k 1.7M 1.8M 0.0k nvme8n4 2024-03-26T17:04:23.073 INFO:tasks.workunit.client.3.smithi157.stdout: 11.50 165.2k 168.8k 0.0k 1.6M 1.6M 0.0k nvme8n5 2024-03-26T17:04:23.073 INFO:tasks.workunit.client.3.smithi157.stdout: 11.50 178.8k 160.4k 0.0k 1.7M 1.6M 0.0k nvme8n6 2024-03-26T17:04:23.073 INFO:tasks.workunit.client.3.smithi157.stdout: 11.50 158.8k 177.2k 0.0k 1.6M 1.7M 0.0k nvme8n7 2024-03-26T17:04:23.073 INFO:tasks.workunit.client.3.smithi157.stdout: 11.50 193.2k 143.2k 0.0k 1.9M 1.4M 0.0k nvme8n8 2024-03-26T17:04:23.073 INFO:tasks.workunit.client.3.smithi157.stdout: 11.50 194.4k 174.4k 0.0k 1.9M 1.7M 0.0k nvme8n9 2024-03-26T17:04:23.073 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:04:23.222 INFO:tasks.workunit.client.3.smithi157.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-26T17:04:23.222 INFO:tasks.workunit.client.3.smithi157.stdout:myimage42 7/s 4/s 223 KiB/s 101 KiB/s 1.48 ms 330.00 us 2024-03-26T17:04:23.222 INFO:tasks.workunit.client.3.smithi157.stdout:myimage47 7/s 4/s 194 KiB/s 139 KiB/s 1.59 ms 297.03 us 2024-03-26T17:04:23.222 INFO:tasks.workunit.client.3.smithi157.stdout:myimage13 7/s 4/s 201 KiB/s 156 KiB/s 1.48 ms 413.20 us 2024-03-26T17:04:23.222 INFO:tasks.workunit.client.3.smithi157.stdout:myimage40 7/s 4/s 221 KiB/s 110 KiB/s 1.51 ms 307.48 us 2024-03-26T17:04:23.222 INFO:tasks.workunit.client.3.smithi157.stdout:myimage28 6/s 4/s 161 KiB/s 95 KiB/s 1.74 ms 573.09 us 2024-03-26T17:04:23.222 INFO:tasks.workunit.client.3.smithi157.stdout:myimage37 6/s 4/s 188 KiB/s 136 KiB/s 1.54 ms 374.77 us 2024-03-26T17:04:23.222 INFO:tasks.workunit.client.3.smithi157.stdout:myimage38 6/s 6/s 172 KiB/s 190 KiB/s 1.42 ms 327.09 us 2024-03-26T17:04:23.222 INFO:tasks.workunit.client.3.smithi157.stdout:myimage11 6/s 6/s 203 KiB/s 175 KiB/s 1.67 ms 320.93 us 2024-03-26T17:04:23.222 INFO:tasks.workunit.client.3.smithi157.stdout:myimage20 6/s 6/s 152 KiB/s 166 KiB/s 1.46 ms 305.58 us 2024-03-26T17:04:23.222 INFO:tasks.workunit.client.3.smithi157.stdout:myimage24 6/s 4/s 174 KiB/s 154 KiB/s 1.59 ms 331.35 us 2024-03-26T17:04:23.223 INFO:tasks.workunit.client.3.smithi157.stdout:myimage22 6/s 5/s 151 KiB/s 182 KiB/s 1.54 ms 306.58 us 2024-03-26T17:04:23.223 INFO:tasks.workunit.client.3.smithi157.stdout:myimage52 6/s 5/s 164 KiB/s 182 KiB/s 1.66 ms 322.38 us 2024-03-26T17:04:23.223 INFO:tasks.workunit.client.3.smithi157.stdout:myimage8 6/s 5/s 175 KiB/s 161 KiB/s 1.59 ms 311.12 us 2024-03-26T17:04:23.223 INFO:tasks.workunit.client.3.smithi157.stdout:myimage17 6/s 5/s 185 KiB/s 177 KiB/s 1.55 ms 383.67 us 2024-03-26T17:04:23.223 INFO:tasks.workunit.client.3.smithi157.stdout:myimage19 6/s 5/s 193 KiB/s 150 KiB/s 1.56 ms 359.32 us 2024-03-26T17:04:23.223 INFO:tasks.workunit.client.3.smithi157.stdout:myimage49 6/s 5/s 184 KiB/s 168 KiB/s 1.50 ms 315.20 us 2024-03-26T17:04:23.223 INFO:tasks.workunit.client.3.smithi157.stdout:myimage7 6/s 4/s 180 KiB/s 126 KiB/s 1.59 ms 336.07 us 2024-03-26T17:04:23.223 INFO:tasks.workunit.client.3.smithi157.stdout:myimage12 6/s 5/s 184 KiB/s 131 KiB/s 1.60 ms 365.27 us 2024-03-26T17:04:23.223 INFO:tasks.workunit.client.3.smithi157.stdout:myimage43 6/s 6/s 172 KiB/s 187 KiB/s 1.68 ms 320.40 us 2024-03-26T17:04:23.223 INFO:tasks.workunit.client.3.smithi157.stdout:myimage45 6/s 5/s 186 KiB/s 156 KiB/s 1.55 ms 285.07 us 2024-03-26T17:04:23.223 INFO:tasks.workunit.client.3.smithi157.stdout:myimage32 6/s 5/s 173 KiB/s 162 KiB/s 1.67 ms 402.08 us 2024-03-26T17:04:23.223 INFO:tasks.workunit.client.3.smithi157.stdout:myimage48 6/s 5/s 143 KiB/s 170 KiB/s 1.57 ms 320.70 us 2024-03-26T17:04:23.223 INFO:tasks.workunit.client.3.smithi157.stdout:myimage58 6/s 5/s 167 KiB/s 155 KiB/s 1.44 ms 462.39 us 2024-03-26T17:04:23.224 INFO:tasks.workunit.client.3.smithi157.stdout:myimage4 6/s 5/s 162 KiB/s 138 KiB/s 1.62 ms 284.92 us 2024-03-26T17:04:23.224 INFO:tasks.workunit.client.3.smithi157.stdout:myimage41 6/s 5/s 189 KiB/s 149 KiB/s 1.65 ms 408.40 us 2024-03-26T17:04:23.224 INFO:tasks.workunit.client.3.smithi157.stdout:myimage30 5/s 6/s 203 KiB/s 204 KiB/s 1.72 ms 332.53 us 2024-03-26T17:04:23.224 INFO:tasks.workunit.client.3.smithi157.stdout:myimage31 5/s 6/s 153 KiB/s 180 KiB/s 1.78 ms 382.32 us 2024-03-26T17:04:23.224 INFO:tasks.workunit.client.3.smithi157.stdout:myimage5 5/s 7/s 158 KiB/s 196 KiB/s 1.51 ms 320.55 us 2024-03-26T17:04:23.224 INFO:tasks.workunit.client.3.smithi157.stdout:myimage6 5/s 5/s 202 KiB/s 182 KiB/s 1.49 ms 326.92 us 2024-03-26T17:04:23.224 INFO:tasks.workunit.client.3.smithi157.stdout:myimage10 5/s 4/s 160 KiB/s 136 KiB/s 1.49 ms 313.52 us 2024-03-26T17:04:23.224 INFO:tasks.workunit.client.3.smithi157.stdout:myimage9 5/s 6/s 204 KiB/s 169 KiB/s 1.65 ms 321.02 us 2024-03-26T17:04:23.224 INFO:tasks.workunit.client.3.smithi157.stdout:myimage33 5/s 6/s 158 KiB/s 160 KiB/s 1.56 ms 413.81 us 2024-03-26T17:04:23.224 INFO:tasks.workunit.client.3.smithi157.stdout:myimage51 5/s 4/s 146 KiB/s 113 KiB/s 1.71 ms 293.77 us 2024-03-26T17:04:23.224 INFO:tasks.workunit.client.3.smithi157.stdout:myimage53 5/s 6/s 152 KiB/s 176 KiB/s 1.48 ms 310.86 us 2024-03-26T17:04:23.224 INFO:tasks.workunit.client.3.smithi157.stdout:myimage57 5/s 8/s 166 KiB/s 206 KiB/s 1.57 ms 289.25 us 2024-03-26T17:04:23.224 INFO:tasks.workunit.client.3.smithi157.stdout:myimage59 5/s 5/s 146 KiB/s 154 KiB/s 1.60 ms 334.96 us 2024-03-26T17:04:23.224 INFO:tasks.workunit.client.3.smithi157.stdout:myimage2 5/s 4/s 162 KiB/s 123 KiB/s 1.50 ms 339.73 us 2024-03-26T17:04:23.224 INFO:tasks.workunit.client.3.smithi157.stdout:myimage14 5/s 5/s 141 KiB/s 154 KiB/s 1.60 ms 343.09 us 2024-03-26T17:04:23.225 INFO:tasks.workunit.client.3.smithi157.stdout:myimage16 5/s 6/s 146 KiB/s 207 KiB/s 1.61 ms 314.27 us 2024-03-26T17:04:23.225 INFO:tasks.workunit.client.3.smithi157.stdout:myimage18 5/s 5/s 157 KiB/s 164 KiB/s 1.47 ms 319.38 us 2024-03-26T17:04:23.225 INFO:tasks.workunit.client.3.smithi157.stdout:myimage50 5/s 5/s 145 KiB/s 139 KiB/s 1.54 ms 282.36 us 2024-03-26T17:04:23.225 INFO:tasks.workunit.client.3.smithi157.stdout:myimage25 5/s 6/s 164 KiB/s 159 KiB/s 1.74 ms 305.97 us 2024-03-26T17:04:23.225 INFO:tasks.workunit.client.3.smithi157.stdout:myimage26 5/s 5/s 114 KiB/s 138 KiB/s 1.53 ms 324.13 us 2024-03-26T17:04:23.225 INFO:tasks.workunit.client.3.smithi157.stdout:myimage27 5/s 5/s 170 KiB/s 167 KiB/s 1.48 ms 282.94 us 2024-03-26T17:04:23.225 INFO:tasks.workunit.client.3.smithi157.stdout:myimage36 5/s 7/s 186 KiB/s 187 KiB/s 1.48 ms 331.95 us 2024-03-26T17:04:23.225 INFO:tasks.workunit.client.3.smithi157.stdout:myimage56 5/s 6/s 128 KiB/s 186 KiB/s 1.70 ms 329.63 us 2024-03-26T17:04:23.225 INFO:tasks.workunit.client.3.smithi157.stdout:myimage60 5/s 7/s 122 KiB/s 208 KiB/s 1.58 ms 308.37 us 2024-03-26T17:04:23.225 INFO:tasks.workunit.client.3.smithi157.stdout:myimage35 5/s 4/s 146 KiB/s 133 KiB/s 1.54 ms 299.29 us 2024-03-26T17:04:23.225 INFO:tasks.workunit.client.3.smithi157.stdout:myimage15 5/s 5/s 115 KiB/s 159 KiB/s 1.45 ms 315.47 us 2024-03-26T17:04:23.225 INFO:tasks.workunit.client.3.smithi157.stdout:myimage54 5/s 7/s 127 KiB/s 210 KiB/s 1.44 ms 322.91 us 2024-03-26T17:04:23.225 INFO:tasks.workunit.client.3.smithi157.stdout:myimage3 4/s 6/s 160 KiB/s 187 KiB/s 1.43 ms 413.65 us 2024-03-26T17:04:23.225 INFO:tasks.workunit.client.3.smithi157.stdout:myimage23 4/s 6/s 114 KiB/s 192 KiB/s 1.37 ms 289.70 us 2024-03-26T17:04:23.225 INFO:tasks.workunit.client.3.smithi157.stdout:myimage21 4/s 7/s 147 KiB/s 181 KiB/s 1.86 ms 315.36 us 2024-03-26T17:04:23.226 INFO:tasks.workunit.client.3.smithi157.stdout:myimage39 4/s 5/s 138 KiB/s 162 KiB/s 1.58 ms 293.83 us 2024-03-26T17:04:23.226 INFO:tasks.workunit.client.3.smithi157.stdout:myimage44 4/s 6/s 110 KiB/s 183 KiB/s 1.59 ms 394.56 us 2024-03-26T17:04:23.226 INFO:tasks.workunit.client.3.smithi157.stdout:myimage1 4/s 7/s 127 KiB/s 203 KiB/s 1.39 ms 298.48 us 2024-03-26T17:04:23.226 INFO:tasks.workunit.client.3.smithi157.stdout:myimage34 4/s 6/s 129 KiB/s 154 KiB/s 1.54 ms 271.29 us 2024-03-26T17:04:23.226 INFO:tasks.workunit.client.3.smithi157.stdout:myimage29 4/s 7/s 119 KiB/s 203 KiB/s 1.47 ms 362.23 us 2024-03-26T17:04:23.226 INFO:tasks.workunit.client.3.smithi157.stdout:myimage55 4/s 7/s 152 KiB/s 161 KiB/s 1.70 ms 314.46 us 2024-03-26T17:04:23.226 INFO:tasks.workunit.client.3.smithi157.stdout:myimage46 3/s 7/s 99 KiB/s 191 KiB/s 1.61 ms 325.46 us 2024-03-26T17:04:23.226 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:04:23.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:04:23 smithi044 ceph-mon[30624]: pgmap v552: 33 pgs: 33 active+clean; 1023 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 9.3 MiB/s rd, 9.5 MiB/s wr, 647 op/s 2024-03-26T17:04:23.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:04:23 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:04:23] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:04:23.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:04:23 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:04:23] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:04:23.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:04:23 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:04:23.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:04:23 smithi064 ceph-mon[34420]: pgmap v552: 33 pgs: 33 active+clean; 1023 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 9.3 MiB/s rd, 9.5 MiB/s wr, 647 op/s 2024-03-26T17:04:23.582 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:04:23 smithi149 ceph-mon[34678]: pgmap v552: 33 pgs: 33 active+clean; 1023 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 9.3 MiB/s rd, 9.5 MiB/s wr, 647 op/s 2024-03-26T17:04:23.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:04:23 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:04:23] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:04:23.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:04:23 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:04:23] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:04:23.897 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:04:23 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:04:24.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:04:24 smithi064 ceph-mon[34420]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:04:24.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:04:24 smithi064 ceph-mon[34420]: { 2024-03-26T17:04:24.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:04:24 smithi064 ceph-mon[34420]: "prefix": "rbd perf image stats", 2024-03-26T17:04:24.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:04:24 smithi064 ceph-mon[34420]: "pool_spec": "mypool", 2024-03-26T17:04:24.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:04:24 smithi064 ceph-mon[34420]: "sort_by": "write_ops", 2024-03-26T17:04:24.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:04:24 smithi064 ceph-mon[34420]: "format": "json" 2024-03-26T17:04:24.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:04:24 smithi064 ceph-mon[34420]: }"]: dispatch 2024-03-26T17:04:24.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:04:24 smithi064 ceph-mon[34420]: Health check update: 3 slow ops, oldest one blocked for 358 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:04:24.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:04:24 smithi149 ceph-mon[34678]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:04:24.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:04:24 smithi149 ceph-mon[34678]: { 2024-03-26T17:04:24.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:04:24 smithi149 ceph-mon[34678]: "prefix": "rbd perf image stats", 2024-03-26T17:04:24.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:04:24 smithi149 ceph-mon[34678]: "pool_spec": "mypool", 2024-03-26T17:04:24.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:04:24 smithi149 ceph-mon[34678]: "sort_by": "write_ops", 2024-03-26T17:04:24.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:04:24 smithi149 ceph-mon[34678]: "format": "json" 2024-03-26T17:04:24.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:04:24 smithi149 ceph-mon[34678]: }"]: dispatch 2024-03-26T17:04:24.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:04:24 smithi149 ceph-mon[34678]: Health check update: 3 slow ops, oldest one blocked for 358 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:04:24.765 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:04:24 smithi044 ceph-mon[30624]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:04:24.765 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:04:24 smithi044 ceph-mon[30624]: { 2024-03-26T17:04:24.765 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:04:24 smithi044 ceph-mon[30624]: "prefix": "rbd perf image stats", 2024-03-26T17:04:24.765 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:04:24 smithi044 ceph-mon[30624]: "pool_spec": "mypool", 2024-03-26T17:04:24.765 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:04:24 smithi044 ceph-mon[30624]: "sort_by": "write_ops", 2024-03-26T17:04:24.765 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:04:24 smithi044 ceph-mon[30624]: "format": "json" 2024-03-26T17:04:24.765 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:04:24 smithi044 ceph-mon[30624]: }"]: dispatch 2024-03-26T17:04:24.765 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:04:24 smithi044 ceph-mon[30624]: Health check update: 3 slow ops, oldest one blocked for 358 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:04:25.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:04:25 smithi064 ceph-mon[34420]: pgmap v553: 33 pgs: 33 active+clean; 1023 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 11 MiB/s rd, 11 MiB/s wr, 751 op/s 2024-03-26T17:04:25.599 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:04:25 smithi149 ceph-mon[34678]: pgmap v553: 33 pgs: 33 active+clean; 1023 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 11 MiB/s rd, 11 MiB/s wr, 751 op/s 2024-03-26T17:04:25.666 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:04:25 smithi044 ceph-mon[30624]: pgmap v553: 33 pgs: 33 active+clean; 1023 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 11 MiB/s rd, 11 MiB/s wr, 751 op/s 2024-03-26T17:04:25.667 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:04:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:04:25] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:04:25.667 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:04:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:04:25] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:04:25.667 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:04:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:04:25.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:04:25 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:04:25] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:04:25.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:04:25 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:04:25] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:04:25.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:04:25 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:04:26.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:04:26 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 2024-03-26T17:04:26.219+0000 7fa707a55700 -1 mon.c@1(peon) e3 get_health_metrics reporting 3 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T17:04:27.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:04:27 smithi064 ceph-mon[34420]: pgmap v554: 33 pgs: 33 active+clean; 1023 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 9.2 MiB/s rd, 9.5 MiB/s wr, 673 op/s 2024-03-26T17:04:27.612 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:04:27 smithi149 ceph-mon[34678]: pgmap v554: 33 pgs: 33 active+clean; 1023 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 9.2 MiB/s rd, 9.5 MiB/s wr, 673 op/s 2024-03-26T17:04:27.765 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:04:27 smithi044 ceph-mon[30624]: pgmap v554: 33 pgs: 33 active+clean; 1023 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 9.2 MiB/s rd, 9.5 MiB/s wr, 673 op/s 2024-03-26T17:04:27.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:04:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:04:27] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:04:27.766 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:04:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:04:27] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:04:27.766 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:04:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:04:27.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:04:27 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:04:27] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:04:27.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:04:27 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:04:27] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:04:27.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:04:27 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:04:28.226 INFO:tasks.workunit.client.3.smithi157.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-26T17:04:28.226 INFO:tasks.workunit.client.3.smithi157.stdout:myimage59 7/s 4/s 188 KiB/s 104 KiB/s 1.62 ms 311.37 us 2024-03-26T17:04:28.226 INFO:tasks.workunit.client.3.smithi157.stdout:myimage40 7/s 4/s 206 KiB/s 121 KiB/s 1.53 ms 296.00 us 2024-03-26T17:04:28.226 INFO:tasks.workunit.client.3.smithi157.stdout:myimage50 7/s 5/s 190 KiB/s 137 KiB/s 1.57 ms 319.29 us 2024-03-26T17:04:28.226 INFO:tasks.workunit.client.3.smithi157.stdout:myimage4 7/s 5/s 214 KiB/s 160 KiB/s 1.54 ms 337.33 us 2024-03-26T17:04:28.226 INFO:tasks.workunit.client.3.smithi157.stdout:myimage7 7/s 4/s 203 KiB/s 93 KiB/s 1.62 ms 273.70 us 2024-03-26T17:04:28.226 INFO:tasks.workunit.client.3.smithi157.stdout:myimage44 6/s 5/s 200 KiB/s 130 KiB/s 1.60 ms 299.12 us 2024-03-26T17:04:28.226 INFO:tasks.workunit.client.3.smithi157.stdout:myimage21 6/s 4/s 179 KiB/s 148 KiB/s 1.83 ms 447.75 us 2024-03-26T17:04:28.226 INFO:tasks.workunit.client.3.smithi157.stdout:myimage2 6/s 4/s 198 KiB/s 110 KiB/s 1.65 ms 297.72 us 2024-03-26T17:04:28.227 INFO:tasks.workunit.client.3.smithi157.stdout:myimage20 6/s 4/s 169 KiB/s 124 KiB/s 1.50 ms 384.86 us 2024-03-26T17:04:28.227 INFO:tasks.workunit.client.3.smithi157.stdout:myimage35 6/s 4/s 169 KiB/s 141 KiB/s 1.59 ms 393.59 us 2024-03-26T17:04:28.227 INFO:tasks.workunit.client.3.smithi157.stdout:myimage29 6/s 5/s 202 KiB/s 162 KiB/s 1.46 ms 341.53 us 2024-03-26T17:04:28.227 INFO:tasks.workunit.client.3.smithi157.stdout:myimage42 6/s 6/s 154 KiB/s 171 KiB/s 1.49 ms 348.70 us 2024-03-26T17:04:28.227 INFO:tasks.workunit.client.3.smithi157.stdout:myimage53 6/s 4/s 202 KiB/s 118 KiB/s 1.49 ms 387.51 us 2024-03-26T17:04:28.227 INFO:tasks.workunit.client.3.smithi157.stdout:myimage13 6/s 4/s 180 KiB/s 117 KiB/s 1.52 ms 352.74 us 2024-03-26T17:04:28.227 INFO:tasks.workunit.client.3.smithi157.stdout:myimage23 6/s 4/s 182 KiB/s 106 KiB/s 1.38 ms 308.54 us 2024-03-26T17:04:28.227 INFO:tasks.workunit.client.3.smithi157.stdout:myimage6 6/s 5/s 168 KiB/s 134 KiB/s 1.64 ms 372.65 us 2024-03-26T17:04:28.227 INFO:tasks.workunit.client.3.smithi157.stdout:myimage8 6/s 4/s 162 KiB/s 122 KiB/s 1.61 ms 259.01 us 2024-03-26T17:04:28.227 INFO:tasks.workunit.client.3.smithi157.stdout:myimage27 6/s 5/s 177 KiB/s 148 KiB/s 1.46 ms 439.73 us 2024-03-26T17:04:28.227 INFO:tasks.workunit.client.3.smithi157.stdout:myimage22 6/s 5/s 152 KiB/s 126 KiB/s 1.56 ms 325.06 us 2024-03-26T17:04:28.227 INFO:tasks.workunit.client.3.smithi157.stdout:myimage30 6/s 5/s 151 KiB/s 154 KiB/s 1.82 ms 312.52 us 2024-03-26T17:04:28.227 INFO:tasks.workunit.client.3.smithi157.stdout:myimage38 6/s 6/s 186 KiB/s 171 KiB/s 1.46 ms 311.71 us 2024-03-26T17:04:28.228 INFO:tasks.workunit.client.3.smithi157.stdout:myimage47 6/s 5/s 179 KiB/s 120 KiB/s 1.58 ms 378.57 us 2024-03-26T17:04:28.228 INFO:tasks.workunit.client.3.smithi157.stdout:myimage49 6/s 4/s 137 KiB/s 104 KiB/s 1.59 ms 318.68 us 2024-03-26T17:04:28.228 INFO:tasks.workunit.client.3.smithi157.stdout:myimage24 6/s 5/s 152 KiB/s 114 KiB/s 1.58 ms 320.82 us 2024-03-26T17:04:28.228 INFO:tasks.workunit.client.3.smithi157.stdout:myimage36 6/s 4/s 182 KiB/s 131 KiB/s 1.57 ms 412.48 us 2024-03-26T17:04:28.228 INFO:tasks.workunit.client.3.smithi157.stdout:myimage39 6/s 5/s 188 KiB/s 152 KiB/s 1.46 ms 305.94 us 2024-03-26T17:04:28.228 INFO:tasks.workunit.client.3.smithi157.stdout:myimage51 6/s 5/s 162 KiB/s 151 KiB/s 1.65 ms 305.22 us 2024-03-26T17:04:28.228 INFO:tasks.workunit.client.3.smithi157.stdout:myimage56 6/s 5/s 162 KiB/s 122 KiB/s 1.73 ms 322.19 us 2024-03-26T17:04:28.228 INFO:tasks.workunit.client.3.smithi157.stdout:myimage32 5/s 5/s 206 KiB/s 136 KiB/s 1.58 ms 346.16 us 2024-03-26T17:04:28.228 INFO:tasks.workunit.client.3.smithi157.stdout:myimage37 5/s 5/s 162 KiB/s 122 KiB/s 1.61 ms 323.86 us 2024-03-26T17:04:28.228 INFO:tasks.workunit.client.3.smithi157.stdout:myimage15 5/s 5/s 157 KiB/s 156 KiB/s 1.50 ms 320.04 us 2024-03-26T17:04:28.228 INFO:tasks.workunit.client.3.smithi157.stdout:myimage34 5/s 6/s 154 KiB/s 172 KiB/s 1.58 ms 348.29 us 2024-03-26T17:04:28.228 INFO:tasks.workunit.client.3.smithi157.stdout:myimage58 5/s 5/s 134 KiB/s 126 KiB/s 1.53 ms 377.86 us 2024-03-26T17:04:28.228 INFO:tasks.workunit.client.3.smithi157.stdout:myimage17 5/s 5/s 137 KiB/s 95 KiB/s 1.56 ms 340.18 us 2024-03-26T17:04:28.228 INFO:tasks.workunit.client.3.smithi157.stdout:myimage18 5/s 5/s 139 KiB/s 136 KiB/s 1.56 ms 316.95 us 2024-03-26T17:04:28.229 INFO:tasks.workunit.client.3.smithi157.stdout:myimage55 5/s 6/s 138 KiB/s 150 KiB/s 1.62 ms 302.16 us 2024-03-26T17:04:28.229 INFO:tasks.workunit.client.3.smithi157.stdout:myimage52 5/s 6/s 145 KiB/s 200 KiB/s 1.71 ms 330.25 us 2024-03-26T17:04:28.229 INFO:tasks.workunit.client.3.smithi157.stdout:myimage11 5/s 5/s 135 KiB/s 142 KiB/s 1.64 ms 294.13 us 2024-03-26T17:04:28.229 INFO:tasks.workunit.client.3.smithi157.stdout:myimage10 5/s 6/s 122 KiB/s 196 KiB/s 1.56 ms 318.71 us 2024-03-26T17:04:28.229 INFO:tasks.workunit.client.3.smithi157.stdout:myimage48 5/s 4/s 142 KiB/s 114 KiB/s 1.51 ms 379.17 us 2024-03-26T17:04:28.229 INFO:tasks.workunit.client.3.smithi157.stdout:myimage5 5/s 4/s 143 KiB/s 114 KiB/s 1.50 ms 292.91 us 2024-03-26T17:04:28.229 INFO:tasks.workunit.client.3.smithi157.stdout:myimage12 5/s 5/s 124 KiB/s 141 KiB/s 1.55 ms 411.29 us 2024-03-26T17:04:28.229 INFO:tasks.workunit.client.3.smithi157.stdout:myimage43 5/s 5/s 111 KiB/s 152 KiB/s 1.61 ms 329.70 us 2024-03-26T17:04:28.229 INFO:tasks.workunit.client.3.smithi157.stdout:myimage31 5/s 5/s 131 KiB/s 146 KiB/s 1.73 ms 398.86 us 2024-03-26T17:04:28.229 INFO:tasks.workunit.client.3.smithi157.stdout:myimage28 5/s 5/s 133 KiB/s 162 KiB/s 1.81 ms 299.20 us 2024-03-26T17:04:28.229 INFO:tasks.workunit.client.3.smithi157.stdout:myimage33 5/s 5/s 134 KiB/s 145 KiB/s 1.68 ms 317.45 us 2024-03-26T17:04:28.229 INFO:tasks.workunit.client.3.smithi157.stdout:myimage46 5/s 6/s 153 KiB/s 135 KiB/s 1.51 ms 332.38 us 2024-03-26T17:04:28.229 INFO:tasks.workunit.client.3.smithi157.stdout:myimage14 4/s 5/s 137 KiB/s 122 KiB/s 1.64 ms 344.10 us 2024-03-26T17:04:28.230 INFO:tasks.workunit.client.3.smithi157.stdout:myimage16 4/s 6/s 129 KiB/s 139 KiB/s 1.48 ms 291.89 us 2024-03-26T17:04:28.230 INFO:tasks.workunit.client.3.smithi157.stdout:myimage9 4/s 6/s 117 KiB/s 165 KiB/s 1.61 ms 373.27 us 2024-03-26T17:04:28.230 INFO:tasks.workunit.client.3.smithi157.stdout:myimage19 4/s 5/s 148 KiB/s 194 KiB/s 1.63 ms 337.58 us 2024-03-26T17:04:28.230 INFO:tasks.workunit.client.3.smithi157.stdout:myimage41 4/s 5/s 134 KiB/s 162 KiB/s 1.61 ms 319.45 us 2024-03-26T17:04:28.230 INFO:tasks.workunit.client.3.smithi157.stdout:myimage60 4/s 5/s 142 KiB/s 136 KiB/s 1.62 ms 302.13 us 2024-03-26T17:04:28.230 INFO:tasks.workunit.client.3.smithi157.stdout:myimage26 4/s 7/s 116 KiB/s 191 KiB/s 1.58 ms 286.05 us 2024-03-26T17:04:28.230 INFO:tasks.workunit.client.3.smithi157.stdout:myimage45 4/s 6/s 134 KiB/s 198 KiB/s 1.60 ms 300.82 us 2024-03-26T17:04:28.230 INFO:tasks.workunit.client.3.smithi157.stdout:myimage54 4/s 6/s 104 KiB/s 180 KiB/s 1.48 ms 294.99 us 2024-03-26T17:04:28.230 INFO:tasks.workunit.client.3.smithi157.stdout:myimage57 4/s 5/s 158 KiB/s 159 KiB/s 1.56 ms 302.76 us 2024-03-26T17:04:28.230 INFO:tasks.workunit.client.3.smithi157.stdout:myimage3 4/s 7/s 108 KiB/s 182 KiB/s 1.38 ms 394.55 us 2024-03-26T17:04:28.230 INFO:tasks.workunit.client.3.smithi157.stdout:myimage25 4/s 5/s 95 KiB/s 139 KiB/s 1.83 ms 313.40 us 2024-03-26T17:04:28.230 INFO:tasks.workunit.client.3.smithi157.stdout:myimage1 3/s 8/s 74 KiB/s 212 KiB/s 1.45 ms 308.17 us 2024-03-26T17:04:28.230 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:04:29.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:04:29 smithi064 ceph-mon[34420]: pgmap v555: 33 pgs: 33 active+clean; 1023 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 9.0 MiB/s rd, 9.4 MiB/s wr, 678 op/s 2024-03-26T17:04:29.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:04:29 smithi064 ceph-mon[34420]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:04:29.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:04:29 smithi064 ceph-mon[34420]: { 2024-03-26T17:04:29.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:04:29 smithi064 ceph-mon[34420]: "prefix": "rbd perf image stats", 2024-03-26T17:04:29.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:04:29 smithi064 ceph-mon[34420]: "pool_spec": "mypool", 2024-03-26T17:04:29.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:04:29 smithi064 ceph-mon[34420]: "sort_by": "write_ops", 2024-03-26T17:04:29.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:04:29 smithi064 ceph-mon[34420]: "format": "json" 2024-03-26T17:04:29.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:04:29 smithi064 ceph-mon[34420]: }"]: dispatch 2024-03-26T17:04:29.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:04:29 smithi064 ceph-mon[34420]: Health check update: 3 slow ops, oldest one blocked for 363 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:04:29.624 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:04:29 smithi149 ceph-mon[34678]: pgmap v555: 33 pgs: 33 active+clean; 1023 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 9.0 MiB/s rd, 9.4 MiB/s wr, 678 op/s 2024-03-26T17:04:29.624 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:04:29 smithi149 ceph-mon[34678]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:04:29.624 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:04:29 smithi149 ceph-mon[34678]: { 2024-03-26T17:04:29.625 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:04:29 smithi149 ceph-mon[34678]: "prefix": "rbd perf image stats", 2024-03-26T17:04:29.625 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:04:29 smithi149 ceph-mon[34678]: "pool_spec": "mypool", 2024-03-26T17:04:29.625 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:04:29 smithi149 ceph-mon[34678]: "sort_by": "write_ops", 2024-03-26T17:04:29.625 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:04:29 smithi149 ceph-mon[34678]: "format": "json" 2024-03-26T17:04:29.625 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:04:29 smithi149 ceph-mon[34678]: }"]: dispatch 2024-03-26T17:04:29.625 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:04:29 smithi149 ceph-mon[34678]: Health check update: 3 slow ops, oldest one blocked for 363 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:04:29.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:04:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:04:29] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:04:29.766 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:04:29 smithi044 ceph-mon[30624]: pgmap v555: 33 pgs: 33 active+clean; 1023 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 9.0 MiB/s rd, 9.4 MiB/s wr, 678 op/s 2024-03-26T17:04:29.766 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:04:29 smithi044 ceph-mon[30624]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:04:29.766 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:04:29 smithi044 ceph-mon[30624]: { 2024-03-26T17:04:29.766 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:04:29 smithi044 ceph-mon[30624]: "prefix": "rbd perf image stats", 2024-03-26T17:04:29.766 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:04:29 smithi044 ceph-mon[30624]: "pool_spec": "mypool", 2024-03-26T17:04:29.766 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:04:29 smithi044 ceph-mon[30624]: "sort_by": "write_ops", 2024-03-26T17:04:29.766 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:04:29 smithi044 ceph-mon[30624]: "format": "json" 2024-03-26T17:04:29.766 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:04:29 smithi044 ceph-mon[30624]: }"]: dispatch 2024-03-26T17:04:29.766 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:04:29 smithi044 ceph-mon[30624]: Health check update: 3 slow ops, oldest one blocked for 363 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:04:29.766 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:04:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:04:29] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:04:29.767 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:04:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:04:29.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:04:29 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:04:29] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:04:29.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:04:29 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:04:29] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:04:29.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:04:29 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:04:31.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:04:31 smithi064 ceph-mon[34420]: pgmap v556: 33 pgs: 33 active+clean; 1023 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 9.1 MiB/s rd, 9.5 MiB/s wr, 709 op/s 2024-03-26T17:04:31.636 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:04:31 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 2024-03-26T17:04:31.220+0000 7fa707a55700 -1 mon.c@1(peon) e3 get_health_metrics reporting 3 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T17:04:31.636 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:04:31 smithi149 ceph-mon[34678]: pgmap v556: 33 pgs: 33 active+clean; 1023 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 9.1 MiB/s rd, 9.5 MiB/s wr, 709 op/s 2024-03-26T17:04:31.765 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:04:31 smithi044 ceph-mon[30624]: pgmap v556: 33 pgs: 33 active+clean; 1023 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 9.1 MiB/s rd, 9.5 MiB/s wr, 709 op/s 2024-03-26T17:04:31.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:04:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:04:31] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:04:31.766 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:04:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:04:31] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:04:31.766 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:04:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:04:31.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:04:31 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:04:31] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:04:31.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:04:31 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:04:31] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:04:31.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:04:31 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:04:33.061 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:04:33.068 INFO:tasks.workunit.client.3.smithi157.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2024-03-26T17:04:33.068 INFO:tasks.workunit.client.3.smithi157.stdout: 11.00 122.0k 134.8k 0.0k 1.2M 1.3M 0.0k nvme2n1 2024-03-26T17:04:33.069 INFO:tasks.workunit.client.3.smithi157.stdout: 10.90 133.2k 130.0k 0.0k 1.3M 1.3M 0.0k nvme2n10 2024-03-26T17:04:33.069 INFO:tasks.workunit.client.3.smithi157.stdout: 11.00 130.4k 148.4k 0.0k 1.3M 1.4M 0.0k nvme2n11 2024-03-26T17:04:33.069 INFO:tasks.workunit.client.3.smithi157.stdout: 11.00 150.8k 139.6k 0.0k 1.5M 1.4M 0.0k nvme2n12 2024-03-26T17:04:33.069 INFO:tasks.workunit.client.3.smithi157.stdout: 11.00 145.2k 143.2k 0.0k 1.4M 1.4M 0.0k nvme2n13 2024-03-26T17:04:33.069 INFO:tasks.workunit.client.3.smithi157.stdout: 11.00 127.2k 164.8k 0.0k 1.2M 1.6M 0.0k nvme2n14 2024-03-26T17:04:33.069 INFO:tasks.workunit.client.3.smithi157.stdout: 11.00 136.0k 120.0k 0.0k 1.3M 1.2M 0.0k nvme2n15 2024-03-26T17:04:33.069 INFO:tasks.workunit.client.3.smithi157.stdout: 11.00 149.6k 147.6k 0.0k 1.5M 1.4M 0.0k nvme2n16 2024-03-26T17:04:33.069 INFO:tasks.workunit.client.3.smithi157.stdout: 11.00 100.0k 168.4k 0.0k 1000.0k 1.6M 0.0k nvme2n17 2024-03-26T17:04:33.070 INFO:tasks.workunit.client.3.smithi157.stdout: 11.00 116.0k 149.2k 0.0k 1.1M 1.5M 0.0k nvme2n18 2024-03-26T17:04:33.070 INFO:tasks.workunit.client.3.smithi157.stdout: 11.00 180.8k 139.6k 0.0k 1.8M 1.4M 0.0k nvme2n19 2024-03-26T17:04:33.070 INFO:tasks.workunit.client.3.smithi157.stdout: 10.90 126.0k 154.4k 0.0k 1.2M 1.5M 0.0k nvme2n2 2024-03-26T17:04:33.070 INFO:tasks.workunit.client.3.smithi157.stdout: 11.00 138.4k 123.6k 0.0k 1.4M 1.2M 0.0k nvme2n20 2024-03-26T17:04:33.070 INFO:tasks.workunit.client.3.smithi157.stdout: 10.90 144.4k 133.2k 0.0k 1.4M 1.3M 0.0k nvme2n3 2024-03-26T17:04:33.070 INFO:tasks.workunit.client.3.smithi157.stdout: 10.90 138.0k 165.6k 0.0k 1.3M 1.6M 0.0k nvme2n4 2024-03-26T17:04:33.070 INFO:tasks.workunit.client.3.smithi157.stdout: 10.90 116.4k 144.0k 0.0k 1.1M 1.4M 0.0k nvme2n5 2024-03-26T17:04:33.070 INFO:tasks.workunit.client.3.smithi157.stdout: 10.90 130.4k 153.2k 0.0k 1.3M 1.5M 0.0k nvme2n6 2024-03-26T17:04:33.070 INFO:tasks.workunit.client.3.smithi157.stdout: 10.90 132.4k 122.8k 0.0k 1.3M 1.2M 0.0k nvme2n7 2024-03-26T17:04:33.070 INFO:tasks.workunit.client.3.smithi157.stdout: 10.90 106.4k 144.8k 0.0k 1.0M 1.4M 0.0k nvme2n8 2024-03-26T17:04:33.070 INFO:tasks.workunit.client.3.smithi157.stdout: 10.90 162.4k 127.6k 0.0k 1.6M 1.2M 0.0k nvme2n9 2024-03-26T17:04:33.070 INFO:tasks.workunit.client.3.smithi157.stdout: 11.00 164.4k 148.8k 0.0k 1.6M 1.5M 0.0k nvme5n1 2024-03-26T17:04:33.070 INFO:tasks.workunit.client.3.smithi157.stdout: 10.90 108.8k 154.8k 0.0k 1.1M 1.5M 0.0k nvme5n10 2024-03-26T17:04:33.071 INFO:tasks.workunit.client.3.smithi157.stdout: 11.00 132.4k 117.2k 0.0k 1.3M 1.1M 0.0k nvme5n11 2024-03-26T17:04:33.071 INFO:tasks.workunit.client.3.smithi157.stdout: 11.00 180.8k 136.0k 0.0k 1.8M 1.3M 0.0k nvme5n12 2024-03-26T17:04:33.071 INFO:tasks.workunit.client.3.smithi157.stdout: 11.00 162.4k 128.0k 0.0k 1.6M 1.2M 0.0k nvme5n13 2024-03-26T17:04:33.071 INFO:tasks.workunit.client.3.smithi157.stdout: 11.00 174.4k 128.4k 0.0k 1.7M 1.3M 0.0k nvme5n14 2024-03-26T17:04:33.071 INFO:tasks.workunit.client.3.smithi157.stdout: 11.00 133.6k 142.4k 0.0k 1.3M 1.4M 0.0k nvme5n15 2024-03-26T17:04:33.071 INFO:tasks.workunit.client.3.smithi157.stdout: 11.00 118.4k 177.6k 0.0k 1.2M 1.7M 0.0k nvme5n16 2024-03-26T17:04:33.071 INFO:tasks.workunit.client.3.smithi157.stdout: 11.00 124.0k 141.6k 0.0k 1.2M 1.4M 0.0k nvme5n17 2024-03-26T17:04:33.071 INFO:tasks.workunit.client.3.smithi157.stdout: 11.00 147.2k 149.6k 0.0k 1.4M 1.5M 0.0k nvme5n18 2024-03-26T17:04:33.071 INFO:tasks.workunit.client.3.smithi157.stdout: 11.00 146.4k 170.8k 0.0k 1.4M 1.7M 0.0k nvme5n19 2024-03-26T17:04:33.071 INFO:tasks.workunit.client.3.smithi157.stdout: 10.90 116.8k 142.4k 0.0k 1.1M 1.4M 0.0k nvme5n2 2024-03-26T17:04:33.071 INFO:tasks.workunit.client.3.smithi157.stdout: 11.00 118.0k 172.0k 0.0k 1.2M 1.7M 0.0k nvme5n20 2024-03-26T17:04:33.071 INFO:tasks.workunit.client.3.smithi157.stdout: 10.90 126.0k 170.8k 0.0k 1.2M 1.7M 0.0k nvme5n3 2024-03-26T17:04:33.071 INFO:tasks.workunit.client.3.smithi157.stdout: 10.90 107.2k 161.6k 0.0k 1.0M 1.6M 0.0k nvme5n4 2024-03-26T17:04:33.072 INFO:tasks.workunit.client.3.smithi157.stdout: 10.90 122.8k 128.8k 0.0k 1.2M 1.3M 0.0k nvme5n5 2024-03-26T17:04:33.072 INFO:tasks.workunit.client.3.smithi157.stdout: 10.90 155.2k 105.6k 0.0k 1.5M 1.0M 0.0k nvme5n6 2024-03-26T17:04:33.072 INFO:tasks.workunit.client.3.smithi157.stdout: 10.90 125.6k 174.0k 0.0k 1.2M 1.7M 0.0k nvme5n7 2024-03-26T17:04:33.072 INFO:tasks.workunit.client.3.smithi157.stdout: 10.90 142.4k 133.2k 0.0k 1.4M 1.3M 0.0k nvme5n8 2024-03-26T17:04:33.072 INFO:tasks.workunit.client.3.smithi157.stdout: 10.90 120.4k 135.6k 0.0k 1.2M 1.3M 0.0k nvme5n9 2024-03-26T17:04:33.072 INFO:tasks.workunit.client.3.smithi157.stdout: 11.00 134.8k 139.6k 0.0k 1.3M 1.4M 0.0k nvme8n1 2024-03-26T17:04:33.072 INFO:tasks.workunit.client.3.smithi157.stdout: 10.90 152.4k 98.4k 0.0k 1.5M 984.0k 0.0k nvme8n10 2024-03-26T17:04:33.072 INFO:tasks.workunit.client.3.smithi157.stdout: 11.00 140.8k 119.6k 0.0k 1.4M 1.2M 0.0k nvme8n11 2024-03-26T17:04:33.072 INFO:tasks.workunit.client.3.smithi157.stdout: 11.00 152.4k 154.8k 0.0k 1.5M 1.5M 0.0k nvme8n12 2024-03-26T17:04:33.072 INFO:tasks.workunit.client.3.smithi157.stdout: 11.00 144.8k 140.4k 0.0k 1.4M 1.4M 0.0k nvme8n13 2024-03-26T17:04:33.073 INFO:tasks.workunit.client.3.smithi157.stdout: 11.00 162.4k 112.0k 0.0k 1.6M 1.1M 0.0k nvme8n14 2024-03-26T17:04:33.073 INFO:tasks.workunit.client.3.smithi157.stdout: 11.00 126.4k 143.2k 0.0k 1.2M 1.4M 0.0k nvme8n15 2024-03-26T17:04:33.073 INFO:tasks.workunit.client.3.smithi157.stdout: 11.00 112.0k 183.6k 0.0k 1.1M 1.8M 0.0k nvme8n16 2024-03-26T17:04:33.073 INFO:tasks.workunit.client.3.smithi157.stdout: 11.00 108.0k 176.8k 0.0k 1.1M 1.7M 0.0k nvme8n17 2024-03-26T17:04:33.073 INFO:tasks.workunit.client.3.smithi157.stdout: 11.00 157.2k 118.0k 0.0k 1.5M 1.2M 0.0k nvme8n18 2024-03-26T17:04:33.073 INFO:tasks.workunit.client.3.smithi157.stdout: 11.00 130.8k 147.6k 0.0k 1.3M 1.4M 0.0k nvme8n19 2024-03-26T17:04:33.073 INFO:tasks.workunit.client.3.smithi157.stdout: 10.90 119.6k 168.4k 0.0k 1.2M 1.6M 0.0k nvme8n2 2024-03-26T17:04:33.073 INFO:tasks.workunit.client.3.smithi157.stdout: 11.00 138.0k 148.8k 0.0k 1.3M 1.5M 0.0k nvme8n20 2024-03-26T17:04:33.073 INFO:tasks.workunit.client.3.smithi157.stdout: 10.90 166.0k 132.8k 0.0k 1.6M 1.3M 0.0k nvme8n3 2024-03-26T17:04:33.073 INFO:tasks.workunit.client.3.smithi157.stdout: 10.90 138.8k 138.0k 0.0k 1.4M 1.3M 0.0k nvme8n4 2024-03-26T17:04:33.073 INFO:tasks.workunit.client.3.smithi157.stdout: 10.90 145.2k 156.8k 0.0k 1.4M 1.5M 0.0k nvme8n5 2024-03-26T17:04:33.073 INFO:tasks.workunit.client.3.smithi157.stdout: 10.90 122.8k 151.2k 0.0k 1.2M 1.5M 0.0k nvme8n6 2024-03-26T17:04:33.073 INFO:tasks.workunit.client.3.smithi157.stdout: 10.90 142.0k 138.0k 0.0k 1.4M 1.3M 0.0k nvme8n7 2024-03-26T17:04:33.074 INFO:tasks.workunit.client.3.smithi157.stdout: 10.90 153.6k 136.4k 0.0k 1.5M 1.3M 0.0k nvme8n8 2024-03-26T17:04:33.074 INFO:tasks.workunit.client.3.smithi157.stdout: 10.90 113.2k 168.0k 0.0k 1.1M 1.6M 0.0k nvme8n9 2024-03-26T17:04:33.074 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:04:33.230 INFO:tasks.workunit.client.3.smithi157.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-26T17:04:33.230 INFO:tasks.workunit.client.3.smithi157.stdout:myimage14 7/s 4/s 190 KiB/s 116 KiB/s 1.70 ms 337.20 us 2024-03-26T17:04:33.230 INFO:tasks.workunit.client.3.smithi157.stdout:myimage36 7/s 3/s 219 KiB/s 82 KiB/s 1.58 ms 306.62 us 2024-03-26T17:04:33.230 INFO:tasks.workunit.client.3.smithi157.stdout:myimage57 7/s 4/s 185 KiB/s 82 KiB/s 1.56 ms 259.43 us 2024-03-26T17:04:33.230 INFO:tasks.workunit.client.3.smithi157.stdout:myimage24 7/s 4/s 188 KiB/s 94 KiB/s 1.49 ms 282.41 us 2024-03-26T17:04:33.230 INFO:tasks.workunit.client.3.smithi157.stdout:myimage42 7/s 3/s 187 KiB/s 86 KiB/s 1.54 ms 414.93 us 2024-03-26T17:04:33.230 INFO:tasks.workunit.client.3.smithi157.stdout:myimage60 7/s 4/s 172 KiB/s 106 KiB/s 1.73 ms 296.04 us 2024-03-26T17:04:33.230 INFO:tasks.workunit.client.3.smithi157.stdout:myimage30 7/s 3/s 170 KiB/s 74 KiB/s 1.81 ms 273.03 us 2024-03-26T17:04:33.230 INFO:tasks.workunit.client.3.smithi157.stdout:myimage9 6/s 5/s 148 KiB/s 149 KiB/s 1.65 ms 378.94 us 2024-03-26T17:04:33.230 INFO:tasks.workunit.client.3.smithi157.stdout:myimage18 6/s 5/s 178 KiB/s 138 KiB/s 1.55 ms 343.62 us 2024-03-26T17:04:33.230 INFO:tasks.workunit.client.3.smithi157.stdout:myimage46 6/s 4/s 183 KiB/s 125 KiB/s 1.58 ms 445.38 us 2024-03-26T17:04:33.231 INFO:tasks.workunit.client.3.smithi157.stdout:myimage23 6/s 5/s 199 KiB/s 140 KiB/s 1.45 ms 280.86 us 2024-03-26T17:04:33.231 INFO:tasks.workunit.client.3.smithi157.stdout:myimage41 6/s 5/s 171 KiB/s 126 KiB/s 1.61 ms 297.21 us 2024-03-26T17:04:33.231 INFO:tasks.workunit.client.3.smithi157.stdout:myimage56 6/s 5/s 165 KiB/s 130 KiB/s 1.81 ms 349.29 us 2024-03-26T17:04:33.231 INFO:tasks.workunit.client.3.smithi157.stdout:myimage17 6/s 4/s 196 KiB/s 112 KiB/s 1.59 ms 332.10 us 2024-03-26T17:04:33.231 INFO:tasks.workunit.client.3.smithi157.stdout:myimage40 6/s 5/s 190 KiB/s 114 KiB/s 1.56 ms 315.17 us 2024-03-26T17:04:33.231 INFO:tasks.workunit.client.3.smithi157.stdout:myimage44 6/s 5/s 159 KiB/s 166 KiB/s 1.59 ms 374.29 us 2024-03-26T17:04:33.231 INFO:tasks.workunit.client.3.smithi157.stdout:myimage5 6/s 5/s 144 KiB/s 119 KiB/s 1.56 ms 315.32 us 2024-03-26T17:04:33.231 INFO:tasks.workunit.client.3.smithi157.stdout:myimage25 6/s 5/s 148 KiB/s 114 KiB/s 1.82 ms 311.59 us 2024-03-26T17:04:33.231 INFO:tasks.workunit.client.3.smithi157.stdout:myimage2 6/s 6/s 166 KiB/s 122 KiB/s 1.64 ms 293.09 us 2024-03-26T17:04:33.231 INFO:tasks.workunit.client.3.smithi157.stdout:myimage49 6/s 5/s 161 KiB/s 143 KiB/s 1.59 ms 327.08 us 2024-03-26T17:04:33.231 INFO:tasks.workunit.client.3.smithi157.stdout:myimage1 6/s 4/s 152 KiB/s 108 KiB/s 1.47 ms 289.59 us 2024-03-26T17:04:33.231 INFO:tasks.workunit.client.3.smithi157.stdout:myimage11 6/s 4/s 126 KiB/s 102 KiB/s 1.77 ms 427.44 us 2024-03-26T17:04:33.231 INFO:tasks.workunit.client.3.smithi157.stdout:myimage27 6/s 4/s 173 KiB/s 102 KiB/s 1.47 ms 338.41 us 2024-03-26T17:04:33.231 INFO:tasks.workunit.client.3.smithi157.stdout:myimage55 6/s 4/s 150 KiB/s 92 KiB/s 1.66 ms 288.26 us 2024-03-26T17:04:33.231 INFO:tasks.workunit.client.3.smithi157.stdout:myimage3 5/s 5/s 155 KiB/s 108 KiB/s 1.44 ms 316.37 us 2024-03-26T17:04:33.232 INFO:tasks.workunit.client.3.smithi157.stdout:myimage31 5/s 4/s 146 KiB/s 113 KiB/s 1.61 ms 378.04 us 2024-03-26T17:04:33.232 INFO:tasks.workunit.client.3.smithi157.stdout:myimage35 5/s 5/s 125 KiB/s 150 KiB/s 1.60 ms 329.51 us 2024-03-26T17:04:33.232 INFO:tasks.workunit.client.3.smithi157.stdout:myimage4 5/s 3/s 172 KiB/s 86 KiB/s 1.50 ms 305.25 us 2024-03-26T17:04:33.232 INFO:tasks.workunit.client.3.smithi157.stdout:myimage28 5/s 6/s 151 KiB/s 134 KiB/s 1.79 ms 346.47 us 2024-03-26T17:04:33.232 INFO:tasks.workunit.client.3.smithi157.stdout:myimage39 5/s 4/s 170 KiB/s 142 KiB/s 1.53 ms 320.94 us 2024-03-26T17:04:33.232 INFO:tasks.workunit.client.3.smithi157.stdout:myimage10 5/s 4/s 156 KiB/s 90 KiB/s 1.59 ms 303.03 us 2024-03-26T17:04:33.232 INFO:tasks.workunit.client.3.smithi157.stdout:myimage16 5/s 6/s 157 KiB/s 146 KiB/s 1.64 ms 312.41 us 2024-03-26T17:04:33.232 INFO:tasks.workunit.client.3.smithi157.stdout:myimage32 5/s 4/s 163 KiB/s 145 KiB/s 1.59 ms 361.14 us 2024-03-26T17:04:33.232 INFO:tasks.workunit.client.3.smithi157.stdout:myimage37 5/s 6/s 105 KiB/s 133 KiB/s 1.75 ms 319.48 us 2024-03-26T17:04:33.232 INFO:tasks.workunit.client.3.smithi157.stdout:myimage52 5/s 4/s 138 KiB/s 135 KiB/s 1.75 ms 298.31 us 2024-03-26T17:04:33.232 INFO:tasks.workunit.client.3.smithi157.stdout:myimage58 5/s 6/s 134 KiB/s 147 KiB/s 1.52 ms 317.79 us 2024-03-26T17:04:33.232 INFO:tasks.workunit.client.3.smithi157.stdout:myimage8 5/s 4/s 126 KiB/s 86 KiB/s 1.64 ms 268.94 us 2024-03-26T17:04:33.232 INFO:tasks.workunit.client.3.smithi157.stdout:myimage15 5/s 6/s 126 KiB/s 142 KiB/s 1.50 ms 350.50 us 2024-03-26T17:04:33.232 INFO:tasks.workunit.client.3.smithi157.stdout:myimage43 5/s 6/s 118 KiB/s 179 KiB/s 1.62 ms 359.32 us 2024-03-26T17:04:33.233 INFO:tasks.workunit.client.3.smithi157.stdout:myimage51 5/s 5/s 134 KiB/s 106 KiB/s 1.66 ms 265.13 us 2024-03-26T17:04:33.233 INFO:tasks.workunit.client.3.smithi157.stdout:myimage54 5/s 5/s 126 KiB/s 138 KiB/s 1.54 ms 312.41 us 2024-03-26T17:04:33.233 INFO:tasks.workunit.client.3.smithi157.stdout:myimage59 5/s 5/s 132 KiB/s 152 KiB/s 1.61 ms 346.54 us 2024-03-26T17:04:33.233 INFO:tasks.workunit.client.3.smithi157.stdout:myimage47 5/s 4/s 122 KiB/s 121 KiB/s 1.56 ms 332.82 us 2024-03-26T17:04:33.233 INFO:tasks.workunit.client.3.smithi157.stdout:myimage7 5/s 5/s 124 KiB/s 119 KiB/s 1.75 ms 287.65 us 2024-03-26T17:04:33.233 INFO:tasks.workunit.client.3.smithi157.stdout:myimage12 5/s 6/s 140 KiB/s 145 KiB/s 1.59 ms 353.61 us 2024-03-26T17:04:33.233 INFO:tasks.workunit.client.3.smithi157.stdout:myimage19 5/s 6/s 149 KiB/s 182 KiB/s 1.61 ms 355.68 us 2024-03-26T17:04:33.233 INFO:tasks.workunit.client.3.smithi157.stdout:myimage33 5/s 6/s 119 KiB/s 187 KiB/s 1.61 ms 321.12 us 2024-03-26T17:04:33.233 INFO:tasks.workunit.client.3.smithi157.stdout:myimage45 5/s 5/s 124 KiB/s 130 KiB/s 1.66 ms 367.90 us 2024-03-26T17:04:33.233 INFO:tasks.workunit.client.3.smithi157.stdout:myimage21 4/s 5/s 126 KiB/s 144 KiB/s 1.81 ms 352.89 us 2024-03-26T17:04:33.233 INFO:tasks.workunit.client.3.smithi157.stdout:myimage13 4/s 5/s 99 KiB/s 167 KiB/s 1.49 ms 427.56 us 2024-03-26T17:04:33.233 INFO:tasks.workunit.client.3.smithi157.stdout:myimage48 4/s 6/s 126 KiB/s 149 KiB/s 1.56 ms 302.35 us 2024-03-26T17:04:33.233 INFO:tasks.workunit.client.3.smithi157.stdout:myimage29 4/s 5/s 101 KiB/s 121 KiB/s 1.48 ms 300.89 us 2024-03-26T17:04:33.234 INFO:tasks.workunit.client.3.smithi157.stdout:myimage34 4/s 7/s 111 KiB/s 223 KiB/s 1.54 ms 302.11 us 2024-03-26T17:04:33.234 INFO:tasks.workunit.client.3.smithi157.stdout:myimage38 4/s 5/s 102 KiB/s 153 KiB/s 1.50 ms 330.02 us 2024-03-26T17:04:33.234 INFO:tasks.workunit.client.3.smithi157.stdout:myimage6 4/s 6/s 113 KiB/s 157 KiB/s 1.70 ms 331.92 us 2024-03-26T17:04:33.234 INFO:tasks.workunit.client.3.smithi157.stdout:myimage20 4/s 5/s 109 KiB/s 122 KiB/s 1.65 ms 290.90 us 2024-03-26T17:04:33.234 INFO:tasks.workunit.client.3.smithi157.stdout:myimage26 4/s 6/s 98 KiB/s 154 KiB/s 1.50 ms 336.62 us 2024-03-26T17:04:33.234 INFO:tasks.workunit.client.3.smithi157.stdout:myimage53 4/s 7/s 85 KiB/s 185 KiB/s 1.54 ms 293.62 us 2024-03-26T17:04:33.234 INFO:tasks.workunit.client.3.smithi157.stdout:myimage22 4/s 6/s 94 KiB/s 105 KiB/s 1.69 ms 278.53 us 2024-03-26T17:04:33.234 INFO:tasks.workunit.client.3.smithi157.stdout:myimage50 3/s 5/s 86 KiB/s 134 KiB/s 1.75 ms 318.43 us 2024-03-26T17:04:33.234 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:04:33.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:04:33 smithi064 ceph-mon[34420]: pgmap v557: 33 pgs: 33 active+clean; 1023 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 7.7 MiB/s rd, 8.1 MiB/s wr, 616 op/s 2024-03-26T17:04:33.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:04:33 smithi149 ceph-mon[34678]: pgmap v557: 33 pgs: 33 active+clean; 1023 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 7.7 MiB/s rd, 8.1 MiB/s wr, 616 op/s 2024-03-26T17:04:33.765 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:04:33 smithi044 ceph-mon[30624]: pgmap v557: 33 pgs: 33 active+clean; 1023 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 7.7 MiB/s rd, 8.1 MiB/s wr, 616 op/s 2024-03-26T17:04:33.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:04:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:04:33] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:04:33.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:04:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:04:33] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:04:33.766 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:04:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:04:34.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:04:33 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:04:33] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:04:34.147 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:04:33 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:04:33] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:04:34.147 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:04:33 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:04:34.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:04:34 smithi064 ceph-mon[34420]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:04:34.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:04:34 smithi064 ceph-mon[34420]: { 2024-03-26T17:04:34.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:04:34 smithi064 ceph-mon[34420]: "prefix": "rbd perf image stats", 2024-03-26T17:04:34.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:04:34 smithi064 ceph-mon[34420]: "pool_spec": "mypool", 2024-03-26T17:04:34.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:04:34 smithi064 ceph-mon[34420]: "sort_by": "write_ops", 2024-03-26T17:04:34.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:04:34 smithi064 ceph-mon[34420]: "format": "json" 2024-03-26T17:04:34.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:04:34 smithi064 ceph-mon[34420]: }"]: dispatch 2024-03-26T17:04:34.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:04:34 smithi064 ceph-mon[34420]: Health check update: 3 slow ops, oldest one blocked for 368 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:04:34.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:04:34 smithi149 ceph-mon[34678]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:04:34.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:04:34 smithi149 ceph-mon[34678]: { 2024-03-26T17:04:34.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:04:34 smithi149 ceph-mon[34678]: "prefix": "rbd perf image stats", 2024-03-26T17:04:34.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:04:34 smithi149 ceph-mon[34678]: "pool_spec": "mypool", 2024-03-26T17:04:34.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:04:34 smithi149 ceph-mon[34678]: "sort_by": "write_ops", 2024-03-26T17:04:34.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:04:34 smithi149 ceph-mon[34678]: "format": "json" 2024-03-26T17:04:34.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:04:34 smithi149 ceph-mon[34678]: }"]: dispatch 2024-03-26T17:04:34.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:04:34 smithi149 ceph-mon[34678]: Health check update: 3 slow ops, oldest one blocked for 368 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:04:34.765 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:04:34 smithi044 ceph-mon[30624]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:04:34.765 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:04:34 smithi044 ceph-mon[30624]: { 2024-03-26T17:04:34.765 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:04:34 smithi044 ceph-mon[30624]: "prefix": "rbd perf image stats", 2024-03-26T17:04:34.765 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:04:34 smithi044 ceph-mon[30624]: "pool_spec": "mypool", 2024-03-26T17:04:34.765 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:04:34 smithi044 ceph-mon[30624]: "sort_by": "write_ops", 2024-03-26T17:04:34.765 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:04:34 smithi044 ceph-mon[30624]: "format": "json" 2024-03-26T17:04:34.766 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:04:34 smithi044 ceph-mon[30624]: }"]: dispatch 2024-03-26T17:04:34.766 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:04:34 smithi044 ceph-mon[30624]: Health check update: 3 slow ops, oldest one blocked for 368 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:04:35.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:04:35 smithi064 ceph-mon[34420]: pgmap v558: 33 pgs: 33 active+clean; 1024 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 8.8 MiB/s rd, 9.3 MiB/s wr, 718 op/s 2024-03-26T17:04:35.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:04:35 smithi149 ceph-mon[34678]: pgmap v558: 33 pgs: 33 active+clean; 1024 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 8.8 MiB/s rd, 9.3 MiB/s wr, 718 op/s 2024-03-26T17:04:35.666 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:04:35 smithi044 ceph-mon[30624]: pgmap v558: 33 pgs: 33 active+clean; 1024 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 8.8 MiB/s rd, 9.3 MiB/s wr, 718 op/s 2024-03-26T17:04:35.667 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:04:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:04:35] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:04:35.667 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:04:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:04:35] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:04:35.667 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:04:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:04:36.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:04:35 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:04:35] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:04:36.147 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:04:35 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:04:35] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:04:36.147 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:04:35 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:04:36.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:04:36 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 2024-03-26T17:04:36.219+0000 7fa707a55700 -1 mon.c@1(peon) e3 get_health_metrics reporting 3 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T17:04:37.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:04:37 smithi064 ceph-mon[34420]: pgmap v559: 33 pgs: 33 active+clean; 1024 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 7.8 MiB/s rd, 8.1 MiB/s wr, 643 op/s 2024-03-26T17:04:37.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:04:37 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-26T17:04:37.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:04:37 smithi149 ceph-mon[34678]: pgmap v559: 33 pgs: 33 active+clean; 1024 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 7.8 MiB/s rd, 8.1 MiB/s wr, 643 op/s 2024-03-26T17:04:37.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:04:37 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-26T17:04:37.765 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:04:37 smithi044 ceph-mon[30624]: pgmap v559: 33 pgs: 33 active+clean; 1024 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 7.8 MiB/s rd, 8.1 MiB/s wr, 643 op/s 2024-03-26T17:04:37.765 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:04:37 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-26T17:04:37.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:04:37 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:04:37] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:04:37.766 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:04:37 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:04:37] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:04:37.766 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:04:37 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:04:38.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:04:37 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:04:37] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:04:38.147 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:04:37 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:04:37] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:04:38.147 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:04:37 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:04:38.234 INFO:tasks.workunit.client.3.smithi157.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-26T17:04:38.234 INFO:tasks.workunit.client.3.smithi157.stdout:myimage6 7/s 4/s 198 KiB/s 142 KiB/s 1.75 ms 308.49 us 2024-03-26T17:04:38.234 INFO:tasks.workunit.client.3.smithi157.stdout:myimage52 6/s 4/s 181 KiB/s 108 KiB/s 1.80 ms 390.87 us 2024-03-26T17:04:38.234 INFO:tasks.workunit.client.3.smithi157.stdout:myimage14 6/s 5/s 145 KiB/s 138 KiB/s 1.66 ms 352.55 us 2024-03-26T17:04:38.235 INFO:tasks.workunit.client.3.smithi157.stdout:myimage35 6/s 5/s 161 KiB/s 126 KiB/s 1.58 ms 352.62 us 2024-03-26T17:04:38.235 INFO:tasks.workunit.client.3.smithi157.stdout:myimage19 6/s 5/s 176 KiB/s 143 KiB/s 1.66 ms 403.41 us 2024-03-26T17:04:38.235 INFO:tasks.workunit.client.3.smithi157.stdout:myimage26 6/s 4/s 163 KiB/s 122 KiB/s 1.64 ms 315.58 us 2024-03-26T17:04:38.235 INFO:tasks.workunit.client.3.smithi157.stdout:myimage2 6/s 5/s 143 KiB/s 147 KiB/s 1.61 ms 394.72 us 2024-03-26T17:04:38.235 INFO:tasks.workunit.client.3.smithi157.stdout:myimage38 6/s 5/s 158 KiB/s 129 KiB/s 1.43 ms 299.99 us 2024-03-26T17:04:38.235 INFO:tasks.workunit.client.3.smithi157.stdout:myimage5 6/s 4/s 126 KiB/s 118 KiB/s 1.56 ms 381.63 us 2024-03-26T17:04:38.235 INFO:tasks.workunit.client.3.smithi157.stdout:myimage45 6/s 5/s 166 KiB/s 130 KiB/s 1.64 ms 296.32 us 2024-03-26T17:04:38.235 INFO:tasks.workunit.client.3.smithi157.stdout:myimage53 6/s 4/s 198 KiB/s 119 KiB/s 1.58 ms 301.35 us 2024-03-26T17:04:38.235 INFO:tasks.workunit.client.3.smithi157.stdout:myimage34 6/s 4/s 134 KiB/s 126 KiB/s 1.58 ms 300.29 us 2024-03-26T17:04:38.235 INFO:tasks.workunit.client.3.smithi157.stdout:myimage40 6/s 4/s 139 KiB/s 91 KiB/s 1.55 ms 429.91 us 2024-03-26T17:04:38.236 INFO:tasks.workunit.client.3.smithi157.stdout:myimage29 6/s 6/s 138 KiB/s 130 KiB/s 1.53 ms 403.16 us 2024-03-26T17:04:38.236 INFO:tasks.workunit.client.3.smithi157.stdout:myimage59 6/s 4/s 134 KiB/s 138 KiB/s 1.69 ms 337.45 us 2024-03-26T17:04:38.236 INFO:tasks.workunit.client.3.smithi157.stdout:myimage30 5/s 6/s 134 KiB/s 141 KiB/s 1.77 ms 305.70 us 2024-03-26T17:04:38.236 INFO:tasks.workunit.client.3.smithi157.stdout:myimage8 5/s 5/s 129 KiB/s 118 KiB/s 1.68 ms 298.66 us 2024-03-26T17:04:38.236 INFO:tasks.workunit.client.3.smithi157.stdout:myimage11 5/s 6/s 163 KiB/s 129 KiB/s 1.79 ms 336.39 us 2024-03-26T17:04:38.236 INFO:tasks.workunit.client.3.smithi157.stdout:myimage17 5/s 5/s 156 KiB/s 119 KiB/s 1.63 ms 290.16 us 2024-03-26T17:04:38.236 INFO:tasks.workunit.client.3.smithi157.stdout:myimage27 5/s 5/s 133 KiB/s 143 KiB/s 1.51 ms 282.23 us 2024-03-26T17:04:38.236 INFO:tasks.workunit.client.3.smithi157.stdout:myimage28 5/s 4/s 134 KiB/s 126 KiB/s 1.85 ms 396.37 us 2024-03-26T17:04:38.236 INFO:tasks.workunit.client.3.smithi157.stdout:myimage46 5/s 6/s 124 KiB/s 153 KiB/s 1.58 ms 323.93 us 2024-03-26T17:04:38.236 INFO:tasks.workunit.client.3.smithi157.stdout:myimage51 5/s 6/s 145 KiB/s 151 KiB/s 1.65 ms 308.46 us 2024-03-26T17:04:38.236 INFO:tasks.workunit.client.3.smithi157.stdout:myimage22 5/s 6/s 130 KiB/s 183 KiB/s 1.64 ms 305.14 us 2024-03-26T17:04:38.236 INFO:tasks.workunit.client.3.smithi157.stdout:myimage47 5/s 6/s 153 KiB/s 154 KiB/s 1.74 ms 328.01 us 2024-03-26T17:04:38.237 INFO:tasks.workunit.client.3.smithi157.stdout:myimage42 5/s 4/s 140 KiB/s 113 KiB/s 1.67 ms 338.10 us 2024-03-26T17:04:38.237 INFO:tasks.workunit.client.3.smithi157.stdout:myimage54 5/s 6/s 117 KiB/s 150 KiB/s 1.59 ms 358.39 us 2024-03-26T17:04:38.237 INFO:tasks.workunit.client.3.smithi157.stdout:myimage13 5/s 5/s 125 KiB/s 133 KiB/s 1.48 ms 274.56 us 2024-03-26T17:04:38.237 INFO:tasks.workunit.client.3.smithi157.stdout:myimage44 5/s 4/s 113 KiB/s 108 KiB/s 1.65 ms 309.71 us 2024-03-26T17:04:38.237 INFO:tasks.workunit.client.3.smithi157.stdout:myimage12 5/s 5/s 123 KiB/s 150 KiB/s 1.70 ms 340.58 us 2024-03-26T17:04:38.237 INFO:tasks.workunit.client.3.smithi157.stdout:myimage18 5/s 3/s 121 KiB/s 81 KiB/s 1.55 ms 297.55 us 2024-03-26T17:04:38.237 INFO:tasks.workunit.client.3.smithi157.stdout:myimage57 5/s 5/s 182 KiB/s 126 KiB/s 1.58 ms 367.40 us 2024-03-26T17:04:38.237 INFO:tasks.workunit.client.3.smithi157.stdout:myimage3 5/s 5/s 159 KiB/s 86 KiB/s 1.54 ms 284.98 us 2024-03-26T17:04:38.237 INFO:tasks.workunit.client.3.smithi157.stdout:myimage31 5/s 6/s 92 KiB/s 124 KiB/s 1.71 ms 299.88 us 2024-03-26T17:04:38.237 INFO:tasks.workunit.client.3.smithi157.stdout:myimage48 5/s 6/s 122 KiB/s 144 KiB/s 1.66 ms 364.52 us 2024-03-26T17:04:38.237 INFO:tasks.workunit.client.3.smithi157.stdout:myimage4 5/s 7/s 165 KiB/s 184 KiB/s 1.65 ms 323.98 us 2024-03-26T17:04:38.238 INFO:tasks.workunit.client.3.smithi157.stdout:myimage33 5/s 6/s 126 KiB/s 171 KiB/s 1.57 ms 295.71 us 2024-03-26T17:04:38.238 INFO:tasks.workunit.client.3.smithi157.stdout:myimage56 5/s 5/s 138 KiB/s 122 KiB/s 1.90 ms 319.39 us 2024-03-26T17:04:38.238 INFO:tasks.workunit.client.3.smithi157.stdout:myimage49 5/s 6/s 150 KiB/s 150 KiB/s 1.60 ms 309.28 us 2024-03-26T17:04:38.238 INFO:tasks.workunit.client.3.smithi157.stdout:myimage58 5/s 6/s 80 KiB/s 150 KiB/s 1.57 ms 375.65 us 2024-03-26T17:04:38.238 INFO:tasks.workunit.client.3.smithi157.stdout:myimage15 5/s 6/s 154 KiB/s 150 KiB/s 1.52 ms 380.67 us 2024-03-26T17:04:38.238 INFO:tasks.workunit.client.3.smithi157.stdout:myimage25 5/s 5/s 133 KiB/s 126 KiB/s 1.75 ms 336.96 us 2024-03-26T17:04:38.238 INFO:tasks.workunit.client.3.smithi157.stdout:myimage39 5/s 6/s 129 KiB/s 138 KiB/s 1.56 ms 284.98 us 2024-03-26T17:04:38.238 INFO:tasks.workunit.client.3.smithi157.stdout:myimage41 5/s 5/s 121 KiB/s 110 KiB/s 1.57 ms 328.97 us 2024-03-26T17:04:38.238 INFO:tasks.workunit.client.3.smithi157.stdout:myimage16 4/s 5/s 107 KiB/s 158 KiB/s 1.60 ms 338.42 us 2024-03-26T17:04:38.238 INFO:tasks.workunit.client.3.smithi157.stdout:myimage37 4/s 6/s 110 KiB/s 142 KiB/s 1.77 ms 321.84 us 2024-03-26T17:04:38.238 INFO:tasks.workunit.client.3.smithi157.stdout:myimage9 4/s 5/s 126 KiB/s 151 KiB/s 1.66 ms 368.87 us 2024-03-26T17:04:38.239 INFO:tasks.workunit.client.3.smithi157.stdout:myimage21 4/s 5/s 113 KiB/s 151 KiB/s 1.86 ms 383.78 us 2024-03-26T17:04:38.239 INFO:tasks.workunit.client.3.smithi157.stdout:myimage24 4/s 5/s 136 KiB/s 122 KiB/s 1.53 ms 378.25 us 2024-03-26T17:04:38.239 INFO:tasks.workunit.client.3.smithi157.stdout:myimage36 4/s 6/s 108 KiB/s 142 KiB/s 1.58 ms 337.13 us 2024-03-26T17:04:38.239 INFO:tasks.workunit.client.3.smithi157.stdout:myimage43 4/s 5/s 122 KiB/s 122 KiB/s 1.67 ms 375.05 us 2024-03-26T17:04:38.239 INFO:tasks.workunit.client.3.smithi157.stdout:myimage50 4/s 6/s 90 KiB/s 134 KiB/s 1.68 ms 379.40 us 2024-03-26T17:04:38.239 INFO:tasks.workunit.client.3.smithi157.stdout:myimage60 4/s 6/s 142 KiB/s 186 KiB/s 1.66 ms 415.52 us 2024-03-26T17:04:38.239 INFO:tasks.workunit.client.3.smithi157.stdout:myimage55 4/s 5/s 90 KiB/s 134 KiB/s 1.67 ms 346.48 us 2024-03-26T17:04:38.239 INFO:tasks.workunit.client.3.smithi157.stdout:myimage10 4/s 7/s 87 KiB/s 199 KiB/s 1.60 ms 343.31 us 2024-03-26T17:04:38.239 INFO:tasks.workunit.client.3.smithi157.stdout:myimage32 4/s 5/s 74 KiB/s 166 KiB/s 1.61 ms 393.23 us 2024-03-26T17:04:38.239 INFO:tasks.workunit.client.3.smithi157.stdout:myimage1 4/s 6/s 102 KiB/s 145 KiB/s 1.44 ms 283.53 us 2024-03-26T17:04:38.240 INFO:tasks.workunit.client.3.smithi157.stdout:myimage7 4/s 7/s 104 KiB/s 175 KiB/s 1.81 ms 281.91 us 2024-03-26T17:04:38.240 INFO:tasks.workunit.client.3.smithi157.stdout:myimage23 4/s 6/s 96 KiB/s 155 KiB/s 1.31 ms 336.40 us 2024-03-26T17:04:38.240 INFO:tasks.workunit.client.3.smithi157.stdout:myimage20 4/s 7/s 81 KiB/s 127 KiB/s 1.55 ms 272.54 us 2024-03-26T17:04:38.240 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:04:38.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:04:38 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T17:04:38.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:04:38 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-26T17:04:38.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:04:38 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T17:04:38.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:04:38 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T17:04:38.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:04:38 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-26T17:04:38.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:04:38 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T17:04:38.765 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:04:38 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T17:04:38.765 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:04:38 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-26T17:04:38.765 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:04:38 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T17:04:39.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:04:39 smithi064 ceph-mon[34420]: pgmap v560: 33 pgs: 33 active+clean; 1024 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 7.7 MiB/s rd, 8.0 MiB/s wr, 652 op/s 2024-03-26T17:04:39.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:04:39 smithi064 ceph-mon[34420]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:04:39.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:04:39 smithi064 ceph-mon[34420]: { 2024-03-26T17:04:39.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:04:39 smithi064 ceph-mon[34420]: "prefix": "rbd perf image stats", 2024-03-26T17:04:39.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:04:39 smithi064 ceph-mon[34420]: "pool_spec": "mypool", 2024-03-26T17:04:39.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:04:39 smithi064 ceph-mon[34420]: "sort_by": "write_ops", 2024-03-26T17:04:39.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:04:39 smithi064 ceph-mon[34420]: "format": "json" 2024-03-26T17:04:39.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:04:39 smithi064 ceph-mon[34420]: }"]: dispatch 2024-03-26T17:04:39.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:04:39 smithi064 ceph-mon[34420]: Health check update: 3 slow ops, oldest one blocked for 373 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:04:39.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:04:39 smithi149 ceph-mon[34678]: pgmap v560: 33 pgs: 33 active+clean; 1024 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 7.7 MiB/s rd, 8.0 MiB/s wr, 652 op/s 2024-03-26T17:04:39.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:04:39 smithi149 ceph-mon[34678]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:04:39.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:04:39 smithi149 ceph-mon[34678]: { 2024-03-26T17:04:39.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:04:39 smithi149 ceph-mon[34678]: "prefix": "rbd perf image stats", 2024-03-26T17:04:39.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:04:39 smithi149 ceph-mon[34678]: "pool_spec": "mypool", 2024-03-26T17:04:39.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:04:39 smithi149 ceph-mon[34678]: "sort_by": "write_ops", 2024-03-26T17:04:39.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:04:39 smithi149 ceph-mon[34678]: "format": "json" 2024-03-26T17:04:39.647 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:04:39 smithi149 ceph-mon[34678]: }"]: dispatch 2024-03-26T17:04:39.647 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:04:39 smithi149 ceph-mon[34678]: Health check update: 3 slow ops, oldest one blocked for 373 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:04:39.666 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:04:39 smithi044 ceph-mon[30624]: pgmap v560: 33 pgs: 33 active+clean; 1024 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 7.7 MiB/s rd, 8.0 MiB/s wr, 652 op/s 2024-03-26T17:04:39.666 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:04:39 smithi044 ceph-mon[30624]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:04:39.666 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:04:39 smithi044 ceph-mon[30624]: { 2024-03-26T17:04:39.666 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:04:39 smithi044 ceph-mon[30624]: "prefix": "rbd perf image stats", 2024-03-26T17:04:39.666 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:04:39 smithi044 ceph-mon[30624]: "pool_spec": "mypool", 2024-03-26T17:04:39.666 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:04:39 smithi044 ceph-mon[30624]: "sort_by": "write_ops", 2024-03-26T17:04:39.666 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:04:39 smithi044 ceph-mon[30624]: "format": "json" 2024-03-26T17:04:39.666 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:04:39 smithi044 ceph-mon[30624]: }"]: dispatch 2024-03-26T17:04:39.667 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:04:39 smithi044 ceph-mon[30624]: Health check update: 3 slow ops, oldest one blocked for 373 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:04:39.667 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:04:39 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:04:39] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:04:39.667 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:04:39 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:04:39] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:04:39.667 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:04:39 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:04:40.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:04:39 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:04:39] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:04:40.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:04:39 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:04:39] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:04:40.147 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:04:39 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:04:41.547 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:04:41 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 2024-03-26T17:04:41.220+0000 7fa707a55700 -1 mon.c@1(peon) e3 get_health_metrics reporting 3 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T17:04:41.547 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:04:41 smithi149 ceph-mon[34678]: pgmap v561: 33 pgs: 33 active+clean; 1024 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 8.1 MiB/s rd, 8.4 MiB/s wr, 692 op/s 2024-03-26T17:04:41.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:04:41 smithi064 ceph-mon[34420]: pgmap v561: 33 pgs: 33 active+clean; 1024 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 8.1 MiB/s rd, 8.4 MiB/s wr, 692 op/s 2024-03-26T17:04:41.765 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:04:41 smithi044 ceph-mon[30624]: pgmap v561: 33 pgs: 33 active+clean; 1024 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 8.1 MiB/s rd, 8.4 MiB/s wr, 692 op/s 2024-03-26T17:04:41.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:04:41 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:04:41] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:04:41.766 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:04:41 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:04:41] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:04:41.766 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:04:41 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:04:41.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:04:41 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:04:41] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:04:41.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:04:41 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:04:41] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:04:41.897 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:04:41 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:04:43.062 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:04:43.070 INFO:tasks.workunit.client.3.smithi157.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2024-03-26T17:04:43.070 INFO:tasks.workunit.client.3.smithi157.stdout: 11.00 152.8k 105.2k 0.0k 1.5M 1.0M 0.0k nvme2n1 2024-03-26T17:04:43.071 INFO:tasks.workunit.client.3.smithi157.stdout: 11.00 148.0k 100.8k 0.0k 1.4M 1008.0k 0.0k nvme2n10 2024-03-26T17:04:43.071 INFO:tasks.workunit.client.3.smithi157.stdout: 11.00 119.2k 125.2k 0.0k 1.2M 1.2M 0.0k nvme2n11 2024-03-26T17:04:43.071 INFO:tasks.workunit.client.3.smithi157.stdout: 11.00 126.4k 119.2k 0.0k 1.2M 1.2M 0.0k nvme2n12 2024-03-26T17:04:43.071 INFO:tasks.workunit.client.3.smithi157.stdout: 11.00 144.0k 84.0k 0.0k 1.4M 840.0k 0.0k nvme2n13 2024-03-26T17:04:43.071 INFO:tasks.workunit.client.3.smithi157.stdout: 11.00 145.2k 115.6k 0.0k 1.4M 1.1M 0.0k nvme2n14 2024-03-26T17:04:43.071 INFO:tasks.workunit.client.3.smithi157.stdout: 11.00 136.8k 142.8k 0.0k 1.3M 1.4M 0.0k nvme2n15 2024-03-26T17:04:43.071 INFO:tasks.workunit.client.3.smithi157.stdout: 11.00 143.2k 130.8k 0.0k 1.4M 1.3M 0.0k nvme2n16 2024-03-26T17:04:43.071 INFO:tasks.workunit.client.3.smithi157.stdout: 11.00 106.8k 153.2k 0.0k 1.0M 1.5M 0.0k nvme2n17 2024-03-26T17:04:43.071 INFO:tasks.workunit.client.3.smithi157.stdout: 11.00 141.2k 132.8k 0.0k 1.4M 1.3M 0.0k nvme2n18 2024-03-26T17:04:43.071 INFO:tasks.workunit.client.3.smithi157.stdout: 11.00 82.4k 149.6k 0.0k 824.0k 1.5M 0.0k nvme2n19 2024-03-26T17:04:43.071 INFO:tasks.workunit.client.3.smithi157.stdout: 11.10 120.4k 140.8k 0.0k 1.2M 1.4M 0.0k nvme2n2 2024-03-26T17:04:43.072 INFO:tasks.workunit.client.3.smithi157.stdout: 11.00 147.2k 100.8k 0.0k 1.4M 1008.0k 0.0k nvme2n20 2024-03-26T17:04:43.072 INFO:tasks.workunit.client.3.smithi157.stdout: 11.10 102.8k 158.8k 0.0k 1.0M 1.6M 0.0k nvme2n3 2024-03-26T17:04:43.072 INFO:tasks.workunit.client.3.smithi157.stdout: 11.10 131.2k 136.4k 0.0k 1.3M 1.3M 0.0k nvme2n4 2024-03-26T17:04:43.072 INFO:tasks.workunit.client.3.smithi157.stdout: 11.10 128.8k 120.4k 0.0k 1.3M 1.2M 0.0k nvme2n5 2024-03-26T17:04:43.072 INFO:tasks.workunit.client.3.smithi157.stdout: 11.00 114.8k 153.2k 0.0k 1.1M 1.5M 0.0k nvme2n6 2024-03-26T17:04:43.072 INFO:tasks.workunit.client.3.smithi157.stdout: 11.00 133.6k 132.8k 0.0k 1.3M 1.3M 0.0k nvme2n7 2024-03-26T17:04:43.072 INFO:tasks.workunit.client.3.smithi157.stdout: 11.00 130.4k 104.0k 0.0k 1.3M 1.0M 0.0k nvme2n8 2024-03-26T17:04:43.072 INFO:tasks.workunit.client.3.smithi157.stdout: 11.00 130.0k 122.4k 0.0k 1.3M 1.2M 0.0k nvme2n9 2024-03-26T17:04:43.072 INFO:tasks.workunit.client.3.smithi157.stdout: 11.00 122.4k 106.4k 0.0k 1.2M 1.0M 0.0k nvme5n1 2024-03-26T17:04:43.072 INFO:tasks.workunit.client.3.smithi157.stdout: 11.00 139.2k 132.0k 0.0k 1.4M 1.3M 0.0k nvme5n10 2024-03-26T17:04:43.072 INFO:tasks.workunit.client.3.smithi157.stdout: 11.00 116.4k 112.8k 0.0k 1.1M 1.1M 0.0k nvme5n11 2024-03-26T17:04:43.072 INFO:tasks.workunit.client.3.smithi157.stdout: 11.00 135.6k 132.8k 0.0k 1.3M 1.3M 0.0k nvme5n12 2024-03-26T17:04:43.073 INFO:tasks.workunit.client.3.smithi157.stdout: 11.00 152.0k 83.6k 0.0k 1.5M 836.0k 0.0k nvme5n13 2024-03-26T17:04:43.073 INFO:tasks.workunit.client.3.smithi157.stdout: 11.00 146.4k 110.0k 0.0k 1.4M 1.1M 0.0k nvme5n14 2024-03-26T17:04:43.073 INFO:tasks.workunit.client.3.smithi157.stdout: 11.00 123.6k 130.8k 0.0k 1.2M 1.3M 0.0k nvme5n15 2024-03-26T17:04:43.073 INFO:tasks.workunit.client.3.smithi157.stdout: 11.00 116.0k 137.6k 0.0k 1.1M 1.3M 0.0k nvme5n16 2024-03-26T17:04:43.073 INFO:tasks.workunit.client.3.smithi157.stdout: 11.00 114.8k 119.2k 0.0k 1.1M 1.2M 0.0k nvme5n17 2024-03-26T17:04:43.073 INFO:tasks.workunit.client.3.smithi157.stdout: 11.00 122.8k 121.6k 0.0k 1.2M 1.2M 0.0k nvme5n18 2024-03-26T17:04:43.073 INFO:tasks.workunit.client.3.smithi157.stdout: 11.00 123.6k 140.4k 0.0k 1.2M 1.4M 0.0k nvme5n19 2024-03-26T17:04:43.073 INFO:tasks.workunit.client.3.smithi157.stdout: 11.10 148.8k 93.2k 0.0k 1.5M 932.0k 0.0k nvme5n2 2024-03-26T17:04:43.073 INFO:tasks.workunit.client.3.smithi157.stdout: 11.00 112.8k 146.8k 0.0k 1.1M 1.4M 0.0k nvme5n20 2024-03-26T17:04:43.073 INFO:tasks.workunit.client.3.smithi157.stdout: 11.10 141.6k 126.4k 0.0k 1.4M 1.2M 0.0k nvme5n3 2024-03-26T17:04:43.073 INFO:tasks.workunit.client.3.smithi157.stdout: 11.10 170.8k 101.6k 0.0k 1.7M 1016.0k 0.0k nvme5n4 2024-03-26T17:04:43.073 INFO:tasks.workunit.client.3.smithi157.stdout: 11.10 125.6k 122.8k 0.0k 1.2M 1.2M 0.0k nvme5n5 2024-03-26T17:04:43.074 INFO:tasks.workunit.client.3.smithi157.stdout: 11.10 126.8k 165.2k 0.0k 1.2M 1.6M 0.0k nvme5n6 2024-03-26T17:04:43.074 INFO:tasks.workunit.client.3.smithi157.stdout: 11.00 111.6k 123.6k 0.0k 1.1M 1.2M 0.0k nvme5n7 2024-03-26T17:04:43.074 INFO:tasks.workunit.client.3.smithi157.stdout: 11.00 129.6k 146.0k 0.0k 1.3M 1.4M 0.0k nvme5n8 2024-03-26T17:04:43.074 INFO:tasks.workunit.client.3.smithi157.stdout: 11.00 120.4k 118.0k 0.0k 1.2M 1.2M 0.0k nvme5n9 2024-03-26T17:04:43.074 INFO:tasks.workunit.client.3.smithi157.stdout: 11.00 90.0k 157.6k 0.0k 900.0k 1.5M 0.0k nvme8n1 2024-03-26T17:04:43.074 INFO:tasks.workunit.client.3.smithi157.stdout: 11.00 114.4k 108.0k 0.0k 1.1M 1.1M 0.0k nvme8n10 2024-03-26T17:04:43.074 INFO:tasks.workunit.client.3.smithi157.stdout: 11.00 126.0k 114.8k 0.0k 1.2M 1.1M 0.0k nvme8n11 2024-03-26T17:04:43.074 INFO:tasks.workunit.client.3.smithi157.stdout: 11.00 124.0k 138.4k 0.0k 1.2M 1.4M 0.0k nvme8n12 2024-03-26T17:04:43.074 INFO:tasks.workunit.client.3.smithi157.stdout: 11.00 117.6k 151.6k 0.0k 1.1M 1.5M 0.0k nvme8n13 2024-03-26T17:04:43.074 INFO:tasks.workunit.client.3.smithi157.stdout: 11.00 149.6k 111.2k 0.0k 1.5M 1.1M 0.0k nvme8n14 2024-03-26T17:04:43.074 INFO:tasks.workunit.client.3.smithi157.stdout: 11.00 121.6k 140.8k 0.0k 1.2M 1.4M 0.0k nvme8n15 2024-03-26T17:04:43.075 INFO:tasks.workunit.client.3.smithi157.stdout: 11.00 136.8k 108.4k 0.0k 1.3M 1.1M 0.0k nvme8n16 2024-03-26T17:04:43.075 INFO:tasks.workunit.client.3.smithi157.stdout: 11.00 158.8k 132.4k 0.0k 1.6M 1.3M 0.0k nvme8n17 2024-03-26T17:04:43.075 INFO:tasks.workunit.client.3.smithi157.stdout: 11.00 130.0k 96.0k 0.0k 1.3M 960.0k 0.0k nvme8n18 2024-03-26T17:04:43.075 INFO:tasks.workunit.client.3.smithi157.stdout: 11.00 152.0k 112.0k 0.0k 1.5M 1.1M 0.0k nvme8n19 2024-03-26T17:04:43.075 INFO:tasks.workunit.client.3.smithi157.stdout: 11.10 151.2k 107.6k 0.0k 1.5M 1.1M 0.0k nvme8n2 2024-03-26T17:04:43.075 INFO:tasks.workunit.client.3.smithi157.stdout: 11.00 122.4k 130.8k 0.0k 1.2M 1.3M 0.0k nvme8n20 2024-03-26T17:04:43.075 INFO:tasks.workunit.client.3.smithi157.stdout: 11.10 119.6k 143.6k 0.0k 1.2M 1.4M 0.0k nvme8n3 2024-03-26T17:04:43.075 INFO:tasks.workunit.client.3.smithi157.stdout: 11.10 132.8k 108.4k 0.0k 1.3M 1.1M 0.0k nvme8n4 2024-03-26T17:04:43.075 INFO:tasks.workunit.client.3.smithi157.stdout: 11.10 138.4k 138.0k 0.0k 1.4M 1.3M 0.0k nvme8n5 2024-03-26T17:04:43.075 INFO:tasks.workunit.client.3.smithi157.stdout: 11.00 132.8k 115.2k 0.0k 1.3M 1.1M 0.0k nvme8n6 2024-03-26T17:04:43.075 INFO:tasks.workunit.client.3.smithi157.stdout: 11.00 125.6k 116.0k 0.0k 1.2M 1.1M 0.0k nvme8n7 2024-03-26T17:04:43.076 INFO:tasks.workunit.client.3.smithi157.stdout: 11.00 98.8k 140.4k 0.0k 988.0k 1.4M 0.0k nvme8n8 2024-03-26T17:04:43.076 INFO:tasks.workunit.client.3.smithi157.stdout: 11.00 144.0k 126.8k 0.0k 1.4M 1.2M 0.0k nvme8n9 2024-03-26T17:04:43.076 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:04:43.238 INFO:tasks.workunit.client.3.smithi157.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-26T17:04:43.238 INFO:tasks.workunit.client.3.smithi157.stdout:myimage18 7/s 5/s 177 KiB/s 131 KiB/s 1.60 ms 300.25 us 2024-03-26T17:04:43.238 INFO:tasks.workunit.client.3.smithi157.stdout:myimage43 7/s 4/s 190 KiB/s 130 KiB/s 1.73 ms 327.77 us 2024-03-26T17:04:43.238 INFO:tasks.workunit.client.3.smithi157.stdout:myimage36 7/s 4/s 138 KiB/s 94 KiB/s 1.59 ms 325.42 us 2024-03-26T17:04:43.238 INFO:tasks.workunit.client.3.smithi157.stdout:myimage60 7/s 4/s 135 KiB/s 86 KiB/s 1.67 ms 259.77 us 2024-03-26T17:04:43.238 INFO:tasks.workunit.client.3.smithi157.stdout:myimage19 6/s 3/s 130 KiB/s 49 KiB/s 1.60 ms 351.08 us 2024-03-26T17:04:43.238 INFO:tasks.workunit.client.3.smithi157.stdout:myimage26 6/s 5/s 177 KiB/s 142 KiB/s 1.67 ms 343.72 us 2024-03-26T17:04:43.238 INFO:tasks.workunit.client.3.smithi157.stdout:myimage41 6/s 4/s 143 KiB/s 74 KiB/s 1.68 ms 270.40 us 2024-03-26T17:04:43.238 INFO:tasks.workunit.client.3.smithi157.stdout:myimage59 6/s 5/s 141 KiB/s 123 KiB/s 1.78 ms 381.43 us 2024-03-26T17:04:43.239 INFO:tasks.workunit.client.3.smithi157.stdout:myimage38 6/s 6/s 154 KiB/s 136 KiB/s 1.53 ms 354.65 us 2024-03-26T17:04:43.239 INFO:tasks.workunit.client.3.smithi157.stdout:myimage51 6/s 4/s 106 KiB/s 94 KiB/s 1.71 ms 295.49 us 2024-03-26T17:04:43.239 INFO:tasks.workunit.client.3.smithi157.stdout:myimage55 6/s 5/s 182 KiB/s 122 KiB/s 1.82 ms 294.16 us 2024-03-26T17:04:43.239 INFO:tasks.workunit.client.3.smithi157.stdout:myimage3 6/s 5/s 157 KiB/s 102 KiB/s 1.52 ms 300.50 us 2024-03-26T17:04:43.239 INFO:tasks.workunit.client.3.smithi157.stdout:myimage48 6/s 5/s 162 KiB/s 96 KiB/s 1.78 ms 280.02 us 2024-03-26T17:04:43.239 INFO:tasks.workunit.client.3.smithi157.stdout:myimage52 6/s 5/s 150 KiB/s 94 KiB/s 1.70 ms 373.53 us 2024-03-26T17:04:43.239 INFO:tasks.workunit.client.3.smithi157.stdout:myimage21 6/s 5/s 114 KiB/s 115 KiB/s 1.97 ms 324.35 us 2024-03-26T17:04:43.239 INFO:tasks.workunit.client.3.smithi157.stdout:myimage49 5/s 5/s 141 KiB/s 111 KiB/s 1.68 ms 303.46 us 2024-03-26T17:04:43.239 INFO:tasks.workunit.client.3.smithi157.stdout:myimage17 5/s 4/s 149 KiB/s 82 KiB/s 1.73 ms 296.64 us 2024-03-26T17:04:43.239 INFO:tasks.workunit.client.3.smithi157.stdout:myimage39 5/s 5/s 160 KiB/s 125 KiB/s 1.55 ms 312.77 us 2024-03-26T17:04:43.239 INFO:tasks.workunit.client.3.smithi157.stdout:myimage50 5/s 5/s 114 KiB/s 94 KiB/s 1.76 ms 268.58 us 2024-03-26T17:04:43.239 INFO:tasks.workunit.client.3.smithi157.stdout:myimage53 5/s 5/s 146 KiB/s 134 KiB/s 1.71 ms 346.58 us 2024-03-26T17:04:43.239 INFO:tasks.workunit.client.3.smithi157.stdout:myimage31 5/s 5/s 107 KiB/s 107 KiB/s 1.77 ms 327.54 us 2024-03-26T17:04:43.239 INFO:tasks.workunit.client.3.smithi157.stdout:myimage35 5/s 5/s 114 KiB/s 120 KiB/s 1.74 ms 304.48 us 2024-03-26T17:04:43.240 INFO:tasks.workunit.client.3.smithi157.stdout:myimage47 5/s 5/s 110 KiB/s 111 KiB/s 1.78 ms 306.20 us 2024-03-26T17:04:43.240 INFO:tasks.workunit.client.3.smithi157.stdout:myimage12 5/s 6/s 136 KiB/s 145 KiB/s 1.54 ms 390.37 us 2024-03-26T17:04:43.240 INFO:tasks.workunit.client.3.smithi157.stdout:myimage16 5/s 5/s 144 KiB/s 134 KiB/s 1.66 ms 290.68 us 2024-03-26T17:04:43.240 INFO:tasks.workunit.client.3.smithi157.stdout:myimage22 5/s 6/s 124 KiB/s 134 KiB/s 1.76 ms 409.59 us 2024-03-26T17:04:43.240 INFO:tasks.workunit.client.3.smithi157.stdout:myimage32 5/s 6/s 150 KiB/s 170 KiB/s 1.74 ms 329.06 us 2024-03-26T17:04:43.240 INFO:tasks.workunit.client.3.smithi157.stdout:myimage6 5/s 4/s 118 KiB/s 75 KiB/s 1.63 ms 288.55 us 2024-03-26T17:04:43.240 INFO:tasks.workunit.client.3.smithi157.stdout:myimage7 5/s 5/s 138 KiB/s 91 KiB/s 1.70 ms 342.91 us 2024-03-26T17:04:43.240 INFO:tasks.workunit.client.3.smithi157.stdout:myimage25 5/s 6/s 125 KiB/s 127 KiB/s 1.94 ms 425.19 us 2024-03-26T17:04:43.240 INFO:tasks.workunit.client.3.smithi157.stdout:myimage27 5/s 5/s 108 KiB/s 115 KiB/s 1.62 ms 293.42 us 2024-03-26T17:04:43.240 INFO:tasks.workunit.client.3.smithi157.stdout:myimage28 5/s 5/s 142 KiB/s 142 KiB/s 1.95 ms 343.79 us 2024-03-26T17:04:43.240 INFO:tasks.workunit.client.3.smithi157.stdout:myimage45 5/s 4/s 140 KiB/s 108 KiB/s 1.70 ms 275.19 us 2024-03-26T17:04:43.240 INFO:tasks.workunit.client.3.smithi157.stdout:myimage56 5/s 5/s 101 KiB/s 151 KiB/s 1.78 ms 352.62 us 2024-03-26T17:04:43.240 INFO:tasks.workunit.client.3.smithi157.stdout:myimage57 5/s 6/s 146 KiB/s 139 KiB/s 1.58 ms 312.73 us 2024-03-26T17:04:43.240 INFO:tasks.workunit.client.3.smithi157.stdout:myimage37 5/s 3/s 125 KiB/s 79 KiB/s 1.76 ms 424.26 us 2024-03-26T17:04:43.240 INFO:tasks.workunit.client.3.smithi157.stdout:myimage4 5/s 5/s 122 KiB/s 114 KiB/s 1.60 ms 294.72 us 2024-03-26T17:04:43.241 INFO:tasks.workunit.client.3.smithi157.stdout:myimage13 5/s 6/s 95 KiB/s 142 KiB/s 1.52 ms 302.48 us 2024-03-26T17:04:43.241 INFO:tasks.workunit.client.3.smithi157.stdout:myimage5 5/s 6/s 105 KiB/s 136 KiB/s 1.69 ms 313.47 us 2024-03-26T17:04:43.241 INFO:tasks.workunit.client.3.smithi157.stdout:myimage20 5/s 6/s 116 KiB/s 153 KiB/s 1.65 ms 345.92 us 2024-03-26T17:04:43.241 INFO:tasks.workunit.client.3.smithi157.stdout:myimage14 4/s 5/s 93 KiB/s 162 KiB/s 1.65 ms 383.79 us 2024-03-26T17:04:43.241 INFO:tasks.workunit.client.3.smithi157.stdout:myimage44 4/s 6/s 100 KiB/s 133 KiB/s 1.67 ms 312.25 us 2024-03-26T17:04:43.241 INFO:tasks.workunit.client.3.smithi157.stdout:myimage11 4/s 6/s 119 KiB/s 115 KiB/s 1.78 ms 322.42 us 2024-03-26T17:04:43.241 INFO:tasks.workunit.client.3.smithi157.stdout:myimage33 4/s 5/s 78 KiB/s 131 KiB/s 1.67 ms 327.82 us 2024-03-26T17:04:43.241 INFO:tasks.workunit.client.3.smithi157.stdout:myimage42 4/s 6/s 91 KiB/s 164 KiB/s 1.53 ms 391.39 us 2024-03-26T17:04:43.241 INFO:tasks.workunit.client.3.smithi157.stdout:myimage30 4/s 5/s 117 KiB/s 136 KiB/s 1.95 ms 318.64 us 2024-03-26T17:04:43.241 INFO:tasks.workunit.client.3.smithi157.stdout:myimage40 4/s 5/s 102 KiB/s 145 KiB/s 1.59 ms 401.28 us 2024-03-26T17:04:43.241 INFO:tasks.workunit.client.3.smithi157.stdout:myimage1 4/s 6/s 121 KiB/s 138 KiB/s 1.54 ms 356.78 us 2024-03-26T17:04:43.241 INFO:tasks.workunit.client.3.smithi157.stdout:myimage29 4/s 6/s 114 KiB/s 107 KiB/s 1.51 ms 313.85 us 2024-03-26T17:04:43.241 INFO:tasks.workunit.client.3.smithi157.stdout:myimage46 4/s 5/s 86 KiB/s 104 KiB/s 1.64 ms 326.27 us 2024-03-26T17:04:43.242 INFO:tasks.workunit.client.3.smithi157.stdout:myimage10 4/s 6/s 112 KiB/s 138 KiB/s 1.58 ms 308.47 us 2024-03-26T17:04:43.242 INFO:tasks.workunit.client.3.smithi157.stdout:myimage23 4/s 6/s 94 KiB/s 123 KiB/s 1.47 ms 276.72 us 2024-03-26T17:04:43.242 INFO:tasks.workunit.client.3.smithi157.stdout:myimage8 4/s 7/s 91 KiB/s 171 KiB/s 1.68 ms 358.52 us 2024-03-26T17:04:43.242 INFO:tasks.workunit.client.3.smithi157.stdout:myimage9 4/s 6/s 111 KiB/s 132 KiB/s 1.72 ms 351.63 us 2024-03-26T17:04:43.242 INFO:tasks.workunit.client.3.smithi157.stdout:myimage15 4/s 5/s 101 KiB/s 112 KiB/s 1.56 ms 312.27 us 2024-03-26T17:04:43.242 INFO:tasks.workunit.client.3.smithi157.stdout:myimage34 4/s 5/s 94 KiB/s 136 KiB/s 1.67 ms 297.32 us 2024-03-26T17:04:43.242 INFO:tasks.workunit.client.3.smithi157.stdout:myimage58 4/s 6/s 83 KiB/s 105 KiB/s 1.52 ms 310.10 us 2024-03-26T17:04:43.242 INFO:tasks.workunit.client.3.smithi157.stdout:myimage24 4/s 7/s 88 KiB/s 192 KiB/s 1.60 ms 325.15 us 2024-03-26T17:04:43.242 INFO:tasks.workunit.client.3.smithi157.stdout:myimage54 4/s 6/s 109 KiB/s 145 KiB/s 1.61 ms 517.12 us 2024-03-26T17:04:43.242 INFO:tasks.workunit.client.3.smithi157.stdout:myimage2 3/s 5/s 96 KiB/s 93 KiB/s 1.76 ms 323.73 us 2024-03-26T17:04:43.242 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:04:43.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:04:43 smithi064 ceph-mon[34420]: pgmap v562: 33 pgs: 33 active+clean; 1024 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 7.2 MiB/s rd, 7.1 MiB/s wr, 609 op/s 2024-03-26T17:04:43.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:04:43 smithi149 ceph-mon[34678]: pgmap v562: 33 pgs: 33 active+clean; 1024 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 7.2 MiB/s rd, 7.1 MiB/s wr, 609 op/s 2024-03-26T17:04:43.765 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:04:43 smithi044 ceph-mon[30624]: pgmap v562: 33 pgs: 33 active+clean; 1024 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 7.2 MiB/s rd, 7.1 MiB/s wr, 609 op/s 2024-03-26T17:04:43.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:04:43 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:04:43] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:04:43.766 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:04:43 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:04:43] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:04:43.766 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:04:43 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:04:44.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:04:43 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:04:43] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:04:44.147 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:04:43 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:04:43] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:04:44.147 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:04:43 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:04:44.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:04:44 smithi064 ceph-mon[34420]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:04:44.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:04:44 smithi064 ceph-mon[34420]: { 2024-03-26T17:04:44.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:04:44 smithi064 ceph-mon[34420]: "prefix": "rbd perf image stats", 2024-03-26T17:04:44.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:04:44 smithi064 ceph-mon[34420]: "pool_spec": "mypool", 2024-03-26T17:04:44.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:04:44 smithi064 ceph-mon[34420]: "sort_by": "write_ops", 2024-03-26T17:04:44.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:04:44 smithi064 ceph-mon[34420]: "format": "json" 2024-03-26T17:04:44.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:04:44 smithi064 ceph-mon[34420]: }"]: dispatch 2024-03-26T17:04:44.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:04:44 smithi064 ceph-mon[34420]: Health check update: 3 slow ops, oldest one blocked for 378 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:04:44.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:04:44 smithi149 ceph-mon[34678]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:04:44.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:04:44 smithi149 ceph-mon[34678]: { 2024-03-26T17:04:44.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:04:44 smithi149 ceph-mon[34678]: "prefix": "rbd perf image stats", 2024-03-26T17:04:44.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:04:44 smithi149 ceph-mon[34678]: "pool_spec": "mypool", 2024-03-26T17:04:44.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:04:44 smithi149 ceph-mon[34678]: "sort_by": "write_ops", 2024-03-26T17:04:44.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:04:44 smithi149 ceph-mon[34678]: "format": "json" 2024-03-26T17:04:44.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:04:44 smithi149 ceph-mon[34678]: }"]: dispatch 2024-03-26T17:04:44.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:04:44 smithi149 ceph-mon[34678]: Health check update: 3 slow ops, oldest one blocked for 378 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:04:44.765 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:04:44 smithi044 ceph-mon[30624]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:04:44.765 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:04:44 smithi044 ceph-mon[30624]: { 2024-03-26T17:04:44.765 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:04:44 smithi044 ceph-mon[30624]: "prefix": "rbd perf image stats", 2024-03-26T17:04:44.765 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:04:44 smithi044 ceph-mon[30624]: "pool_spec": "mypool", 2024-03-26T17:04:44.765 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:04:44 smithi044 ceph-mon[30624]: "sort_by": "write_ops", 2024-03-26T17:04:44.765 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:04:44 smithi044 ceph-mon[30624]: "format": "json" 2024-03-26T17:04:44.765 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:04:44 smithi044 ceph-mon[30624]: }"]: dispatch 2024-03-26T17:04:44.765 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:04:44 smithi044 ceph-mon[30624]: Health check update: 3 slow ops, oldest one blocked for 378 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:04:45.558 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:04:45 smithi064 ceph-mon[34420]: pgmap v563: 33 pgs: 33 active+clean; 1024 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 8.2 MiB/s rd, 8.1 MiB/s wr, 713 op/s 2024-03-26T17:04:45.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:04:45 smithi149 ceph-mon[34678]: pgmap v563: 33 pgs: 33 active+clean; 1024 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 8.2 MiB/s rd, 8.1 MiB/s wr, 713 op/s 2024-03-26T17:04:45.667 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:04:45 smithi044 ceph-mon[30624]: pgmap v563: 33 pgs: 33 active+clean; 1024 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 8.2 MiB/s rd, 8.1 MiB/s wr, 713 op/s 2024-03-26T17:04:45.667 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:04:45 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:04:45] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:04:45.667 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:04:45 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:04:45] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:04:45.667 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:04:45 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:04:46.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:04:45 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:04:45] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:04:46.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:04:45 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:04:45] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:04:46.147 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:04:45 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:04:46.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:04:46 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 2024-03-26T17:04:46.221+0000 7fa707a55700 -1 mon.c@1(peon) e3 get_health_metrics reporting 3 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T17:04:47.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:04:47 smithi064 ceph-mon[34420]: pgmap v564: 33 pgs: 33 active+clean; 1024 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 7.3 MiB/s rd, 7.2 MiB/s wr, 646 op/s 2024-03-26T17:04:47.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:04:47 smithi149 ceph-mon[34678]: pgmap v564: 33 pgs: 33 active+clean; 1024 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 7.3 MiB/s rd, 7.2 MiB/s wr, 646 op/s 2024-03-26T17:04:47.765 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:04:47 smithi044 ceph-mon[30624]: pgmap v564: 33 pgs: 33 active+clean; 1024 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 7.3 MiB/s rd, 7.2 MiB/s wr, 646 op/s 2024-03-26T17:04:47.766 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:04:47 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:04:47] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:04:47.766 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:04:47 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:04:47] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:04:47.766 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:04:47 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:04:48.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:04:47 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:04:47] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:04:48.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:04:47 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:04:47] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:04:48.147 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:04:47 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:04:48.242 INFO:tasks.workunit.client.3.smithi157.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-26T17:04:48.242 INFO:tasks.workunit.client.3.smithi157.stdout:myimage15 8/s 4/s 168 KiB/s 67 KiB/s 1.63 ms 397.80 us 2024-03-26T17:04:48.242 INFO:tasks.workunit.client.3.smithi157.stdout:myimage36 7/s 4/s 166 KiB/s 106 KiB/s 1.60 ms 315.88 us 2024-03-26T17:04:48.242 INFO:tasks.workunit.client.3.smithi157.stdout:myimage40 7/s 5/s 190 KiB/s 117 KiB/s 1.62 ms 372.93 us 2024-03-26T17:04:48.243 INFO:tasks.workunit.client.3.smithi157.stdout:myimage7 7/s 4/s 141 KiB/s 130 KiB/s 1.63 ms 470.90 us 2024-03-26T17:04:48.243 INFO:tasks.workunit.client.3.smithi157.stdout:myimage32 6/s 4/s 140 KiB/s 97 KiB/s 1.74 ms 322.68 us 2024-03-26T17:04:48.243 INFO:tasks.workunit.client.3.smithi157.stdout:myimage37 6/s 5/s 122 KiB/s 133 KiB/s 1.68 ms 323.20 us 2024-03-26T17:04:48.243 INFO:tasks.workunit.client.3.smithi157.stdout:myimage41 6/s 4/s 163 KiB/s 117 KiB/s 1.67 ms 337.10 us 2024-03-26T17:04:48.243 INFO:tasks.workunit.client.3.smithi157.stdout:myimage39 6/s 5/s 151 KiB/s 115 KiB/s 1.59 ms 321.29 us 2024-03-26T17:04:48.243 INFO:tasks.workunit.client.3.smithi157.stdout:myimage35 6/s 4/s 148 KiB/s 110 KiB/s 1.69 ms 353.13 us 2024-03-26T17:04:48.243 INFO:tasks.workunit.client.3.smithi157.stdout:myimage47 6/s 4/s 134 KiB/s 107 KiB/s 1.69 ms 331.53 us 2024-03-26T17:04:48.243 INFO:tasks.workunit.client.3.smithi157.stdout:myimage53 6/s 5/s 135 KiB/s 82 KiB/s 1.56 ms 309.81 us 2024-03-26T17:04:48.243 INFO:tasks.workunit.client.3.smithi157.stdout:myimage60 6/s 4/s 120 KiB/s 120 KiB/s 1.75 ms 294.98 us 2024-03-26T17:04:48.243 INFO:tasks.workunit.client.3.smithi157.stdout:myimage30 6/s 6/s 134 KiB/s 139 KiB/s 1.92 ms 367.37 us 2024-03-26T17:04:48.243 INFO:tasks.workunit.client.3.smithi157.stdout:myimage1 6/s 5/s 121 KiB/s 131 KiB/s 1.47 ms 309.30 us 2024-03-26T17:04:48.243 INFO:tasks.workunit.client.3.smithi157.stdout:myimage6 6/s 6/s 151 KiB/s 127 KiB/s 1.69 ms 302.51 us 2024-03-26T17:04:48.243 INFO:tasks.workunit.client.3.smithi157.stdout:myimage56 6/s 4/s 129 KiB/s 102 KiB/s 1.79 ms 335.64 us 2024-03-26T17:04:48.244 INFO:tasks.workunit.client.3.smithi157.stdout:myimage48 6/s 5/s 78 KiB/s 102 KiB/s 1.79 ms 301.33 us 2024-03-26T17:04:48.244 INFO:tasks.workunit.client.3.smithi157.stdout:myimage49 6/s 3/s 95 KiB/s 118 KiB/s 1.70 ms 366.34 us 2024-03-26T17:04:48.244 INFO:tasks.workunit.client.3.smithi157.stdout:myimage14 5/s 4/s 112 KiB/s 118 KiB/s 1.68 ms 373.69 us 2024-03-26T17:04:48.244 INFO:tasks.workunit.client.3.smithi157.stdout:myimage44 5/s 4/s 132 KiB/s 74 KiB/s 1.65 ms 295.81 us 2024-03-26T17:04:48.244 INFO:tasks.workunit.client.3.smithi157.stdout:myimage58 5/s 6/s 132 KiB/s 147 KiB/s 1.56 ms 355.23 us 2024-03-26T17:04:48.244 INFO:tasks.workunit.client.3.smithi157.stdout:myimage12 5/s 5/s 108 KiB/s 116 KiB/s 1.56 ms 314.66 us 2024-03-26T17:04:48.244 INFO:tasks.workunit.client.3.smithi157.stdout:myimage25 5/s 5/s 128 KiB/s 97 KiB/s 1.92 ms 308.52 us 2024-03-26T17:04:48.244 INFO:tasks.workunit.client.3.smithi157.stdout:myimage27 5/s 5/s 149 KiB/s 103 KiB/s 1.50 ms 279.76 us 2024-03-26T17:04:48.244 INFO:tasks.workunit.client.3.smithi157.stdout:myimage29 5/s 5/s 126 KiB/s 98 KiB/s 1.50 ms 286.14 us 2024-03-26T17:04:48.244 INFO:tasks.workunit.client.3.smithi157.stdout:myimage50 5/s 6/s 125 KiB/s 118 KiB/s 1.77 ms 293.09 us 2024-03-26T17:04:48.244 INFO:tasks.workunit.client.3.smithi157.stdout:myimage54 5/s 5/s 122 KiB/s 137 KiB/s 1.61 ms 392.36 us 2024-03-26T17:04:48.244 INFO:tasks.workunit.client.3.smithi157.stdout:myimage5 5/s 5/s 146 KiB/s 70 KiB/s 1.61 ms 284.02 us 2024-03-26T17:04:48.244 INFO:tasks.workunit.client.3.smithi157.stdout:myimage8 5/s 5/s 121 KiB/s 98 KiB/s 1.67 ms 264.04 us 2024-03-26T17:04:48.245 INFO:tasks.workunit.client.3.smithi157.stdout:myimage42 5/s 5/s 125 KiB/s 127 KiB/s 1.57 ms 368.42 us 2024-03-26T17:04:48.245 INFO:tasks.workunit.client.3.smithi157.stdout:myimage10 5/s 5/s 99 KiB/s 130 KiB/s 1.59 ms 325.45 us 2024-03-26T17:04:48.245 INFO:tasks.workunit.client.3.smithi157.stdout:myimage16 5/s 6/s 151 KiB/s 135 KiB/s 1.55 ms 342.79 us 2024-03-26T17:04:48.245 INFO:tasks.workunit.client.3.smithi157.stdout:myimage19 5/s 5/s 96 KiB/s 141 KiB/s 1.60 ms 385.94 us 2024-03-26T17:04:48.245 INFO:tasks.workunit.client.3.smithi157.stdout:myimage45 5/s 6/s 135 KiB/s 126 KiB/s 1.63 ms 344.91 us 2024-03-26T17:04:48.245 INFO:tasks.workunit.client.3.smithi157.stdout:myimage55 5/s 5/s 112 KiB/s 107 KiB/s 1.67 ms 328.88 us 2024-03-26T17:04:48.245 INFO:tasks.workunit.client.3.smithi157.stdout:myimage2 5/s 5/s 118 KiB/s 140 KiB/s 1.69 ms 335.01 us 2024-03-26T17:04:48.245 INFO:tasks.workunit.client.3.smithi157.stdout:myimage23 5/s 5/s 143 KiB/s 142 KiB/s 1.53 ms 408.05 us 2024-03-26T17:04:48.245 INFO:tasks.workunit.client.3.smithi157.stdout:myimage9 5/s 5/s 114 KiB/s 126 KiB/s 1.74 ms 294.10 us 2024-03-26T17:04:48.245 INFO:tasks.workunit.client.3.smithi157.stdout:myimage11 5/s 4/s 102 KiB/s 83 KiB/s 1.92 ms 301.90 us 2024-03-26T17:04:48.245 INFO:tasks.workunit.client.3.smithi157.stdout:myimage22 5/s 4/s 97 KiB/s 86 KiB/s 1.65 ms 318.69 us 2024-03-26T17:04:48.245 INFO:tasks.workunit.client.3.smithi157.stdout:myimage34 5/s 6/s 106 KiB/s 133 KiB/s 1.76 ms 286.40 us 2024-03-26T17:04:48.245 INFO:tasks.workunit.client.3.smithi157.stdout:myimage33 5/s 6/s 107 KiB/s 126 KiB/s 1.67 ms 324.92 us 2024-03-26T17:04:48.245 INFO:tasks.workunit.client.3.smithi157.stdout:myimage13 4/s 7/s 83 KiB/s 163 KiB/s 1.53 ms 301.12 us 2024-03-26T17:04:48.246 INFO:tasks.workunit.client.3.smithi157.stdout:myimage18 4/s 6/s 94 KiB/s 181 KiB/s 1.61 ms 390.13 us 2024-03-26T17:04:48.246 INFO:tasks.workunit.client.3.smithi157.stdout:myimage21 4/s 6/s 85 KiB/s 130 KiB/s 1.95 ms 318.83 us 2024-03-26T17:04:48.246 INFO:tasks.workunit.client.3.smithi157.stdout:myimage28 4/s 5/s 103 KiB/s 132 KiB/s 1.89 ms 315.49 us 2024-03-26T17:04:48.246 INFO:tasks.workunit.client.3.smithi157.stdout:myimage43 4/s 5/s 95 KiB/s 118 KiB/s 1.65 ms 301.37 us 2024-03-26T17:04:48.246 INFO:tasks.workunit.client.3.smithi157.stdout:myimage31 4/s 7/s 93 KiB/s 154 KiB/s 1.86 ms 409.09 us 2024-03-26T17:04:48.246 INFO:tasks.workunit.client.3.smithi157.stdout:myimage38 4/s 5/s 92 KiB/s 147 KiB/s 1.45 ms 318.31 us 2024-03-26T17:04:48.246 INFO:tasks.workunit.client.3.smithi157.stdout:myimage4 4/s 6/s 139 KiB/s 160 KiB/s 1.55 ms 335.29 us 2024-03-26T17:04:48.246 INFO:tasks.workunit.client.3.smithi157.stdout:myimage17 4/s 7/s 109 KiB/s 161 KiB/s 1.76 ms 332.50 us 2024-03-26T17:04:48.246 INFO:tasks.workunit.client.3.smithi157.stdout:myimage20 4/s 6/s 98 KiB/s 139 KiB/s 1.61 ms 325.18 us 2024-03-26T17:04:48.246 INFO:tasks.workunit.client.3.smithi157.stdout:myimage24 4/s 6/s 89 KiB/s 170 KiB/s 1.75 ms 306.96 us 2024-03-26T17:04:48.246 INFO:tasks.workunit.client.3.smithi157.stdout:myimage46 4/s 7/s 98 KiB/s 159 KiB/s 1.59 ms 375.42 us 2024-03-26T17:04:48.246 INFO:tasks.workunit.client.3.smithi157.stdout:myimage3 4/s 6/s 96 KiB/s 178 KiB/s 1.53 ms 310.76 us 2024-03-26T17:04:48.246 INFO:tasks.workunit.client.3.smithi157.stdout:myimage52 4/s 5/s 115 KiB/s 146 KiB/s 1.76 ms 300.90 us 2024-03-26T17:04:48.247 INFO:tasks.workunit.client.3.smithi157.stdout:myimage26 4/s 5/s 92 KiB/s 91 KiB/s 1.65 ms 327.48 us 2024-03-26T17:04:48.247 INFO:tasks.workunit.client.3.smithi157.stdout:myimage51 4/s 6/s 86 KiB/s 143 KiB/s 1.72 ms 364.48 us 2024-03-26T17:04:48.247 INFO:tasks.workunit.client.3.smithi157.stdout:myimage57 3/s 7/s 102 KiB/s 159 KiB/s 1.59 ms 284.77 us 2024-03-26T17:04:48.247 INFO:tasks.workunit.client.3.smithi157.stdout:myimage59 3/s 7/s 66 KiB/s 169 KiB/s 1.68 ms 366.36 us 2024-03-26T17:04:48.247 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:04:49.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:04:49 smithi064 ceph-mon[34420]: pgmap v565: 33 pgs: 33 active+clean; 1024 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 7.2 MiB/s rd, 7.1 MiB/s wr, 652 op/s 2024-03-26T17:04:49.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:04:49 smithi064 ceph-mon[34420]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:04:49.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:04:49 smithi064 ceph-mon[34420]: { 2024-03-26T17:04:49.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:04:49 smithi064 ceph-mon[34420]: "prefix": "rbd perf image stats", 2024-03-26T17:04:49.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:04:49 smithi064 ceph-mon[34420]: "pool_spec": "mypool", 2024-03-26T17:04:49.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:04:49 smithi064 ceph-mon[34420]: "sort_by": "write_ops", 2024-03-26T17:04:49.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:04:49 smithi064 ceph-mon[34420]: "format": "json" 2024-03-26T17:04:49.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:04:49 smithi064 ceph-mon[34420]: }"]: dispatch 2024-03-26T17:04:49.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:04:49 smithi064 ceph-mon[34420]: Health check update: 3 slow ops, oldest one blocked for 383 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:04:49.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:04:49 smithi149 ceph-mon[34678]: pgmap v565: 33 pgs: 33 active+clean; 1024 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 7.2 MiB/s rd, 7.1 MiB/s wr, 652 op/s 2024-03-26T17:04:49.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:04:49 smithi149 ceph-mon[34678]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:04:49.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:04:49 smithi149 ceph-mon[34678]: { 2024-03-26T17:04:49.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:04:49 smithi149 ceph-mon[34678]: "prefix": "rbd perf image stats", 2024-03-26T17:04:49.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:04:49 smithi149 ceph-mon[34678]: "pool_spec": "mypool", 2024-03-26T17:04:49.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:04:49 smithi149 ceph-mon[34678]: "sort_by": "write_ops", 2024-03-26T17:04:49.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:04:49 smithi149 ceph-mon[34678]: "format": "json" 2024-03-26T17:04:49.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:04:49 smithi149 ceph-mon[34678]: }"]: dispatch 2024-03-26T17:04:49.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:04:49 smithi149 ceph-mon[34678]: Health check update: 3 slow ops, oldest one blocked for 383 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:04:49.765 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:04:49 smithi044 ceph-mon[30624]: pgmap v565: 33 pgs: 33 active+clean; 1024 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 7.2 MiB/s rd, 7.1 MiB/s wr, 652 op/s 2024-03-26T17:04:49.765 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:04:49 smithi044 ceph-mon[30624]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:04:49.765 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:04:49 smithi044 ceph-mon[30624]: { 2024-03-26T17:04:49.765 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:04:49 smithi044 ceph-mon[30624]: "prefix": "rbd perf image stats", 2024-03-26T17:04:49.765 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:04:49 smithi044 ceph-mon[30624]: "pool_spec": "mypool", 2024-03-26T17:04:49.765 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:04:49 smithi044 ceph-mon[30624]: "sort_by": "write_ops", 2024-03-26T17:04:49.765 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:04:49 smithi044 ceph-mon[30624]: "format": "json" 2024-03-26T17:04:49.765 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:04:49 smithi044 ceph-mon[30624]: }"]: dispatch 2024-03-26T17:04:49.766 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:04:49 smithi044 ceph-mon[30624]: Health check update: 3 slow ops, oldest one blocked for 383 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:04:49.766 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:04:49 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:04:49] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:04:49.766 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:04:49 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:04:49] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:04:49.766 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:04:49 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:04:50.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:04:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:04:49] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:04:50.147 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:04:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:04:49] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:04:50.147 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:04:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:04:51.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:04:51 smithi064 ceph-mon[34420]: pgmap v566: 33 pgs: 33 active+clean; 1024 MiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 7.4 MiB/s rd, 7.4 MiB/s wr, 690 op/s 2024-03-26T17:04:51.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:04:51 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 2024-03-26T17:04:51.221+0000 7fa707a55700 -1 mon.c@1(peon) e3 get_health_metrics reporting 3 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T17:04:51.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:04:51 smithi149 ceph-mon[34678]: pgmap v566: 33 pgs: 33 active+clean; 1024 MiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 7.4 MiB/s rd, 7.4 MiB/s wr, 690 op/s 2024-03-26T17:04:51.765 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:04:51 smithi044 ceph-mon[30624]: pgmap v566: 33 pgs: 33 active+clean; 1024 MiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 7.4 MiB/s rd, 7.4 MiB/s wr, 690 op/s 2024-03-26T17:04:51.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:04:51 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:04:51] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:04:51.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:04:51 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:04:51] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:04:51.766 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:04:51 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:04:52.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:04:51 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:04:51] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:04:52.147 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:04:51 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:04:51] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:04:52.147 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:04:51 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:04:53.061 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:04:53.071 INFO:tasks.workunit.client.3.smithi157.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2024-03-26T17:04:53.071 INFO:tasks.workunit.client.3.smithi157.stdout: 10.80 108.8k 138.8k 0.0k 1.1M 1.4M 0.0k nvme2n1 2024-03-26T17:04:53.071 INFO:tasks.workunit.client.3.smithi157.stdout: 10.90 94.8k 126.4k 0.0k 948.0k 1.2M 0.0k nvme2n10 2024-03-26T17:04:53.071 INFO:tasks.workunit.client.3.smithi157.stdout: 10.90 104.0k 102.8k 0.0k 1.0M 1.0M 0.0k nvme2n11 2024-03-26T17:04:53.071 INFO:tasks.workunit.client.3.smithi157.stdout: 10.80 130.8k 103.2k 0.0k 1.3M 1.0M 0.0k nvme2n12 2024-03-26T17:04:53.071 INFO:tasks.workunit.client.3.smithi157.stdout: 10.80 118.8k 109.6k 0.0k 1.2M 1.1M 0.0k nvme2n13 2024-03-26T17:04:53.071 INFO:tasks.workunit.client.3.smithi157.stdout: 10.80 148.4k 119.2k 0.0k 1.4M 1.2M 0.0k nvme2n14 2024-03-26T17:04:53.071 INFO:tasks.workunit.client.3.smithi157.stdout: 10.80 88.8k 124.4k 0.0k 888.0k 1.2M 0.0k nvme2n15 2024-03-26T17:04:53.071 INFO:tasks.workunit.client.3.smithi157.stdout: 10.80 99.2k 146.4k 0.0k 992.0k 1.4M 0.0k nvme2n16 2024-03-26T17:04:53.072 INFO:tasks.workunit.client.3.smithi157.stdout: 10.80 131.2k 104.8k 0.0k 1.3M 1.0M 0.0k nvme2n17 2024-03-26T17:04:53.072 INFO:tasks.workunit.client.3.smithi157.stdout: 10.80 122.8k 99.6k 0.0k 1.2M 996.0k 0.0k nvme2n18 2024-03-26T17:04:53.072 INFO:tasks.workunit.client.3.smithi157.stdout: 10.80 150.8k 109.6k 0.0k 1.5M 1.1M 0.0k nvme2n19 2024-03-26T17:04:53.072 INFO:tasks.workunit.client.3.smithi157.stdout: 10.80 92.4k 117.2k 0.0k 924.0k 1.1M 0.0k nvme2n2 2024-03-26T17:04:53.072 INFO:tasks.workunit.client.3.smithi157.stdout: 10.80 83.2k 130.4k 0.0k 832.0k 1.3M 0.0k nvme2n20 2024-03-26T17:04:53.072 INFO:tasks.workunit.client.3.smithi157.stdout: 10.80 147.6k 114.4k 0.0k 1.4M 1.1M 0.0k nvme2n3 2024-03-26T17:04:53.072 INFO:tasks.workunit.client.3.smithi157.stdout: 10.80 113.6k 119.6k 0.0k 1.1M 1.2M 0.0k nvme2n4 2024-03-26T17:04:53.072 INFO:tasks.workunit.client.3.smithi157.stdout: 10.80 111.6k 95.2k 0.0k 1.1M 952.0k 0.0k nvme2n5 2024-03-26T17:04:53.072 INFO:tasks.workunit.client.3.smithi157.stdout: 10.90 104.4k 104.4k 0.0k 1.0M 1.0M 0.0k nvme2n6 2024-03-26T17:04:53.072 INFO:tasks.workunit.client.3.smithi157.stdout: 10.90 91.2k 108.8k 0.0k 912.0k 1.1M 0.0k nvme2n7 2024-03-26T17:04:53.072 INFO:tasks.workunit.client.3.smithi157.stdout: 10.90 92.8k 122.4k 0.0k 928.0k 1.2M 0.0k nvme2n8 2024-03-26T17:04:53.072 INFO:tasks.workunit.client.3.smithi157.stdout: 10.90 110.4k 127.2k 0.0k 1.1M 1.2M 0.0k nvme2n9 2024-03-26T17:04:53.072 INFO:tasks.workunit.client.3.smithi157.stdout: 10.80 112.0k 105.6k 0.0k 1.1M 1.0M 0.0k nvme5n1 2024-03-26T17:04:53.072 INFO:tasks.workunit.client.3.smithi157.stdout: 10.90 100.0k 130.4k 0.0k 1000.0k 1.3M 0.0k nvme5n10 2024-03-26T17:04:53.073 INFO:tasks.workunit.client.3.smithi157.stdout: 10.90 145.2k 112.4k 0.0k 1.4M 1.1M 0.0k nvme5n11 2024-03-26T17:04:53.073 INFO:tasks.workunit.client.3.smithi157.stdout: 10.80 133.2k 102.8k 0.0k 1.3M 1.0M 0.0k nvme5n12 2024-03-26T17:04:53.073 INFO:tasks.workunit.client.3.smithi157.stdout: 10.80 111.6k 105.6k 0.0k 1.1M 1.0M 0.0k nvme5n13 2024-03-26T17:04:53.073 INFO:tasks.workunit.client.3.smithi157.stdout: 10.80 106.0k 93.2k 0.0k 1.0M 932.0k 0.0k nvme5n14 2024-03-26T17:04:53.073 INFO:tasks.workunit.client.3.smithi157.stdout: 10.80 108.8k 130.0k 0.0k 1.1M 1.3M 0.0k nvme5n15 2024-03-26T17:04:53.073 INFO:tasks.workunit.client.3.smithi157.stdout: 10.80 119.6k 107.2k 0.0k 1.2M 1.0M 0.0k nvme5n16 2024-03-26T17:04:53.073 INFO:tasks.workunit.client.3.smithi157.stdout: 10.80 101.6k 114.0k 0.0k 1016.0k 1.1M 0.0k nvme5n17 2024-03-26T17:04:53.073 INFO:tasks.workunit.client.3.smithi157.stdout: 10.80 126.8k 127.2k 0.0k 1.2M 1.2M 0.0k nvme5n18 2024-03-26T17:04:53.073 INFO:tasks.workunit.client.3.smithi157.stdout: 10.80 122.0k 106.4k 0.0k 1.2M 1.0M 0.0k nvme5n19 2024-03-26T17:04:53.073 INFO:tasks.workunit.client.3.smithi157.stdout: 10.80 118.0k 123.6k 0.0k 1.2M 1.2M 0.0k nvme5n2 2024-03-26T17:04:53.073 INFO:tasks.workunit.client.3.smithi157.stdout: 10.80 116.4k 117.2k 0.0k 1.1M 1.1M 0.0k nvme5n20 2024-03-26T17:04:53.073 INFO:tasks.workunit.client.3.smithi157.stdout: 10.80 105.6k 124.0k 0.0k 1.0M 1.2M 0.0k nvme5n3 2024-03-26T17:04:53.073 INFO:tasks.workunit.client.3.smithi157.stdout: 10.80 164.4k 85.2k 0.0k 1.6M 852.0k 0.0k nvme5n4 2024-03-26T17:04:53.073 INFO:tasks.workunit.client.3.smithi157.stdout: 10.80 94.4k 126.8k 0.0k 944.0k 1.2M 0.0k nvme5n5 2024-03-26T17:04:53.074 INFO:tasks.workunit.client.3.smithi157.stdout: 10.80 110.8k 127.2k 0.0k 1.1M 1.2M 0.0k nvme5n6 2024-03-26T17:04:53.074 INFO:tasks.workunit.client.3.smithi157.stdout: 10.90 82.4k 154.0k 0.0k 824.0k 1.5M 0.0k nvme5n7 2024-03-26T17:04:53.074 INFO:tasks.workunit.client.3.smithi157.stdout: 10.90 149.2k 100.4k 0.0k 1.5M 1004.0k 0.0k nvme5n8 2024-03-26T17:04:53.074 INFO:tasks.workunit.client.3.smithi157.stdout: 10.90 121.6k 108.4k 0.0k 1.2M 1.1M 0.0k nvme5n9 2024-03-26T17:04:53.074 INFO:tasks.workunit.client.3.smithi157.stdout: 10.80 117.2k 130.8k 0.0k 1.1M 1.3M 0.0k nvme8n1 2024-03-26T17:04:53.074 INFO:tasks.workunit.client.3.smithi157.stdout: 10.90 104.4k 113.6k 0.0k 1.0M 1.1M 0.0k nvme8n10 2024-03-26T17:04:53.074 INFO:tasks.workunit.client.3.smithi157.stdout: 10.90 101.2k 124.8k 0.0k 1012.0k 1.2M 0.0k nvme8n11 2024-03-26T17:04:53.074 INFO:tasks.workunit.client.3.smithi157.stdout: 10.80 95.2k 144.0k 0.0k 952.0k 1.4M 0.0k nvme8n12 2024-03-26T17:04:53.074 INFO:tasks.workunit.client.3.smithi157.stdout: 10.80 90.8k 122.8k 0.0k 908.0k 1.2M 0.0k nvme8n13 2024-03-26T17:04:53.074 INFO:tasks.workunit.client.3.smithi157.stdout: 10.80 106.0k 115.6k 0.0k 1.0M 1.1M 0.0k nvme8n14 2024-03-26T17:04:53.074 INFO:tasks.workunit.client.3.smithi157.stdout: 10.80 90.8k 152.4k 0.0k 908.0k 1.5M 0.0k nvme8n15 2024-03-26T17:04:53.074 INFO:tasks.workunit.client.3.smithi157.stdout: 10.80 122.8k 125.6k 0.0k 1.2M 1.2M 0.0k nvme8n16 2024-03-26T17:04:53.074 INFO:tasks.workunit.client.3.smithi157.stdout: 10.80 126.4k 111.6k 0.0k 1.2M 1.1M 0.0k nvme8n17 2024-03-26T17:04:53.074 INFO:tasks.workunit.client.3.smithi157.stdout: 10.80 113.2k 125.6k 0.0k 1.1M 1.2M 0.0k nvme8n18 2024-03-26T17:04:53.074 INFO:tasks.workunit.client.3.smithi157.stdout: 10.80 108.4k 116.0k 0.0k 1.1M 1.1M 0.0k nvme8n19 2024-03-26T17:04:53.075 INFO:tasks.workunit.client.3.smithi157.stdout: 10.80 107.2k 112.0k 0.0k 1.0M 1.1M 0.0k nvme8n2 2024-03-26T17:04:53.075 INFO:tasks.workunit.client.3.smithi157.stdout: 10.80 97.6k 129.2k 0.0k 976.0k 1.3M 0.0k nvme8n20 2024-03-26T17:04:53.075 INFO:tasks.workunit.client.3.smithi157.stdout: 10.80 104.4k 91.2k 0.0k 1.0M 912.0k 0.0k nvme8n3 2024-03-26T17:04:53.075 INFO:tasks.workunit.client.3.smithi157.stdout: 10.80 107.6k 148.8k 0.0k 1.1M 1.5M 0.0k nvme8n4 2024-03-26T17:04:53.075 INFO:tasks.workunit.client.3.smithi157.stdout: 10.80 115.6k 88.0k 0.0k 1.1M 880.0k 0.0k nvme8n5 2024-03-26T17:04:53.075 INFO:tasks.workunit.client.3.smithi157.stdout: 10.90 136.4k 97.6k 0.0k 1.3M 976.0k 0.0k nvme8n6 2024-03-26T17:04:53.075 INFO:tasks.workunit.client.3.smithi157.stdout: 10.90 126.0k 102.8k 0.0k 1.2M 1.0M 0.0k nvme8n7 2024-03-26T17:04:53.075 INFO:tasks.workunit.client.3.smithi157.stdout: 10.90 123.2k 89.6k 0.0k 1.2M 896.0k 0.0k nvme8n8 2024-03-26T17:04:53.075 INFO:tasks.workunit.client.3.smithi157.stdout: 10.90 116.0k 131.2k 0.0k 1.1M 1.3M 0.0k nvme8n9 2024-03-26T17:04:53.075 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:04:53.246 INFO:tasks.workunit.client.3.smithi157.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-26T17:04:53.246 INFO:tasks.workunit.client.3.smithi157.stdout:myimage10 7/s 4/s 146 KiB/s 90 KiB/s 1.60 ms 295.59 us 2024-03-26T17:04:53.246 INFO:tasks.workunit.client.3.smithi157.stdout:myimage27 6/s 4/s 154 KiB/s 69 KiB/s 1.61 ms 282.02 us 2024-03-26T17:04:53.246 INFO:tasks.workunit.client.3.smithi157.stdout:myimage23 6/s 5/s 150 KiB/s 108 KiB/s 1.51 ms 313.25 us 2024-03-26T17:04:53.246 INFO:tasks.workunit.client.3.smithi157.stdout:myimage49 6/s 5/s 145 KiB/s 119 KiB/s 1.65 ms 320.80 us 2024-03-26T17:04:53.247 INFO:tasks.workunit.client.3.smithi157.stdout:myimage52 6/s 4/s 145 KiB/s 84 KiB/s 1.92 ms 313.76 us 2024-03-26T17:04:53.247 INFO:tasks.workunit.client.3.smithi157.stdout:myimage25 6/s 4/s 137 KiB/s 105 KiB/s 1.95 ms 286.60 us 2024-03-26T17:04:53.247 INFO:tasks.workunit.client.3.smithi157.stdout:myimage26 6/s 5/s 165 KiB/s 127 KiB/s 1.73 ms 386.84 us 2024-03-26T17:04:53.247 INFO:tasks.workunit.client.3.smithi157.stdout:myimage54 6/s 5/s 136 KiB/s 106 KiB/s 1.65 ms 352.52 us 2024-03-26T17:04:53.247 INFO:tasks.workunit.client.3.smithi157.stdout:myimage55 6/s 4/s 188 KiB/s 94 KiB/s 1.84 ms 312.94 us 2024-03-26T17:04:53.247 INFO:tasks.workunit.client.3.smithi157.stdout:myimage56 6/s 5/s 156 KiB/s 114 KiB/s 1.90 ms 455.31 us 2024-03-26T17:04:53.247 INFO:tasks.workunit.client.3.smithi157.stdout:myimage59 6/s 4/s 150 KiB/s 80 KiB/s 1.75 ms 305.73 us 2024-03-26T17:04:53.247 INFO:tasks.workunit.client.3.smithi157.stdout:myimage2 6/s 4/s 130 KiB/s 70 KiB/s 1.67 ms 265.45 us 2024-03-26T17:04:53.247 INFO:tasks.workunit.client.3.smithi157.stdout:myimage32 6/s 4/s 101 KiB/s 140 KiB/s 1.70 ms 334.55 us 2024-03-26T17:04:53.247 INFO:tasks.workunit.client.3.smithi157.stdout:myimage51 6/s 5/s 132 KiB/s 98 KiB/s 1.78 ms 284.52 us 2024-03-26T17:04:53.247 INFO:tasks.workunit.client.3.smithi157.stdout:myimage3 6/s 5/s 136 KiB/s 116 KiB/s 1.45 ms 374.57 us 2024-03-26T17:04:53.247 INFO:tasks.workunit.client.3.smithi157.stdout:myimage14 6/s 6/s 125 KiB/s 174 KiB/s 1.77 ms 390.67 us 2024-03-26T17:04:53.247 INFO:tasks.workunit.client.3.smithi157.stdout:myimage22 6/s 6/s 139 KiB/s 142 KiB/s 1.68 ms 276.37 us 2024-03-26T17:04:53.247 INFO:tasks.workunit.client.3.smithi157.stdout:myimage34 6/s 5/s 102 KiB/s 99 KiB/s 1.59 ms 334.31 us 2024-03-26T17:04:53.248 INFO:tasks.workunit.client.3.smithi157.stdout:myimage4 6/s 3/s 129 KiB/s 65 KiB/s 1.54 ms 305.78 us 2024-03-26T17:04:53.248 INFO:tasks.workunit.client.3.smithi157.stdout:myimage5 6/s 5/s 101 KiB/s 127 KiB/s 1.60 ms 308.38 us 2024-03-26T17:04:53.248 INFO:tasks.workunit.client.3.smithi157.stdout:myimage8 6/s 5/s 106 KiB/s 77 KiB/s 1.60 ms 347.94 us 2024-03-26T17:04:53.248 INFO:tasks.workunit.client.3.smithi157.stdout:myimage35 5/s 5/s 126 KiB/s 103 KiB/s 1.63 ms 255.13 us 2024-03-26T17:04:53.248 INFO:tasks.workunit.client.3.smithi157.stdout:myimage1 5/s 4/s 129 KiB/s 100 KiB/s 1.47 ms 316.36 us 2024-03-26T17:04:53.248 INFO:tasks.workunit.client.3.smithi157.stdout:myimage17 5/s 5/s 114 KiB/s 110 KiB/s 1.65 ms 314.58 us 2024-03-26T17:04:53.248 INFO:tasks.workunit.client.3.smithi157.stdout:myimage19 5/s 5/s 109 KiB/s 121 KiB/s 1.65 ms 287.89 us 2024-03-26T17:04:53.248 INFO:tasks.workunit.client.3.smithi157.stdout:myimage20 5/s 5/s 126 KiB/s 73 KiB/s 1.57 ms 286.92 us 2024-03-26T17:04:53.248 INFO:tasks.workunit.client.3.smithi157.stdout:myimage33 5/s 5/s 90 KiB/s 114 KiB/s 1.64 ms 413.11 us 2024-03-26T17:04:53.248 INFO:tasks.workunit.client.3.smithi157.stdout:myimage39 5/s 4/s 104 KiB/s 132 KiB/s 1.64 ms 356.49 us 2024-03-26T17:04:53.248 INFO:tasks.workunit.client.3.smithi157.stdout:myimage46 5/s 4/s 107 KiB/s 119 KiB/s 1.66 ms 305.81 us 2024-03-26T17:04:53.248 INFO:tasks.workunit.client.3.smithi157.stdout:myimage16 5/s 5/s 127 KiB/s 86 KiB/s 1.59 ms 273.64 us 2024-03-26T17:04:53.248 INFO:tasks.workunit.client.3.smithi157.stdout:myimage21 5/s 5/s 119 KiB/s 107 KiB/s 1.96 ms 404.59 us 2024-03-26T17:04:53.248 INFO:tasks.workunit.client.3.smithi157.stdout:myimage53 5/s 5/s 122 KiB/s 102 KiB/s 1.68 ms 342.27 us 2024-03-26T17:04:53.249 INFO:tasks.workunit.client.3.smithi157.stdout:myimage57 5/s 5/s 142 KiB/s 137 KiB/s 1.65 ms 300.00 us 2024-03-26T17:04:53.249 INFO:tasks.workunit.client.3.smithi157.stdout:myimage60 5/s 5/s 122 KiB/s 112 KiB/s 1.75 ms 259.58 us 2024-03-26T17:04:53.249 INFO:tasks.workunit.client.3.smithi157.stdout:myimage13 5/s 4/s 129 KiB/s 100 KiB/s 1.61 ms 296.74 us 2024-03-26T17:04:53.249 INFO:tasks.workunit.client.3.smithi157.stdout:myimage28 5/s 6/s 115 KiB/s 158 KiB/s 1.94 ms 423.60 us 2024-03-26T17:04:53.249 INFO:tasks.workunit.client.3.smithi157.stdout:myimage41 5/s 5/s 99 KiB/s 130 KiB/s 1.71 ms 292.41 us 2024-03-26T17:04:53.249 INFO:tasks.workunit.client.3.smithi157.stdout:myimage30 5/s 5/s 136 KiB/s 82 KiB/s 1.95 ms 285.88 us 2024-03-26T17:04:53.249 INFO:tasks.workunit.client.3.smithi157.stdout:myimage37 5/s 5/s 129 KiB/s 96 KiB/s 1.70 ms 313.08 us 2024-03-26T17:04:53.249 INFO:tasks.workunit.client.3.smithi157.stdout:myimage44 5/s 5/s 133 KiB/s 100 KiB/s 1.75 ms 321.95 us 2024-03-26T17:04:53.249 INFO:tasks.workunit.client.3.smithi157.stdout:myimage48 5/s 6/s 103 KiB/s 134 KiB/s 1.73 ms 277.71 us 2024-03-26T17:04:53.249 INFO:tasks.workunit.client.3.smithi157.stdout:myimage15 5/s 5/s 98 KiB/s 112 KiB/s 1.58 ms 369.48 us 2024-03-26T17:04:53.249 INFO:tasks.workunit.client.3.smithi157.stdout:myimage42 5/s 6/s 106 KiB/s 106 KiB/s 1.63 ms 317.06 us 2024-03-26T17:04:53.249 INFO:tasks.workunit.client.3.smithi157.stdout:myimage31 5/s 6/s 130 KiB/s 154 KiB/s 1.86 ms 329.30 us 2024-03-26T17:04:53.249 INFO:tasks.workunit.client.3.smithi157.stdout:myimage38 5/s 5/s 118 KiB/s 121 KiB/s 1.46 ms 289.53 us 2024-03-26T17:04:53.249 INFO:tasks.workunit.client.3.smithi157.stdout:myimage47 5/s 4/s 86 KiB/s 114 KiB/s 1.79 ms 452.27 us 2024-03-26T17:04:53.249 INFO:tasks.workunit.client.3.smithi157.stdout:myimage7 5/s 5/s 78 KiB/s 83 KiB/s 1.68 ms 295.76 us 2024-03-26T17:04:53.250 INFO:tasks.workunit.client.3.smithi157.stdout:myimage11 5/s 5/s 111 KiB/s 128 KiB/s 1.68 ms 310.69 us 2024-03-26T17:04:53.250 INFO:tasks.workunit.client.3.smithi157.stdout:myimage58 4/s 5/s 126 KiB/s 106 KiB/s 1.62 ms 404.56 us 2024-03-26T17:04:53.250 INFO:tasks.workunit.client.3.smithi157.stdout:myimage24 4/s 6/s 102 KiB/s 139 KiB/s 1.68 ms 375.73 us 2024-03-26T17:04:53.250 INFO:tasks.workunit.client.3.smithi157.stdout:myimage29 4/s 4/s 115 KiB/s 85 KiB/s 1.55 ms 334.30 us 2024-03-26T17:04:53.250 INFO:tasks.workunit.client.3.smithi157.stdout:myimage40 4/s 6/s 86 KiB/s 135 KiB/s 1.59 ms 335.31 us 2024-03-26T17:04:53.250 INFO:tasks.workunit.client.3.smithi157.stdout:myimage12 4/s 5/s 101 KiB/s 146 KiB/s 1.64 ms 309.37 us 2024-03-26T17:04:53.250 INFO:tasks.workunit.client.3.smithi157.stdout:myimage36 4/s 4/s 82 KiB/s 113 KiB/s 1.62 ms 381.80 us 2024-03-26T17:04:53.250 INFO:tasks.workunit.client.3.smithi157.stdout:myimage50 4/s 5/s 74 KiB/s 117 KiB/s 1.73 ms 334.44 us 2024-03-26T17:04:53.250 INFO:tasks.workunit.client.3.smithi157.stdout:myimage6 4/s 6/s 70 KiB/s 108 KiB/s 1.71 ms 304.50 us 2024-03-26T17:04:53.250 INFO:tasks.workunit.client.3.smithi157.stdout:myimage18 4/s 6/s 76 KiB/s 122 KiB/s 1.61 ms 326.64 us 2024-03-26T17:04:53.250 INFO:tasks.workunit.client.3.smithi157.stdout:myimage43 4/s 6/s 99 KiB/s 108 KiB/s 1.77 ms 371.24 us 2024-03-26T17:04:53.250 INFO:tasks.workunit.client.3.smithi157.stdout:myimage45 4/s 7/s 60 KiB/s 142 KiB/s 1.71 ms 278.42 us 2024-03-26T17:04:53.250 INFO:tasks.workunit.client.3.smithi157.stdout:myimage9 3/s 6/s 91 KiB/s 124 KiB/s 1.81 ms 340.38 us 2024-03-26T17:04:53.250 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:04:53.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:04:53 smithi064 ceph-mon[34420]: pgmap v567: 33 pgs: 33 active+clean; 1024 MiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 6.4 MiB/s rd, 6.4 MiB/s wr, 610 op/s 2024-03-26T17:04:53.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:04:53 smithi149 ceph-mon[34678]: pgmap v567: 33 pgs: 33 active+clean; 1024 MiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 6.4 MiB/s rd, 6.4 MiB/s wr, 610 op/s 2024-03-26T17:04:53.765 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:04:53 smithi044 ceph-mon[30624]: pgmap v567: 33 pgs: 33 active+clean; 1024 MiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 6.4 MiB/s rd, 6.4 MiB/s wr, 610 op/s 2024-03-26T17:04:53.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:04:53 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:04:53] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:04:53.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:04:53 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:04:53] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:04:53.766 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:04:53 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:04:54.147 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:04:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:04:53] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:04:54.147 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:04:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:04:53] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:04:54.147 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:04:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:04:54.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:04:54 smithi149 ceph-mon[34678]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:04:54.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:04:54 smithi149 ceph-mon[34678]: { 2024-03-26T17:04:54.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:04:54 smithi149 ceph-mon[34678]: "prefix": "rbd perf image stats", 2024-03-26T17:04:54.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:04:54 smithi149 ceph-mon[34678]: "pool_spec": "mypool", 2024-03-26T17:04:54.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:04:54 smithi149 ceph-mon[34678]: "sort_by": "write_ops", 2024-03-26T17:04:54.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:04:54 smithi149 ceph-mon[34678]: "format": "json" 2024-03-26T17:04:54.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:04:54 smithi149 ceph-mon[34678]: }"]: dispatch 2024-03-26T17:04:54.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:04:54 smithi149 ceph-mon[34678]: Health check update: 3 slow ops, oldest one blocked for 388 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:04:54.765 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:04:54 smithi044 ceph-mon[30624]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:04:54.765 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:04:54 smithi044 ceph-mon[30624]: { 2024-03-26T17:04:54.765 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:04:54 smithi044 ceph-mon[30624]: "prefix": "rbd perf image stats", 2024-03-26T17:04:54.765 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:04:54 smithi044 ceph-mon[30624]: "pool_spec": "mypool", 2024-03-26T17:04:54.765 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:04:54 smithi044 ceph-mon[30624]: "sort_by": "write_ops", 2024-03-26T17:04:54.765 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:04:54 smithi044 ceph-mon[30624]: "format": "json" 2024-03-26T17:04:54.765 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:04:54 smithi044 ceph-mon[30624]: }"]: dispatch 2024-03-26T17:04:54.765 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:04:54 smithi044 ceph-mon[30624]: Health check update: 3 slow ops, oldest one blocked for 388 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:04:54.805 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:04:54 smithi064 ceph-mon[34420]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:04:54.806 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:04:54 smithi064 ceph-mon[34420]: { 2024-03-26T17:04:54.806 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:04:54 smithi064 ceph-mon[34420]: "prefix": "rbd perf image stats", 2024-03-26T17:04:54.806 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:04:54 smithi064 ceph-mon[34420]: "pool_spec": "mypool", 2024-03-26T17:04:54.806 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:04:54 smithi064 ceph-mon[34420]: "sort_by": "write_ops", 2024-03-26T17:04:54.806 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:04:54 smithi064 ceph-mon[34420]: "format": "json" 2024-03-26T17:04:54.806 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:04:54 smithi064 ceph-mon[34420]: }"]: dispatch 2024-03-26T17:04:54.806 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:04:54 smithi064 ceph-mon[34420]: Health check update: 3 slow ops, oldest one blocked for 388 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:04:55.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:04:55 smithi149 ceph-mon[34678]: pgmap v568: 33 pgs: 33 active+clean; 1024 MiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 7.4 MiB/s rd, 7.5 MiB/s wr, 714 op/s 2024-03-26T17:04:55.667 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:04:55 smithi044 ceph-mon[30624]: pgmap v568: 33 pgs: 33 active+clean; 1024 MiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 7.4 MiB/s rd, 7.5 MiB/s wr, 714 op/s 2024-03-26T17:04:55.667 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:04:55 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:04:55] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:04:55.667 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:04:55 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:04:55] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:04:55.667 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:04:55 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:04:55.805 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:04:55 smithi064 ceph-mon[34420]: pgmap v568: 33 pgs: 33 active+clean; 1024 MiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 7.4 MiB/s rd, 7.5 MiB/s wr, 714 op/s 2024-03-26T17:04:56.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:04:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:04:55] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:04:56.147 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:04:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:04:55] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:04:56.147 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:04:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:04:56.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:04:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 2024-03-26T17:04:56.221+0000 7fa707a55700 -1 mon.c@1(peon) e3 get_health_metrics reporting 3 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T17:04:57.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:04:57 smithi149 ceph-mon[34678]: pgmap v569: 33 pgs: 33 active+clean; 1024 MiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 6.5 MiB/s rd, 6.7 MiB/s wr, 643 op/s 2024-03-26T17:04:57.765 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:04:57 smithi044 ceph-mon[30624]: pgmap v569: 33 pgs: 33 active+clean; 1024 MiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 6.5 MiB/s rd, 6.7 MiB/s wr, 643 op/s 2024-03-26T17:04:57.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:04:57 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:04:57] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:04:57.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:04:57 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:04:57] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:04:57.766 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:04:57 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:04:57.805 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:04:57 smithi064 ceph-mon[34420]: pgmap v569: 33 pgs: 33 active+clean; 1024 MiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 6.5 MiB/s rd, 6.7 MiB/s wr, 643 op/s 2024-03-26T17:04:58.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:04:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:04:57] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:04:58.147 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:04:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:04:57] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:04:58.147 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:04:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:04:58.251 INFO:tasks.workunit.client.3.smithi157.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-26T17:04:58.251 INFO:tasks.workunit.client.3.smithi157.stdout:myimage52 7/s 3/s 114 KiB/s 75 KiB/s 1.74 ms 306.93 us 2024-03-26T17:04:58.251 INFO:tasks.workunit.client.3.smithi157.stdout:myimage44 7/s 4/s 150 KiB/s 115 KiB/s 1.72 ms 356.50 us 2024-03-26T17:04:58.251 INFO:tasks.workunit.client.3.smithi157.stdout:myimage6 6/s 5/s 134 KiB/s 115 KiB/s 1.68 ms 345.72 us 2024-03-26T17:04:58.251 INFO:tasks.workunit.client.3.smithi157.stdout:myimage43 6/s 4/s 145 KiB/s 93 KiB/s 1.83 ms 1.02 ms 2024-03-26T17:04:58.251 INFO:tasks.workunit.client.3.smithi157.stdout:myimage55 6/s 4/s 134 KiB/s 81 KiB/s 1.76 ms 346.54 us 2024-03-26T17:04:58.251 INFO:tasks.workunit.client.3.smithi157.stdout:myimage47 6/s 6/s 120 KiB/s 122 KiB/s 1.77 ms 341.77 us 2024-03-26T17:04:58.251 INFO:tasks.workunit.client.3.smithi157.stdout:myimage1 6/s 4/s 156 KiB/s 106 KiB/s 1.49 ms 288.28 us 2024-03-26T17:04:58.251 INFO:tasks.workunit.client.3.smithi157.stdout:myimage21 6/s 4/s 120 KiB/s 82 KiB/s 1.88 ms 335.17 us 2024-03-26T17:04:58.251 INFO:tasks.workunit.client.3.smithi157.stdout:myimage41 6/s 5/s 158 KiB/s 66 KiB/s 1.79 ms 258.91 us 2024-03-26T17:04:58.251 INFO:tasks.workunit.client.3.smithi157.stdout:myimage14 6/s 4/s 150 KiB/s 106 KiB/s 1.75 ms 320.15 us 2024-03-26T17:04:58.252 INFO:tasks.workunit.client.3.smithi157.stdout:myimage16 6/s 4/s 166 KiB/s 101 KiB/s 1.75 ms 353.95 us 2024-03-26T17:04:58.252 INFO:tasks.workunit.client.3.smithi157.stdout:myimage38 6/s 5/s 135 KiB/s 120 KiB/s 1.55 ms 385.03 us 2024-03-26T17:04:58.252 INFO:tasks.workunit.client.3.smithi157.stdout:myimage9 6/s 4/s 139 KiB/s 86 KiB/s 1.87 ms 305.98 us 2024-03-26T17:04:58.252 INFO:tasks.workunit.client.3.smithi157.stdout:myimage27 6/s 4/s 132 KiB/s 102 KiB/s 1.63 ms 407.47 us 2024-03-26T17:04:58.252 INFO:tasks.workunit.client.3.smithi157.stdout:myimage7 6/s 5/s 126 KiB/s 113 KiB/s 1.74 ms 296.20 us 2024-03-26T17:04:58.252 INFO:tasks.workunit.client.3.smithi157.stdout:myimage31 6/s 4/s 123 KiB/s 83 KiB/s 1.89 ms 430.61 us 2024-03-26T17:04:58.252 INFO:tasks.workunit.client.3.smithi157.stdout:myimage40 6/s 4/s 101 KiB/s 90 KiB/s 1.61 ms 309.20 us 2024-03-26T17:04:58.252 INFO:tasks.workunit.client.3.smithi157.stdout:myimage48 6/s 5/s 120 KiB/s 110 KiB/s 1.65 ms 288.91 us 2024-03-26T17:04:58.252 INFO:tasks.workunit.client.3.smithi157.stdout:myimage25 6/s 5/s 121 KiB/s 100 KiB/s 2.01 ms 486.53 us 2024-03-26T17:04:58.252 INFO:tasks.workunit.client.3.smithi157.stdout:myimage45 6/s 4/s 127 KiB/s 66 KiB/s 1.66 ms 322.60 us 2024-03-26T17:04:58.252 INFO:tasks.workunit.client.3.smithi157.stdout:myimage50 6/s 5/s 144 KiB/s 90 KiB/s 1.80 ms 289.56 us 2024-03-26T17:04:58.252 INFO:tasks.workunit.client.3.smithi157.stdout:myimage51 6/s 3/s 118 KiB/s 83 KiB/s 1.86 ms 333.92 us 2024-03-26T17:04:58.252 INFO:tasks.workunit.client.3.smithi157.stdout:myimage23 5/s 5/s 122 KiB/s 114 KiB/s 1.55 ms 323.47 us 2024-03-26T17:04:58.252 INFO:tasks.workunit.client.3.smithi157.stdout:myimage8 5/s 4/s 118 KiB/s 103 KiB/s 1.70 ms 419.14 us 2024-03-26T17:04:58.253 INFO:tasks.workunit.client.3.smithi157.stdout:myimage59 5/s 5/s 115 KiB/s 121 KiB/s 1.80 ms 338.98 us 2024-03-26T17:04:58.253 INFO:tasks.workunit.client.3.smithi157.stdout:myimage2 5/s 6/s 105 KiB/s 99 KiB/s 1.62 ms 283.53 us 2024-03-26T17:04:58.253 INFO:tasks.workunit.client.3.smithi157.stdout:myimage5 5/s 5/s 99 KiB/s 118 KiB/s 1.56 ms 283.49 us 2024-03-26T17:04:58.253 INFO:tasks.workunit.client.3.smithi157.stdout:myimage15 5/s 5/s 119 KiB/s 122 KiB/s 1.64 ms 298.30 us 2024-03-26T17:04:58.253 INFO:tasks.workunit.client.3.smithi157.stdout:myimage58 5/s 4/s 124 KiB/s 82 KiB/s 1.58 ms 305.04 us 2024-03-26T17:04:58.253 INFO:tasks.workunit.client.3.smithi157.stdout:myimage18 5/s 5/s 108 KiB/s 106 KiB/s 1.60 ms 377.98 us 2024-03-26T17:04:58.253 INFO:tasks.workunit.client.3.smithi157.stdout:myimage36 5/s 5/s 115 KiB/s 99 KiB/s 1.68 ms 286.12 us 2024-03-26T17:04:58.253 INFO:tasks.workunit.client.3.smithi157.stdout:myimage10 5/s 5/s 86 KiB/s 111 KiB/s 1.71 ms 308.63 us 2024-03-26T17:04:58.253 INFO:tasks.workunit.client.3.smithi157.stdout:myimage13 5/s 5/s 108 KiB/s 106 KiB/s 1.64 ms 296.49 us 2024-03-26T17:04:58.253 INFO:tasks.workunit.client.3.smithi157.stdout:myimage20 5/s 4/s 134 KiB/s 81 KiB/s 1.82 ms 426.97 us 2024-03-26T17:04:58.253 INFO:tasks.workunit.client.3.smithi157.stdout:myimage39 5/s 5/s 91 KiB/s 111 KiB/s 1.52 ms 348.89 us 2024-03-26T17:04:58.253 INFO:tasks.workunit.client.3.smithi157.stdout:myimage3 5/s 5/s 92 KiB/s 100 KiB/s 1.50 ms 298.43 us 2024-03-26T17:04:58.253 INFO:tasks.workunit.client.3.smithi157.stdout:myimage30 5/s 4/s 108 KiB/s 106 KiB/s 1.99 ms 320.92 us 2024-03-26T17:04:58.254 INFO:tasks.workunit.client.3.smithi157.stdout:myimage35 5/s 5/s 110 KiB/s 94 KiB/s 1.60 ms 295.44 us 2024-03-26T17:04:58.254 INFO:tasks.workunit.client.3.smithi157.stdout:myimage37 5/s 5/s 97 KiB/s 108 KiB/s 1.85 ms 318.06 us 2024-03-26T17:04:58.254 INFO:tasks.workunit.client.3.smithi157.stdout:myimage26 5/s 4/s 103 KiB/s 85 KiB/s 1.67 ms 284.06 us 2024-03-26T17:04:58.254 INFO:tasks.workunit.client.3.smithi157.stdout:myimage29 5/s 6/s 96 KiB/s 142 KiB/s 1.56 ms 318.57 us 2024-03-26T17:04:58.254 INFO:tasks.workunit.client.3.smithi157.stdout:myimage56 5/s 6/s 106 KiB/s 137 KiB/s 1.93 ms 379.52 us 2024-03-26T17:04:58.254 INFO:tasks.workunit.client.3.smithi157.stdout:myimage17 4/s 6/s 93 KiB/s 142 KiB/s 1.75 ms 305.78 us 2024-03-26T17:04:58.254 INFO:tasks.workunit.client.3.smithi157.stdout:myimage46 4/s 6/s 100 KiB/s 103 KiB/s 1.64 ms 413.42 us 2024-03-26T17:04:58.254 INFO:tasks.workunit.client.3.smithi157.stdout:myimage53 4/s 4/s 119 KiB/s 97 KiB/s 1.69 ms 304.37 us 2024-03-26T17:04:58.254 INFO:tasks.workunit.client.3.smithi157.stdout:myimage54 4/s 5/s 75 KiB/s 108 KiB/s 1.66 ms 391.51 us 2024-03-26T17:04:58.254 INFO:tasks.workunit.client.3.smithi157.stdout:myimage60 4/s 6/s 87 KiB/s 115 KiB/s 1.78 ms 297.24 us 2024-03-26T17:04:58.254 INFO:tasks.workunit.client.3.smithi157.stdout:myimage22 4/s 5/s 102 KiB/s 100 KiB/s 1.62 ms 332.74 us 2024-03-26T17:04:58.254 INFO:tasks.workunit.client.3.smithi157.stdout:myimage4 4/s 7/s 97 KiB/s 143 KiB/s 1.71 ms 314.65 us 2024-03-26T17:04:58.254 INFO:tasks.workunit.client.3.smithi157.stdout:myimage11 4/s 7/s 77 KiB/s 127 KiB/s 1.59 ms 386.14 us 2024-03-26T17:04:58.254 INFO:tasks.workunit.client.3.smithi157.stdout:myimage32 4/s 6/s 96 KiB/s 139 KiB/s 1.73 ms 291.27 us 2024-03-26T17:04:58.255 INFO:tasks.workunit.client.3.smithi157.stdout:myimage34 4/s 6/s 78 KiB/s 137 KiB/s 1.69 ms 324.52 us 2024-03-26T17:04:58.255 INFO:tasks.workunit.client.3.smithi157.stdout:myimage12 4/s 6/s 99 KiB/s 121 KiB/s 1.69 ms 329.83 us 2024-03-26T17:04:58.255 INFO:tasks.workunit.client.3.smithi157.stdout:myimage19 4/s 7/s 106 KiB/s 178 KiB/s 1.71 ms 322.79 us 2024-03-26T17:04:58.255 INFO:tasks.workunit.client.3.smithi157.stdout:myimage28 4/s 6/s 107 KiB/s 108 KiB/s 2.00 ms 324.65 us 2024-03-26T17:04:58.255 INFO:tasks.workunit.client.3.smithi157.stdout:myimage33 4/s 6/s 123 KiB/s 122 KiB/s 1.81 ms 312.58 us 2024-03-26T17:04:58.255 INFO:tasks.workunit.client.3.smithi157.stdout:myimage42 4/s 5/s 86 KiB/s 130 KiB/s 1.61 ms 329.52 us 2024-03-26T17:04:58.255 INFO:tasks.workunit.client.3.smithi157.stdout:myimage57 4/s 5/s 54 KiB/s 112 KiB/s 1.57 ms 284.12 us 2024-03-26T17:04:58.255 INFO:tasks.workunit.client.3.smithi157.stdout:myimage49 4/s 6/s 105 KiB/s 134 KiB/s 1.87 ms 423.43 us 2024-03-26T17:04:58.255 INFO:tasks.workunit.client.3.smithi157.stdout:myimage24 3/s 6/s 61 KiB/s 145 KiB/s 1.67 ms 431.37 us 2024-03-26T17:04:58.255 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:04:59.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:04:59 smithi149 ceph-mon[34678]: pgmap v570: 33 pgs: 33 active+clean; 1024 MiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 6.5 MiB/s rd, 6.6 MiB/s wr, 650 op/s 2024-03-26T17:04:59.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:04:59 smithi149 ceph-mon[34678]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:04:59.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:04:59 smithi149 ceph-mon[34678]: { 2024-03-26T17:04:59.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:04:59 smithi149 ceph-mon[34678]: "prefix": "rbd perf image stats", 2024-03-26T17:04:59.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:04:59 smithi149 ceph-mon[34678]: "pool_spec": "mypool", 2024-03-26T17:04:59.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:04:59 smithi149 ceph-mon[34678]: "sort_by": "write_ops", 2024-03-26T17:04:59.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:04:59 smithi149 ceph-mon[34678]: "format": "json" 2024-03-26T17:04:59.647 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:04:59 smithi149 ceph-mon[34678]: }"]: dispatch 2024-03-26T17:04:59.647 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:04:59 smithi149 ceph-mon[34678]: Health check update: 3 slow ops, oldest one blocked for 393 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:04:59.765 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:04:59 smithi044 ceph-mon[30624]: pgmap v570: 33 pgs: 33 active+clean; 1024 MiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 6.5 MiB/s rd, 6.6 MiB/s wr, 650 op/s 2024-03-26T17:04:59.765 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:04:59 smithi044 ceph-mon[30624]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:04:59.765 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:04:59 smithi044 ceph-mon[30624]: { 2024-03-26T17:04:59.765 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:04:59 smithi044 ceph-mon[30624]: "prefix": "rbd perf image stats", 2024-03-26T17:04:59.766 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:04:59 smithi044 ceph-mon[30624]: "pool_spec": "mypool", 2024-03-26T17:04:59.766 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:04:59 smithi044 ceph-mon[30624]: "sort_by": "write_ops", 2024-03-26T17:04:59.766 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:04:59 smithi044 ceph-mon[30624]: "format": "json" 2024-03-26T17:04:59.766 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:04:59 smithi044 ceph-mon[30624]: }"]: dispatch 2024-03-26T17:04:59.766 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:04:59 smithi044 ceph-mon[30624]: Health check update: 3 slow ops, oldest one blocked for 393 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:04:59.766 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:04:59 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:04:59] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:04:59.767 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:04:59 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:04:59] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:04:59.767 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:04:59 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:04:59.805 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:04:59 smithi064 ceph-mon[34420]: pgmap v570: 33 pgs: 33 active+clean; 1024 MiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 6.5 MiB/s rd, 6.6 MiB/s wr, 650 op/s 2024-03-26T17:04:59.805 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:04:59 smithi064 ceph-mon[34420]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:04:59.806 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:04:59 smithi064 ceph-mon[34420]: { 2024-03-26T17:04:59.806 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:04:59 smithi064 ceph-mon[34420]: "prefix": "rbd perf image stats", 2024-03-26T17:04:59.806 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:04:59 smithi064 ceph-mon[34420]: "pool_spec": "mypool", 2024-03-26T17:04:59.806 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:04:59 smithi064 ceph-mon[34420]: "sort_by": "write_ops", 2024-03-26T17:04:59.806 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:04:59 smithi064 ceph-mon[34420]: "format": "json" 2024-03-26T17:04:59.806 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:04:59 smithi064 ceph-mon[34420]: }"]: dispatch 2024-03-26T17:04:59.806 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:04:59 smithi064 ceph-mon[34420]: Health check update: 3 slow ops, oldest one blocked for 393 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:05:00.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:04:59 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:04:59] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:05:00.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:04:59 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:04:59] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:05:00.147 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:04:59 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:05:01.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:05:01 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 2024-03-26T17:05:01.222+0000 7fa707a55700 -1 mon.c@1(peon) e3 get_health_metrics reporting 3 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T17:05:01.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:05:01 smithi149 ceph-mon[34678]: pgmap v571: 33 pgs: 33 active+clean; 1024 MiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 6.7 MiB/s rd, 7.0 MiB/s wr, 699 op/s 2024-03-26T17:05:01.765 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:05:01 smithi044 ceph-mon[30624]: pgmap v571: 33 pgs: 33 active+clean; 1024 MiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 6.7 MiB/s rd, 7.0 MiB/s wr, 699 op/s 2024-03-26T17:05:01.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:05:01 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:05:01] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:05:01.766 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:05:01 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:05:01] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:05:01.766 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:05:01 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:05:01.805 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:05:01 smithi064 ceph-mon[34420]: pgmap v571: 33 pgs: 33 active+clean; 1024 MiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 6.7 MiB/s rd, 7.0 MiB/s wr, 699 op/s 2024-03-26T17:05:02.147 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:05:01 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:05:01] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:05:02.147 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:05:01 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:05:01] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:05:02.147 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:05:01 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:05:03.061 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:05:03.071 INFO:tasks.workunit.client.3.smithi157.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2024-03-26T17:05:03.071 INFO:tasks.workunit.client.3.smithi157.stdout: 10.80 108.0k 98.4k 0.0k 1.1M 984.0k 0.0k nvme2n1 2024-03-26T17:05:03.071 INFO:tasks.workunit.client.3.smithi157.stdout: 10.70 82.8k 120.8k 0.0k 828.0k 1.2M 0.0k nvme2n10 2024-03-26T17:05:03.071 INFO:tasks.workunit.client.3.smithi157.stdout: 10.70 112.8k 97.6k 0.0k 1.1M 976.0k 0.0k nvme2n11 2024-03-26T17:05:03.071 INFO:tasks.workunit.client.3.smithi157.stdout: 10.80 128.8k 90.4k 0.0k 1.3M 904.0k 0.0k nvme2n12 2024-03-26T17:05:03.071 INFO:tasks.workunit.client.3.smithi157.stdout: 10.80 109.2k 113.2k 0.0k 1.1M 1.1M 0.0k nvme2n13 2024-03-26T17:05:03.071 INFO:tasks.workunit.client.3.smithi157.stdout: 10.80 75.6k 124.4k 0.0k 756.0k 1.2M 0.0k nvme2n14 2024-03-26T17:05:03.071 INFO:tasks.workunit.client.3.smithi157.stdout: 10.80 114.8k 90.8k 0.0k 1.1M 908.0k 0.0k nvme2n15 2024-03-26T17:05:03.071 INFO:tasks.workunit.client.3.smithi157.stdout: 10.80 116.4k 105.6k 0.0k 1.1M 1.0M 0.0k nvme2n16 2024-03-26T17:05:03.071 INFO:tasks.workunit.client.3.smithi157.stdout: 10.80 107.6k 97.2k 0.0k 1.1M 972.0k 0.0k nvme2n17 2024-03-26T17:05:03.071 INFO:tasks.workunit.client.3.smithi157.stdout: 10.80 126.0k 84.8k 0.0k 1.2M 848.0k 0.0k nvme2n18 2024-03-26T17:05:03.071 INFO:tasks.workunit.client.3.smithi157.stdout: 10.80 126.0k 76.4k 0.0k 1.2M 764.0k 0.0k nvme2n19 2024-03-26T17:05:03.072 INFO:tasks.workunit.client.3.smithi157.stdout: 10.80 110.8k 78.8k 0.0k 1.1M 788.0k 0.0k nvme2n2 2024-03-26T17:05:03.072 INFO:tasks.workunit.client.3.smithi157.stdout: 10.80 86.0k 93.2k 0.0k 860.0k 932.0k 0.0k nvme2n20 2024-03-26T17:05:03.072 INFO:tasks.workunit.client.3.smithi157.stdout: 10.80 106.8k 96.0k 0.0k 1.0M 960.0k 0.0k nvme2n3 2024-03-26T17:05:03.072 INFO:tasks.workunit.client.3.smithi157.stdout: 10.80 103.2k 100.4k 0.0k 1.0M 1004.0k 0.0k nvme2n4 2024-03-26T17:05:03.072 INFO:tasks.workunit.client.3.smithi157.stdout: 10.80 117.6k 88.8k 0.0k 1.1M 888.0k 0.0k nvme2n5 2024-03-26T17:05:03.072 INFO:tasks.workunit.client.3.smithi157.stdout: 10.80 104.8k 94.8k 0.0k 1.0M 948.0k 0.0k nvme2n6 2024-03-26T17:05:03.072 INFO:tasks.workunit.client.3.smithi157.stdout: 10.80 98.4k 110.8k 0.0k 984.0k 1.1M 0.0k nvme2n7 2024-03-26T17:05:03.072 INFO:tasks.workunit.client.3.smithi157.stdout: 10.80 108.0k 112.4k 0.0k 1.1M 1.1M 0.0k nvme2n8 2024-03-26T17:05:03.072 INFO:tasks.workunit.client.3.smithi157.stdout: 10.70 92.0k 117.2k 0.0k 920.0k 1.1M 0.0k nvme2n9 2024-03-26T17:05:03.072 INFO:tasks.workunit.client.3.smithi157.stdout: 10.80 83.2k 112.4k 0.0k 832.0k 1.1M 0.0k nvme5n1 2024-03-26T17:05:03.072 INFO:tasks.workunit.client.3.smithi157.stdout: 10.70 96.0k 89.6k 0.0k 960.0k 896.0k 0.0k nvme5n10 2024-03-26T17:05:03.072 INFO:tasks.workunit.client.3.smithi157.stdout: 10.70 99.2k 99.2k 0.0k 992.0k 992.0k 0.0k nvme5n11 2024-03-26T17:05:03.073 INFO:tasks.workunit.client.3.smithi157.stdout: 10.80 143.6k 80.8k 0.0k 1.4M 808.0k 0.0k nvme5n12 2024-03-26T17:05:03.073 INFO:tasks.workunit.client.3.smithi157.stdout: 10.80 98.4k 114.8k 0.0k 984.0k 1.1M 0.0k nvme5n13 2024-03-26T17:05:03.073 INFO:tasks.workunit.client.3.smithi157.stdout: 10.80 108.0k 100.4k 0.0k 1.1M 1004.0k 0.0k nvme5n14 2024-03-26T17:05:03.073 INFO:tasks.workunit.client.3.smithi157.stdout: 10.80 86.8k 108.8k 0.0k 868.0k 1.1M 0.0k nvme5n15 2024-03-26T17:05:03.073 INFO:tasks.workunit.client.3.smithi157.stdout: 10.80 100.8k 89.6k 0.0k 1008.0k 896.0k 0.0k nvme5n16 2024-03-26T17:05:03.073 INFO:tasks.workunit.client.3.smithi157.stdout: 10.80 114.4k 121.2k 0.0k 1.1M 1.2M 0.0k nvme5n17 2024-03-26T17:05:03.073 INFO:tasks.workunit.client.3.smithi157.stdout: 10.80 112.8k 78.4k 0.0k 1.1M 784.0k 0.0k nvme5n18 2024-03-26T17:05:03.073 INFO:tasks.workunit.client.3.smithi157.stdout: 10.80 104.0k 93.6k 0.0k 1.0M 936.0k 0.0k nvme5n19 2024-03-26T17:05:03.073 INFO:tasks.workunit.client.3.smithi157.stdout: 10.80 118.0k 113.2k 0.0k 1.2M 1.1M 0.0k nvme5n2 2024-03-26T17:05:03.073 INFO:tasks.workunit.client.3.smithi157.stdout: 10.80 103.6k 94.4k 0.0k 1.0M 944.0k 0.0k nvme5n20 2024-03-26T17:05:03.073 INFO:tasks.workunit.client.3.smithi157.stdout: 10.80 120.0k 102.8k 0.0k 1.2M 1.0M 0.0k nvme5n3 2024-03-26T17:05:03.073 INFO:tasks.workunit.client.3.smithi157.stdout: 10.80 98.8k 103.6k 0.0k 988.0k 1.0M 0.0k nvme5n4 2024-03-26T17:05:03.073 INFO:tasks.workunit.client.3.smithi157.stdout: 10.80 114.4k 103.2k 0.0k 1.1M 1.0M 0.0k nvme5n5 2024-03-26T17:05:03.073 INFO:tasks.workunit.client.3.smithi157.stdout: 10.80 98.4k 106.4k 0.0k 984.0k 1.0M 0.0k nvme5n6 2024-03-26T17:05:03.074 INFO:tasks.workunit.client.3.smithi157.stdout: 10.80 124.4k 86.4k 0.0k 1.2M 864.0k 0.0k nvme5n7 2024-03-26T17:05:03.074 INFO:tasks.workunit.client.3.smithi157.stdout: 10.80 99.2k 117.6k 0.0k 992.0k 1.1M 0.0k nvme5n8 2024-03-26T17:05:03.074 INFO:tasks.workunit.client.3.smithi157.stdout: 10.70 86.8k 105.2k 0.0k 868.0k 1.0M 0.0k nvme5n9 2024-03-26T17:05:03.074 INFO:tasks.workunit.client.3.smithi157.stdout: 10.80 96.4k 113.6k 0.0k 964.0k 1.1M 0.0k nvme8n1 2024-03-26T17:05:03.074 INFO:tasks.workunit.client.3.smithi157.stdout: 10.70 98.8k 114.0k 0.0k 988.0k 1.1M 0.0k nvme8n10 2024-03-26T17:05:03.074 INFO:tasks.workunit.client.3.smithi157.stdout: 10.70 71.2k 111.6k 0.0k 712.0k 1.1M 0.0k nvme8n11 2024-03-26T17:05:03.074 INFO:tasks.workunit.client.3.smithi157.stdout: 10.80 92.0k 113.6k 0.0k 920.0k 1.1M 0.0k nvme8n12 2024-03-26T17:05:03.074 INFO:tasks.workunit.client.3.smithi157.stdout: 10.80 129.2k 89.6k 0.0k 1.3M 896.0k 0.0k nvme8n13 2024-03-26T17:05:03.074 INFO:tasks.workunit.client.3.smithi157.stdout: 10.80 125.6k 76.8k 0.0k 1.2M 768.0k 0.0k nvme8n14 2024-03-26T17:05:03.074 INFO:tasks.workunit.client.3.smithi157.stdout: 10.80 96.0k 103.2k 0.0k 960.0k 1.0M 0.0k nvme8n15 2024-03-26T17:05:03.074 INFO:tasks.workunit.client.3.smithi157.stdout: 10.80 132.0k 109.6k 0.0k 1.3M 1.1M 0.0k nvme8n16 2024-03-26T17:05:03.074 INFO:tasks.workunit.client.3.smithi157.stdout: 10.80 104.0k 110.8k 0.0k 1.0M 1.1M 0.0k nvme8n17 2024-03-26T17:05:03.074 INFO:tasks.workunit.client.3.smithi157.stdout: 10.80 79.2k 129.6k 0.0k 792.0k 1.3M 0.0k nvme8n18 2024-03-26T17:05:03.075 INFO:tasks.workunit.client.3.smithi157.stdout: 10.80 105.2k 118.0k 0.0k 1.0M 1.2M 0.0k nvme8n19 2024-03-26T17:05:03.075 INFO:tasks.workunit.client.3.smithi157.stdout: 10.80 134.8k 100.8k 0.0k 1.3M 1008.0k 0.0k nvme8n2 2024-03-26T17:05:03.075 INFO:tasks.workunit.client.3.smithi157.stdout: 10.80 130.0k 65.2k 0.0k 1.3M 652.0k 0.0k nvme8n20 2024-03-26T17:05:03.075 INFO:tasks.workunit.client.3.smithi157.stdout: 10.80 112.8k 141.2k 0.0k 1.1M 1.4M 0.0k nvme8n3 2024-03-26T17:05:03.075 INFO:tasks.workunit.client.3.smithi157.stdout: 10.80 95.2k 130.0k 0.0k 952.0k 1.3M 0.0k nvme8n4 2024-03-26T17:05:03.075 INFO:tasks.workunit.client.3.smithi157.stdout: 10.80 100.8k 100.0k 0.0k 1008.0k 1000.0k 0.0k nvme8n5 2024-03-26T17:05:03.075 INFO:tasks.workunit.client.3.smithi157.stdout: 10.80 147.2k 86.0k 0.0k 1.4M 860.0k 0.0k nvme8n6 2024-03-26T17:05:03.075 INFO:tasks.workunit.client.3.smithi157.stdout: 10.80 81.2k 104.8k 0.0k 812.0k 1.0M 0.0k nvme8n7 2024-03-26T17:05:03.075 INFO:tasks.workunit.client.3.smithi157.stdout: 10.80 93.6k 110.0k 0.0k 936.0k 1.1M 0.0k nvme8n8 2024-03-26T17:05:03.075 INFO:tasks.workunit.client.3.smithi157.stdout: 10.70 111.6k 100.4k 0.0k 1.1M 1004.0k 0.0k nvme8n9 2024-03-26T17:05:03.075 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:05:03.255 INFO:tasks.workunit.client.3.smithi157.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-26T17:05:03.255 INFO:tasks.workunit.client.3.smithi157.stdout:myimage10 7/s 3/s 154 KiB/s 49 KiB/s 1.70 ms 240.00 us 2024-03-26T17:05:03.255 INFO:tasks.workunit.client.3.smithi157.stdout:myimage22 7/s 5/s 143 KiB/s 141 KiB/s 1.70 ms 320.19 us 2024-03-26T17:05:03.255 INFO:tasks.workunit.client.3.smithi157.stdout:myimage29 7/s 4/s 118 KiB/s 86 KiB/s 1.79 ms 323.97 us 2024-03-26T17:05:03.255 INFO:tasks.workunit.client.3.smithi157.stdout:myimage6 6/s 3/s 95 KiB/s 69 KiB/s 2.01 ms 283.12 us 2024-03-26T17:05:03.255 INFO:tasks.workunit.client.3.smithi157.stdout:myimage7 6/s 4/s 122 KiB/s 71 KiB/s 1.87 ms 288.59 us 2024-03-26T17:05:03.255 INFO:tasks.workunit.client.3.smithi157.stdout:myimage24 6/s 4/s 121 KiB/s 90 KiB/s 1.64 ms 285.36 us 2024-03-26T17:05:03.256 INFO:tasks.workunit.client.3.smithi157.stdout:myimage26 6/s 5/s 130 KiB/s 84 KiB/s 1.84 ms 319.24 us 2024-03-26T17:05:03.256 INFO:tasks.workunit.client.3.smithi157.stdout:myimage44 6/s 4/s 151 KiB/s 104 KiB/s 1.74 ms 365.05 us 2024-03-26T17:05:03.256 INFO:tasks.workunit.client.3.smithi157.stdout:myimage21 6/s 6/s 134 KiB/s 102 KiB/s 2.00 ms 359.34 us 2024-03-26T17:05:03.256 INFO:tasks.workunit.client.3.smithi157.stdout:myimage34 6/s 5/s 114 KiB/s 94 KiB/s 1.45 ms 266.35 us 2024-03-26T17:05:03.256 INFO:tasks.workunit.client.3.smithi157.stdout:myimage49 6/s 5/s 130 KiB/s 91 KiB/s 1.70 ms 294.95 us 2024-03-26T17:05:03.256 INFO:tasks.workunit.client.3.smithi157.stdout:myimage33 6/s 4/s 116 KiB/s 73 KiB/s 1.65 ms 314.49 us 2024-03-26T17:05:03.256 INFO:tasks.workunit.client.3.smithi157.stdout:myimage30 6/s 6/s 112 KiB/s 99 KiB/s 2.01 ms 361.98 us 2024-03-26T17:05:03.256 INFO:tasks.workunit.client.3.smithi157.stdout:myimage11 6/s 5/s 117 KiB/s 96 KiB/s 1.82 ms 268.66 us 2024-03-26T17:05:03.256 INFO:tasks.workunit.client.3.smithi157.stdout:myimage57 6/s 4/s 134 KiB/s 93 KiB/s 1.67 ms 286.48 us 2024-03-26T17:05:03.256 INFO:tasks.workunit.client.3.smithi157.stdout:myimage14 5/s 4/s 142 KiB/s 68 KiB/s 1.86 ms 284.72 us 2024-03-26T17:05:03.256 INFO:tasks.workunit.client.3.smithi157.stdout:myimage52 5/s 6/s 130 KiB/s 130 KiB/s 1.91 ms 354.81 us 2024-03-26T17:05:03.256 INFO:tasks.workunit.client.3.smithi157.stdout:myimage58 5/s 4/s 121 KiB/s 81 KiB/s 1.61 ms 312.09 us 2024-03-26T17:05:03.256 INFO:tasks.workunit.client.3.smithi157.stdout:myimage19 5/s 4/s 81 KiB/s 80 KiB/s 1.77 ms 484.19 us 2024-03-26T17:05:03.256 INFO:tasks.workunit.client.3.smithi157.stdout:myimage20 5/s 5/s 86 KiB/s 80 KiB/s 1.69 ms 311.69 us 2024-03-26T17:05:03.257 INFO:tasks.workunit.client.3.smithi157.stdout:myimage27 5/s 6/s 113 KiB/s 143 KiB/s 1.58 ms 287.41 us 2024-03-26T17:05:03.257 INFO:tasks.workunit.client.3.smithi157.stdout:myimage39 5/s 4/s 89 KiB/s 88 KiB/s 1.66 ms 300.93 us 2024-03-26T17:05:03.257 INFO:tasks.workunit.client.3.smithi157.stdout:myimage41 5/s 4/s 96 KiB/s 102 KiB/s 1.80 ms 350.14 us 2024-03-26T17:05:03.257 INFO:tasks.workunit.client.3.smithi157.stdout:myimage51 5/s 4/s 100 KiB/s 70 KiB/s 1.88 ms 272.48 us 2024-03-26T17:05:03.257 INFO:tasks.workunit.client.3.smithi157.stdout:myimage13 5/s 5/s 114 KiB/s 91 KiB/s 1.63 ms 340.71 us 2024-03-26T17:05:03.257 INFO:tasks.workunit.client.3.smithi157.stdout:myimage16 5/s 7/s 106 KiB/s 154 KiB/s 1.70 ms 300.69 us 2024-03-26T17:05:03.257 INFO:tasks.workunit.client.3.smithi157.stdout:myimage35 5/s 5/s 104 KiB/s 94 KiB/s 1.81 ms 377.25 us 2024-03-26T17:05:03.257 INFO:tasks.workunit.client.3.smithi157.stdout:myimage47 5/s 3/s 93 KiB/s 74 KiB/s 1.70 ms 367.50 us 2024-03-26T17:05:03.257 INFO:tasks.workunit.client.3.smithi157.stdout:myimage8 5/s 6/s 126 KiB/s 122 KiB/s 1.59 ms 318.57 us 2024-03-26T17:05:03.257 INFO:tasks.workunit.client.3.smithi157.stdout:myimage17 5/s 5/s 133 KiB/s 73 KiB/s 1.76 ms 330.13 us 2024-03-26T17:05:03.257 INFO:tasks.workunit.client.3.smithi157.stdout:myimage59 5/s 5/s 120 KiB/s 96 KiB/s 1.92 ms 309.44 us 2024-03-26T17:05:03.257 INFO:tasks.workunit.client.3.smithi157.stdout:myimage12 5/s 5/s 93 KiB/s 111 KiB/s 1.79 ms 407.63 us 2024-03-26T17:05:03.257 INFO:tasks.workunit.client.3.smithi157.stdout:myimage53 5/s 6/s 94 KiB/s 113 KiB/s 1.75 ms 278.01 us 2024-03-26T17:05:03.257 INFO:tasks.workunit.client.3.smithi157.stdout:myimage9 5/s 5/s 107 KiB/s 88 KiB/s 1.88 ms 442.85 us 2024-03-26T17:05:03.258 INFO:tasks.workunit.client.3.smithi157.stdout:myimage28 5/s 6/s 115 KiB/s 112 KiB/s 2.12 ms 368.02 us 2024-03-26T17:05:03.258 INFO:tasks.workunit.client.3.smithi157.stdout:myimage43 5/s 5/s 114 KiB/s 92 KiB/s 1.77 ms 430.39 us 2024-03-26T17:05:03.258 INFO:tasks.workunit.client.3.smithi157.stdout:myimage32 4/s 5/s 81 KiB/s 137 KiB/s 1.79 ms 424.22 us 2024-03-26T17:05:03.258 INFO:tasks.workunit.client.3.smithi157.stdout:myimage37 4/s 5/s 116 KiB/s 92 KiB/s 2.07 ms 332.90 us 2024-03-26T17:05:03.258 INFO:tasks.workunit.client.3.smithi157.stdout:myimage38 4/s 4/s 78 KiB/s 80 KiB/s 1.50 ms 294.09 us 2024-03-26T17:05:03.258 INFO:tasks.workunit.client.3.smithi157.stdout:myimage18 4/s 5/s 86 KiB/s 128 KiB/s 1.68 ms 326.88 us 2024-03-26T17:05:03.258 INFO:tasks.workunit.client.3.smithi157.stdout:myimage42 4/s 6/s 91 KiB/s 129 KiB/s 1.76 ms 297.43 us 2024-03-26T17:05:03.258 INFO:tasks.workunit.client.3.smithi157.stdout:myimage46 4/s 5/s 89 KiB/s 139 KiB/s 1.74 ms 353.32 us 2024-03-26T17:05:03.258 INFO:tasks.workunit.client.3.smithi157.stdout:myimage60 4/s 5/s 74 KiB/s 112 KiB/s 1.76 ms 301.99 us 2024-03-26T17:05:03.258 INFO:tasks.workunit.client.3.smithi157.stdout:myimage23 4/s 5/s 91 KiB/s 111 KiB/s 1.57 ms 293.61 us 2024-03-26T17:05:03.258 INFO:tasks.workunit.client.3.smithi157.stdout:myimage31 4/s 5/s 87 KiB/s 101 KiB/s 1.90 ms 373.67 us 2024-03-26T17:05:03.259 INFO:tasks.workunit.client.3.smithi157.stdout:myimage1 4/s 5/s 70 KiB/s 109 KiB/s 1.52 ms 250.92 us 2024-03-26T17:05:03.259 INFO:tasks.workunit.client.3.smithi157.stdout:myimage15 4/s 6/s 75 KiB/s 86 KiB/s 1.73 ms 298.04 us 2024-03-26T17:05:03.259 INFO:tasks.workunit.client.3.smithi157.stdout:myimage55 4/s 6/s 81 KiB/s 121 KiB/s 1.77 ms 297.39 us 2024-03-26T17:05:03.259 INFO:tasks.workunit.client.3.smithi157.stdout:myimage40 4/s 4/s 82 KiB/s 95 KiB/s 1.61 ms 343.91 us 2024-03-26T17:05:03.259 INFO:tasks.workunit.client.3.smithi157.stdout:myimage36 4/s 7/s 85 KiB/s 150 KiB/s 1.68 ms 348.78 us 2024-03-26T17:05:03.259 INFO:tasks.workunit.client.3.smithi157.stdout:myimage50 4/s 5/s 84 KiB/s 105 KiB/s 1.89 ms 307.27 us 2024-03-26T17:05:03.259 INFO:tasks.workunit.client.3.smithi157.stdout:myimage54 4/s 8/s 82 KiB/s 142 KiB/s 1.62 ms 392.64 us 2024-03-26T17:05:03.259 INFO:tasks.workunit.client.3.smithi157.stdout:myimage56 4/s 6/s 122 KiB/s 102 KiB/s 2.04 ms 327.66 us 2024-03-26T17:05:03.259 INFO:tasks.workunit.client.3.smithi157.stdout:myimage3 4/s 6/s 86 KiB/s 126 KiB/s 1.50 ms 307.79 us 2024-03-26T17:05:03.259 INFO:tasks.workunit.client.3.smithi157.stdout:myimage5 4/s 6/s 72 KiB/s 123 KiB/s 1.64 ms 362.96 us 2024-03-26T17:05:03.259 INFO:tasks.workunit.client.3.smithi157.stdout:myimage45 4/s 6/s 85 KiB/s 122 KiB/s 1.69 ms 414.83 us 2024-03-26T17:05:03.259 INFO:tasks.workunit.client.3.smithi157.stdout:myimage2 3/s 6/s 68 KiB/s 101 KiB/s 1.84 ms 320.23 us 2024-03-26T17:05:03.259 INFO:tasks.workunit.client.3.smithi157.stdout:myimage4 3/s 5/s 72 KiB/s 106 KiB/s 1.64 ms 296.76 us 2024-03-26T17:05:03.259 INFO:tasks.workunit.client.3.smithi157.stdout:myimage25 3/s 4/s 78 KiB/s 108 KiB/s 2.09 ms 285.72 us 2024-03-26T17:05:03.259 INFO:tasks.workunit.client.3.smithi157.stdout:myimage48 2/s 2/s 64 KiB/s 51 KiB/s 1.81 ms 280.62 us 2024-03-26T17:05:03.260 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:05:03.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:05:03 smithi149 ceph-mon[34678]: pgmap v572: 33 pgs: 33 active+clean; 1024 MiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 5.9 MiB/s rd, 6.0 MiB/s wr, 614 op/s 2024-03-26T17:05:03.765 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:05:03 smithi044 ceph-mon[30624]: pgmap v572: 33 pgs: 33 active+clean; 1024 MiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 5.9 MiB/s rd, 6.0 MiB/s wr, 614 op/s 2024-03-26T17:05:03.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:05:03 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:05:03] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:05:03.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:05:03 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:05:03] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:05:03.766 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:05:03 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:05:03.805 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:05:03 smithi064 ceph-mon[34420]: pgmap v572: 33 pgs: 33 active+clean; 1024 MiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 5.9 MiB/s rd, 6.0 MiB/s wr, 614 op/s 2024-03-26T17:05:04.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:05:03 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:05:03] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:05:04.147 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:05:03 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:05:03] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:05:04.147 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:05:03 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:05:04.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:05:04 smithi149 ceph-mon[34678]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:05:04.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:05:04 smithi149 ceph-mon[34678]: { 2024-03-26T17:05:04.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:05:04 smithi149 ceph-mon[34678]: "prefix": "rbd perf image stats", 2024-03-26T17:05:04.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:05:04 smithi149 ceph-mon[34678]: "pool_spec": "mypool", 2024-03-26T17:05:04.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:05:04 smithi149 ceph-mon[34678]: "sort_by": "write_ops", 2024-03-26T17:05:04.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:05:04 smithi149 ceph-mon[34678]: "format": "json" 2024-03-26T17:05:04.647 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:05:04 smithi149 ceph-mon[34678]: }"]: dispatch 2024-03-26T17:05:04.647 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:05:04 smithi149 ceph-mon[34678]: Health check update: 3 slow ops, oldest one blocked for 398 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:05:04.766 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:05:04 smithi044 ceph-mon[30624]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:05:04.766 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:05:04 smithi044 ceph-mon[30624]: { 2024-03-26T17:05:04.766 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:05:04 smithi044 ceph-mon[30624]: "prefix": "rbd perf image stats", 2024-03-26T17:05:04.766 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:05:04 smithi044 ceph-mon[30624]: "pool_spec": "mypool", 2024-03-26T17:05:04.766 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:05:04 smithi044 ceph-mon[30624]: "sort_by": "write_ops", 2024-03-26T17:05:04.766 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:05:04 smithi044 ceph-mon[30624]: "format": "json" 2024-03-26T17:05:04.766 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:05:04 smithi044 ceph-mon[30624]: }"]: dispatch 2024-03-26T17:05:04.766 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:05:04 smithi044 ceph-mon[30624]: Health check update: 3 slow ops, oldest one blocked for 398 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:05:04.805 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:05:04 smithi064 ceph-mon[34420]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:05:04.805 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:05:04 smithi064 ceph-mon[34420]: { 2024-03-26T17:05:04.805 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:05:04 smithi064 ceph-mon[34420]: "prefix": "rbd perf image stats", 2024-03-26T17:05:04.805 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:05:04 smithi064 ceph-mon[34420]: "pool_spec": "mypool", 2024-03-26T17:05:04.806 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:05:04 smithi064 ceph-mon[34420]: "sort_by": "write_ops", 2024-03-26T17:05:04.806 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:05:04 smithi064 ceph-mon[34420]: "format": "json" 2024-03-26T17:05:04.806 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:05:04 smithi064 ceph-mon[34420]: }"]: dispatch 2024-03-26T17:05:04.806 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:05:04 smithi064 ceph-mon[34420]: Health check update: 3 slow ops, oldest one blocked for 398 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:05:05.573 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:05:05 smithi044 ceph-mon[30624]: pgmap v573: 33 pgs: 33 active+clean; 1024 MiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 6.7 MiB/s rd, 6.8 MiB/s wr, 720 op/s 2024-03-26T17:05:05.573 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:05:05 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:05:05] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:05:05.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:05:05 smithi149 ceph-mon[34678]: pgmap v573: 33 pgs: 33 active+clean; 1024 MiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 6.7 MiB/s rd, 6.8 MiB/s wr, 720 op/s 2024-03-26T17:05:05.805 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:05:05 smithi064 ceph-mon[34420]: pgmap v573: 33 pgs: 33 active+clean; 1024 MiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 6.7 MiB/s rd, 6.8 MiB/s wr, 720 op/s 2024-03-26T17:05:06.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:05:05 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:05:05] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:05:06.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:05:05 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:05:06.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:05:05 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:05:05] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:05:06.147 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:05:05 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:05:05] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:05:06.147 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:05:05 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:05:06.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:05:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 2024-03-26T17:05:06.222+0000 7fa707a55700 -1 mon.c@1(peon) e3 get_health_metrics reporting 3 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T17:05:07.577 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:05:07 smithi044 ceph-mon[30624]: pgmap v574: 33 pgs: 33 active+clean; 1024 MiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 6.0 MiB/s rd, 5.9 MiB/s wr, 649 op/s 2024-03-26T17:05:07.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:05:07 smithi149 ceph-mon[34678]: pgmap v574: 33 pgs: 33 active+clean; 1024 MiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 6.0 MiB/s rd, 5.9 MiB/s wr, 649 op/s 2024-03-26T17:05:07.805 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:05:07 smithi064 ceph-mon[34420]: pgmap v574: 33 pgs: 33 active+clean; 1024 MiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 6.0 MiB/s rd, 5.9 MiB/s wr, 649 op/s 2024-03-26T17:05:08.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:05:07 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:05:07] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:05:08.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:05:07 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:05:07] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:05:08.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:05:07 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:05:08.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:05:07 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:05:07] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:05:08.147 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:05:07 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:05:07] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:05:08.147 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:05:07 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:05:08.259 INFO:tasks.workunit.client.3.smithi157.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-26T17:05:08.259 INFO:tasks.workunit.client.3.smithi157.stdout:myimage51 8/s 4/s 133 KiB/s 74 KiB/s 1.93 ms 268.22 us 2024-03-26T17:05:08.259 INFO:tasks.workunit.client.3.smithi157.stdout:myimage37 7/s 5/s 198 KiB/s 150 KiB/s 2.03 ms 388.62 us 2024-03-26T17:05:08.259 INFO:tasks.workunit.client.3.smithi157.stdout:myimage31 7/s 5/s 117 KiB/s 99 KiB/s 1.74 ms 407.71 us 2024-03-26T17:05:08.259 INFO:tasks.workunit.client.3.smithi157.stdout:myimage40 6/s 5/s 105 KiB/s 102 KiB/s 1.68 ms 308.98 us 2024-03-26T17:05:08.259 INFO:tasks.workunit.client.3.smithi157.stdout:myimage44 6/s 5/s 128 KiB/s 110 KiB/s 1.73 ms 354.07 us 2024-03-26T17:05:08.259 INFO:tasks.workunit.client.3.smithi157.stdout:myimage9 6/s 5/s 118 KiB/s 125 KiB/s 1.87 ms 313.18 us 2024-03-26T17:05:08.259 INFO:tasks.workunit.client.3.smithi157.stdout:myimage27 6/s 6/s 111 KiB/s 114 KiB/s 1.70 ms 285.55 us 2024-03-26T17:05:08.259 INFO:tasks.workunit.client.3.smithi157.stdout:myimage50 6/s 6/s 140 KiB/s 126 KiB/s 1.83 ms 303.60 us 2024-03-26T17:05:08.259 INFO:tasks.workunit.client.3.smithi157.stdout:myimage49 6/s 4/s 106 KiB/s 93 KiB/s 1.72 ms 333.50 us 2024-03-26T17:05:08.260 INFO:tasks.workunit.client.3.smithi157.stdout:myimage11 6/s 4/s 118 KiB/s 95 KiB/s 1.81 ms 308.13 us 2024-03-26T17:05:08.260 INFO:tasks.workunit.client.3.smithi157.stdout:myimage55 6/s 6/s 100 KiB/s 90 KiB/s 1.69 ms 291.21 us 2024-03-26T17:05:08.260 INFO:tasks.workunit.client.3.smithi157.stdout:myimage45 6/s 6/s 128 KiB/s 94 KiB/s 1.70 ms 302.68 us 2024-03-26T17:05:08.260 INFO:tasks.workunit.client.3.smithi157.stdout:myimage14 6/s 4/s 104 KiB/s 58 KiB/s 1.80 ms 278.15 us 2024-03-26T17:05:08.260 INFO:tasks.workunit.client.3.smithi157.stdout:myimage48 6/s 8/s 113 KiB/s 178 KiB/s 2.12 ms 315.20 us 2024-03-26T17:05:08.260 INFO:tasks.workunit.client.3.smithi157.stdout:myimage20 6/s 6/s 142 KiB/s 147 KiB/s 1.60 ms 329.77 us 2024-03-26T17:05:08.260 INFO:tasks.workunit.client.3.smithi157.stdout:myimage24 6/s 5/s 118 KiB/s 91 KiB/s 1.78 ms 293.43 us 2024-03-26T17:05:08.260 INFO:tasks.workunit.client.3.smithi157.stdout:myimage34 5/s 5/s 102 KiB/s 103 KiB/s 1.57 ms 355.51 us 2024-03-26T17:05:08.260 INFO:tasks.workunit.client.3.smithi157.stdout:myimage35 5/s 4/s 101 KiB/s 72 KiB/s 1.75 ms 270.57 us 2024-03-26T17:05:08.260 INFO:tasks.workunit.client.3.smithi157.stdout:myimage29 5/s 6/s 113 KiB/s 113 KiB/s 1.64 ms 330.64 us 2024-03-26T17:05:08.260 INFO:tasks.workunit.client.3.smithi157.stdout:myimage59 5/s 5/s 111 KiB/s 117 KiB/s 1.89 ms 472.09 us 2024-03-26T17:05:08.260 INFO:tasks.workunit.client.3.smithi157.stdout:myimage2 5/s 4/s 120 KiB/s 95 KiB/s 1.79 ms 355.37 us 2024-03-26T17:05:08.260 INFO:tasks.workunit.client.3.smithi157.stdout:myimage3 5/s 5/s 110 KiB/s 107 KiB/s 1.81 ms 306.22 us 2024-03-26T17:05:08.260 INFO:tasks.workunit.client.3.smithi157.stdout:myimage1 5/s 6/s 107 KiB/s 150 KiB/s 1.39 ms 312.11 us 2024-03-26T17:05:08.260 INFO:tasks.workunit.client.3.smithi157.stdout:myimage4 5/s 5/s 114 KiB/s 85 KiB/s 1.75 ms 332.24 us 2024-03-26T17:05:08.261 INFO:tasks.workunit.client.3.smithi157.stdout:myimage19 5/s 5/s 102 KiB/s 137 KiB/s 1.78 ms 315.61 us 2024-03-26T17:05:08.261 INFO:tasks.workunit.client.3.smithi157.stdout:myimage41 5/s 6/s 117 KiB/s 111 KiB/s 1.84 ms 301.91 us 2024-03-26T17:05:08.261 INFO:tasks.workunit.client.3.smithi157.stdout:myimage23 5/s 5/s 90 KiB/s 110 KiB/s 1.58 ms 280.57 us 2024-03-26T17:05:08.261 INFO:tasks.workunit.client.3.smithi157.stdout:myimage30 5/s 5/s 88 KiB/s 82 KiB/s 2.04 ms 378.59 us 2024-03-26T17:05:08.261 INFO:tasks.workunit.client.3.smithi157.stdout:myimage47 5/s 4/s 86 KiB/s 94 KiB/s 1.88 ms 371.92 us 2024-03-26T17:05:08.261 INFO:tasks.workunit.client.3.smithi157.stdout:myimage8 5/s 6/s 126 KiB/s 140 KiB/s 1.58 ms 309.03 us 2024-03-26T17:05:08.261 INFO:tasks.workunit.client.3.smithi157.stdout:myimage25 5/s 5/s 73 KiB/s 94 KiB/s 1.91 ms 284.98 us 2024-03-26T17:05:08.261 INFO:tasks.workunit.client.3.smithi157.stdout:myimage13 5/s 6/s 82 KiB/s 126 KiB/s 1.59 ms 319.52 us 2024-03-26T17:05:08.261 INFO:tasks.workunit.client.3.smithi157.stdout:myimage15 5/s 4/s 78 KiB/s 96 KiB/s 1.63 ms 274.50 us 2024-03-26T17:05:08.261 INFO:tasks.workunit.client.3.smithi157.stdout:myimage26 5/s 5/s 76 KiB/s 94 KiB/s 1.66 ms 403.84 us 2024-03-26T17:05:08.261 INFO:tasks.workunit.client.3.smithi157.stdout:myimage42 5/s 6/s 98 KiB/s 118 KiB/s 1.62 ms 282.91 us 2024-03-26T17:05:08.261 INFO:tasks.workunit.client.3.smithi157.stdout:myimage57 5/s 5/s 94 KiB/s 111 KiB/s 1.78 ms 309.60 us 2024-03-26T17:05:08.261 INFO:tasks.workunit.client.3.smithi157.stdout:myimage10 5/s 5/s 97 KiB/s 88 KiB/s 1.77 ms 291.29 us 2024-03-26T17:05:08.262 INFO:tasks.workunit.client.3.smithi157.stdout:myimage52 4/s 5/s 74 KiB/s 81 KiB/s 2.05 ms 310.40 us 2024-03-26T17:05:08.262 INFO:tasks.workunit.client.3.smithi157.stdout:myimage6 4/s 5/s 110 KiB/s 126 KiB/s 2.12 ms 441.72 us 2024-03-26T17:05:08.262 INFO:tasks.workunit.client.3.smithi157.stdout:myimage12 4/s 6/s 82 KiB/s 122 KiB/s 1.88 ms 372.37 us 2024-03-26T17:05:08.262 INFO:tasks.workunit.client.3.smithi157.stdout:myimage17 4/s 6/s 102 KiB/s 102 KiB/s 1.73 ms 346.22 us 2024-03-26T17:05:08.262 INFO:tasks.workunit.client.3.smithi157.stdout:myimage21 4/s 5/s 87 KiB/s 83 KiB/s 2.05 ms 340.18 us 2024-03-26T17:05:08.262 INFO:tasks.workunit.client.3.smithi157.stdout:myimage36 4/s 4/s 84 KiB/s 68 KiB/s 1.75 ms 411.67 us 2024-03-26T17:05:08.262 INFO:tasks.workunit.client.3.smithi157.stdout:myimage38 4/s 6/s 90 KiB/s 110 KiB/s 1.54 ms 362.42 us 2024-03-26T17:05:08.262 INFO:tasks.workunit.client.3.smithi157.stdout:myimage58 4/s 6/s 98 KiB/s 98 KiB/s 1.58 ms 300.99 us 2024-03-26T17:05:08.262 INFO:tasks.workunit.client.3.smithi157.stdout:myimage7 4/s 4/s 115 KiB/s 111 KiB/s 1.93 ms 309.31 us 2024-03-26T17:05:08.262 INFO:tasks.workunit.client.3.smithi157.stdout:myimage54 4/s 5/s 111 KiB/s 144 KiB/s 1.61 ms 401.48 us 2024-03-26T17:05:08.262 INFO:tasks.workunit.client.3.smithi157.stdout:myimage18 4/s 8/s 90 KiB/s 147 KiB/s 1.65 ms 456.69 us 2024-03-26T17:05:08.262 INFO:tasks.workunit.client.3.smithi157.stdout:myimage28 4/s 5/s 86 KiB/s 102 KiB/s 2.20 ms 360.98 us 2024-03-26T17:05:08.262 INFO:tasks.workunit.client.3.smithi157.stdout:myimage33 4/s 6/s 87 KiB/s 117 KiB/s 1.80 ms 325.40 us 2024-03-26T17:05:08.262 INFO:tasks.workunit.client.3.smithi157.stdout:myimage43 4/s 5/s 104 KiB/s 102 KiB/s 1.89 ms 343.68 us 2024-03-26T17:05:08.263 INFO:tasks.workunit.client.3.smithi157.stdout:myimage53 4/s 6/s 74 KiB/s 142 KiB/s 1.64 ms 317.65 us 2024-03-26T17:05:08.263 INFO:tasks.workunit.client.3.smithi157.stdout:myimage32 4/s 5/s 74 KiB/s 106 KiB/s 1.70 ms 332.37 us 2024-03-26T17:05:08.263 INFO:tasks.workunit.client.3.smithi157.stdout:myimage46 4/s 6/s 58 KiB/s 142 KiB/s 1.73 ms 329.39 us 2024-03-26T17:05:08.263 INFO:tasks.workunit.client.3.smithi157.stdout:myimage56 4/s 6/s 114 KiB/s 170 KiB/s 1.99 ms 386.62 us 2024-03-26T17:05:08.263 INFO:tasks.workunit.client.3.smithi157.stdout:myimage39 3/s 5/s 75 KiB/s 105 KiB/s 1.69 ms 301.22 us 2024-03-26T17:05:08.263 INFO:tasks.workunit.client.3.smithi157.stdout:myimage5 3/s 5/s 65 KiB/s 103 KiB/s 1.61 ms 305.53 us 2024-03-26T17:05:08.263 INFO:tasks.workunit.client.3.smithi157.stdout:myimage16 3/s 4/s 54 KiB/s 71 KiB/s 1.66 ms 296.99 us 2024-03-26T17:05:08.263 INFO:tasks.workunit.client.3.smithi157.stdout:myimage22 3/s 5/s 62 KiB/s 92 KiB/s 1.64 ms 318.73 us 2024-03-26T17:05:08.263 INFO:tasks.workunit.client.3.smithi157.stdout:myimage60 3/s 5/s 66 KiB/s 120 KiB/s 1.76 ms 389.31 us 2024-03-26T17:05:08.264 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:05:09.590 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:05:09 smithi044 ceph-mon[30624]: pgmap v575: 33 pgs: 33 active+clean; 1024 MiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 6.2 MiB/s rd, 5.9 MiB/s wr, 653 op/s 2024-03-26T17:05:09.590 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:05:09 smithi044 ceph-mon[30624]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:05:09.590 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:05:09 smithi044 ceph-mon[30624]: { 2024-03-26T17:05:09.590 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:05:09 smithi044 ceph-mon[30624]: "prefix": "rbd perf image stats", 2024-03-26T17:05:09.590 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:05:09 smithi044 ceph-mon[30624]: "pool_spec": "mypool", 2024-03-26T17:05:09.591 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:05:09 smithi044 ceph-mon[30624]: "sort_by": "write_ops", 2024-03-26T17:05:09.591 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:05:09 smithi044 ceph-mon[30624]: "format": "json" 2024-03-26T17:05:09.591 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:05:09 smithi044 ceph-mon[30624]: }"]: dispatch 2024-03-26T17:05:09.591 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:05:09 smithi044 ceph-mon[30624]: Health check update: 3 slow ops, oldest one blocked for 403 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:05:09.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:05:09 smithi149 ceph-mon[34678]: pgmap v575: 33 pgs: 33 active+clean; 1024 MiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 6.2 MiB/s rd, 5.9 MiB/s wr, 653 op/s 2024-03-26T17:05:09.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:05:09 smithi149 ceph-mon[34678]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:05:09.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:05:09 smithi149 ceph-mon[34678]: { 2024-03-26T17:05:09.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:05:09 smithi149 ceph-mon[34678]: "prefix": "rbd perf image stats", 2024-03-26T17:05:09.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:05:09 smithi149 ceph-mon[34678]: "pool_spec": "mypool", 2024-03-26T17:05:09.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:05:09 smithi149 ceph-mon[34678]: "sort_by": "write_ops", 2024-03-26T17:05:09.647 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:05:09 smithi149 ceph-mon[34678]: "format": "json" 2024-03-26T17:05:09.647 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:05:09 smithi149 ceph-mon[34678]: }"]: dispatch 2024-03-26T17:05:09.647 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:05:09 smithi149 ceph-mon[34678]: Health check update: 3 slow ops, oldest one blocked for 403 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:05:09.805 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:05:09 smithi064 ceph-mon[34420]: pgmap v575: 33 pgs: 33 active+clean; 1024 MiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 6.2 MiB/s rd, 5.9 MiB/s wr, 653 op/s 2024-03-26T17:05:09.806 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:05:09 smithi064 ceph-mon[34420]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:05:09.806 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:05:09 smithi064 ceph-mon[34420]: { 2024-03-26T17:05:09.806 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:05:09 smithi064 ceph-mon[34420]: "prefix": "rbd perf image stats", 2024-03-26T17:05:09.806 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:05:09 smithi064 ceph-mon[34420]: "pool_spec": "mypool", 2024-03-26T17:05:09.806 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:05:09 smithi064 ceph-mon[34420]: "sort_by": "write_ops", 2024-03-26T17:05:09.806 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:05:09 smithi064 ceph-mon[34420]: "format": "json" 2024-03-26T17:05:09.806 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:05:09 smithi064 ceph-mon[34420]: }"]: dispatch 2024-03-26T17:05:09.806 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:05:09 smithi064 ceph-mon[34420]: Health check update: 3 slow ops, oldest one blocked for 403 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:05:10.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:05:09 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:05:09] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:05:10.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:05:09 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:05:09] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:05:10.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:05:09 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:05:10.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:05:09 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:05:09] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:05:10.147 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:05:09 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:05:09] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:05:10.147 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:05:09 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:05:11.547 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:05:11 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 2024-03-26T17:05:11.222+0000 7fa707a55700 -1 mon.c@1(peon) e3 get_health_metrics reporting 3 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T17:05:11.547 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:05:11 smithi149 ceph-mon[34678]: pgmap v576: 33 pgs: 33 active+clean; 1.0 GiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 6.6 MiB/s rd, 6.4 MiB/s wr, 686 op/s 2024-03-26T17:05:11.604 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:05:11 smithi044 ceph-mon[30624]: pgmap v576: 33 pgs: 33 active+clean; 1.0 GiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 6.6 MiB/s rd, 6.4 MiB/s wr, 686 op/s 2024-03-26T17:05:11.805 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:05:11 smithi064 ceph-mon[34420]: pgmap v576: 33 pgs: 33 active+clean; 1.0 GiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 6.6 MiB/s rd, 6.4 MiB/s wr, 686 op/s 2024-03-26T17:05:12.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:05:11 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:05:11] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:05:12.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:05:11 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:05:11] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:05:12.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:05:11 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:05:12.396 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:05:11 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:05:11] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:05:12.396 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:05:11 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:05:11] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:05:12.397 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:05:11 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:05:13.062 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:05:13.072 INFO:tasks.workunit.client.3.smithi157.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2024-03-26T17:05:13.072 INFO:tasks.workunit.client.3.smithi157.stdout: 10.50 166.4k 128.4k 0.0k 1.6M 1.3M 0.0k nvme2n1 2024-03-26T17:05:13.072 INFO:tasks.workunit.client.3.smithi157.stdout: 10.60 150.4k 168.0k 0.0k 1.5M 1.6M 0.0k nvme2n10 2024-03-26T17:05:13.072 INFO:tasks.workunit.client.3.smithi157.stdout: 10.60 85.2k 98.0k 0.0k 852.0k 980.0k 0.0k nvme2n11 2024-03-26T17:05:13.072 INFO:tasks.workunit.client.3.smithi157.stdout: 10.60 91.6k 96.4k 0.0k 916.0k 964.0k 0.0k nvme2n12 2024-03-26T17:05:13.072 INFO:tasks.workunit.client.3.smithi157.stdout: 10.60 118.4k 144.8k 0.0k 1.2M 1.4M 0.0k nvme2n13 2024-03-26T17:05:13.072 INFO:tasks.workunit.client.3.smithi157.stdout: 10.60 82.4k 124.0k 0.0k 824.0k 1.2M 0.0k nvme2n14 2024-03-26T17:05:13.073 INFO:tasks.workunit.client.3.smithi157.stdout: 10.60 102.0k 138.0k 0.0k 1020.0k 1.3M 0.0k nvme2n15 2024-03-26T17:05:13.073 INFO:tasks.workunit.client.3.smithi157.stdout: 10.60 102.4k 91.6k 0.0k 1.0M 916.0k 0.0k nvme2n16 2024-03-26T17:05:13.073 INFO:tasks.workunit.client.3.smithi157.stdout: 10.60 91.2k 91.2k 0.0k 912.0k 912.0k 0.0k nvme2n17 2024-03-26T17:05:13.073 INFO:tasks.workunit.client.3.smithi157.stdout: 10.50 136.4k 106.4k 0.0k 1.3M 1.0M 0.0k nvme2n18 2024-03-26T17:05:13.073 INFO:tasks.workunit.client.3.smithi157.stdout: 10.50 92.4k 88.4k 0.0k 924.0k 884.0k 0.0k nvme2n19 2024-03-26T17:05:13.073 INFO:tasks.workunit.client.3.smithi157.stdout: 10.50 120.0k 118.4k 0.0k 1.2M 1.2M 0.0k nvme2n2 2024-03-26T17:05:13.073 INFO:tasks.workunit.client.3.smithi157.stdout: 10.50 184.8k 150.4k 0.0k 1.8M 1.5M 0.0k nvme2n20 2024-03-26T17:05:13.073 INFO:tasks.workunit.client.3.smithi157.stdout: 10.50 116.8k 111.6k 0.0k 1.1M 1.1M 0.0k nvme2n3 2024-03-26T17:05:13.073 INFO:tasks.workunit.client.3.smithi157.stdout: 10.50 153.2k 104.4k 0.0k 1.5M 1.0M 0.0k nvme2n4 2024-03-26T17:05:13.073 INFO:tasks.workunit.client.3.smithi157.stdout: 10.50 136.0k 120.4k 0.0k 1.3M 1.2M 0.0k nvme2n5 2024-03-26T17:05:13.073 INFO:tasks.workunit.client.3.smithi157.stdout: 10.50 148.4k 185.2k 0.0k 1.4M 1.8M 0.0k nvme2n6 2024-03-26T17:05:13.073 INFO:tasks.workunit.client.3.smithi157.stdout: 10.50 142.0k 181.2k 0.0k 1.4M 1.8M 0.0k nvme2n7 2024-03-26T17:05:13.073 INFO:tasks.workunit.client.3.smithi157.stdout: 10.50 132.4k 163.2k 0.0k 1.3M 1.6M 0.0k nvme2n8 2024-03-26T17:05:13.074 INFO:tasks.workunit.client.3.smithi157.stdout: 10.60 131.2k 140.8k 0.0k 1.3M 1.4M 0.0k nvme2n9 2024-03-26T17:05:13.074 INFO:tasks.workunit.client.3.smithi157.stdout: 10.50 174.8k 143.6k 0.0k 1.7M 1.4M 0.0k nvme5n1 2024-03-26T17:05:13.074 INFO:tasks.workunit.client.3.smithi157.stdout: 10.60 98.8k 88.4k 0.0k 988.0k 884.0k 0.0k nvme5n10 2024-03-26T17:05:13.074 INFO:tasks.workunit.client.3.smithi157.stdout: 10.60 142.4k 118.0k 0.0k 1.4M 1.2M 0.0k nvme5n11 2024-03-26T17:05:13.074 INFO:tasks.workunit.client.3.smithi157.stdout: 10.60 102.8k 91.2k 0.0k 1.0M 912.0k 0.0k nvme5n12 2024-03-26T17:05:13.074 INFO:tasks.workunit.client.3.smithi157.stdout: 10.60 129.2k 88.0k 0.0k 1.3M 880.0k 0.0k nvme5n13 2024-03-26T17:05:13.074 INFO:tasks.workunit.client.3.smithi157.stdout: 10.60 88.0k 121.2k 0.0k 880.0k 1.2M 0.0k nvme5n14 2024-03-26T17:05:13.074 INFO:tasks.workunit.client.3.smithi157.stdout: 10.60 107.2k 114.0k 0.0k 1.0M 1.1M 0.0k nvme5n15 2024-03-26T17:05:13.074 INFO:tasks.workunit.client.3.smithi157.stdout: 10.60 136.4k 162.0k 0.0k 1.3M 1.6M 0.0k nvme5n16 2024-03-26T17:05:13.075 INFO:tasks.workunit.client.3.smithi157.stdout: 10.60 170.0k 160.4k 0.0k 1.7M 1.6M 0.0k nvme5n17 2024-03-26T17:05:13.075 INFO:tasks.workunit.client.3.smithi157.stdout: 10.50 152.0k 107.2k 0.0k 1.5M 1.0M 0.0k nvme5n18 2024-03-26T17:05:13.075 INFO:tasks.workunit.client.3.smithi157.stdout: 10.50 67.6k 121.6k 0.0k 676.0k 1.2M 0.0k nvme5n19 2024-03-26T17:05:13.075 INFO:tasks.workunit.client.3.smithi157.stdout: 10.50 160.8k 128.4k 0.0k 1.6M 1.3M 0.0k nvme5n2 2024-03-26T17:05:13.075 INFO:tasks.workunit.client.3.smithi157.stdout: 10.50 122.8k 74.4k 0.0k 1.2M 744.0k 0.0k nvme5n20 2024-03-26T17:05:13.075 INFO:tasks.workunit.client.3.smithi157.stdout: 10.50 97.2k 86.8k 0.0k 972.0k 868.0k 0.0k nvme5n3 2024-03-26T17:05:13.075 INFO:tasks.workunit.client.3.smithi157.stdout: 10.50 92.8k 113.2k 0.0k 928.0k 1.1M 0.0k nvme5n4 2024-03-26T17:05:13.075 INFO:tasks.workunit.client.3.smithi157.stdout: 10.50 165.6k 111.2k 0.0k 1.6M 1.1M 0.0k nvme5n5 2024-03-26T17:05:13.075 INFO:tasks.workunit.client.3.smithi157.stdout: 10.50 102.4k 94.0k 0.0k 1.0M 940.0k 0.0k nvme5n6 2024-03-26T17:05:13.075 INFO:tasks.workunit.client.3.smithi157.stdout: 10.50 162.0k 148.8k 0.0k 1.6M 1.5M 0.0k nvme5n7 2024-03-26T17:05:13.075 INFO:tasks.workunit.client.3.smithi157.stdout: 10.50 114.4k 81.6k 0.0k 1.1M 816.0k 0.0k nvme5n8 2024-03-26T17:05:13.075 INFO:tasks.workunit.client.3.smithi157.stdout: 10.60 155.2k 166.0k 0.0k 1.5M 1.6M 0.0k nvme5n9 2024-03-26T17:05:13.075 INFO:tasks.workunit.client.3.smithi157.stdout: 10.50 116.8k 111.2k 0.0k 1.1M 1.1M 0.0k nvme8n1 2024-03-26T17:05:13.076 INFO:tasks.workunit.client.3.smithi157.stdout: 10.60 176.0k 136.4k 0.0k 1.7M 1.3M 0.0k nvme8n10 2024-03-26T17:05:13.076 INFO:tasks.workunit.client.3.smithi157.stdout: 10.60 125.2k 128.4k 0.0k 1.2M 1.3M 0.0k nvme8n11 2024-03-26T17:05:13.076 INFO:tasks.workunit.client.3.smithi157.stdout: 10.60 100.8k 86.8k 0.0k 1008.0k 868.0k 0.0k nvme8n12 2024-03-26T17:05:13.076 INFO:tasks.workunit.client.3.smithi157.stdout: 10.60 138.4k 88.0k 0.0k 1.4M 880.0k 0.0k nvme8n13 2024-03-26T17:05:13.076 INFO:tasks.workunit.client.3.smithi157.stdout: 10.60 140.4k 168.0k 0.0k 1.4M 1.6M 0.0k nvme8n14 2024-03-26T17:05:13.076 INFO:tasks.workunit.client.3.smithi157.stdout: 10.60 74.4k 100.0k 0.0k 744.0k 1000.0k 0.0k nvme8n15 2024-03-26T17:05:13.076 INFO:tasks.workunit.client.3.smithi157.stdout: 10.60 148.8k 186.8k 0.0k 1.5M 1.8M 0.0k nvme8n16 2024-03-26T17:05:13.076 INFO:tasks.workunit.client.3.smithi157.stdout: 10.60 106.8k 92.8k 0.0k 1.0M 928.0k 0.0k nvme8n17 2024-03-26T17:05:13.076 INFO:tasks.workunit.client.3.smithi157.stdout: 10.50 96.4k 112.8k 0.0k 964.0k 1.1M 0.0k nvme8n18 2024-03-26T17:05:13.076 INFO:tasks.workunit.client.3.smithi157.stdout: 10.50 115.6k 115.6k 0.0k 1.1M 1.1M 0.0k nvme8n19 2024-03-26T17:05:13.077 INFO:tasks.workunit.client.3.smithi157.stdout: 10.50 134.8k 107.6k 0.0k 1.3M 1.1M 0.0k nvme8n2 2024-03-26T17:05:13.077 INFO:tasks.workunit.client.3.smithi157.stdout: 10.50 133.6k 151.6k 0.0k 1.3M 1.5M 0.0k nvme8n20 2024-03-26T17:05:13.077 INFO:tasks.workunit.client.3.smithi157.stdout: 10.50 108.8k 110.4k 0.0k 1.1M 1.1M 0.0k nvme8n3 2024-03-26T17:05:13.077 INFO:tasks.workunit.client.3.smithi157.stdout: 10.50 112.0k 113.6k 0.0k 1.1M 1.1M 0.0k nvme8n4 2024-03-26T17:05:13.077 INFO:tasks.workunit.client.3.smithi157.stdout: 10.50 117.2k 106.8k 0.0k 1.1M 1.0M 0.0k nvme8n5 2024-03-26T17:05:13.077 INFO:tasks.workunit.client.3.smithi157.stdout: 10.50 107.2k 94.0k 0.0k 1.0M 940.0k 0.0k nvme8n6 2024-03-26T17:05:13.077 INFO:tasks.workunit.client.3.smithi157.stdout: 10.50 93.2k 93.2k 0.0k 932.0k 932.0k 0.0k nvme8n7 2024-03-26T17:05:13.077 INFO:tasks.workunit.client.3.smithi157.stdout: 10.50 160.8k 119.2k 0.0k 1.6M 1.2M 0.0k nvme8n8 2024-03-26T17:05:13.077 INFO:tasks.workunit.client.3.smithi157.stdout: 10.60 98.8k 96.4k 0.0k 988.0k 964.0k 0.0k nvme8n9 2024-03-26T17:05:13.077 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:05:13.264 INFO:tasks.workunit.client.3.smithi157.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-26T17:05:13.264 INFO:tasks.workunit.client.3.smithi157.stdout:myimage58 9/s 4/s 159 KiB/s 109 KiB/s 1.68 ms 286.22 us 2024-03-26T17:05:13.264 INFO:tasks.workunit.client.3.smithi157.stdout:myimage15 7/s 5/s 162 KiB/s 119 KiB/s 1.95 ms 435.76 us 2024-03-26T17:05:13.264 INFO:tasks.workunit.client.3.smithi157.stdout:myimage35 7/s 7/s 158 KiB/s 164 KiB/s 1.67 ms 300.26 us 2024-03-26T17:05:13.264 INFO:tasks.workunit.client.3.smithi157.stdout:myimage10 7/s 4/s 233 KiB/s 105 KiB/s 1.65 ms 363.07 us 2024-03-26T17:05:13.264 INFO:tasks.workunit.client.3.smithi157.stdout:myimage19 7/s 6/s 102 KiB/s 120 KiB/s 1.69 ms 306.78 us 2024-03-26T17:05:13.264 INFO:tasks.workunit.client.3.smithi157.stdout:myimage32 6/s 8/s 130 KiB/s 166 KiB/s 1.77 ms 346.82 us 2024-03-26T17:05:13.264 INFO:tasks.workunit.client.3.smithi157.stdout:myimage40 6/s 6/s 85 KiB/s 158 KiB/s 1.66 ms 408.95 us 2024-03-26T17:05:13.264 INFO:tasks.workunit.client.3.smithi157.stdout:myimage36 6/s 4/s 186 KiB/s 158 KiB/s 1.69 ms 371.98 us 2024-03-26T17:05:13.264 INFO:tasks.workunit.client.3.smithi157.stdout:myimage43 6/s 5/s 150 KiB/s 117 KiB/s 1.90 ms 344.31 us 2024-03-26T17:05:13.264 INFO:tasks.workunit.client.3.smithi157.stdout:myimage2 6/s 6/s 149 KiB/s 114 KiB/s 1.82 ms 318.03 us 2024-03-26T17:05:13.264 INFO:tasks.workunit.client.3.smithi157.stdout:myimage9 6/s 4/s 175 KiB/s 128 KiB/s 1.86 ms 362.18 us 2024-03-26T17:05:13.265 INFO:tasks.workunit.client.3.smithi157.stdout:myimage7 6/s 5/s 195 KiB/s 164 KiB/s 1.73 ms 294.71 us 2024-03-26T17:05:13.265 INFO:tasks.workunit.client.3.smithi157.stdout:myimage25 6/s 7/s 127 KiB/s 193 KiB/s 2.18 ms 451.41 us 2024-03-26T17:05:13.265 INFO:tasks.workunit.client.3.smithi157.stdout:myimage60 6/s 5/s 181 KiB/s 132 KiB/s 1.88 ms 332.85 us 2024-03-26T17:05:13.265 INFO:tasks.workunit.client.3.smithi157.stdout:myimage13 6/s 4/s 169 KiB/s 95 KiB/s 1.63 ms 313.02 us 2024-03-26T17:05:13.265 INFO:tasks.workunit.client.3.smithi157.stdout:myimage5 6/s 6/s 166 KiB/s 160 KiB/s 1.79 ms 345.35 us 2024-03-26T17:05:13.265 INFO:tasks.workunit.client.3.smithi157.stdout:myimage51 6/s 4/s 155 KiB/s 129 KiB/s 1.92 ms 331.16 us 2024-03-26T17:05:13.265 INFO:tasks.workunit.client.3.smithi157.stdout:myimage57 6/s 7/s 122 KiB/s 122 KiB/s 1.73 ms 289.70 us 2024-03-26T17:05:13.265 INFO:tasks.workunit.client.3.smithi157.stdout:myimage14 5/s 4/s 123 KiB/s 73 KiB/s 1.91 ms 280.04 us 2024-03-26T17:05:13.265 INFO:tasks.workunit.client.3.smithi157.stdout:myimage39 5/s 4/s 126 KiB/s 62 KiB/s 1.77 ms 274.82 us 2024-03-26T17:05:13.265 INFO:tasks.workunit.client.3.smithi157.stdout:myimage53 5/s 7/s 119 KiB/s 180 KiB/s 1.82 ms 412.72 us 2024-03-26T17:05:13.265 INFO:tasks.workunit.client.3.smithi157.stdout:myimage34 5/s 5/s 117 KiB/s 74 KiB/s 1.88 ms 323.29 us 2024-03-26T17:05:13.265 INFO:tasks.workunit.client.3.smithi157.stdout:myimage38 5/s 7/s 99 KiB/s 189 KiB/s 1.70 ms 312.85 us 2024-03-26T17:05:13.265 INFO:tasks.workunit.client.3.smithi157.stdout:myimage48 5/s 5/s 158 KiB/s 156 KiB/s 1.93 ms 338.41 us 2024-03-26T17:05:13.265 INFO:tasks.workunit.client.3.smithi157.stdout:myimage6 5/s 4/s 179 KiB/s 155 KiB/s 2.00 ms 429.54 us 2024-03-26T17:05:13.265 INFO:tasks.workunit.client.3.smithi157.stdout:myimage11 5/s 3/s 85 KiB/s 64 KiB/s 1.86 ms 268.72 us 2024-03-26T17:05:13.265 INFO:tasks.workunit.client.3.smithi157.stdout:myimage55 5/s 4/s 94 KiB/s 60 KiB/s 1.74 ms 321.13 us 2024-03-26T17:05:13.266 INFO:tasks.workunit.client.3.smithi157.stdout:myimage3 5/s 5/s 122 KiB/s 118 KiB/s 1.58 ms 298.24 us 2024-03-26T17:05:13.266 INFO:tasks.workunit.client.3.smithi157.stdout:myimage8 5/s 4/s 170 KiB/s 125 KiB/s 1.74 ms 293.54 us 2024-03-26T17:05:13.266 INFO:tasks.workunit.client.3.smithi157.stdout:myimage41 5/s 4/s 102 KiB/s 90 KiB/s 1.73 ms 327.82 us 2024-03-26T17:05:13.266 INFO:tasks.workunit.client.3.smithi157.stdout:myimage54 5/s 3/s 172 KiB/s 138 KiB/s 1.62 ms 452.16 us 2024-03-26T17:05:13.266 INFO:tasks.workunit.client.3.smithi157.stdout:myimage1 5/s 6/s 140 KiB/s 155 KiB/s 1.52 ms 310.05 us 2024-03-26T17:05:13.266 INFO:tasks.workunit.client.3.smithi157.stdout:myimage17 5/s 4/s 77 KiB/s 91 KiB/s 1.80 ms 353.23 us 2024-03-26T17:05:13.266 INFO:tasks.workunit.client.3.smithi157.stdout:myimage45 5/s 5/s 109 KiB/s 101 KiB/s 1.58 ms 280.54 us 2024-03-26T17:05:13.266 INFO:tasks.workunit.client.3.smithi157.stdout:myimage22 5/s 5/s 122 KiB/s 176 KiB/s 2.10 ms 308.39 us 2024-03-26T17:05:13.266 INFO:tasks.workunit.client.3.smithi157.stdout:myimage4 5/s 6/s 78 KiB/s 122 KiB/s 1.68 ms 430.48 us 2024-03-26T17:05:13.266 INFO:tasks.workunit.client.3.smithi157.stdout:myimage46 5/s 6/s 79 KiB/s 97 KiB/s 1.67 ms 343.07 us 2024-03-26T17:05:13.266 INFO:tasks.workunit.client.3.smithi157.stdout:myimage50 5/s 4/s 173 KiB/s 145 KiB/s 1.89 ms 337.80 us 2024-03-26T17:05:13.266 INFO:tasks.workunit.client.3.smithi157.stdout:myimage56 5/s 5/s 166 KiB/s 174 KiB/s 1.91 ms 319.63 us 2024-03-26T17:05:13.266 INFO:tasks.workunit.client.3.smithi157.stdout:myimage59 5/s 4/s 72 KiB/s 69 KiB/s 1.92 ms 293.64 us 2024-03-26T17:05:13.266 INFO:tasks.workunit.client.3.smithi157.stdout:myimage47 4/s 5/s 62 KiB/s 76 KiB/s 1.88 ms 371.87 us 2024-03-26T17:05:13.267 INFO:tasks.workunit.client.3.smithi157.stdout:myimage49 4/s 6/s 93 KiB/s 106 KiB/s 1.76 ms 332.83 us 2024-03-26T17:05:13.267 INFO:tasks.workunit.client.3.smithi157.stdout:myimage52 4/s 7/s 69 KiB/s 114 KiB/s 1.64 ms 394.47 us 2024-03-26T17:05:13.267 INFO:tasks.workunit.client.3.smithi157.stdout:myimage20 4/s 4/s 140 KiB/s 173 KiB/s 1.69 ms 377.59 us 2024-03-26T17:05:13.267 INFO:tasks.workunit.client.3.smithi157.stdout:myimage33 4/s 5/s 98 KiB/s 101 KiB/s 1.88 ms 284.61 us 2024-03-26T17:05:13.267 INFO:tasks.workunit.client.3.smithi157.stdout:myimage42 4/s 5/s 118 KiB/s 141 KiB/s 1.58 ms 303.55 us 2024-03-26T17:05:13.267 INFO:tasks.workunit.client.3.smithi157.stdout:myimage16 4/s 4/s 78 KiB/s 98 KiB/s 1.54 ms 297.88 us 2024-03-26T17:05:13.267 INFO:tasks.workunit.client.3.smithi157.stdout:myimage23 4/s 5/s 86 KiB/s 86 KiB/s 1.60 ms 302.04 us 2024-03-26T17:05:13.267 INFO:tasks.workunit.client.3.smithi157.stdout:myimage24 4/s 3/s 106 KiB/s 84 KiB/s 1.85 ms 302.10 us 2024-03-26T17:05:13.267 INFO:tasks.workunit.client.3.smithi157.stdout:myimage12 4/s 6/s 86 KiB/s 103 KiB/s 1.65 ms 301.66 us 2024-03-26T17:05:13.267 INFO:tasks.workunit.client.3.smithi157.stdout:myimage31 4/s 5/s 104 KiB/s 152 KiB/s 1.64 ms 366.17 us 2024-03-26T17:05:13.267 INFO:tasks.workunit.client.3.smithi157.stdout:myimage37 4/s 6/s 127 KiB/s 200 KiB/s 1.77 ms 416.85 us 2024-03-26T17:05:13.267 INFO:tasks.workunit.client.3.smithi157.stdout:myimage29 4/s 5/s 162 KiB/s 187 KiB/s 1.68 ms 343.23 us 2024-03-26T17:05:13.267 INFO:tasks.workunit.client.3.smithi157.stdout:myimage30 4/s 6/s 86 KiB/s 100 KiB/s 2.00 ms 295.99 us 2024-03-26T17:05:13.267 INFO:tasks.workunit.client.3.smithi157.stdout:myimage44 4/s 5/s 69 KiB/s 110 KiB/s 1.77 ms 309.26 us 2024-03-26T17:05:13.268 INFO:tasks.workunit.client.3.smithi157.stdout:myimage18 4/s 5/s 85 KiB/s 90 KiB/s 1.75 ms 304.05 us 2024-03-26T17:05:13.268 INFO:tasks.workunit.client.3.smithi157.stdout:myimage28 4/s 6/s 67 KiB/s 110 KiB/s 2.30 ms 325.51 us 2024-03-26T17:05:13.268 INFO:tasks.workunit.client.3.smithi157.stdout:myimage21 3/s 5/s 134 KiB/s 164 KiB/s 2.02 ms 360.94 us 2024-03-26T17:05:13.268 INFO:tasks.workunit.client.3.smithi157.stdout:myimage26 3/s 6/s 66 KiB/s 108 KiB/s 1.72 ms 329.95 us 2024-03-26T17:05:13.268 INFO:tasks.workunit.client.3.smithi157.stdout:myimage27 3/s 3/s 114 KiB/s 137 KiB/s 1.59 ms 338.76 us 2024-03-26T17:05:13.268 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:05:13.607 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:05:13 smithi064 ceph-mon[34420]: pgmap v577: 33 pgs: 33 active+clean; 1.0 GiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 6.0 MiB/s rd, 5.7 MiB/s wr, 602 op/s 2024-03-26T17:05:13.620 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:05:13 smithi044 ceph-mon[30624]: pgmap v577: 33 pgs: 33 active+clean; 1.0 GiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 6.0 MiB/s rd, 5.7 MiB/s wr, 602 op/s 2024-03-26T17:05:13.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:05:13 smithi149 ceph-mon[34678]: pgmap v577: 33 pgs: 33 active+clean; 1.0 GiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 6.0 MiB/s rd, 5.7 MiB/s wr, 602 op/s 2024-03-26T17:05:14.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:05:13 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:05:13] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:05:14.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:05:13 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:05:13] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:05:14.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:05:13 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:05:14.334 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:05:13 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:05:13] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:05:14.335 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:05:13 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:05:13] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:05:14.335 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:05:13 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:05:14.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:05:14 smithi149 ceph-mon[34678]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:05:14.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:05:14 smithi149 ceph-mon[34678]: { 2024-03-26T17:05:14.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:05:14 smithi149 ceph-mon[34678]: "prefix": "rbd perf image stats", 2024-03-26T17:05:14.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:05:14 smithi149 ceph-mon[34678]: "pool_spec": "mypool", 2024-03-26T17:05:14.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:05:14 smithi149 ceph-mon[34678]: "sort_by": "write_ops", 2024-03-26T17:05:14.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:05:14 smithi149 ceph-mon[34678]: "format": "json" 2024-03-26T17:05:14.647 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:05:14 smithi149 ceph-mon[34678]: }"]: dispatch 2024-03-26T17:05:14.647 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:05:14 smithi149 ceph-mon[34678]: Health check update: 3 slow ops, oldest one blocked for 408 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:05:14.765 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:05:14 smithi044 ceph-mon[30624]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:05:14.765 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:05:14 smithi044 ceph-mon[30624]: { 2024-03-26T17:05:14.765 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:05:14 smithi044 ceph-mon[30624]: "prefix": "rbd perf image stats", 2024-03-26T17:05:14.765 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:05:14 smithi044 ceph-mon[30624]: "pool_spec": "mypool", 2024-03-26T17:05:14.765 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:05:14 smithi044 ceph-mon[30624]: "sort_by": "write_ops", 2024-03-26T17:05:14.765 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:05:14 smithi044 ceph-mon[30624]: "format": "json" 2024-03-26T17:05:14.766 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:05:14 smithi044 ceph-mon[30624]: }"]: dispatch 2024-03-26T17:05:14.766 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:05:14 smithi044 ceph-mon[30624]: Health check update: 3 slow ops, oldest one blocked for 408 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:05:14.806 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:05:14 smithi064 ceph-mon[34420]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:05:14.806 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:05:14 smithi064 ceph-mon[34420]: { 2024-03-26T17:05:14.806 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:05:14 smithi064 ceph-mon[34420]: "prefix": "rbd perf image stats", 2024-03-26T17:05:14.806 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:05:14 smithi064 ceph-mon[34420]: "pool_spec": "mypool", 2024-03-26T17:05:14.807 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:05:14 smithi064 ceph-mon[34420]: "sort_by": "write_ops", 2024-03-26T17:05:14.807 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:05:14 smithi064 ceph-mon[34420]: "format": "json" 2024-03-26T17:05:14.807 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:05:14 smithi064 ceph-mon[34420]: }"]: dispatch 2024-03-26T17:05:14.808 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:05:14 smithi064 ceph-mon[34420]: Health check update: 3 slow ops, oldest one blocked for 408 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:05:15.636 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:05:15 smithi044 ceph-mon[30624]: pgmap v578: 33 pgs: 33 active+clean; 1.0 GiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 7.3 MiB/s rd, 7.0 MiB/s wr, 692 op/s 2024-03-26T17:05:15.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:05:15 smithi149 ceph-mon[34678]: pgmap v578: 33 pgs: 33 active+clean; 1.0 GiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 7.3 MiB/s rd, 7.0 MiB/s wr, 692 op/s 2024-03-26T17:05:15.805 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:05:15 smithi064 ceph-mon[34420]: pgmap v578: 33 pgs: 33 active+clean; 1.0 GiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 7.3 MiB/s rd, 7.0 MiB/s wr, 692 op/s 2024-03-26T17:05:16.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:05:15 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:05:15] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:05:16.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:05:15 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:05:15] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:05:16.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:05:15 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:05:16.224 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:05:15 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:05:15] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:05:16.224 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:05:15 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:05:15] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:05:16.225 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:05:15 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:05:16.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:05:16 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 2024-03-26T17:05:16.223+0000 7fa707a55700 -1 mon.c@1(peon) e3 get_health_metrics reporting 3 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T17:05:17.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:05:17 smithi149 ceph-mon[34678]: pgmap v579: 33 pgs: 33 active+clean; 1.0 GiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 7.1 MiB/s rd, 6.8 MiB/s wr, 617 op/s 2024-03-26T17:05:17.653 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:05:17 smithi044 ceph-mon[30624]: pgmap v579: 33 pgs: 33 active+clean; 1.0 GiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 7.1 MiB/s rd, 6.8 MiB/s wr, 617 op/s 2024-03-26T17:05:17.805 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:05:17 smithi064 ceph-mon[34420]: pgmap v579: 33 pgs: 33 active+clean; 1.0 GiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 7.1 MiB/s rd, 6.8 MiB/s wr, 617 op/s 2024-03-26T17:05:18.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:05:17 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:05:17] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:05:18.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:05:17 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:05:17] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:05:18.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:05:17 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:05:18.268 INFO:tasks.workunit.client.3.smithi157.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-26T17:05:18.269 INFO:tasks.workunit.client.3.smithi157.stdout:myimage26 6/s 4/s 196 KiB/s 146 KiB/s 1.85 ms 426.83 us 2024-03-26T17:05:18.269 INFO:tasks.workunit.client.3.smithi157.stdout:myimage39 6/s 5/s 138 KiB/s 129 KiB/s 1.65 ms 381.42 us 2024-03-26T17:05:18.269 INFO:tasks.workunit.client.3.smithi157.stdout:myimage31 6/s 4/s 209 KiB/s 148 KiB/s 1.88 ms 369.32 us 2024-03-26T17:05:18.269 INFO:tasks.workunit.client.3.smithi157.stdout:myimage6 6/s 4/s 210 KiB/s 150 KiB/s 1.79 ms 337.18 us 2024-03-26T17:05:18.269 INFO:tasks.workunit.client.3.smithi157.stdout:myimage13 6/s 4/s 178 KiB/s 155 KiB/s 1.71 ms 345.09 us 2024-03-26T17:05:18.269 INFO:tasks.workunit.client.3.smithi157.stdout:myimage8 6/s 3/s 178 KiB/s 114 KiB/s 1.76 ms 334.84 us 2024-03-26T17:05:18.269 INFO:tasks.workunit.client.3.smithi157.stdout:myimage14 6/s 5/s 135 KiB/s 129 KiB/s 1.91 ms 317.99 us 2024-03-26T17:05:18.269 INFO:tasks.workunit.client.3.smithi157.stdout:myimage22 6/s 5/s 184 KiB/s 155 KiB/s 1.66 ms 382.21 us 2024-03-26T17:05:18.269 INFO:tasks.workunit.client.3.smithi157.stdout:myimage29 6/s 3/s 178 KiB/s 103 KiB/s 1.68 ms 417.14 us 2024-03-26T17:05:18.269 INFO:tasks.workunit.client.3.smithi157.stdout:myimage56 6/s 5/s 202 KiB/s 143 KiB/s 2.10 ms 297.75 us 2024-03-26T17:05:18.269 INFO:tasks.workunit.client.3.smithi157.stdout:myimage16 5/s 7/s 164 KiB/s 146 KiB/s 2.03 ms 374.62 us 2024-03-26T17:05:18.269 INFO:tasks.workunit.client.3.smithi157.stdout:myimage47 5/s 5/s 143 KiB/s 169 KiB/s 1.91 ms 329.44 us 2024-03-26T17:05:18.269 INFO:tasks.workunit.client.3.smithi157.stdout:myimage18 5/s 4/s 168 KiB/s 160 KiB/s 1.79 ms 332.64 us 2024-03-26T17:05:18.269 INFO:tasks.workunit.client.3.smithi157.stdout:myimage54 5/s 5/s 167 KiB/s 122 KiB/s 1.76 ms 324.31 us 2024-03-26T17:05:18.270 INFO:tasks.workunit.client.3.smithi157.stdout:myimage59 5/s 5/s 178 KiB/s 172 KiB/s 1.97 ms 347.87 us 2024-03-26T17:05:18.270 INFO:tasks.workunit.client.3.smithi157.stdout:myimage44 5/s 4/s 149 KiB/s 104 KiB/s 1.89 ms 275.28 us 2024-03-26T17:05:18.270 INFO:tasks.workunit.client.3.smithi157.stdout:myimage30 5/s 5/s 96 KiB/s 108 KiB/s 2.14 ms 336.95 us 2024-03-26T17:05:18.270 INFO:tasks.workunit.client.3.smithi157.stdout:myimage37 5/s 4/s 134 KiB/s 96 KiB/s 1.85 ms 402.38 us 2024-03-26T17:05:18.270 INFO:tasks.workunit.client.3.smithi157.stdout:myimage11 5/s 7/s 98 KiB/s 135 KiB/s 1.99 ms 300.38 us 2024-03-26T17:05:18.270 INFO:tasks.workunit.client.3.smithi157.stdout:myimage12 5/s 4/s 114 KiB/s 106 KiB/s 1.74 ms 377.01 us 2024-03-26T17:05:18.270 INFO:tasks.workunit.client.3.smithi157.stdout:myimage17 5/s 4/s 115 KiB/s 107 KiB/s 1.86 ms 326.26 us 2024-03-26T17:05:18.270 INFO:tasks.workunit.client.3.smithi157.stdout:myimage41 5/s 5/s 150 KiB/s 164 KiB/s 1.87 ms 349.22 us 2024-03-26T17:05:18.270 INFO:tasks.workunit.client.3.smithi157.stdout:myimage46 5/s 5/s 193 KiB/s 172 KiB/s 1.73 ms 344.39 us 2024-03-26T17:05:18.270 INFO:tasks.workunit.client.3.smithi157.stdout:myimage60 5/s 5/s 166 KiB/s 147 KiB/s 1.86 ms 290.43 us 2024-03-26T17:05:18.270 INFO:tasks.workunit.client.3.smithi157.stdout:myimage24 5/s 5/s 110 KiB/s 96 KiB/s 1.71 ms 373.73 us 2024-03-26T17:05:18.270 INFO:tasks.workunit.client.3.smithi157.stdout:myimage28 5/s 6/s 136 KiB/s 142 KiB/s 2.15 ms 321.03 us 2024-03-26T17:05:18.270 INFO:tasks.workunit.client.3.smithi157.stdout:myimage4 5/s 5/s 153 KiB/s 217 KiB/s 1.72 ms 391.61 us 2024-03-26T17:05:18.270 INFO:tasks.workunit.client.3.smithi157.stdout:myimage5 5/s 4/s 162 KiB/s 116 KiB/s 1.70 ms 332.28 us 2024-03-26T17:05:18.271 INFO:tasks.workunit.client.3.smithi157.stdout:myimage23 4/s 5/s 99 KiB/s 106 KiB/s 1.72 ms 343.02 us 2024-03-26T17:05:18.271 INFO:tasks.workunit.client.3.smithi157.stdout:myimage7 4/s 5/s 143 KiB/s 152 KiB/s 1.87 ms 359.29 us 2024-03-26T17:05:18.271 INFO:tasks.workunit.client.3.smithi157.stdout:myimage33 4/s 4/s 119 KiB/s 126 KiB/s 1.88 ms 409.50 us 2024-03-26T17:05:18.271 INFO:tasks.workunit.client.3.smithi157.stdout:myimage51 4/s 4/s 115 KiB/s 145 KiB/s 1.95 ms 342.54 us 2024-03-26T17:05:18.271 INFO:tasks.workunit.client.3.smithi157.stdout:myimage34 4/s 3/s 109 KiB/s 74 KiB/s 1.70 ms 324.23 us 2024-03-26T17:05:18.271 INFO:tasks.workunit.client.3.smithi157.stdout:myimage1 4/s 5/s 129 KiB/s 170 KiB/s 1.64 ms 298.26 us 2024-03-26T17:05:18.271 INFO:tasks.workunit.client.3.smithi157.stdout:myimage20 4/s 4/s 147 KiB/s 170 KiB/s 1.78 ms 372.83 us 2024-03-26T17:05:18.271 INFO:tasks.workunit.client.3.smithi157.stdout:myimage36 4/s 4/s 160 KiB/s 168 KiB/s 1.71 ms 348.11 us 2024-03-26T17:05:18.271 INFO:tasks.workunit.client.3.smithi157.stdout:myimage50 4/s 5/s 121 KiB/s 178 KiB/s 1.96 ms 313.01 us 2024-03-26T17:05:18.271 INFO:tasks.workunit.client.3.smithi157.stdout:myimage48 4/s 5/s 148 KiB/s 133 KiB/s 1.78 ms 301.68 us 2024-03-26T17:05:18.273 INFO:tasks.workunit.client.3.smithi157.stdout:myimage9 4/s 5/s 148 KiB/s 120 KiB/s 2.02 ms 319.51 us 2024-03-26T17:05:18.273 INFO:tasks.workunit.client.3.smithi157.stdout:myimage15 4/s 4/s 142 KiB/s 131 KiB/s 1.62 ms 418.56 us 2024-03-26T17:05:18.273 INFO:tasks.workunit.client.3.smithi157.stdout:myimage19 4/s 3/s 98 KiB/s 91 KiB/s 1.92 ms 307.01 us 2024-03-26T17:05:18.274 INFO:tasks.workunit.client.3.smithi157.stdout:myimage27 4/s 5/s 175 KiB/s 167 KiB/s 1.69 ms 338.49 us 2024-03-26T17:05:18.274 INFO:tasks.workunit.client.3.smithi157.stdout:myimage21 4/s 6/s 155 KiB/s 201 KiB/s 2.25 ms 358.74 us 2024-03-26T17:05:18.274 INFO:tasks.workunit.client.3.smithi157.stdout:myimage25 4/s 5/s 159 KiB/s 163 KiB/s 2.08 ms 356.30 us 2024-03-26T17:05:18.274 INFO:tasks.workunit.client.3.smithi157.stdout:myimage2 4/s 5/s 127 KiB/s 190 KiB/s 1.87 ms 390.63 us 2024-03-26T17:05:18.274 INFO:tasks.workunit.client.3.smithi157.stdout:myimage38 4/s 4/s 133 KiB/s 146 KiB/s 1.57 ms 375.45 us 2024-03-26T17:05:18.274 INFO:tasks.workunit.client.3.smithi157.stdout:myimage40 4/s 3/s 131 KiB/s 113 KiB/s 1.77 ms 360.91 us 2024-03-26T17:05:18.274 INFO:tasks.workunit.client.3.smithi157.stdout:myimage42 4/s 6/s 110 KiB/s 162 KiB/s 1.76 ms 299.72 us 2024-03-26T17:05:18.274 INFO:tasks.workunit.client.3.smithi157.stdout:myimage43 4/s 5/s 139 KiB/s 186 KiB/s 1.89 ms 356.91 us 2024-03-26T17:05:18.274 INFO:tasks.workunit.client.3.smithi157.stdout:myimage3 3/s 6/s 133 KiB/s 192 KiB/s 1.55 ms 375.89 us 2024-03-26T17:05:18.274 INFO:tasks.workunit.client.3.smithi157.stdout:myimage49 3/s 5/s 103 KiB/s 127 KiB/s 1.91 ms 378.24 us 2024-03-26T17:05:18.274 INFO:tasks.workunit.client.3.smithi157.stdout:myimage57 3/s 4/s 90 KiB/s 122 KiB/s 1.84 ms 313.52 us 2024-03-26T17:05:18.274 INFO:tasks.workunit.client.3.smithi157.stdout:myimage10 3/s 6/s 128 KiB/s 209 KiB/s 1.73 ms 319.94 us 2024-03-26T17:05:18.274 INFO:tasks.workunit.client.3.smithi157.stdout:myimage35 3/s 4/s 63 KiB/s 99 KiB/s 1.63 ms 323.97 us 2024-03-26T17:05:18.274 INFO:tasks.workunit.client.3.smithi157.stdout:myimage52 3/s 4/s 161 KiB/s 130 KiB/s 2.02 ms 406.71 us 2024-03-26T17:05:18.275 INFO:tasks.workunit.client.3.smithi157.stdout:myimage55 3/s 4/s 88 KiB/s 130 KiB/s 1.74 ms 312.08 us 2024-03-26T17:05:18.275 INFO:tasks.workunit.client.3.smithi157.stdout:myimage45 3/s 6/s 114 KiB/s 154 KiB/s 1.63 ms 291.73 us 2024-03-26T17:05:18.275 INFO:tasks.workunit.client.3.smithi157.stdout:myimage53 3/s 4/s 74 KiB/s 103 KiB/s 1.67 ms 307.29 us 2024-03-26T17:05:18.275 INFO:tasks.workunit.client.3.smithi157.stdout:myimage58 3/s 4/s 94 KiB/s 146 KiB/s 1.68 ms 461.26 us 2024-03-26T17:05:18.275 INFO:tasks.workunit.client.3.smithi157.stdout:myimage32 2/s 4/s 70 KiB/s 106 KiB/s 2.08 ms 391.62 us 2024-03-26T17:05:18.275 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:05:18.396 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:05:17 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:05:17] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:05:18.397 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:05:17 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:05:17] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:05:18.397 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:05:17 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:05:19.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:05:19 smithi149 ceph-mon[34678]: pgmap v580: 33 pgs: 33 active+clean; 1.0 GiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 7.5 MiB/s rd, 7.3 MiB/s wr, 615 op/s 2024-03-26T17:05:19.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:05:19 smithi149 ceph-mon[34678]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:05:19.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:05:19 smithi149 ceph-mon[34678]: { 2024-03-26T17:05:19.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:05:19 smithi149 ceph-mon[34678]: "prefix": "rbd perf image stats", 2024-03-26T17:05:19.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:05:19 smithi149 ceph-mon[34678]: "pool_spec": "mypool", 2024-03-26T17:05:19.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:05:19 smithi149 ceph-mon[34678]: "sort_by": "write_ops", 2024-03-26T17:05:19.647 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:05:19 smithi149 ceph-mon[34678]: "format": "json" 2024-03-26T17:05:19.647 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:05:19 smithi149 ceph-mon[34678]: }"]: dispatch 2024-03-26T17:05:19.647 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:05:19 smithi149 ceph-mon[34678]: Health check update: 3 slow ops, oldest one blocked for 413 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:05:19.667 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:05:19 smithi044 ceph-mon[30624]: pgmap v580: 33 pgs: 33 active+clean; 1.0 GiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 7.5 MiB/s rd, 7.3 MiB/s wr, 615 op/s 2024-03-26T17:05:19.667 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:05:19 smithi044 ceph-mon[30624]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:05:19.667 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:05:19 smithi044 ceph-mon[30624]: { 2024-03-26T17:05:19.667 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:05:19 smithi044 ceph-mon[30624]: "prefix": "rbd perf image stats", 2024-03-26T17:05:19.667 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:05:19 smithi044 ceph-mon[30624]: "pool_spec": "mypool", 2024-03-26T17:05:19.667 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:05:19 smithi044 ceph-mon[30624]: "sort_by": "write_ops", 2024-03-26T17:05:19.668 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:05:19 smithi044 ceph-mon[30624]: "format": "json" 2024-03-26T17:05:19.668 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:05:19 smithi044 ceph-mon[30624]: }"]: dispatch 2024-03-26T17:05:19.668 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:05:19 smithi044 ceph-mon[30624]: Health check update: 3 slow ops, oldest one blocked for 413 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:05:19.805 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:05:19 smithi064 ceph-mon[34420]: pgmap v580: 33 pgs: 33 active+clean; 1.0 GiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 7.5 MiB/s rd, 7.3 MiB/s wr, 615 op/s 2024-03-26T17:05:19.805 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:05:19 smithi064 ceph-mon[34420]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:05:19.806 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:05:19 smithi064 ceph-mon[34420]: { 2024-03-26T17:05:19.806 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:05:19 smithi064 ceph-mon[34420]: "prefix": "rbd perf image stats", 2024-03-26T17:05:19.806 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:05:19 smithi064 ceph-mon[34420]: "pool_spec": "mypool", 2024-03-26T17:05:19.806 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:05:19 smithi064 ceph-mon[34420]: "sort_by": "write_ops", 2024-03-26T17:05:19.806 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:05:19 smithi064 ceph-mon[34420]: "format": "json" 2024-03-26T17:05:19.806 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:05:19 smithi064 ceph-mon[34420]: }"]: dispatch 2024-03-26T17:05:19.807 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:05:19 smithi064 ceph-mon[34420]: Health check update: 3 slow ops, oldest one blocked for 413 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:05:20.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:05:19 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:05:19] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:05:20.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:05:19 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:05:19] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:05:20.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:05:19 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:05:20.396 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:05:19 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:05:19] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:05:20.397 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:05:19 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:05:19] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:05:20.397 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:05:19 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:05:21.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:05:21 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 2024-03-26T17:05:21.223+0000 7fa707a55700 -1 mon.c@1(peon) e3 get_health_metrics reporting 3 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T17:05:21.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:05:21 smithi149 ceph-mon[34678]: pgmap v581: 33 pgs: 33 active+clean; 1.0 GiB data, 3.4 GiB used, 712 GiB / 715 GiB avail; 8.4 MiB/s rd, 8.5 MiB/s wr, 655 op/s 2024-03-26T17:05:21.678 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:05:21 smithi044 ceph-mon[30624]: pgmap v581: 33 pgs: 33 active+clean; 1.0 GiB data, 3.4 GiB used, 712 GiB / 715 GiB avail; 8.4 MiB/s rd, 8.5 MiB/s wr, 655 op/s 2024-03-26T17:05:21.806 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:05:21 smithi064 ceph-mon[34420]: pgmap v581: 33 pgs: 33 active+clean; 1.0 GiB data, 3.4 GiB used, 712 GiB / 715 GiB avail; 8.4 MiB/s rd, 8.5 MiB/s wr, 655 op/s 2024-03-26T17:05:22.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:05:21 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:05:21] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:05:22.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:05:21 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:05:21] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:05:22.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:05:21 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:05:22.396 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:05:21 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:05:21] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:05:22.397 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:05:21 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:05:21] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:05:22.397 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:05:21 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:05:23.062 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:05:23.070 INFO:tasks.workunit.client.3.smithi157.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2024-03-26T17:05:23.070 INFO:tasks.workunit.client.3.smithi157.stdout: 10.10 123.6k 171.6k 0.0k 1.2M 1.7M 0.0k nvme2n1 2024-03-26T17:05:23.070 INFO:tasks.workunit.client.3.smithi157.stdout: 10.10 154.0k 156.0k 0.0k 1.5M 1.5M 0.0k nvme2n10 2024-03-26T17:05:23.070 INFO:tasks.workunit.client.3.smithi157.stdout: 10.10 158.4k 143.6k 0.0k 1.5M 1.4M 0.0k nvme2n11 2024-03-26T17:05:23.070 INFO:tasks.workunit.client.3.smithi157.stdout: 10.10 142.8k 153.2k 0.0k 1.4M 1.5M 0.0k nvme2n12 2024-03-26T17:05:23.070 INFO:tasks.workunit.client.3.smithi157.stdout: 10.10 150.4k 135.6k 0.0k 1.5M 1.3M 0.0k nvme2n13 2024-03-26T17:05:23.070 INFO:tasks.workunit.client.3.smithi157.stdout: 10.10 197.6k 124.0k 0.0k 1.9M 1.2M 0.0k nvme2n14 2024-03-26T17:05:23.070 INFO:tasks.workunit.client.3.smithi157.stdout: 10.10 154.4k 188.4k 0.0k 1.5M 1.8M 0.0k nvme2n15 2024-03-26T17:05:23.070 INFO:tasks.workunit.client.3.smithi157.stdout: 10.00 160.8k 140.4k 0.0k 1.6M 1.4M 0.0k nvme2n16 2024-03-26T17:05:23.070 INFO:tasks.workunit.client.3.smithi157.stdout: 10.00 156.8k 142.8k 0.0k 1.5M 1.4M 0.0k nvme2n17 2024-03-26T17:05:23.070 INFO:tasks.workunit.client.3.smithi157.stdout: 10.10 155.2k 177.6k 0.0k 1.5M 1.7M 0.0k nvme2n18 2024-03-26T17:05:23.070 INFO:tasks.workunit.client.3.smithi157.stdout: 10.10 156.0k 152.4k 0.0k 1.5M 1.5M 0.0k nvme2n19 2024-03-26T17:05:23.071 INFO:tasks.workunit.client.3.smithi157.stdout: 10.10 169.2k 133.2k 0.0k 1.7M 1.3M 0.0k nvme2n2 2024-03-26T17:05:23.071 INFO:tasks.workunit.client.3.smithi157.stdout: 10.10 158.0k 164.4k 0.0k 1.5M 1.6M 0.0k nvme2n20 2024-03-26T17:05:23.071 INFO:tasks.workunit.client.3.smithi157.stdout: 10.10 209.6k 122.4k 0.0k 2.0M 1.2M 0.0k nvme2n3 2024-03-26T17:05:23.071 INFO:tasks.workunit.client.3.smithi157.stdout: 10.10 170.0k 166.4k 0.0k 1.7M 1.6M 0.0k nvme2n4 2024-03-26T17:05:23.071 INFO:tasks.workunit.client.3.smithi157.stdout: 10.10 117.2k 169.2k 0.0k 1.1M 1.7M 0.0k nvme2n5 2024-03-26T17:05:23.071 INFO:tasks.workunit.client.3.smithi157.stdout: 10.10 168.8k 162.8k 0.0k 1.6M 1.6M 0.0k nvme2n6 2024-03-26T17:05:23.071 INFO:tasks.workunit.client.3.smithi157.stdout: 10.10 161.6k 122.8k 0.0k 1.6M 1.2M 0.0k nvme2n7 2024-03-26T17:05:23.071 INFO:tasks.workunit.client.3.smithi157.stdout: 10.10 140.4k 165.6k 0.0k 1.4M 1.6M 0.0k nvme2n8 2024-03-26T17:05:23.071 INFO:tasks.workunit.client.3.smithi157.stdout: 10.10 136.8k 148.0k 0.0k 1.3M 1.4M 0.0k nvme2n9 2024-03-26T17:05:23.071 INFO:tasks.workunit.client.3.smithi157.stdout: 10.10 131.2k 160.0k 0.0k 1.3M 1.6M 0.0k nvme5n1 2024-03-26T17:05:23.071 INFO:tasks.workunit.client.3.smithi157.stdout: 10.10 159.2k 126.4k 0.0k 1.6M 1.2M 0.0k nvme5n10 2024-03-26T17:05:23.071 INFO:tasks.workunit.client.3.smithi157.stdout: 10.10 155.2k 150.8k 0.0k 1.5M 1.5M 0.0k nvme5n11 2024-03-26T17:05:23.072 INFO:tasks.workunit.client.3.smithi157.stdout: 10.10 182.4k 148.4k 0.0k 1.8M 1.4M 0.0k nvme5n12 2024-03-26T17:05:23.072 INFO:tasks.workunit.client.3.smithi157.stdout: 10.10 129.2k 142.0k 0.0k 1.3M 1.4M 0.0k nvme5n13 2024-03-26T17:05:23.072 INFO:tasks.workunit.client.3.smithi157.stdout: 10.10 137.6k 136.0k 0.0k 1.3M 1.3M 0.0k nvme5n14 2024-03-26T17:05:23.072 INFO:tasks.workunit.client.3.smithi157.stdout: 10.10 171.6k 122.0k 0.0k 1.7M 1.2M 0.0k nvme5n15 2024-03-26T17:05:23.072 INFO:tasks.workunit.client.3.smithi157.stdout: 10.00 172.4k 142.4k 0.0k 1.7M 1.4M 0.0k nvme5n16 2024-03-26T17:05:23.072 INFO:tasks.workunit.client.3.smithi157.stdout: 10.00 126.8k 134.4k 0.0k 1.2M 1.3M 0.0k nvme5n17 2024-03-26T17:05:23.072 INFO:tasks.workunit.client.3.smithi157.stdout: 10.10 160.4k 148.4k 0.0k 1.6M 1.4M 0.0k nvme5n18 2024-03-26T17:05:23.072 INFO:tasks.workunit.client.3.smithi157.stdout: 10.10 160.4k 150.8k 0.0k 1.6M 1.5M 0.0k nvme5n19 2024-03-26T17:05:23.072 INFO:tasks.workunit.client.3.smithi157.stdout: 10.10 148.0k 172.4k 0.0k 1.4M 1.7M 0.0k nvme5n2 2024-03-26T17:05:23.072 INFO:tasks.workunit.client.3.smithi157.stdout: 10.10 139.6k 185.2k 0.0k 1.4M 1.8M 0.0k nvme5n20 2024-03-26T17:05:23.072 INFO:tasks.workunit.client.3.smithi157.stdout: 10.10 139.2k 137.6k 0.0k 1.4M 1.3M 0.0k nvme5n3 2024-03-26T17:05:23.072 INFO:tasks.workunit.client.3.smithi157.stdout: 10.10 115.6k 165.6k 0.0k 1.1M 1.6M 0.0k nvme5n4 2024-03-26T17:05:23.072 INFO:tasks.workunit.client.3.smithi157.stdout: 10.10 161.2k 169.6k 0.0k 1.6M 1.7M 0.0k nvme5n5 2024-03-26T17:05:23.072 INFO:tasks.workunit.client.3.smithi157.stdout: 10.10 153.2k 198.8k 0.0k 1.5M 1.9M 0.0k nvme5n6 2024-03-26T17:05:23.072 INFO:tasks.workunit.client.3.smithi157.stdout: 10.10 156.4k 167.6k 0.0k 1.5M 1.6M 0.0k nvme5n7 2024-03-26T17:05:23.072 INFO:tasks.workunit.client.3.smithi157.stdout: 10.10 182.8k 143.2k 0.0k 1.8M 1.4M 0.0k nvme5n8 2024-03-26T17:05:23.073 INFO:tasks.workunit.client.3.smithi157.stdout: 10.10 136.8k 160.8k 0.0k 1.3M 1.6M 0.0k nvme5n9 2024-03-26T17:05:23.073 INFO:tasks.workunit.client.3.smithi157.stdout: 10.10 159.2k 158.8k 0.0k 1.6M 1.6M 0.0k nvme8n1 2024-03-26T17:05:23.073 INFO:tasks.workunit.client.3.smithi157.stdout: 10.10 134.4k 144.8k 0.0k 1.3M 1.4M 0.0k nvme8n10 2024-03-26T17:05:23.073 INFO:tasks.workunit.client.3.smithi157.stdout: 10.10 149.2k 145.2k 0.0k 1.5M 1.4M 0.0k nvme8n11 2024-03-26T17:05:23.073 INFO:tasks.workunit.client.3.smithi157.stdout: 10.10 152.0k 194.0k 0.0k 1.5M 1.9M 0.0k nvme8n12 2024-03-26T17:05:23.073 INFO:tasks.workunit.client.3.smithi157.stdout: 10.10 140.4k 184.4k 0.0k 1.4M 1.8M 0.0k nvme8n13 2024-03-26T17:05:23.073 INFO:tasks.workunit.client.3.smithi157.stdout: 10.10 190.4k 133.2k 0.0k 1.9M 1.3M 0.0k nvme8n14 2024-03-26T17:05:23.073 INFO:tasks.workunit.client.3.smithi157.stdout: 10.00 178.8k 109.2k 0.0k 1.7M 1.1M 0.0k nvme8n15 2024-03-26T17:05:23.073 INFO:tasks.workunit.client.3.smithi157.stdout: 10.00 154.8k 122.8k 0.0k 1.5M 1.2M 0.0k nvme8n16 2024-03-26T17:05:23.073 INFO:tasks.workunit.client.3.smithi157.stdout: 10.00 172.0k 168.0k 0.0k 1.7M 1.6M 0.0k nvme8n17 2024-03-26T17:05:23.073 INFO:tasks.workunit.client.3.smithi157.stdout: 10.10 170.4k 149.6k 0.0k 1.7M 1.5M 0.0k nvme8n18 2024-03-26T17:05:23.073 INFO:tasks.workunit.client.3.smithi157.stdout: 10.10 144.0k 203.6k 0.0k 1.4M 2.0M 0.0k nvme8n19 2024-03-26T17:05:23.073 INFO:tasks.workunit.client.3.smithi157.stdout: 10.10 151.6k 131.6k 0.0k 1.5M 1.3M 0.0k nvme8n2 2024-03-26T17:05:23.074 INFO:tasks.workunit.client.3.smithi157.stdout: 10.10 154.4k 154.4k 0.0k 1.5M 1.5M 0.0k nvme8n20 2024-03-26T17:05:23.074 INFO:tasks.workunit.client.3.smithi157.stdout: 10.10 159.2k 158.0k 0.0k 1.6M 1.5M 0.0k nvme8n3 2024-03-26T17:05:23.074 INFO:tasks.workunit.client.3.smithi157.stdout: 10.10 146.8k 136.8k 0.0k 1.4M 1.3M 0.0k nvme8n4 2024-03-26T17:05:23.074 INFO:tasks.workunit.client.3.smithi157.stdout: 10.10 117.2k 160.8k 0.0k 1.1M 1.6M 0.0k nvme8n5 2024-03-26T17:05:23.074 INFO:tasks.workunit.client.3.smithi157.stdout: 10.10 148.4k 174.0k 0.0k 1.4M 1.7M 0.0k nvme8n6 2024-03-26T17:05:23.074 INFO:tasks.workunit.client.3.smithi157.stdout: 10.10 194.0k 146.4k 0.0k 1.9M 1.4M 0.0k nvme8n7 2024-03-26T17:05:23.074 INFO:tasks.workunit.client.3.smithi157.stdout: 10.10 151.6k 122.4k 0.0k 1.5M 1.2M 0.0k nvme8n8 2024-03-26T17:05:23.074 INFO:tasks.workunit.client.3.smithi157.stdout: 10.10 142.8k 152.0k 0.0k 1.4M 1.5M 0.0k nvme8n9 2024-03-26T17:05:23.074 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:05:23.273 INFO:tasks.workunit.client.3.smithi157.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-26T17:05:23.273 INFO:tasks.workunit.client.3.smithi157.stdout:myimage15 7/s 4/s 266 KiB/s 157 KiB/s 1.69 ms 400.16 us 2024-03-26T17:05:23.273 INFO:tasks.workunit.client.3.smithi157.stdout:myimage58 6/s 4/s 201 KiB/s 154 KiB/s 1.65 ms 413.88 us 2024-03-26T17:05:23.273 INFO:tasks.workunit.client.3.smithi157.stdout:myimage26 6/s 3/s 218 KiB/s 113 KiB/s 1.78 ms 386.25 us 2024-03-26T17:05:23.273 INFO:tasks.workunit.client.3.smithi157.stdout:myimage42 6/s 4/s 181 KiB/s 129 KiB/s 1.75 ms 323.91 us 2024-03-26T17:05:23.273 INFO:tasks.workunit.client.3.smithi157.stdout:myimage40 6/s 4/s 204 KiB/s 141 KiB/s 1.77 ms 453.06 us 2024-03-26T17:05:23.273 INFO:tasks.workunit.client.3.smithi157.stdout:myimage53 6/s 4/s 232 KiB/s 130 KiB/s 1.89 ms 372.23 us 2024-03-26T17:05:23.273 INFO:tasks.workunit.client.3.smithi157.stdout:myimage12 6/s 4/s 209 KiB/s 118 KiB/s 1.77 ms 341.29 us 2024-03-26T17:05:23.273 INFO:tasks.workunit.client.3.smithi157.stdout:myimage20 6/s 5/s 172 KiB/s 179 KiB/s 1.77 ms 359.94 us 2024-03-26T17:05:23.273 INFO:tasks.workunit.client.3.smithi157.stdout:myimage33 6/s 4/s 153 KiB/s 122 KiB/s 1.84 ms 399.52 us 2024-03-26T17:05:23.273 INFO:tasks.workunit.client.3.smithi157.stdout:myimage59 6/s 4/s 206 KiB/s 126 KiB/s 1.86 ms 345.94 us 2024-03-26T17:05:23.274 INFO:tasks.workunit.client.3.smithi157.stdout:myimage37 5/s 4/s 162 KiB/s 126 KiB/s 1.88 ms 361.03 us 2024-03-26T17:05:23.274 INFO:tasks.workunit.client.3.smithi157.stdout:myimage1 5/s 4/s 185 KiB/s 127 KiB/s 1.60 ms 295.35 us 2024-03-26T17:05:23.274 INFO:tasks.workunit.client.3.smithi157.stdout:myimage49 5/s 5/s 157 KiB/s 174 KiB/s 1.81 ms 322.45 us 2024-03-26T17:05:23.274 INFO:tasks.workunit.client.3.smithi157.stdout:myimage36 5/s 5/s 154 KiB/s 159 KiB/s 1.77 ms 330.25 us 2024-03-26T17:05:23.274 INFO:tasks.workunit.client.3.smithi157.stdout:myimage39 5/s 5/s 174 KiB/s 158 KiB/s 1.79 ms 337.75 us 2024-03-26T17:05:23.274 INFO:tasks.workunit.client.3.smithi157.stdout:myimage45 5/s 4/s 150 KiB/s 109 KiB/s 1.91 ms 280.67 us 2024-03-26T17:05:23.274 INFO:tasks.workunit.client.3.smithi157.stdout:myimage52 5/s 5/s 216 KiB/s 154 KiB/s 2.03 ms 357.51 us 2024-03-26T17:05:23.274 INFO:tasks.workunit.client.3.smithi157.stdout:myimage19 5/s 4/s 144 KiB/s 151 KiB/s 1.90 ms 374.95 us 2024-03-26T17:05:23.274 INFO:tasks.workunit.client.3.smithi157.stdout:myimage24 5/s 5/s 194 KiB/s 139 KiB/s 1.85 ms 432.44 us 2024-03-26T17:05:23.274 INFO:tasks.workunit.client.3.smithi157.stdout:myimage57 5/s 5/s 191 KiB/s 198 KiB/s 1.79 ms 378.59 us 2024-03-26T17:05:23.274 INFO:tasks.workunit.client.3.smithi157.stdout:myimage44 5/s 5/s 143 KiB/s 138 KiB/s 1.89 ms 307.61 us 2024-03-26T17:05:23.274 INFO:tasks.workunit.client.3.smithi157.stdout:myimage8 5/s 5/s 153 KiB/s 166 KiB/s 1.87 ms 307.89 us 2024-03-26T17:05:23.274 INFO:tasks.workunit.client.3.smithi157.stdout:myimage41 5/s 4/s 171 KiB/s 149 KiB/s 1.87 ms 549.73 us 2024-03-26T17:05:23.274 INFO:tasks.workunit.client.3.smithi157.stdout:myimage43 5/s 5/s 156 KiB/s 153 KiB/s 1.99 ms 369.18 us 2024-03-26T17:05:23.275 INFO:tasks.workunit.client.3.smithi157.stdout:myimage16 5/s 5/s 138 KiB/s 172 KiB/s 1.91 ms 426.94 us 2024-03-26T17:05:23.275 INFO:tasks.workunit.client.3.smithi157.stdout:myimage32 5/s 5/s 169 KiB/s 191 KiB/s 1.91 ms 361.44 us 2024-03-26T17:05:23.275 INFO:tasks.workunit.client.3.smithi157.stdout:myimage38 5/s 4/s 167 KiB/s 155 KiB/s 1.78 ms 339.93 us 2024-03-26T17:05:23.275 INFO:tasks.workunit.client.3.smithi157.stdout:myimage47 5/s 6/s 158 KiB/s 183 KiB/s 1.95 ms 408.62 us 2024-03-26T17:05:23.275 INFO:tasks.workunit.client.3.smithi157.stdout:myimage4 5/s 5/s 170 KiB/s 178 KiB/s 1.91 ms 400.71 us 2024-03-26T17:05:23.275 INFO:tasks.workunit.client.3.smithi157.stdout:myimage6 5/s 4/s 164 KiB/s 146 KiB/s 1.85 ms 472.07 us 2024-03-26T17:05:23.275 INFO:tasks.workunit.client.3.smithi157.stdout:myimage7 5/s 5/s 138 KiB/s 150 KiB/s 1.92 ms 447.32 us 2024-03-26T17:05:23.275 INFO:tasks.workunit.client.3.smithi157.stdout:myimage21 5/s 4/s 168 KiB/s 98 KiB/s 2.16 ms 435.09 us 2024-03-26T17:05:23.275 INFO:tasks.workunit.client.3.smithi157.stdout:myimage27 5/s 4/s 156 KiB/s 121 KiB/s 1.69 ms 304.27 us 2024-03-26T17:05:23.275 INFO:tasks.workunit.client.3.smithi157.stdout:myimage46 5/s 4/s 162 KiB/s 150 KiB/s 1.81 ms 331.77 us 2024-03-26T17:05:23.275 INFO:tasks.workunit.client.3.smithi157.stdout:myimage25 4/s 5/s 174 KiB/s 165 KiB/s 2.09 ms 476.76 us 2024-03-26T17:05:23.275 INFO:tasks.workunit.client.3.smithi157.stdout:myimage28 4/s 5/s 135 KiB/s 188 KiB/s 2.26 ms 395.82 us 2024-03-26T17:05:23.275 INFO:tasks.workunit.client.3.smithi157.stdout:myimage51 4/s 5/s 148 KiB/s 173 KiB/s 2.03 ms 335.64 us 2024-03-26T17:05:23.275 INFO:tasks.workunit.client.3.smithi157.stdout:myimage60 4/s 5/s 144 KiB/s 145 KiB/s 1.99 ms 287.32 us 2024-03-26T17:05:23.275 INFO:tasks.workunit.client.3.smithi157.stdout:myimage13 4/s 5/s 121 KiB/s 142 KiB/s 1.67 ms 359.58 us 2024-03-26T17:05:23.276 INFO:tasks.workunit.client.3.smithi157.stdout:myimage14 4/s 6/s 136 KiB/s 206 KiB/s 1.78 ms 344.30 us 2024-03-26T17:05:23.276 INFO:tasks.workunit.client.3.smithi157.stdout:myimage23 4/s 5/s 136 KiB/s 134 KiB/s 1.50 ms 309.05 us 2024-03-26T17:05:23.276 INFO:tasks.workunit.client.3.smithi157.stdout:myimage34 4/s 7/s 153 KiB/s 173 KiB/s 1.87 ms 300.90 us 2024-03-26T17:05:23.276 INFO:tasks.workunit.client.3.smithi157.stdout:myimage29 4/s 5/s 146 KiB/s 143 KiB/s 1.65 ms 515.17 us 2024-03-26T17:05:23.276 INFO:tasks.workunit.client.3.smithi157.stdout:myimage55 4/s 6/s 134 KiB/s 196 KiB/s 1.91 ms 336.30 us 2024-03-26T17:05:23.276 INFO:tasks.workunit.client.3.smithi157.stdout:myimage10 4/s 5/s 118 KiB/s 172 KiB/s 1.82 ms 309.75 us 2024-03-26T17:05:23.276 INFO:tasks.workunit.client.3.smithi157.stdout:myimage3 4/s 5/s 107 KiB/s 190 KiB/s 1.65 ms 387.13 us 2024-03-26T17:05:23.276 INFO:tasks.workunit.client.3.smithi157.stdout:myimage35 4/s 5/s 147 KiB/s 182 KiB/s 1.67 ms 290.37 us 2024-03-26T17:05:23.276 INFO:tasks.workunit.client.3.smithi157.stdout:myimage48 4/s 6/s 105 KiB/s 171 KiB/s 1.95 ms 302.53 us 2024-03-26T17:05:23.276 INFO:tasks.workunit.client.3.smithi157.stdout:myimage5 4/s 5/s 146 KiB/s 139 KiB/s 1.79 ms 302.55 us 2024-03-26T17:05:23.276 INFO:tasks.workunit.client.3.smithi157.stdout:myimage18 4/s 5/s 136 KiB/s 162 KiB/s 1.72 ms 328.25 us 2024-03-26T17:05:23.276 INFO:tasks.workunit.client.3.smithi157.stdout:myimage50 4/s 5/s 120 KiB/s 146 KiB/s 1.90 ms 356.02 us 2024-03-26T17:05:23.276 INFO:tasks.workunit.client.3.smithi157.stdout:myimage56 4/s 5/s 132 KiB/s 134 KiB/s 2.04 ms 451.28 us 2024-03-26T17:05:23.276 INFO:tasks.workunit.client.3.smithi157.stdout:myimage2 4/s 5/s 117 KiB/s 140 KiB/s 1.95 ms 300.56 us 2024-03-26T17:05:23.276 INFO:tasks.workunit.client.3.smithi157.stdout:myimage31 4/s 5/s 118 KiB/s 162 KiB/s 1.90 ms 412.28 us 2024-03-26T17:05:23.276 INFO:tasks.workunit.client.3.smithi157.stdout:myimage9 4/s 6/s 138 KiB/s 164 KiB/s 1.94 ms 295.84 us 2024-03-26T17:05:23.277 INFO:tasks.workunit.client.3.smithi157.stdout:myimage11 4/s 5/s 150 KiB/s 190 KiB/s 1.77 ms 352.03 us 2024-03-26T17:05:23.277 INFO:tasks.workunit.client.3.smithi157.stdout:myimage22 4/s 4/s 134 KiB/s 147 KiB/s 1.88 ms 289.79 us 2024-03-26T17:05:23.277 INFO:tasks.workunit.client.3.smithi157.stdout:myimage30 4/s 5/s 119 KiB/s 186 KiB/s 2.03 ms 349.50 us 2024-03-26T17:05:23.277 INFO:tasks.workunit.client.3.smithi157.stdout:myimage17 4/s 6/s 122 KiB/s 213 KiB/s 1.98 ms 367.05 us 2024-03-26T17:05:23.277 INFO:tasks.workunit.client.3.smithi157.stdout:myimage54 3/s 6/s 102 KiB/s 225 KiB/s 1.76 ms 405.71 us 2024-03-26T17:05:23.277 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:05:23.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:05:23 smithi149 ceph-mon[34678]: pgmap v582: 33 pgs: 33 active+clean; 1.0 GiB data, 3.4 GiB used, 712 GiB / 715 GiB avail; 7.8 MiB/s rd, 7.8 MiB/s wr, 571 op/s 2024-03-26T17:05:23.691 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:05:23 smithi044 ceph-mon[30624]: pgmap v582: 33 pgs: 33 active+clean; 1.0 GiB data, 3.4 GiB used, 712 GiB / 715 GiB avail; 7.8 MiB/s rd, 7.8 MiB/s wr, 571 op/s 2024-03-26T17:05:23.805 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:05:23 smithi064 ceph-mon[34420]: pgmap v582: 33 pgs: 33 active+clean; 1.0 GiB data, 3.4 GiB used, 712 GiB / 715 GiB avail; 7.8 MiB/s rd, 7.8 MiB/s wr, 571 op/s 2024-03-26T17:05:24.019 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:05:23 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:05:23] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:05:24.019 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:05:23 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:05:23] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:05:24.019 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:05:23 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:05:24.349 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:05:23 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:05:23] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:05:24.349 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:05:23 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:05:23] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:05:24.349 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:05:23 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:05:24.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:05:24 smithi149 ceph-mon[34678]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:05:24.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:05:24 smithi149 ceph-mon[34678]: { 2024-03-26T17:05:24.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:05:24 smithi149 ceph-mon[34678]: "prefix": "rbd perf image stats", 2024-03-26T17:05:24.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:05:24 smithi149 ceph-mon[34678]: "pool_spec": "mypool", 2024-03-26T17:05:24.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:05:24 smithi149 ceph-mon[34678]: "sort_by": "write_ops", 2024-03-26T17:05:24.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:05:24 smithi149 ceph-mon[34678]: "format": "json" 2024-03-26T17:05:24.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:05:24 smithi149 ceph-mon[34678]: }"]: dispatch 2024-03-26T17:05:24.647 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:05:24 smithi149 ceph-mon[34678]: Health check update: 3 slow ops, oldest one blocked for 418 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:05:24.765 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:05:24 smithi044 ceph-mon[30624]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:05:24.765 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:05:24 smithi044 ceph-mon[30624]: { 2024-03-26T17:05:24.765 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:05:24 smithi044 ceph-mon[30624]: "prefix": "rbd perf image stats", 2024-03-26T17:05:24.765 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:05:24 smithi044 ceph-mon[30624]: "pool_spec": "mypool", 2024-03-26T17:05:24.765 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:05:24 smithi044 ceph-mon[30624]: "sort_by": "write_ops", 2024-03-26T17:05:24.765 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:05:24 smithi044 ceph-mon[30624]: "format": "json" 2024-03-26T17:05:24.765 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:05:24 smithi044 ceph-mon[30624]: }"]: dispatch 2024-03-26T17:05:24.765 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:05:24 smithi044 ceph-mon[30624]: Health check update: 3 slow ops, oldest one blocked for 418 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:05:24.805 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:05:24 smithi064 ceph-mon[34420]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:05:24.805 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:05:24 smithi064 ceph-mon[34420]: { 2024-03-26T17:05:24.805 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:05:24 smithi064 ceph-mon[34420]: "prefix": "rbd perf image stats", 2024-03-26T17:05:24.805 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:05:24 smithi064 ceph-mon[34420]: "pool_spec": "mypool", 2024-03-26T17:05:24.806 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:05:24 smithi064 ceph-mon[34420]: "sort_by": "write_ops", 2024-03-26T17:05:24.806 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:05:24 smithi064 ceph-mon[34420]: "format": "json" 2024-03-26T17:05:24.806 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:05:24 smithi064 ceph-mon[34420]: }"]: dispatch 2024-03-26T17:05:24.806 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:05:24 smithi064 ceph-mon[34420]: Health check update: 3 slow ops, oldest one blocked for 418 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:05:25.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:05:25 smithi149 ceph-mon[34678]: pgmap v583: 33 pgs: 33 active+clean; 1.0 GiB data, 3.4 GiB used, 712 GiB / 715 GiB avail; 9.2 MiB/s rd, 9.2 MiB/s wr, 655 op/s 2024-03-26T17:05:25.704 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:05:25 smithi044 ceph-mon[30624]: pgmap v583: 33 pgs: 33 active+clean; 1.0 GiB data, 3.4 GiB used, 712 GiB / 715 GiB avail; 9.2 MiB/s rd, 9.2 MiB/s wr, 655 op/s 2024-03-26T17:05:25.805 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:05:25 smithi064 ceph-mon[34420]: pgmap v583: 33 pgs: 33 active+clean; 1.0 GiB data, 3.4 GiB used, 712 GiB / 715 GiB avail; 9.2 MiB/s rd, 9.2 MiB/s wr, 655 op/s 2024-03-26T17:05:26.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:05:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:05:25] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:05:26.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:05:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:05:25] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:05:26.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:05:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:05:26.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:05:26 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 2024-03-26T17:05:26.222+0000 7fa707a55700 -1 mon.c@1(peon) e3 get_health_metrics reporting 3 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T17:05:26.396 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:05:25 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:05:25] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:05:26.396 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:05:25 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:05:25] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:05:26.397 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:05:25 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:05:27.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:05:27 smithi149 ceph-mon[34678]: pgmap v584: 33 pgs: 33 active+clean; 1.0 GiB data, 3.4 GiB used, 712 GiB / 715 GiB avail; 8.6 MiB/s rd, 8.6 MiB/s wr, 595 op/s 2024-03-26T17:05:27.718 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:05:27 smithi044 ceph-mon[30624]: pgmap v584: 33 pgs: 33 active+clean; 1.0 GiB data, 3.4 GiB used, 712 GiB / 715 GiB avail; 8.6 MiB/s rd, 8.6 MiB/s wr, 595 op/s 2024-03-26T17:05:27.805 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:05:27 smithi064 ceph-mon[34420]: pgmap v584: 33 pgs: 33 active+clean; 1.0 GiB data, 3.4 GiB used, 712 GiB / 715 GiB avail; 8.6 MiB/s rd, 8.6 MiB/s wr, 595 op/s 2024-03-26T17:05:28.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:05:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:05:27] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:05:28.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:05:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:05:27] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:05:28.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:05:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:05:28.277 INFO:tasks.workunit.client.3.smithi157.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-26T17:05:28.277 INFO:tasks.workunit.client.3.smithi157.stdout:myimage10 6/s 4/s 213 KiB/s 118 KiB/s 1.77 ms 325.74 us 2024-03-26T17:05:28.277 INFO:tasks.workunit.client.3.smithi157.stdout:myimage4 6/s 4/s 192 KiB/s 148 KiB/s 1.68 ms 343.57 us 2024-03-26T17:05:28.277 INFO:tasks.workunit.client.3.smithi157.stdout:myimage11 6/s 4/s 177 KiB/s 122 KiB/s 1.99 ms 524.81 us 2024-03-26T17:05:28.278 INFO:tasks.workunit.client.3.smithi157.stdout:myimage24 6/s 4/s 182 KiB/s 130 KiB/s 2.04 ms 326.43 us 2024-03-26T17:05:28.278 INFO:tasks.workunit.client.3.smithi157.stdout:myimage29 6/s 4/s 170 KiB/s 134 KiB/s 1.65 ms 366.83 us 2024-03-26T17:05:28.278 INFO:tasks.workunit.client.3.smithi157.stdout:myimage2 5/s 4/s 164 KiB/s 149 KiB/s 1.98 ms 372.48 us 2024-03-26T17:05:28.278 INFO:tasks.workunit.client.3.smithi157.stdout:myimage22 5/s 5/s 200 KiB/s 179 KiB/s 1.81 ms 328.41 us 2024-03-26T17:05:28.278 INFO:tasks.workunit.client.3.smithi157.stdout:myimage1 5/s 3/s 149 KiB/s 98 KiB/s 1.64 ms 290.38 us 2024-03-26T17:05:28.278 INFO:tasks.workunit.client.3.smithi157.stdout:myimage7 5/s 5/s 130 KiB/s 160 KiB/s 1.89 ms 433.45 us 2024-03-26T17:05:28.278 INFO:tasks.workunit.client.3.smithi157.stdout:myimage17 5/s 4/s 202 KiB/s 137 KiB/s 2.05 ms 399.02 us 2024-03-26T17:05:28.278 INFO:tasks.workunit.client.3.smithi157.stdout:myimage28 5/s 4/s 169 KiB/s 166 KiB/s 2.24 ms 370.34 us 2024-03-26T17:05:28.278 INFO:tasks.workunit.client.3.smithi157.stdout:myimage39 5/s 3/s 162 KiB/s 137 KiB/s 1.76 ms 328.37 us 2024-03-26T17:05:28.278 INFO:tasks.workunit.client.3.smithi157.stdout:myimage59 5/s 4/s 220 KiB/s 142 KiB/s 1.79 ms 319.94 us 2024-03-26T17:05:28.278 INFO:tasks.workunit.client.3.smithi157.stdout:myimage18 5/s 5/s 190 KiB/s 172 KiB/s 1.80 ms 328.61 us 2024-03-26T17:05:28.278 INFO:tasks.workunit.client.3.smithi157.stdout:myimage51 5/s 4/s 149 KiB/s 110 KiB/s 1.93 ms 281.36 us 2024-03-26T17:05:28.279 INFO:tasks.workunit.client.3.smithi157.stdout:myimage57 5/s 3/s 170 KiB/s 109 KiB/s 1.85 ms 363.10 us 2024-03-26T17:05:28.279 INFO:tasks.workunit.client.3.smithi157.stdout:myimage44 5/s 5/s 138 KiB/s 178 KiB/s 1.88 ms 348.70 us 2024-03-26T17:05:28.279 INFO:tasks.workunit.client.3.smithi157.stdout:myimage5 5/s 4/s 125 KiB/s 95 KiB/s 1.72 ms 381.79 us 2024-03-26T17:05:28.279 INFO:tasks.workunit.client.3.smithi157.stdout:myimage9 5/s 4/s 163 KiB/s 114 KiB/s 2.09 ms 353.70 us 2024-03-26T17:05:28.279 INFO:tasks.workunit.client.3.smithi157.stdout:myimage21 5/s 5/s 148 KiB/s 136 KiB/s 2.19 ms 418.57 us 2024-03-26T17:05:28.279 INFO:tasks.workunit.client.3.smithi157.stdout:myimage50 5/s 5/s 130 KiB/s 142 KiB/s 1.87 ms 340.50 us 2024-03-26T17:05:28.279 INFO:tasks.workunit.client.3.smithi157.stdout:myimage40 5/s 4/s 164 KiB/s 119 KiB/s 1.72 ms 431.44 us 2024-03-26T17:05:28.279 INFO:tasks.workunit.client.3.smithi157.stdout:myimage27 5/s 5/s 181 KiB/s 178 KiB/s 1.73 ms 359.10 us 2024-03-26T17:05:28.279 INFO:tasks.workunit.client.3.smithi157.stdout:myimage54 5/s 5/s 158 KiB/s 143 KiB/s 1.79 ms 395.54 us 2024-03-26T17:05:28.279 INFO:tasks.workunit.client.3.smithi157.stdout:myimage56 5/s 5/s 121 KiB/s 142 KiB/s 2.13 ms 301.90 us 2024-03-26T17:05:28.279 INFO:tasks.workunit.client.3.smithi157.stdout:myimage49 5/s 5/s 153 KiB/s 165 KiB/s 1.92 ms 328.90 us 2024-03-26T17:05:28.279 INFO:tasks.workunit.client.3.smithi157.stdout:myimage52 5/s 5/s 158 KiB/s 131 KiB/s 1.94 ms 394.39 us 2024-03-26T17:05:28.279 INFO:tasks.workunit.client.3.smithi157.stdout:myimage6 5/s 5/s 117 KiB/s 172 KiB/s 1.89 ms 398.52 us 2024-03-26T17:05:28.279 INFO:tasks.workunit.client.3.smithi157.stdout:myimage34 4/s 5/s 146 KiB/s 183 KiB/s 1.65 ms 355.99 us 2024-03-26T17:05:28.280 INFO:tasks.workunit.client.3.smithi157.stdout:myimage38 4/s 6/s 145 KiB/s 176 KiB/s 1.62 ms 321.50 us 2024-03-26T17:05:28.280 INFO:tasks.workunit.client.3.smithi157.stdout:myimage47 4/s 4/s 138 KiB/s 164 KiB/s 1.98 ms 321.06 us 2024-03-26T17:05:28.280 INFO:tasks.workunit.client.3.smithi157.stdout:myimage8 4/s 5/s 137 KiB/s 114 KiB/s 1.81 ms 300.55 us 2024-03-26T17:05:28.280 INFO:tasks.workunit.client.3.smithi157.stdout:myimage26 4/s 5/s 152 KiB/s 186 KiB/s 1.84 ms 408.37 us 2024-03-26T17:05:28.280 INFO:tasks.workunit.client.3.smithi157.stdout:myimage36 4/s 5/s 149 KiB/s 166 KiB/s 1.84 ms 329.78 us 2024-03-26T17:05:28.280 INFO:tasks.workunit.client.3.smithi157.stdout:myimage43 4/s 5/s 126 KiB/s 130 KiB/s 1.98 ms 442.69 us 2024-03-26T17:05:28.280 INFO:tasks.workunit.client.3.smithi157.stdout:myimage53 4/s 4/s 153 KiB/s 123 KiB/s 1.85 ms 311.93 us 2024-03-26T17:05:28.280 INFO:tasks.workunit.client.3.smithi157.stdout:myimage55 4/s 5/s 117 KiB/s 142 KiB/s 1.91 ms 352.44 us 2024-03-26T17:05:28.280 INFO:tasks.workunit.client.3.smithi157.stdout:myimage3 4/s 5/s 121 KiB/s 199 KiB/s 1.82 ms 347.79 us 2024-03-26T17:05:28.280 INFO:tasks.workunit.client.3.smithi157.stdout:myimage23 4/s 6/s 162 KiB/s 190 KiB/s 1.77 ms 387.49 us 2024-03-26T17:05:28.280 INFO:tasks.workunit.client.3.smithi157.stdout:myimage25 4/s 5/s 152 KiB/s 158 KiB/s 2.08 ms 351.81 us 2024-03-26T17:05:28.280 INFO:tasks.workunit.client.3.smithi157.stdout:myimage33 4/s 5/s 110 KiB/s 140 KiB/s 1.88 ms 357.76 us 2024-03-26T17:05:28.280 INFO:tasks.workunit.client.3.smithi157.stdout:myimage45 4/s 5/s 114 KiB/s 128 KiB/s 1.88 ms 293.11 us 2024-03-26T17:05:28.280 INFO:tasks.workunit.client.3.smithi157.stdout:myimage30 4/s 6/s 127 KiB/s 181 KiB/s 2.11 ms 322.61 us 2024-03-26T17:05:28.280 INFO:tasks.workunit.client.3.smithi157.stdout:myimage35 4/s 4/s 139 KiB/s 121 KiB/s 1.85 ms 299.93 us 2024-03-26T17:05:28.281 INFO:tasks.workunit.client.3.smithi157.stdout:myimage58 4/s 5/s 125 KiB/s 142 KiB/s 1.65 ms 330.09 us 2024-03-26T17:05:28.281 INFO:tasks.workunit.client.3.smithi157.stdout:myimage46 4/s 5/s 138 KiB/s 164 KiB/s 1.79 ms 347.40 us 2024-03-26T17:05:28.281 INFO:tasks.workunit.client.3.smithi157.stdout:myimage60 4/s 5/s 155 KiB/s 161 KiB/s 2.03 ms 408.41 us 2024-03-26T17:05:28.281 INFO:tasks.workunit.client.3.smithi157.stdout:myimage13 4/s 6/s 94 KiB/s 187 KiB/s 1.67 ms 412.32 us 2024-03-26T17:05:28.281 INFO:tasks.workunit.client.3.smithi157.stdout:myimage16 4/s 5/s 126 KiB/s 152 KiB/s 1.95 ms 330.93 us 2024-03-26T17:05:28.281 INFO:tasks.workunit.client.3.smithi157.stdout:myimage37 4/s 5/s 128 KiB/s 163 KiB/s 2.00 ms 392.54 us 2024-03-26T17:05:28.281 INFO:tasks.workunit.client.3.smithi157.stdout:myimage12 4/s 5/s 118 KiB/s 152 KiB/s 1.94 ms 309.29 us 2024-03-26T17:05:28.281 INFO:tasks.workunit.client.3.smithi157.stdout:myimage15 4/s 5/s 111 KiB/s 146 KiB/s 1.79 ms 348.93 us 2024-03-26T17:05:28.281 INFO:tasks.workunit.client.3.smithi157.stdout:myimage20 4/s 4/s 164 KiB/s 101 KiB/s 1.65 ms 416.95 us 2024-03-26T17:05:28.281 INFO:tasks.workunit.client.3.smithi157.stdout:myimage41 4/s 6/s 106 KiB/s 177 KiB/s 1.84 ms 347.31 us 2024-03-26T17:05:28.281 INFO:tasks.workunit.client.3.smithi157.stdout:myimage48 4/s 5/s 130 KiB/s 137 KiB/s 1.90 ms 329.87 us 2024-03-26T17:05:28.281 INFO:tasks.workunit.client.3.smithi157.stdout:myimage42 4/s 4/s 126 KiB/s 134 KiB/s 1.71 ms 452.60 us 2024-03-26T17:05:28.281 INFO:tasks.workunit.client.3.smithi157.stdout:myimage31 3/s 6/s 86 KiB/s 167 KiB/s 1.98 ms 367.95 us 2024-03-26T17:05:28.281 INFO:tasks.workunit.client.3.smithi157.stdout:myimage19 3/s 6/s 109 KiB/s 213 KiB/s 1.94 ms 358.42 us 2024-03-26T17:05:28.282 INFO:tasks.workunit.client.3.smithi157.stdout:myimage32 3/s 6/s 96 KiB/s 165 KiB/s 1.88 ms 315.47 us 2024-03-26T17:05:28.282 INFO:tasks.workunit.client.3.smithi157.stdout:myimage14 2/s 6/s 88 KiB/s 198 KiB/s 1.89 ms 366.05 us 2024-03-26T17:05:28.282 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:05:28.396 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:05:27 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:05:27] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:05:28.396 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:05:28 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:05:28] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:05:28.397 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:05:28 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:05:29.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:05:29 smithi149 ceph-mon[34678]: pgmap v585: 33 pgs: 33 active+clean; 1.0 GiB data, 3.4 GiB used, 712 GiB / 715 GiB avail; 8.8 MiB/s rd, 8.6 MiB/s wr, 595 op/s 2024-03-26T17:05:29.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:05:29 smithi149 ceph-mon[34678]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:05:29.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:05:29 smithi149 ceph-mon[34678]: { 2024-03-26T17:05:29.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:05:29 smithi149 ceph-mon[34678]: "prefix": "rbd perf image stats", 2024-03-26T17:05:29.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:05:29 smithi149 ceph-mon[34678]: "pool_spec": "mypool", 2024-03-26T17:05:29.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:05:29 smithi149 ceph-mon[34678]: "sort_by": "write_ops", 2024-03-26T17:05:29.647 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:05:29 smithi149 ceph-mon[34678]: "format": "json" 2024-03-26T17:05:29.647 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:05:29 smithi149 ceph-mon[34678]: }"]: dispatch 2024-03-26T17:05:29.647 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:05:29 smithi149 ceph-mon[34678]: Health check update: 3 slow ops, oldest one blocked for 423 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:05:29.727 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:05:29 smithi044 ceph-mon[30624]: pgmap v585: 33 pgs: 33 active+clean; 1.0 GiB data, 3.4 GiB used, 712 GiB / 715 GiB avail; 8.8 MiB/s rd, 8.6 MiB/s wr, 595 op/s 2024-03-26T17:05:29.727 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:05:29 smithi044 ceph-mon[30624]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:05:29.728 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:05:29 smithi044 ceph-mon[30624]: { 2024-03-26T17:05:29.728 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:05:29 smithi044 ceph-mon[30624]: "prefix": "rbd perf image stats", 2024-03-26T17:05:29.728 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:05:29 smithi044 ceph-mon[30624]: "pool_spec": "mypool", 2024-03-26T17:05:29.728 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:05:29 smithi044 ceph-mon[30624]: "sort_by": "write_ops", 2024-03-26T17:05:29.728 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:05:29 smithi044 ceph-mon[30624]: "format": "json" 2024-03-26T17:05:29.728 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:05:29 smithi044 ceph-mon[30624]: }"]: dispatch 2024-03-26T17:05:29.728 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:05:29 smithi044 ceph-mon[30624]: Health check update: 3 slow ops, oldest one blocked for 423 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:05:29.805 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:05:29 smithi064 ceph-mon[34420]: pgmap v585: 33 pgs: 33 active+clean; 1.0 GiB data, 3.4 GiB used, 712 GiB / 715 GiB avail; 8.8 MiB/s rd, 8.6 MiB/s wr, 595 op/s 2024-03-26T17:05:29.806 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:05:29 smithi064 ceph-mon[34420]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:05:29.806 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:05:29 smithi064 ceph-mon[34420]: { 2024-03-26T17:05:29.806 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:05:29 smithi064 ceph-mon[34420]: "prefix": "rbd perf image stats", 2024-03-26T17:05:29.806 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:05:29 smithi064 ceph-mon[34420]: "pool_spec": "mypool", 2024-03-26T17:05:29.806 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:05:29 smithi064 ceph-mon[34420]: "sort_by": "write_ops", 2024-03-26T17:05:29.806 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:05:29 smithi064 ceph-mon[34420]: "format": "json" 2024-03-26T17:05:29.807 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:05:29 smithi064 ceph-mon[34420]: }"]: dispatch 2024-03-26T17:05:29.807 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:05:29 smithi064 ceph-mon[34420]: Health check update: 3 slow ops, oldest one blocked for 423 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:05:30.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:05:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:05:29] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:05:30.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:05:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:05:29] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:05:30.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:05:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:05:30.396 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:05:30 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:05:30] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:05:30.396 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:05:30 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:05:30] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:05:30.396 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:05:30 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:05:31.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:05:31 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 2024-03-26T17:05:31.224+0000 7fa707a55700 -1 mon.c@1(peon) e3 get_health_metrics reporting 3 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T17:05:31.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:05:31 smithi149 ceph-mon[34678]: pgmap v586: 33 pgs: 33 active+clean; 1.0 GiB data, 3.5 GiB used, 712 GiB / 715 GiB avail; 9.3 MiB/s rd, 9.1 MiB/s wr, 637 op/s 2024-03-26T17:05:31.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:05:31 smithi044 ceph-mon[30624]: pgmap v586: 33 pgs: 33 active+clean; 1.0 GiB data, 3.5 GiB used, 712 GiB / 715 GiB avail; 9.3 MiB/s rd, 9.1 MiB/s wr, 637 op/s 2024-03-26T17:05:31.805 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:05:31 smithi064 ceph-mon[34420]: pgmap v586: 33 pgs: 33 active+clean; 1.0 GiB data, 3.5 GiB used, 712 GiB / 715 GiB avail; 9.3 MiB/s rd, 9.1 MiB/s wr, 637 op/s 2024-03-26T17:05:32.018 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:05:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:05:31] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:05:32.019 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:05:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:05:31] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:05:32.019 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:05:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:05:32.396 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:05:32 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:05:32] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:05:32.396 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:05:32 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:05:32] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:05:32.396 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:05:32 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:05:33.062 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:05:33.070 INFO:tasks.workunit.client.3.smithi157.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2024-03-26T17:05:33.070 INFO:tasks.workunit.client.3.smithi157.stdout: 10.00 133.6k 122.0k 0.0k 1.3M 1.2M 0.0k nvme2n1 2024-03-26T17:05:33.070 INFO:tasks.workunit.client.3.smithi157.stdout: 10.00 118.8k 128.8k 0.0k 1.2M 1.3M 0.0k nvme2n10 2024-03-26T17:05:33.070 INFO:tasks.workunit.client.3.smithi157.stdout: 10.00 125.6k 156.4k 0.0k 1.2M 1.5M 0.0k nvme2n11 2024-03-26T17:05:33.070 INFO:tasks.workunit.client.3.smithi157.stdout: 10.00 115.6k 183.6k 0.0k 1.1M 1.8M 0.0k nvme2n12 2024-03-26T17:05:33.071 INFO:tasks.workunit.client.3.smithi157.stdout: 10.00 172.8k 98.4k 0.0k 1.7M 984.0k 0.0k nvme2n13 2024-03-26T17:05:33.071 INFO:tasks.workunit.client.3.smithi157.stdout: 10.00 152.4k 140.0k 0.0k 1.5M 1.4M 0.0k nvme2n14 2024-03-26T17:05:33.071 INFO:tasks.workunit.client.3.smithi157.stdout: 10.00 143.2k 122.4k 0.0k 1.4M 1.2M 0.0k nvme2n15 2024-03-26T17:05:33.071 INFO:tasks.workunit.client.3.smithi157.stdout: 10.10 135.2k 166.0k 0.0k 1.3M 1.6M 0.0k nvme2n16 2024-03-26T17:05:33.071 INFO:tasks.workunit.client.3.smithi157.stdout: 10.10 152.4k 156.8k 0.0k 1.5M 1.5M 0.0k nvme2n17 2024-03-26T17:05:33.071 INFO:tasks.workunit.client.3.smithi157.stdout: 10.10 138.0k 131.2k 0.0k 1.3M 1.3M 0.0k nvme2n18 2024-03-26T17:05:33.071 INFO:tasks.workunit.client.3.smithi157.stdout: 10.00 186.0k 104.0k 0.0k 1.8M 1.0M 0.0k nvme2n19 2024-03-26T17:05:33.071 INFO:tasks.workunit.client.3.smithi157.stdout: 10.00 122.4k 144.4k 0.0k 1.2M 1.4M 0.0k nvme2n2 2024-03-26T17:05:33.071 INFO:tasks.workunit.client.3.smithi157.stdout: 10.00 124.0k 138.0k 0.0k 1.2M 1.3M 0.0k nvme2n20 2024-03-26T17:05:33.071 INFO:tasks.workunit.client.3.smithi157.stdout: 10.00 136.4k 142.4k 0.0k 1.3M 1.4M 0.0k nvme2n3 2024-03-26T17:05:33.071 INFO:tasks.workunit.client.3.smithi157.stdout: 10.00 155.2k 139.6k 0.0k 1.5M 1.4M 0.0k nvme2n4 2024-03-26T17:05:33.071 INFO:tasks.workunit.client.3.smithi157.stdout: 10.00 134.4k 129.6k 0.0k 1.3M 1.3M 0.0k nvme2n5 2024-03-26T17:05:33.071 INFO:tasks.workunit.client.3.smithi157.stdout: 10.00 133.6k 124.8k 0.0k 1.3M 1.2M 0.0k nvme2n6 2024-03-26T17:05:33.071 INFO:tasks.workunit.client.3.smithi157.stdout: 10.00 137.2k 112.8k 0.0k 1.3M 1.1M 0.0k nvme2n7 2024-03-26T17:05:33.072 INFO:tasks.workunit.client.3.smithi157.stdout: 10.00 125.2k 136.0k 0.0k 1.2M 1.3M 0.0k nvme2n8 2024-03-26T17:05:33.072 INFO:tasks.workunit.client.3.smithi157.stdout: 10.00 136.4k 159.2k 0.0k 1.3M 1.6M 0.0k nvme2n9 2024-03-26T17:05:33.072 INFO:tasks.workunit.client.3.smithi157.stdout: 10.00 153.6k 129.2k 0.0k 1.5M 1.3M 0.0k nvme5n1 2024-03-26T17:05:33.072 INFO:tasks.workunit.client.3.smithi157.stdout: 10.00 173.2k 131.6k 0.0k 1.7M 1.3M 0.0k nvme5n10 2024-03-26T17:05:33.072 INFO:tasks.workunit.client.3.smithi157.stdout: 10.00 121.2k 129.6k 0.0k 1.2M 1.3M 0.0k nvme5n11 2024-03-26T17:05:33.072 INFO:tasks.workunit.client.3.smithi157.stdout: 10.00 171.2k 129.2k 0.0k 1.7M 1.3M 0.0k nvme5n12 2024-03-26T17:05:33.072 INFO:tasks.workunit.client.3.smithi157.stdout: 10.00 141.2k 146.8k 0.0k 1.4M 1.4M 0.0k nvme5n13 2024-03-26T17:05:33.072 INFO:tasks.workunit.client.3.smithi157.stdout: 10.00 165.2k 136.8k 0.0k 1.6M 1.3M 0.0k nvme5n14 2024-03-26T17:05:33.072 INFO:tasks.workunit.client.3.smithi157.stdout: 10.00 158.8k 129.6k 0.0k 1.6M 1.3M 0.0k nvme5n15 2024-03-26T17:05:33.072 INFO:tasks.workunit.client.3.smithi157.stdout: 10.10 136.8k 161.6k 0.0k 1.3M 1.6M 0.0k nvme5n16 2024-03-26T17:05:33.072 INFO:tasks.workunit.client.3.smithi157.stdout: 10.10 124.0k 130.0k 0.0k 1.2M 1.3M 0.0k nvme5n17 2024-03-26T17:05:33.072 INFO:tasks.workunit.client.3.smithi157.stdout: 10.10 146.4k 136.4k 0.0k 1.4M 1.3M 0.0k nvme5n18 2024-03-26T17:05:33.072 INFO:tasks.workunit.client.3.smithi157.stdout: 10.10 127.2k 182.8k 0.0k 1.2M 1.8M 0.0k nvme5n19 2024-03-26T17:05:33.072 INFO:tasks.workunit.client.3.smithi157.stdout: 10.00 169.6k 106.0k 0.0k 1.7M 1.0M 0.0k nvme5n2 2024-03-26T17:05:33.073 INFO:tasks.workunit.client.3.smithi157.stdout: 10.00 129.2k 170.0k 0.0k 1.3M 1.7M 0.0k nvme5n20 2024-03-26T17:05:33.073 INFO:tasks.workunit.client.3.smithi157.stdout: 10.00 179.6k 116.8k 0.0k 1.8M 1.1M 0.0k nvme5n3 2024-03-26T17:05:33.073 INFO:tasks.workunit.client.3.smithi157.stdout: 10.00 136.0k 143.2k 0.0k 1.3M 1.4M 0.0k nvme5n4 2024-03-26T17:05:33.073 INFO:tasks.workunit.client.3.smithi157.stdout: 10.00 158.0k 122.4k 0.0k 1.5M 1.2M 0.0k nvme5n5 2024-03-26T17:05:33.073 INFO:tasks.workunit.client.3.smithi157.stdout: 10.00 168.4k 141.6k 0.0k 1.6M 1.4M 0.0k nvme5n6 2024-03-26T17:05:33.073 INFO:tasks.workunit.client.3.smithi157.stdout: 10.00 120.4k 159.2k 0.0k 1.2M 1.6M 0.0k nvme5n7 2024-03-26T17:05:33.073 INFO:tasks.workunit.client.3.smithi157.stdout: 10.00 166.8k 135.2k 0.0k 1.6M 1.3M 0.0k nvme5n8 2024-03-26T17:05:33.073 INFO:tasks.workunit.client.3.smithi157.stdout: 10.00 115.6k 148.8k 0.0k 1.1M 1.5M 0.0k nvme5n9 2024-03-26T17:05:33.073 INFO:tasks.workunit.client.3.smithi157.stdout: 10.00 180.0k 82.8k 0.0k 1.8M 828.0k 0.0k nvme8n1 2024-03-26T17:05:33.073 INFO:tasks.workunit.client.3.smithi157.stdout: 10.00 121.2k 118.0k 0.0k 1.2M 1.2M 0.0k nvme8n10 2024-03-26T17:05:33.073 INFO:tasks.workunit.client.3.smithi157.stdout: 10.00 141.2k 154.4k 0.0k 1.4M 1.5M 0.0k nvme8n11 2024-03-26T17:05:33.073 INFO:tasks.workunit.client.3.smithi157.stdout: 10.00 144.0k 160.4k 0.0k 1.4M 1.6M 0.0k nvme8n12 2024-03-26T17:05:33.073 INFO:tasks.workunit.client.3.smithi157.stdout: 10.00 130.4k 177.2k 0.0k 1.3M 1.7M 0.0k nvme8n13 2024-03-26T17:05:33.073 INFO:tasks.workunit.client.3.smithi157.stdout: 10.00 124.0k 129.2k 0.0k 1.2M 1.3M 0.0k nvme8n14 2024-03-26T17:05:33.073 INFO:tasks.workunit.client.3.smithi157.stdout: 10.10 136.4k 126.0k 0.0k 1.3M 1.2M 0.0k nvme8n15 2024-03-26T17:05:33.074 INFO:tasks.workunit.client.3.smithi157.stdout: 10.10 128.0k 117.2k 0.0k 1.2M 1.1M 0.0k nvme8n16 2024-03-26T17:05:33.074 INFO:tasks.workunit.client.3.smithi157.stdout: 10.10 108.4k 189.6k 0.0k 1.1M 1.9M 0.0k nvme8n17 2024-03-26T17:05:33.074 INFO:tasks.workunit.client.3.smithi157.stdout: 10.10 146.8k 120.4k 0.0k 1.4M 1.2M 0.0k nvme8n18 2024-03-26T17:05:33.074 INFO:tasks.workunit.client.3.smithi157.stdout: 10.00 148.4k 111.6k 0.0k 1.4M 1.1M 0.0k nvme8n19 2024-03-26T17:05:33.074 INFO:tasks.workunit.client.3.smithi157.stdout: 10.00 108.0k 177.2k 0.0k 1.1M 1.7M 0.0k nvme8n2 2024-03-26T17:05:33.074 INFO:tasks.workunit.client.3.smithi157.stdout: 10.00 161.6k 140.8k 0.0k 1.6M 1.4M 0.0k nvme8n20 2024-03-26T17:05:33.074 INFO:tasks.workunit.client.3.smithi157.stdout: 10.00 162.0k 128.0k 0.0k 1.6M 1.2M 0.0k nvme8n3 2024-03-26T17:05:33.074 INFO:tasks.workunit.client.3.smithi157.stdout: 10.00 180.4k 94.4k 0.0k 1.8M 944.0k 0.0k nvme8n4 2024-03-26T17:05:33.074 INFO:tasks.workunit.client.3.smithi157.stdout: 10.00 122.8k 149.2k 0.0k 1.2M 1.5M 0.0k nvme8n5 2024-03-26T17:05:33.074 INFO:tasks.workunit.client.3.smithi157.stdout: 10.00 159.6k 124.8k 0.0k 1.6M 1.2M 0.0k nvme8n6 2024-03-26T17:05:33.074 INFO:tasks.workunit.client.3.smithi157.stdout: 10.00 176.4k 130.8k 0.0k 1.7M 1.3M 0.0k nvme8n7 2024-03-26T17:05:33.074 INFO:tasks.workunit.client.3.smithi157.stdout: 10.00 162.8k 122.4k 0.0k 1.6M 1.2M 0.0k nvme8n8 2024-03-26T17:05:33.074 INFO:tasks.workunit.client.3.smithi157.stdout: 10.00 166.0k 156.8k 0.0k 1.6M 1.5M 0.0k nvme8n9 2024-03-26T17:05:33.074 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:05:33.281 INFO:tasks.workunit.client.3.smithi157.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-26T17:05:33.281 INFO:tasks.workunit.client.3.smithi157.stdout:myimage3 6/s 4/s 182 KiB/s 102 KiB/s 1.65 ms 441.21 us 2024-03-26T17:05:33.281 INFO:tasks.workunit.client.3.smithi157.stdout:myimage9 6/s 4/s 175 KiB/s 133 KiB/s 1.96 ms 410.70 us 2024-03-26T17:05:33.282 INFO:tasks.workunit.client.3.smithi157.stdout:myimage12 6/s 4/s 195 KiB/s 122 KiB/s 1.78 ms 334.05 us 2024-03-26T17:05:33.282 INFO:tasks.workunit.client.3.smithi157.stdout:myimage42 6/s 5/s 199 KiB/s 131 KiB/s 1.82 ms 438.72 us 2024-03-26T17:05:33.282 INFO:tasks.workunit.client.3.smithi157.stdout:myimage20 6/s 5/s 158 KiB/s 142 KiB/s 1.94 ms 321.90 us 2024-03-26T17:05:33.282 INFO:tasks.workunit.client.3.smithi157.stdout:myimage29 6/s 4/s 121 KiB/s 115 KiB/s 1.73 ms 431.45 us 2024-03-26T17:05:33.282 INFO:tasks.workunit.client.3.smithi157.stdout:myimage50 6/s 4/s 145 KiB/s 106 KiB/s 2.03 ms 423.89 us 2024-03-26T17:05:33.282 INFO:tasks.workunit.client.3.smithi157.stdout:myimage57 6/s 3/s 198 KiB/s 100 KiB/s 1.90 ms 354.27 us 2024-03-26T17:05:33.282 INFO:tasks.workunit.client.3.smithi157.stdout:myimage5 5/s 5/s 159 KiB/s 147 KiB/s 1.80 ms 325.35 us 2024-03-26T17:05:33.282 INFO:tasks.workunit.client.3.smithi157.stdout:myimage8 5/s 4/s 150 KiB/s 130 KiB/s 1.90 ms 360.88 us 2024-03-26T17:05:33.282 INFO:tasks.workunit.client.3.smithi157.stdout:myimage33 5/s 4/s 162 KiB/s 138 KiB/s 1.81 ms 481.57 us 2024-03-26T17:05:33.282 INFO:tasks.workunit.client.3.smithi157.stdout:myimage16 5/s 5/s 197 KiB/s 138 KiB/s 1.74 ms 291.70 us 2024-03-26T17:05:33.282 INFO:tasks.workunit.client.3.smithi157.stdout:myimage18 5/s 4/s 134 KiB/s 118 KiB/s 1.80 ms 318.22 us 2024-03-26T17:05:33.282 INFO:tasks.workunit.client.3.smithi157.stdout:myimage21 5/s 4/s 135 KiB/s 143 KiB/s 2.12 ms 451.20 us 2024-03-26T17:05:33.283 INFO:tasks.workunit.client.3.smithi157.stdout:myimage24 5/s 5/s 144 KiB/s 134 KiB/s 1.84 ms 401.57 us 2024-03-26T17:05:33.283 INFO:tasks.workunit.client.3.smithi157.stdout:myimage14 5/s 4/s 145 KiB/s 142 KiB/s 1.98 ms 344.75 us 2024-03-26T17:05:33.283 INFO:tasks.workunit.client.3.smithi157.stdout:myimage30 5/s 4/s 141 KiB/s 154 KiB/s 2.14 ms 334.72 us 2024-03-26T17:05:33.283 INFO:tasks.workunit.client.3.smithi157.stdout:myimage40 5/s 4/s 170 KiB/s 137 KiB/s 1.74 ms 436.55 us 2024-03-26T17:05:33.283 INFO:tasks.workunit.client.3.smithi157.stdout:myimage15 5/s 5/s 144 KiB/s 135 KiB/s 1.73 ms 326.16 us 2024-03-26T17:05:33.283 INFO:tasks.workunit.client.3.smithi157.stdout:myimage39 5/s 3/s 163 KiB/s 127 KiB/s 1.75 ms 317.21 us 2024-03-26T17:05:33.283 INFO:tasks.workunit.client.3.smithi157.stdout:myimage45 5/s 4/s 177 KiB/s 119 KiB/s 1.93 ms 328.63 us 2024-03-26T17:05:33.283 INFO:tasks.workunit.client.3.smithi157.stdout:myimage31 5/s 5/s 154 KiB/s 114 KiB/s 1.97 ms 387.83 us 2024-03-26T17:05:33.283 INFO:tasks.workunit.client.3.smithi157.stdout:myimage11 5/s 4/s 145 KiB/s 107 KiB/s 2.09 ms 422.53 us 2024-03-26T17:05:33.283 INFO:tasks.workunit.client.3.smithi157.stdout:myimage27 5/s 5/s 138 KiB/s 121 KiB/s 1.64 ms 425.85 us 2024-03-26T17:05:33.283 INFO:tasks.workunit.client.3.smithi157.stdout:myimage51 5/s 5/s 149 KiB/s 167 KiB/s 2.06 ms 421.46 us 2024-03-26T17:05:33.283 INFO:tasks.workunit.client.3.smithi157.stdout:myimage60 5/s 5/s 133 KiB/s 176 KiB/s 1.98 ms 409.18 us 2024-03-26T17:05:33.283 INFO:tasks.workunit.client.3.smithi157.stdout:myimage2 5/s 5/s 142 KiB/s 129 KiB/s 2.04 ms 294.77 us 2024-03-26T17:05:33.283 INFO:tasks.workunit.client.3.smithi157.stdout:myimage35 5/s 6/s 134 KiB/s 158 KiB/s 1.90 ms 322.99 us 2024-03-26T17:05:33.284 INFO:tasks.workunit.client.3.smithi157.stdout:myimage37 5/s 6/s 121 KiB/s 131 KiB/s 1.84 ms 311.41 us 2024-03-26T17:05:33.284 INFO:tasks.workunit.client.3.smithi157.stdout:myimage52 5/s 5/s 167 KiB/s 146 KiB/s 2.15 ms 453.82 us 2024-03-26T17:05:33.284 INFO:tasks.workunit.client.3.smithi157.stdout:myimage1 5/s 4/s 118 KiB/s 113 KiB/s 1.60 ms 360.78 us 2024-03-26T17:05:33.284 INFO:tasks.workunit.client.3.smithi157.stdout:myimage6 5/s 5/s 154 KiB/s 133 KiB/s 1.92 ms 377.01 us 2024-03-26T17:05:33.284 INFO:tasks.workunit.client.3.smithi157.stdout:myimage46 5/s 5/s 121 KiB/s 146 KiB/s 1.85 ms 421.71 us 2024-03-26T17:05:33.284 INFO:tasks.workunit.client.3.smithi157.stdout:myimage53 5/s 5/s 185 KiB/s 138 KiB/s 1.90 ms 309.30 us 2024-03-26T17:05:33.284 INFO:tasks.workunit.client.3.smithi157.stdout:myimage32 4/s 6/s 133 KiB/s 174 KiB/s 1.90 ms 386.71 us 2024-03-26T17:05:33.284 INFO:tasks.workunit.client.3.smithi157.stdout:myimage17 4/s 4/s 138 KiB/s 138 KiB/s 1.85 ms 332.72 us 2024-03-26T17:05:33.284 INFO:tasks.workunit.client.3.smithi157.stdout:myimage28 4/s 6/s 139 KiB/s 163 KiB/s 2.14 ms 401.44 us 2024-03-26T17:05:33.284 INFO:tasks.workunit.client.3.smithi157.stdout:myimage10 4/s 4/s 125 KiB/s 106 KiB/s 1.81 ms 286.25 us 2024-03-26T17:05:33.284 INFO:tasks.workunit.client.3.smithi157.stdout:myimage22 4/s 5/s 96 KiB/s 158 KiB/s 2.07 ms 349.73 us 2024-03-26T17:05:33.284 INFO:tasks.workunit.client.3.smithi157.stdout:myimage34 4/s 5/s 130 KiB/s 150 KiB/s 1.80 ms 320.21 us 2024-03-26T17:05:33.284 INFO:tasks.workunit.client.3.smithi157.stdout:myimage55 4/s 5/s 101 KiB/s 161 KiB/s 1.83 ms 390.49 us 2024-03-26T17:05:33.284 INFO:tasks.workunit.client.3.smithi157.stdout:myimage56 4/s 5/s 114 KiB/s 125 KiB/s 2.21 ms 319.74 us 2024-03-26T17:05:33.285 INFO:tasks.workunit.client.3.smithi157.stdout:myimage48 4/s 6/s 119 KiB/s 176 KiB/s 1.91 ms 436.17 us 2024-03-26T17:05:33.285 INFO:tasks.workunit.client.3.smithi157.stdout:myimage36 4/s 4/s 113 KiB/s 139 KiB/s 1.85 ms 335.34 us 2024-03-26T17:05:33.285 INFO:tasks.workunit.client.3.smithi157.stdout:myimage43 4/s 5/s 130 KiB/s 185 KiB/s 2.04 ms 457.93 us 2024-03-26T17:05:33.285 INFO:tasks.workunit.client.3.smithi157.stdout:myimage59 4/s 4/s 90 KiB/s 135 KiB/s 2.02 ms 442.66 us 2024-03-26T17:05:33.285 INFO:tasks.workunit.client.3.smithi157.stdout:myimage49 4/s 4/s 149 KiB/s 143 KiB/s 1.94 ms 364.42 us 2024-03-26T17:05:33.285 INFO:tasks.workunit.client.3.smithi157.stdout:myimage4 4/s 5/s 134 KiB/s 164 KiB/s 1.69 ms 395.50 us 2024-03-26T17:05:33.285 INFO:tasks.workunit.client.3.smithi157.stdout:myimage19 4/s 5/s 122 KiB/s 174 KiB/s 1.92 ms 341.77 us 2024-03-26T17:05:33.285 INFO:tasks.workunit.client.3.smithi157.stdout:myimage26 4/s 5/s 107 KiB/s 186 KiB/s 1.79 ms 393.43 us 2024-03-26T17:05:33.285 INFO:tasks.workunit.client.3.smithi157.stdout:myimage54 4/s 5/s 119 KiB/s 141 KiB/s 1.86 ms 387.00 us 2024-03-26T17:05:33.285 INFO:tasks.workunit.client.3.smithi157.stdout:myimage58 4/s 5/s 110 KiB/s 154 KiB/s 1.83 ms 345.49 us 2024-03-26T17:05:33.285 INFO:tasks.workunit.client.3.smithi157.stdout:myimage38 3/s 4/s 116 KiB/s 116 KiB/s 1.58 ms 354.23 us 2024-03-26T17:05:33.285 INFO:tasks.workunit.client.3.smithi157.stdout:myimage44 3/s 5/s 73 KiB/s 167 KiB/s 1.88 ms 413.42 us 2024-03-26T17:05:33.285 INFO:tasks.workunit.client.3.smithi157.stdout:myimage47 3/s 6/s 119 KiB/s 203 KiB/s 1.90 ms 352.31 us 2024-03-26T17:05:33.285 INFO:tasks.workunit.client.3.smithi157.stdout:myimage25 3/s 6/s 127 KiB/s 166 KiB/s 2.27 ms 345.29 us 2024-03-26T17:05:33.286 INFO:tasks.workunit.client.3.smithi157.stdout:myimage13 3/s 5/s 99 KiB/s 138 KiB/s 1.70 ms 317.62 us 2024-03-26T17:05:33.286 INFO:tasks.workunit.client.3.smithi157.stdout:myimage41 3/s 6/s 94 KiB/s 212 KiB/s 1.91 ms 442.52 us 2024-03-26T17:05:33.286 INFO:tasks.workunit.client.3.smithi157.stdout:myimage23 3/s 5/s 104 KiB/s 152 KiB/s 1.74 ms 314.79 us 2024-03-26T17:05:33.286 INFO:tasks.workunit.client.3.smithi157.stdout:myimage7 3/s 6/s 94 KiB/s 154 KiB/s 1.98 ms 336.44 us 2024-03-26T17:05:33.286 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:05:33.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:05:33 smithi149 ceph-mon[34678]: pgmap v587: 33 pgs: 33 active+clean; 1.0 GiB data, 3.4 GiB used, 712 GiB / 715 GiB avail; 8.1 MiB/s rd, 7.8 MiB/s wr, 557 op/s 2024-03-26T17:05:33.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:05:33 smithi044 ceph-mon[30624]: pgmap v587: 33 pgs: 33 active+clean; 1.0 GiB data, 3.4 GiB used, 712 GiB / 715 GiB avail; 8.1 MiB/s rd, 7.8 MiB/s wr, 557 op/s 2024-03-26T17:05:33.805 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:05:33 smithi064 ceph-mon[34420]: pgmap v587: 33 pgs: 33 active+clean; 1.0 GiB data, 3.4 GiB used, 712 GiB / 715 GiB avail; 8.1 MiB/s rd, 7.8 MiB/s wr, 557 op/s 2024-03-26T17:05:34.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:05:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:05:33] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:05:34.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:05:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:05:33] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:05:34.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:05:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:05:34.358 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:05:34 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:05:34] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:05:34.358 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:05:34 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:05:34] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:05:34.358 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:05:34 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:05:34.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:05:34 smithi149 ceph-mon[34678]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:05:34.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:05:34 smithi149 ceph-mon[34678]: { 2024-03-26T17:05:34.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:05:34 smithi149 ceph-mon[34678]: "prefix": "rbd perf image stats", 2024-03-26T17:05:34.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:05:34 smithi149 ceph-mon[34678]: "pool_spec": "mypool", 2024-03-26T17:05:34.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:05:34 smithi149 ceph-mon[34678]: "sort_by": "write_ops", 2024-03-26T17:05:34.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:05:34 smithi149 ceph-mon[34678]: "format": "json" 2024-03-26T17:05:34.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:05:34 smithi149 ceph-mon[34678]: }"]: dispatch 2024-03-26T17:05:34.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:05:34 smithi149 ceph-mon[34678]: Health check update: 3 slow ops, oldest one blocked for 428 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:05:34.765 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:05:34 smithi044 ceph-mon[30624]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:05:34.765 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:05:34 smithi044 ceph-mon[30624]: { 2024-03-26T17:05:34.765 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:05:34 smithi044 ceph-mon[30624]: "prefix": "rbd perf image stats", 2024-03-26T17:05:34.765 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:05:34 smithi044 ceph-mon[30624]: "pool_spec": "mypool", 2024-03-26T17:05:34.765 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:05:34 smithi044 ceph-mon[30624]: "sort_by": "write_ops", 2024-03-26T17:05:34.765 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:05:34 smithi044 ceph-mon[30624]: "format": "json" 2024-03-26T17:05:34.765 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:05:34 smithi044 ceph-mon[30624]: }"]: dispatch 2024-03-26T17:05:34.765 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:05:34 smithi044 ceph-mon[30624]: Health check update: 3 slow ops, oldest one blocked for 428 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:05:34.805 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:05:34 smithi064 ceph-mon[34420]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:05:34.805 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:05:34 smithi064 ceph-mon[34420]: { 2024-03-26T17:05:34.805 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:05:34 smithi064 ceph-mon[34420]: "prefix": "rbd perf image stats", 2024-03-26T17:05:34.806 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:05:34 smithi064 ceph-mon[34420]: "pool_spec": "mypool", 2024-03-26T17:05:34.806 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:05:34 smithi064 ceph-mon[34420]: "sort_by": "write_ops", 2024-03-26T17:05:34.806 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:05:34 smithi064 ceph-mon[34420]: "format": "json" 2024-03-26T17:05:34.806 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:05:34 smithi064 ceph-mon[34420]: }"]: dispatch 2024-03-26T17:05:34.806 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:05:34 smithi064 ceph-mon[34420]: Health check update: 3 slow ops, oldest one blocked for 428 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:05:35.896 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:05:35 smithi149 ceph-mon[34678]: pgmap v588: 33 pgs: 33 active+clean; 1.0 GiB data, 3.5 GiB used, 712 GiB / 715 GiB avail; 9.3 MiB/s rd, 8.8 MiB/s wr, 651 op/s 2024-03-26T17:05:36.015 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:05:35 smithi044 ceph-mon[30624]: pgmap v588: 33 pgs: 33 active+clean; 1.0 GiB data, 3.5 GiB used, 712 GiB / 715 GiB avail; 9.3 MiB/s rd, 8.8 MiB/s wr, 651 op/s 2024-03-26T17:05:36.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:05:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:05:35] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:05:36.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:05:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:05:35] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:05:36.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:05:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:05:36.055 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:05:35 smithi064 ceph-mon[34420]: pgmap v588: 33 pgs: 33 active+clean; 1.0 GiB data, 3.5 GiB used, 712 GiB / 715 GiB avail; 9.3 MiB/s rd, 8.8 MiB/s wr, 651 op/s 2024-03-26T17:05:36.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:05:36 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 2024-03-26T17:05:36.224+0000 7fa707a55700 -1 mon.c@1(peon) e3 get_health_metrics reporting 3 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T17:05:36.396 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:05:36 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:05:36] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:05:36.396 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:05:36 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:05:36] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:05:36.397 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:05:36 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:05:37.896 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:05:37 smithi149 ceph-mon[34678]: pgmap v589: 33 pgs: 33 active+clean; 1.0 GiB data, 3.5 GiB used, 712 GiB / 715 GiB avail; 8.2 MiB/s rd, 7.8 MiB/s wr, 590 op/s 2024-03-26T17:05:38.015 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:05:37 smithi044 ceph-mon[30624]: pgmap v589: 33 pgs: 33 active+clean; 1.0 GiB data, 3.5 GiB used, 712 GiB / 715 GiB avail; 8.2 MiB/s rd, 7.8 MiB/s wr, 590 op/s 2024-03-26T17:05:38.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:05:37 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:05:37] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:05:38.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:05:37 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:05:37] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:05:38.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:05:37 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:05:38.056 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:05:37 smithi064 ceph-mon[34420]: pgmap v589: 33 pgs: 33 active+clean; 1.0 GiB data, 3.5 GiB used, 712 GiB / 715 GiB avail; 8.2 MiB/s rd, 7.8 MiB/s wr, 590 op/s 2024-03-26T17:05:38.286 INFO:tasks.workunit.client.3.smithi157.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-26T17:05:38.286 INFO:tasks.workunit.client.3.smithi157.stdout:myimage45 6/s 3/s 166 KiB/s 94 KiB/s 1.87 ms 345.71 us 2024-03-26T17:05:38.286 INFO:tasks.workunit.client.3.smithi157.stdout:myimage40 6/s 5/s 138 KiB/s 170 KiB/s 1.76 ms 353.56 us 2024-03-26T17:05:38.286 INFO:tasks.workunit.client.3.smithi157.stdout:myimage49 6/s 3/s 178 KiB/s 110 KiB/s 1.83 ms 444.71 us 2024-03-26T17:05:38.286 INFO:tasks.workunit.client.3.smithi157.stdout:myimage8 6/s 3/s 156 KiB/s 94 KiB/s 1.79 ms 388.97 us 2024-03-26T17:05:38.286 INFO:tasks.workunit.client.3.smithi157.stdout:myimage26 6/s 4/s 173 KiB/s 109 KiB/s 1.84 ms 451.80 us 2024-03-26T17:05:38.286 INFO:tasks.workunit.client.3.smithi157.stdout:myimage33 6/s 4/s 158 KiB/s 122 KiB/s 1.75 ms 514.94 us 2024-03-26T17:05:38.286 INFO:tasks.workunit.client.3.smithi157.stdout:myimage60 6/s 3/s 175 KiB/s 118 KiB/s 1.95 ms 317.03 us 2024-03-26T17:05:38.287 INFO:tasks.workunit.client.3.smithi157.stdout:myimage14 6/s 5/s 136 KiB/s 182 KiB/s 1.96 ms 439.84 us 2024-03-26T17:05:38.287 INFO:tasks.workunit.client.3.smithi157.stdout:myimage38 6/s 4/s 129 KiB/s 105 KiB/s 1.66 ms 468.45 us 2024-03-26T17:05:38.287 INFO:tasks.workunit.client.3.smithi157.stdout:myimage58 6/s 4/s 158 KiB/s 111 KiB/s 1.78 ms 331.67 us 2024-03-26T17:05:38.287 INFO:tasks.workunit.client.3.smithi157.stdout:myimage39 6/s 4/s 162 KiB/s 96 KiB/s 1.75 ms 374.88 us 2024-03-26T17:05:38.287 INFO:tasks.workunit.client.3.smithi157.stdout:myimage13 5/s 5/s 134 KiB/s 133 KiB/s 1.73 ms 312.07 us 2024-03-26T17:05:38.287 INFO:tasks.workunit.client.3.smithi157.stdout:myimage25 5/s 4/s 148 KiB/s 150 KiB/s 2.24 ms 339.94 us 2024-03-26T17:05:38.287 INFO:tasks.workunit.client.3.smithi157.stdout:myimage29 5/s 4/s 162 KiB/s 118 KiB/s 1.68 ms 348.14 us 2024-03-26T17:05:38.287 INFO:tasks.workunit.client.3.smithi157.stdout:myimage12 5/s 5/s 141 KiB/s 142 KiB/s 1.77 ms 306.78 us 2024-03-26T17:05:38.287 INFO:tasks.workunit.client.3.smithi157.stdout:myimage51 5/s 4/s 150 KiB/s 120 KiB/s 1.93 ms 303.43 us 2024-03-26T17:05:38.287 INFO:tasks.workunit.client.3.smithi157.stdout:myimage53 5/s 4/s 178 KiB/s 97 KiB/s 1.91 ms 339.11 us 2024-03-26T17:05:38.288 INFO:tasks.workunit.client.3.smithi157.stdout:myimage23 5/s 7/s 138 KiB/s 191 KiB/s 1.76 ms 319.34 us 2024-03-26T17:05:38.288 INFO:tasks.workunit.client.3.smithi157.stdout:myimage34 5/s 4/s 152 KiB/s 120 KiB/s 1.74 ms 312.15 us 2024-03-26T17:05:38.288 INFO:tasks.workunit.client.3.smithi157.stdout:myimage11 5/s 4/s 140 KiB/s 130 KiB/s 2.09 ms 350.19 us 2024-03-26T17:05:38.288 INFO:tasks.workunit.client.3.smithi157.stdout:myimage27 5/s 5/s 146 KiB/s 138 KiB/s 1.72 ms 322.66 us 2024-03-26T17:05:38.288 INFO:tasks.workunit.client.3.smithi157.stdout:myimage46 5/s 5/s 142 KiB/s 144 KiB/s 1.74 ms 342.08 us 2024-03-26T17:05:38.288 INFO:tasks.workunit.client.3.smithi157.stdout:myimage55 5/s 4/s 142 KiB/s 124 KiB/s 2.00 ms 340.44 us 2024-03-26T17:05:38.288 INFO:tasks.workunit.client.3.smithi157.stdout:myimage3 5/s 5/s 180 KiB/s 116 KiB/s 1.61 ms 333.00 us 2024-03-26T17:05:38.288 INFO:tasks.workunit.client.3.smithi157.stdout:myimage32 5/s 4/s 155 KiB/s 122 KiB/s 1.99 ms 304.35 us 2024-03-26T17:05:38.288 INFO:tasks.workunit.client.3.smithi157.stdout:myimage6 5/s 4/s 126 KiB/s 109 KiB/s 1.78 ms 410.78 us 2024-03-26T17:05:38.289 INFO:tasks.workunit.client.3.smithi157.stdout:myimage7 5/s 5/s 118 KiB/s 120 KiB/s 2.22 ms 347.79 us 2024-03-26T17:05:38.289 INFO:tasks.workunit.client.3.smithi157.stdout:myimage18 5/s 4/s 121 KiB/s 126 KiB/s 1.82 ms 322.06 us 2024-03-26T17:05:38.289 INFO:tasks.workunit.client.3.smithi157.stdout:myimage36 5/s 5/s 162 KiB/s 111 KiB/s 1.82 ms 331.02 us 2024-03-26T17:05:38.289 INFO:tasks.workunit.client.3.smithi157.stdout:myimage42 5/s 4/s 146 KiB/s 82 KiB/s 1.90 ms 392.58 us 2024-03-26T17:05:38.289 INFO:tasks.workunit.client.3.smithi157.stdout:myimage22 5/s 6/s 120 KiB/s 171 KiB/s 1.87 ms 300.89 us 2024-03-26T17:05:38.289 INFO:tasks.workunit.client.3.smithi157.stdout:myimage31 5/s 5/s 134 KiB/s 134 KiB/s 1.99 ms 334.90 us 2024-03-26T17:05:38.289 INFO:tasks.workunit.client.3.smithi157.stdout:myimage47 5/s 4/s 162 KiB/s 94 KiB/s 2.07 ms 401.82 us 2024-03-26T17:05:38.289 INFO:tasks.workunit.client.3.smithi157.stdout:myimage17 5/s 4/s 145 KiB/s 111 KiB/s 1.85 ms 311.89 us 2024-03-26T17:05:38.289 INFO:tasks.workunit.client.3.smithi157.stdout:myimage16 4/s 4/s 117 KiB/s 112 KiB/s 1.91 ms 354.15 us 2024-03-26T17:05:38.290 INFO:tasks.workunit.client.3.smithi157.stdout:myimage52 4/s 4/s 137 KiB/s 146 KiB/s 1.88 ms 343.16 us 2024-03-26T17:05:38.290 INFO:tasks.workunit.client.3.smithi157.stdout:myimage1 4/s 6/s 142 KiB/s 178 KiB/s 1.65 ms 339.30 us 2024-03-26T17:05:38.290 INFO:tasks.workunit.client.3.smithi157.stdout:myimage9 4/s 4/s 134 KiB/s 117 KiB/s 1.96 ms 345.99 us 2024-03-26T17:05:38.290 INFO:tasks.workunit.client.3.smithi157.stdout:myimage57 4/s 4/s 131 KiB/s 95 KiB/s 1.84 ms 461.57 us 2024-03-26T17:05:38.290 INFO:tasks.workunit.client.3.smithi157.stdout:myimage59 4/s 6/s 113 KiB/s 150 KiB/s 1.96 ms 417.54 us 2024-03-26T17:05:38.290 INFO:tasks.workunit.client.3.smithi157.stdout:myimage5 4/s 4/s 105 KiB/s 92 KiB/s 1.84 ms 303.70 us 2024-03-26T17:05:38.290 INFO:tasks.workunit.client.3.smithi157.stdout:myimage15 4/s 6/s 144 KiB/s 178 KiB/s 1.63 ms 342.96 us 2024-03-26T17:05:38.290 INFO:tasks.workunit.client.3.smithi157.stdout:myimage19 4/s 4/s 124 KiB/s 134 KiB/s 1.89 ms 361.68 us 2024-03-26T17:05:38.290 INFO:tasks.workunit.client.3.smithi157.stdout:myimage24 4/s 4/s 148 KiB/s 129 KiB/s 1.88 ms 418.13 us 2024-03-26T17:05:38.290 INFO:tasks.workunit.client.3.smithi157.stdout:myimage28 4/s 5/s 102 KiB/s 146 KiB/s 2.24 ms 371.02 us 2024-03-26T17:05:38.290 INFO:tasks.workunit.client.3.smithi157.stdout:myimage50 4/s 5/s 111 KiB/s 115 KiB/s 1.85 ms 292.70 us 2024-03-26T17:05:38.291 INFO:tasks.workunit.client.3.smithi157.stdout:myimage54 4/s 5/s 124 KiB/s 98 KiB/s 1.79 ms 361.29 us 2024-03-26T17:05:38.291 INFO:tasks.workunit.client.3.smithi157.stdout:myimage2 4/s 5/s 118 KiB/s 108 KiB/s 1.97 ms 327.78 us 2024-03-26T17:05:38.291 INFO:tasks.workunit.client.3.smithi157.stdout:myimage37 4/s 4/s 96 KiB/s 102 KiB/s 2.03 ms 376.70 us 2024-03-26T17:05:38.291 INFO:tasks.workunit.client.3.smithi157.stdout:myimage48 4/s 4/s 109 KiB/s 148 KiB/s 1.95 ms 351.88 us 2024-03-26T17:05:38.291 INFO:tasks.workunit.client.3.smithi157.stdout:myimage4 4/s 4/s 91 KiB/s 129 KiB/s 1.87 ms 330.70 us 2024-03-26T17:05:38.291 INFO:tasks.workunit.client.3.smithi157.stdout:myimage43 4/s 5/s 108 KiB/s 97 KiB/s 2.02 ms 334.43 us 2024-03-26T17:05:38.291 INFO:tasks.workunit.client.3.smithi157.stdout:myimage44 4/s 5/s 106 KiB/s 174 KiB/s 1.91 ms 343.00 us 2024-03-26T17:05:38.291 INFO:tasks.workunit.client.3.smithi157.stdout:myimage35 4/s 5/s 125 KiB/s 182 KiB/s 1.78 ms 292.62 us 2024-03-26T17:05:38.291 INFO:tasks.workunit.client.3.smithi157.stdout:myimage30 3/s 5/s 112 KiB/s 145 KiB/s 2.20 ms 449.24 us 2024-03-26T17:05:38.291 INFO:tasks.workunit.client.3.smithi157.stdout:myimage21 3/s 5/s 108 KiB/s 155 KiB/s 2.26 ms 360.74 us 2024-03-26T17:05:38.291 INFO:tasks.workunit.client.3.smithi157.stdout:myimage56 3/s 5/s 88 KiB/s 118 KiB/s 2.15 ms 370.42 us 2024-03-26T17:05:38.292 INFO:tasks.workunit.client.3.smithi157.stdout:myimage20 3/s 6/s 73 KiB/s 144 KiB/s 1.86 ms 341.70 us 2024-03-26T17:05:38.292 INFO:tasks.workunit.client.3.smithi157.stdout:myimage10 3/s 5/s 76 KiB/s 114 KiB/s 1.80 ms 310.38 us 2024-03-26T17:05:38.292 INFO:tasks.workunit.client.3.smithi157.stdout:myimage41 3/s 5/s 59 KiB/s 151 KiB/s 1.97 ms 364.27 us 2024-03-26T17:05:38.292 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:05:38.396 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:05:38 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:05:38] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:05:38.396 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:05:38 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:05:38] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:05:38.397 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:05:38 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:05:38.896 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:05:38 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-26T17:05:38.896 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:05:38 smithi149 ceph-mon[34678]: Health check update: 3 slow ops, oldest one blocked for 433 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:05:39.015 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:05:38 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-26T17:05:39.015 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:05:38 smithi044 ceph-mon[30624]: Health check update: 3 slow ops, oldest one blocked for 433 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:05:39.055 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:05:38 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-26T17:05:39.055 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:05:38 smithi064 ceph-mon[34420]: Health check update: 3 slow ops, oldest one blocked for 433 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:05:39.805 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:05:39 smithi064 ceph-mon[34420]: pgmap v590: 33 pgs: 33 active+clean; 1.0 GiB data, 3.5 GiB used, 712 GiB / 715 GiB avail; 8.0 MiB/s rd, 7.8 MiB/s wr, 593 op/s 2024-03-26T17:05:39.805 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:05:39 smithi064 ceph-mon[34420]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:05:39.805 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:05:39 smithi064 ceph-mon[34420]: { 2024-03-26T17:05:39.805 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:05:39 smithi064 ceph-mon[34420]: "prefix": "rbd perf image stats", 2024-03-26T17:05:39.806 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:05:39 smithi064 ceph-mon[34420]: "pool_spec": "mypool", 2024-03-26T17:05:39.806 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:05:39 smithi064 ceph-mon[34420]: "sort_by": "write_ops", 2024-03-26T17:05:39.806 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:05:39 smithi064 ceph-mon[34420]: "format": "json" 2024-03-26T17:05:39.806 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:05:39 smithi064 ceph-mon[34420]: }"]: dispatch 2024-03-26T17:05:39.896 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:05:39 smithi149 ceph-mon[34678]: pgmap v590: 33 pgs: 33 active+clean; 1.0 GiB data, 3.5 GiB used, 712 GiB / 715 GiB avail; 8.0 MiB/s rd, 7.8 MiB/s wr, 593 op/s 2024-03-26T17:05:39.896 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:05:39 smithi149 ceph-mon[34678]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:05:39.896 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:05:39 smithi149 ceph-mon[34678]: { 2024-03-26T17:05:39.896 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:05:39 smithi149 ceph-mon[34678]: "prefix": "rbd perf image stats", 2024-03-26T17:05:39.896 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:05:39 smithi149 ceph-mon[34678]: "pool_spec": "mypool", 2024-03-26T17:05:39.896 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:05:39 smithi149 ceph-mon[34678]: "sort_by": "write_ops", 2024-03-26T17:05:39.897 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:05:39 smithi149 ceph-mon[34678]: "format": "json" 2024-03-26T17:05:39.897 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:05:39 smithi149 ceph-mon[34678]: }"]: dispatch 2024-03-26T17:05:40.015 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:05:39 smithi044 ceph-mon[30624]: pgmap v590: 33 pgs: 33 active+clean; 1.0 GiB data, 3.5 GiB used, 712 GiB / 715 GiB avail; 8.0 MiB/s rd, 7.8 MiB/s wr, 593 op/s 2024-03-26T17:05:40.015 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:05:39 smithi044 ceph-mon[30624]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:05:40.015 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:05:39 smithi044 ceph-mon[30624]: { 2024-03-26T17:05:40.015 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:05:39 smithi044 ceph-mon[30624]: "prefix": "rbd perf image stats", 2024-03-26T17:05:40.016 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:05:39 smithi044 ceph-mon[30624]: "pool_spec": "mypool", 2024-03-26T17:05:40.016 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:05:39 smithi044 ceph-mon[30624]: "sort_by": "write_ops", 2024-03-26T17:05:40.016 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:05:39 smithi044 ceph-mon[30624]: "format": "json" 2024-03-26T17:05:40.016 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:05:39 smithi044 ceph-mon[30624]: }"]: dispatch 2024-03-26T17:05:40.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:05:39 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:05:39] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:05:40.017 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:05:39 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:05:39] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:05:40.017 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:05:39 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:05:40.397 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:05:40 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:05:40] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:05:40.397 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:05:40 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:05:40] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:05:40.397 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:05:40 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:05:41.226 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:05:40 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T17:05:41.226 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:05:40 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T17:05:41.226 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:05:40 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T17:05:41.226 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:05:40 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T17:05:41.226 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:05:40 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T17:05:41.226 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:05:40 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T17:05:41.226 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:05:40 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T17:05:41.226 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:05:40 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-26T17:05:41.227 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:05:40 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T17:05:41.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:05:40 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T17:05:41.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:05:40 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T17:05:41.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:05:40 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T17:05:41.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:05:40 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T17:05:41.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:05:40 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T17:05:41.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:05:40 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T17:05:41.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:05:40 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T17:05:41.266 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:05:40 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-26T17:05:41.266 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:05:40 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T17:05:41.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:05:40 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T17:05:41.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:05:40 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T17:05:41.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:05:40 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T17:05:41.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:05:40 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T17:05:41.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:05:40 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T17:05:41.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:05:40 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T17:05:41.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:05:40 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T17:05:41.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:05:40 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-26T17:05:41.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:05:40 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T17:05:41.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:05:41 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 2024-03-26T17:05:41.225+0000 7fa707a55700 -1 mon.c@1(peon) e3 get_health_metrics reporting 3 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T17:05:42.167 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:05:41 smithi044 ceph-mon[30624]: pgmap v591: 33 pgs: 33 active+clean; 1.0 GiB data, 3.5 GiB used, 712 GiB / 715 GiB avail; 8.4 MiB/s rd, 8.2 MiB/s wr, 634 op/s 2024-03-26T17:05:42.167 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:05:41 smithi044 ceph-mon[30624]: pgmap v592: 33 pgs: 33 active+clean; 1.0 GiB data, 3.5 GiB used, 712 GiB / 715 GiB avail; 7.9 MiB/s rd, 7.8 MiB/s wr, 611 op/s 2024-03-26T17:05:42.167 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:05:41 smithi044 ceph-mon[30624]: Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-03-26T17:05:42.167 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:05:41 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:05:41] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:05:42.168 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:05:41 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:05:41] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:05:42.168 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:05:41 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:05:42.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:05:41 smithi064 ceph-mon[34420]: pgmap v591: 33 pgs: 33 active+clean; 1.0 GiB data, 3.5 GiB used, 712 GiB / 715 GiB avail; 8.4 MiB/s rd, 8.2 MiB/s wr, 634 op/s 2024-03-26T17:05:42.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:05:41 smithi064 ceph-mon[34420]: pgmap v592: 33 pgs: 33 active+clean; 1.0 GiB data, 3.5 GiB used, 712 GiB / 715 GiB avail; 7.9 MiB/s rd, 7.8 MiB/s wr, 611 op/s 2024-03-26T17:05:42.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:05:41 smithi064 ceph-mon[34420]: Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-03-26T17:05:42.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:05:41 smithi149 ceph-mon[34678]: pgmap v591: 33 pgs: 33 active+clean; 1.0 GiB data, 3.5 GiB used, 712 GiB / 715 GiB avail; 8.4 MiB/s rd, 8.2 MiB/s wr, 634 op/s 2024-03-26T17:05:42.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:05:41 smithi149 ceph-mon[34678]: pgmap v592: 33 pgs: 33 active+clean; 1.0 GiB data, 3.5 GiB used, 712 GiB / 715 GiB avail; 7.9 MiB/s rd, 7.8 MiB/s wr, 611 op/s 2024-03-26T17:05:42.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:05:41 smithi149 ceph-mon[34678]: Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-03-26T17:05:42.397 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:05:42 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:05:42] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:05:42.397 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:05:42 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:05:42] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:05:42.397 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:05:42 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:05:43.062 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:05:43.071 INFO:tasks.workunit.client.3.smithi157.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2024-03-26T17:05:43.071 INFO:tasks.workunit.client.3.smithi157.stdout: 9.90 130.4k 118.0k 0.0k 1.3M 1.2M 0.0k nvme2n1 2024-03-26T17:05:43.071 INFO:tasks.workunit.client.3.smithi157.stdout: 9.80 75.2k 146.8k 0.0k 752.0k 1.4M 0.0k nvme2n10 2024-03-26T17:05:43.071 INFO:tasks.workunit.client.3.smithi157.stdout: 9.80 122.4k 148.4k 0.0k 1.2M 1.4M 0.0k nvme2n11 2024-03-26T17:05:43.071 INFO:tasks.workunit.client.3.smithi157.stdout: 9.80 133.2k 112.4k 0.0k 1.3M 1.1M 0.0k nvme2n12 2024-03-26T17:05:43.072 INFO:tasks.workunit.client.3.smithi157.stdout: 9.80 117.6k 121.6k 0.0k 1.1M 1.2M 0.0k nvme2n13 2024-03-26T17:05:43.072 INFO:tasks.workunit.client.3.smithi157.stdout: 9.80 140.8k 126.8k 0.0k 1.4M 1.2M 0.0k nvme2n14 2024-03-26T17:05:43.072 INFO:tasks.workunit.client.3.smithi157.stdout: 9.80 147.2k 110.4k 0.0k 1.4M 1.1M 0.0k nvme2n15 2024-03-26T17:05:43.072 INFO:tasks.workunit.client.3.smithi157.stdout: 9.80 136.0k 128.4k 0.0k 1.3M 1.3M 0.0k nvme2n16 2024-03-26T17:05:43.072 INFO:tasks.workunit.client.3.smithi157.stdout: 9.80 112.0k 158.4k 0.0k 1.1M 1.5M 0.0k nvme2n17 2024-03-26T17:05:43.072 INFO:tasks.workunit.client.3.smithi157.stdout: 9.80 134.0k 114.8k 0.0k 1.3M 1.1M 0.0k nvme2n18 2024-03-26T17:05:43.072 INFO:tasks.workunit.client.3.smithi157.stdout: 9.90 183.6k 114.0k 0.0k 1.8M 1.1M 0.0k nvme2n19 2024-03-26T17:05:43.072 INFO:tasks.workunit.client.3.smithi157.stdout: 9.90 123.2k 146.4k 0.0k 1.2M 1.4M 0.0k nvme2n2 2024-03-26T17:05:43.072 INFO:tasks.workunit.client.3.smithi157.stdout: 9.90 130.0k 108.8k 0.0k 1.3M 1.1M 0.0k nvme2n20 2024-03-26T17:05:43.072 INFO:tasks.workunit.client.3.smithi157.stdout: 9.90 126.0k 149.6k 0.0k 1.2M 1.5M 0.0k nvme2n3 2024-03-26T17:05:43.072 INFO:tasks.workunit.client.3.smithi157.stdout: 9.90 134.4k 109.2k 0.0k 1.3M 1.1M 0.0k nvme2n4 2024-03-26T17:05:43.072 INFO:tasks.workunit.client.3.smithi157.stdout: 9.90 103.6k 141.2k 0.0k 1.0M 1.4M 0.0k nvme2n5 2024-03-26T17:05:43.072 INFO:tasks.workunit.client.3.smithi157.stdout: 9.90 112.8k 97.6k 0.0k 1.1M 976.0k 0.0k nvme2n6 2024-03-26T17:05:43.072 INFO:tasks.workunit.client.3.smithi157.stdout: 9.90 139.2k 120.4k 0.0k 1.4M 1.2M 0.0k nvme2n7 2024-03-26T17:05:43.073 INFO:tasks.workunit.client.3.smithi157.stdout: 9.90 126.4k 120.4k 0.0k 1.2M 1.2M 0.0k nvme2n8 2024-03-26T17:05:43.073 INFO:tasks.workunit.client.3.smithi157.stdout: 9.90 113.6k 131.2k 0.0k 1.1M 1.3M 0.0k nvme2n9 2024-03-26T17:05:43.073 INFO:tasks.workunit.client.3.smithi157.stdout: 9.90 120.8k 115.2k 0.0k 1.2M 1.1M 0.0k nvme5n1 2024-03-26T17:05:43.073 INFO:tasks.workunit.client.3.smithi157.stdout: 9.90 125.6k 138.0k 0.0k 1.2M 1.3M 0.0k nvme5n10 2024-03-26T17:05:43.073 INFO:tasks.workunit.client.3.smithi157.stdout: 9.80 140.4k 119.2k 0.0k 1.4M 1.2M 0.0k nvme5n11 2024-03-26T17:05:43.073 INFO:tasks.workunit.client.3.smithi157.stdout: 9.80 116.8k 127.2k 0.0k 1.1M 1.2M 0.0k nvme5n12 2024-03-26T17:05:43.073 INFO:tasks.workunit.client.3.smithi157.stdout: 9.80 106.4k 127.6k 0.0k 1.0M 1.2M 0.0k nvme5n13 2024-03-26T17:05:43.073 INFO:tasks.workunit.client.3.smithi157.stdout: 9.80 140.8k 136.0k 0.0k 1.4M 1.3M 0.0k nvme5n14 2024-03-26T17:05:43.073 INFO:tasks.workunit.client.3.smithi157.stdout: 9.80 113.6k 155.6k 0.0k 1.1M 1.5M 0.0k nvme5n15 2024-03-26T17:05:43.073 INFO:tasks.workunit.client.3.smithi157.stdout: 9.80 117.6k 132.4k 0.0k 1.1M 1.3M 0.0k nvme5n16 2024-03-26T17:05:43.073 INFO:tasks.workunit.client.3.smithi157.stdout: 9.80 106.8k 123.6k 0.0k 1.0M 1.2M 0.0k nvme5n17 2024-03-26T17:05:43.073 INFO:tasks.workunit.client.3.smithi157.stdout: 9.80 81.2k 142.4k 0.0k 812.0k 1.4M 0.0k nvme5n18 2024-03-26T17:05:43.073 INFO:tasks.workunit.client.3.smithi157.stdout: 9.80 138.8k 126.0k 0.0k 1.4M 1.2M 0.0k nvme5n19 2024-03-26T17:05:43.074 INFO:tasks.workunit.client.3.smithi157.stdout: 9.90 141.6k 133.2k 0.0k 1.4M 1.3M 0.0k nvme5n2 2024-03-26T17:05:43.074 INFO:tasks.workunit.client.3.smithi157.stdout: 9.90 124.8k 134.4k 0.0k 1.2M 1.3M 0.0k nvme5n20 2024-03-26T17:05:43.074 INFO:tasks.workunit.client.3.smithi157.stdout: 9.90 154.0k 126.8k 0.0k 1.5M 1.2M 0.0k nvme5n3 2024-03-26T17:05:43.074 INFO:tasks.workunit.client.3.smithi157.stdout: 9.90 132.0k 148.4k 0.0k 1.3M 1.4M 0.0k nvme5n4 2024-03-26T17:05:43.074 INFO:tasks.workunit.client.3.smithi157.stdout: 9.90 124.0k 149.2k 0.0k 1.2M 1.5M 0.0k nvme5n5 2024-03-26T17:05:43.074 INFO:tasks.workunit.client.3.smithi157.stdout: 9.90 128.8k 127.6k 0.0k 1.3M 1.2M 0.0k nvme5n6 2024-03-26T17:05:43.074 INFO:tasks.workunit.client.3.smithi157.stdout: 9.90 126.4k 110.4k 0.0k 1.2M 1.1M 0.0k nvme5n7 2024-03-26T17:05:43.074 INFO:tasks.workunit.client.3.smithi157.stdout: 9.90 124.0k 123.2k 0.0k 1.2M 1.2M 0.0k nvme5n8 2024-03-26T17:05:43.074 INFO:tasks.workunit.client.3.smithi157.stdout: 9.90 145.2k 108.0k 0.0k 1.4M 1.1M 0.0k nvme5n9 2024-03-26T17:05:43.074 INFO:tasks.workunit.client.3.smithi157.stdout: 9.90 156.0k 102.8k 0.0k 1.5M 1.0M 0.0k nvme8n1 2024-03-26T17:05:43.074 INFO:tasks.workunit.client.3.smithi157.stdout: 9.80 139.6k 99.6k 0.0k 1.4M 996.0k 0.0k nvme8n10 2024-03-26T17:05:43.074 INFO:tasks.workunit.client.3.smithi157.stdout: 9.80 128.0k 104.0k 0.0k 1.2M 1.0M 0.0k nvme8n11 2024-03-26T17:05:43.074 INFO:tasks.workunit.client.3.smithi157.stdout: 9.80 116.0k 154.4k 0.0k 1.1M 1.5M 0.0k nvme8n12 2024-03-26T17:05:43.075 INFO:tasks.workunit.client.3.smithi157.stdout: 9.80 146.8k 105.6k 0.0k 1.4M 1.0M 0.0k nvme8n13 2024-03-26T17:05:43.075 INFO:tasks.workunit.client.3.smithi157.stdout: 9.80 119.2k 113.2k 0.0k 1.2M 1.1M 0.0k nvme8n14 2024-03-26T17:05:43.075 INFO:tasks.workunit.client.3.smithi157.stdout: 9.80 133.2k 138.4k 0.0k 1.3M 1.4M 0.0k nvme8n15 2024-03-26T17:05:43.075 INFO:tasks.workunit.client.3.smithi157.stdout: 9.80 132.4k 101.2k 0.0k 1.3M 1012.0k 0.0k nvme8n16 2024-03-26T17:05:43.075 INFO:tasks.workunit.client.3.smithi157.stdout: 9.80 123.6k 117.6k 0.0k 1.2M 1.1M 0.0k nvme8n17 2024-03-26T17:05:43.075 INFO:tasks.workunit.client.3.smithi157.stdout: 9.80 131.2k 136.0k 0.0k 1.3M 1.3M 0.0k nvme8n18 2024-03-26T17:05:43.075 INFO:tasks.workunit.client.3.smithi157.stdout: 9.90 114.8k 132.4k 0.0k 1.1M 1.3M 0.0k nvme8n19 2024-03-26T17:05:43.075 INFO:tasks.workunit.client.3.smithi157.stdout: 9.90 108.0k 133.2k 0.0k 1.1M 1.3M 0.0k nvme8n2 2024-03-26T17:05:43.075 INFO:tasks.workunit.client.3.smithi157.stdout: 9.90 107.2k 136.8k 0.0k 1.0M 1.3M 0.0k nvme8n20 2024-03-26T17:05:43.075 INFO:tasks.workunit.client.3.smithi157.stdout: 9.90 119.2k 108.0k 0.0k 1.2M 1.1M 0.0k nvme8n3 2024-03-26T17:05:43.077 INFO:tasks.workunit.client.3.smithi157.stdout: 9.90 128.4k 138.8k 0.0k 1.3M 1.4M 0.0k nvme8n4 2024-03-26T17:05:43.077 INFO:tasks.workunit.client.3.smithi157.stdout: 9.90 93.6k 160.8k 0.0k 936.0k 1.6M 0.0k nvme8n5 2024-03-26T17:05:43.077 INFO:tasks.workunit.client.3.smithi157.stdout: 9.90 148.0k 116.0k 0.0k 1.4M 1.1M 0.0k nvme8n6 2024-03-26T17:05:43.077 INFO:tasks.workunit.client.3.smithi157.stdout: 9.90 128.8k 152.0k 0.0k 1.3M 1.5M 0.0k nvme8n7 2024-03-26T17:05:43.077 INFO:tasks.workunit.client.3.smithi157.stdout: 9.90 116.0k 135.2k 0.0k 1.1M 1.3M 0.0k nvme8n8 2024-03-26T17:05:43.077 INFO:tasks.workunit.client.3.smithi157.stdout: 9.90 131.6k 132.0k 0.0k 1.3M 1.3M 0.0k nvme8n9 2024-03-26T17:05:43.077 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:05:43.289 INFO:tasks.workunit.client.3.smithi157.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-26T17:05:43.290 INFO:tasks.workunit.client.3.smithi157.stdout:myimage10 8/s 3/s 183 KiB/s 70 KiB/s 1.89 ms 353.84 us 2024-03-26T17:05:43.290 INFO:tasks.workunit.client.3.smithi157.stdout:myimage37 6/s 4/s 175 KiB/s 106 KiB/s 2.00 ms 392.68 us 2024-03-26T17:05:43.290 INFO:tasks.workunit.client.3.smithi157.stdout:myimage5 6/s 4/s 172 KiB/s 122 KiB/s 1.92 ms 347.95 us 2024-03-26T17:05:43.290 INFO:tasks.workunit.client.3.smithi157.stdout:myimage52 6/s 3/s 190 KiB/s 107 KiB/s 2.07 ms 350.19 us 2024-03-26T17:05:43.290 INFO:tasks.workunit.client.3.smithi157.stdout:myimage17 6/s 4/s 189 KiB/s 122 KiB/s 1.91 ms 388.07 us 2024-03-26T17:05:43.290 INFO:tasks.workunit.client.3.smithi157.stdout:myimage1 6/s 4/s 134 KiB/s 135 KiB/s 1.72 ms 317.25 us 2024-03-26T17:05:43.290 INFO:tasks.workunit.client.3.smithi157.stdout:myimage16 6/s 4/s 163 KiB/s 135 KiB/s 2.02 ms 340.11 us 2024-03-26T17:05:43.290 INFO:tasks.workunit.client.3.smithi157.stdout:myimage33 6/s 4/s 142 KiB/s 125 KiB/s 1.99 ms 501.02 us 2024-03-26T17:05:43.290 INFO:tasks.workunit.client.3.smithi157.stdout:myimage57 6/s 5/s 145 KiB/s 143 KiB/s 1.98 ms 371.45 us 2024-03-26T17:05:43.290 INFO:tasks.workunit.client.3.smithi157.stdout:myimage60 6/s 3/s 130 KiB/s 90 KiB/s 2.13 ms 379.51 us 2024-03-26T17:05:43.290 INFO:tasks.workunit.client.3.smithi157.stdout:myimage2 5/s 4/s 155 KiB/s 134 KiB/s 2.02 ms 355.41 us 2024-03-26T17:05:43.290 INFO:tasks.workunit.client.3.smithi157.stdout:myimage30 5/s 5/s 151 KiB/s 138 KiB/s 2.31 ms 336.57 us 2024-03-26T17:05:43.290 INFO:tasks.workunit.client.3.smithi157.stdout:myimage44 5/s 4/s 154 KiB/s 122 KiB/s 1.91 ms 376.03 us 2024-03-26T17:05:43.291 INFO:tasks.workunit.client.3.smithi157.stdout:myimage21 5/s 5/s 137 KiB/s 130 KiB/s 2.13 ms 327.06 us 2024-03-26T17:05:43.291 INFO:tasks.workunit.client.3.smithi157.stdout:myimage38 5/s 4/s 154 KiB/s 97 KiB/s 1.77 ms 402.78 us 2024-03-26T17:05:43.291 INFO:tasks.workunit.client.3.smithi157.stdout:myimage47 5/s 5/s 134 KiB/s 140 KiB/s 2.11 ms 404.29 us 2024-03-26T17:05:43.291 INFO:tasks.workunit.client.3.smithi157.stdout:myimage48 5/s 5/s 136 KiB/s 118 KiB/s 2.02 ms 337.37 us 2024-03-26T17:05:43.291 INFO:tasks.workunit.client.3.smithi157.stdout:myimage24 5/s 4/s 139 KiB/s 133 KiB/s 1.84 ms 334.67 us 2024-03-26T17:05:43.291 INFO:tasks.workunit.client.3.smithi157.stdout:myimage39 5/s 5/s 154 KiB/s 160 KiB/s 1.85 ms 341.53 us 2024-03-26T17:05:43.291 INFO:tasks.workunit.client.3.smithi157.stdout:myimage14 5/s 3/s 137 KiB/s 101 KiB/s 2.03 ms 384.01 us 2024-03-26T17:05:43.291 INFO:tasks.workunit.client.3.smithi157.stdout:myimage35 5/s 4/s 129 KiB/s 99 KiB/s 1.90 ms 335.57 us 2024-03-26T17:05:43.291 INFO:tasks.workunit.client.3.smithi157.stdout:myimage40 5/s 3/s 134 KiB/s 102 KiB/s 1.98 ms 366.03 us 2024-03-26T17:05:43.291 INFO:tasks.workunit.client.3.smithi157.stdout:myimage4 5/s 5/s 127 KiB/s 134 KiB/s 1.78 ms 324.99 us 2024-03-26T17:05:43.291 INFO:tasks.workunit.client.3.smithi157.stdout:myimage41 5/s 5/s 137 KiB/s 143 KiB/s 1.94 ms 320.26 us 2024-03-26T17:05:43.291 INFO:tasks.workunit.client.3.smithi157.stdout:myimage45 5/s 4/s 149 KiB/s 86 KiB/s 1.88 ms 322.90 us 2024-03-26T17:05:43.291 INFO:tasks.workunit.client.3.smithi157.stdout:myimage22 5/s 4/s 147 KiB/s 135 KiB/s 1.92 ms 319.55 us 2024-03-26T17:05:43.291 INFO:tasks.workunit.client.3.smithi157.stdout:myimage11 5/s 5/s 162 KiB/s 133 KiB/s 2.21 ms 321.61 us 2024-03-26T17:05:43.291 INFO:tasks.workunit.client.3.smithi157.stdout:myimage20 5/s 4/s 128 KiB/s 138 KiB/s 1.80 ms 344.79 us 2024-03-26T17:05:43.292 INFO:tasks.workunit.client.3.smithi157.stdout:myimage55 5/s 4/s 136 KiB/s 114 KiB/s 1.96 ms 328.82 us 2024-03-26T17:05:43.292 INFO:tasks.workunit.client.3.smithi157.stdout:myimage59 5/s 4/s 122 KiB/s 79 KiB/s 2.04 ms 317.72 us 2024-03-26T17:05:43.292 INFO:tasks.workunit.client.3.smithi157.stdout:myimage32 5/s 4/s 134 KiB/s 130 KiB/s 1.95 ms 409.99 us 2024-03-26T17:05:43.292 INFO:tasks.workunit.client.3.smithi157.stdout:myimage42 5/s 5/s 129 KiB/s 113 KiB/s 1.90 ms 448.00 us 2024-03-26T17:05:43.292 INFO:tasks.workunit.client.3.smithi157.stdout:myimage12 4/s 4/s 134 KiB/s 109 KiB/s 1.95 ms 393.08 us 2024-03-26T17:05:43.292 INFO:tasks.workunit.client.3.smithi157.stdout:myimage18 4/s 5/s 131 KiB/s 160 KiB/s 1.94 ms 444.73 us 2024-03-26T17:05:43.292 INFO:tasks.workunit.client.3.smithi157.stdout:myimage54 4/s 6/s 105 KiB/s 150 KiB/s 1.83 ms 361.90 us 2024-03-26T17:05:43.292 INFO:tasks.workunit.client.3.smithi157.stdout:myimage34 4/s 5/s 126 KiB/s 173 KiB/s 1.82 ms 327.20 us 2024-03-26T17:05:43.292 INFO:tasks.workunit.client.3.smithi157.stdout:myimage9 4/s 5/s 130 KiB/s 122 KiB/s 2.15 ms 335.11 us 2024-03-26T17:05:43.292 INFO:tasks.workunit.client.3.smithi157.stdout:myimage13 4/s 6/s 102 KiB/s 165 KiB/s 1.80 ms 322.71 us 2024-03-26T17:05:43.292 INFO:tasks.workunit.client.3.smithi157.stdout:myimage27 4/s 5/s 130 KiB/s 121 KiB/s 1.82 ms 320.71 us 2024-03-26T17:05:43.292 INFO:tasks.workunit.client.3.smithi157.stdout:myimage29 4/s 5/s 109 KiB/s 123 KiB/s 1.76 ms 352.75 us 2024-03-26T17:05:43.292 INFO:tasks.workunit.client.3.smithi157.stdout:myimage58 4/s 5/s 127 KiB/s 167 KiB/s 1.90 ms 318.52 us 2024-03-26T17:05:43.292 INFO:tasks.workunit.client.3.smithi157.stdout:myimage26 4/s 6/s 118 KiB/s 139 KiB/s 1.95 ms 306.52 us 2024-03-26T17:05:43.292 INFO:tasks.workunit.client.3.smithi157.stdout:myimage51 4/s 5/s 98 KiB/s 123 KiB/s 2.02 ms 294.34 us 2024-03-26T17:05:43.293 INFO:tasks.workunit.client.3.smithi157.stdout:myimage56 4/s 6/s 102 KiB/s 161 KiB/s 2.25 ms 360.85 us 2024-03-26T17:05:43.293 INFO:tasks.workunit.client.3.smithi157.stdout:myimage23 4/s 5/s 110 KiB/s 167 KiB/s 1.67 ms 358.06 us 2024-03-26T17:05:43.293 INFO:tasks.workunit.client.3.smithi157.stdout:myimage49 4/s 5/s 112 KiB/s 150 KiB/s 1.91 ms 387.84 us 2024-03-26T17:05:43.293 INFO:tasks.workunit.client.3.smithi157.stdout:myimage7 4/s 6/s 106 KiB/s 158 KiB/s 2.08 ms 313.06 us 2024-03-26T17:05:43.293 INFO:tasks.workunit.client.3.smithi157.stdout:myimage28 4/s 5/s 114 KiB/s 136 KiB/s 2.27 ms 329.57 us 2024-03-26T17:05:43.293 INFO:tasks.workunit.client.3.smithi157.stdout:myimage19 3/s 5/s 101 KiB/s 174 KiB/s 1.88 ms 445.79 us 2024-03-26T17:05:43.293 INFO:tasks.workunit.client.3.smithi157.stdout:myimage36 3/s 6/s 112 KiB/s 148 KiB/s 1.86 ms 337.59 us 2024-03-26T17:05:43.293 INFO:tasks.workunit.client.3.smithi157.stdout:myimage46 3/s 4/s 90 KiB/s 142 KiB/s 1.96 ms 356.69 us 2024-03-26T17:05:43.293 INFO:tasks.workunit.client.3.smithi157.stdout:myimage53 3/s 6/s 67 KiB/s 180 KiB/s 1.85 ms 317.28 us 2024-03-26T17:05:43.293 INFO:tasks.workunit.client.3.smithi157.stdout:myimage31 3/s 5/s 84 KiB/s 128 KiB/s 2.06 ms 398.68 us 2024-03-26T17:05:43.293 INFO:tasks.workunit.client.3.smithi157.stdout:myimage6 3/s 6/s 72 KiB/s 142 KiB/s 1.91 ms 322.04 us 2024-03-26T17:05:43.293 INFO:tasks.workunit.client.3.smithi157.stdout:myimage15 3/s 5/s 78 KiB/s 126 KiB/s 1.85 ms 334.87 us 2024-03-26T17:05:43.293 INFO:tasks.workunit.client.3.smithi157.stdout:myimage25 3/s 6/s 106 KiB/s 143 KiB/s 2.24 ms 355.17 us 2024-03-26T17:05:43.293 INFO:tasks.workunit.client.3.smithi157.stdout:myimage3 3/s 6/s 97 KiB/s 138 KiB/s 1.69 ms 326.91 us 2024-03-26T17:05:43.293 INFO:tasks.workunit.client.3.smithi157.stdout:myimage8 3/s 6/s 85 KiB/s 157 KiB/s 2.05 ms 303.40 us 2024-03-26T17:05:43.294 INFO:tasks.workunit.client.3.smithi157.stdout:myimage43 3/s 6/s 78 KiB/s 144 KiB/s 1.97 ms 403.40 us 2024-03-26T17:05:43.294 INFO:tasks.workunit.client.3.smithi157.stdout:myimage50 3/s 6/s 54 KiB/s 173 KiB/s 2.07 ms 376.18 us 2024-03-26T17:05:43.294 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:05:44.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:05:43 smithi044 ceph-mon[30624]: pgmap v593: 33 pgs: 33 active+clean; 1.0 GiB data, 3.5 GiB used, 712 GiB / 715 GiB avail; 8.0 MiB/s rd, 7.8 MiB/s wr, 622 op/s 2024-03-26T17:05:44.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:05:43 smithi044 ceph-mon[30624]: Health check update: 3 slow ops, oldest one blocked for 438 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:05:44.265 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:05:43 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:05:43] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:05:44.266 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:05:43 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:05:43] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:05:44.266 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:05:43 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:05:44.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:05:43 smithi064 ceph-mon[34420]: pgmap v593: 33 pgs: 33 active+clean; 1.0 GiB data, 3.5 GiB used, 712 GiB / 715 GiB avail; 8.0 MiB/s rd, 7.8 MiB/s wr, 622 op/s 2024-03-26T17:05:44.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:05:43 smithi064 ceph-mon[34420]: Health check update: 3 slow ops, oldest one blocked for 438 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:05:44.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:05:43 smithi149 ceph-mon[34678]: pgmap v593: 33 pgs: 33 active+clean; 1.0 GiB data, 3.5 GiB used, 712 GiB / 715 GiB avail; 8.0 MiB/s rd, 7.8 MiB/s wr, 622 op/s 2024-03-26T17:05:44.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:05:43 smithi149 ceph-mon[34678]: Health check update: 3 slow ops, oldest one blocked for 438 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:05:44.396 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:05:44 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:05:44] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:05:44.397 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:05:44 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:05:44] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:05:44.397 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:05:44 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:05:45.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:05:44 smithi044 ceph-mon[30624]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:05:45.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:05:44 smithi044 ceph-mon[30624]: { 2024-03-26T17:05:45.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:05:44 smithi044 ceph-mon[30624]: "prefix": "rbd perf image stats", 2024-03-26T17:05:45.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:05:44 smithi044 ceph-mon[30624]: "pool_spec": "mypool", 2024-03-26T17:05:45.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:05:44 smithi044 ceph-mon[30624]: "sort_by": "write_ops", 2024-03-26T17:05:45.266 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:05:44 smithi044 ceph-mon[30624]: "format": "json" 2024-03-26T17:05:45.266 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:05:44 smithi044 ceph-mon[30624]: }"]: dispatch 2024-03-26T17:05:45.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:05:44 smithi064 ceph-mon[34420]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:05:45.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:05:44 smithi064 ceph-mon[34420]: { 2024-03-26T17:05:45.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:05:44 smithi064 ceph-mon[34420]: "prefix": "rbd perf image stats", 2024-03-26T17:05:45.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:05:44 smithi064 ceph-mon[34420]: "pool_spec": "mypool", 2024-03-26T17:05:45.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:05:44 smithi064 ceph-mon[34420]: "sort_by": "write_ops", 2024-03-26T17:05:45.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:05:44 smithi064 ceph-mon[34420]: "format": "json" 2024-03-26T17:05:45.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:05:44 smithi064 ceph-mon[34420]: }"]: dispatch 2024-03-26T17:05:45.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:05:44 smithi149 ceph-mon[34678]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:05:45.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:05:44 smithi149 ceph-mon[34678]: { 2024-03-26T17:05:45.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:05:44 smithi149 ceph-mon[34678]: "prefix": "rbd perf image stats", 2024-03-26T17:05:45.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:05:44 smithi149 ceph-mon[34678]: "pool_spec": "mypool", 2024-03-26T17:05:45.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:05:44 smithi149 ceph-mon[34678]: "sort_by": "write_ops", 2024-03-26T17:05:45.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:05:44 smithi149 ceph-mon[34678]: "format": "json" 2024-03-26T17:05:45.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:05:44 smithi149 ceph-mon[34678]: }"]: dispatch 2024-03-26T17:05:46.167 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:05:45 smithi044 ceph-mon[30624]: pgmap v594: 33 pgs: 33 active+clean; 1.0 GiB data, 3.6 GiB used, 712 GiB / 715 GiB avail; 7.1 MiB/s rd, 7.2 MiB/s wr, 572 op/s 2024-03-26T17:05:46.167 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:05:45 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:05:45] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:05:46.167 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:05:45 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:05:45] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:05:46.167 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:05:45 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:05:46.226 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:05:45 smithi149 ceph-mon[34678]: pgmap v594: 33 pgs: 33 active+clean; 1.0 GiB data, 3.6 GiB used, 712 GiB / 715 GiB avail; 7.1 MiB/s rd, 7.2 MiB/s wr, 572 op/s 2024-03-26T17:05:46.227 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:05:46 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:05:46] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:05:46.227 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:05:46 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:05:46] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:05:46.227 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:05:46 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:05:46.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:05:45 smithi064 ceph-mon[34420]: pgmap v594: 33 pgs: 33 active+clean; 1.0 GiB data, 3.6 GiB used, 712 GiB / 715 GiB avail; 7.1 MiB/s rd, 7.2 MiB/s wr, 572 op/s 2024-03-26T17:05:46.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:05:46 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 2024-03-26T17:05:46.225+0000 7fa707a55700 -1 mon.c@1(peon) e3 get_health_metrics reporting 3 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T17:05:48.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:05:47 smithi044 ceph-mon[30624]: pgmap v595: 33 pgs: 33 active+clean; 1.0 GiB data, 3.6 GiB used, 712 GiB / 715 GiB avail; 6.9 MiB/s rd, 7.1 MiB/s wr, 567 op/s 2024-03-26T17:05:48.265 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:05:47 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:05:47] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:05:48.265 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:05:47 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:05:47] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:05:48.266 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:05:47 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:05:48.293 INFO:tasks.workunit.client.3.smithi157.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-26T17:05:48.294 INFO:tasks.workunit.client.3.smithi157.stdout:myimage8 6/s 3/s 162 KiB/s 87 KiB/s 2.02 ms 310.20 us 2024-03-26T17:05:48.294 INFO:tasks.workunit.client.3.smithi157.stdout:myimage23 6/s 3/s 127 KiB/s 75 KiB/s 1.65 ms 291.05 us 2024-03-26T17:05:48.294 INFO:tasks.workunit.client.3.smithi157.stdout:myimage38 6/s 3/s 159 KiB/s 65 KiB/s 1.58 ms 339.21 us 2024-03-26T17:05:48.294 INFO:tasks.workunit.client.3.smithi157.stdout:myimage24 6/s 3/s 151 KiB/s 100 KiB/s 1.95 ms 320.60 us 2024-03-26T17:05:48.294 INFO:tasks.workunit.client.3.smithi157.stdout:myimage49 6/s 4/s 174 KiB/s 96 KiB/s 1.98 ms 321.23 us 2024-03-26T17:05:48.294 INFO:tasks.workunit.client.3.smithi157.stdout:myimage11 6/s 3/s 120 KiB/s 94 KiB/s 2.12 ms 386.35 us 2024-03-26T17:05:48.294 INFO:tasks.workunit.client.3.smithi157.stdout:myimage20 6/s 4/s 118 KiB/s 89 KiB/s 1.87 ms 331.57 us 2024-03-26T17:05:48.294 INFO:tasks.workunit.client.3.smithi157.stdout:myimage45 6/s 4/s 156 KiB/s 104 KiB/s 1.82 ms 388.84 us 2024-03-26T17:05:48.294 INFO:tasks.workunit.client.3.smithi157.stdout:myimage50 6/s 4/s 158 KiB/s 117 KiB/s 2.04 ms 310.26 us 2024-03-26T17:05:48.294 INFO:tasks.workunit.client.3.smithi157.stdout:myimage43 6/s 4/s 153 KiB/s 106 KiB/s 2.10 ms 375.63 us 2024-03-26T17:05:48.294 INFO:tasks.workunit.client.3.smithi157.stdout:myimage10 6/s 3/s 144 KiB/s 88 KiB/s 1.94 ms 324.88 us 2024-03-26T17:05:48.294 INFO:tasks.workunit.client.3.smithi157.stdout:myimage34 5/s 4/s 150 KiB/s 110 KiB/s 1.66 ms 310.49 us 2024-03-26T17:05:48.295 INFO:tasks.workunit.client.3.smithi157.stdout:myimage58 5/s 4/s 120 KiB/s 99 KiB/s 1.69 ms 306.88 us 2024-03-26T17:05:48.295 INFO:tasks.workunit.client.3.smithi157.stdout:myimage36 5/s 3/s 138 KiB/s 68 KiB/s 1.87 ms 424.14 us 2024-03-26T17:05:48.295 INFO:tasks.workunit.client.3.smithi157.stdout:myimage2 5/s 4/s 130 KiB/s 116 KiB/s 1.97 ms 420.02 us 2024-03-26T17:05:48.295 INFO:tasks.workunit.client.3.smithi157.stdout:myimage32 5/s 4/s 134 KiB/s 102 KiB/s 1.99 ms 373.12 us 2024-03-26T17:05:48.295 INFO:tasks.workunit.client.3.smithi157.stdout:myimage35 5/s 4/s 163 KiB/s 101 KiB/s 2.00 ms 382.03 us 2024-03-26T17:05:48.295 INFO:tasks.workunit.client.3.smithi157.stdout:myimage25 5/s 4/s 158 KiB/s 73 KiB/s 2.29 ms 379.82 us 2024-03-26T17:05:48.295 INFO:tasks.workunit.client.3.smithi157.stdout:myimage3 5/s 5/s 130 KiB/s 88 KiB/s 1.69 ms 374.74 us 2024-03-26T17:05:48.295 INFO:tasks.workunit.client.3.smithi157.stdout:myimage16 5/s 4/s 116 KiB/s 131 KiB/s 1.90 ms 334.07 us 2024-03-26T17:05:48.295 INFO:tasks.workunit.client.3.smithi157.stdout:myimage31 5/s 4/s 137 KiB/s 105 KiB/s 2.27 ms 327.37 us 2024-03-26T17:05:48.295 INFO:tasks.workunit.client.3.smithi157.stdout:myimage40 5/s 4/s 152 KiB/s 82 KiB/s 1.83 ms 382.50 us 2024-03-26T17:05:48.295 INFO:tasks.workunit.client.3.smithi157.stdout:myimage13 5/s 3/s 122 KiB/s 86 KiB/s 1.89 ms 330.54 us 2024-03-26T17:05:48.295 INFO:tasks.workunit.client.3.smithi157.stdout:myimage14 5/s 4/s 130 KiB/s 135 KiB/s 2.08 ms 365.51 us 2024-03-26T17:05:48.295 INFO:tasks.workunit.client.3.smithi157.stdout:myimage48 5/s 4/s 137 KiB/s 112 KiB/s 2.03 ms 399.34 us 2024-03-26T17:05:48.295 INFO:tasks.workunit.client.3.smithi157.stdout:myimage7 5/s 4/s 127 KiB/s 102 KiB/s 1.98 ms 457.68 us 2024-03-26T17:05:48.296 INFO:tasks.workunit.client.3.smithi157.stdout:myimage42 5/s 4/s 118 KiB/s 90 KiB/s 1.72 ms 381.17 us 2024-03-26T17:05:48.296 INFO:tasks.workunit.client.3.smithi157.stdout:myimage55 5/s 4/s 135 KiB/s 129 KiB/s 2.07 ms 368.99 us 2024-03-26T17:05:48.296 INFO:tasks.workunit.client.3.smithi157.stdout:myimage30 5/s 4/s 126 KiB/s 125 KiB/s 2.22 ms 416.48 us 2024-03-26T17:05:48.296 INFO:tasks.workunit.client.3.smithi157.stdout:myimage44 5/s 4/s 132 KiB/s 98 KiB/s 2.08 ms 316.98 us 2024-03-26T17:05:48.296 INFO:tasks.workunit.client.3.smithi157.stdout:myimage52 5/s 4/s 151 KiB/s 92 KiB/s 2.06 ms 317.25 us 2024-03-26T17:05:48.296 INFO:tasks.workunit.client.3.smithi157.stdout:myimage26 5/s 4/s 123 KiB/s 139 KiB/s 1.84 ms 343.85 us 2024-03-26T17:05:48.296 INFO:tasks.workunit.client.3.smithi157.stdout:myimage46 5/s 5/s 126 KiB/s 148 KiB/s 1.86 ms 332.32 us 2024-03-26T17:05:48.296 INFO:tasks.workunit.client.3.smithi157.stdout:myimage59 5/s 5/s 121 KiB/s 148 KiB/s 2.05 ms 448.99 us 2024-03-26T17:05:48.296 INFO:tasks.workunit.client.3.smithi157.stdout:myimage47 4/s 5/s 138 KiB/s 151 KiB/s 1.92 ms 359.61 us 2024-03-26T17:05:48.296 INFO:tasks.workunit.client.3.smithi157.stdout:myimage9 4/s 6/s 122 KiB/s 127 KiB/s 1.94 ms 340.75 us 2024-03-26T17:05:48.296 INFO:tasks.workunit.client.3.smithi157.stdout:myimage19 4/s 6/s 154 KiB/s 174 KiB/s 2.33 ms 419.76 us 2024-03-26T17:05:48.296 INFO:tasks.workunit.client.3.smithi157.stdout:myimage53 4/s 4/s 131 KiB/s 127 KiB/s 1.85 ms 324.13 us 2024-03-26T17:05:48.296 INFO:tasks.workunit.client.3.smithi157.stdout:myimage54 4/s 3/s 130 KiB/s 79 KiB/s 1.87 ms 386.13 us 2024-03-26T17:05:48.296 INFO:tasks.workunit.client.3.smithi157.stdout:myimage60 4/s 5/s 108 KiB/s 102 KiB/s 2.05 ms 363.00 us 2024-03-26T17:05:48.297 INFO:tasks.workunit.client.3.smithi157.stdout:myimage17 4/s 4/s 102 KiB/s 109 KiB/s 1.92 ms 368.79 us 2024-03-26T17:05:48.297 INFO:tasks.workunit.client.3.smithi157.stdout:myimage21 4/s 4/s 110 KiB/s 107 KiB/s 2.44 ms 449.66 us 2024-03-26T17:05:48.297 INFO:tasks.workunit.client.3.smithi157.stdout:myimage28 4/s 5/s 126 KiB/s 110 KiB/s 2.36 ms 343.64 us 2024-03-26T17:05:48.297 INFO:tasks.workunit.client.3.smithi157.stdout:myimage29 4/s 5/s 98 KiB/s 158 KiB/s 1.71 ms 394.13 us 2024-03-26T17:05:48.297 INFO:tasks.workunit.client.3.smithi157.stdout:myimage33 4/s 4/s 99 KiB/s 104 KiB/s 2.09 ms 471.01 us 2024-03-26T17:05:48.297 INFO:tasks.workunit.client.3.smithi157.stdout:myimage41 4/s 4/s 129 KiB/s 109 KiB/s 1.87 ms 326.07 us 2024-03-26T17:05:48.297 INFO:tasks.workunit.client.3.smithi157.stdout:myimage37 4/s 5/s 88 KiB/s 86 KiB/s 2.08 ms 295.03 us 2024-03-26T17:05:48.297 INFO:tasks.workunit.client.3.smithi157.stdout:myimage15 4/s 6/s 117 KiB/s 130 KiB/s 1.79 ms 311.62 us 2024-03-26T17:05:48.297 INFO:tasks.workunit.client.3.smithi157.stdout:myimage27 4/s 5/s 90 KiB/s 96 KiB/s 1.80 ms 349.31 us 2024-03-26T17:05:48.297 INFO:tasks.workunit.client.3.smithi157.stdout:myimage39 4/s 4/s 105 KiB/s 114 KiB/s 1.86 ms 342.38 us 2024-03-26T17:05:48.297 INFO:tasks.workunit.client.3.smithi157.stdout:myimage51 4/s 4/s 113 KiB/s 96 KiB/s 2.05 ms 336.54 us 2024-03-26T17:05:48.297 INFO:tasks.workunit.client.3.smithi157.stdout:myimage56 4/s 5/s 102 KiB/s 122 KiB/s 2.30 ms 348.14 us 2024-03-26T17:05:48.297 INFO:tasks.workunit.client.3.smithi157.stdout:myimage4 4/s 4/s 117 KiB/s 122 KiB/s 1.79 ms 449.07 us 2024-03-26T17:05:48.297 INFO:tasks.workunit.client.3.smithi157.stdout:myimage6 4/s 5/s 81 KiB/s 112 KiB/s 2.10 ms 303.99 us 2024-03-26T17:05:48.297 INFO:tasks.workunit.client.3.smithi157.stdout:myimage18 4/s 5/s 94 KiB/s 118 KiB/s 1.92 ms 385.42 us 2024-03-26T17:05:48.298 INFO:tasks.workunit.client.3.smithi157.stdout:myimage22 3/s 4/s 70 KiB/s 89 KiB/s 1.83 ms 390.71 us 2024-03-26T17:05:48.298 INFO:tasks.workunit.client.3.smithi157.stdout:myimage57 3/s 5/s 106 KiB/s 134 KiB/s 2.08 ms 333.82 us 2024-03-26T17:05:48.298 INFO:tasks.workunit.client.3.smithi157.stdout:myimage1 3/s 5/s 80 KiB/s 113 KiB/s 1.73 ms 312.86 us 2024-03-26T17:05:48.298 INFO:tasks.workunit.client.3.smithi157.stdout:myimage12 3/s 7/s 92 KiB/s 154 KiB/s 1.89 ms 336.58 us 2024-03-26T17:05:48.298 INFO:tasks.workunit.client.3.smithi157.stdout:myimage5 3/s 4/s 87 KiB/s 139 KiB/s 1.84 ms 339.78 us 2024-03-26T17:05:48.298 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:05:48.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:05:47 smithi064 ceph-mon[34420]: pgmap v595: 33 pgs: 33 active+clean; 1.0 GiB data, 3.6 GiB used, 712 GiB / 715 GiB avail; 6.9 MiB/s rd, 7.1 MiB/s wr, 567 op/s 2024-03-26T17:05:48.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:05:47 smithi149 ceph-mon[34678]: pgmap v595: 33 pgs: 33 active+clean; 1.0 GiB data, 3.6 GiB used, 712 GiB / 715 GiB avail; 6.9 MiB/s rd, 7.1 MiB/s wr, 567 op/s 2024-03-26T17:05:48.396 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:05:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:05:48] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:05:48.396 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:05:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:05:48] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:05:48.397 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:05:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:05:49.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:05:48 smithi044 ceph-mon[30624]: Health check update: 3 slow ops, oldest one blocked for 443 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:05:49.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:05:48 smithi064 ceph-mon[34420]: Health check update: 3 slow ops, oldest one blocked for 443 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:05:49.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:05:48 smithi149 ceph-mon[34678]: Health check update: 3 slow ops, oldest one blocked for 443 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:05:50.166 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:05:49 smithi044 ceph-mon[30624]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:05:50.166 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:05:49 smithi044 ceph-mon[30624]: { 2024-03-26T17:05:50.166 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:05:49 smithi044 ceph-mon[30624]: "prefix": "rbd perf image stats", 2024-03-26T17:05:50.166 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:05:49 smithi044 ceph-mon[30624]: "pool_spec": "mypool", 2024-03-26T17:05:50.166 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:05:49 smithi044 ceph-mon[30624]: "sort_by": "write_ops", 2024-03-26T17:05:50.166 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:05:49 smithi044 ceph-mon[30624]: "format": "json" 2024-03-26T17:05:50.166 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:05:49 smithi044 ceph-mon[30624]: }"]: dispatch 2024-03-26T17:05:50.167 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:05:49 smithi044 ceph-mon[30624]: pgmap v596: 33 pgs: 33 active+clean; 1.0 GiB data, 3.5 GiB used, 712 GiB / 715 GiB avail; 7.2 MiB/s rd, 7.4 MiB/s wr, 608 op/s 2024-03-26T17:05:50.167 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:05:49 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:05:49] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:05:50.167 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:05:49 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:05:49] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:05:50.167 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:05:49 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:05:50.298 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:05:49 smithi149 ceph-mon[34678]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:05:50.298 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:05:49 smithi149 ceph-mon[34678]: { 2024-03-26T17:05:50.298 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:05:49 smithi149 ceph-mon[34678]: "prefix": "rbd perf image stats", 2024-03-26T17:05:50.298 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:05:49 smithi149 ceph-mon[34678]: "pool_spec": "mypool", 2024-03-26T17:05:50.298 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:05:49 smithi149 ceph-mon[34678]: "sort_by": "write_ops", 2024-03-26T17:05:50.298 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:05:49 smithi149 ceph-mon[34678]: "format": "json" 2024-03-26T17:05:50.298 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:05:49 smithi149 ceph-mon[34678]: }"]: dispatch 2024-03-26T17:05:50.298 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:05:49 smithi149 ceph-mon[34678]: pgmap v596: 33 pgs: 33 active+clean; 1.0 GiB data, 3.5 GiB used, 712 GiB / 715 GiB avail; 7.2 MiB/s rd, 7.4 MiB/s wr, 608 op/s 2024-03-26T17:05:50.299 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:05:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:05:50] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:05:50.299 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:05:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:05:50] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:05:50.299 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:05:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:05:50.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:05:49 smithi064 ceph-mon[34420]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:05:50.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:05:49 smithi064 ceph-mon[34420]: { 2024-03-26T17:05:50.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:05:49 smithi064 ceph-mon[34420]: "prefix": "rbd perf image stats", 2024-03-26T17:05:50.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:05:49 smithi064 ceph-mon[34420]: "pool_spec": "mypool", 2024-03-26T17:05:50.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:05:49 smithi064 ceph-mon[34420]: "sort_by": "write_ops", 2024-03-26T17:05:50.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:05:49 smithi064 ceph-mon[34420]: "format": "json" 2024-03-26T17:05:50.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:05:49 smithi064 ceph-mon[34420]: }"]: dispatch 2024-03-26T17:05:50.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:05:49 smithi064 ceph-mon[34420]: pgmap v596: 33 pgs: 33 active+clean; 1.0 GiB data, 3.5 GiB used, 712 GiB / 715 GiB avail; 7.2 MiB/s rd, 7.4 MiB/s wr, 608 op/s 2024-03-26T17:05:51.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:05:51 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 2024-03-26T17:05:51.225+0000 7fa707a55700 -1 mon.c@1(peon) e3 get_health_metrics reporting 3 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T17:05:52.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:05:51 smithi044 ceph-mon[30624]: pgmap v597: 33 pgs: 33 active+clean; 1.0 GiB data, 3.6 GiB used, 712 GiB / 715 GiB avail; 6.8 MiB/s rd, 7.2 MiB/s wr, 602 op/s 2024-03-26T17:05:52.265 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:05:51 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:05:51] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:05:52.265 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:05:51 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:05:51] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:05:52.266 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:05:51 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:05:52.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:05:51 smithi064 ceph-mon[34420]: pgmap v597: 33 pgs: 33 active+clean; 1.0 GiB data, 3.6 GiB used, 712 GiB / 715 GiB avail; 6.8 MiB/s rd, 7.2 MiB/s wr, 602 op/s 2024-03-26T17:05:52.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:05:51 smithi149 ceph-mon[34678]: pgmap v597: 33 pgs: 33 active+clean; 1.0 GiB data, 3.6 GiB used, 712 GiB / 715 GiB avail; 6.8 MiB/s rd, 7.2 MiB/s wr, 602 op/s 2024-03-26T17:05:52.396 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:05:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:05:52] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:05:52.396 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:05:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:05:52] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:05:52.397 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:05:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:05:53.062 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:05:53.072 INFO:tasks.workunit.client.3.smithi157.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2024-03-26T17:05:53.072 INFO:tasks.workunit.client.3.smithi157.stdout: 9.80 133.6k 86.8k 0.0k 1.3M 868.0k 0.0k nvme2n1 2024-03-26T17:05:53.072 INFO:tasks.workunit.client.3.smithi157.stdout: 9.90 106.8k 130.0k 0.0k 1.0M 1.3M 0.0k nvme2n10 2024-03-26T17:05:53.072 INFO:tasks.workunit.client.3.smithi157.stdout: 9.90 101.6k 105.2k 0.0k 1016.0k 1.0M 0.0k nvme2n11 2024-03-26T17:05:53.072 INFO:tasks.workunit.client.3.smithi157.stdout: 9.90 138.4k 98.8k 0.0k 1.4M 988.0k 0.0k nvme2n12 2024-03-26T17:05:53.072 INFO:tasks.workunit.client.3.smithi157.stdout: 9.90 121.6k 127.6k 0.0k 1.2M 1.2M 0.0k nvme2n13 2024-03-26T17:05:53.073 INFO:tasks.workunit.client.3.smithi157.stdout: 9.90 121.6k 128.4k 0.0k 1.2M 1.3M 0.0k nvme2n14 2024-03-26T17:05:53.073 INFO:tasks.workunit.client.3.smithi157.stdout: 9.90 115.6k 116.4k 0.0k 1.1M 1.1M 0.0k nvme2n15 2024-03-26T17:05:53.073 INFO:tasks.workunit.client.3.smithi157.stdout: 9.90 128.0k 112.0k 0.0k 1.2M 1.1M 0.0k nvme2n16 2024-03-26T17:05:53.073 INFO:tasks.workunit.client.3.smithi157.stdout: 9.90 125.2k 124.0k 0.0k 1.2M 1.2M 0.0k nvme2n17 2024-03-26T17:05:53.073 INFO:tasks.workunit.client.3.smithi157.stdout: 9.90 129.6k 124.0k 0.0k 1.3M 1.2M 0.0k nvme2n18 2024-03-26T17:05:53.073 INFO:tasks.workunit.client.3.smithi157.stdout: 9.90 94.4k 130.8k 0.0k 944.0k 1.3M 0.0k nvme2n19 2024-03-26T17:05:53.073 INFO:tasks.workunit.client.3.smithi157.stdout: 9.80 86.4k 137.6k 0.0k 864.0k 1.3M 0.0k nvme2n2 2024-03-26T17:05:53.073 INFO:tasks.workunit.client.3.smithi157.stdout: 9.90 145.2k 96.4k 0.0k 1.4M 964.0k 0.0k nvme2n20 2024-03-26T17:05:53.073 INFO:tasks.workunit.client.3.smithi157.stdout: 9.80 105.2k 132.0k 0.0k 1.0M 1.3M 0.0k nvme2n3 2024-03-26T17:05:53.073 INFO:tasks.workunit.client.3.smithi157.stdout: 9.80 104.8k 108.0k 0.0k 1.0M 1.1M 0.0k nvme2n4 2024-03-26T17:05:53.073 INFO:tasks.workunit.client.3.smithi157.stdout: 9.80 125.2k 120.8k 0.0k 1.2M 1.2M 0.0k nvme2n5 2024-03-26T17:05:53.073 INFO:tasks.workunit.client.3.smithi157.stdout: 9.80 112.4k 93.2k 0.0k 1.1M 932.0k 0.0k nvme2n6 2024-03-26T17:05:53.073 INFO:tasks.workunit.client.3.smithi157.stdout: 9.80 89.6k 141.6k 0.0k 896.0k 1.4M 0.0k nvme2n7 2024-03-26T17:05:53.074 INFO:tasks.workunit.client.3.smithi157.stdout: 9.80 93.6k 116.0k 0.0k 936.0k 1.1M 0.0k nvme2n8 2024-03-26T17:05:53.074 INFO:tasks.workunit.client.3.smithi157.stdout: 9.80 111.6k 100.0k 0.0k 1.1M 1000.0k 0.0k nvme2n9 2024-03-26T17:05:53.074 INFO:tasks.workunit.client.3.smithi157.stdout: 9.80 115.6k 119.6k 0.0k 1.1M 1.2M 0.0k nvme5n1 2024-03-26T17:05:53.074 INFO:tasks.workunit.client.3.smithi157.stdout: 9.80 130.0k 142.8k 0.0k 1.3M 1.4M 0.0k nvme5n10 2024-03-26T17:05:53.074 INFO:tasks.workunit.client.3.smithi157.stdout: 9.90 105.2k 130.8k 0.0k 1.0M 1.3M 0.0k nvme5n11 2024-03-26T17:05:53.074 INFO:tasks.workunit.client.3.smithi157.stdout: 9.90 113.2k 118.8k 0.0k 1.1M 1.2M 0.0k nvme5n12 2024-03-26T17:05:53.074 INFO:tasks.workunit.client.3.smithi157.stdout: 9.90 98.4k 132.0k 0.0k 984.0k 1.3M 0.0k nvme5n13 2024-03-26T17:05:53.074 INFO:tasks.workunit.client.3.smithi157.stdout: 9.90 108.0k 124.4k 0.0k 1.1M 1.2M 0.0k nvme5n14 2024-03-26T17:05:53.074 INFO:tasks.workunit.client.3.smithi157.stdout: 9.90 127.2k 111.6k 0.0k 1.2M 1.1M 0.0k nvme5n15 2024-03-26T17:05:53.074 INFO:tasks.workunit.client.3.smithi157.stdout: 9.90 119.2k 80.8k 0.0k 1.2M 808.0k 0.0k nvme5n16 2024-03-26T17:05:53.074 INFO:tasks.workunit.client.3.smithi157.stdout: 9.90 96.8k 122.8k 0.0k 968.0k 1.2M 0.0k nvme5n17 2024-03-26T17:05:53.074 INFO:tasks.workunit.client.3.smithi157.stdout: 9.90 77.2k 145.2k 0.0k 772.0k 1.4M 0.0k nvme5n18 2024-03-26T17:05:53.074 INFO:tasks.workunit.client.3.smithi157.stdout: 9.90 130.0k 119.2k 0.0k 1.3M 1.2M 0.0k nvme5n19 2024-03-26T17:05:53.075 INFO:tasks.workunit.client.3.smithi157.stdout: 9.80 82.8k 90.8k 0.0k 828.0k 908.0k 0.0k nvme5n2 2024-03-26T17:05:53.075 INFO:tasks.workunit.client.3.smithi157.stdout: 9.90 136.0k 120.4k 0.0k 1.3M 1.2M 0.0k nvme5n20 2024-03-26T17:05:53.075 INFO:tasks.workunit.client.3.smithi157.stdout: 9.80 97.6k 138.8k 0.0k 976.0k 1.4M 0.0k nvme5n3 2024-03-26T17:05:53.075 INFO:tasks.workunit.client.3.smithi157.stdout: 9.80 80.0k 156.4k 0.0k 800.0k 1.5M 0.0k nvme5n4 2024-03-26T17:05:53.075 INFO:tasks.workunit.client.3.smithi157.stdout: 9.80 76.8k 116.4k 0.0k 768.0k 1.1M 0.0k nvme5n5 2024-03-26T17:05:53.075 INFO:tasks.workunit.client.3.smithi157.stdout: 9.80 111.6k 101.2k 0.0k 1.1M 1012.0k 0.0k nvme5n6 2024-03-26T17:05:53.075 INFO:tasks.workunit.client.3.smithi157.stdout: 9.80 111.6k 94.8k 0.0k 1.1M 948.0k 0.0k nvme5n7 2024-03-26T17:05:53.075 INFO:tasks.workunit.client.3.smithi157.stdout: 9.80 118.0k 95.6k 0.0k 1.2M 956.0k 0.0k nvme5n8 2024-03-26T17:05:53.075 INFO:tasks.workunit.client.3.smithi157.stdout: 9.80 115.2k 108.8k 0.0k 1.1M 1.1M 0.0k nvme5n9 2024-03-26T17:05:53.075 INFO:tasks.workunit.client.3.smithi157.stdout: 9.80 94.0k 124.4k 0.0k 940.0k 1.2M 0.0k nvme8n1 2024-03-26T17:05:53.075 INFO:tasks.workunit.client.3.smithi157.stdout: 9.90 131.6k 111.6k 0.0k 1.3M 1.1M 0.0k nvme8n10 2024-03-26T17:05:53.075 INFO:tasks.workunit.client.3.smithi157.stdout: 9.90 109.2k 120.0k 0.0k 1.1M 1.2M 0.0k nvme8n11 2024-03-26T17:05:53.075 INFO:tasks.workunit.client.3.smithi157.stdout: 9.90 91.6k 154.4k 0.0k 916.0k 1.5M 0.0k nvme8n12 2024-03-26T17:05:53.075 INFO:tasks.workunit.client.3.smithi157.stdout: 9.90 95.2k 127.2k 0.0k 952.0k 1.2M 0.0k nvme8n13 2024-03-26T17:05:53.076 INFO:tasks.workunit.client.3.smithi157.stdout: 9.90 100.0k 114.8k 0.0k 1000.0k 1.1M 0.0k nvme8n14 2024-03-26T17:05:53.076 INFO:tasks.workunit.client.3.smithi157.stdout: 9.90 121.2k 115.6k 0.0k 1.2M 1.1M 0.0k nvme8n15 2024-03-26T17:05:53.076 INFO:tasks.workunit.client.3.smithi157.stdout: 9.90 111.6k 113.6k 0.0k 1.1M 1.1M 0.0k nvme8n16 2024-03-26T17:05:53.076 INFO:tasks.workunit.client.3.smithi157.stdout: 9.90 112.8k 136.4k 0.0k 1.1M 1.3M 0.0k nvme8n17 2024-03-26T17:05:53.076 INFO:tasks.workunit.client.3.smithi157.stdout: 9.90 102.4k 132.8k 0.0k 1.0M 1.3M 0.0k nvme8n18 2024-03-26T17:05:53.076 INFO:tasks.workunit.client.3.smithi157.stdout: 9.90 110.0k 106.0k 0.0k 1.1M 1.0M 0.0k nvme8n19 2024-03-26T17:05:53.076 INFO:tasks.workunit.client.3.smithi157.stdout: 9.80 126.0k 114.0k 0.0k 1.2M 1.1M 0.0k nvme8n2 2024-03-26T17:05:53.076 INFO:tasks.workunit.client.3.smithi157.stdout: 9.80 119.6k 95.6k 0.0k 1.2M 956.0k 0.0k nvme8n20 2024-03-26T17:05:53.076 INFO:tasks.workunit.client.3.smithi157.stdout: 9.80 112.4k 129.6k 0.0k 1.1M 1.3M 0.0k nvme8n3 2024-03-26T17:05:53.076 INFO:tasks.workunit.client.3.smithi157.stdout: 9.80 116.0k 132.0k 0.0k 1.1M 1.3M 0.0k nvme8n4 2024-03-26T17:05:53.076 INFO:tasks.workunit.client.3.smithi157.stdout: 9.80 96.4k 128.8k 0.0k 964.0k 1.3M 0.0k nvme8n5 2024-03-26T17:05:53.076 INFO:tasks.workunit.client.3.smithi157.stdout: 9.80 116.0k 108.8k 0.0k 1.1M 1.1M 0.0k nvme8n6 2024-03-26T17:05:53.076 INFO:tasks.workunit.client.3.smithi157.stdout: 9.80 145.2k 96.4k 0.0k 1.4M 964.0k 0.0k nvme8n7 2024-03-26T17:05:53.076 INFO:tasks.workunit.client.3.smithi157.stdout: 9.80 96.4k 112.4k 0.0k 964.0k 1.1M 0.0k nvme8n8 2024-03-26T17:05:53.076 INFO:tasks.workunit.client.3.smithi157.stdout: 9.80 123.6k 131.2k 0.0k 1.2M 1.3M 0.0k nvme8n9 2024-03-26T17:05:53.077 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:05:53.298 INFO:tasks.workunit.client.3.smithi157.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-26T17:05:53.298 INFO:tasks.workunit.client.3.smithi157.stdout:myimage31 7/s 4/s 150 KiB/s 124 KiB/s 1.94 ms 332.36 us 2024-03-26T17:05:53.298 INFO:tasks.workunit.client.3.smithi157.stdout:myimage2 6/s 2/s 160 KiB/s 69 KiB/s 2.09 ms 333.08 us 2024-03-26T17:05:53.298 INFO:tasks.workunit.client.3.smithi157.stdout:myimage13 6/s 4/s 167 KiB/s 87 KiB/s 1.73 ms 317.88 us 2024-03-26T17:05:53.298 INFO:tasks.workunit.client.3.smithi157.stdout:myimage17 6/s 5/s 140 KiB/s 146 KiB/s 2.07 ms 406.63 us 2024-03-26T17:05:53.298 INFO:tasks.workunit.client.3.smithi157.stdout:myimage46 6/s 4/s 125 KiB/s 92 KiB/s 1.85 ms 349.26 us 2024-03-26T17:05:53.299 INFO:tasks.workunit.client.3.smithi157.stdout:myimage57 6/s 3/s 142 KiB/s 99 KiB/s 1.86 ms 328.22 us 2024-03-26T17:05:53.299 INFO:tasks.workunit.client.3.smithi157.stdout:myimage7 6/s 4/s 166 KiB/s 91 KiB/s 2.01 ms 349.88 us 2024-03-26T17:05:53.299 INFO:tasks.workunit.client.3.smithi157.stdout:myimage55 6/s 5/s 140 KiB/s 130 KiB/s 2.04 ms 346.23 us 2024-03-26T17:05:53.299 INFO:tasks.workunit.client.3.smithi157.stdout:myimage30 5/s 4/s 173 KiB/s 119 KiB/s 2.40 ms 320.56 us 2024-03-26T17:05:53.299 INFO:tasks.workunit.client.3.smithi157.stdout:myimage52 5/s 3/s 156 KiB/s 87 KiB/s 2.21 ms 302.84 us 2024-03-26T17:05:53.299 INFO:tasks.workunit.client.3.smithi157.stdout:myimage24 5/s 2/s 126 KiB/s 47 KiB/s 1.93 ms 246.93 us 2024-03-26T17:05:53.299 INFO:tasks.workunit.client.3.smithi157.stdout:myimage22 5/s 5/s 94 KiB/s 102 KiB/s 1.91 ms 302.43 us 2024-03-26T17:05:53.299 INFO:tasks.workunit.client.3.smithi157.stdout:myimage38 5/s 5/s 118 KiB/s 106 KiB/s 1.66 ms 331.73 us 2024-03-26T17:05:53.299 INFO:tasks.workunit.client.3.smithi157.stdout:myimage4 5/s 5/s 136 KiB/s 102 KiB/s 1.76 ms 360.84 us 2024-03-26T17:05:53.299 INFO:tasks.workunit.client.3.smithi157.stdout:myimage29 5/s 4/s 138 KiB/s 92 KiB/s 1.77 ms 323.20 us 2024-03-26T17:05:53.299 INFO:tasks.workunit.client.3.smithi157.stdout:myimage39 5/s 4/s 145 KiB/s 132 KiB/s 1.83 ms 327.83 us 2024-03-26T17:05:53.299 INFO:tasks.workunit.client.3.smithi157.stdout:myimage41 5/s 4/s 129 KiB/s 105 KiB/s 1.98 ms 320.73 us 2024-03-26T17:05:53.299 INFO:tasks.workunit.client.3.smithi157.stdout:myimage45 5/s 4/s 161 KiB/s 116 KiB/s 1.78 ms 301.30 us 2024-03-26T17:05:53.299 INFO:tasks.workunit.client.3.smithi157.stdout:myimage51 5/s 5/s 128 KiB/s 139 KiB/s 2.09 ms 349.60 us 2024-03-26T17:05:53.300 INFO:tasks.workunit.client.3.smithi157.stdout:myimage3 5/s 4/s 154 KiB/s 112 KiB/s 1.63 ms 367.05 us 2024-03-26T17:05:53.300 INFO:tasks.workunit.client.3.smithi157.stdout:myimage58 5/s 3/s 130 KiB/s 100 KiB/s 1.69 ms 314.76 us 2024-03-26T17:05:53.300 INFO:tasks.workunit.client.3.smithi157.stdout:myimage19 5/s 4/s 103 KiB/s 84 KiB/s 1.97 ms 336.24 us 2024-03-26T17:05:53.300 INFO:tasks.workunit.client.3.smithi157.stdout:myimage25 5/s 4/s 118 KiB/s 82 KiB/s 2.27 ms 355.24 us 2024-03-26T17:05:53.300 INFO:tasks.workunit.client.3.smithi157.stdout:myimage34 5/s 4/s 111 KiB/s 87 KiB/s 1.76 ms 378.10 us 2024-03-26T17:05:53.300 INFO:tasks.workunit.client.3.smithi157.stdout:myimage37 5/s 4/s 138 KiB/s 96 KiB/s 1.99 ms 318.81 us 2024-03-26T17:05:53.300 INFO:tasks.workunit.client.3.smithi157.stdout:myimage1 5/s 5/s 110 KiB/s 126 KiB/s 1.69 ms 343.95 us 2024-03-26T17:05:53.300 INFO:tasks.workunit.client.3.smithi157.stdout:myimage5 5/s 5/s 134 KiB/s 107 KiB/s 1.77 ms 305.04 us 2024-03-26T17:05:53.300 INFO:tasks.workunit.client.3.smithi157.stdout:myimage35 5/s 5/s 122 KiB/s 136 KiB/s 2.14 ms 361.38 us 2024-03-26T17:05:53.300 INFO:tasks.workunit.client.3.smithi157.stdout:myimage15 5/s 4/s 110 KiB/s 98 KiB/s 1.82 ms 443.45 us 2024-03-26T17:05:53.300 INFO:tasks.workunit.client.3.smithi157.stdout:myimage18 5/s 5/s 123 KiB/s 151 KiB/s 1.83 ms 350.80 us 2024-03-26T17:05:53.300 INFO:tasks.workunit.client.3.smithi157.stdout:myimage53 5/s 5/s 104 KiB/s 126 KiB/s 1.80 ms 320.28 us 2024-03-26T17:05:53.300 INFO:tasks.workunit.client.3.smithi157.stdout:myimage54 5/s 4/s 114 KiB/s 82 KiB/s 1.82 ms 333.24 us 2024-03-26T17:05:53.300 INFO:tasks.workunit.client.3.smithi157.stdout:myimage10 5/s 5/s 134 KiB/s 106 KiB/s 1.88 ms 315.85 us 2024-03-26T17:05:53.300 INFO:tasks.workunit.client.3.smithi157.stdout:myimage23 4/s 4/s 139 KiB/s 119 KiB/s 1.69 ms 294.48 us 2024-03-26T17:05:53.301 INFO:tasks.workunit.client.3.smithi157.stdout:myimage32 4/s 4/s 127 KiB/s 97 KiB/s 1.97 ms 304.30 us 2024-03-26T17:05:53.301 INFO:tasks.workunit.client.3.smithi157.stdout:myimage48 4/s 4/s 87 KiB/s 84 KiB/s 1.93 ms 321.57 us 2024-03-26T17:05:53.301 INFO:tasks.workunit.client.3.smithi157.stdout:myimage9 4/s 4/s 110 KiB/s 86 KiB/s 2.05 ms 372.59 us 2024-03-26T17:05:53.301 INFO:tasks.workunit.client.3.smithi157.stdout:myimage11 4/s 4/s 114 KiB/s 106 KiB/s 2.12 ms 377.38 us 2024-03-26T17:05:53.301 INFO:tasks.workunit.client.3.smithi157.stdout:myimage59 4/s 5/s 88 KiB/s 106 KiB/s 2.03 ms 322.91 us 2024-03-26T17:05:53.301 INFO:tasks.workunit.client.3.smithi157.stdout:myimage33 4/s 4/s 109 KiB/s 84 KiB/s 1.97 ms 292.90 us 2024-03-26T17:05:53.301 INFO:tasks.workunit.client.3.smithi157.stdout:myimage50 4/s 4/s 110 KiB/s 114 KiB/s 2.10 ms 310.80 us 2024-03-26T17:05:53.301 INFO:tasks.workunit.client.3.smithi157.stdout:myimage47 4/s 5/s 107 KiB/s 120 KiB/s 2.01 ms 468.68 us 2024-03-26T17:05:53.301 INFO:tasks.workunit.client.3.smithi157.stdout:myimage26 4/s 5/s 76 KiB/s 114 KiB/s 1.90 ms 314.17 us 2024-03-26T17:05:53.301 INFO:tasks.workunit.client.3.smithi157.stdout:myimage36 4/s 6/s 77 KiB/s 138 KiB/s 1.93 ms 341.38 us 2024-03-26T17:05:53.301 INFO:tasks.workunit.client.3.smithi157.stdout:myimage42 4/s 6/s 130 KiB/s 149 KiB/s 1.97 ms 446.15 us 2024-03-26T17:05:53.301 INFO:tasks.workunit.client.3.smithi157.stdout:myimage56 4/s 5/s 101 KiB/s 97 KiB/s 2.15 ms 318.64 us 2024-03-26T17:05:53.301 INFO:tasks.workunit.client.3.smithi157.stdout:myimage14 4/s 4/s 90 KiB/s 146 KiB/s 2.19 ms 361.24 us 2024-03-26T17:05:53.301 INFO:tasks.workunit.client.3.smithi157.stdout:myimage44 4/s 4/s 101 KiB/s 109 KiB/s 1.89 ms 328.27 us 2024-03-26T17:05:53.301 INFO:tasks.workunit.client.3.smithi157.stdout:myimage6 4/s 5/s 94 KiB/s 98 KiB/s 2.12 ms 333.72 us 2024-03-26T17:05:53.302 INFO:tasks.workunit.client.3.smithi157.stdout:myimage27 4/s 6/s 87 KiB/s 146 KiB/s 1.77 ms 339.17 us 2024-03-26T17:05:53.302 INFO:tasks.workunit.client.3.smithi157.stdout:myimage28 4/s 5/s 95 KiB/s 83 KiB/s 2.35 ms 432.63 us 2024-03-26T17:05:53.302 INFO:tasks.workunit.client.3.smithi157.stdout:myimage43 4/s 5/s 132 KiB/s 119 KiB/s 2.06 ms 329.30 us 2024-03-26T17:05:53.302 INFO:tasks.workunit.client.3.smithi157.stdout:myimage40 4/s 5/s 87 KiB/s 172 KiB/s 1.80 ms 344.59 us 2024-03-26T17:05:53.302 INFO:tasks.workunit.client.3.smithi157.stdout:myimage12 4/s 5/s 102 KiB/s 141 KiB/s 1.93 ms 300.31 us 2024-03-26T17:05:53.302 INFO:tasks.workunit.client.3.smithi157.stdout:myimage21 4/s 7/s 129 KiB/s 123 KiB/s 2.30 ms 323.18 us 2024-03-26T17:05:53.302 INFO:tasks.workunit.client.3.smithi157.stdout:myimage60 4/s 5/s 82 KiB/s 130 KiB/s 1.99 ms 310.03 us 2024-03-26T17:05:53.302 INFO:tasks.workunit.client.3.smithi157.stdout:myimage16 3/s 6/s 117 KiB/s 151 KiB/s 1.86 ms 322.85 us 2024-03-26T17:05:53.302 INFO:tasks.workunit.client.3.smithi157.stdout:myimage8 3/s 4/s 82 KiB/s 93 KiB/s 2.00 ms 353.42 us 2024-03-26T17:05:53.302 INFO:tasks.workunit.client.3.smithi157.stdout:myimage49 3/s 6/s 105 KiB/s 160 KiB/s 1.77 ms 362.96 us 2024-03-26T17:05:53.302 INFO:tasks.workunit.client.3.smithi157.stdout:myimage20 3/s 6/s 69 KiB/s 171 KiB/s 1.69 ms 350.62 us 2024-03-26T17:05:53.303 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:05:54.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:05:53 smithi044 ceph-mon[30624]: pgmap v598: 33 pgs: 33 active+clean; 1.0 GiB data, 3.6 GiB used, 712 GiB / 715 GiB avail; 6.3 MiB/s rd, 6.7 MiB/s wr, 560 op/s 2024-03-26T17:05:54.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:05:53 smithi044 ceph-mon[30624]: Health check update: 3 slow ops, oldest one blocked for 448 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:05:54.266 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:05:53 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:05:53] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:05:54.266 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:05:53 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:05:53] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:05:54.266 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:05:53 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:05:54.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:05:53 smithi064 ceph-mon[34420]: pgmap v598: 33 pgs: 33 active+clean; 1.0 GiB data, 3.6 GiB used, 712 GiB / 715 GiB avail; 6.3 MiB/s rd, 6.7 MiB/s wr, 560 op/s 2024-03-26T17:05:54.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:05:53 smithi064 ceph-mon[34420]: Health check update: 3 slow ops, oldest one blocked for 448 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:05:54.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:05:53 smithi149 ceph-mon[34678]: pgmap v598: 33 pgs: 33 active+clean; 1.0 GiB data, 3.6 GiB used, 712 GiB / 715 GiB avail; 6.3 MiB/s rd, 6.7 MiB/s wr, 560 op/s 2024-03-26T17:05:54.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:05:53 smithi149 ceph-mon[34678]: Health check update: 3 slow ops, oldest one blocked for 448 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:05:54.397 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:05:54 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:05:54] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:05:54.397 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:05:54 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:05:54] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:05:54.397 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:05:54 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:05:55.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:05:54 smithi044 ceph-mon[30624]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:05:55.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:05:54 smithi044 ceph-mon[30624]: { 2024-03-26T17:05:55.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:05:54 smithi044 ceph-mon[30624]: "prefix": "rbd perf image stats", 2024-03-26T17:05:55.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:05:54 smithi044 ceph-mon[30624]: "pool_spec": "mypool", 2024-03-26T17:05:55.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:05:54 smithi044 ceph-mon[30624]: "sort_by": "write_ops", 2024-03-26T17:05:55.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:05:54 smithi044 ceph-mon[30624]: "format": "json" 2024-03-26T17:05:55.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:05:54 smithi044 ceph-mon[30624]: }"]: dispatch 2024-03-26T17:05:55.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:05:54 smithi064 ceph-mon[34420]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:05:55.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:05:54 smithi064 ceph-mon[34420]: { 2024-03-26T17:05:55.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:05:54 smithi064 ceph-mon[34420]: "prefix": "rbd perf image stats", 2024-03-26T17:05:55.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:05:54 smithi064 ceph-mon[34420]: "pool_spec": "mypool", 2024-03-26T17:05:55.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:05:54 smithi064 ceph-mon[34420]: "sort_by": "write_ops", 2024-03-26T17:05:55.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:05:54 smithi064 ceph-mon[34420]: "format": "json" 2024-03-26T17:05:55.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:05:54 smithi064 ceph-mon[34420]: }"]: dispatch 2024-03-26T17:05:55.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:05:54 smithi149 ceph-mon[34678]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:05:55.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:05:54 smithi149 ceph-mon[34678]: { 2024-03-26T17:05:55.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:05:54 smithi149 ceph-mon[34678]: "prefix": "rbd perf image stats", 2024-03-26T17:05:55.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:05:54 smithi149 ceph-mon[34678]: "pool_spec": "mypool", 2024-03-26T17:05:55.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:05:54 smithi149 ceph-mon[34678]: "sort_by": "write_ops", 2024-03-26T17:05:55.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:05:54 smithi149 ceph-mon[34678]: "format": "json" 2024-03-26T17:05:55.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:05:54 smithi149 ceph-mon[34678]: }"]: dispatch 2024-03-26T17:05:56.167 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:05:55 smithi044 ceph-mon[30624]: pgmap v599: 33 pgs: 33 active+clean; 1.0 GiB data, 3.6 GiB used, 712 GiB / 715 GiB avail; 6.6 MiB/s rd, 7.1 MiB/s wr, 601 op/s 2024-03-26T17:05:56.167 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:05:55 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:05:55] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:05:56.167 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:05:55 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:05:55] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:05:56.168 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:05:55 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:05:56.178 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:05:55 smithi149 ceph-mon[34678]: pgmap v599: 33 pgs: 33 active+clean; 1.0 GiB data, 3.6 GiB used, 712 GiB / 715 GiB avail; 6.6 MiB/s rd, 7.1 MiB/s wr, 601 op/s 2024-03-26T17:05:56.178 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:05:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:05:56] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:05:56.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:05:55 smithi064 ceph-mon[34420]: pgmap v599: 33 pgs: 33 active+clean; 1.0 GiB data, 3.6 GiB used, 712 GiB / 715 GiB avail; 6.6 MiB/s rd, 7.1 MiB/s wr, 601 op/s 2024-03-26T17:05:56.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:05:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 2024-03-26T17:05:56.225+0000 7fa707a55700 -1 mon.c@1(peon) e3 get_health_metrics reporting 3 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T17:05:56.646 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:05:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:05:56] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:05:56.646 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:05:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:05:58.182 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:05:57 smithi149 ceph-mon[34678]: pgmap v600: 33 pgs: 33 active+clean; 1.0 GiB data, 3.6 GiB used, 712 GiB / 715 GiB avail; 6.3 MiB/s rd, 6.7 MiB/s wr, 581 op/s 2024-03-26T17:05:58.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:05:57 smithi044 ceph-mon[30624]: pgmap v600: 33 pgs: 33 active+clean; 1.0 GiB data, 3.6 GiB used, 712 GiB / 715 GiB avail; 6.3 MiB/s rd, 6.7 MiB/s wr, 581 op/s 2024-03-26T17:05:58.265 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:05:57 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:05:57] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:05:58.266 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:05:57 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:05:57] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:05:58.266 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:05:57 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:05:58.302 INFO:tasks.workunit.client.3.smithi157.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-26T17:05:58.302 INFO:tasks.workunit.client.3.smithi157.stdout:myimage10 6/s 3/s 122 KiB/s 84 KiB/s 1.90 ms 296.20 us 2024-03-26T17:05:58.302 INFO:tasks.workunit.client.3.smithi157.stdout:myimage5 6/s 4/s 153 KiB/s 110 KiB/s 1.84 ms 322.06 us 2024-03-26T17:05:58.302 INFO:tasks.workunit.client.3.smithi157.stdout:myimage24 6/s 4/s 135 KiB/s 95 KiB/s 1.82 ms 365.15 us 2024-03-26T17:05:58.302 INFO:tasks.workunit.client.3.smithi157.stdout:myimage16 6/s 4/s 138 KiB/s 107 KiB/s 2.00 ms 333.12 us 2024-03-26T17:05:58.302 INFO:tasks.workunit.client.3.smithi157.stdout:myimage6 6/s 5/s 139 KiB/s 125 KiB/s 1.91 ms 330.74 us 2024-03-26T17:05:58.302 INFO:tasks.workunit.client.3.smithi157.stdout:myimage26 6/s 3/s 139 KiB/s 59 KiB/s 2.06 ms 322.97 us 2024-03-26T17:05:58.302 INFO:tasks.workunit.client.3.smithi157.stdout:myimage53 6/s 4/s 123 KiB/s 65 KiB/s 1.81 ms 256.33 us 2024-03-26T17:05:58.302 INFO:tasks.workunit.client.3.smithi157.stdout:myimage27 5/s 5/s 115 KiB/s 94 KiB/s 1.78 ms 312.95 us 2024-03-26T17:05:58.302 INFO:tasks.workunit.client.3.smithi157.stdout:myimage3 5/s 4/s 116 KiB/s 88 KiB/s 1.66 ms 282.52 us 2024-03-26T17:05:58.303 INFO:tasks.workunit.client.3.smithi157.stdout:myimage22 5/s 4/s 122 KiB/s 110 KiB/s 2.04 ms 321.23 us 2024-03-26T17:05:58.303 INFO:tasks.workunit.client.3.smithi157.stdout:myimage23 5/s 4/s 116 KiB/s 77 KiB/s 1.62 ms 283.15 us 2024-03-26T17:05:58.303 INFO:tasks.workunit.client.3.smithi157.stdout:myimage34 5/s 4/s 110 KiB/s 98 KiB/s 1.84 ms 305.39 us 2024-03-26T17:05:58.303 INFO:tasks.workunit.client.3.smithi157.stdout:myimage40 5/s 4/s 117 KiB/s 81 KiB/s 1.89 ms 300.05 us 2024-03-26T17:05:58.303 INFO:tasks.workunit.client.3.smithi157.stdout:myimage48 5/s 4/s 131 KiB/s 90 KiB/s 2.11 ms 291.47 us 2024-03-26T17:05:58.303 INFO:tasks.workunit.client.3.smithi157.stdout:myimage11 5/s 5/s 101 KiB/s 118 KiB/s 2.25 ms 338.38 us 2024-03-26T17:05:58.303 INFO:tasks.workunit.client.3.smithi157.stdout:myimage12 5/s 4/s 115 KiB/s 79 KiB/s 1.97 ms 411.69 us 2024-03-26T17:05:58.303 INFO:tasks.workunit.client.3.smithi157.stdout:myimage19 5/s 4/s 147 KiB/s 92 KiB/s 2.04 ms 296.75 us 2024-03-26T17:05:58.303 INFO:tasks.workunit.client.3.smithi157.stdout:myimage20 5/s 5/s 137 KiB/s 98 KiB/s 1.71 ms 313.14 us 2024-03-26T17:05:58.303 INFO:tasks.workunit.client.3.smithi157.stdout:myimage55 5/s 3/s 121 KiB/s 78 KiB/s 1.94 ms 403.42 us 2024-03-26T17:05:58.303 INFO:tasks.workunit.client.3.smithi157.stdout:myimage60 5/s 5/s 109 KiB/s 130 KiB/s 2.05 ms 462.67 us 2024-03-26T17:05:58.303 INFO:tasks.workunit.client.3.smithi157.stdout:myimage30 5/s 4/s 118 KiB/s 112 KiB/s 2.38 ms 358.77 us 2024-03-26T17:05:58.303 INFO:tasks.workunit.client.3.smithi157.stdout:myimage15 5/s 4/s 112 KiB/s 100 KiB/s 1.96 ms 326.36 us 2024-03-26T17:05:58.304 INFO:tasks.workunit.client.3.smithi157.stdout:myimage44 5/s 6/s 152 KiB/s 146 KiB/s 1.94 ms 325.68 us 2024-03-26T17:05:58.304 INFO:tasks.workunit.client.3.smithi157.stdout:myimage49 5/s 4/s 121 KiB/s 94 KiB/s 1.89 ms 307.10 us 2024-03-26T17:05:58.304 INFO:tasks.workunit.client.3.smithi157.stdout:myimage52 5/s 4/s 118 KiB/s 102 KiB/s 2.13 ms 498.22 us 2024-03-26T17:05:58.304 INFO:tasks.workunit.client.3.smithi157.stdout:myimage31 5/s 3/s 110 KiB/s 69 KiB/s 2.08 ms 339.65 us 2024-03-26T17:05:58.304 INFO:tasks.workunit.client.3.smithi157.stdout:myimage35 5/s 4/s 146 KiB/s 102 KiB/s 1.97 ms 308.14 us 2024-03-26T17:05:58.304 INFO:tasks.workunit.client.3.smithi157.stdout:myimage58 5/s 4/s 79 KiB/s 87 KiB/s 1.89 ms 274.08 us 2024-03-26T17:05:58.304 INFO:tasks.workunit.client.3.smithi157.stdout:myimage8 5/s 5/s 114 KiB/s 102 KiB/s 2.02 ms 367.20 us 2024-03-26T17:05:58.304 INFO:tasks.workunit.client.3.smithi157.stdout:myimage36 5/s 4/s 104 KiB/s 94 KiB/s 1.85 ms 388.12 us 2024-03-26T17:05:58.304 INFO:tasks.workunit.client.3.smithi157.stdout:myimage56 5/s 4/s 133 KiB/s 120 KiB/s 2.27 ms 323.95 us 2024-03-26T17:05:58.304 INFO:tasks.workunit.client.3.smithi157.stdout:myimage13 4/s 4/s 76 KiB/s 117 KiB/s 1.85 ms 325.64 us 2024-03-26T17:05:58.304 INFO:tasks.workunit.client.3.smithi157.stdout:myimage7 4/s 4/s 115 KiB/s 86 KiB/s 1.91 ms 391.30 us 2024-03-26T17:05:58.304 INFO:tasks.workunit.client.3.smithi157.stdout:myimage33 4/s 5/s 111 KiB/s 121 KiB/s 2.11 ms 391.76 us 2024-03-26T17:05:58.304 INFO:tasks.workunit.client.3.smithi157.stdout:myimage54 4/s 5/s 114 KiB/s 94 KiB/s 1.91 ms 310.22 us 2024-03-26T17:05:58.304 INFO:tasks.workunit.client.3.smithi157.stdout:myimage57 4/s 5/s 114 KiB/s 115 KiB/s 1.85 ms 331.89 us 2024-03-26T17:05:58.305 INFO:tasks.workunit.client.3.smithi157.stdout:myimage14 4/s 6/s 114 KiB/s 123 KiB/s 2.13 ms 305.80 us 2024-03-26T17:05:58.305 INFO:tasks.workunit.client.3.smithi157.stdout:myimage17 4/s 5/s 85 KiB/s 136 KiB/s 1.95 ms 423.19 us 2024-03-26T17:05:58.305 INFO:tasks.workunit.client.3.smithi157.stdout:myimage25 4/s 4/s 95 KiB/s 85 KiB/s 2.14 ms 409.86 us 2024-03-26T17:05:58.305 INFO:tasks.workunit.client.3.smithi157.stdout:myimage43 4/s 5/s 93 KiB/s 103 KiB/s 2.03 ms 342.59 us 2024-03-26T17:05:58.305 INFO:tasks.workunit.client.3.smithi157.stdout:myimage45 4/s 5/s 90 KiB/s 95 KiB/s 1.98 ms 366.24 us 2024-03-26T17:05:58.305 INFO:tasks.workunit.client.3.smithi157.stdout:myimage51 4/s 5/s 95 KiB/s 98 KiB/s 2.18 ms 386.54 us 2024-03-26T17:05:58.305 INFO:tasks.workunit.client.3.smithi157.stdout:myimage2 4/s 5/s 65 KiB/s 134 KiB/s 2.11 ms 355.13 us 2024-03-26T17:05:58.305 INFO:tasks.workunit.client.3.smithi157.stdout:myimage18 4/s 4/s 121 KiB/s 98 KiB/s 1.84 ms 338.75 us 2024-03-26T17:05:58.305 INFO:tasks.workunit.client.3.smithi157.stdout:myimage29 4/s 5/s 91 KiB/s 129 KiB/s 1.80 ms 305.51 us 2024-03-26T17:05:58.305 INFO:tasks.workunit.client.3.smithi157.stdout:myimage37 4/s 4/s 82 KiB/s 97 KiB/s 2.06 ms 395.54 us 2024-03-26T17:05:58.305 INFO:tasks.workunit.client.3.smithi157.stdout:myimage1 4/s 5/s 69 KiB/s 130 KiB/s 1.62 ms 292.71 us 2024-03-26T17:05:58.305 INFO:tasks.workunit.client.3.smithi157.stdout:myimage41 4/s 4/s 86 KiB/s 99 KiB/s 1.97 ms 394.32 us 2024-03-26T17:05:58.305 INFO:tasks.workunit.client.3.smithi157.stdout:myimage59 4/s 5/s 120 KiB/s 117 KiB/s 2.06 ms 523.45 us 2024-03-26T17:05:58.306 INFO:tasks.workunit.client.3.smithi157.stdout:myimage32 4/s 6/s 69 KiB/s 142 KiB/s 2.03 ms 333.30 us 2024-03-26T17:05:58.306 INFO:tasks.workunit.client.3.smithi157.stdout:myimage28 4/s 6/s 90 KiB/s 151 KiB/s 2.38 ms 346.01 us 2024-03-26T17:05:58.306 INFO:tasks.workunit.client.3.smithi157.stdout:myimage42 4/s 5/s 107 KiB/s 125 KiB/s 1.94 ms 306.21 us 2024-03-26T17:05:58.306 INFO:tasks.workunit.client.3.smithi157.stdout:myimage38 3/s 5/s 99 KiB/s 99 KiB/s 1.71 ms 349.99 us 2024-03-26T17:05:58.306 INFO:tasks.workunit.client.3.smithi157.stdout:myimage47 3/s 5/s 86 KiB/s 119 KiB/s 2.03 ms 307.86 us 2024-03-26T17:05:58.306 INFO:tasks.workunit.client.3.smithi157.stdout:myimage21 3/s 4/s 83 KiB/s 100 KiB/s 2.48 ms 385.71 us 2024-03-26T17:05:58.306 INFO:tasks.workunit.client.3.smithi157.stdout:myimage46 3/s 5/s 66 KiB/s 114 KiB/s 1.84 ms 389.17 us 2024-03-26T17:05:58.306 INFO:tasks.workunit.client.3.smithi157.stdout:myimage4 3/s 6/s 65 KiB/s 138 KiB/s 2.18 ms 381.79 us 2024-03-26T17:05:58.306 INFO:tasks.workunit.client.3.smithi157.stdout:myimage9 3/s 6/s 60 KiB/s 146 KiB/s 2.10 ms 335.66 us 2024-03-26T17:05:58.306 INFO:tasks.workunit.client.3.smithi157.stdout:myimage39 3/s 5/s 71 KiB/s 148 KiB/s 1.82 ms 445.42 us 2024-03-26T17:05:58.306 INFO:tasks.workunit.client.3.smithi157.stdout:myimage50 2/s 7/s 59 KiB/s 142 KiB/s 2.24 ms 301.84 us 2024-03-26T17:05:58.306 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:05:58.307 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:05:57 smithi064 ceph-mon[34420]: pgmap v600: 33 pgs: 33 active+clean; 1.0 GiB data, 3.6 GiB used, 712 GiB / 715 GiB avail; 6.3 MiB/s rd, 6.7 MiB/s wr, 581 op/s 2024-03-26T17:05:58.646 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:05:58 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:05:58] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:05:58.646 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:05:58 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:05:58] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:05:58.647 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:05:58 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:05:59.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:05:58 smithi044 ceph-mon[30624]: Health check update: 3 slow ops, oldest one blocked for 453 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:05:59.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:05:58 smithi064 ceph-mon[34420]: Health check update: 3 slow ops, oldest one blocked for 453 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:05:59.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:05:58 smithi149 ceph-mon[34678]: Health check update: 3 slow ops, oldest one blocked for 453 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:06:00.166 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:05:59 smithi044 ceph-mon[30624]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:06:00.166 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:05:59 smithi044 ceph-mon[30624]: { 2024-03-26T17:06:00.166 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:05:59 smithi044 ceph-mon[30624]: "prefix": "rbd perf image stats", 2024-03-26T17:06:00.167 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:05:59 smithi044 ceph-mon[30624]: "pool_spec": "mypool", 2024-03-26T17:06:00.167 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:05:59 smithi044 ceph-mon[30624]: "sort_by": "write_ops", 2024-03-26T17:06:00.167 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:05:59 smithi044 ceph-mon[30624]: "format": "json" 2024-03-26T17:06:00.167 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:05:59 smithi044 ceph-mon[30624]: }"]: dispatch 2024-03-26T17:06:00.167 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:05:59 smithi044 ceph-mon[30624]: pgmap v601: 33 pgs: 33 active+clean; 1.0 GiB data, 3.6 GiB used, 712 GiB / 715 GiB avail; 6.6 MiB/s rd, 6.9 MiB/s wr, 626 op/s 2024-03-26T17:06:00.168 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:05:59 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:05:59] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:06:00.169 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:05:59 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:05:59] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:06:00.169 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:05:59 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:06:00.195 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:05:59 smithi149 ceph-mon[34678]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:06:00.195 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:05:59 smithi149 ceph-mon[34678]: { 2024-03-26T17:06:00.195 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:05:59 smithi149 ceph-mon[34678]: "prefix": "rbd perf image stats", 2024-03-26T17:06:00.196 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:05:59 smithi149 ceph-mon[34678]: "pool_spec": "mypool", 2024-03-26T17:06:00.196 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:05:59 smithi149 ceph-mon[34678]: "sort_by": "write_ops", 2024-03-26T17:06:00.196 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:05:59 smithi149 ceph-mon[34678]: "format": "json" 2024-03-26T17:06:00.196 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:05:59 smithi149 ceph-mon[34678]: }"]: dispatch 2024-03-26T17:06:00.196 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:05:59 smithi149 ceph-mon[34678]: pgmap v601: 33 pgs: 33 active+clean; 1.0 GiB data, 3.6 GiB used, 712 GiB / 715 GiB avail; 6.6 MiB/s rd, 6.9 MiB/s wr, 626 op/s 2024-03-26T17:06:00.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:05:59 smithi064 ceph-mon[34420]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:06:00.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:05:59 smithi064 ceph-mon[34420]: { 2024-03-26T17:06:00.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:05:59 smithi064 ceph-mon[34420]: "prefix": "rbd perf image stats", 2024-03-26T17:06:00.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:05:59 smithi064 ceph-mon[34420]: "pool_spec": "mypool", 2024-03-26T17:06:00.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:05:59 smithi064 ceph-mon[34420]: "sort_by": "write_ops", 2024-03-26T17:06:00.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:05:59 smithi064 ceph-mon[34420]: "format": "json" 2024-03-26T17:06:00.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:05:59 smithi064 ceph-mon[34420]: }"]: dispatch 2024-03-26T17:06:00.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:05:59 smithi064 ceph-mon[34420]: pgmap v601: 33 pgs: 33 active+clean; 1.0 GiB data, 3.6 GiB used, 712 GiB / 715 GiB avail; 6.6 MiB/s rd, 6.9 MiB/s wr, 626 op/s 2024-03-26T17:06:00.646 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:06:00 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:06:00] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:06:00.646 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:06:00 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:06:00] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:06:00.646 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:06:00 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:06:01.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:06:01 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 2024-03-26T17:06:01.226+0000 7fa707a55700 -1 mon.c@1(peon) e3 get_health_metrics reporting 3 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T17:06:02.207 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:06:01 smithi149 ceph-mon[34678]: pgmap v602: 33 pgs: 33 active+clean; 1.0 GiB data, 3.6 GiB used, 712 GiB / 715 GiB avail; 6.6 MiB/s rd, 6.8 MiB/s wr, 633 op/s 2024-03-26T17:06:02.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:06:01 smithi044 ceph-mon[30624]: pgmap v602: 33 pgs: 33 active+clean; 1.0 GiB data, 3.6 GiB used, 712 GiB / 715 GiB avail; 6.6 MiB/s rd, 6.8 MiB/s wr, 633 op/s 2024-03-26T17:06:02.265 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:06:01 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:06:01] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:06:02.265 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:06:01 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:06:01] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:06:02.266 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:06:01 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:06:02.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:06:01 smithi064 ceph-mon[34420]: pgmap v602: 33 pgs: 33 active+clean; 1.0 GiB data, 3.6 GiB used, 712 GiB / 715 GiB avail; 6.6 MiB/s rd, 6.8 MiB/s wr, 633 op/s 2024-03-26T17:06:02.646 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:06:02 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:06:02] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:06:02.647 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:06:02 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:06:02] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:06:02.647 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:06:02 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:06:03.062 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:06:03.076 INFO:tasks.workunit.client.3.smithi157.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2024-03-26T17:06:03.077 INFO:tasks.workunit.client.3.smithi157.stdout: 9.80 112.0k 92.0k 0.0k 1.1M 920.0k 0.0k nvme2n1 2024-03-26T17:06:03.077 INFO:tasks.workunit.client.3.smithi157.stdout: 9.80 92.0k 118.8k 0.0k 920.0k 1.2M 0.0k nvme2n10 2024-03-26T17:06:03.077 INFO:tasks.workunit.client.3.smithi157.stdout: 9.80 101.2k 110.0k 0.0k 1012.0k 1.1M 0.0k nvme2n11 2024-03-26T17:06:03.077 INFO:tasks.workunit.client.3.smithi157.stdout: 9.80 106.4k 97.2k 0.0k 1.0M 972.0k 0.0k nvme2n12 2024-03-26T17:06:03.077 INFO:tasks.workunit.client.3.smithi157.stdout: 9.80 100.8k 91.2k 0.0k 1008.0k 912.0k 0.0k nvme2n13 2024-03-26T17:06:03.077 INFO:tasks.workunit.client.3.smithi157.stdout: 9.80 126.8k 76.8k 0.0k 1.2M 768.0k 0.0k nvme2n14 2024-03-26T17:06:03.077 INFO:tasks.workunit.client.3.smithi157.stdout: 9.80 94.8k 102.4k 0.0k 948.0k 1.0M 0.0k nvme2n15 2024-03-26T17:06:03.078 INFO:tasks.workunit.client.3.smithi157.stdout: 9.80 102.4k 134.4k 0.0k 1.0M 1.3M 0.0k nvme2n16 2024-03-26T17:06:03.078 INFO:tasks.workunit.client.3.smithi157.stdout: 9.80 132.8k 95.6k 0.0k 1.3M 956.0k 0.0k nvme2n17 2024-03-26T17:06:03.078 INFO:tasks.workunit.client.3.smithi157.stdout: 9.80 105.2k 110.8k 0.0k 1.0M 1.1M 0.0k nvme2n18 2024-03-26T17:06:03.078 INFO:tasks.workunit.client.3.smithi157.stdout: 9.80 91.2k 111.2k 0.0k 912.0k 1.1M 0.0k nvme2n19 2024-03-26T17:06:03.078 INFO:tasks.workunit.client.3.smithi157.stdout: 9.80 131.6k 87.2k 0.0k 1.3M 872.0k 0.0k nvme2n2 2024-03-26T17:06:03.078 INFO:tasks.workunit.client.3.smithi157.stdout: 9.70 81.2k 112.0k 0.0k 812.0k 1.1M 0.0k nvme2n20 2024-03-26T17:06:03.078 INFO:tasks.workunit.client.3.smithi157.stdout: 9.80 98.0k 111.2k 0.0k 980.0k 1.1M 0.0k nvme2n3 2024-03-26T17:06:03.078 INFO:tasks.workunit.client.3.smithi157.stdout: 9.80 124.8k 85.6k 0.0k 1.2M 856.0k 0.0k nvme2n4 2024-03-26T17:06:03.079 INFO:tasks.workunit.client.3.smithi157.stdout: 9.80 110.8k 102.0k 0.0k 1.1M 1020.0k 0.0k nvme2n5 2024-03-26T17:06:03.079 INFO:tasks.workunit.client.3.smithi157.stdout: 9.80 117.6k 108.4k 0.0k 1.1M 1.1M 0.0k nvme2n6 2024-03-26T17:06:03.079 INFO:tasks.workunit.client.3.smithi157.stdout: 9.80 98.4k 108.0k 0.0k 984.0k 1.1M 0.0k nvme2n7 2024-03-26T17:06:03.079 INFO:tasks.workunit.client.3.smithi157.stdout: 9.80 85.2k 112.8k 0.0k 852.0k 1.1M 0.0k nvme2n8 2024-03-26T17:06:03.079 INFO:tasks.workunit.client.3.smithi157.stdout: 9.80 120.4k 86.8k 0.0k 1.2M 868.0k 0.0k nvme2n9 2024-03-26T17:06:03.079 INFO:tasks.workunit.client.3.smithi157.stdout: 9.80 102.0k 90.8k 0.0k 1020.0k 908.0k 0.0k nvme5n1 2024-03-26T17:06:03.079 INFO:tasks.workunit.client.3.smithi157.stdout: 9.80 82.4k 124.4k 0.0k 824.0k 1.2M 0.0k nvme5n10 2024-03-26T17:06:03.079 INFO:tasks.workunit.client.3.smithi157.stdout: 9.80 93.2k 104.0k 0.0k 932.0k 1.0M 0.0k nvme5n11 2024-03-26T17:06:03.079 INFO:tasks.workunit.client.3.smithi157.stdout: 9.80 94.8k 96.0k 0.0k 948.0k 960.0k 0.0k nvme5n12 2024-03-26T17:06:03.079 INFO:tasks.workunit.client.3.smithi157.stdout: 9.80 117.6k 84.0k 0.0k 1.1M 840.0k 0.0k nvme5n13 2024-03-26T17:06:03.079 INFO:tasks.workunit.client.3.smithi157.stdout: 9.80 108.4k 111.2k 0.0k 1.1M 1.1M 0.0k nvme5n14 2024-03-26T17:06:03.079 INFO:tasks.workunit.client.3.smithi157.stdout: 9.80 105.2k 158.4k 0.0k 1.0M 1.5M 0.0k nvme5n15 2024-03-26T17:06:03.079 INFO:tasks.workunit.client.3.smithi157.stdout: 9.80 103.6k 92.4k 0.0k 1.0M 924.0k 0.0k nvme5n16 2024-03-26T17:06:03.080 INFO:tasks.workunit.client.3.smithi157.stdout: 9.80 102.4k 83.6k 0.0k 1.0M 836.0k 0.0k nvme5n17 2024-03-26T17:06:03.080 INFO:tasks.workunit.client.3.smithi157.stdout: 9.80 110.8k 83.6k 0.0k 1.1M 836.0k 0.0k nvme5n18 2024-03-26T17:06:03.080 INFO:tasks.workunit.client.3.smithi157.stdout: 9.80 127.2k 97.6k 0.0k 1.2M 976.0k 0.0k nvme5n19 2024-03-26T17:06:03.080 INFO:tasks.workunit.client.3.smithi157.stdout: 9.80 126.4k 87.6k 0.0k 1.2M 876.0k 0.0k nvme5n2 2024-03-26T17:06:03.080 INFO:tasks.workunit.client.3.smithi157.stdout: 9.80 98.0k 99.2k 0.0k 980.0k 992.0k 0.0k nvme5n20 2024-03-26T17:06:03.080 INFO:tasks.workunit.client.3.smithi157.stdout: 9.80 100.4k 120.8k 0.0k 1004.0k 1.2M 0.0k nvme5n3 2024-03-26T17:06:03.080 INFO:tasks.workunit.client.3.smithi157.stdout: 9.80 83.2k 115.6k 0.0k 832.0k 1.1M 0.0k nvme5n4 2024-03-26T17:06:03.080 INFO:tasks.workunit.client.3.smithi157.stdout: 9.80 102.0k 78.0k 0.0k 1020.0k 780.0k 0.0k nvme5n5 2024-03-26T17:06:03.080 INFO:tasks.workunit.client.3.smithi157.stdout: 9.80 96.0k 113.6k 0.0k 960.0k 1.1M 0.0k nvme5n6 2024-03-26T17:06:03.080 INFO:tasks.workunit.client.3.smithi157.stdout: 9.80 82.0k 92.0k 0.0k 820.0k 920.0k 0.0k nvme5n7 2024-03-26T17:06:03.080 INFO:tasks.workunit.client.3.smithi157.stdout: 9.80 96.8k 115.6k 0.0k 968.0k 1.1M 0.0k nvme5n8 2024-03-26T17:06:03.080 INFO:tasks.workunit.client.3.smithi157.stdout: 9.80 88.8k 100.4k 0.0k 888.0k 1004.0k 0.0k nvme5n9 2024-03-26T17:06:03.080 INFO:tasks.workunit.client.3.smithi157.stdout: 9.80 84.4k 134.8k 0.0k 844.0k 1.3M 0.0k nvme8n1 2024-03-26T17:06:03.080 INFO:tasks.workunit.client.3.smithi157.stdout: 9.80 112.0k 73.2k 0.0k 1.1M 732.0k 0.0k nvme8n10 2024-03-26T17:06:03.081 INFO:tasks.workunit.client.3.smithi157.stdout: 9.80 110.8k 96.0k 0.0k 1.1M 960.0k 0.0k nvme8n11 2024-03-26T17:06:03.081 INFO:tasks.workunit.client.3.smithi157.stdout: 9.80 102.0k 105.2k 0.0k 1020.0k 1.0M 0.0k nvme8n12 2024-03-26T17:06:03.081 INFO:tasks.workunit.client.3.smithi157.stdout: 9.80 101.2k 92.4k 0.0k 1012.0k 924.0k 0.0k nvme8n13 2024-03-26T17:06:03.081 INFO:tasks.workunit.client.3.smithi157.stdout: 9.80 83.6k 127.6k 0.0k 836.0k 1.2M 0.0k nvme8n14 2024-03-26T17:06:03.081 INFO:tasks.workunit.client.3.smithi157.stdout: 9.80 86.0k 130.0k 0.0k 860.0k 1.3M 0.0k nvme8n15 2024-03-26T17:06:03.081 INFO:tasks.workunit.client.3.smithi157.stdout: 9.80 96.8k 114.8k 0.0k 968.0k 1.1M 0.0k nvme8n16 2024-03-26T17:06:03.081 INFO:tasks.workunit.client.3.smithi157.stdout: 9.80 102.0k 136.0k 0.0k 1020.0k 1.3M 0.0k nvme8n17 2024-03-26T17:06:03.081 INFO:tasks.workunit.client.3.smithi157.stdout: 9.80 85.2k 124.8k 0.0k 852.0k 1.2M 0.0k nvme8n18 2024-03-26T17:06:03.081 INFO:tasks.workunit.client.3.smithi157.stdout: 9.80 95.6k 104.4k 0.0k 956.0k 1.0M 0.0k nvme8n19 2024-03-26T17:06:03.081 INFO:tasks.workunit.client.3.smithi157.stdout: 9.80 95.6k 132.4k 0.0k 956.0k 1.3M 0.0k nvme8n2 2024-03-26T17:06:03.081 INFO:tasks.workunit.client.3.smithi157.stdout: 9.80 84.8k 107.2k 0.0k 848.0k 1.0M 0.0k nvme8n20 2024-03-26T17:06:03.081 INFO:tasks.workunit.client.3.smithi157.stdout: 9.80 86.8k 114.4k 0.0k 868.0k 1.1M 0.0k nvme8n3 2024-03-26T17:06:03.081 INFO:tasks.workunit.client.3.smithi157.stdout: 9.80 98.4k 101.6k 0.0k 984.0k 1016.0k 0.0k nvme8n4 2024-03-26T17:06:03.081 INFO:tasks.workunit.client.3.smithi157.stdout: 9.80 122.8k 76.8k 0.0k 1.2M 768.0k 0.0k nvme8n5 2024-03-26T17:06:03.081 INFO:tasks.workunit.client.3.smithi157.stdout: 9.80 131.6k 83.2k 0.0k 1.3M 832.0k 0.0k nvme8n6 2024-03-26T17:06:03.082 INFO:tasks.workunit.client.3.smithi157.stdout: 9.80 100.8k 111.6k 0.0k 1008.0k 1.1M 0.0k nvme8n7 2024-03-26T17:06:03.082 INFO:tasks.workunit.client.3.smithi157.stdout: 9.80 86.0k 98.4k 0.0k 860.0k 984.0k 0.0k nvme8n8 2024-03-26T17:06:03.082 INFO:tasks.workunit.client.3.smithi157.stdout: 9.80 94.0k 108.0k 0.0k 940.0k 1.1M 0.0k nvme8n9 2024-03-26T17:06:03.082 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:06:03.306 INFO:tasks.workunit.client.3.smithi157.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-26T17:06:03.306 INFO:tasks.workunit.client.3.smithi157.stdout:myimage41 6/s 4/s 157 KiB/s 93 KiB/s 2.02 ms 317.26 us 2024-03-26T17:06:03.306 INFO:tasks.workunit.client.3.smithi157.stdout:myimage56 6/s 4/s 133 KiB/s 74 KiB/s 2.37 ms 323.30 us 2024-03-26T17:06:03.306 INFO:tasks.workunit.client.3.smithi157.stdout:myimage57 6/s 4/s 187 KiB/s 84 KiB/s 1.92 ms 292.25 us 2024-03-26T17:06:03.306 INFO:tasks.workunit.client.3.smithi157.stdout:myimage30 6/s 2/s 154 KiB/s 58 KiB/s 2.36 ms 304.81 us 2024-03-26T17:06:03.307 INFO:tasks.workunit.client.3.smithi157.stdout:myimage42 6/s 4/s 161 KiB/s 85 KiB/s 1.76 ms 404.05 us 2024-03-26T17:06:03.307 INFO:tasks.workunit.client.3.smithi157.stdout:myimage23 5/s 3/s 123 KiB/s 110 KiB/s 1.80 ms 408.69 us 2024-03-26T17:06:03.307 INFO:tasks.workunit.client.3.smithi157.stdout:myimage58 5/s 5/s 161 KiB/s 91 KiB/s 1.83 ms 360.52 us 2024-03-26T17:06:03.307 INFO:tasks.workunit.client.3.smithi157.stdout:myimage8 5/s 3/s 116 KiB/s 73 KiB/s 1.92 ms 281.40 us 2024-03-26T17:06:03.307 INFO:tasks.workunit.client.3.smithi157.stdout:myimage20 5/s 3/s 122 KiB/s 66 KiB/s 1.95 ms 350.14 us 2024-03-26T17:06:03.307 INFO:tasks.workunit.client.3.smithi157.stdout:myimage28 5/s 4/s 118 KiB/s 92 KiB/s 2.47 ms 311.01 us 2024-03-26T17:06:03.307 INFO:tasks.workunit.client.3.smithi157.stdout:myimage55 5/s 4/s 139 KiB/s 90 KiB/s 2.05 ms 335.92 us 2024-03-26T17:06:03.307 INFO:tasks.workunit.client.3.smithi157.stdout:myimage10 5/s 4/s 126 KiB/s 110 KiB/s 1.93 ms 493.86 us 2024-03-26T17:06:03.307 INFO:tasks.workunit.client.3.smithi157.stdout:myimage31 5/s 4/s 112 KiB/s 99 KiB/s 2.11 ms 387.41 us 2024-03-26T17:06:03.307 INFO:tasks.workunit.client.3.smithi157.stdout:myimage40 5/s 4/s 90 KiB/s 119 KiB/s 1.88 ms 399.17 us 2024-03-26T17:06:03.307 INFO:tasks.workunit.client.3.smithi157.stdout:myimage47 5/s 5/s 117 KiB/s 104 KiB/s 1.97 ms 327.11 us 2024-03-26T17:06:03.307 INFO:tasks.workunit.client.3.smithi157.stdout:myimage54 5/s 5/s 121 KiB/s 105 KiB/s 1.84 ms 404.69 us 2024-03-26T17:06:03.307 INFO:tasks.workunit.client.3.smithi157.stdout:myimage44 5/s 4/s 113 KiB/s 68 KiB/s 2.00 ms 321.84 us 2024-03-26T17:06:03.307 INFO:tasks.workunit.client.3.smithi157.stdout:myimage48 5/s 4/s 94 KiB/s 73 KiB/s 1.92 ms 316.29 us 2024-03-26T17:06:03.308 INFO:tasks.workunit.client.3.smithi157.stdout:myimage49 5/s 4/s 94 KiB/s 84 KiB/s 1.91 ms 318.44 us 2024-03-26T17:06:03.308 INFO:tasks.workunit.client.3.smithi157.stdout:myimage9 5/s 5/s 91 KiB/s 106 KiB/s 2.08 ms 329.27 us 2024-03-26T17:06:03.308 INFO:tasks.workunit.client.3.smithi157.stdout:myimage60 5/s 5/s 102 KiB/s 95 KiB/s 2.07 ms 309.39 us 2024-03-26T17:06:03.308 INFO:tasks.workunit.client.3.smithi157.stdout:myimage32 5/s 4/s 115 KiB/s 79 KiB/s 2.02 ms 384.05 us 2024-03-26T17:06:03.308 INFO:tasks.workunit.client.3.smithi157.stdout:myimage35 5/s 5/s 138 KiB/s 146 KiB/s 2.06 ms 336.50 us 2024-03-26T17:06:03.308 INFO:tasks.workunit.client.3.smithi157.stdout:myimage24 5/s 4/s 117 KiB/s 104 KiB/s 1.85 ms 562.85 us 2024-03-26T17:06:03.308 INFO:tasks.workunit.client.3.smithi157.stdout:myimage29 5/s 4/s 84 KiB/s 89 KiB/s 1.78 ms 422.78 us 2024-03-26T17:06:03.308 INFO:tasks.workunit.client.3.smithi157.stdout:myimage33 5/s 5/s 107 KiB/s 100 KiB/s 1.97 ms 310.79 us 2024-03-26T17:06:03.308 INFO:tasks.workunit.client.3.smithi157.stdout:myimage43 5/s 4/s 117 KiB/s 72 KiB/s 2.07 ms 480.11 us 2024-03-26T17:06:03.308 INFO:tasks.workunit.client.3.smithi157.stdout:myimage53 5/s 5/s 90 KiB/s 123 KiB/s 1.95 ms 349.72 us 2024-03-26T17:06:03.308 INFO:tasks.workunit.client.3.smithi157.stdout:myimage13 4/s 6/s 127 KiB/s 121 KiB/s 1.71 ms 351.93 us 2024-03-26T17:06:03.308 INFO:tasks.workunit.client.3.smithi157.stdout:myimage16 4/s 4/s 114 KiB/s 98 KiB/s 1.84 ms 332.38 us 2024-03-26T17:06:03.308 INFO:tasks.workunit.client.3.smithi157.stdout:myimage1 4/s 5/s 100 KiB/s 87 KiB/s 1.69 ms 344.01 us 2024-03-26T17:06:03.308 INFO:tasks.workunit.client.3.smithi157.stdout:myimage7 4/s 5/s 106 KiB/s 112 KiB/s 2.07 ms 437.71 us 2024-03-26T17:06:03.309 INFO:tasks.workunit.client.3.smithi157.stdout:myimage17 4/s 4/s 101 KiB/s 98 KiB/s 1.79 ms 396.27 us 2024-03-26T17:06:03.309 INFO:tasks.workunit.client.3.smithi157.stdout:myimage39 4/s 5/s 113 KiB/s 126 KiB/s 1.91 ms 326.82 us 2024-03-26T17:06:03.309 INFO:tasks.workunit.client.3.smithi157.stdout:myimage37 4/s 5/s 90 KiB/s 122 KiB/s 2.09 ms 349.52 us 2024-03-26T17:06:03.309 INFO:tasks.workunit.client.3.smithi157.stdout:myimage38 4/s 6/s 70 KiB/s 106 KiB/s 1.60 ms 366.99 us 2024-03-26T17:06:03.309 INFO:tasks.workunit.client.3.smithi157.stdout:myimage11 4/s 3/s 83 KiB/s 78 KiB/s 1.91 ms 341.59 us 2024-03-26T17:06:03.309 INFO:tasks.workunit.client.3.smithi157.stdout:myimage15 4/s 4/s 92 KiB/s 76 KiB/s 1.86 ms 375.48 us 2024-03-26T17:06:03.309 INFO:tasks.workunit.client.3.smithi157.stdout:myimage18 4/s 5/s 90 KiB/s 124 KiB/s 1.87 ms 305.03 us 2024-03-26T17:06:03.309 INFO:tasks.workunit.client.3.smithi157.stdout:myimage21 4/s 6/s 86 KiB/s 118 KiB/s 2.48 ms 371.14 us 2024-03-26T17:06:03.309 INFO:tasks.workunit.client.3.smithi157.stdout:myimage25 4/s 5/s 83 KiB/s 107 KiB/s 2.27 ms 324.77 us 2024-03-26T17:06:03.309 INFO:tasks.workunit.client.3.smithi157.stdout:myimage45 4/s 5/s 84 KiB/s 121 KiB/s 1.93 ms 336.26 us 2024-03-26T17:06:03.309 INFO:tasks.workunit.client.3.smithi157.stdout:myimage3 4/s 6/s 98 KiB/s 122 KiB/s 1.83 ms 375.44 us 2024-03-26T17:06:03.309 INFO:tasks.workunit.client.3.smithi157.stdout:myimage14 4/s 4/s 90 KiB/s 82 KiB/s 2.13 ms 382.73 us 2024-03-26T17:06:03.309 INFO:tasks.workunit.client.3.smithi157.stdout:myimage52 4/s 6/s 101 KiB/s 120 KiB/s 2.20 ms 334.72 us 2024-03-26T17:06:03.309 INFO:tasks.workunit.client.3.smithi157.stdout:myimage4 4/s 5/s 78 KiB/s 134 KiB/s 1.87 ms 318.40 us 2024-03-26T17:06:03.309 INFO:tasks.workunit.client.3.smithi157.stdout:myimage5 4/s 5/s 86 KiB/s 119 KiB/s 1.81 ms 348.29 us 2024-03-26T17:06:03.310 INFO:tasks.workunit.client.3.smithi157.stdout:myimage19 4/s 5/s 81 KiB/s 97 KiB/s 1.91 ms 375.51 us 2024-03-26T17:06:03.310 INFO:tasks.workunit.client.3.smithi157.stdout:myimage26 4/s 5/s 97 KiB/s 120 KiB/s 1.88 ms 387.97 us 2024-03-26T17:06:03.310 INFO:tasks.workunit.client.3.smithi157.stdout:myimage50 4/s 6/s 76 KiB/s 130 KiB/s 2.13 ms 308.02 us 2024-03-26T17:06:03.310 INFO:tasks.workunit.client.3.smithi157.stdout:myimage51 4/s 4/s 100 KiB/s 113 KiB/s 2.33 ms 311.17 us 2024-03-26T17:06:03.310 INFO:tasks.workunit.client.3.smithi157.stdout:myimage34 4/s 4/s 110 KiB/s 98 KiB/s 1.78 ms 325.26 us 2024-03-26T17:06:03.310 INFO:tasks.workunit.client.3.smithi157.stdout:myimage6 4/s 4/s 101 KiB/s 113 KiB/s 2.21 ms 326.73 us 2024-03-26T17:06:03.310 INFO:tasks.workunit.client.3.smithi157.stdout:myimage59 4/s 5/s 81 KiB/s 106 KiB/s 2.07 ms 319.48 us 2024-03-26T17:06:03.310 INFO:tasks.workunit.client.3.smithi157.stdout:myimage2 4/s 5/s 90 KiB/s 125 KiB/s 2.08 ms 293.78 us 2024-03-26T17:06:03.310 INFO:tasks.workunit.client.3.smithi157.stdout:myimage12 4/s 6/s 74 KiB/s 117 KiB/s 1.82 ms 333.35 us 2024-03-26T17:06:03.310 INFO:tasks.workunit.client.3.smithi157.stdout:myimage46 4/s 5/s 98 KiB/s 114 KiB/s 2.00 ms 432.08 us 2024-03-26T17:06:03.310 INFO:tasks.workunit.client.3.smithi157.stdout:myimage36 3/s 5/s 90 KiB/s 120 KiB/s 1.88 ms 327.76 us 2024-03-26T17:06:03.310 INFO:tasks.workunit.client.3.smithi157.stdout:myimage22 3/s 5/s 73 KiB/s 124 KiB/s 2.06 ms 307.11 us 2024-03-26T17:06:03.310 INFO:tasks.workunit.client.3.smithi157.stdout:myimage27 3/s 5/s 57 KiB/s 74 KiB/s 1.83 ms 317.29 us 2024-03-26T17:06:03.310 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:06:04.219 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:06:03 smithi149 ceph-mon[34678]: pgmap v603: 33 pgs: 33 active+clean; 1.0 GiB data, 3.6 GiB used, 712 GiB / 715 GiB avail; 5.9 MiB/s rd, 5.9 MiB/s wr, 569 op/s 2024-03-26T17:06:04.219 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:06:03 smithi149 ceph-mon[34678]: Health check update: 3 slow ops, oldest one blocked for 458 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:06:04.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:06:03 smithi044 ceph-mon[30624]: pgmap v603: 33 pgs: 33 active+clean; 1.0 GiB data, 3.6 GiB used, 712 GiB / 715 GiB avail; 5.9 MiB/s rd, 5.9 MiB/s wr, 569 op/s 2024-03-26T17:06:04.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:06:03 smithi044 ceph-mon[30624]: Health check update: 3 slow ops, oldest one blocked for 458 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:06:04.266 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:06:03 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:06:03] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:06:04.266 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:06:03 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:06:03] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:06:04.266 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:06:03 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:06:04.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:06:03 smithi064 ceph-mon[34420]: pgmap v603: 33 pgs: 33 active+clean; 1.0 GiB data, 3.6 GiB used, 712 GiB / 715 GiB avail; 5.9 MiB/s rd, 5.9 MiB/s wr, 569 op/s 2024-03-26T17:06:04.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:06:03 smithi064 ceph-mon[34420]: Health check update: 3 slow ops, oldest one blocked for 458 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:06:04.646 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:06:04 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:06:04] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:06:04.647 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:06:04 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:06:04] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:06:04.647 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:06:04 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:06:05.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:06:04 smithi044 ceph-mon[30624]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:06:05.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:06:04 smithi044 ceph-mon[30624]: { 2024-03-26T17:06:05.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:06:04 smithi044 ceph-mon[30624]: "prefix": "rbd perf image stats", 2024-03-26T17:06:05.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:06:04 smithi044 ceph-mon[30624]: "pool_spec": "mypool", 2024-03-26T17:06:05.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:06:04 smithi044 ceph-mon[30624]: "sort_by": "write_ops", 2024-03-26T17:06:05.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:06:04 smithi044 ceph-mon[30624]: "format": "json" 2024-03-26T17:06:05.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:06:04 smithi044 ceph-mon[30624]: }"]: dispatch 2024-03-26T17:06:05.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:06:04 smithi064 ceph-mon[34420]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:06:05.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:06:04 smithi064 ceph-mon[34420]: { 2024-03-26T17:06:05.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:06:04 smithi064 ceph-mon[34420]: "prefix": "rbd perf image stats", 2024-03-26T17:06:05.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:06:04 smithi064 ceph-mon[34420]: "pool_spec": "mypool", 2024-03-26T17:06:05.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:06:04 smithi064 ceph-mon[34420]: "sort_by": "write_ops", 2024-03-26T17:06:05.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:06:04 smithi064 ceph-mon[34420]: "format": "json" 2024-03-26T17:06:05.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:06:04 smithi064 ceph-mon[34420]: }"]: dispatch 2024-03-26T17:06:05.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:06:04 smithi149 ceph-mon[34678]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:06:05.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:06:04 smithi149 ceph-mon[34678]: { 2024-03-26T17:06:05.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:06:04 smithi149 ceph-mon[34678]: "prefix": "rbd perf image stats", 2024-03-26T17:06:05.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:06:04 smithi149 ceph-mon[34678]: "pool_spec": "mypool", 2024-03-26T17:06:05.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:06:04 smithi149 ceph-mon[34678]: "sort_by": "write_ops", 2024-03-26T17:06:05.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:06:04 smithi149 ceph-mon[34678]: "format": "json" 2024-03-26T17:06:05.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:06:04 smithi149 ceph-mon[34678]: }"]: dispatch 2024-03-26T17:06:06.227 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:06:05 smithi149 ceph-mon[34678]: pgmap v604: 33 pgs: 33 active+clean; 1.0 GiB data, 3.6 GiB used, 712 GiB / 715 GiB avail; 6.1 MiB/s rd, 6.3 MiB/s wr, 609 op/s 2024-03-26T17:06:06.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:06:05 smithi044 ceph-mon[30624]: pgmap v604: 33 pgs: 33 active+clean; 1.0 GiB data, 3.6 GiB used, 712 GiB / 715 GiB avail; 6.1 MiB/s rd, 6.3 MiB/s wr, 609 op/s 2024-03-26T17:06:06.265 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:06:05 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:06:05] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:06:06.266 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:06:05 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:06:05] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:06:06.266 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:06:05 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:06:06.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:06:05 smithi064 ceph-mon[34420]: pgmap v604: 33 pgs: 33 active+clean; 1.0 GiB data, 3.6 GiB used, 712 GiB / 715 GiB avail; 6.1 MiB/s rd, 6.3 MiB/s wr, 609 op/s 2024-03-26T17:06:06.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:06:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 2024-03-26T17:06:06.226+0000 7fa707a55700 -1 mon.c@1(peon) e3 get_health_metrics reporting 3 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T17:06:06.646 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:06:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:06:06] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:06:06.646 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:06:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:06:06] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:06:06.647 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:06:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:06:08.244 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:06:07 smithi149 ceph-mon[34678]: pgmap v605: 33 pgs: 33 active+clean; 1.0 GiB data, 3.6 GiB used, 712 GiB / 715 GiB avail; 5.8 MiB/s rd, 6.0 MiB/s wr, 590 op/s 2024-03-26T17:06:08.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:06:07 smithi044 ceph-mon[30624]: pgmap v605: 33 pgs: 33 active+clean; 1.0 GiB data, 3.6 GiB used, 712 GiB / 715 GiB avail; 5.8 MiB/s rd, 6.0 MiB/s wr, 590 op/s 2024-03-26T17:06:08.265 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:06:07 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:06:07] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:06:08.265 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:06:07 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:06:07] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:06:08.265 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:06:07 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:06:08.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:06:07 smithi064 ceph-mon[34420]: pgmap v605: 33 pgs: 33 active+clean; 1.0 GiB data, 3.6 GiB used, 712 GiB / 715 GiB avail; 5.8 MiB/s rd, 6.0 MiB/s wr, 590 op/s 2024-03-26T17:06:08.310 INFO:tasks.workunit.client.3.smithi157.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-26T17:06:08.310 INFO:tasks.workunit.client.3.smithi157.stdout:myimage51 7/s 4/s 139 KiB/s 95 KiB/s 2.00 ms 312.88 us 2024-03-26T17:06:08.310 INFO:tasks.workunit.client.3.smithi157.stdout:myimage18 6/s 4/s 125 KiB/s 114 KiB/s 1.82 ms 303.96 us 2024-03-26T17:06:08.310 INFO:tasks.workunit.client.3.smithi157.stdout:myimage24 6/s 3/s 127 KiB/s 71 KiB/s 2.02 ms 378.99 us 2024-03-26T17:06:08.310 INFO:tasks.workunit.client.3.smithi157.stdout:myimage27 6/s 4/s 122 KiB/s 82 KiB/s 1.79 ms 304.11 us 2024-03-26T17:06:08.310 INFO:tasks.workunit.client.3.smithi157.stdout:myimage60 6/s 2/s 131 KiB/s 48 KiB/s 2.02 ms 304.89 us 2024-03-26T17:06:08.310 INFO:tasks.workunit.client.3.smithi157.stdout:myimage21 6/s 3/s 142 KiB/s 71 KiB/s 2.51 ms 333.87 us 2024-03-26T17:06:08.311 INFO:tasks.workunit.client.3.smithi157.stdout:myimage59 6/s 3/s 124 KiB/s 81 KiB/s 2.21 ms 351.94 us 2024-03-26T17:06:08.311 INFO:tasks.workunit.client.3.smithi157.stdout:myimage35 6/s 3/s 138 KiB/s 82 KiB/s 1.90 ms 327.65 us 2024-03-26T17:06:08.311 INFO:tasks.workunit.client.3.smithi157.stdout:myimage11 6/s 4/s 150 KiB/s 83 KiB/s 2.08 ms 342.67 us 2024-03-26T17:06:08.311 INFO:tasks.workunit.client.3.smithi157.stdout:myimage19 6/s 4/s 120 KiB/s 78 KiB/s 2.06 ms 329.75 us 2024-03-26T17:06:08.311 INFO:tasks.workunit.client.3.smithi157.stdout:myimage30 5/s 4/s 110 KiB/s 106 KiB/s 2.30 ms 379.92 us 2024-03-26T17:06:08.311 INFO:tasks.workunit.client.3.smithi157.stdout:myimage48 5/s 3/s 88 KiB/s 62 KiB/s 2.10 ms 297.18 us 2024-03-26T17:06:08.311 INFO:tasks.workunit.client.3.smithi157.stdout:myimage49 5/s 4/s 119 KiB/s 100 KiB/s 2.03 ms 339.73 us 2024-03-26T17:06:08.311 INFO:tasks.workunit.client.3.smithi157.stdout:myimage38 5/s 4/s 122 KiB/s 105 KiB/s 1.75 ms 307.92 us 2024-03-26T17:06:08.311 INFO:tasks.workunit.client.3.smithi157.stdout:myimage36 5/s 4/s 93 KiB/s 90 KiB/s 1.86 ms 322.57 us 2024-03-26T17:06:08.311 INFO:tasks.workunit.client.3.smithi157.stdout:myimage56 5/s 4/s 117 KiB/s 97 KiB/s 2.45 ms 397.01 us 2024-03-26T17:06:08.311 INFO:tasks.workunit.client.3.smithi157.stdout:myimage2 5/s 4/s 122 KiB/s 86 KiB/s 2.03 ms 334.39 us 2024-03-26T17:06:08.311 INFO:tasks.workunit.client.3.smithi157.stdout:myimage4 5/s 4/s 99 KiB/s 98 KiB/s 1.88 ms 287.37 us 2024-03-26T17:06:08.311 INFO:tasks.workunit.client.3.smithi157.stdout:myimage29 5/s 5/s 95 KiB/s 101 KiB/s 1.80 ms 376.00 us 2024-03-26T17:06:08.311 INFO:tasks.workunit.client.3.smithi157.stdout:myimage52 5/s 4/s 106 KiB/s 97 KiB/s 2.19 ms 314.48 us 2024-03-26T17:06:08.312 INFO:tasks.workunit.client.3.smithi157.stdout:myimage28 5/s 4/s 112 KiB/s 103 KiB/s 2.59 ms 354.40 us 2024-03-26T17:06:08.312 INFO:tasks.workunit.client.3.smithi157.stdout:myimage42 5/s 4/s 89 KiB/s 96 KiB/s 1.98 ms 310.25 us 2024-03-26T17:06:08.312 INFO:tasks.workunit.client.3.smithi157.stdout:myimage43 5/s 5/s 110 KiB/s 109 KiB/s 2.25 ms 433.66 us 2024-03-26T17:06:08.312 INFO:tasks.workunit.client.3.smithi157.stdout:myimage53 5/s 4/s 110 KiB/s 75 KiB/s 1.94 ms 310.02 us 2024-03-26T17:06:08.312 INFO:tasks.workunit.client.3.smithi157.stdout:myimage55 5/s 4/s 83 KiB/s 75 KiB/s 2.00 ms 407.10 us 2024-03-26T17:06:08.312 INFO:tasks.workunit.client.3.smithi157.stdout:myimage16 5/s 4/s 90 KiB/s 98 KiB/s 2.01 ms 315.74 us 2024-03-26T17:06:08.312 INFO:tasks.workunit.client.3.smithi157.stdout:myimage22 5/s 4/s 98 KiB/s 76 KiB/s 1.97 ms 296.87 us 2024-03-26T17:06:08.312 INFO:tasks.workunit.client.3.smithi157.stdout:myimage32 5/s 5/s 95 KiB/s 94 KiB/s 1.99 ms 298.29 us 2024-03-26T17:06:08.312 INFO:tasks.workunit.client.3.smithi157.stdout:myimage9 5/s 4/s 125 KiB/s 106 KiB/s 2.20 ms 339.98 us 2024-03-26T17:06:08.312 INFO:tasks.workunit.client.3.smithi157.stdout:myimage25 5/s 5/s 94 KiB/s 99 KiB/s 2.41 ms 365.64 us 2024-03-26T17:06:08.312 INFO:tasks.workunit.client.3.smithi157.stdout:myimage33 5/s 5/s 96 KiB/s 116 KiB/s 1.87 ms 352.75 us 2024-03-26T17:06:08.312 INFO:tasks.workunit.client.3.smithi157.stdout:myimage54 5/s 5/s 117 KiB/s 99 KiB/s 1.86 ms 324.67 us 2024-03-26T17:06:08.312 INFO:tasks.workunit.client.3.smithi157.stdout:myimage3 4/s 5/s 99 KiB/s 92 KiB/s 1.70 ms 300.21 us 2024-03-26T17:06:08.312 INFO:tasks.workunit.client.3.smithi157.stdout:myimage26 4/s 5/s 83 KiB/s 104 KiB/s 2.09 ms 344.15 us 2024-03-26T17:06:08.313 INFO:tasks.workunit.client.3.smithi157.stdout:myimage34 4/s 5/s 86 KiB/s 118 KiB/s 1.84 ms 311.47 us 2024-03-26T17:06:08.313 INFO:tasks.workunit.client.3.smithi157.stdout:myimage40 4/s 5/s 98 KiB/s 121 KiB/s 1.86 ms 306.99 us 2024-03-26T17:06:08.313 INFO:tasks.workunit.client.3.smithi157.stdout:myimage1 4/s 5/s 79 KiB/s 116 KiB/s 1.68 ms 302.25 us 2024-03-26T17:06:08.313 INFO:tasks.workunit.client.3.smithi157.stdout:myimage6 4/s 6/s 73 KiB/s 129 KiB/s 2.06 ms 376.27 us 2024-03-26T17:06:08.313 INFO:tasks.workunit.client.3.smithi157.stdout:myimage8 4/s 4/s 82 KiB/s 79 KiB/s 2.15 ms 279.44 us 2024-03-26T17:06:08.313 INFO:tasks.workunit.client.3.smithi157.stdout:myimage15 4/s 6/s 87 KiB/s 137 KiB/s 1.83 ms 323.16 us 2024-03-26T17:06:08.313 INFO:tasks.workunit.client.3.smithi157.stdout:myimage46 4/s 6/s 85 KiB/s 145 KiB/s 1.97 ms 311.21 us 2024-03-26T17:06:08.313 INFO:tasks.workunit.client.3.smithi157.stdout:myimage50 4/s 5/s 108 KiB/s 91 KiB/s 2.01 ms 319.66 us 2024-03-26T17:06:08.313 INFO:tasks.workunit.client.3.smithi157.stdout:myimage39 4/s 5/s 94 KiB/s 147 KiB/s 1.92 ms 344.73 us 2024-03-26T17:06:08.313 INFO:tasks.workunit.client.3.smithi157.stdout:myimage31 4/s 5/s 60 KiB/s 122 KiB/s 2.16 ms 331.23 us 2024-03-26T17:06:08.313 INFO:tasks.workunit.client.3.smithi157.stdout:myimage37 4/s 6/s 72 KiB/s 93 KiB/s 2.25 ms 299.10 us 2024-03-26T17:06:08.313 INFO:tasks.workunit.client.3.smithi157.stdout:myimage58 4/s 6/s 77 KiB/s 124 KiB/s 1.91 ms 311.33 us 2024-03-26T17:06:08.313 INFO:tasks.workunit.client.3.smithi157.stdout:myimage5 4/s 4/s 98 KiB/s 96 KiB/s 1.93 ms 316.05 us 2024-03-26T17:06:08.313 INFO:tasks.workunit.client.3.smithi157.stdout:myimage7 4/s 5/s 106 KiB/s 98 KiB/s 1.85 ms 377.71 us 2024-03-26T17:06:08.314 INFO:tasks.workunit.client.3.smithi157.stdout:myimage20 4/s 5/s 68 KiB/s 102 KiB/s 1.90 ms 316.45 us 2024-03-26T17:06:08.314 INFO:tasks.workunit.client.3.smithi157.stdout:myimage41 4/s 3/s 106 KiB/s 68 KiB/s 2.20 ms 326.35 us 2024-03-26T17:06:08.314 INFO:tasks.workunit.client.3.smithi157.stdout:myimage23 4/s 6/s 117 KiB/s 146 KiB/s 1.93 ms 293.82 us 2024-03-26T17:06:08.314 INFO:tasks.workunit.client.3.smithi157.stdout:myimage47 4/s 6/s 74 KiB/s 141 KiB/s 2.28 ms 361.86 us 2024-03-26T17:06:08.314 INFO:tasks.workunit.client.3.smithi157.stdout:myimage12 4/s 5/s 98 KiB/s 113 KiB/s 1.92 ms 358.62 us 2024-03-26T17:06:08.314 INFO:tasks.workunit.client.3.smithi157.stdout:myimage57 4/s 4/s 74 KiB/s 107 KiB/s 2.10 ms 315.60 us 2024-03-26T17:06:08.314 INFO:tasks.workunit.client.3.smithi157.stdout:myimage10 4/s 5/s 73 KiB/s 86 KiB/s 1.92 ms 370.58 us 2024-03-26T17:06:08.314 INFO:tasks.workunit.client.3.smithi157.stdout:myimage13 3/s 5/s 57 KiB/s 115 KiB/s 1.83 ms 390.36 us 2024-03-26T17:06:08.314 INFO:tasks.workunit.client.3.smithi157.stdout:myimage14 3/s 4/s 72 KiB/s 139 KiB/s 2.14 ms 365.56 us 2024-03-26T17:06:08.315 INFO:tasks.workunit.client.3.smithi157.stdout:myimage44 3/s 5/s 74 KiB/s 104 KiB/s 2.05 ms 334.93 us 2024-03-26T17:06:08.315 INFO:tasks.workunit.client.3.smithi157.stdout:myimage17 3/s 6/s 98 KiB/s 169 KiB/s 2.00 ms 416.87 us 2024-03-26T17:06:08.315 INFO:tasks.workunit.client.3.smithi157.stdout:myimage45 3/s 6/s 85 KiB/s 129 KiB/s 1.93 ms 366.64 us 2024-03-26T17:06:08.315 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:06:08.649 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:06:08 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:06:08] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:06:08.650 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:06:08 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:06:08] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:06:08.650 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:06:08 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:06:09.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:06:08 smithi044 ceph-mon[30624]: Health check update: 3 slow ops, oldest one blocked for 463 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:06:09.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:06:08 smithi064 ceph-mon[34420]: Health check update: 3 slow ops, oldest one blocked for 463 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:06:09.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:06:08 smithi149 ceph-mon[34678]: Health check update: 3 slow ops, oldest one blocked for 463 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:06:10.256 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:06:09 smithi149 ceph-mon[34678]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:06:10.256 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:06:09 smithi149 ceph-mon[34678]: { 2024-03-26T17:06:10.256 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:06:09 smithi149 ceph-mon[34678]: "prefix": "rbd perf image stats", 2024-03-26T17:06:10.256 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:06:09 smithi149 ceph-mon[34678]: "pool_spec": "mypool", 2024-03-26T17:06:10.256 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:06:09 smithi149 ceph-mon[34678]: "sort_by": "write_ops", 2024-03-26T17:06:10.256 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:06:09 smithi149 ceph-mon[34678]: "format": "json" 2024-03-26T17:06:10.256 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:06:09 smithi149 ceph-mon[34678]: }"]: dispatch 2024-03-26T17:06:10.256 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:06:09 smithi149 ceph-mon[34678]: pgmap v606: 33 pgs: 33 active+clean; 1.0 GiB data, 3.6 GiB used, 712 GiB / 715 GiB avail; 6.1 MiB/s rd, 6.2 MiB/s wr, 624 op/s 2024-03-26T17:06:10.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:06:09 smithi044 ceph-mon[30624]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:06:10.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:06:09 smithi044 ceph-mon[30624]: { 2024-03-26T17:06:10.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:06:09 smithi044 ceph-mon[30624]: "prefix": "rbd perf image stats", 2024-03-26T17:06:10.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:06:09 smithi044 ceph-mon[30624]: "pool_spec": "mypool", 2024-03-26T17:06:10.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:06:09 smithi044 ceph-mon[30624]: "sort_by": "write_ops", 2024-03-26T17:06:10.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:06:09 smithi044 ceph-mon[30624]: "format": "json" 2024-03-26T17:06:10.266 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:06:09 smithi044 ceph-mon[30624]: }"]: dispatch 2024-03-26T17:06:10.266 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:06:09 smithi044 ceph-mon[30624]: pgmap v606: 33 pgs: 33 active+clean; 1.0 GiB data, 3.6 GiB used, 712 GiB / 715 GiB avail; 6.1 MiB/s rd, 6.2 MiB/s wr, 624 op/s 2024-03-26T17:06:10.266 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:06:09 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:06:09] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:06:10.266 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:06:09 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:06:09] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:06:10.266 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:06:09 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:06:10.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:06:09 smithi064 ceph-mon[34420]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:06:10.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:06:09 smithi064 ceph-mon[34420]: { 2024-03-26T17:06:10.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:06:09 smithi064 ceph-mon[34420]: "prefix": "rbd perf image stats", 2024-03-26T17:06:10.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:06:09 smithi064 ceph-mon[34420]: "pool_spec": "mypool", 2024-03-26T17:06:10.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:06:09 smithi064 ceph-mon[34420]: "sort_by": "write_ops", 2024-03-26T17:06:10.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:06:09 smithi064 ceph-mon[34420]: "format": "json" 2024-03-26T17:06:10.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:06:09 smithi064 ceph-mon[34420]: }"]: dispatch 2024-03-26T17:06:10.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:06:09 smithi064 ceph-mon[34420]: pgmap v606: 33 pgs: 33 active+clean; 1.0 GiB data, 3.6 GiB used, 712 GiB / 715 GiB avail; 6.1 MiB/s rd, 6.2 MiB/s wr, 624 op/s 2024-03-26T17:06:10.646 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:06:10 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:06:10] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:06:10.646 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:06:10 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:06:10] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:06:10.646 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:06:10 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:06:11.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:06:11 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 2024-03-26T17:06:11.226+0000 7fa707a55700 -1 mon.c@1(peon) e3 get_health_metrics reporting 3 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T17:06:12.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:06:11 smithi044 ceph-mon[30624]: pgmap v607: 33 pgs: 33 active+clean; 1.0 GiB data, 3.6 GiB used, 712 GiB / 715 GiB avail; 6.1 MiB/s rd, 6.3 MiB/s wr, 627 op/s 2024-03-26T17:06:12.265 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:06:11 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:06:11] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:06:12.266 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:06:11 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:06:11] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:06:12.266 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:06:11 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:06:12.268 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:06:11 smithi149 ceph-mon[34678]: pgmap v607: 33 pgs: 33 active+clean; 1.0 GiB data, 3.6 GiB used, 712 GiB / 715 GiB avail; 6.1 MiB/s rd, 6.3 MiB/s wr, 627 op/s 2024-03-26T17:06:12.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:06:11 smithi064 ceph-mon[34420]: pgmap v607: 33 pgs: 33 active+clean; 1.0 GiB data, 3.6 GiB used, 712 GiB / 715 GiB avail; 6.1 MiB/s rd, 6.3 MiB/s wr, 627 op/s 2024-03-26T17:06:12.646 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:06:12 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:06:12] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:06:12.646 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:06:12 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:06:12] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:06:12.647 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:06:12 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:06:13.062 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:06:13.075 INFO:tasks.workunit.client.3.smithi157.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2024-03-26T17:06:13.075 INFO:tasks.workunit.client.3.smithi157.stdout: 9.70 83.2k 90.8k 0.0k 832.0k 908.0k 0.0k nvme2n1 2024-03-26T17:06:13.075 INFO:tasks.workunit.client.3.smithi157.stdout: 9.70 92.8k 104.4k 0.0k 928.0k 1.0M 0.0k nvme2n10 2024-03-26T17:06:13.075 INFO:tasks.workunit.client.3.smithi157.stdout: 9.70 96.0k 114.8k 0.0k 960.0k 1.1M 0.0k nvme2n11 2024-03-26T17:06:13.075 INFO:tasks.workunit.client.3.smithi157.stdout: 9.70 78.0k 104.8k 0.0k 780.0k 1.0M 0.0k nvme2n12 2024-03-26T17:06:13.075 INFO:tasks.workunit.client.3.smithi157.stdout: 9.70 114.4k 71.6k 0.0k 1.1M 716.0k 0.0k nvme2n13 2024-03-26T17:06:13.075 INFO:tasks.workunit.client.3.smithi157.stdout: 9.70 105.6k 86.0k 0.0k 1.0M 860.0k 0.0k nvme2n14 2024-03-26T17:06:13.075 INFO:tasks.workunit.client.3.smithi157.stdout: 9.70 109.2k 89.6k 0.0k 1.1M 896.0k 0.0k nvme2n15 2024-03-26T17:06:13.075 INFO:tasks.workunit.client.3.smithi157.stdout: 9.70 96.0k 108.0k 0.0k 960.0k 1.1M 0.0k nvme2n16 2024-03-26T17:06:13.075 INFO:tasks.workunit.client.3.smithi157.stdout: 9.70 132.4k 81.2k 0.0k 1.3M 812.0k 0.0k nvme2n17 2024-03-26T17:06:13.076 INFO:tasks.workunit.client.3.smithi157.stdout: 9.70 118.4k 76.8k 0.0k 1.2M 768.0k 0.0k nvme2n18 2024-03-26T17:06:13.076 INFO:tasks.workunit.client.3.smithi157.stdout: 9.70 75.2k 120.8k 0.0k 752.0k 1.2M 0.0k nvme2n19 2024-03-26T17:06:13.076 INFO:tasks.workunit.client.3.smithi157.stdout: 9.70 85.2k 85.2k 0.0k 852.0k 852.0k 0.0k nvme2n2 2024-03-26T17:06:13.076 INFO:tasks.workunit.client.3.smithi157.stdout: 9.80 82.0k 117.2k 0.0k 820.0k 1.1M 0.0k nvme2n20 2024-03-26T17:06:13.076 INFO:tasks.workunit.client.3.smithi157.stdout: 9.70 109.2k 92.0k 0.0k 1.1M 920.0k 0.0k nvme2n3 2024-03-26T17:06:13.076 INFO:tasks.workunit.client.3.smithi157.stdout: 9.70 80.0k 110.8k 0.0k 800.0k 1.1M 0.0k nvme2n4 2024-03-26T17:06:13.076 INFO:tasks.workunit.client.3.smithi157.stdout: 9.70 102.0k 103.2k 0.0k 1020.0k 1.0M 0.0k nvme2n5 2024-03-26T17:06:13.076 INFO:tasks.workunit.client.3.smithi157.stdout: 9.70 93.6k 84.0k 0.0k 936.0k 840.0k 0.0k nvme2n6 2024-03-26T17:06:13.076 INFO:tasks.workunit.client.3.smithi157.stdout: 9.70 123.2k 86.4k 0.0k 1.2M 864.0k 0.0k nvme2n7 2024-03-26T17:06:13.076 INFO:tasks.workunit.client.3.smithi157.stdout: 9.70 87.2k 111.6k 0.0k 872.0k 1.1M 0.0k nvme2n8 2024-03-26T17:06:13.076 INFO:tasks.workunit.client.3.smithi157.stdout: 9.70 106.4k 80.4k 0.0k 1.0M 804.0k 0.0k nvme2n9 2024-03-26T17:06:13.076 INFO:tasks.workunit.client.3.smithi157.stdout: 9.70 85.2k 115.6k 0.0k 852.0k 1.1M 0.0k nvme5n1 2024-03-26T17:06:13.076 INFO:tasks.workunit.client.3.smithi157.stdout: 9.70 102.8k 96.8k 0.0k 1.0M 968.0k 0.0k nvme5n10 2024-03-26T17:06:13.076 INFO:tasks.workunit.client.3.smithi157.stdout: 9.70 118.4k 68.8k 0.0k 1.2M 688.0k 0.0k nvme5n11 2024-03-26T17:06:13.077 INFO:tasks.workunit.client.3.smithi157.stdout: 9.70 96.0k 86.8k 0.0k 960.0k 868.0k 0.0k nvme5n12 2024-03-26T17:06:13.077 INFO:tasks.workunit.client.3.smithi157.stdout: 9.70 82.8k 114.4k 0.0k 828.0k 1.1M 0.0k nvme5n13 2024-03-26T17:06:13.077 INFO:tasks.workunit.client.3.smithi157.stdout: 9.70 78.0k 113.2k 0.0k 780.0k 1.1M 0.0k nvme5n14 2024-03-26T17:06:13.077 INFO:tasks.workunit.client.3.smithi157.stdout: 9.70 100.4k 110.0k 0.0k 1004.0k 1.1M 0.0k nvme5n15 2024-03-26T17:06:13.077 INFO:tasks.workunit.client.3.smithi157.stdout: 9.70 106.0k 102.0k 0.0k 1.0M 1020.0k 0.0k nvme5n16 2024-03-26T17:06:13.077 INFO:tasks.workunit.client.3.smithi157.stdout: 9.70 112.8k 62.4k 0.0k 1.1M 624.0k 0.0k nvme5n17 2024-03-26T17:06:13.077 INFO:tasks.workunit.client.3.smithi157.stdout: 9.70 107.6k 100.4k 0.0k 1.1M 1004.0k 0.0k nvme5n18 2024-03-26T17:06:13.077 INFO:tasks.workunit.client.3.smithi157.stdout: 9.70 117.6k 94.0k 0.0k 1.1M 940.0k 0.0k nvme5n19 2024-03-26T17:06:13.077 INFO:tasks.workunit.client.3.smithi157.stdout: 9.70 84.8k 103.6k 0.0k 848.0k 1.0M 0.0k nvme5n2 2024-03-26T17:06:13.077 INFO:tasks.workunit.client.3.smithi157.stdout: 9.70 99.2k 82.8k 0.0k 992.0k 828.0k 0.0k nvme5n20 2024-03-26T17:06:13.077 INFO:tasks.workunit.client.3.smithi157.stdout: 9.70 104.8k 103.2k 0.0k 1.0M 1.0M 0.0k nvme5n3 2024-03-26T17:06:13.077 INFO:tasks.workunit.client.3.smithi157.stdout: 9.70 98.0k 85.2k 0.0k 980.0k 852.0k 0.0k nvme5n4 2024-03-26T17:06:13.077 INFO:tasks.workunit.client.3.smithi157.stdout: 9.70 85.2k 92.4k 0.0k 852.0k 924.0k 0.0k nvme5n5 2024-03-26T17:06:13.077 INFO:tasks.workunit.client.3.smithi157.stdout: 9.70 106.0k 74.0k 0.0k 1.0M 740.0k 0.0k nvme5n6 2024-03-26T17:06:13.077 INFO:tasks.workunit.client.3.smithi157.stdout: 9.70 96.4k 96.8k 0.0k 964.0k 968.0k 0.0k nvme5n7 2024-03-26T17:06:13.078 INFO:tasks.workunit.client.3.smithi157.stdout: 9.70 100.4k 113.2k 0.0k 1004.0k 1.1M 0.0k nvme5n8 2024-03-26T17:06:13.078 INFO:tasks.workunit.client.3.smithi157.stdout: 9.70 93.2k 94.4k 0.0k 932.0k 944.0k 0.0k nvme5n9 2024-03-26T17:06:13.078 INFO:tasks.workunit.client.3.smithi157.stdout: 9.70 102.0k 91.6k 0.0k 1020.0k 916.0k 0.0k nvme8n1 2024-03-26T17:06:13.078 INFO:tasks.workunit.client.3.smithi157.stdout: 9.70 90.0k 131.6k 0.0k 900.0k 1.3M 0.0k nvme8n10 2024-03-26T17:06:13.078 INFO:tasks.workunit.client.3.smithi157.stdout: 9.70 90.0k 93.6k 0.0k 900.0k 936.0k 0.0k nvme8n11 2024-03-26T17:06:13.078 INFO:tasks.workunit.client.3.smithi157.stdout: 9.70 118.0k 100.0k 0.0k 1.2M 1000.0k 0.0k nvme8n12 2024-03-26T17:06:13.078 INFO:tasks.workunit.client.3.smithi157.stdout: 9.70 93.2k 86.0k 0.0k 932.0k 860.0k 0.0k nvme8n13 2024-03-26T17:06:13.078 INFO:tasks.workunit.client.3.smithi157.stdout: 9.70 96.0k 92.8k 0.0k 960.0k 928.0k 0.0k nvme8n14 2024-03-26T17:06:13.078 INFO:tasks.workunit.client.3.smithi157.stdout: 9.70 63.2k 116.8k 0.0k 632.0k 1.1M 0.0k nvme8n15 2024-03-26T17:06:13.078 INFO:tasks.workunit.client.3.smithi157.stdout: 9.70 64.4k 101.2k 0.0k 644.0k 1012.0k 0.0k nvme8n16 2024-03-26T17:06:13.078 INFO:tasks.workunit.client.3.smithi157.stdout: 9.70 120.0k 96.0k 0.0k 1.2M 960.0k 0.0k nvme8n17 2024-03-26T17:06:13.078 INFO:tasks.workunit.client.3.smithi157.stdout: 9.70 112.8k 87.6k 0.0k 1.1M 876.0k 0.0k nvme8n18 2024-03-26T17:06:13.078 INFO:tasks.workunit.client.3.smithi157.stdout: 9.70 102.0k 119.2k 0.0k 1020.0k 1.2M 0.0k nvme8n19 2024-03-26T17:06:13.078 INFO:tasks.workunit.client.3.smithi157.stdout: 9.70 100.8k 74.4k 0.0k 1008.0k 744.0k 0.0k nvme8n2 2024-03-26T17:06:13.079 INFO:tasks.workunit.client.3.smithi157.stdout: 9.70 80.4k 116.8k 0.0k 804.0k 1.1M 0.0k nvme8n20 2024-03-26T17:06:13.079 INFO:tasks.workunit.client.3.smithi157.stdout: 9.70 86.0k 84.4k 0.0k 860.0k 844.0k 0.0k nvme8n3 2024-03-26T17:06:13.079 INFO:tasks.workunit.client.3.smithi157.stdout: 9.70 76.4k 105.2k 0.0k 764.0k 1.0M 0.0k nvme8n4 2024-03-26T17:06:13.079 INFO:tasks.workunit.client.3.smithi157.stdout: 9.70 120.4k 92.4k 0.0k 1.2M 924.0k 0.0k nvme8n5 2024-03-26T17:06:13.079 INFO:tasks.workunit.client.3.smithi157.stdout: 9.70 99.2k 85.6k 0.0k 992.0k 856.0k 0.0k nvme8n6 2024-03-26T17:06:13.079 INFO:tasks.workunit.client.3.smithi157.stdout: 9.70 124.0k 92.0k 0.0k 1.2M 920.0k 0.0k nvme8n7 2024-03-26T17:06:13.079 INFO:tasks.workunit.client.3.smithi157.stdout: 9.70 88.0k 100.8k 0.0k 880.0k 1008.0k 0.0k nvme8n8 2024-03-26T17:06:13.079 INFO:tasks.workunit.client.3.smithi157.stdout: 9.70 112.0k 100.4k 0.0k 1.1M 1004.0k 0.0k nvme8n9 2024-03-26T17:06:13.079 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:06:13.314 INFO:tasks.workunit.client.3.smithi157.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-26T17:06:13.315 INFO:tasks.workunit.client.3.smithi157.stdout:myimage55 6/s 4/s 141 KiB/s 75 KiB/s 2.26 ms 371.83 us 2024-03-26T17:06:13.315 INFO:tasks.workunit.client.3.smithi157.stdout:myimage19 6/s 4/s 132 KiB/s 80 KiB/s 2.08 ms 324.28 us 2024-03-26T17:06:13.315 INFO:tasks.workunit.client.3.smithi157.stdout:myimage33 6/s 3/s 114 KiB/s 65 KiB/s 2.02 ms 262.63 us 2024-03-26T17:06:13.315 INFO:tasks.workunit.client.3.smithi157.stdout:myimage14 6/s 6/s 112 KiB/s 106 KiB/s 2.21 ms 321.97 us 2024-03-26T17:06:13.315 INFO:tasks.workunit.client.3.smithi157.stdout:myimage4 6/s 3/s 130 KiB/s 62 KiB/s 1.90 ms 301.49 us 2024-03-26T17:06:13.315 INFO:tasks.workunit.client.3.smithi157.stdout:myimage12 6/s 3/s 121 KiB/s 78 KiB/s 1.97 ms 335.35 us 2024-03-26T17:06:13.315 INFO:tasks.workunit.client.3.smithi157.stdout:myimage21 6/s 3/s 111 KiB/s 86 KiB/s 2.19 ms 544.21 us 2024-03-26T17:06:13.315 INFO:tasks.workunit.client.3.smithi157.stdout:myimage36 6/s 4/s 124 KiB/s 102 KiB/s 1.85 ms 315.63 us 2024-03-26T17:06:13.315 INFO:tasks.workunit.client.3.smithi157.stdout:myimage34 5/s 4/s 122 KiB/s 75 KiB/s 1.79 ms 289.33 us 2024-03-26T17:06:13.315 INFO:tasks.workunit.client.3.smithi157.stdout:myimage48 5/s 6/s 119 KiB/s 136 KiB/s 2.11 ms 297.91 us 2024-03-26T17:06:13.315 INFO:tasks.workunit.client.3.smithi157.stdout:myimage40 5/s 5/s 87 KiB/s 110 KiB/s 1.95 ms 335.44 us 2024-03-26T17:06:13.315 INFO:tasks.workunit.client.3.smithi157.stdout:myimage47 5/s 5/s 127 KiB/s 116 KiB/s 2.15 ms 337.76 us 2024-03-26T17:06:13.316 INFO:tasks.workunit.client.3.smithi157.stdout:myimage8 5/s 5/s 136 KiB/s 99 KiB/s 2.01 ms 301.33 us 2024-03-26T17:06:13.316 INFO:tasks.workunit.client.3.smithi157.stdout:myimage43 5/s 4/s 89 KiB/s 65 KiB/s 2.09 ms 312.07 us 2024-03-26T17:06:13.316 INFO:tasks.workunit.client.3.smithi157.stdout:myimage57 5/s 5/s 102 KiB/s 121 KiB/s 1.93 ms 325.98 us 2024-03-26T17:06:13.316 INFO:tasks.workunit.client.3.smithi157.stdout:myimage39 5/s 5/s 100 KiB/s 105 KiB/s 1.87 ms 365.56 us 2024-03-26T17:06:13.316 INFO:tasks.workunit.client.3.smithi157.stdout:myimage10 5/s 4/s 122 KiB/s 104 KiB/s 2.00 ms 317.83 us 2024-03-26T17:06:13.316 INFO:tasks.workunit.client.3.smithi157.stdout:myimage30 5/s 4/s 70 KiB/s 109 KiB/s 2.35 ms 429.03 us 2024-03-26T17:06:13.316 INFO:tasks.workunit.client.3.smithi157.stdout:myimage32 5/s 4/s 89 KiB/s 98 KiB/s 2.11 ms 322.89 us 2024-03-26T17:06:13.316 INFO:tasks.workunit.client.3.smithi157.stdout:myimage20 5/s 2/s 122 KiB/s 76 KiB/s 2.00 ms 331.11 us 2024-03-26T17:06:13.316 INFO:tasks.workunit.client.3.smithi157.stdout:myimage29 5/s 3/s 101 KiB/s 74 KiB/s 1.84 ms 366.10 us 2024-03-26T17:06:13.316 INFO:tasks.workunit.client.3.smithi157.stdout:myimage23 5/s 3/s 98 KiB/s 59 KiB/s 1.87 ms 383.50 us 2024-03-26T17:06:13.316 INFO:tasks.workunit.client.3.smithi157.stdout:myimage44 5/s 4/s 122 KiB/s 71 KiB/s 2.06 ms 446.25 us 2024-03-26T17:06:13.316 INFO:tasks.workunit.client.3.smithi157.stdout:myimage58 5/s 4/s 106 KiB/s 90 KiB/s 1.83 ms 296.77 us 2024-03-26T17:06:13.316 INFO:tasks.workunit.client.3.smithi157.stdout:myimage1 5/s 6/s 112 KiB/s 107 KiB/s 1.75 ms 299.07 us 2024-03-26T17:06:13.317 INFO:tasks.workunit.client.3.smithi157.stdout:myimage6 5/s 5/s 78 KiB/s 101 KiB/s 2.06 ms 380.51 us 2024-03-26T17:06:13.317 INFO:tasks.workunit.client.3.smithi157.stdout:myimage7 5/s 6/s 98 KiB/s 145 KiB/s 1.94 ms 411.83 us 2024-03-26T17:06:13.317 INFO:tasks.workunit.client.3.smithi157.stdout:myimage18 5/s 5/s 82 KiB/s 110 KiB/s 2.00 ms 324.25 us 2024-03-26T17:06:13.317 INFO:tasks.workunit.client.3.smithi157.stdout:myimage25 5/s 4/s 86 KiB/s 69 KiB/s 2.47 ms 365.03 us 2024-03-26T17:06:13.317 INFO:tasks.workunit.client.3.smithi157.stdout:myimage28 5/s 4/s 105 KiB/s 114 KiB/s 2.60 ms 426.10 us 2024-03-26T17:06:13.317 INFO:tasks.workunit.client.3.smithi157.stdout:myimage60 5/s 3/s 110 KiB/s 78 KiB/s 2.07 ms 351.89 us 2024-03-26T17:06:13.317 INFO:tasks.workunit.client.3.smithi157.stdout:myimage59 5/s 5/s 124 KiB/s 119 KiB/s 2.28 ms 339.87 us 2024-03-26T17:06:13.317 INFO:tasks.workunit.client.3.smithi157.stdout:myimage37 4/s 4/s 69 KiB/s 98 KiB/s 1.99 ms 349.90 us 2024-03-26T17:06:13.317 INFO:tasks.workunit.client.3.smithi157.stdout:myimage5 4/s 6/s 125 KiB/s 127 KiB/s 1.85 ms 328.35 us 2024-03-26T17:06:13.317 INFO:tasks.workunit.client.3.smithi157.stdout:myimage3 4/s 5/s 94 KiB/s 101 KiB/s 1.71 ms 329.56 us 2024-03-26T17:06:13.317 INFO:tasks.workunit.client.3.smithi157.stdout:myimage11 4/s 5/s 98 KiB/s 94 KiB/s 2.14 ms 298.93 us 2024-03-26T17:06:13.317 INFO:tasks.workunit.client.3.smithi157.stdout:myimage24 4/s 4/s 73 KiB/s 98 KiB/s 2.01 ms 337.00 us 2024-03-26T17:06:13.317 INFO:tasks.workunit.client.3.smithi157.stdout:myimage41 4/s 5/s 93 KiB/s 99 KiB/s 2.08 ms 319.32 us 2024-03-26T17:06:13.318 INFO:tasks.workunit.client.3.smithi157.stdout:myimage2 4/s 4/s 74 KiB/s 86 KiB/s 1.98 ms 330.65 us 2024-03-26T17:06:13.318 INFO:tasks.workunit.client.3.smithi157.stdout:myimage35 4/s 4/s 106 KiB/s 106 KiB/s 1.97 ms 324.34 us 2024-03-26T17:06:13.318 INFO:tasks.workunit.client.3.smithi157.stdout:myimage49 4/s 5/s 94 KiB/s 122 KiB/s 2.03 ms 338.96 us 2024-03-26T17:06:13.318 INFO:tasks.workunit.client.3.smithi157.stdout:myimage26 4/s 5/s 84 KiB/s 91 KiB/s 1.96 ms 290.39 us 2024-03-26T17:06:13.318 INFO:tasks.workunit.client.3.smithi157.stdout:myimage50 4/s 3/s 103 KiB/s 82 KiB/s 2.00 ms 336.61 us 2024-03-26T17:06:13.318 INFO:tasks.workunit.client.3.smithi157.stdout:myimage56 4/s 5/s 81 KiB/s 79 KiB/s 2.34 ms 343.77 us 2024-03-26T17:06:13.318 INFO:tasks.workunit.client.3.smithi157.stdout:myimage31 4/s 5/s 77 KiB/s 113 KiB/s 2.04 ms 372.52 us 2024-03-26T17:06:13.318 INFO:tasks.workunit.client.3.smithi157.stdout:myimage15 4/s 5/s 88 KiB/s 119 KiB/s 1.68 ms 453.58 us 2024-03-26T17:06:13.318 INFO:tasks.workunit.client.3.smithi157.stdout:myimage27 4/s 5/s 75 KiB/s 119 KiB/s 1.78 ms 346.05 us 2024-03-26T17:06:13.318 INFO:tasks.workunit.client.3.smithi157.stdout:myimage42 4/s 4/s 62 KiB/s 100 KiB/s 1.92 ms 393.73 us 2024-03-26T17:06:13.318 INFO:tasks.workunit.client.3.smithi157.stdout:myimage45 4/s 4/s 95 KiB/s 103 KiB/s 2.01 ms 434.31 us 2024-03-26T17:06:13.318 INFO:tasks.workunit.client.3.smithi157.stdout:myimage13 4/s 5/s 64 KiB/s 97 KiB/s 1.85 ms 314.09 us 2024-03-26T17:06:13.318 INFO:tasks.workunit.client.3.smithi157.stdout:myimage22 4/s 4/s 58 KiB/s 93 KiB/s 2.04 ms 272.74 us 2024-03-26T17:06:13.319 INFO:tasks.workunit.client.3.smithi157.stdout:myimage38 4/s 5/s 113 KiB/s 106 KiB/s 1.74 ms 352.88 us 2024-03-26T17:06:13.319 INFO:tasks.workunit.client.3.smithi157.stdout:myimage52 4/s 4/s 89 KiB/s 112 KiB/s 2.15 ms 353.24 us 2024-03-26T17:06:13.319 INFO:tasks.workunit.client.3.smithi157.stdout:myimage9 4/s 5/s 70 KiB/s 90 KiB/s 2.11 ms 392.03 us 2024-03-26T17:06:13.319 INFO:tasks.workunit.client.3.smithi157.stdout:myimage46 4/s 5/s 72 KiB/s 85 KiB/s 1.86 ms 289.49 us 2024-03-26T17:06:13.319 INFO:tasks.workunit.client.3.smithi157.stdout:myimage16 3/s 4/s 108 KiB/s 82 KiB/s 2.27 ms 314.62 us 2024-03-26T17:06:13.319 INFO:tasks.workunit.client.3.smithi157.stdout:myimage54 3/s 5/s 75 KiB/s 102 KiB/s 1.78 ms 340.22 us 2024-03-26T17:06:13.319 INFO:tasks.workunit.client.3.smithi157.stdout:myimage17 3/s 5/s 67 KiB/s 115 KiB/s 2.07 ms 357.62 us 2024-03-26T17:06:13.319 INFO:tasks.workunit.client.3.smithi157.stdout:myimage53 3/s 6/s 67 KiB/s 84 KiB/s 2.04 ms 336.82 us 2024-03-26T17:06:13.319 INFO:tasks.workunit.client.3.smithi157.stdout:myimage51 3/s 6/s 52 KiB/s 121 KiB/s 2.06 ms 323.91 us 2024-03-26T17:06:13.319 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:06:14.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:06:13 smithi044 ceph-mon[30624]: pgmap v608: 33 pgs: 33 active+clean; 1.0 GiB data, 3.6 GiB used, 712 GiB / 715 GiB avail; 5.5 MiB/s rd, 5.6 MiB/s wr, 562 op/s 2024-03-26T17:06:14.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:06:13 smithi044 ceph-mon[30624]: Health check update: 3 slow ops, oldest one blocked for 468 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:06:14.266 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:06:13 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:06:13] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:06:14.266 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:06:14 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:06:14] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:06:14.266 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:06:14 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:06:14.280 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:06:13 smithi149 ceph-mon[34678]: pgmap v608: 33 pgs: 33 active+clean; 1.0 GiB data, 3.6 GiB used, 712 GiB / 715 GiB avail; 5.5 MiB/s rd, 5.6 MiB/s wr, 562 op/s 2024-03-26T17:06:14.280 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:06:13 smithi149 ceph-mon[34678]: Health check update: 3 slow ops, oldest one blocked for 468 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:06:14.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:06:13 smithi064 ceph-mon[34420]: pgmap v608: 33 pgs: 33 active+clean; 1.0 GiB data, 3.6 GiB used, 712 GiB / 715 GiB avail; 5.5 MiB/s rd, 5.6 MiB/s wr, 562 op/s 2024-03-26T17:06:14.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:06:13 smithi064 ceph-mon[34420]: Health check update: 3 slow ops, oldest one blocked for 468 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:06:14.646 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:06:14 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:06:14] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:06:14.646 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:06:14 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:06:14] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:06:14.647 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:06:14 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:06:15.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:06:14 smithi044 ceph-mon[30624]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:06:15.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:06:14 smithi044 ceph-mon[30624]: { 2024-03-26T17:06:15.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:06:14 smithi044 ceph-mon[30624]: "prefix": "rbd perf image stats", 2024-03-26T17:06:15.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:06:14 smithi044 ceph-mon[30624]: "pool_spec": "mypool", 2024-03-26T17:06:15.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:06:14 smithi044 ceph-mon[30624]: "sort_by": "write_ops", 2024-03-26T17:06:15.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:06:14 smithi044 ceph-mon[30624]: "format": "json" 2024-03-26T17:06:15.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:06:14 smithi044 ceph-mon[30624]: }"]: dispatch 2024-03-26T17:06:15.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:06:14 smithi064 ceph-mon[34420]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:06:15.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:06:14 smithi064 ceph-mon[34420]: { 2024-03-26T17:06:15.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:06:14 smithi064 ceph-mon[34420]: "prefix": "rbd perf image stats", 2024-03-26T17:06:15.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:06:14 smithi064 ceph-mon[34420]: "pool_spec": "mypool", 2024-03-26T17:06:15.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:06:14 smithi064 ceph-mon[34420]: "sort_by": "write_ops", 2024-03-26T17:06:15.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:06:14 smithi064 ceph-mon[34420]: "format": "json" 2024-03-26T17:06:15.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:06:14 smithi064 ceph-mon[34420]: }"]: dispatch 2024-03-26T17:06:15.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:06:14 smithi149 ceph-mon[34678]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:06:15.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:06:14 smithi149 ceph-mon[34678]: { 2024-03-26T17:06:15.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:06:14 smithi149 ceph-mon[34678]: "prefix": "rbd perf image stats", 2024-03-26T17:06:15.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:06:14 smithi149 ceph-mon[34678]: "pool_spec": "mypool", 2024-03-26T17:06:15.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:06:14 smithi149 ceph-mon[34678]: "sort_by": "write_ops", 2024-03-26T17:06:15.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:06:14 smithi149 ceph-mon[34678]: "format": "json" 2024-03-26T17:06:15.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:06:14 smithi149 ceph-mon[34678]: }"]: dispatch 2024-03-26T17:06:16.228 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:06:15 smithi149 ceph-mon[34678]: pgmap v609: 33 pgs: 33 active+clean; 1.0 GiB data, 3.6 GiB used, 712 GiB / 715 GiB avail; 5.8 MiB/s rd, 5.8 MiB/s wr, 596 op/s 2024-03-26T17:06:16.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:06:15 smithi044 ceph-mon[30624]: pgmap v609: 33 pgs: 33 active+clean; 1.0 GiB data, 3.6 GiB used, 712 GiB / 715 GiB avail; 5.8 MiB/s rd, 5.8 MiB/s wr, 596 op/s 2024-03-26T17:06:16.265 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:06:16 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:06:16] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:06:16.265 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:06:16 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:06:16] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:06:16.266 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:06:16 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:06:16.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:06:15 smithi064 ceph-mon[34420]: pgmap v609: 33 pgs: 33 active+clean; 1.0 GiB data, 3.6 GiB used, 712 GiB / 715 GiB avail; 5.8 MiB/s rd, 5.8 MiB/s wr, 596 op/s 2024-03-26T17:06:16.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:06:16 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 2024-03-26T17:06:16.226+0000 7fa707a55700 -1 mon.c@1(peon) e3 get_health_metrics reporting 3 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T17:06:16.650 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:06:16 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:06:16] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:06:16.651 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:06:16 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:06:16] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:06:16.651 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:06:16 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:06:18.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:06:17 smithi044 ceph-mon[30624]: pgmap v610: 33 pgs: 33 active+clean; 1.0 GiB data, 3.6 GiB used, 712 GiB / 715 GiB avail; 5.6 MiB/s rd, 5.5 MiB/s wr, 575 op/s 2024-03-26T17:06:18.265 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:06:18 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:06:18] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:06:18.266 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:06:18 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:06:18] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:06:18.266 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:06:18 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:06:18.305 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:06:17 smithi149 ceph-mon[34678]: pgmap v610: 33 pgs: 33 active+clean; 1.0 GiB data, 3.6 GiB used, 712 GiB / 715 GiB avail; 5.6 MiB/s rd, 5.5 MiB/s wr, 575 op/s 2024-03-26T17:06:18.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:06:17 smithi064 ceph-mon[34420]: pgmap v610: 33 pgs: 33 active+clean; 1.0 GiB data, 3.6 GiB used, 712 GiB / 715 GiB avail; 5.6 MiB/s rd, 5.5 MiB/s wr, 575 op/s 2024-03-26T17:06:18.318 INFO:tasks.workunit.client.3.smithi157.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-26T17:06:18.318 INFO:tasks.workunit.client.3.smithi157.stdout:myimage22 6/s 4/s 134 KiB/s 78 KiB/s 2.08 ms 305.46 us 2024-03-26T17:06:18.319 INFO:tasks.workunit.client.3.smithi157.stdout:myimage36 6/s 6/s 114 KiB/s 133 KiB/s 2.05 ms 430.63 us 2024-03-26T17:06:18.319 INFO:tasks.workunit.client.3.smithi157.stdout:myimage38 6/s 5/s 113 KiB/s 104 KiB/s 1.74 ms 331.68 us 2024-03-26T17:06:18.319 INFO:tasks.workunit.client.3.smithi157.stdout:myimage23 6/s 3/s 120 KiB/s 80 KiB/s 1.90 ms 361.84 us 2024-03-26T17:06:18.319 INFO:tasks.workunit.client.3.smithi157.stdout:myimage20 6/s 4/s 181 KiB/s 110 KiB/s 2.14 ms 324.01 us 2024-03-26T17:06:18.319 INFO:tasks.workunit.client.3.smithi157.stdout:myimage41 6/s 4/s 115 KiB/s 102 KiB/s 2.05 ms 324.59 us 2024-03-26T17:06:18.319 INFO:tasks.workunit.client.3.smithi157.stdout:myimage50 6/s 4/s 122 KiB/s 70 KiB/s 2.15 ms 361.09 us 2024-03-26T17:06:18.319 INFO:tasks.workunit.client.3.smithi157.stdout:myimage30 5/s 4/s 115 KiB/s 98 KiB/s 2.50 ms 399.75 us 2024-03-26T17:06:18.319 INFO:tasks.workunit.client.3.smithi157.stdout:myimage40 5/s 2/s 107 KiB/s 46 KiB/s 1.93 ms 327.39 us 2024-03-26T17:06:18.319 INFO:tasks.workunit.client.3.smithi157.stdout:myimage12 5/s 4/s 100 KiB/s 63 KiB/s 2.10 ms 349.34 us 2024-03-26T17:06:18.319 INFO:tasks.workunit.client.3.smithi157.stdout:myimage28 5/s 4/s 121 KiB/s 90 KiB/s 2.50 ms 436.07 us 2024-03-26T17:06:18.319 INFO:tasks.workunit.client.3.smithi157.stdout:myimage39 5/s 4/s 99 KiB/s 83 KiB/s 1.86 ms 357.22 us 2024-03-26T17:06:18.319 INFO:tasks.workunit.client.3.smithi157.stdout:myimage54 5/s 3/s 105 KiB/s 62 KiB/s 1.98 ms 347.66 us 2024-03-26T17:06:18.319 INFO:tasks.workunit.client.3.smithi157.stdout:myimage48 5/s 4/s 87 KiB/s 78 KiB/s 1.73 ms 317.59 us 2024-03-26T17:06:18.319 INFO:tasks.workunit.client.3.smithi157.stdout:myimage6 5/s 2/s 110 KiB/s 38 KiB/s 2.57 ms 290.52 us 2024-03-26T17:06:18.320 INFO:tasks.workunit.client.3.smithi157.stdout:myimage33 5/s 5/s 104 KiB/s 116 KiB/s 2.10 ms 414.08 us 2024-03-26T17:06:18.320 INFO:tasks.workunit.client.3.smithi157.stdout:myimage10 5/s 4/s 104 KiB/s 90 KiB/s 2.04 ms 371.24 us 2024-03-26T17:06:18.320 INFO:tasks.workunit.client.3.smithi157.stdout:myimage49 5/s 3/s 94 KiB/s 67 KiB/s 2.03 ms 296.48 us 2024-03-26T17:06:18.320 INFO:tasks.workunit.client.3.smithi157.stdout:myimage17 5/s 4/s 98 KiB/s 79 KiB/s 2.27 ms 346.40 us 2024-03-26T17:06:18.320 INFO:tasks.workunit.client.3.smithi157.stdout:myimage26 5/s 5/s 96 KiB/s 110 KiB/s 2.10 ms 322.67 us 2024-03-26T17:06:18.320 INFO:tasks.workunit.client.3.smithi157.stdout:myimage46 5/s 4/s 94 KiB/s 94 KiB/s 1.97 ms 328.22 us 2024-03-26T17:06:18.320 INFO:tasks.workunit.client.3.smithi157.stdout:myimage3 5/s 4/s 86 KiB/s 77 KiB/s 1.80 ms 341.39 us 2024-03-26T17:06:18.320 INFO:tasks.workunit.client.3.smithi157.stdout:myimage13 5/s 5/s 78 KiB/s 116 KiB/s 1.84 ms 299.01 us 2024-03-26T17:06:18.320 INFO:tasks.workunit.client.3.smithi157.stdout:myimage15 5/s 3/s 122 KiB/s 61 KiB/s 1.93 ms 296.57 us 2024-03-26T17:06:18.320 INFO:tasks.workunit.client.3.smithi157.stdout:myimage57 5/s 5/s 111 KiB/s 123 KiB/s 1.87 ms 356.35 us 2024-03-26T17:06:18.320 INFO:tasks.workunit.client.3.smithi157.stdout:myimage60 5/s 3/s 82 KiB/s 89 KiB/s 2.17 ms 361.24 us 2024-03-26T17:06:18.320 INFO:tasks.workunit.client.3.smithi157.stdout:myimage37 5/s 7/s 90 KiB/s 150 KiB/s 2.37 ms 353.92 us 2024-03-26T17:06:18.320 INFO:tasks.workunit.client.3.smithi157.stdout:myimage4 5/s 5/s 102 KiB/s 98 KiB/s 1.77 ms 291.38 us 2024-03-26T17:06:18.321 INFO:tasks.workunit.client.3.smithi157.stdout:myimage5 5/s 4/s 79 KiB/s 72 KiB/s 1.91 ms 365.30 us 2024-03-26T17:06:18.321 INFO:tasks.workunit.client.3.smithi157.stdout:myimage45 5/s 6/s 104 KiB/s 108 KiB/s 1.76 ms 305.66 us 2024-03-26T17:06:18.321 INFO:tasks.workunit.client.3.smithi157.stdout:myimage59 5/s 5/s 106 KiB/s 104 KiB/s 2.19 ms 342.48 us 2024-03-26T17:06:18.321 INFO:tasks.workunit.client.3.smithi157.stdout:myimage14 4/s 4/s 78 KiB/s 78 KiB/s 2.40 ms 370.00 us 2024-03-26T17:06:18.321 INFO:tasks.workunit.client.3.smithi157.stdout:myimage47 4/s 5/s 95 KiB/s 105 KiB/s 1.85 ms 357.98 us 2024-03-26T17:06:18.321 INFO:tasks.workunit.client.3.smithi157.stdout:myimage29 4/s 6/s 106 KiB/s 113 KiB/s 1.89 ms 397.20 us 2024-03-26T17:06:18.321 INFO:tasks.workunit.client.3.smithi157.stdout:myimage43 4/s 4/s 94 KiB/s 103 KiB/s 2.28 ms 419.13 us 2024-03-26T17:06:18.321 INFO:tasks.workunit.client.3.smithi157.stdout:myimage56 4/s 4/s 94 KiB/s 76 KiB/s 2.29 ms 287.54 us 2024-03-26T17:06:18.321 INFO:tasks.workunit.client.3.smithi157.stdout:myimage16 4/s 5/s 86 KiB/s 70 KiB/s 2.06 ms 300.44 us 2024-03-26T17:06:18.321 INFO:tasks.workunit.client.3.smithi157.stdout:myimage31 4/s 5/s 78 KiB/s 91 KiB/s 2.25 ms 315.75 us 2024-03-26T17:06:18.321 INFO:tasks.workunit.client.3.smithi157.stdout:myimage32 4/s 4/s 86 KiB/s 86 KiB/s 2.15 ms 313.12 us 2024-03-26T17:06:18.321 INFO:tasks.workunit.client.3.smithi157.stdout:myimage27 4/s 4/s 99 KiB/s 69 KiB/s 1.80 ms 333.92 us 2024-03-26T17:06:18.321 INFO:tasks.workunit.client.3.smithi157.stdout:myimage55 4/s 3/s 101 KiB/s 82 KiB/s 2.14 ms 361.18 us 2024-03-26T17:06:18.322 INFO:tasks.workunit.client.3.smithi157.stdout:myimage58 4/s 5/s 104 KiB/s 104 KiB/s 2.06 ms 303.27 us 2024-03-26T17:06:18.322 INFO:tasks.workunit.client.3.smithi157.stdout:myimage19 4/s 4/s 78 KiB/s 89 KiB/s 2.12 ms 356.08 us 2024-03-26T17:06:18.322 INFO:tasks.workunit.client.3.smithi157.stdout:myimage42 4/s 4/s 70 KiB/s 74 KiB/s 1.96 ms 328.57 us 2024-03-26T17:06:18.322 INFO:tasks.workunit.client.3.smithi157.stdout:myimage34 4/s 4/s 94 KiB/s 87 KiB/s 2.15 ms 317.79 us 2024-03-26T17:06:18.322 INFO:tasks.workunit.client.3.smithi157.stdout:myimage44 4/s 5/s 62 KiB/s 74 KiB/s 2.06 ms 314.38 us 2024-03-26T17:06:18.322 INFO:tasks.workunit.client.3.smithi157.stdout:myimage51 4/s 4/s 86 KiB/s 62 KiB/s 1.99 ms 283.43 us 2024-03-26T17:06:18.322 INFO:tasks.workunit.client.3.smithi157.stdout:myimage2 4/s 4/s 94 KiB/s 86 KiB/s 2.19 ms 317.96 us 2024-03-26T17:06:18.322 INFO:tasks.workunit.client.3.smithi157.stdout:myimage52 4/s 4/s 80 KiB/s 95 KiB/s 2.40 ms 334.28 us 2024-03-26T17:06:18.322 INFO:tasks.workunit.client.3.smithi157.stdout:myimage9 4/s 5/s 54 KiB/s 102 KiB/s 2.18 ms 394.59 us 2024-03-26T17:06:18.322 INFO:tasks.workunit.client.3.smithi157.stdout:myimage18 4/s 4/s 77 KiB/s 101 KiB/s 2.07 ms 337.52 us 2024-03-26T17:06:18.322 INFO:tasks.workunit.client.3.smithi157.stdout:myimage24 3/s 5/s 70 KiB/s 94 KiB/s 2.06 ms 345.87 us 2024-03-26T17:06:18.322 INFO:tasks.workunit.client.3.smithi157.stdout:myimage53 3/s 5/s 97 KiB/s 128 KiB/s 1.92 ms 320.57 us 2024-03-26T17:06:18.322 INFO:tasks.workunit.client.3.smithi157.stdout:myimage35 3/s 6/s 66 KiB/s 92 KiB/s 2.08 ms 295.94 us 2024-03-26T17:06:18.322 INFO:tasks.workunit.client.3.smithi157.stdout:myimage1 3/s 3/s 78 KiB/s 64 KiB/s 1.90 ms 316.06 us 2024-03-26T17:06:18.323 INFO:tasks.workunit.client.3.smithi157.stdout:myimage7 3/s 3/s 65 KiB/s 60 KiB/s 2.14 ms 452.99 us 2024-03-26T17:06:18.323 INFO:tasks.workunit.client.3.smithi157.stdout:myimage11 3/s 5/s 91 KiB/s 118 KiB/s 2.04 ms 356.02 us 2024-03-26T17:06:18.323 INFO:tasks.workunit.client.3.smithi157.stdout:myimage25 3/s 5/s 60 KiB/s 129 KiB/s 2.30 ms 350.28 us 2024-03-26T17:06:18.323 INFO:tasks.workunit.client.3.smithi157.stdout:myimage8 3/s 6/s 78 KiB/s 118 KiB/s 2.01 ms 276.10 us 2024-03-26T17:06:18.323 INFO:tasks.workunit.client.3.smithi157.stdout:myimage21 3/s 5/s 67 KiB/s 83 KiB/s 2.37 ms 283.43 us 2024-03-26T17:06:18.323 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:06:18.646 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:06:18 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:06:18] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:06:18.647 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:06:18 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:06:18] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:06:18.647 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:06:18 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:06:19.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:06:18 smithi044 ceph-mon[30624]: Health check update: 3 slow ops, oldest one blocked for 473 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:06:19.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:06:18 smithi064 ceph-mon[34420]: Health check update: 3 slow ops, oldest one blocked for 473 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:06:19.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:06:18 smithi149 ceph-mon[34678]: Health check update: 3 slow ops, oldest one blocked for 473 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:06:20.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:06:19 smithi044 ceph-mon[30624]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:06:20.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:06:19 smithi044 ceph-mon[30624]: { 2024-03-26T17:06:20.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:06:19 smithi044 ceph-mon[30624]: "prefix": "rbd perf image stats", 2024-03-26T17:06:20.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:06:19 smithi044 ceph-mon[30624]: "pool_spec": "mypool", 2024-03-26T17:06:20.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:06:19 smithi044 ceph-mon[30624]: "sort_by": "write_ops", 2024-03-26T17:06:20.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:06:19 smithi044 ceph-mon[30624]: "format": "json" 2024-03-26T17:06:20.266 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:06:19 smithi044 ceph-mon[30624]: }"]: dispatch 2024-03-26T17:06:20.266 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:06:19 smithi044 ceph-mon[30624]: pgmap v611: 33 pgs: 33 active+clean; 1.0 GiB data, 3.6 GiB used, 712 GiB / 715 GiB avail; 5.8 MiB/s rd, 5.8 MiB/s wr, 602 op/s 2024-03-26T17:06:20.266 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:06:20 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:06:20] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:06:20.266 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:06:20 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:06:20] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:06:20.266 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:06:20 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:06:20.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:06:19 smithi064 ceph-mon[34420]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:06:20.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:06:19 smithi064 ceph-mon[34420]: { 2024-03-26T17:06:20.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:06:19 smithi064 ceph-mon[34420]: "prefix": "rbd perf image stats", 2024-03-26T17:06:20.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:06:19 smithi064 ceph-mon[34420]: "pool_spec": "mypool", 2024-03-26T17:06:20.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:06:19 smithi064 ceph-mon[34420]: "sort_by": "write_ops", 2024-03-26T17:06:20.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:06:19 smithi064 ceph-mon[34420]: "format": "json" 2024-03-26T17:06:20.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:06:19 smithi064 ceph-mon[34420]: }"]: dispatch 2024-03-26T17:06:20.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:06:19 smithi064 ceph-mon[34420]: pgmap v611: 33 pgs: 33 active+clean; 1.0 GiB data, 3.6 GiB used, 712 GiB / 715 GiB avail; 5.8 MiB/s rd, 5.8 MiB/s wr, 602 op/s 2024-03-26T17:06:20.317 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:06:19 smithi149 ceph-mon[34678]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:06:20.317 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:06:19 smithi149 ceph-mon[34678]: { 2024-03-26T17:06:20.317 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:06:19 smithi149 ceph-mon[34678]: "prefix": "rbd perf image stats", 2024-03-26T17:06:20.317 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:06:19 smithi149 ceph-mon[34678]: "pool_spec": "mypool", 2024-03-26T17:06:20.317 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:06:19 smithi149 ceph-mon[34678]: "sort_by": "write_ops", 2024-03-26T17:06:20.317 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:06:19 smithi149 ceph-mon[34678]: "format": "json" 2024-03-26T17:06:20.317 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:06:19 smithi149 ceph-mon[34678]: }"]: dispatch 2024-03-26T17:06:20.317 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:06:19 smithi149 ceph-mon[34678]: pgmap v611: 33 pgs: 33 active+clean; 1.0 GiB data, 3.6 GiB used, 712 GiB / 715 GiB avail; 5.8 MiB/s rd, 5.8 MiB/s wr, 602 op/s 2024-03-26T17:06:20.646 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:06:20 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:06:20] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:06:20.646 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:06:20 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:06:20] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:06:20.647 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:06:20 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:06:21.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:06:21 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 2024-03-26T17:06:21.227+0000 7fa707a55700 -1 mon.c@1(peon) e3 get_health_metrics reporting 3 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T17:06:22.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:06:21 smithi044 ceph-mon[30624]: pgmap v612: 33 pgs: 33 active+clean; 1.0 GiB data, 3.6 GiB used, 712 GiB / 715 GiB avail; 5.9 MiB/s rd, 5.8 MiB/s wr, 605 op/s 2024-03-26T17:06:22.265 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:06:22 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:06:22] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:06:22.265 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:06:22 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:06:22] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:06:22.266 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:06:22 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:06:22.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:06:21 smithi064 ceph-mon[34420]: pgmap v612: 33 pgs: 33 active+clean; 1.0 GiB data, 3.6 GiB used, 712 GiB / 715 GiB avail; 5.9 MiB/s rd, 5.8 MiB/s wr, 605 op/s 2024-03-26T17:06:22.329 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:06:21 smithi149 ceph-mon[34678]: pgmap v612: 33 pgs: 33 active+clean; 1.0 GiB data, 3.6 GiB used, 712 GiB / 715 GiB avail; 5.9 MiB/s rd, 5.8 MiB/s wr, 605 op/s 2024-03-26T17:06:22.646 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:06:22 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:06:22] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:06:22.647 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:06:22 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:06:22] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:06:22.647 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:06:22 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:06:23.062 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:06:23.072 INFO:tasks.workunit.client.3.smithi157.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2024-03-26T17:06:23.072 INFO:tasks.workunit.client.3.smithi157.stdout: 9.30 134.0k 100.0k 0.0k 1.3M 1000.0k 0.0k nvme2n1 2024-03-26T17:06:23.072 INFO:tasks.workunit.client.3.smithi157.stdout: 9.30 150.8k 89.2k 0.0k 1.5M 892.0k 0.0k nvme2n10 2024-03-26T17:06:23.072 INFO:tasks.workunit.client.3.smithi157.stdout: 9.30 93.6k 76.0k 0.0k 936.0k 760.0k 0.0k nvme2n11 2024-03-26T17:06:23.072 INFO:tasks.workunit.client.3.smithi157.stdout: 9.30 58.8k 83.2k 0.0k 588.0k 832.0k 0.0k nvme2n12 2024-03-26T17:06:23.072 INFO:tasks.workunit.client.3.smithi157.stdout: 9.30 106.4k 116.4k 0.0k 1.0M 1.1M 0.0k nvme2n13 2024-03-26T17:06:23.072 INFO:tasks.workunit.client.3.smithi157.stdout: 9.30 69.2k 102.0k 0.0k 692.0k 1020.0k 0.0k nvme2n14 2024-03-26T17:06:23.072 INFO:tasks.workunit.client.3.smithi157.stdout: 9.30 100.8k 115.6k 0.0k 1008.0k 1.1M 0.0k nvme2n15 2024-03-26T17:06:23.073 INFO:tasks.workunit.client.3.smithi157.stdout: 9.30 76.8k 92.8k 0.0k 768.0k 928.0k 0.0k nvme2n16 2024-03-26T17:06:23.073 INFO:tasks.workunit.client.3.smithi157.stdout: 9.30 81.2k 94.8k 0.0k 812.0k 948.0k 0.0k nvme2n17 2024-03-26T17:06:23.073 INFO:tasks.workunit.client.3.smithi157.stdout: 9.20 111.6k 83.6k 0.0k 1.1M 836.0k 0.0k nvme2n18 2024-03-26T17:06:23.073 INFO:tasks.workunit.client.3.smithi157.stdout: 9.20 99.6k 96.0k 0.0k 996.0k 960.0k 0.0k nvme2n19 2024-03-26T17:06:23.073 INFO:tasks.workunit.client.3.smithi157.stdout: 9.30 88.8k 105.6k 0.0k 888.0k 1.0M 0.0k nvme2n2 2024-03-26T17:06:23.073 INFO:tasks.workunit.client.3.smithi157.stdout: 9.20 136.0k 168.4k 0.0k 1.3M 1.6M 0.0k nvme2n20 2024-03-26T17:06:23.073 INFO:tasks.workunit.client.3.smithi157.stdout: 9.30 65.2k 86.4k 0.0k 652.0k 864.0k 0.0k nvme2n3 2024-03-26T17:06:23.073 INFO:tasks.workunit.client.3.smithi157.stdout: 9.30 106.0k 145.6k 0.0k 1.0M 1.4M 0.0k nvme2n4 2024-03-26T17:06:23.073 INFO:tasks.workunit.client.3.smithi157.stdout: 9.30 91.2k 79.6k 0.0k 912.0k 796.0k 0.0k nvme2n5 2024-03-26T17:06:23.073 INFO:tasks.workunit.client.3.smithi157.stdout: 9.30 117.2k 139.6k 0.0k 1.1M 1.4M 0.0k nvme2n6 2024-03-26T17:06:23.073 INFO:tasks.workunit.client.3.smithi157.stdout: 9.30 122.8k 131.6k 0.0k 1.2M 1.3M 0.0k nvme2n7 2024-03-26T17:06:23.073 INFO:tasks.workunit.client.3.smithi157.stdout: 9.30 137.2k 84.8k 0.0k 1.3M 848.0k 0.0k nvme2n8 2024-03-26T17:06:23.073 INFO:tasks.workunit.client.3.smithi157.stdout: 9.30 96.0k 102.0k 0.0k 960.0k 1020.0k 0.0k nvme2n9 2024-03-26T17:06:23.074 INFO:tasks.workunit.client.3.smithi157.stdout: 9.30 149.2k 135.6k 0.0k 1.5M 1.3M 0.0k nvme5n1 2024-03-26T17:06:23.074 INFO:tasks.workunit.client.3.smithi157.stdout: 9.30 79.6k 115.2k 0.0k 796.0k 1.1M 0.0k nvme5n10 2024-03-26T17:06:23.074 INFO:tasks.workunit.client.3.smithi157.stdout: 9.30 115.6k 98.4k 0.0k 1.1M 984.0k 0.0k nvme5n11 2024-03-26T17:06:23.074 INFO:tasks.workunit.client.3.smithi157.stdout: 9.30 79.6k 95.2k 0.0k 796.0k 952.0k 0.0k nvme5n12 2024-03-26T17:06:23.074 INFO:tasks.workunit.client.3.smithi157.stdout: 9.30 105.2k 77.2k 0.0k 1.0M 772.0k 0.0k nvme5n13 2024-03-26T17:06:23.074 INFO:tasks.workunit.client.3.smithi157.stdout: 9.30 94.4k 74.0k 0.0k 944.0k 740.0k 0.0k nvme5n14 2024-03-26T17:06:23.074 INFO:tasks.workunit.client.3.smithi157.stdout: 9.30 96.0k 54.4k 0.0k 960.0k 544.0k 0.0k nvme5n15 2024-03-26T17:06:23.074 INFO:tasks.workunit.client.3.smithi157.stdout: 9.30 126.8k 114.4k 0.0k 1.2M 1.1M 0.0k nvme5n16 2024-03-26T17:06:23.074 INFO:tasks.workunit.client.3.smithi157.stdout: 9.30 114.4k 128.8k 0.0k 1.1M 1.3M 0.0k nvme5n17 2024-03-26T17:06:23.074 INFO:tasks.workunit.client.3.smithi157.stdout: 9.30 90.0k 76.8k 0.0k 900.0k 768.0k 0.0k nvme5n18 2024-03-26T17:06:23.074 INFO:tasks.workunit.client.3.smithi157.stdout: 9.20 66.8k 86.8k 0.0k 668.0k 868.0k 0.0k nvme5n19 2024-03-26T17:06:23.074 INFO:tasks.workunit.client.3.smithi157.stdout: 9.30 113.6k 122.0k 0.0k 1.1M 1.2M 0.0k nvme5n2 2024-03-26T17:06:23.074 INFO:tasks.workunit.client.3.smithi157.stdout: 9.20 79.6k 87.2k 0.0k 796.0k 872.0k 0.0k nvme5n20 2024-03-26T17:06:23.075 INFO:tasks.workunit.client.3.smithi157.stdout: 9.30 92.0k 91.6k 0.0k 920.0k 916.0k 0.0k nvme5n3 2024-03-26T17:06:23.075 INFO:tasks.workunit.client.3.smithi157.stdout: 9.30 113.2k 69.2k 0.0k 1.1M 692.0k 0.0k nvme5n4 2024-03-26T17:06:23.075 INFO:tasks.workunit.client.3.smithi157.stdout: 9.30 118.4k 83.2k 0.0k 1.2M 832.0k 0.0k nvme5n5 2024-03-26T17:06:23.075 INFO:tasks.workunit.client.3.smithi157.stdout: 9.30 82.8k 87.2k 0.0k 828.0k 872.0k 0.0k nvme5n6 2024-03-26T17:06:23.075 INFO:tasks.workunit.client.3.smithi157.stdout: 9.30 118.0k 109.2k 0.0k 1.2M 1.1M 0.0k nvme5n7 2024-03-26T17:06:23.075 INFO:tasks.workunit.client.3.smithi157.stdout: 9.30 107.2k 79.2k 0.0k 1.0M 792.0k 0.0k nvme5n8 2024-03-26T17:06:23.075 INFO:tasks.workunit.client.3.smithi157.stdout: 9.30 128.4k 120.8k 0.0k 1.3M 1.2M 0.0k nvme5n9 2024-03-26T17:06:23.075 INFO:tasks.workunit.client.3.smithi157.stdout: 9.30 76.0k 86.0k 0.0k 760.0k 860.0k 0.0k nvme8n1 2024-03-26T17:06:23.075 INFO:tasks.workunit.client.3.smithi157.stdout: 9.30 104.0k 126.8k 0.0k 1.0M 1.2M 0.0k nvme8n10 2024-03-26T17:06:23.075 INFO:tasks.workunit.client.3.smithi157.stdout: 9.30 94.4k 100.0k 0.0k 944.0k 1000.0k 0.0k nvme8n11 2024-03-26T17:06:23.075 INFO:tasks.workunit.client.3.smithi157.stdout: 9.30 106.8k 87.6k 0.0k 1.0M 876.0k 0.0k nvme8n12 2024-03-26T17:06:23.075 INFO:tasks.workunit.client.3.smithi157.stdout: 9.30 99.6k 65.6k 0.0k 996.0k 656.0k 0.0k nvme8n13 2024-03-26T17:06:23.075 INFO:tasks.workunit.client.3.smithi157.stdout: 9.30 118.4k 131.6k 0.0k 1.2M 1.3M 0.0k nvme8n14 2024-03-26T17:06:23.076 INFO:tasks.workunit.client.3.smithi157.stdout: 9.30 95.2k 82.0k 0.0k 952.0k 820.0k 0.0k nvme8n15 2024-03-26T17:06:23.076 INFO:tasks.workunit.client.3.smithi157.stdout: 9.30 113.6k 163.2k 0.0k 1.1M 1.6M 0.0k nvme8n16 2024-03-26T17:06:23.076 INFO:tasks.workunit.client.3.smithi157.stdout: 9.30 82.8k 87.6k 0.0k 828.0k 876.0k 0.0k nvme8n17 2024-03-26T17:06:23.076 INFO:tasks.workunit.client.3.smithi157.stdout: 9.20 93.6k 71.6k 0.0k 936.0k 716.0k 0.0k nvme8n18 2024-03-26T17:06:23.076 INFO:tasks.workunit.client.3.smithi157.stdout: 9.20 90.4k 60.8k 0.0k 904.0k 608.0k 0.0k nvme8n19 2024-03-26T17:06:23.076 INFO:tasks.workunit.client.3.smithi157.stdout: 9.30 100.4k 97.2k 0.0k 1004.0k 972.0k 0.0k nvme8n2 2024-03-26T17:06:23.076 INFO:tasks.workunit.client.3.smithi157.stdout: 9.30 99.2k 140.0k 0.0k 992.0k 1.4M 0.0k nvme8n20 2024-03-26T17:06:23.076 INFO:tasks.workunit.client.3.smithi157.stdout: 9.30 101.2k 81.2k 0.0k 1012.0k 812.0k 0.0k nvme8n3 2024-03-26T17:06:23.076 INFO:tasks.workunit.client.3.smithi157.stdout: 9.30 86.4k 86.0k 0.0k 864.0k 860.0k 0.0k nvme8n4 2024-03-26T17:06:23.076 INFO:tasks.workunit.client.3.smithi157.stdout: 9.30 69.6k 108.0k 0.0k 696.0k 1.1M 0.0k nvme8n5 2024-03-26T17:06:23.076 INFO:tasks.workunit.client.3.smithi157.stdout: 9.30 101.6k 102.4k 0.0k 1016.0k 1.0M 0.0k nvme8n6 2024-03-26T17:06:23.076 INFO:tasks.workunit.client.3.smithi157.stdout: 9.30 97.2k 104.4k 0.0k 972.0k 1.0M 0.0k nvme8n7 2024-03-26T17:06:23.076 INFO:tasks.workunit.client.3.smithi157.stdout: 9.30 99.2k 95.6k 0.0k 992.0k 956.0k 0.0k nvme8n8 2024-03-26T17:06:23.077 INFO:tasks.workunit.client.3.smithi157.stdout: 9.30 64.8k 99.2k 0.0k 648.0k 992.0k 0.0k nvme8n9 2024-03-26T17:06:23.077 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:06:23.323 INFO:tasks.workunit.client.3.smithi157.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-26T17:06:23.323 INFO:tasks.workunit.client.3.smithi157.stdout:myimage6 6/s 3/s 155 KiB/s 106 KiB/s 2.25 ms 326.68 us 2024-03-26T17:06:23.323 INFO:tasks.workunit.client.3.smithi157.stdout:myimage12 6/s 3/s 92 KiB/s 36 KiB/s 2.11 ms 381.74 us 2024-03-26T17:06:23.323 INFO:tasks.workunit.client.3.smithi157.stdout:myimage19 5/s 3/s 125 KiB/s 76 KiB/s 1.96 ms 325.41 us 2024-03-26T17:06:23.324 INFO:tasks.workunit.client.3.smithi157.stdout:myimage21 5/s 5/s 169 KiB/s 174 KiB/s 2.57 ms 325.85 us 2024-03-26T17:06:23.324 INFO:tasks.workunit.client.3.smithi157.stdout:myimage4 5/s 3/s 138 KiB/s 96 KiB/s 2.18 ms 297.07 us 2024-03-26T17:06:23.324 INFO:tasks.workunit.client.3.smithi157.stdout:myimage20 5/s 4/s 176 KiB/s 146 KiB/s 7.44 ms 338.41 us 2024-03-26T17:06:23.324 INFO:tasks.workunit.client.3.smithi157.stdout:myimage56 5/s 4/s 198 KiB/s 106 KiB/s 2.42 ms 339.26 us 2024-03-26T17:06:23.324 INFO:tasks.workunit.client.3.smithi157.stdout:myimage60 5/s 4/s 128 KiB/s 102 KiB/s 2.14 ms 323.48 us 2024-03-26T17:06:23.324 INFO:tasks.workunit.client.3.smithi157.stdout:myimage2 5/s 4/s 96 KiB/s 105 KiB/s 2.04 ms 323.64 us 2024-03-26T17:06:23.324 INFO:tasks.workunit.client.3.smithi157.stdout:myimage16 5/s 6/s 108 KiB/s 104 KiB/s 1.85 ms 376.76 us 2024-03-26T17:06:23.324 INFO:tasks.workunit.client.3.smithi157.stdout:myimage22 5/s 5/s 146 KiB/s 109 KiB/s 2.29 ms 329.64 us 2024-03-26T17:06:23.324 INFO:tasks.workunit.client.3.smithi157.stdout:myimage42 5/s 4/s 102 KiB/s 97 KiB/s 2.08 ms 335.74 us 2024-03-26T17:06:23.324 INFO:tasks.workunit.client.3.smithi157.stdout:myimage50 5/s 2/s 138 KiB/s 84 KiB/s 2.35 ms 471.25 us 2024-03-26T17:06:23.324 INFO:tasks.workunit.client.3.smithi157.stdout:myimage3 5/s 4/s 87 KiB/s 69 KiB/s 1.74 ms 311.73 us 2024-03-26T17:06:23.324 INFO:tasks.workunit.client.3.smithi157.stdout:myimage14 5/s 3/s 93 KiB/s 58 KiB/s 2.23 ms 354.40 us 2024-03-26T17:06:23.325 INFO:tasks.workunit.client.3.smithi157.stdout:myimage49 5/s 4/s 90 KiB/s 91 KiB/s 1.99 ms 390.92 us 2024-03-26T17:06:23.325 INFO:tasks.workunit.client.3.smithi157.stdout:myimage17 5/s 4/s 100 KiB/s 92 KiB/s 2.05 ms 451.50 us 2024-03-26T17:06:23.325 INFO:tasks.workunit.client.3.smithi157.stdout:myimage44 5/s 4/s 95 KiB/s 94 KiB/s 2.10 ms 445.77 us 2024-03-26T17:06:23.325 INFO:tasks.workunit.client.3.smithi157.stdout:myimage39 5/s 4/s 98 KiB/s 71 KiB/s 1.92 ms 310.63 us 2024-03-26T17:06:23.325 INFO:tasks.workunit.client.3.smithi157.stdout:myimage41 5/s 4/s 68 KiB/s 77 KiB/s 2.10 ms 308.42 us 2024-03-26T17:06:23.325 INFO:tasks.workunit.client.3.smithi157.stdout:myimage43 5/s 3/s 79 KiB/s 78 KiB/s 2.25 ms 328.00 us 2024-03-26T17:06:23.325 INFO:tasks.workunit.client.3.smithi157.stdout:myimage46 5/s 5/s 126 KiB/s 106 KiB/s 2.01 ms 424.67 us 2024-03-26T17:06:23.325 INFO:tasks.workunit.client.3.smithi157.stdout:myimage13 4/s 3/s 117 KiB/s 104 KiB/s 1.70 ms 475.74 us 2024-03-26T17:06:23.326 INFO:tasks.workunit.client.3.smithi157.stdout:myimage23 4/s 5/s 86 KiB/s 97 KiB/s 1.93 ms 303.88 us 2024-03-26T17:06:23.326 INFO:tasks.workunit.client.3.smithi157.stdout:myimage34 4/s 4/s 73 KiB/s 85 KiB/s 1.98 ms 306.53 us 2024-03-26T17:06:23.326 INFO:tasks.workunit.client.3.smithi157.stdout:myimage15 4/s 5/s 122 KiB/s 119 KiB/s 1.71 ms 338.85 us 2024-03-26T17:06:23.326 INFO:tasks.workunit.client.3.smithi157.stdout:myimage32 4/s 4/s 86 KiB/s 82 KiB/s 2.08 ms 339.85 us 2024-03-26T17:06:23.326 INFO:tasks.workunit.client.3.smithi157.stdout:myimage47 4/s 3/s 90 KiB/s 75 KiB/s 2.17 ms 301.63 us 2024-03-26T17:06:23.326 INFO:tasks.workunit.client.3.smithi157.stdout:myimage1 4/s 5/s 94 KiB/s 139 KiB/s 1.78 ms 333.75 us 2024-03-26T17:06:23.326 INFO:tasks.workunit.client.3.smithi157.stdout:myimage7 4/s 6/s 145 KiB/s 166 KiB/s 2.20 ms 358.35 us 2024-03-26T17:06:23.326 INFO:tasks.workunit.client.3.smithi157.stdout:myimage8 4/s 5/s 94 KiB/s 126 KiB/s 2.02 ms 317.91 us 2024-03-26T17:06:23.327 INFO:tasks.workunit.client.3.smithi157.stdout:myimage9 4/s 4/s 87 KiB/s 84 KiB/s 2.27 ms 390.88 us 2024-03-26T17:06:23.327 INFO:tasks.workunit.client.3.smithi157.stdout:myimage11 4/s 6/s 82 KiB/s 96 KiB/s 2.02 ms 265.47 us 2024-03-26T17:06:23.327 INFO:tasks.workunit.client.3.smithi157.stdout:myimage18 4/s 4/s 82 KiB/s 68 KiB/s 1.85 ms 288.88 us 2024-03-26T17:06:23.327 INFO:tasks.workunit.client.3.smithi157.stdout:myimage51 4/s 5/s 93 KiB/s 115 KiB/s 2.29 ms 328.44 us 2024-03-26T17:06:23.327 INFO:tasks.workunit.client.3.smithi157.stdout:myimage54 4/s 5/s 131 KiB/s 160 KiB/s 2.09 ms 412.88 us 2024-03-26T17:06:23.327 INFO:tasks.workunit.client.3.smithi157.stdout:myimage55 4/s 5/s 61 KiB/s 99 KiB/s 2.22 ms 369.42 us 2024-03-26T17:06:23.327 INFO:tasks.workunit.client.3.smithi157.stdout:myimage24 4/s 5/s 78 KiB/s 144 KiB/s 2.02 ms 321.09 us 2024-03-26T17:06:23.327 INFO:tasks.workunit.client.3.smithi157.stdout:myimage29 4/s 2/s 122 KiB/s 80 KiB/s 1.95 ms 458.11 us 2024-03-26T17:06:23.327 INFO:tasks.workunit.client.3.smithi157.stdout:myimage59 4/s 5/s 65 KiB/s 87 KiB/s 2.40 ms 397.59 us 2024-03-26T17:06:23.327 INFO:tasks.workunit.client.3.smithi157.stdout:myimage35 4/s 5/s 72 KiB/s 99 KiB/s 2.15 ms 328.04 us 2024-03-26T17:06:23.327 INFO:tasks.workunit.client.3.smithi157.stdout:myimage52 4/s 5/s 70 KiB/s 123 KiB/s 2.25 ms 402.84 us 2024-03-26T17:06:23.327 INFO:tasks.workunit.client.3.smithi157.stdout:myimage58 4/s 4/s 63 KiB/s 74 KiB/s 2.12 ms 321.09 us 2024-03-26T17:06:23.328 INFO:tasks.workunit.client.3.smithi157.stdout:myimage27 4/s 6/s 102 KiB/s 148 KiB/s 2.02 ms 390.72 us 2024-03-26T17:06:23.328 INFO:tasks.workunit.client.3.smithi157.stdout:myimage30 3/s 5/s 103 KiB/s 95 KiB/s 2.34 ms 359.54 us 2024-03-26T17:06:23.328 INFO:tasks.workunit.client.3.smithi157.stdout:myimage37 3/s 3/s 90 KiB/s 109 KiB/s 1.92 ms 307.97 us 2024-03-26T17:06:23.328 INFO:tasks.workunit.client.3.smithi157.stdout:myimage38 3/s 4/s 60 KiB/s 79 KiB/s 1.76 ms 314.76 us 2024-03-26T17:06:23.328 INFO:tasks.workunit.client.3.smithi157.stdout:myimage40 3/s 4/s 65 KiB/s 82 KiB/s 1.95 ms 379.56 us 2024-03-26T17:06:23.328 INFO:tasks.workunit.client.3.smithi157.stdout:myimage45 3/s 4/s 57 KiB/s 82 KiB/s 1.87 ms 420.63 us 2024-03-26T17:06:23.328 INFO:tasks.workunit.client.3.smithi157.stdout:myimage53 3/s 5/s 66 KiB/s 93 KiB/s 1.86 ms 326.28 us 2024-03-26T17:06:23.328 INFO:tasks.workunit.client.3.smithi157.stdout:myimage57 3/s 5/s 75 KiB/s 89 KiB/s 1.89 ms 330.74 us 2024-03-26T17:06:23.328 INFO:tasks.workunit.client.3.smithi157.stdout:myimage26 3/s 6/s 70 KiB/s 97 KiB/s 2.07 ms 389.46 us 2024-03-26T17:06:23.328 INFO:tasks.workunit.client.3.smithi157.stdout:myimage33 3/s 6/s 72 KiB/s 114 KiB/s 2.04 ms 337.29 us 2024-03-26T17:06:23.328 INFO:tasks.workunit.client.3.smithi157.stdout:myimage10 3/s 4/s 72 KiB/s 99 KiB/s 2.07 ms 362.05 us 2024-03-26T17:06:23.328 INFO:tasks.workunit.client.3.smithi157.stdout:myimage28 3/s 5/s 62 KiB/s 108 KiB/s 2.77 ms 472.10 us 2024-03-26T17:06:23.328 INFO:tasks.workunit.client.3.smithi157.stdout:myimage31 3/s 4/s 92 KiB/s 93 KiB/s 2.58 ms 316.47 us 2024-03-26T17:06:23.328 INFO:tasks.workunit.client.3.smithi157.stdout:myimage5 3/s 4/s 43 KiB/s 74 KiB/s 2.11 ms 423.13 us 2024-03-26T17:06:23.329 INFO:tasks.workunit.client.3.smithi157.stdout:myimage36 3/s 3/s 86 KiB/s 96 KiB/s 2.00 ms 314.39 us 2024-03-26T17:06:23.329 INFO:tasks.workunit.client.3.smithi157.stdout:myimage25 2/s 5/s 62 KiB/s 95 KiB/s 2.35 ms 330.45 us 2024-03-26T17:06:23.329 INFO:tasks.workunit.client.3.smithi157.stdout:myimage48 2/s 3/s 61 KiB/s 74 KiB/s 1.92 ms 316.36 us 2024-03-26T17:06:23.329 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:06:24.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:06:23 smithi044 ceph-mon[30624]: pgmap v613: 33 pgs: 33 active+clean; 1.0 GiB data, 3.6 GiB used, 712 GiB / 715 GiB avail; 5.3 MiB/s rd, 5.3 MiB/s wr, 540 op/s 2024-03-26T17:06:24.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:06:23 smithi044 ceph-mon[30624]: Health check update: 3 slow ops, oldest one blocked for 478 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:06:24.266 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:06:24 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:06:24] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:06:24.266 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:06:24 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:06:24] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:06:24.266 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:06:24 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:06:24.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:06:23 smithi064 ceph-mon[34420]: pgmap v613: 33 pgs: 33 active+clean; 1.0 GiB data, 3.6 GiB used, 712 GiB / 715 GiB avail; 5.3 MiB/s rd, 5.3 MiB/s wr, 540 op/s 2024-03-26T17:06:24.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:06:23 smithi064 ceph-mon[34420]: Health check update: 3 slow ops, oldest one blocked for 478 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:06:24.341 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:06:23 smithi149 ceph-mon[34678]: pgmap v613: 33 pgs: 33 active+clean; 1.0 GiB data, 3.6 GiB used, 712 GiB / 715 GiB avail; 5.3 MiB/s rd, 5.3 MiB/s wr, 540 op/s 2024-03-26T17:06:24.341 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:06:23 smithi149 ceph-mon[34678]: Health check update: 3 slow ops, oldest one blocked for 478 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:06:24.646 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:06:24 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:06:24] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:06:24.646 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:06:24 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:06:24] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:06:24.647 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:06:24 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:06:25.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:06:24 smithi044 ceph-mon[30624]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:06:25.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:06:24 smithi044 ceph-mon[30624]: { 2024-03-26T17:06:25.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:06:24 smithi044 ceph-mon[30624]: "prefix": "rbd perf image stats", 2024-03-26T17:06:25.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:06:24 smithi044 ceph-mon[30624]: "pool_spec": "mypool", 2024-03-26T17:06:25.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:06:24 smithi044 ceph-mon[30624]: "sort_by": "write_ops", 2024-03-26T17:06:25.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:06:24 smithi044 ceph-mon[30624]: "format": "json" 2024-03-26T17:06:25.266 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:06:24 smithi044 ceph-mon[30624]: }"]: dispatch 2024-03-26T17:06:25.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:06:24 smithi064 ceph-mon[34420]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:06:25.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:06:24 smithi064 ceph-mon[34420]: { 2024-03-26T17:06:25.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:06:24 smithi064 ceph-mon[34420]: "prefix": "rbd perf image stats", 2024-03-26T17:06:25.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:06:24 smithi064 ceph-mon[34420]: "pool_spec": "mypool", 2024-03-26T17:06:25.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:06:24 smithi064 ceph-mon[34420]: "sort_by": "write_ops", 2024-03-26T17:06:25.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:06:24 smithi064 ceph-mon[34420]: "format": "json" 2024-03-26T17:06:25.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:06:24 smithi064 ceph-mon[34420]: }"]: dispatch 2024-03-26T17:06:25.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:06:24 smithi149 ceph-mon[34678]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:06:25.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:06:24 smithi149 ceph-mon[34678]: { 2024-03-26T17:06:25.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:06:24 smithi149 ceph-mon[34678]: "prefix": "rbd perf image stats", 2024-03-26T17:06:25.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:06:24 smithi149 ceph-mon[34678]: "pool_spec": "mypool", 2024-03-26T17:06:25.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:06:24 smithi149 ceph-mon[34678]: "sort_by": "write_ops", 2024-03-26T17:06:25.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:06:24 smithi149 ceph-mon[34678]: "format": "json" 2024-03-26T17:06:25.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:06:24 smithi149 ceph-mon[34678]: }"]: dispatch 2024-03-26T17:06:26.228 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:06:25 smithi149 ceph-mon[34678]: pgmap v614: 33 pgs: 33 active+clean; 1.0 GiB data, 3.6 GiB used, 712 GiB / 715 GiB avail; 5.8 MiB/s rd, 5.7 MiB/s wr, 566 op/s 2024-03-26T17:06:26.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:06:25 smithi044 ceph-mon[30624]: pgmap v614: 33 pgs: 33 active+clean; 1.0 GiB data, 3.6 GiB used, 712 GiB / 715 GiB avail; 5.8 MiB/s rd, 5.7 MiB/s wr, 566 op/s 2024-03-26T17:06:26.265 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:06:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:06:26] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:06:26.265 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:06:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:06:26] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:06:26.266 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:06:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:06:26.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:06:25 smithi064 ceph-mon[34420]: pgmap v614: 33 pgs: 33 active+clean; 1.0 GiB data, 3.6 GiB used, 712 GiB / 715 GiB avail; 5.8 MiB/s rd, 5.7 MiB/s wr, 566 op/s 2024-03-26T17:06:26.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:06:26 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 2024-03-26T17:06:26.227+0000 7fa707a55700 -1 mon.c@1(peon) e3 get_health_metrics reporting 3 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T17:06:26.646 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:06:26 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:06:26] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:06:26.646 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:06:26 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:06:26] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:06:26.647 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:06:26 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:06:28.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:06:27 smithi044 ceph-mon[30624]: pgmap v615: 33 pgs: 33 active+clean; 1.0 GiB data, 3.7 GiB used, 712 GiB / 715 GiB avail; 5.7 MiB/s rd, 5.8 MiB/s wr, 544 op/s 2024-03-26T17:06:28.265 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:06:28 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:06:28] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:06:28.265 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:06:28 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:06:28] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:06:28.266 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:06:28 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:06:28.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:06:27 smithi064 ceph-mon[34420]: pgmap v615: 33 pgs: 33 active+clean; 1.0 GiB data, 3.7 GiB used, 712 GiB / 715 GiB avail; 5.7 MiB/s rd, 5.8 MiB/s wr, 544 op/s 2024-03-26T17:06:28.328 INFO:tasks.workunit.client.3.smithi157.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-26T17:06:28.328 INFO:tasks.workunit.client.3.smithi157.stdout:myimage44 6/s 5/s 102 KiB/s 109 KiB/s 1.99 ms 323.07 us 2024-03-26T17:06:28.328 INFO:tasks.workunit.client.3.smithi157.stdout:myimage2 6/s 4/s 169 KiB/s 118 KiB/s 2.12 ms 469.98 us 2024-03-26T17:06:28.328 INFO:tasks.workunit.client.3.smithi157.stdout:myimage16 6/s 2/s 170 KiB/s 68 KiB/s 2.13 ms 332.25 us 2024-03-26T17:06:28.328 INFO:tasks.workunit.client.3.smithi157.stdout:myimage9 6/s 4/s 189 KiB/s 132 KiB/s 2.22 ms 343.92 us 2024-03-26T17:06:28.329 INFO:tasks.workunit.client.3.smithi157.stdout:myimage14 6/s 2/s 128 KiB/s 62 KiB/s 1.96 ms 324.02 us 2024-03-26T17:06:28.329 INFO:tasks.workunit.client.3.smithi157.stdout:myimage32 6/s 5/s 106 KiB/s 82 KiB/s 2.09 ms 393.57 us 2024-03-26T17:06:28.329 INFO:tasks.workunit.client.3.smithi157.stdout:myimage49 6/s 2/s 98 KiB/s 50 KiB/s 1.98 ms 415.36 us 2024-03-26T17:06:28.329 INFO:tasks.workunit.client.3.smithi157.stdout:myimage5 6/s 4/s 145 KiB/s 142 KiB/s 2.09 ms 339.65 us 2024-03-26T17:06:28.329 INFO:tasks.workunit.client.3.smithi157.stdout:myimage28 6/s 5/s 90 KiB/s 124 KiB/s 2.52 ms 447.63 us 2024-03-26T17:06:28.329 INFO:tasks.workunit.client.3.smithi157.stdout:myimage7 5/s 3/s 173 KiB/s 122 KiB/s 2.21 ms 372.61 us 2024-03-26T17:06:28.329 INFO:tasks.workunit.client.3.smithi157.stdout:myimage19 5/s 6/s 114 KiB/s 121 KiB/s 2.02 ms 512.62 us 2024-03-26T17:06:28.329 INFO:tasks.workunit.client.3.smithi157.stdout:myimage3 5/s 3/s 179 KiB/s 86 KiB/s 1.78 ms 451.41 us 2024-03-26T17:06:28.329 INFO:tasks.workunit.client.3.smithi157.stdout:myimage60 5/s 4/s 174 KiB/s 104 KiB/s 2.31 ms 412.92 us 2024-03-26T17:06:28.329 INFO:tasks.workunit.client.3.smithi157.stdout:myimage23 5/s 5/s 87 KiB/s 92 KiB/s 1.61 ms 363.27 us 2024-03-26T17:06:28.329 INFO:tasks.workunit.client.3.smithi157.stdout:myimage31 5/s 5/s 178 KiB/s 121 KiB/s 2.36 ms 371.58 us 2024-03-26T17:06:28.329 INFO:tasks.workunit.client.3.smithi157.stdout:myimage25 5/s 4/s 165 KiB/s 115 KiB/s 2.47 ms 362.85 us 2024-03-26T17:06:28.329 INFO:tasks.workunit.client.3.smithi157.stdout:myimage27 5/s 2/s 137 KiB/s 77 KiB/s 1.85 ms 345.68 us 2024-03-26T17:06:28.329 INFO:tasks.workunit.client.3.smithi157.stdout:myimage29 5/s 5/s 148 KiB/s 171 KiB/s 1.87 ms 438.23 us 2024-03-26T17:06:28.329 INFO:tasks.workunit.client.3.smithi157.stdout:myimage41 5/s 3/s 130 KiB/s 82 KiB/s 2.05 ms 292.08 us 2024-03-26T17:06:28.330 INFO:tasks.workunit.client.3.smithi157.stdout:myimage13 5/s 3/s 194 KiB/s 122 KiB/s 1.94 ms 369.10 us 2024-03-26T17:06:28.330 INFO:tasks.workunit.client.3.smithi157.stdout:myimage47 5/s 4/s 160 KiB/s 111 KiB/s 2.18 ms 331.14 us 2024-03-26T17:06:28.330 INFO:tasks.workunit.client.3.smithi157.stdout:myimage48 5/s 4/s 166 KiB/s 122 KiB/s 2.28 ms 319.85 us 2024-03-26T17:06:28.330 INFO:tasks.workunit.client.3.smithi157.stdout:myimage21 5/s 4/s 166 KiB/s 159 KiB/s 2.48 ms 383.89 us 2024-03-26T17:06:28.330 INFO:tasks.workunit.client.3.smithi157.stdout:myimage56 5/s 4/s 147 KiB/s 134 KiB/s 2.33 ms 410.91 us 2024-03-26T17:06:28.330 INFO:tasks.workunit.client.3.smithi157.stdout:myimage57 5/s 3/s 98 KiB/s 71 KiB/s 2.27 ms 324.82 us 2024-03-26T17:06:28.330 INFO:tasks.workunit.client.3.smithi157.stdout:myimage58 4/s 5/s 90 KiB/s 118 KiB/s 1.99 ms 357.80 us 2024-03-26T17:06:28.330 INFO:tasks.workunit.client.3.smithi157.stdout:myimage6 4/s 4/s 151 KiB/s 150 KiB/s 2.09 ms 381.10 us 2024-03-26T17:06:28.330 INFO:tasks.workunit.client.3.smithi157.stdout:myimage8 4/s 3/s 147 KiB/s 114 KiB/s 2.06 ms 302.18 us 2024-03-26T17:06:28.330 INFO:tasks.workunit.client.3.smithi157.stdout:myimage24 4/s 5/s 82 KiB/s 103 KiB/s 2.09 ms 379.35 us 2024-03-26T17:06:28.330 INFO:tasks.workunit.client.3.smithi157.stdout:myimage42 4/s 5/s 135 KiB/s 198 KiB/s 2.00 ms 500.71 us 2024-03-26T17:06:28.330 INFO:tasks.workunit.client.3.smithi157.stdout:myimage55 4/s 4/s 97 KiB/s 69 KiB/s 2.21 ms 333.65 us 2024-03-26T17:06:28.330 INFO:tasks.workunit.client.3.smithi157.stdout:myimage52 4/s 3/s 135 KiB/s 107 KiB/s 2.30 ms 326.19 us 2024-03-26T17:06:28.330 INFO:tasks.workunit.client.3.smithi157.stdout:myimage12 4/s 5/s 78 KiB/s 106 KiB/s 2.20 ms 351.04 us 2024-03-26T17:06:28.331 INFO:tasks.workunit.client.3.smithi157.stdout:myimage46 4/s 4/s 145 KiB/s 153 KiB/s 2.06 ms 367.02 us 2024-03-26T17:06:28.331 INFO:tasks.workunit.client.3.smithi157.stdout:myimage50 4/s 4/s 153 KiB/s 152 KiB/s 2.27 ms 322.89 us 2024-03-26T17:06:28.331 INFO:tasks.workunit.client.3.smithi157.stdout:myimage53 4/s 4/s 57 KiB/s 73 KiB/s 1.89 ms 350.46 us 2024-03-26T17:06:28.331 INFO:tasks.workunit.client.3.smithi157.stdout:myimage54 4/s 5/s 148 KiB/s 154 KiB/s 1.97 ms 362.44 us 2024-03-26T17:06:28.331 INFO:tasks.workunit.client.3.smithi157.stdout:myimage37 4/s 4/s 174 KiB/s 134 KiB/s 2.19 ms 427.39 us 2024-03-26T17:06:28.331 INFO:tasks.workunit.client.3.smithi157.stdout:myimage4 4/s 4/s 170 KiB/s 114 KiB/s 1.98 ms 306.96 us 2024-03-26T17:06:28.331 INFO:tasks.workunit.client.3.smithi157.stdout:myimage26 4/s 2/s 68 KiB/s 42 KiB/s 2.11 ms 338.87 us 2024-03-26T17:06:28.331 INFO:tasks.workunit.client.3.smithi157.stdout:myimage51 4/s 5/s 147 KiB/s 113 KiB/s 2.12 ms 309.01 us 2024-03-26T17:06:28.331 INFO:tasks.workunit.client.3.smithi157.stdout:myimage30 4/s 4/s 106 KiB/s 118 KiB/s 2.47 ms 379.58 us 2024-03-26T17:06:28.331 INFO:tasks.workunit.client.3.smithi157.stdout:myimage40 4/s 4/s 68 KiB/s 92 KiB/s 1.98 ms 420.69 us 2024-03-26T17:06:28.331 INFO:tasks.workunit.client.3.smithi157.stdout:myimage1 4/s 4/s 110 KiB/s 154 KiB/s 1.72 ms 323.52 us 2024-03-26T17:06:28.331 INFO:tasks.workunit.client.3.smithi157.stdout:myimage20 4/s 4/s 136 KiB/s 110 KiB/s 1.91 ms 325.07 us 2024-03-26T17:06:28.331 INFO:tasks.workunit.client.3.smithi157.stdout:myimage59 4/s 4/s 85 KiB/s 71 KiB/s 2.23 ms 403.41 us 2024-03-26T17:06:28.331 INFO:tasks.workunit.client.3.smithi157.stdout:myimage34 4/s 5/s 82 KiB/s 105 KiB/s 2.00 ms 321.40 us 2024-03-26T17:06:28.331 INFO:tasks.workunit.client.3.smithi157.stdout:myimage11 4/s 3/s 85 KiB/s 53 KiB/s 2.17 ms 334.85 us 2024-03-26T17:06:28.331 INFO:tasks.workunit.client.3.smithi157.stdout:myimage18 4/s 6/s 89 KiB/s 167 KiB/s 1.90 ms 326.40 us 2024-03-26T17:06:28.331 INFO:tasks.workunit.client.3.smithi157.stdout:myimage36 4/s 5/s 132 KiB/s 182 KiB/s 1.94 ms 382.34 us 2024-03-26T17:06:28.332 INFO:tasks.workunit.client.3.smithi157.stdout:myimage39 4/s 3/s 87 KiB/s 68 KiB/s 1.88 ms 317.47 us 2024-03-26T17:06:28.332 INFO:tasks.workunit.client.3.smithi157.stdout:myimage45 4/s 3/s 106 KiB/s 52 KiB/s 2.16 ms 299.37 us 2024-03-26T17:06:28.332 INFO:tasks.workunit.client.3.smithi157.stdout:myimage15 3/s 4/s 128 KiB/s 130 KiB/s 1.87 ms 398.44 us 2024-03-26T17:06:28.332 INFO:tasks.workunit.client.3.smithi157.stdout:myimage17 3/s 5/s 85 KiB/s 121 KiB/s 2.11 ms 322.50 us 2024-03-26T17:06:28.332 INFO:tasks.workunit.client.3.smithi157.stdout:myimage33 3/s 4/s 51 KiB/s 99 KiB/s 1.95 ms 331.72 us 2024-03-26T17:06:28.332 INFO:tasks.workunit.client.3.smithi157.stdout:myimage10 3/s 5/s 97 KiB/s 201 KiB/s 2.01 ms 411.43 us 2024-03-26T17:06:28.332 INFO:tasks.workunit.client.3.smithi157.stdout:myimage22 3/s 4/s 130 KiB/s 138 KiB/s 2.16 ms 318.89 us 2024-03-26T17:06:28.332 INFO:tasks.workunit.client.3.smithi157.stdout:myimage43 3/s 4/s 56 KiB/s 102 KiB/s 2.18 ms 355.05 us 2024-03-26T17:06:28.332 INFO:tasks.workunit.client.3.smithi157.stdout:myimage38 3/s 5/s 67 KiB/s 121 KiB/s 1.88 ms 346.43 us 2024-03-26T17:06:28.332 INFO:tasks.workunit.client.3.smithi157.stdout:myimage35 2/s 4/s 37 KiB/s 62 KiB/s 2.06 ms 305.14 us 2024-03-26T17:06:28.332 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:06:28.365 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:06:27 smithi149 ceph-mon[34678]: pgmap v615: 33 pgs: 33 active+clean; 1.0 GiB data, 3.7 GiB used, 712 GiB / 715 GiB avail; 5.7 MiB/s rd, 5.8 MiB/s wr, 544 op/s 2024-03-26T17:06:28.646 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:06:28 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:06:28] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:06:28.647 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:06:28 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:06:28] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:06:28.647 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:06:28 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:06:29.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:06:28 smithi044 ceph-mon[30624]: Health check update: 3 slow ops, oldest one blocked for 483 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:06:29.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:06:28 smithi064 ceph-mon[34420]: Health check update: 3 slow ops, oldest one blocked for 483 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:06:29.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:06:28 smithi149 ceph-mon[34678]: Health check update: 3 slow ops, oldest one blocked for 483 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:06:30.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:06:29 smithi044 ceph-mon[30624]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:06:30.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:06:29 smithi044 ceph-mon[30624]: { 2024-03-26T17:06:30.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:06:29 smithi044 ceph-mon[30624]: "prefix": "rbd perf image stats", 2024-03-26T17:06:30.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:06:29 smithi044 ceph-mon[30624]: "pool_spec": "mypool", 2024-03-26T17:06:30.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:06:29 smithi044 ceph-mon[30624]: "sort_by": "write_ops", 2024-03-26T17:06:30.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:06:29 smithi044 ceph-mon[30624]: "format": "json" 2024-03-26T17:06:30.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:06:29 smithi044 ceph-mon[30624]: }"]: dispatch 2024-03-26T17:06:30.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:06:29 smithi044 ceph-mon[30624]: pgmap v616: 33 pgs: 33 active+clean; 1.0 GiB data, 3.7 GiB used, 712 GiB / 715 GiB avail; 6.3 MiB/s rd, 6.5 MiB/s wr, 571 op/s 2024-03-26T17:06:30.266 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:06:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:06:30] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:06:30.266 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:06:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:06:30] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:06:30.266 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:06:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:06:30.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:06:29 smithi064 ceph-mon[34420]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:06:30.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:06:29 smithi064 ceph-mon[34420]: { 2024-03-26T17:06:30.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:06:29 smithi064 ceph-mon[34420]: "prefix": "rbd perf image stats", 2024-03-26T17:06:30.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:06:29 smithi064 ceph-mon[34420]: "pool_spec": "mypool", 2024-03-26T17:06:30.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:06:29 smithi064 ceph-mon[34420]: "sort_by": "write_ops", 2024-03-26T17:06:30.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:06:29 smithi064 ceph-mon[34420]: "format": "json" 2024-03-26T17:06:30.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:06:29 smithi064 ceph-mon[34420]: }"]: dispatch 2024-03-26T17:06:30.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:06:29 smithi064 ceph-mon[34420]: pgmap v616: 33 pgs: 33 active+clean; 1.0 GiB data, 3.7 GiB used, 712 GiB / 715 GiB avail; 6.3 MiB/s rd, 6.5 MiB/s wr, 571 op/s 2024-03-26T17:06:30.378 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:06:29 smithi149 ceph-mon[34678]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:06:30.378 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:06:29 smithi149 ceph-mon[34678]: { 2024-03-26T17:06:30.378 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:06:29 smithi149 ceph-mon[34678]: "prefix": "rbd perf image stats", 2024-03-26T17:06:30.378 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:06:29 smithi149 ceph-mon[34678]: "pool_spec": "mypool", 2024-03-26T17:06:30.378 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:06:29 smithi149 ceph-mon[34678]: "sort_by": "write_ops", 2024-03-26T17:06:30.378 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:06:29 smithi149 ceph-mon[34678]: "format": "json" 2024-03-26T17:06:30.379 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:06:29 smithi149 ceph-mon[34678]: }"]: dispatch 2024-03-26T17:06:30.379 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:06:29 smithi149 ceph-mon[34678]: pgmap v616: 33 pgs: 33 active+clean; 1.0 GiB data, 3.7 GiB used, 712 GiB / 715 GiB avail; 6.3 MiB/s rd, 6.5 MiB/s wr, 571 op/s 2024-03-26T17:06:30.646 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:06:30 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:06:30] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:06:30.646 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:06:30 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:06:30] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:06:30.646 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:06:30 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:06:31.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:06:31 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 2024-03-26T17:06:31.228+0000 7fa707a55700 -1 mon.c@1(peon) e3 get_health_metrics reporting 3 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T17:06:32.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:06:31 smithi044 ceph-mon[30624]: pgmap v617: 33 pgs: 33 active+clean; 1.0 GiB data, 3.7 GiB used, 712 GiB / 715 GiB avail; 6.9 MiB/s rd, 7.1 MiB/s wr, 577 op/s 2024-03-26T17:06:32.266 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:06:32 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:06:32] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:06:32.266 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:06:32 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:06:32] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:06:32.266 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:06:32 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:06:32.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:06:31 smithi064 ceph-mon[34420]: pgmap v617: 33 pgs: 33 active+clean; 1.0 GiB data, 3.7 GiB used, 712 GiB / 715 GiB avail; 6.9 MiB/s rd, 7.1 MiB/s wr, 577 op/s 2024-03-26T17:06:32.390 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:06:31 smithi149 ceph-mon[34678]: pgmap v617: 33 pgs: 33 active+clean; 1.0 GiB data, 3.7 GiB used, 712 GiB / 715 GiB avail; 6.9 MiB/s rd, 7.1 MiB/s wr, 577 op/s 2024-03-26T17:06:32.646 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:06:32 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:06:32] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:06:32.646 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:06:32 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:06:32] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:06:32.647 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:06:32 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:06:33.062 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:06:33.071 INFO:tasks.workunit.client.3.smithi157.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2024-03-26T17:06:33.071 INFO:tasks.workunit.client.3.smithi157.stdout: 9.10 140.0k 135.2k 0.0k 1.4M 1.3M 0.0k nvme2n1 2024-03-26T17:06:33.071 INFO:tasks.workunit.client.3.smithi157.stdout: 9.10 158.4k 136.0k 0.0k 1.5M 1.3M 0.0k nvme2n10 2024-03-26T17:06:33.071 INFO:tasks.workunit.client.3.smithi157.stdout: 9.10 71.6k 97.6k 0.0k 716.0k 976.0k 0.0k nvme2n11 2024-03-26T17:06:33.071 INFO:tasks.workunit.client.3.smithi157.stdout: 9.10 106.8k 104.4k 0.0k 1.0M 1.0M 0.0k nvme2n12 2024-03-26T17:06:33.071 INFO:tasks.workunit.client.3.smithi157.stdout: 9.10 120.0k 168.8k 0.0k 1.2M 1.6M 0.0k nvme2n13 2024-03-26T17:06:33.071 INFO:tasks.workunit.client.3.smithi157.stdout: 9.00 105.6k 143.6k 0.0k 1.0M 1.4M 0.0k nvme2n14 2024-03-26T17:06:33.071 INFO:tasks.workunit.client.3.smithi157.stdout: 9.00 134.4k 140.0k 0.0k 1.3M 1.4M 0.0k nvme2n15 2024-03-26T17:06:33.071 INFO:tasks.workunit.client.3.smithi157.stdout: 9.00 107.2k 190.8k 0.0k 1.0M 1.9M 0.0k nvme2n16 2024-03-26T17:06:33.071 INFO:tasks.workunit.client.3.smithi157.stdout: 9.00 142.8k 122.8k 0.0k 1.4M 1.2M 0.0k nvme2n17 2024-03-26T17:06:33.072 INFO:tasks.workunit.client.3.smithi157.stdout: 9.10 114.8k 177.2k 0.0k 1.1M 1.7M 0.0k nvme2n18 2024-03-26T17:06:33.072 INFO:tasks.workunit.client.3.smithi157.stdout: 9.10 109.2k 142.0k 0.0k 1.1M 1.4M 0.0k nvme2n19 2024-03-26T17:06:33.072 INFO:tasks.workunit.client.3.smithi157.stdout: 9.10 141.6k 156.0k 0.0k 1.4M 1.5M 0.0k nvme2n2 2024-03-26T17:06:33.072 INFO:tasks.workunit.client.3.smithi157.stdout: 9.10 126.8k 140.4k 0.0k 1.2M 1.4M 0.0k nvme2n20 2024-03-26T17:06:33.072 INFO:tasks.workunit.client.3.smithi157.stdout: 9.10 112.4k 184.0k 0.0k 1.1M 1.8M 0.0k nvme2n3 2024-03-26T17:06:33.072 INFO:tasks.workunit.client.3.smithi157.stdout: 9.10 160.0k 149.2k 0.0k 1.6M 1.5M 0.0k nvme2n4 2024-03-26T17:06:33.072 INFO:tasks.workunit.client.3.smithi157.stdout: 9.10 148.0k 148.8k 0.0k 1.4M 1.5M 0.0k nvme2n5 2024-03-26T17:06:33.072 INFO:tasks.workunit.client.3.smithi157.stdout: 9.10 116.0k 173.6k 0.0k 1.1M 1.7M 0.0k nvme2n6 2024-03-26T17:06:33.072 INFO:tasks.workunit.client.3.smithi157.stdout: 9.10 122.8k 173.2k 0.0k 1.2M 1.7M 0.0k nvme2n7 2024-03-26T17:06:33.072 INFO:tasks.workunit.client.3.smithi157.stdout: 9.10 84.8k 168.0k 0.0k 848.0k 1.6M 0.0k nvme2n8 2024-03-26T17:06:33.072 INFO:tasks.workunit.client.3.smithi157.stdout: 9.10 146.0k 141.6k 0.0k 1.4M 1.4M 0.0k nvme2n9 2024-03-26T17:06:33.072 INFO:tasks.workunit.client.3.smithi157.stdout: 9.10 124.4k 157.6k 0.0k 1.2M 1.5M 0.0k nvme5n1 2024-03-26T17:06:33.072 INFO:tasks.workunit.client.3.smithi157.stdout: 9.10 139.6k 140.0k 0.0k 1.4M 1.4M 0.0k nvme5n10 2024-03-26T17:06:33.072 INFO:tasks.workunit.client.3.smithi157.stdout: 9.10 136.8k 144.8k 0.0k 1.3M 1.4M 0.0k nvme5n11 2024-03-26T17:06:33.073 INFO:tasks.workunit.client.3.smithi157.stdout: 9.10 107.6k 87.6k 0.0k 1.1M 876.0k 0.0k nvme5n12 2024-03-26T17:06:33.073 INFO:tasks.workunit.client.3.smithi157.stdout: 9.10 174.4k 82.0k 0.0k 1.7M 820.0k 0.0k nvme5n13 2024-03-26T17:06:33.073 INFO:tasks.workunit.client.3.smithi157.stdout: 9.00 84.0k 79.2k 0.0k 840.0k 792.0k 0.0k nvme5n14 2024-03-26T17:06:33.073 INFO:tasks.workunit.client.3.smithi157.stdout: 9.00 109.6k 96.4k 0.0k 1.1M 964.0k 0.0k nvme5n15 2024-03-26T17:06:33.073 INFO:tasks.workunit.client.3.smithi157.stdout: 9.00 153.6k 118.4k 0.0k 1.5M 1.2M 0.0k nvme5n16 2024-03-26T17:06:33.073 INFO:tasks.workunit.client.3.smithi157.stdout: 9.00 156.4k 147.6k 0.0k 1.5M 1.4M 0.0k nvme5n17 2024-03-26T17:06:33.073 INFO:tasks.workunit.client.3.smithi157.stdout: 9.00 148.4k 122.0k 0.0k 1.4M 1.2M 0.0k nvme5n18 2024-03-26T17:06:33.073 INFO:tasks.workunit.client.3.smithi157.stdout: 9.10 162.0k 112.0k 0.0k 1.6M 1.1M 0.0k nvme5n19 2024-03-26T17:06:33.073 INFO:tasks.workunit.client.3.smithi157.stdout: 9.10 143.2k 140.8k 0.0k 1.4M 1.4M 0.0k nvme5n2 2024-03-26T17:06:33.073 INFO:tasks.workunit.client.3.smithi157.stdout: 9.10 139.6k 132.0k 0.0k 1.4M 1.3M 0.0k nvme5n20 2024-03-26T17:06:33.073 INFO:tasks.workunit.client.3.smithi157.stdout: 9.10 101.2k 104.8k 0.0k 1012.0k 1.0M 0.0k nvme5n3 2024-03-26T17:06:33.073 INFO:tasks.workunit.client.3.smithi157.stdout: 9.10 90.4k 92.4k 0.0k 904.0k 924.0k 0.0k nvme5n4 2024-03-26T17:06:33.073 INFO:tasks.workunit.client.3.smithi157.stdout: 9.10 166.4k 147.6k 0.0k 1.6M 1.4M 0.0k nvme5n5 2024-03-26T17:06:33.074 INFO:tasks.workunit.client.3.smithi157.stdout: 9.10 120.8k 123.2k 0.0k 1.2M 1.2M 0.0k nvme5n6 2024-03-26T17:06:33.074 INFO:tasks.workunit.client.3.smithi157.stdout: 9.10 171.2k 97.6k 0.0k 1.7M 976.0k 0.0k nvme5n7 2024-03-26T17:06:33.074 INFO:tasks.workunit.client.3.smithi157.stdout: 9.10 126.8k 139.6k 0.0k 1.2M 1.4M 0.0k nvme5n8 2024-03-26T17:06:33.074 INFO:tasks.workunit.client.3.smithi157.stdout: 9.10 129.2k 127.2k 0.0k 1.3M 1.2M 0.0k nvme5n9 2024-03-26T17:06:33.074 INFO:tasks.workunit.client.3.smithi157.stdout: 9.10 132.4k 147.2k 0.0k 1.3M 1.4M 0.0k nvme8n1 2024-03-26T17:06:33.074 INFO:tasks.workunit.client.3.smithi157.stdout: 9.10 122.8k 142.0k 0.0k 1.2M 1.4M 0.0k nvme8n10 2024-03-26T17:06:33.074 INFO:tasks.workunit.client.3.smithi157.stdout: 9.10 167.6k 128.0k 0.0k 1.6M 1.2M 0.0k nvme8n11 2024-03-26T17:06:33.074 INFO:tasks.workunit.client.3.smithi157.stdout: 9.10 135.2k 142.8k 0.0k 1.3M 1.4M 0.0k nvme8n12 2024-03-26T17:06:33.074 INFO:tasks.workunit.client.3.smithi157.stdout: 9.00 94.4k 116.4k 0.0k 944.0k 1.1M 0.0k nvme8n13 2024-03-26T17:06:33.074 INFO:tasks.workunit.client.3.smithi157.stdout: 9.00 168.8k 130.0k 0.0k 1.6M 1.3M 0.0k nvme8n14 2024-03-26T17:06:33.074 INFO:tasks.workunit.client.3.smithi157.stdout: 9.00 78.4k 86.4k 0.0k 784.0k 864.0k 0.0k nvme8n15 2024-03-26T17:06:33.074 INFO:tasks.workunit.client.3.smithi157.stdout: 9.00 152.4k 108.8k 0.0k 1.5M 1.1M 0.0k nvme8n16 2024-03-26T17:06:33.074 INFO:tasks.workunit.client.3.smithi157.stdout: 9.00 105.6k 160.8k 0.0k 1.0M 1.6M 0.0k nvme8n17 2024-03-26T17:06:33.075 INFO:tasks.workunit.client.3.smithi157.stdout: 9.10 133.2k 124.0k 0.0k 1.3M 1.2M 0.0k nvme8n18 2024-03-26T17:06:33.075 INFO:tasks.workunit.client.3.smithi157.stdout: 9.10 115.6k 164.0k 0.0k 1.1M 1.6M 0.0k nvme8n19 2024-03-26T17:06:33.075 INFO:tasks.workunit.client.3.smithi157.stdout: 9.10 152.8k 152.8k 0.0k 1.5M 1.5M 0.0k nvme8n2 2024-03-26T17:06:33.075 INFO:tasks.workunit.client.3.smithi157.stdout: 9.10 114.4k 145.6k 0.0k 1.1M 1.4M 0.0k nvme8n20 2024-03-26T17:06:33.075 INFO:tasks.workunit.client.3.smithi157.stdout: 9.10 106.0k 98.0k 0.0k 1.0M 980.0k 0.0k nvme8n3 2024-03-26T17:06:33.075 INFO:tasks.workunit.client.3.smithi157.stdout: 9.10 129.2k 100.4k 0.0k 1.3M 1004.0k 0.0k nvme8n4 2024-03-26T17:06:33.075 INFO:tasks.workunit.client.3.smithi157.stdout: 9.10 106.0k 150.0k 0.0k 1.0M 1.5M 0.0k nvme8n5 2024-03-26T17:06:33.075 INFO:tasks.workunit.client.3.smithi157.stdout: 9.10 148.8k 159.6k 0.0k 1.5M 1.6M 0.0k nvme8n6 2024-03-26T17:06:33.075 INFO:tasks.workunit.client.3.smithi157.stdout: 9.10 134.0k 170.4k 0.0k 1.3M 1.7M 0.0k nvme8n7 2024-03-26T17:06:33.075 INFO:tasks.workunit.client.3.smithi157.stdout: 9.10 169.2k 135.6k 0.0k 1.7M 1.3M 0.0k nvme8n8 2024-03-26T17:06:33.075 INFO:tasks.workunit.client.3.smithi157.stdout: 9.10 130.0k 108.0k 0.0k 1.3M 1.1M 0.0k nvme8n9 2024-03-26T17:06:33.075 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:06:33.333 INFO:tasks.workunit.client.3.smithi157.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-26T17:06:33.334 INFO:tasks.workunit.client.3.smithi157.stdout:myimage45 6/s 5/s 170 KiB/s 127 KiB/s 2.07 ms 388.24 us 2024-03-26T17:06:33.334 INFO:tasks.workunit.client.3.smithi157.stdout:myimage8 6/s 3/s 178 KiB/s 92 KiB/s 2.27 ms 355.77 us 2024-03-26T17:06:33.334 INFO:tasks.workunit.client.3.smithi157.stdout:myimage14 6/s 3/s 172 KiB/s 110 KiB/s 2.06 ms 317.66 us 2024-03-26T17:06:33.334 INFO:tasks.workunit.client.3.smithi157.stdout:myimage57 6/s 3/s 207 KiB/s 76 KiB/s 2.04 ms 333.53 us 2024-03-26T17:06:33.334 INFO:tasks.workunit.client.3.smithi157.stdout:myimage42 5/s 3/s 198 KiB/s 127 KiB/s 2.03 ms 381.33 us 2024-03-26T17:06:33.334 INFO:tasks.workunit.client.3.smithi157.stdout:myimage53 5/s 4/s 115 KiB/s 97 KiB/s 2.26 ms 334.48 us 2024-03-26T17:06:33.334 INFO:tasks.workunit.client.3.smithi157.stdout:myimage18 5/s 4/s 199 KiB/s 130 KiB/s 2.00 ms 327.64 us 2024-03-26T17:06:33.334 INFO:tasks.workunit.client.3.smithi157.stdout:myimage30 5/s 2/s 158 KiB/s 86 KiB/s 2.65 ms 305.26 us 2024-03-26T17:06:33.334 INFO:tasks.workunit.client.3.smithi157.stdout:myimage9 5/s 3/s 146 KiB/s 110 KiB/s 2.21 ms 451.73 us 2024-03-26T17:06:33.334 INFO:tasks.workunit.client.3.smithi157.stdout:myimage50 5/s 4/s 174 KiB/s 120 KiB/s 2.21 ms 380.80 us 2024-03-26T17:06:33.335 INFO:tasks.workunit.client.3.smithi157.stdout:myimage59 5/s 4/s 186 KiB/s 144 KiB/s 2.28 ms 338.20 us 2024-03-26T17:06:33.335 INFO:tasks.workunit.client.3.smithi157.stdout:myimage16 5/s 3/s 188 KiB/s 121 KiB/s 2.08 ms 328.63 us 2024-03-26T17:06:33.335 INFO:tasks.workunit.client.3.smithi157.stdout:myimage6 5/s 3/s 166 KiB/s 105 KiB/s 2.23 ms 460.36 us 2024-03-26T17:06:33.335 INFO:tasks.workunit.client.3.smithi157.stdout:myimage17 5/s 4/s 150 KiB/s 147 KiB/s 2.19 ms 412.82 us 2024-03-26T17:06:33.335 INFO:tasks.workunit.client.3.smithi157.stdout:myimage26 5/s 4/s 143 KiB/s 127 KiB/s 2.08 ms 319.56 us 2024-03-26T17:06:33.335 INFO:tasks.workunit.client.3.smithi157.stdout:myimage60 5/s 4/s 151 KiB/s 134 KiB/s 2.07 ms 376.24 us 2024-03-26T17:06:33.335 INFO:tasks.workunit.client.3.smithi157.stdout:myimage3 5/s 4/s 160 KiB/s 137 KiB/s 1.83 ms 326.69 us 2024-03-26T17:06:33.335 INFO:tasks.workunit.client.3.smithi157.stdout:myimage13 5/s 4/s 148 KiB/s 135 KiB/s 1.95 ms 375.24 us 2024-03-26T17:06:33.335 INFO:tasks.workunit.client.3.smithi157.stdout:myimage35 5/s 5/s 120 KiB/s 126 KiB/s 2.18 ms 296.91 us 2024-03-26T17:06:33.335 INFO:tasks.workunit.client.3.smithi157.stdout:myimage52 5/s 5/s 141 KiB/s 157 KiB/s 2.27 ms 422.07 us 2024-03-26T17:06:33.335 INFO:tasks.workunit.client.3.smithi157.stdout:myimage4 5/s 4/s 152 KiB/s 130 KiB/s 2.17 ms 319.13 us 2024-03-26T17:06:33.335 INFO:tasks.workunit.client.3.smithi157.stdout:myimage7 5/s 3/s 158 KiB/s 122 KiB/s 2.08 ms 365.01 us 2024-03-26T17:06:33.335 INFO:tasks.workunit.client.3.smithi157.stdout:myimage20 5/s 4/s 129 KiB/s 139 KiB/s 2.14 ms 366.02 us 2024-03-26T17:06:33.336 INFO:tasks.workunit.client.3.smithi157.stdout:myimage47 4/s 4/s 154 KiB/s 126 KiB/s 2.19 ms 345.37 us 2024-03-26T17:06:33.336 INFO:tasks.workunit.client.3.smithi157.stdout:myimage21 4/s 4/s 145 KiB/s 123 KiB/s 2.64 ms 397.90 us 2024-03-26T17:06:33.336 INFO:tasks.workunit.client.3.smithi157.stdout:myimage22 4/s 4/s 135 KiB/s 127 KiB/s 2.03 ms 313.67 us 2024-03-26T17:06:33.336 INFO:tasks.workunit.client.3.smithi157.stdout:myimage5 4/s 4/s 170 KiB/s 136 KiB/s 2.01 ms 325.81 us 2024-03-26T17:06:33.336 INFO:tasks.workunit.client.3.smithi157.stdout:myimage15 4/s 4/s 135 KiB/s 128 KiB/s 1.96 ms 378.04 us 2024-03-26T17:06:33.336 INFO:tasks.workunit.client.3.smithi157.stdout:myimage28 4/s 3/s 150 KiB/s 121 KiB/s 2.55 ms 519.16 us 2024-03-26T17:06:33.336 INFO:tasks.workunit.client.3.smithi157.stdout:myimage23 4/s 3/s 85 KiB/s 75 KiB/s 1.80 ms 351.27 us 2024-03-26T17:06:33.336 INFO:tasks.workunit.client.3.smithi157.stdout:myimage32 4/s 3/s 70 KiB/s 78 KiB/s 2.17 ms 331.80 us 2024-03-26T17:06:33.336 INFO:tasks.workunit.client.3.smithi157.stdout:myimage24 4/s 5/s 90 KiB/s 98 KiB/s 1.91 ms 347.35 us 2024-03-26T17:06:33.336 INFO:tasks.workunit.client.3.smithi157.stdout:myimage33 4/s 5/s 120 KiB/s 187 KiB/s 2.05 ms 347.02 us 2024-03-26T17:06:33.336 INFO:tasks.workunit.client.3.smithi157.stdout:myimage10 4/s 4/s 147 KiB/s 148 KiB/s 2.04 ms 330.28 us 2024-03-26T17:06:33.336 INFO:tasks.workunit.client.3.smithi157.stdout:myimage34 4/s 4/s 78 KiB/s 77 KiB/s 1.89 ms 316.34 us 2024-03-26T17:06:33.336 INFO:tasks.workunit.client.3.smithi157.stdout:myimage40 4/s 5/s 136 KiB/s 178 KiB/s 2.02 ms 392.12 us 2024-03-26T17:06:33.337 INFO:tasks.workunit.client.3.smithi157.stdout:myimage58 4/s 4/s 128 KiB/s 142 KiB/s 1.91 ms 491.26 us 2024-03-26T17:06:33.337 INFO:tasks.workunit.client.3.smithi157.stdout:myimage36 4/s 4/s 96 KiB/s 122 KiB/s 2.07 ms 330.16 us 2024-03-26T17:06:33.337 INFO:tasks.workunit.client.3.smithi157.stdout:myimage41 4/s 4/s 146 KiB/s 122 KiB/s 2.09 ms 329.54 us 2024-03-26T17:06:33.337 INFO:tasks.workunit.client.3.smithi157.stdout:myimage43 4/s 6/s 92 KiB/s 126 KiB/s 1.91 ms 329.02 us 2024-03-26T17:06:33.337 INFO:tasks.workunit.client.3.smithi157.stdout:myimage46 4/s 3/s 150 KiB/s 129 KiB/s 2.05 ms 367.05 us 2024-03-26T17:06:33.337 INFO:tasks.workunit.client.3.smithi157.stdout:myimage2 4/s 4/s 134 KiB/s 118 KiB/s 2.15 ms 336.97 us 2024-03-26T17:06:33.337 INFO:tasks.workunit.client.3.smithi157.stdout:myimage31 4/s 6/s 123 KiB/s 186 KiB/s 2.26 ms 325.26 us 2024-03-26T17:06:33.337 INFO:tasks.workunit.client.3.smithi157.stdout:myimage38 4/s 5/s 141 KiB/s 163 KiB/s 1.80 ms 305.02 us 2024-03-26T17:06:33.337 INFO:tasks.workunit.client.3.smithi157.stdout:myimage25 4/s 5/s 145 KiB/s 186 KiB/s 2.65 ms 367.70 us 2024-03-26T17:06:33.337 INFO:tasks.workunit.client.3.smithi157.stdout:myimage39 4/s 6/s 118 KiB/s 210 KiB/s 2.02 ms 438.79 us 2024-03-26T17:06:33.337 INFO:tasks.workunit.client.3.smithi157.stdout:myimage55 4/s 4/s 71 KiB/s 65 KiB/s 2.27 ms 319.77 us 2024-03-26T17:06:33.337 INFO:tasks.workunit.client.3.smithi157.stdout:myimage37 3/s 5/s 140 KiB/s 178 KiB/s 2.21 ms 330.81 us 2024-03-26T17:06:33.337 INFO:tasks.workunit.client.3.smithi157.stdout:myimage44 3/s 3/s 102 KiB/s 113 KiB/s 2.17 ms 370.55 us 2024-03-26T17:06:33.337 INFO:tasks.workunit.client.3.smithi157.stdout:myimage1 3/s 5/s 124 KiB/s 150 KiB/s 1.79 ms 305.38 us 2024-03-26T17:06:33.338 INFO:tasks.workunit.client.3.smithi157.stdout:myimage11 3/s 4/s 66 KiB/s 76 KiB/s 1.75 ms 262.81 us 2024-03-26T17:06:33.338 INFO:tasks.workunit.client.3.smithi157.stdout:myimage48 3/s 5/s 94 KiB/s 220 KiB/s 1.94 ms 423.60 us 2024-03-26T17:06:33.338 INFO:tasks.workunit.client.3.smithi157.stdout:myimage49 3/s 5/s 100 KiB/s 179 KiB/s 2.24 ms 411.80 us 2024-03-26T17:06:33.338 INFO:tasks.workunit.client.3.smithi157.stdout:myimage12 3/s 4/s 57 KiB/s 67 KiB/s 1.96 ms 483.26 us 2024-03-26T17:06:33.338 INFO:tasks.workunit.client.3.smithi157.stdout:myimage27 3/s 6/s 105 KiB/s 212 KiB/s 2.03 ms 375.61 us 2024-03-26T17:06:33.338 INFO:tasks.workunit.client.3.smithi157.stdout:myimage29 3/s 5/s 89 KiB/s 142 KiB/s 1.90 ms 380.69 us 2024-03-26T17:06:33.338 INFO:tasks.workunit.client.3.smithi157.stdout:myimage56 3/s 5/s 110 KiB/s 132 KiB/s 2.53 ms 324.04 us 2024-03-26T17:06:33.338 INFO:tasks.workunit.client.3.smithi157.stdout:myimage19 3/s 4/s 99 KiB/s 127 KiB/s 2.24 ms 357.56 us 2024-03-26T17:06:33.338 INFO:tasks.workunit.client.3.smithi157.stdout:myimage54 3/s 5/s 110 KiB/s 188 KiB/s 2.11 ms 412.52 us 2024-03-26T17:06:33.338 INFO:tasks.workunit.client.3.smithi157.stdout:myimage51 2/s 5/s 98 KiB/s 179 KiB/s 2.22 ms 327.21 us 2024-03-26T17:06:33.338 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:06:34.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:06:33 smithi044 ceph-mon[30624]: pgmap v618: 33 pgs: 33 active+clean; 1.0 GiB data, 3.7 GiB used, 712 GiB / 715 GiB avail; 6.4 MiB/s rd, 6.8 MiB/s wr, 514 op/s 2024-03-26T17:06:34.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:06:33 smithi044 ceph-mon[30624]: Health check update: 3 slow ops, oldest one blocked for 488 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:06:34.266 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:06:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:06:34] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:06:34.266 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:06:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:06:34] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:06:34.266 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:06:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:06:34.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:06:33 smithi064 ceph-mon[34420]: pgmap v618: 33 pgs: 33 active+clean; 1.0 GiB data, 3.7 GiB used, 712 GiB / 715 GiB avail; 6.4 MiB/s rd, 6.8 MiB/s wr, 514 op/s 2024-03-26T17:06:34.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:06:33 smithi064 ceph-mon[34420]: Health check update: 3 slow ops, oldest one blocked for 488 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:06:34.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:06:33 smithi149 ceph-mon[34678]: pgmap v618: 33 pgs: 33 active+clean; 1.0 GiB data, 3.7 GiB used, 712 GiB / 715 GiB avail; 6.4 MiB/s rd, 6.8 MiB/s wr, 514 op/s 2024-03-26T17:06:34.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:06:33 smithi149 ceph-mon[34678]: Health check update: 3 slow ops, oldest one blocked for 488 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:06:34.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:06:34 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:06:34] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:06:34.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:06:34 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:06:34] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:06:34.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:06:34 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:06:35.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:06:34 smithi044 ceph-mon[30624]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:06:35.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:06:34 smithi044 ceph-mon[30624]: { 2024-03-26T17:06:35.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:06:34 smithi044 ceph-mon[30624]: "prefix": "rbd perf image stats", 2024-03-26T17:06:35.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:06:34 smithi044 ceph-mon[30624]: "pool_spec": "mypool", 2024-03-26T17:06:35.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:06:34 smithi044 ceph-mon[30624]: "sort_by": "write_ops", 2024-03-26T17:06:35.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:06:34 smithi044 ceph-mon[30624]: "format": "json" 2024-03-26T17:06:35.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:06:34 smithi044 ceph-mon[30624]: }"]: dispatch 2024-03-26T17:06:35.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:06:34 smithi064 ceph-mon[34420]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:06:35.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:06:34 smithi064 ceph-mon[34420]: { 2024-03-26T17:06:35.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:06:34 smithi064 ceph-mon[34420]: "prefix": "rbd perf image stats", 2024-03-26T17:06:35.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:06:34 smithi064 ceph-mon[34420]: "pool_spec": "mypool", 2024-03-26T17:06:35.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:06:34 smithi064 ceph-mon[34420]: "sort_by": "write_ops", 2024-03-26T17:06:35.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:06:34 smithi064 ceph-mon[34420]: "format": "json" 2024-03-26T17:06:35.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:06:34 smithi064 ceph-mon[34420]: }"]: dispatch 2024-03-26T17:06:35.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:06:34 smithi149 ceph-mon[34678]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:06:35.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:06:34 smithi149 ceph-mon[34678]: { 2024-03-26T17:06:35.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:06:34 smithi149 ceph-mon[34678]: "prefix": "rbd perf image stats", 2024-03-26T17:06:35.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:06:34 smithi149 ceph-mon[34678]: "pool_spec": "mypool", 2024-03-26T17:06:35.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:06:34 smithi149 ceph-mon[34678]: "sort_by": "write_ops", 2024-03-26T17:06:35.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:06:34 smithi149 ceph-mon[34678]: "format": "json" 2024-03-26T17:06:35.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:06:34 smithi149 ceph-mon[34678]: }"]: dispatch 2024-03-26T17:06:36.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:06:35 smithi044 ceph-mon[30624]: pgmap v619: 33 pgs: 33 active+clean; 1.0 GiB data, 3.7 GiB used, 712 GiB / 715 GiB avail; 7.3 MiB/s rd, 7.5 MiB/s wr, 552 op/s 2024-03-26T17:06:36.265 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:06:36 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:06:36] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:06:36.266 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:06:36 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:06:36] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:06:36.266 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:06:36 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:06:36.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:06:35 smithi064 ceph-mon[34420]: pgmap v619: 33 pgs: 33 active+clean; 1.0 GiB data, 3.7 GiB used, 712 GiB / 715 GiB avail; 7.3 MiB/s rd, 7.5 MiB/s wr, 552 op/s 2024-03-26T17:06:36.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:06:35 smithi149 ceph-mon[34678]: pgmap v619: 33 pgs: 33 active+clean; 1.0 GiB data, 3.7 GiB used, 712 GiB / 715 GiB avail; 7.3 MiB/s rd, 7.5 MiB/s wr, 552 op/s 2024-03-26T17:06:36.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:06:36 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 2024-03-26T17:06:36.228+0000 7fa707a55700 -1 mon.c@1(peon) e3 get_health_metrics reporting 3 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T17:06:36.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:06:36 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:06:36] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:06:36.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:06:36 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:06:36] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:06:36.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:06:36 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:06:38.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:06:37 smithi044 ceph-mon[30624]: pgmap v620: 33 pgs: 33 active+clean; 1.0 GiB data, 3.7 GiB used, 712 GiB / 715 GiB avail; 7.3 MiB/s rd, 7.6 MiB/s wr, 533 op/s 2024-03-26T17:06:38.266 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:06:38 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:06:38] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:06:38.266 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:06:38 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:06:38] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:06:38.266 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:06:38 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:06:38.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:06:37 smithi064 ceph-mon[34420]: pgmap v620: 33 pgs: 33 active+clean; 1.0 GiB data, 3.7 GiB used, 712 GiB / 715 GiB avail; 7.3 MiB/s rd, 7.6 MiB/s wr, 533 op/s 2024-03-26T17:06:38.339 INFO:tasks.workunit.client.3.smithi157.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-26T17:06:38.339 INFO:tasks.workunit.client.3.smithi157.stdout:myimage11 6/s 3/s 175 KiB/s 106 KiB/s 2.15 ms 324.81 us 2024-03-26T17:06:38.339 INFO:tasks.workunit.client.3.smithi157.stdout:myimage34 6/s 4/s 171 KiB/s 105 KiB/s 1.98 ms 316.00 us 2024-03-26T17:06:38.339 INFO:tasks.workunit.client.3.smithi157.stdout:myimage37 5/s 3/s 187 KiB/s 107 KiB/s 2.07 ms 327.08 us 2024-03-26T17:06:38.339 INFO:tasks.workunit.client.3.smithi157.stdout:myimage6 5/s 4/s 160 KiB/s 122 KiB/s 2.14 ms 436.04 us 2024-03-26T17:06:38.339 INFO:tasks.workunit.client.3.smithi157.stdout:myimage18 5/s 3/s 171 KiB/s 90 KiB/s 2.01 ms 416.26 us 2024-03-26T17:06:38.339 INFO:tasks.workunit.client.3.smithi157.stdout:myimage7 5/s 3/s 151 KiB/s 120 KiB/s 2.29 ms 356.75 us 2024-03-26T17:06:38.339 INFO:tasks.workunit.client.3.smithi157.stdout:myimage19 5/s 3/s 192 KiB/s 94 KiB/s 2.10 ms 386.99 us 2024-03-26T17:06:38.339 INFO:tasks.workunit.client.3.smithi157.stdout:myimage21 5/s 3/s 129 KiB/s 98 KiB/s 2.53 ms 342.87 us 2024-03-26T17:06:38.339 INFO:tasks.workunit.client.3.smithi157.stdout:myimage29 5/s 4/s 150 KiB/s 130 KiB/s 1.94 ms 354.46 us 2024-03-26T17:06:38.340 INFO:tasks.workunit.client.3.smithi157.stdout:myimage43 5/s 4/s 174 KiB/s 122 KiB/s 2.33 ms 415.39 us 2024-03-26T17:06:38.340 INFO:tasks.workunit.client.3.smithi157.stdout:myimage45 5/s 2/s 185 KiB/s 106 KiB/s 2.14 ms 313.03 us 2024-03-26T17:06:38.340 INFO:tasks.workunit.client.3.smithi157.stdout:myimage57 5/s 4/s 124 KiB/s 134 KiB/s 2.12 ms 335.05 us 2024-03-26T17:06:38.340 INFO:tasks.workunit.client.3.smithi157.stdout:myimage60 5/s 3/s 157 KiB/s 94 KiB/s 2.23 ms 330.68 us 2024-03-26T17:06:38.340 INFO:tasks.workunit.client.3.smithi157.stdout:myimage30 5/s 5/s 169 KiB/s 149 KiB/s 2.37 ms 328.76 us 2024-03-26T17:06:38.340 INFO:tasks.workunit.client.3.smithi157.stdout:myimage49 5/s 2/s 167 KiB/s 81 KiB/s 2.16 ms 337.82 us 2024-03-26T17:06:38.340 INFO:tasks.workunit.client.3.smithi157.stdout:myimage52 5/s 5/s 138 KiB/s 131 KiB/s 2.42 ms 402.17 us 2024-03-26T17:06:38.340 INFO:tasks.workunit.client.3.smithi157.stdout:myimage20 5/s 4/s 126 KiB/s 162 KiB/s 1.99 ms 352.52 us 2024-03-26T17:06:38.340 INFO:tasks.workunit.client.3.smithi157.stdout:myimage25 5/s 4/s 134 KiB/s 122 KiB/s 2.59 ms 342.47 us 2024-03-26T17:06:38.340 INFO:tasks.workunit.client.3.smithi157.stdout:myimage36 5/s 5/s 150 KiB/s 151 KiB/s 2.03 ms 325.00 us 2024-03-26T17:06:38.340 INFO:tasks.workunit.client.3.smithi157.stdout:myimage46 5/s 4/s 146 KiB/s 111 KiB/s 1.97 ms 329.83 us 2024-03-26T17:06:38.340 INFO:tasks.workunit.client.3.smithi157.stdout:myimage40 5/s 4/s 180 KiB/s 106 KiB/s 2.00 ms 413.73 us 2024-03-26T17:06:38.340 INFO:tasks.workunit.client.3.smithi157.stdout:myimage47 5/s 4/s 170 KiB/s 157 KiB/s 2.29 ms 426.32 us 2024-03-26T17:06:38.340 INFO:tasks.workunit.client.3.smithi157.stdout:myimage10 5/s 5/s 143 KiB/s 166 KiB/s 2.06 ms 316.53 us 2024-03-26T17:06:38.341 INFO:tasks.workunit.client.3.smithi157.stdout:myimage59 5/s 4/s 141 KiB/s 120 KiB/s 2.17 ms 316.60 us 2024-03-26T17:06:38.341 INFO:tasks.workunit.client.3.smithi157.stdout:myimage3 4/s 4/s 186 KiB/s 119 KiB/s 1.96 ms 334.85 us 2024-03-26T17:06:38.341 INFO:tasks.workunit.client.3.smithi157.stdout:myimage13 4/s 4/s 165 KiB/s 103 KiB/s 1.89 ms 319.54 us 2024-03-26T17:06:38.341 INFO:tasks.workunit.client.3.smithi157.stdout:myimage1 4/s 5/s 163 KiB/s 121 KiB/s 1.83 ms 301.80 us 2024-03-26T17:06:38.341 INFO:tasks.workunit.client.3.smithi157.stdout:myimage55 4/s 4/s 162 KiB/s 116 KiB/s 2.17 ms 414.39 us 2024-03-26T17:06:38.341 INFO:tasks.workunit.client.3.smithi157.stdout:myimage2 4/s 4/s 143 KiB/s 159 KiB/s 2.10 ms 319.69 us 2024-03-26T17:06:38.341 INFO:tasks.workunit.client.3.smithi157.stdout:myimage23 4/s 4/s 154 KiB/s 152 KiB/s 1.92 ms 318.95 us 2024-03-26T17:06:38.341 INFO:tasks.workunit.client.3.smithi157.stdout:myimage5 4/s 4/s 142 KiB/s 162 KiB/s 1.93 ms 330.74 us 2024-03-26T17:06:38.341 INFO:tasks.workunit.client.3.smithi157.stdout:myimage24 4/s 3/s 124 KiB/s 118 KiB/s 2.17 ms 341.60 us 2024-03-26T17:06:38.341 INFO:tasks.workunit.client.3.smithi157.stdout:myimage50 4/s 5/s 104 KiB/s 127 KiB/s 2.24 ms 344.90 us 2024-03-26T17:06:38.341 INFO:tasks.workunit.client.3.smithi157.stdout:myimage16 4/s 5/s 122 KiB/s 123 KiB/s 2.09 ms 334.67 us 2024-03-26T17:06:38.341 INFO:tasks.workunit.client.3.smithi157.stdout:myimage22 4/s 6/s 115 KiB/s 172 KiB/s 2.15 ms 322.74 us 2024-03-26T17:06:38.341 INFO:tasks.workunit.client.3.smithi157.stdout:myimage32 4/s 3/s 108 KiB/s 127 KiB/s 2.24 ms 337.99 us 2024-03-26T17:06:38.341 INFO:tasks.workunit.client.3.smithi157.stdout:myimage38 4/s 4/s 136 KiB/s 112 KiB/s 1.75 ms 436.43 us 2024-03-26T17:06:38.342 INFO:tasks.workunit.client.3.smithi157.stdout:myimage12 4/s 5/s 130 KiB/s 180 KiB/s 2.15 ms 354.99 us 2024-03-26T17:06:38.342 INFO:tasks.workunit.client.3.smithi157.stdout:myimage15 4/s 5/s 119 KiB/s 146 KiB/s 1.81 ms 381.42 us 2024-03-26T17:06:38.342 INFO:tasks.workunit.client.3.smithi157.stdout:myimage28 4/s 5/s 164 KiB/s 141 KiB/s 2.51 ms 357.33 us 2024-03-26T17:06:38.342 INFO:tasks.workunit.client.3.smithi157.stdout:myimage41 4/s 5/s 121 KiB/s 151 KiB/s 2.16 ms 332.34 us 2024-03-26T17:06:38.342 INFO:tasks.workunit.client.3.smithi157.stdout:myimage48 4/s 4/s 132 KiB/s 137 KiB/s 2.23 ms 451.98 us 2024-03-26T17:06:38.342 INFO:tasks.workunit.client.3.smithi157.stdout:myimage58 4/s 5/s 132 KiB/s 164 KiB/s 1.91 ms 363.86 us 2024-03-26T17:06:38.342 INFO:tasks.workunit.client.3.smithi157.stdout:myimage8 4/s 5/s 126 KiB/s 135 KiB/s 2.18 ms 370.12 us 2024-03-26T17:06:38.342 INFO:tasks.workunit.client.3.smithi157.stdout:myimage27 4/s 6/s 114 KiB/s 183 KiB/s 1.93 ms 347.61 us 2024-03-26T17:06:38.342 INFO:tasks.workunit.client.3.smithi157.stdout:myimage53 4/s 4/s 162 KiB/s 106 KiB/s 2.08 ms 423.80 us 2024-03-26T17:06:38.342 INFO:tasks.workunit.client.3.smithi157.stdout:myimage54 4/s 4/s 133 KiB/s 146 KiB/s 2.08 ms 372.49 us 2024-03-26T17:06:38.342 INFO:tasks.workunit.client.3.smithi157.stdout:myimage35 4/s 5/s 131 KiB/s 133 KiB/s 2.15 ms 355.44 us 2024-03-26T17:06:38.342 INFO:tasks.workunit.client.3.smithi157.stdout:myimage9 4/s 5/s 103 KiB/s 179 KiB/s 2.30 ms 368.82 us 2024-03-26T17:06:38.342 INFO:tasks.workunit.client.3.smithi157.stdout:myimage17 4/s 5/s 117 KiB/s 166 KiB/s 2.12 ms 345.26 us 2024-03-26T17:06:38.343 INFO:tasks.workunit.client.3.smithi157.stdout:myimage51 4/s 4/s 135 KiB/s 144 KiB/s 2.31 ms 389.76 us 2024-03-26T17:06:38.343 INFO:tasks.workunit.client.3.smithi157.stdout:myimage56 3/s 5/s 89 KiB/s 164 KiB/s 2.35 ms 355.96 us 2024-03-26T17:06:38.343 INFO:tasks.workunit.client.3.smithi157.stdout:myimage31 3/s 4/s 125 KiB/s 149 KiB/s 2.10 ms 363.16 us 2024-03-26T17:06:38.343 INFO:tasks.workunit.client.3.smithi157.stdout:myimage4 3/s 5/s 122 KiB/s 225 KiB/s 2.02 ms 374.92 us 2024-03-26T17:06:38.343 INFO:tasks.workunit.client.3.smithi157.stdout:myimage26 3/s 6/s 119 KiB/s 210 KiB/s 2.16 ms 381.65 us 2024-03-26T17:06:38.343 INFO:tasks.workunit.client.3.smithi157.stdout:myimage42 3/s 4/s 90 KiB/s 118 KiB/s 2.13 ms 454.05 us 2024-03-26T17:06:38.343 INFO:tasks.workunit.client.3.smithi157.stdout:myimage39 3/s 5/s 74 KiB/s 146 KiB/s 1.97 ms 357.57 us 2024-03-26T17:06:38.343 INFO:tasks.workunit.client.3.smithi157.stdout:myimage14 3/s 6/s 101 KiB/s 185 KiB/s 2.24 ms 384.59 us 2024-03-26T17:06:38.343 INFO:tasks.workunit.client.3.smithi157.stdout:myimage33 2/s 6/s 74 KiB/s 206 KiB/s 2.12 ms 385.70 us 2024-03-26T17:06:38.343 INFO:tasks.workunit.client.3.smithi157.stdout:myimage44 2/s 6/s 78 KiB/s 214 KiB/s 2.13 ms 415.22 us 2024-03-26T17:06:38.343 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:06:38.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:06:37 smithi149 ceph-mon[34678]: pgmap v620: 33 pgs: 33 active+clean; 1.0 GiB data, 3.7 GiB used, 712 GiB / 715 GiB avail; 7.3 MiB/s rd, 7.6 MiB/s wr, 533 op/s 2024-03-26T17:06:38.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:06:38 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:06:38] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:06:38.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:06:38 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:06:38] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:06:38.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:06:38 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:06:39.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:06:38 smithi044 ceph-mon[30624]: Health check update: 3 slow ops, oldest one blocked for 493 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:06:39.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:06:38 smithi064 ceph-mon[34420]: Health check update: 3 slow ops, oldest one blocked for 493 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:06:39.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:06:38 smithi149 ceph-mon[34678]: Health check update: 3 slow ops, oldest one blocked for 493 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:06:40.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:06:39 smithi044 ceph-mon[30624]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:06:40.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:06:39 smithi044 ceph-mon[30624]: { 2024-03-26T17:06:40.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:06:39 smithi044 ceph-mon[30624]: "prefix": "rbd perf image stats", 2024-03-26T17:06:40.266 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:06:39 smithi044 ceph-mon[30624]: "pool_spec": "mypool", 2024-03-26T17:06:40.266 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:06:39 smithi044 ceph-mon[30624]: "sort_by": "write_ops", 2024-03-26T17:06:40.266 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:06:39 smithi044 ceph-mon[30624]: "format": "json" 2024-03-26T17:06:40.266 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:06:39 smithi044 ceph-mon[30624]: }"]: dispatch 2024-03-26T17:06:40.266 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:06:39 smithi044 ceph-mon[30624]: pgmap v621: 33 pgs: 33 active+clean; 1.0 GiB data, 3.7 GiB used, 711 GiB / 715 GiB avail; 8.1 MiB/s rd, 8.1 MiB/s wr, 573 op/s 2024-03-26T17:06:40.266 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:06:40 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:06:40] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:06:40.267 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:06:40 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:06:40] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:06:40.267 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:06:40 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:06:40.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:06:39 smithi064 ceph-mon[34420]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:06:40.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:06:39 smithi064 ceph-mon[34420]: { 2024-03-26T17:06:40.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:06:39 smithi064 ceph-mon[34420]: "prefix": "rbd perf image stats", 2024-03-26T17:06:40.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:06:39 smithi064 ceph-mon[34420]: "pool_spec": "mypool", 2024-03-26T17:06:40.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:06:39 smithi064 ceph-mon[34420]: "sort_by": "write_ops", 2024-03-26T17:06:40.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:06:39 smithi064 ceph-mon[34420]: "format": "json" 2024-03-26T17:06:40.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:06:39 smithi064 ceph-mon[34420]: }"]: dispatch 2024-03-26T17:06:40.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:06:39 smithi064 ceph-mon[34420]: pgmap v621: 33 pgs: 33 active+clean; 1.0 GiB data, 3.7 GiB used, 711 GiB / 715 GiB avail; 8.1 MiB/s rd, 8.1 MiB/s wr, 573 op/s 2024-03-26T17:06:40.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:06:39 smithi149 ceph-mon[34678]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:06:40.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:06:39 smithi149 ceph-mon[34678]: { 2024-03-26T17:06:40.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:06:39 smithi149 ceph-mon[34678]: "prefix": "rbd perf image stats", 2024-03-26T17:06:40.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:06:39 smithi149 ceph-mon[34678]: "pool_spec": "mypool", 2024-03-26T17:06:40.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:06:39 smithi149 ceph-mon[34678]: "sort_by": "write_ops", 2024-03-26T17:06:40.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:06:39 smithi149 ceph-mon[34678]: "format": "json" 2024-03-26T17:06:40.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:06:39 smithi149 ceph-mon[34678]: }"]: dispatch 2024-03-26T17:06:40.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:06:39 smithi149 ceph-mon[34678]: pgmap v621: 33 pgs: 33 active+clean; 1.0 GiB data, 3.7 GiB used, 711 GiB / 715 GiB avail; 8.1 MiB/s rd, 8.1 MiB/s wr, 573 op/s 2024-03-26T17:06:40.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:06:40 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:06:40] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:06:40.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:06:40 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:06:40] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:06:40.897 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:06:40 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:06:41.229 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:06:40 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-26T17:06:41.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:06:40 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-26T17:06:41.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:06:40 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-26T17:06:41.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:06:41 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 2024-03-26T17:06:41.228+0000 7fa707a55700 -1 mon.c@1(peon) e3 get_health_metrics reporting 3 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T17:06:42.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:06:41 smithi044 ceph-mon[30624]: pgmap v622: 33 pgs: 33 active+clean; 1.0 GiB data, 3.7 GiB used, 711 GiB / 715 GiB avail; 8.4 MiB/s rd, 8.3 MiB/s wr, 577 op/s 2024-03-26T17:06:42.265 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:06:42 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:06:42] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:06:42.266 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:06:42 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:06:42] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:06:42.266 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:06:42 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:06:42.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:06:41 smithi064 ceph-mon[34420]: pgmap v622: 33 pgs: 33 active+clean; 1.0 GiB data, 3.7 GiB used, 711 GiB / 715 GiB avail; 8.4 MiB/s rd, 8.3 MiB/s wr, 577 op/s 2024-03-26T17:06:42.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:06:41 smithi149 ceph-mon[34678]: pgmap v622: 33 pgs: 33 active+clean; 1.0 GiB data, 3.7 GiB used, 711 GiB / 715 GiB avail; 8.4 MiB/s rd, 8.3 MiB/s wr, 577 op/s 2024-03-26T17:06:42.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:06:42 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:06:42] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:06:42.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:06:42 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:06:42] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:06:42.897 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:06:42 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:06:43.062 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:06:43.072 INFO:tasks.workunit.client.3.smithi157.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2024-03-26T17:06:43.072 INFO:tasks.workunit.client.3.smithi157.stdout: 9.10 118.0k 160.0k 0.0k 1.2M 1.6M 0.0k nvme2n1 2024-03-26T17:06:43.072 INFO:tasks.workunit.client.3.smithi157.stdout: 9.00 114.8k 161.6k 0.0k 1.1M 1.6M 0.0k nvme2n10 2024-03-26T17:06:43.072 INFO:tasks.workunit.client.3.smithi157.stdout: 9.00 126.8k 147.2k 0.0k 1.2M 1.4M 0.0k nvme2n11 2024-03-26T17:06:43.072 INFO:tasks.workunit.client.3.smithi157.stdout: 9.00 171.6k 94.8k 0.0k 1.7M 948.0k 0.0k nvme2n12 2024-03-26T17:06:43.072 INFO:tasks.workunit.client.3.smithi157.stdout: 9.00 101.2k 134.4k 0.0k 1012.0k 1.3M 0.0k nvme2n13 2024-03-26T17:06:43.072 INFO:tasks.workunit.client.3.smithi157.stdout: 9.10 151.2k 127.2k 0.0k 1.5M 1.2M 0.0k nvme2n14 2024-03-26T17:06:43.072 INFO:tasks.workunit.client.3.smithi157.stdout: 9.10 134.0k 130.4k 0.0k 1.3M 1.3M 0.0k nvme2n15 2024-03-26T17:06:43.072 INFO:tasks.workunit.client.3.smithi157.stdout: 9.10 142.4k 107.6k 0.0k 1.4M 1.1M 0.0k nvme2n16 2024-03-26T17:06:43.073 INFO:tasks.workunit.client.3.smithi157.stdout: 9.10 145.2k 109.6k 0.0k 1.4M 1.1M 0.0k nvme2n17 2024-03-26T17:06:43.073 INFO:tasks.workunit.client.3.smithi157.stdout: 9.10 129.2k 122.8k 0.0k 1.3M 1.2M 0.0k nvme2n18 2024-03-26T17:06:43.073 INFO:tasks.workunit.client.3.smithi157.stdout: 9.10 134.4k 127.2k 0.0k 1.3M 1.2M 0.0k nvme2n19 2024-03-26T17:06:43.073 INFO:tasks.workunit.client.3.smithi157.stdout: 9.10 134.0k 113.6k 0.0k 1.3M 1.1M 0.0k nvme2n2 2024-03-26T17:06:43.073 INFO:tasks.workunit.client.3.smithi157.stdout: 9.10 127.6k 112.4k 0.0k 1.2M 1.1M 0.0k nvme2n20 2024-03-26T17:06:43.073 INFO:tasks.workunit.client.3.smithi157.stdout: 9.10 135.2k 148.8k 0.0k 1.3M 1.5M 0.0k nvme2n3 2024-03-26T17:06:43.073 INFO:tasks.workunit.client.3.smithi157.stdout: 9.10 143.6k 128.4k 0.0k 1.4M 1.3M 0.0k nvme2n4 2024-03-26T17:06:43.073 INFO:tasks.workunit.client.3.smithi157.stdout: 9.10 132.0k 164.0k 0.0k 1.3M 1.6M 0.0k nvme2n5 2024-03-26T17:06:43.073 INFO:tasks.workunit.client.3.smithi157.stdout: 9.10 111.2k 142.0k 0.0k 1.1M 1.4M 0.0k nvme2n6 2024-03-26T17:06:43.073 INFO:tasks.workunit.client.3.smithi157.stdout: 9.10 155.6k 130.4k 0.0k 1.5M 1.3M 0.0k nvme2n7 2024-03-26T17:06:43.074 INFO:tasks.workunit.client.3.smithi157.stdout: 9.10 133.2k 124.4k 0.0k 1.3M 1.2M 0.0k nvme2n8 2024-03-26T17:06:43.074 INFO:tasks.workunit.client.3.smithi157.stdout: 9.00 132.8k 136.0k 0.0k 1.3M 1.3M 0.0k nvme2n9 2024-03-26T17:06:43.074 INFO:tasks.workunit.client.3.smithi157.stdout: 9.10 117.2k 130.0k 0.0k 1.1M 1.3M 0.0k nvme5n1 2024-03-26T17:06:43.074 INFO:tasks.workunit.client.3.smithi157.stdout: 9.00 134.8k 131.2k 0.0k 1.3M 1.3M 0.0k nvme5n10 2024-03-26T17:06:43.074 INFO:tasks.workunit.client.3.smithi157.stdout: 9.00 138.8k 134.4k 0.0k 1.4M 1.3M 0.0k nvme5n11 2024-03-26T17:06:43.074 INFO:tasks.workunit.client.3.smithi157.stdout: 9.00 140.8k 146.4k 0.0k 1.4M 1.4M 0.0k nvme5n12 2024-03-26T17:06:43.074 INFO:tasks.workunit.client.3.smithi157.stdout: 9.00 155.6k 143.6k 0.0k 1.5M 1.4M 0.0k nvme5n13 2024-03-26T17:06:43.074 INFO:tasks.workunit.client.3.smithi157.stdout: 9.10 157.6k 146.8k 0.0k 1.5M 1.4M 0.0k nvme5n14 2024-03-26T17:06:43.074 INFO:tasks.workunit.client.3.smithi157.stdout: 9.10 142.8k 122.8k 0.0k 1.4M 1.2M 0.0k nvme5n15 2024-03-26T17:06:43.074 INFO:tasks.workunit.client.3.smithi157.stdout: 9.10 121.2k 133.2k 0.0k 1.2M 1.3M 0.0k nvme5n16 2024-03-26T17:06:43.074 INFO:tasks.workunit.client.3.smithi157.stdout: 9.10 135.6k 133.2k 0.0k 1.3M 1.3M 0.0k nvme5n17 2024-03-26T17:06:43.075 INFO:tasks.workunit.client.3.smithi157.stdout: 9.10 162.8k 125.2k 0.0k 1.6M 1.2M 0.0k nvme5n18 2024-03-26T17:06:43.075 INFO:tasks.workunit.client.3.smithi157.stdout: 9.10 135.2k 124.8k 0.0k 1.3M 1.2M 0.0k nvme5n19 2024-03-26T17:06:43.075 INFO:tasks.workunit.client.3.smithi157.stdout: 9.10 136.0k 113.6k 0.0k 1.3M 1.1M 0.0k nvme5n2 2024-03-26T17:06:43.075 INFO:tasks.workunit.client.3.smithi157.stdout: 9.10 110.8k 162.8k 0.0k 1.1M 1.6M 0.0k nvme5n20 2024-03-26T17:06:43.075 INFO:tasks.workunit.client.3.smithi157.stdout: 9.10 148.0k 126.0k 0.0k 1.4M 1.2M 0.0k nvme5n3 2024-03-26T17:06:43.075 INFO:tasks.workunit.client.3.smithi157.stdout: 9.10 140.4k 134.8k 0.0k 1.4M 1.3M 0.0k nvme5n4 2024-03-26T17:06:43.075 INFO:tasks.workunit.client.3.smithi157.stdout: 9.10 108.8k 138.4k 0.0k 1.1M 1.4M 0.0k nvme5n5 2024-03-26T17:06:43.075 INFO:tasks.workunit.client.3.smithi157.stdout: 9.10 155.6k 120.0k 0.0k 1.5M 1.2M 0.0k nvme5n6 2024-03-26T17:06:43.075 INFO:tasks.workunit.client.3.smithi157.stdout: 9.10 139.6k 143.6k 0.0k 1.4M 1.4M 0.0k nvme5n7 2024-03-26T17:06:43.075 INFO:tasks.workunit.client.3.smithi157.stdout: 9.10 124.8k 168.0k 0.0k 1.2M 1.6M 0.0k nvme5n8 2024-03-26T17:06:43.075 INFO:tasks.workunit.client.3.smithi157.stdout: 9.10 123.6k 127.2k 0.0k 1.2M 1.2M 0.0k nvme5n9 2024-03-26T17:06:43.075 INFO:tasks.workunit.client.3.smithi157.stdout: 9.10 128.4k 120.0k 0.0k 1.3M 1.2M 0.0k nvme8n1 2024-03-26T17:06:43.075 INFO:tasks.workunit.client.3.smithi157.stdout: 9.00 120.4k 96.8k 0.0k 1.2M 968.0k 0.0k nvme8n10 2024-03-26T17:06:43.075 INFO:tasks.workunit.client.3.smithi157.stdout: 9.00 147.6k 120.8k 0.0k 1.4M 1.2M 0.0k nvme8n11 2024-03-26T17:06:43.075 INFO:tasks.workunit.client.3.smithi157.stdout: 9.00 124.8k 121.6k 0.0k 1.2M 1.2M 0.0k nvme8n12 2024-03-26T17:06:43.076 INFO:tasks.workunit.client.3.smithi157.stdout: 9.10 145.6k 128.4k 0.0k 1.4M 1.3M 0.0k nvme8n13 2024-03-26T17:06:43.076 INFO:tasks.workunit.client.3.smithi157.stdout: 9.10 140.8k 118.4k 0.0k 1.4M 1.2M 0.0k nvme8n14 2024-03-26T17:06:43.076 INFO:tasks.workunit.client.3.smithi157.stdout: 9.10 131.6k 152.0k 0.0k 1.3M 1.5M 0.0k nvme8n15 2024-03-26T17:06:43.076 INFO:tasks.workunit.client.3.smithi157.stdout: 9.10 153.6k 96.8k 0.0k 1.5M 968.0k 0.0k nvme8n16 2024-03-26T17:06:43.076 INFO:tasks.workunit.client.3.smithi157.stdout: 9.10 103.6k 137.2k 0.0k 1.0M 1.3M 0.0k nvme8n17 2024-03-26T17:06:43.076 INFO:tasks.workunit.client.3.smithi157.stdout: 9.10 139.2k 128.0k 0.0k 1.4M 1.2M 0.0k nvme8n18 2024-03-26T17:06:43.076 INFO:tasks.workunit.client.3.smithi157.stdout: 9.10 172.8k 84.0k 0.0k 1.7M 840.0k 0.0k nvme8n19 2024-03-26T17:06:43.076 INFO:tasks.workunit.client.3.smithi157.stdout: 9.10 134.4k 138.4k 0.0k 1.3M 1.4M 0.0k nvme8n2 2024-03-26T17:06:43.076 INFO:tasks.workunit.client.3.smithi157.stdout: 9.10 94.0k 138.8k 0.0k 940.0k 1.4M 0.0k nvme8n20 2024-03-26T17:06:43.076 INFO:tasks.workunit.client.3.smithi157.stdout: 9.10 124.8k 148.4k 0.0k 1.2M 1.4M 0.0k nvme8n3 2024-03-26T17:06:43.076 INFO:tasks.workunit.client.3.smithi157.stdout: 9.10 158.4k 89.2k 0.0k 1.5M 892.0k 0.0k nvme8n4 2024-03-26T17:06:43.076 INFO:tasks.workunit.client.3.smithi157.stdout: 9.10 127.2k 168.4k 0.0k 1.2M 1.6M 0.0k nvme8n5 2024-03-26T17:06:43.076 INFO:tasks.workunit.client.3.smithi157.stdout: 9.10 123.6k 156.0k 0.0k 1.2M 1.5M 0.0k nvme8n6 2024-03-26T17:06:43.076 INFO:tasks.workunit.client.3.smithi157.stdout: 9.10 106.0k 157.2k 0.0k 1.0M 1.5M 0.0k nvme8n7 2024-03-26T17:06:43.077 INFO:tasks.workunit.client.3.smithi157.stdout: 9.10 148.4k 114.4k 0.0k 1.4M 1.1M 0.0k nvme8n8 2024-03-26T17:06:43.077 INFO:tasks.workunit.client.3.smithi157.stdout: 9.00 120.8k 126.8k 0.0k 1.2M 1.2M 0.0k nvme8n9 2024-03-26T17:06:43.077 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:06:43.266 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:06:43 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T17:06:43.266 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:06:43 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-26T17:06:43.266 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:06:43 smithi044 ceph-mon[30624]: pgmap v623: 33 pgs: 33 active+clean; 1.0 GiB data, 3.7 GiB used, 711 GiB / 715 GiB avail; 7.3 MiB/s rd, 7.0 MiB/s wr, 486 op/s 2024-03-26T17:06:43.266 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:06:43 smithi044 ceph-mon[30624]: pgmap v624: 33 pgs: 33 active+clean; 1.0 GiB data, 3.7 GiB used, 711 GiB / 715 GiB avail; 7.7 MiB/s rd, 7.4 MiB/s wr, 519 op/s 2024-03-26T17:06:43.266 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:06:43 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T17:06:43.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:06:43 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T17:06:43.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:06:43 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-26T17:06:43.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:06:43 smithi064 ceph-mon[34420]: pgmap v623: 33 pgs: 33 active+clean; 1.0 GiB data, 3.7 GiB used, 711 GiB / 715 GiB avail; 7.3 MiB/s rd, 7.0 MiB/s wr, 486 op/s 2024-03-26T17:06:43.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:06:43 smithi064 ceph-mon[34420]: pgmap v624: 33 pgs: 33 active+clean; 1.0 GiB data, 3.7 GiB used, 711 GiB / 715 GiB avail; 7.7 MiB/s rd, 7.4 MiB/s wr, 519 op/s 2024-03-26T17:06:43.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:06:43 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T17:06:43.344 INFO:tasks.workunit.client.3.smithi157.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-26T17:06:43.345 INFO:tasks.workunit.client.3.smithi157.stdout:myimage42 6/s 3/s 166 KiB/s 114 KiB/s 2.06 ms 382.41 us 2024-03-26T17:06:43.345 INFO:tasks.workunit.client.3.smithi157.stdout:myimage31 5/s 4/s 143 KiB/s 129 KiB/s 2.25 ms 384.81 us 2024-03-26T17:06:43.345 INFO:tasks.workunit.client.3.smithi157.stdout:myimage4 5/s 4/s 162 KiB/s 116 KiB/s 2.19 ms 325.10 us 2024-03-26T17:06:43.345 INFO:tasks.workunit.client.3.smithi157.stdout:myimage11 5/s 4/s 170 KiB/s 134 KiB/s 2.22 ms 329.13 us 2024-03-26T17:06:43.345 INFO:tasks.workunit.client.3.smithi157.stdout:myimage28 5/s 3/s 188 KiB/s 98 KiB/s 2.66 ms 357.11 us 2024-03-26T17:06:43.345 INFO:tasks.workunit.client.3.smithi157.stdout:myimage39 5/s 4/s 154 KiB/s 126 KiB/s 2.00 ms 333.37 us 2024-03-26T17:06:43.345 INFO:tasks.workunit.client.3.smithi157.stdout:myimage55 5/s 4/s 129 KiB/s 161 KiB/s 2.24 ms 357.83 us 2024-03-26T17:06:43.345 INFO:tasks.workunit.client.3.smithi157.stdout:myimage10 5/s 3/s 178 KiB/s 102 KiB/s 2.10 ms 409.99 us 2024-03-26T17:06:43.345 INFO:tasks.workunit.client.3.smithi157.stdout:myimage45 5/s 4/s 171 KiB/s 138 KiB/s 2.12 ms 370.18 us 2024-03-26T17:06:43.345 INFO:tasks.workunit.client.3.smithi157.stdout:myimage60 5/s 3/s 128 KiB/s 84 KiB/s 2.25 ms 353.10 us 2024-03-26T17:06:43.345 INFO:tasks.workunit.client.3.smithi157.stdout:myimage2 5/s 3/s 104 KiB/s 147 KiB/s 2.33 ms 463.86 us 2024-03-26T17:06:43.345 INFO:tasks.workunit.client.3.smithi157.stdout:myimage49 5/s 5/s 126 KiB/s 146 KiB/s 2.11 ms 351.03 us 2024-03-26T17:06:43.346 INFO:tasks.workunit.client.3.smithi157.stdout:myimage5 5/s 3/s 157 KiB/s 108 KiB/s 2.18 ms 375.13 us 2024-03-26T17:06:43.346 INFO:tasks.workunit.client.3.smithi157.stdout:myimage24 5/s 3/s 121 KiB/s 123 KiB/s 2.05 ms 446.40 us 2024-03-26T17:06:43.346 INFO:tasks.workunit.client.3.smithi157.stdout:myimage14 4/s 4/s 142 KiB/s 147 KiB/s 2.32 ms 372.02 us 2024-03-26T17:06:43.346 INFO:tasks.workunit.client.3.smithi157.stdout:myimage8 4/s 4/s 138 KiB/s 141 KiB/s 2.06 ms 403.52 us 2024-03-26T17:06:43.346 INFO:tasks.workunit.client.3.smithi157.stdout:myimage29 4/s 5/s 126 KiB/s 146 KiB/s 1.92 ms 406.77 us 2024-03-26T17:06:43.346 INFO:tasks.workunit.client.3.smithi157.stdout:myimage53 4/s 4/s 112 KiB/s 140 KiB/s 2.14 ms 432.57 us 2024-03-26T17:06:43.346 INFO:tasks.workunit.client.3.smithi157.stdout:myimage57 4/s 4/s 123 KiB/s 99 KiB/s 2.05 ms 310.41 us 2024-03-26T17:06:43.346 INFO:tasks.workunit.client.3.smithi157.stdout:myimage47 4/s 3/s 143 KiB/s 87 KiB/s 2.25 ms 390.95 us 2024-03-26T17:06:43.346 INFO:tasks.workunit.client.3.smithi157.stdout:myimage48 4/s 5/s 132 KiB/s 154 KiB/s 2.35 ms 341.63 us 2024-03-26T17:06:43.346 INFO:tasks.workunit.client.3.smithi157.stdout:myimage52 4/s 4/s 148 KiB/s 123 KiB/s 2.51 ms 348.06 us 2024-03-26T17:06:43.346 INFO:tasks.workunit.client.3.smithi157.stdout:myimage1 4/s 3/s 129 KiB/s 105 KiB/s 1.82 ms 313.96 us 2024-03-26T17:06:43.346 INFO:tasks.workunit.client.3.smithi157.stdout:myimage20 4/s 4/s 120 KiB/s 102 KiB/s 1.86 ms 406.29 us 2024-03-26T17:06:43.346 INFO:tasks.workunit.client.3.smithi157.stdout:myimage54 4/s 4/s 141 KiB/s 129 KiB/s 2.12 ms 346.83 us 2024-03-26T17:06:43.346 INFO:tasks.workunit.client.3.smithi157.stdout:myimage22 4/s 4/s 141 KiB/s 118 KiB/s 2.14 ms 385.35 us 2024-03-26T17:06:43.347 INFO:tasks.workunit.client.3.smithi157.stdout:myimage7 4/s 5/s 131 KiB/s 174 KiB/s 2.09 ms 378.08 us 2024-03-26T17:06:43.347 INFO:tasks.workunit.client.3.smithi157.stdout:myimage15 4/s 4/s 114 KiB/s 132 KiB/s 2.15 ms 366.70 us 2024-03-26T17:06:43.347 INFO:tasks.workunit.client.3.smithi157.stdout:myimage18 4/s 4/s 89 KiB/s 158 KiB/s 2.09 ms 407.55 us 2024-03-26T17:06:43.347 INFO:tasks.workunit.client.3.smithi157.stdout:myimage36 4/s 4/s 128 KiB/s 150 KiB/s 2.08 ms 427.67 us 2024-03-26T17:06:43.347 INFO:tasks.workunit.client.3.smithi157.stdout:myimage43 4/s 3/s 153 KiB/s 99 KiB/s 2.42 ms 378.03 us 2024-03-26T17:06:43.347 INFO:tasks.workunit.client.3.smithi157.stdout:myimage3 4/s 5/s 119 KiB/s 141 KiB/s 1.96 ms 322.44 us 2024-03-26T17:06:43.347 INFO:tasks.workunit.client.3.smithi157.stdout:myimage38 4/s 5/s 129 KiB/s 186 KiB/s 1.90 ms 408.05 us 2024-03-26T17:06:43.347 INFO:tasks.workunit.client.3.smithi157.stdout:myimage40 4/s 4/s 152 KiB/s 109 KiB/s 2.07 ms 312.35 us 2024-03-26T17:06:43.347 INFO:tasks.workunit.client.3.smithi157.stdout:myimage58 4/s 3/s 127 KiB/s 118 KiB/s 1.94 ms 390.64 us 2024-03-26T17:06:43.347 INFO:tasks.workunit.client.3.smithi157.stdout:myimage6 4/s 5/s 133 KiB/s 127 KiB/s 2.05 ms 355.35 us 2024-03-26T17:06:43.347 INFO:tasks.workunit.client.3.smithi157.stdout:myimage13 4/s 3/s 116 KiB/s 76 KiB/s 1.94 ms 304.40 us 2024-03-26T17:06:43.347 INFO:tasks.workunit.client.3.smithi157.stdout:myimage32 4/s 5/s 122 KiB/s 202 KiB/s 2.21 ms 362.38 us 2024-03-26T17:06:43.347 INFO:tasks.workunit.client.3.smithi157.stdout:myimage19 4/s 5/s 128 KiB/s 142 KiB/s 2.21 ms 383.04 us 2024-03-26T17:06:43.347 INFO:tasks.workunit.client.3.smithi157.stdout:myimage25 4/s 4/s 128 KiB/s 115 KiB/s 2.42 ms 352.90 us 2024-03-26T17:06:43.348 INFO:tasks.workunit.client.3.smithi157.stdout:myimage26 4/s 3/s 128 KiB/s 118 KiB/s 2.26 ms 309.12 us 2024-03-26T17:06:43.348 INFO:tasks.workunit.client.3.smithi157.stdout:myimage41 4/s 4/s 126 KiB/s 132 KiB/s 2.15 ms 450.94 us 2024-03-26T17:06:43.348 INFO:tasks.workunit.client.3.smithi157.stdout:myimage16 3/s 4/s 124 KiB/s 142 KiB/s 2.26 ms 363.13 us 2024-03-26T17:06:43.348 INFO:tasks.workunit.client.3.smithi157.stdout:myimage30 3/s 4/s 106 KiB/s 166 KiB/s 2.59 ms 381.11 us 2024-03-26T17:06:43.348 INFO:tasks.workunit.client.3.smithi157.stdout:myimage34 3/s 4/s 118 KiB/s 177 KiB/s 1.97 ms 350.68 us 2024-03-26T17:06:43.348 INFO:tasks.workunit.client.3.smithi157.stdout:myimage37 3/s 5/s 117 KiB/s 153 KiB/s 2.55 ms 338.65 us 2024-03-26T17:06:43.348 INFO:tasks.workunit.client.3.smithi157.stdout:myimage44 3/s 5/s 103 KiB/s 146 KiB/s 2.13 ms 332.17 us 2024-03-26T17:06:43.348 INFO:tasks.workunit.client.3.smithi157.stdout:myimage9 3/s 5/s 126 KiB/s 173 KiB/s 2.40 ms 367.57 us 2024-03-26T17:06:43.348 INFO:tasks.workunit.client.3.smithi157.stdout:myimage33 3/s 4/s 142 KiB/s 129 KiB/s 2.23 ms 368.67 us 2024-03-26T17:06:43.348 INFO:tasks.workunit.client.3.smithi157.stdout:myimage46 3/s 5/s 136 KiB/s 134 KiB/s 2.07 ms 333.98 us 2024-03-26T17:06:43.348 INFO:tasks.workunit.client.3.smithi157.stdout:myimage56 3/s 5/s 106 KiB/s 153 KiB/s 2.56 ms 331.06 us 2024-03-26T17:06:43.348 INFO:tasks.workunit.client.3.smithi157.stdout:myimage23 3/s 6/s 113 KiB/s 178 KiB/s 1.77 ms 311.15 us 2024-03-26T17:06:43.348 INFO:tasks.workunit.client.3.smithi157.stdout:myimage35 3/s 6/s 89 KiB/s 179 KiB/s 2.21 ms 303.89 us 2024-03-26T17:06:43.348 INFO:tasks.workunit.client.3.smithi157.stdout:myimage17 3/s 3/s 92 KiB/s 96 KiB/s 2.25 ms 490.53 us 2024-03-26T17:06:43.348 INFO:tasks.workunit.client.3.smithi157.stdout:myimage21 3/s 5/s 118 KiB/s 168 KiB/s 2.75 ms 345.97 us 2024-03-26T17:06:43.349 INFO:tasks.workunit.client.3.smithi157.stdout:myimage51 3/s 6/s 103 KiB/s 170 KiB/s 2.30 ms 354.76 us 2024-03-26T17:06:43.349 INFO:tasks.workunit.client.3.smithi157.stdout:myimage50 3/s 4/s 70 KiB/s 122 KiB/s 2.19 ms 328.69 us 2024-03-26T17:06:43.349 INFO:tasks.workunit.client.3.smithi157.stdout:myimage59 3/s 5/s 80 KiB/s 177 KiB/s 2.25 ms 415.64 us 2024-03-26T17:06:43.349 INFO:tasks.workunit.client.3.smithi157.stdout:myimage12 3/s 5/s 89 KiB/s 169 KiB/s 2.21 ms 347.97 us 2024-03-26T17:06:43.349 INFO:tasks.workunit.client.3.smithi157.stdout:myimage27 3/s 3/s 100 KiB/s 130 KiB/s 1.95 ms 323.06 us 2024-03-26T17:06:43.349 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:06:43.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:06:43 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T17:06:43.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:06:43 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-26T17:06:43.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:06:43 smithi149 ceph-mon[34678]: pgmap v623: 33 pgs: 33 active+clean; 1.0 GiB data, 3.7 GiB used, 711 GiB / 715 GiB avail; 7.3 MiB/s rd, 7.0 MiB/s wr, 486 op/s 2024-03-26T17:06:43.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:06:43 smithi149 ceph-mon[34678]: pgmap v624: 33 pgs: 33 active+clean; 1.0 GiB data, 3.7 GiB used, 711 GiB / 715 GiB avail; 7.7 MiB/s rd, 7.4 MiB/s wr, 519 op/s 2024-03-26T17:06:43.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:06:43 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T17:06:44.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:06:44 smithi044 ceph-mon[30624]: Health check update: 3 slow ops, oldest one blocked for 498 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:06:44.265 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:06:44 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:06:44] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:06:44.265 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:06:44 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:06:44] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:06:44.266 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:06:44 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:06:44.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:06:44 smithi064 ceph-mon[34420]: Health check update: 3 slow ops, oldest one blocked for 498 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:06:44.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:06:44 smithi149 ceph-mon[34678]: Health check update: 3 slow ops, oldest one blocked for 498 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:06:44.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:06:44 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:06:44] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:06:44.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:06:44 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:06:44] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:06:44.897 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:06:44 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:06:45.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:06:45 smithi044 ceph-mon[30624]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:06:45.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:06:45 smithi044 ceph-mon[30624]: { 2024-03-26T17:06:45.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:06:45 smithi044 ceph-mon[30624]: "prefix": "rbd perf image stats", 2024-03-26T17:06:45.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:06:45 smithi044 ceph-mon[30624]: "pool_spec": "mypool", 2024-03-26T17:06:45.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:06:45 smithi044 ceph-mon[30624]: "sort_by": "write_ops", 2024-03-26T17:06:45.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:06:45 smithi044 ceph-mon[30624]: "format": "json" 2024-03-26T17:06:45.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:06:45 smithi044 ceph-mon[30624]: }"]: dispatch 2024-03-26T17:06:45.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:06:45 smithi044 ceph-mon[30624]: pgmap v625: 33 pgs: 33 active+clean; 1.0 GiB data, 3.7 GiB used, 711 GiB / 715 GiB avail; 7.7 MiB/s rd, 7.5 MiB/s wr, 528 op/s 2024-03-26T17:06:45.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:06:45 smithi064 ceph-mon[34420]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:06:45.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:06:45 smithi064 ceph-mon[34420]: { 2024-03-26T17:06:45.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:06:45 smithi064 ceph-mon[34420]: "prefix": "rbd perf image stats", 2024-03-26T17:06:45.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:06:45 smithi064 ceph-mon[34420]: "pool_spec": "mypool", 2024-03-26T17:06:45.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:06:45 smithi064 ceph-mon[34420]: "sort_by": "write_ops", 2024-03-26T17:06:45.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:06:45 smithi064 ceph-mon[34420]: "format": "json" 2024-03-26T17:06:45.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:06:45 smithi064 ceph-mon[34420]: }"]: dispatch 2024-03-26T17:06:45.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:06:45 smithi064 ceph-mon[34420]: pgmap v625: 33 pgs: 33 active+clean; 1.0 GiB data, 3.7 GiB used, 711 GiB / 715 GiB avail; 7.7 MiB/s rd, 7.5 MiB/s wr, 528 op/s 2024-03-26T17:06:45.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:06:45 smithi149 ceph-mon[34678]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:06:45.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:06:45 smithi149 ceph-mon[34678]: { 2024-03-26T17:06:45.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:06:45 smithi149 ceph-mon[34678]: "prefix": "rbd perf image stats", 2024-03-26T17:06:45.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:06:45 smithi149 ceph-mon[34678]: "pool_spec": "mypool", 2024-03-26T17:06:45.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:06:45 smithi149 ceph-mon[34678]: "sort_by": "write_ops", 2024-03-26T17:06:45.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:06:45 smithi149 ceph-mon[34678]: "format": "json" 2024-03-26T17:06:45.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:06:45 smithi149 ceph-mon[34678]: }"]: dispatch 2024-03-26T17:06:45.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:06:45 smithi149 ceph-mon[34678]: pgmap v625: 33 pgs: 33 active+clean; 1.0 GiB data, 3.7 GiB used, 711 GiB / 715 GiB avail; 7.7 MiB/s rd, 7.5 MiB/s wr, 528 op/s 2024-03-26T17:06:46.484 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:06:46 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:06:46] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:06:46.484 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:06:46 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 2024-03-26T17:06:46.228+0000 7fa707a55700 -1 mon.c@1(peon) e3 get_health_metrics reporting 3 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T17:06:46.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:06:46 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:06:46] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:06:46.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:06:46 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:06:46] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:06:46.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:06:46 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:06:46.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:06:46 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:06:46] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:06:46.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:06:46 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:06:47.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:06:47 smithi044 ceph-mon[30624]: pgmap v626: 33 pgs: 33 active+clean; 1.0 GiB data, 3.7 GiB used, 711 GiB / 715 GiB avail; 8.4 MiB/s rd, 8.2 MiB/s wr, 591 op/s 2024-03-26T17:06:47.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:06:47 smithi064 ceph-mon[34420]: pgmap v626: 33 pgs: 33 active+clean; 1.0 GiB data, 3.7 GiB used, 711 GiB / 715 GiB avail; 8.4 MiB/s rd, 8.2 MiB/s wr, 591 op/s 2024-03-26T17:06:47.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:06:47 smithi149 ceph-mon[34678]: pgmap v626: 33 pgs: 33 active+clean; 1.0 GiB data, 3.7 GiB used, 711 GiB / 715 GiB avail; 8.4 MiB/s rd, 8.2 MiB/s wr, 591 op/s 2024-03-26T17:06:48.350 INFO:tasks.workunit.client.3.smithi157.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-26T17:06:48.350 INFO:tasks.workunit.client.3.smithi157.stdout:myimage32 6/s 3/s 198 KiB/s 136 KiB/s 2.24 ms 422.88 us 2024-03-26T17:06:48.350 INFO:tasks.workunit.client.3.smithi157.stdout:myimage21 6/s 3/s 161 KiB/s 96 KiB/s 2.64 ms 463.88 us 2024-03-26T17:06:48.350 INFO:tasks.workunit.client.3.smithi157.stdout:myimage40 6/s 5/s 156 KiB/s 160 KiB/s 2.05 ms 354.96 us 2024-03-26T17:06:48.350 INFO:tasks.workunit.client.3.smithi157.stdout:myimage13 6/s 4/s 137 KiB/s 104 KiB/s 2.06 ms 396.32 us 2024-03-26T17:06:48.350 INFO:tasks.workunit.client.3.smithi157.stdout:myimage2 5/s 3/s 142 KiB/s 83 KiB/s 2.20 ms 347.65 us 2024-03-26T17:06:48.350 INFO:tasks.workunit.client.3.smithi157.stdout:myimage27 5/s 4/s 166 KiB/s 115 KiB/s 1.95 ms 345.64 us 2024-03-26T17:06:48.350 INFO:tasks.workunit.client.3.smithi157.stdout:myimage7 5/s 3/s 154 KiB/s 102 KiB/s 2.12 ms 341.70 us 2024-03-26T17:06:48.351 INFO:tasks.workunit.client.3.smithi157.stdout:myimage23 5/s 3/s 158 KiB/s 110 KiB/s 2.05 ms 336.25 us 2024-03-26T17:06:48.351 INFO:tasks.workunit.client.3.smithi157.stdout:myimage31 5/s 3/s 158 KiB/s 85 KiB/s 2.45 ms 325.25 us 2024-03-26T17:06:48.351 INFO:tasks.workunit.client.3.smithi157.stdout:myimage15 5/s 4/s 154 KiB/s 140 KiB/s 2.12 ms 358.59 us 2024-03-26T17:06:48.351 INFO:tasks.workunit.client.3.smithi157.stdout:myimage46 5/s 5/s 165 KiB/s 157 KiB/s 2.03 ms 382.41 us 2024-03-26T17:06:48.351 INFO:tasks.workunit.client.3.smithi157.stdout:myimage50 5/s 4/s 145 KiB/s 116 KiB/s 2.10 ms 456.21 us 2024-03-26T17:06:48.351 INFO:tasks.workunit.client.3.smithi157.stdout:myimage57 5/s 3/s 188 KiB/s 107 KiB/s 2.36 ms 341.67 us 2024-03-26T17:06:48.351 INFO:tasks.workunit.client.3.smithi157.stdout:myimage44 5/s 3/s 137 KiB/s 104 KiB/s 2.12 ms 358.52 us 2024-03-26T17:06:48.351 INFO:tasks.workunit.client.3.smithi157.stdout:myimage18 5/s 4/s 137 KiB/s 102 KiB/s 2.14 ms 358.98 us 2024-03-26T17:06:48.351 INFO:tasks.workunit.client.3.smithi157.stdout:myimage10 5/s 3/s 153 KiB/s 130 KiB/s 2.13 ms 432.94 us 2024-03-26T17:06:48.351 INFO:tasks.workunit.client.3.smithi157.stdout:myimage3 5/s 4/s 152 KiB/s 109 KiB/s 1.82 ms 327.40 us 2024-03-26T17:06:48.351 INFO:tasks.workunit.client.3.smithi157.stdout:myimage30 5/s 4/s 143 KiB/s 112 KiB/s 2.54 ms 493.31 us 2024-03-26T17:06:48.351 INFO:tasks.workunit.client.3.smithi157.stdout:myimage34 5/s 4/s 170 KiB/s 144 KiB/s 2.03 ms 345.96 us 2024-03-26T17:06:48.351 INFO:tasks.workunit.client.3.smithi157.stdout:myimage37 5/s 4/s 119 KiB/s 122 KiB/s 2.25 ms 396.50 us 2024-03-26T17:06:48.352 INFO:tasks.workunit.client.3.smithi157.stdout:myimage48 5/s 4/s 115 KiB/s 134 KiB/s 2.21 ms 333.86 us 2024-03-26T17:06:48.352 INFO:tasks.workunit.client.3.smithi157.stdout:myimage33 5/s 4/s 155 KiB/s 128 KiB/s 2.22 ms 343.40 us 2024-03-26T17:06:48.352 INFO:tasks.workunit.client.3.smithi157.stdout:myimage36 5/s 3/s 111 KiB/s 101 KiB/s 2.04 ms 403.86 us 2024-03-26T17:06:48.352 INFO:tasks.workunit.client.3.smithi157.stdout:myimage60 5/s 5/s 117 KiB/s 143 KiB/s 2.51 ms 328.71 us 2024-03-26T17:06:48.352 INFO:tasks.workunit.client.3.smithi157.stdout:myimage16 4/s 5/s 143 KiB/s 135 KiB/s 2.27 ms 338.44 us 2024-03-26T17:06:48.352 INFO:tasks.workunit.client.3.smithi157.stdout:myimage1 4/s 5/s 186 KiB/s 130 KiB/s 1.90 ms 315.29 us 2024-03-26T17:06:48.352 INFO:tasks.workunit.client.3.smithi157.stdout:myimage5 4/s 4/s 135 KiB/s 134 KiB/s 2.02 ms 339.50 us 2024-03-26T17:06:48.352 INFO:tasks.workunit.client.3.smithi157.stdout:myimage6 4/s 4/s 132 KiB/s 101 KiB/s 2.28 ms 385.49 us 2024-03-26T17:06:48.352 INFO:tasks.workunit.client.3.smithi157.stdout:myimage24 4/s 5/s 130 KiB/s 136 KiB/s 2.22 ms 432.38 us 2024-03-26T17:06:48.352 INFO:tasks.workunit.client.3.smithi157.stdout:myimage26 4/s 6/s 124 KiB/s 153 KiB/s 2.18 ms 349.03 us 2024-03-26T17:06:48.352 INFO:tasks.workunit.client.3.smithi157.stdout:myimage14 4/s 4/s 131 KiB/s 109 KiB/s 2.40 ms 451.01 us 2024-03-26T17:06:48.352 INFO:tasks.workunit.client.3.smithi157.stdout:myimage49 4/s 4/s 103 KiB/s 139 KiB/s 2.23 ms 409.83 us 2024-03-26T17:06:48.353 INFO:tasks.workunit.client.3.smithi157.stdout:myimage17 4/s 6/s 150 KiB/s 170 KiB/s 2.29 ms 433.12 us 2024-03-26T17:06:48.353 INFO:tasks.workunit.client.3.smithi157.stdout:myimage28 4/s 4/s 156 KiB/s 114 KiB/s 2.83 ms 376.87 us 2024-03-26T17:06:48.353 INFO:tasks.workunit.client.3.smithi157.stdout:myimage55 4/s 3/s 149 KiB/s 111 KiB/s 2.28 ms 463.75 us 2024-03-26T17:06:48.353 INFO:tasks.workunit.client.3.smithi157.stdout:myimage56 4/s 5/s 121 KiB/s 134 KiB/s 2.58 ms 360.27 us 2024-03-26T17:06:48.353 INFO:tasks.workunit.client.3.smithi157.stdout:myimage47 4/s 5/s 121 KiB/s 163 KiB/s 2.35 ms 474.39 us 2024-03-26T17:06:48.353 INFO:tasks.workunit.client.3.smithi157.stdout:myimage52 4/s 3/s 105 KiB/s 82 KiB/s 2.57 ms 329.94 us 2024-03-26T17:06:48.353 INFO:tasks.workunit.client.3.smithi157.stdout:myimage25 4/s 5/s 126 KiB/s 159 KiB/s 2.54 ms 355.73 us 2024-03-26T17:06:48.353 INFO:tasks.workunit.client.3.smithi157.stdout:myimage51 4/s 4/s 153 KiB/s 139 KiB/s 2.41 ms 407.91 us 2024-03-26T17:06:48.353 INFO:tasks.workunit.client.3.smithi157.stdout:myimage29 4/s 4/s 97 KiB/s 111 KiB/s 2.02 ms 331.59 us 2024-03-26T17:06:48.353 INFO:tasks.workunit.client.3.smithi157.stdout:myimage43 4/s 6/s 95 KiB/s 166 KiB/s 2.45 ms 366.34 us 2024-03-26T17:06:48.353 INFO:tasks.workunit.client.3.smithi157.stdout:myimage35 4/s 5/s 118 KiB/s 122 KiB/s 2.27 ms 317.31 us 2024-03-26T17:06:48.353 INFO:tasks.workunit.client.3.smithi157.stdout:myimage38 4/s 4/s 114 KiB/s 133 KiB/s 1.89 ms 374.43 us 2024-03-26T17:06:48.353 INFO:tasks.workunit.client.3.smithi157.stdout:myimage8 4/s 4/s 96 KiB/s 106 KiB/s 2.28 ms 304.90 us 2024-03-26T17:06:48.353 INFO:tasks.workunit.client.3.smithi157.stdout:myimage9 4/s 3/s 134 KiB/s 78 KiB/s 2.39 ms 330.69 us 2024-03-26T17:06:48.354 INFO:tasks.workunit.client.3.smithi157.stdout:myimage20 4/s 4/s 102 KiB/s 126 KiB/s 2.23 ms 356.39 us 2024-03-26T17:06:48.354 INFO:tasks.workunit.client.3.smithi157.stdout:myimage45 4/s 4/s 147 KiB/s 112 KiB/s 2.06 ms 466.26 us 2024-03-26T17:06:48.354 INFO:tasks.workunit.client.3.smithi157.stdout:myimage58 3/s 5/s 114 KiB/s 122 KiB/s 1.88 ms 403.41 us 2024-03-26T17:06:48.354 INFO:tasks.workunit.client.3.smithi157.stdout:myimage12 3/s 5/s 106 KiB/s 168 KiB/s 2.40 ms 380.94 us 2024-03-26T17:06:48.354 INFO:tasks.workunit.client.3.smithi157.stdout:myimage19 3/s 6/s 86 KiB/s 144 KiB/s 2.18 ms 368.14 us 2024-03-26T17:06:48.354 INFO:tasks.workunit.client.3.smithi157.stdout:myimage42 3/s 5/s 101 KiB/s 160 KiB/s 2.32 ms 382.49 us 2024-03-26T17:06:48.354 INFO:tasks.workunit.client.3.smithi157.stdout:myimage59 3/s 5/s 111 KiB/s 153 KiB/s 2.39 ms 360.45 us 2024-03-26T17:06:48.354 INFO:tasks.workunit.client.3.smithi157.stdout:myimage4 3/s 4/s 111 KiB/s 142 KiB/s 1.96 ms 405.69 us 2024-03-26T17:06:48.354 INFO:tasks.workunit.client.3.smithi157.stdout:myimage39 3/s 4/s 90 KiB/s 119 KiB/s 2.02 ms 355.79 us 2024-03-26T17:06:48.354 INFO:tasks.workunit.client.3.smithi157.stdout:myimage41 3/s 5/s 92 KiB/s 109 KiB/s 2.14 ms 331.90 us 2024-03-26T17:06:48.354 INFO:tasks.workunit.client.3.smithi157.stdout:myimage53 3/s 5/s 117 KiB/s 172 KiB/s 2.13 ms 424.69 us 2024-03-26T17:06:48.354 INFO:tasks.workunit.client.3.smithi157.stdout:myimage11 3/s 5/s 106 KiB/s 145 KiB/s 2.36 ms 350.58 us 2024-03-26T17:06:48.355 INFO:tasks.workunit.client.3.smithi157.stdout:myimage54 3/s 5/s 90 KiB/s 134 KiB/s 1.99 ms 410.25 us 2024-03-26T17:06:48.355 INFO:tasks.workunit.client.3.smithi157.stdout:myimage22 2/s 5/s 54 KiB/s 158 KiB/s 2.23 ms 393.75 us 2024-03-26T17:06:48.355 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:06:48.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:06:48 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:06:48] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:06:48.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:06:48 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:06:48] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:06:48.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:06:48 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:06:48.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:06:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:06:48] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:06:48.897 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:06:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:06:48] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:06:48.897 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:06:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:06:49.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:06:49 smithi044 ceph-mon[30624]: pgmap v627: 33 pgs: 33 active+clean; 1.0 GiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 7.7 MiB/s rd, 7.6 MiB/s wr, 551 op/s 2024-03-26T17:06:49.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:06:49 smithi044 ceph-mon[30624]: Health check update: 3 slow ops, oldest one blocked for 503 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:06:49.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:06:49 smithi064 ceph-mon[34420]: pgmap v627: 33 pgs: 33 active+clean; 1.0 GiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 7.7 MiB/s rd, 7.6 MiB/s wr, 551 op/s 2024-03-26T17:06:49.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:06:49 smithi064 ceph-mon[34420]: Health check update: 3 slow ops, oldest one blocked for 503 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:06:49.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:06:49 smithi149 ceph-mon[34678]: pgmap v627: 33 pgs: 33 active+clean; 1.0 GiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 7.7 MiB/s rd, 7.6 MiB/s wr, 551 op/s 2024-03-26T17:06:49.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:06:49 smithi149 ceph-mon[34678]: Health check update: 3 slow ops, oldest one blocked for 503 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:06:50.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:06:50 smithi064 ceph-mon[34420]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:06:50.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:06:50 smithi064 ceph-mon[34420]: { 2024-03-26T17:06:50.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:06:50 smithi064 ceph-mon[34420]: "prefix": "rbd perf image stats", 2024-03-26T17:06:50.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:06:50 smithi064 ceph-mon[34420]: "pool_spec": "mypool", 2024-03-26T17:06:50.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:06:50 smithi064 ceph-mon[34420]: "sort_by": "write_ops", 2024-03-26T17:06:50.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:06:50 smithi064 ceph-mon[34420]: "format": "json" 2024-03-26T17:06:50.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:06:50 smithi064 ceph-mon[34420]: }"]: dispatch 2024-03-26T17:06:50.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:06:50 smithi149 ceph-mon[34678]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:06:50.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:06:50 smithi149 ceph-mon[34678]: { 2024-03-26T17:06:50.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:06:50 smithi149 ceph-mon[34678]: "prefix": "rbd perf image stats", 2024-03-26T17:06:50.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:06:50 smithi149 ceph-mon[34678]: "pool_spec": "mypool", 2024-03-26T17:06:50.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:06:50 smithi149 ceph-mon[34678]: "sort_by": "write_ops", 2024-03-26T17:06:50.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:06:50 smithi149 ceph-mon[34678]: "format": "json" 2024-03-26T17:06:50.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:06:50 smithi149 ceph-mon[34678]: }"]: dispatch 2024-03-26T17:06:50.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:06:50 smithi044 ceph-mon[30624]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:06:50.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:06:50 smithi044 ceph-mon[30624]: { 2024-03-26T17:06:50.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:06:50 smithi044 ceph-mon[30624]: "prefix": "rbd perf image stats", 2024-03-26T17:06:50.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:06:50 smithi044 ceph-mon[30624]: "pool_spec": "mypool", 2024-03-26T17:06:50.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:06:50 smithi044 ceph-mon[30624]: "sort_by": "write_ops", 2024-03-26T17:06:50.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:06:50 smithi044 ceph-mon[30624]: "format": "json" 2024-03-26T17:06:50.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:06:50 smithi044 ceph-mon[30624]: }"]: dispatch 2024-03-26T17:06:50.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:06:50 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:06:50] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:06:50.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:06:50 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:06:50] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:06:50.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:06:50 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:06:50.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:06:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:06:50] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:06:50.897 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:06:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:06:50] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:06:50.897 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:06:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:06:51.230 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:06:51 smithi149 ceph-mon[34678]: pgmap v628: 33 pgs: 33 active+clean; 1.0 GiB data, 3.7 GiB used, 711 GiB / 715 GiB avail; 6.6 MiB/s rd, 6.5 MiB/s wr, 494 op/s 2024-03-26T17:06:51.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:06:51 smithi064 ceph-mon[34420]: pgmap v628: 33 pgs: 33 active+clean; 1.0 GiB data, 3.7 GiB used, 711 GiB / 715 GiB avail; 6.6 MiB/s rd, 6.5 MiB/s wr, 494 op/s 2024-03-26T17:06:51.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:06:51 smithi044 ceph-mon[30624]: pgmap v628: 33 pgs: 33 active+clean; 1.0 GiB data, 3.7 GiB used, 711 GiB / 715 GiB avail; 6.6 MiB/s rd, 6.5 MiB/s wr, 494 op/s 2024-03-26T17:06:51.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:06:51 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 2024-03-26T17:06:51.229+0000 7fa707a55700 -1 mon.c@1(peon) e3 get_health_metrics reporting 3 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T17:06:52.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:06:52 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:06:52] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:06:52.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:06:52 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:06:52] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:06:52.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:06:52 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:06:52.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:06:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:06:52] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:06:52.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:06:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:06:52] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:06:52.897 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:06:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:06:53.062 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:06:53.073 INFO:tasks.workunit.client.3.smithi157.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2024-03-26T17:06:53.073 INFO:tasks.workunit.client.3.smithi157.stdout: 9.00 112.0k 125.6k 0.0k 1.1M 1.2M 0.0k nvme2n1 2024-03-26T17:06:53.073 INFO:tasks.workunit.client.3.smithi157.stdout: 9.10 94.4k 110.0k 0.0k 944.0k 1.1M 0.0k nvme2n10 2024-03-26T17:06:53.073 INFO:tasks.workunit.client.3.smithi157.stdout: 9.10 122.4k 144.4k 0.0k 1.2M 1.4M 0.0k nvme2n11 2024-03-26T17:06:53.074 INFO:tasks.workunit.client.3.smithi157.stdout: 9.10 121.2k 145.6k 0.0k 1.2M 1.4M 0.0k nvme2n12 2024-03-26T17:06:53.074 INFO:tasks.workunit.client.3.smithi157.stdout: 9.10 98.8k 135.2k 0.0k 988.0k 1.3M 0.0k nvme2n13 2024-03-26T17:06:53.074 INFO:tasks.workunit.client.3.smithi157.stdout: 9.10 114.4k 165.2k 0.0k 1.1M 1.6M 0.0k nvme2n14 2024-03-26T17:06:53.074 INFO:tasks.workunit.client.3.smithi157.stdout: 9.10 111.6k 126.0k 0.0k 1.1M 1.2M 0.0k nvme2n15 2024-03-26T17:06:53.074 INFO:tasks.workunit.client.3.smithi157.stdout: 9.10 115.2k 116.8k 0.0k 1.1M 1.1M 0.0k nvme2n16 2024-03-26T17:06:53.075 INFO:tasks.workunit.client.3.smithi157.stdout: 9.10 126.0k 122.8k 0.0k 1.2M 1.2M 0.0k nvme2n17 2024-03-26T17:06:53.075 INFO:tasks.workunit.client.3.smithi157.stdout: 9.10 115.2k 102.4k 0.0k 1.1M 1.0M 0.0k nvme2n18 2024-03-26T17:06:53.075 INFO:tasks.workunit.client.3.smithi157.stdout: 9.10 144.4k 96.4k 0.0k 1.4M 964.0k 0.0k nvme2n19 2024-03-26T17:06:53.075 INFO:tasks.workunit.client.3.smithi157.stdout: 9.00 111.6k 130.0k 0.0k 1.1M 1.3M 0.0k nvme2n2 2024-03-26T17:06:53.075 INFO:tasks.workunit.client.3.smithi157.stdout: 9.10 140.8k 101.2k 0.0k 1.4M 1012.0k 0.0k nvme2n20 2024-03-26T17:06:53.075 INFO:tasks.workunit.client.3.smithi157.stdout: 9.00 122.8k 104.8k 0.0k 1.2M 1.0M 0.0k nvme2n3 2024-03-26T17:06:53.075 INFO:tasks.workunit.client.3.smithi157.stdout: 9.00 118.0k 110.8k 0.0k 1.2M 1.1M 0.0k nvme2n4 2024-03-26T17:06:53.076 INFO:tasks.workunit.client.3.smithi157.stdout: 9.00 141.2k 93.6k 0.0k 1.4M 936.0k 0.0k nvme2n5 2024-03-26T17:06:53.076 INFO:tasks.workunit.client.3.smithi157.stdout: 9.00 118.0k 84.0k 0.0k 1.2M 840.0k 0.0k nvme2n6 2024-03-26T17:06:53.076 INFO:tasks.workunit.client.3.smithi157.stdout: 9.00 93.2k 137.2k 0.0k 932.0k 1.3M 0.0k nvme2n7 2024-03-26T17:06:53.076 INFO:tasks.workunit.client.3.smithi157.stdout: 9.00 109.2k 112.8k 0.0k 1.1M 1.1M 0.0k nvme2n8 2024-03-26T17:06:53.076 INFO:tasks.workunit.client.3.smithi157.stdout: 9.10 92.4k 131.2k 0.0k 924.0k 1.3M 0.0k nvme2n9 2024-03-26T17:06:53.076 INFO:tasks.workunit.client.3.smithi157.stdout: 9.10 102.4k 120.8k 0.0k 1.0M 1.2M 0.0k nvme5n1 2024-03-26T17:06:53.077 INFO:tasks.workunit.client.3.smithi157.stdout: 9.10 127.6k 132.4k 0.0k 1.2M 1.3M 0.0k nvme5n10 2024-03-26T17:06:53.077 INFO:tasks.workunit.client.3.smithi157.stdout: 9.10 110.0k 123.2k 0.0k 1.1M 1.2M 0.0k nvme5n11 2024-03-26T17:06:53.077 INFO:tasks.workunit.client.3.smithi157.stdout: 9.10 146.8k 114.0k 0.0k 1.4M 1.1M 0.0k nvme5n12 2024-03-26T17:06:53.077 INFO:tasks.workunit.client.3.smithi157.stdout: 9.10 130.8k 120.8k 0.0k 1.3M 1.2M 0.0k nvme5n13 2024-03-26T17:06:53.077 INFO:tasks.workunit.client.3.smithi157.stdout: 9.10 109.2k 143.2k 0.0k 1.1M 1.4M 0.0k nvme5n14 2024-03-26T17:06:53.077 INFO:tasks.workunit.client.3.smithi157.stdout: 9.10 117.2k 117.2k 0.0k 1.1M 1.1M 0.0k nvme5n15 2024-03-26T17:06:53.078 INFO:tasks.workunit.client.3.smithi157.stdout: 9.10 123.2k 110.4k 0.0k 1.2M 1.1M 0.0k nvme5n16 2024-03-26T17:06:53.078 INFO:tasks.workunit.client.3.smithi157.stdout: 9.10 95.2k 104.4k 0.0k 952.0k 1.0M 0.0k nvme5n17 2024-03-26T17:06:53.078 INFO:tasks.workunit.client.3.smithi157.stdout: 9.10 122.0k 110.0k 0.0k 1.2M 1.1M 0.0k nvme5n18 2024-03-26T17:06:53.078 INFO:tasks.workunit.client.3.smithi157.stdout: 9.10 135.6k 101.2k 0.0k 1.3M 1012.0k 0.0k nvme5n19 2024-03-26T17:06:53.078 INFO:tasks.workunit.client.3.smithi157.stdout: 9.00 137.6k 84.8k 0.0k 1.3M 848.0k 0.0k nvme5n2 2024-03-26T17:06:53.078 INFO:tasks.workunit.client.3.smithi157.stdout: 9.10 125.2k 107.6k 0.0k 1.2M 1.1M 0.0k nvme5n20 2024-03-26T17:06:53.078 INFO:tasks.workunit.client.3.smithi157.stdout: 9.00 99.2k 163.2k 0.0k 992.0k 1.6M 0.0k nvme5n3 2024-03-26T17:06:53.079 INFO:tasks.workunit.client.3.smithi157.stdout: 9.00 111.6k 122.4k 0.0k 1.1M 1.2M 0.0k nvme5n4 2024-03-26T17:06:53.079 INFO:tasks.workunit.client.3.smithi157.stdout: 9.00 126.8k 110.4k 0.0k 1.2M 1.1M 0.0k nvme5n5 2024-03-26T17:06:53.079 INFO:tasks.workunit.client.3.smithi157.stdout: 9.00 136.4k 101.2k 0.0k 1.3M 1012.0k 0.0k nvme5n6 2024-03-26T17:06:53.079 INFO:tasks.workunit.client.3.smithi157.stdout: 9.00 124.0k 96.8k 0.0k 1.2M 968.0k 0.0k nvme5n7 2024-03-26T17:06:53.079 INFO:tasks.workunit.client.3.smithi157.stdout: 9.00 111.6k 138.4k 0.0k 1.1M 1.4M 0.0k nvme5n8 2024-03-26T17:06:53.079 INFO:tasks.workunit.client.3.smithi157.stdout: 9.00 103.2k 100.4k 0.0k 1.0M 1004.0k 0.0k nvme5n9 2024-03-26T17:06:53.080 INFO:tasks.workunit.client.3.smithi157.stdout: 9.00 113.2k 134.0k 0.0k 1.1M 1.3M 0.0k nvme8n1 2024-03-26T17:06:53.080 INFO:tasks.workunit.client.3.smithi157.stdout: 9.10 137.2k 108.4k 0.0k 1.3M 1.1M 0.0k nvme8n10 2024-03-26T17:06:53.081 INFO:tasks.workunit.client.3.smithi157.stdout: 9.10 124.4k 125.6k 0.0k 1.2M 1.2M 0.0k nvme8n11 2024-03-26T17:06:53.081 INFO:tasks.workunit.client.3.smithi157.stdout: 9.10 101.2k 144.8k 0.0k 1012.0k 1.4M 0.0k nvme8n12 2024-03-26T17:06:53.081 INFO:tasks.workunit.client.3.smithi157.stdout: 9.10 131.2k 126.8k 0.0k 1.3M 1.2M 0.0k nvme8n13 2024-03-26T17:06:53.081 INFO:tasks.workunit.client.3.smithi157.stdout: 9.10 124.8k 107.6k 0.0k 1.2M 1.1M 0.0k nvme8n14 2024-03-26T17:06:53.081 INFO:tasks.workunit.client.3.smithi157.stdout: 9.10 158.0k 128.4k 0.0k 1.5M 1.3M 0.0k nvme8n15 2024-03-26T17:06:53.081 INFO:tasks.workunit.client.3.smithi157.stdout: 9.10 99.6k 127.2k 0.0k 996.0k 1.2M 0.0k nvme8n16 2024-03-26T17:06:53.081 INFO:tasks.workunit.client.3.smithi157.stdout: 9.10 98.0k 150.8k 0.0k 980.0k 1.5M 0.0k nvme8n17 2024-03-26T17:06:53.081 INFO:tasks.workunit.client.3.smithi157.stdout: 9.10 144.4k 83.2k 0.0k 1.4M 832.0k 0.0k nvme8n18 2024-03-26T17:06:53.081 INFO:tasks.workunit.client.3.smithi157.stdout: 9.10 136.0k 116.4k 0.0k 1.3M 1.1M 0.0k nvme8n19 2024-03-26T17:06:53.082 INFO:tasks.workunit.client.3.smithi157.stdout: 9.00 123.2k 112.0k 0.0k 1.2M 1.1M 0.0k nvme8n2 2024-03-26T17:06:53.082 INFO:tasks.workunit.client.3.smithi157.stdout: 9.10 106.0k 133.2k 0.0k 1.0M 1.3M 0.0k nvme8n20 2024-03-26T17:06:53.082 INFO:tasks.workunit.client.3.smithi157.stdout: 9.00 134.4k 102.0k 0.0k 1.3M 1020.0k 0.0k nvme8n3 2024-03-26T17:06:53.082 INFO:tasks.workunit.client.3.smithi157.stdout: 9.00 129.6k 138.0k 0.0k 1.3M 1.3M 0.0k nvme8n4 2024-03-26T17:06:53.082 INFO:tasks.workunit.client.3.smithi157.stdout: 9.00 131.6k 112.4k 0.0k 1.3M 1.1M 0.0k nvme8n5 2024-03-26T17:06:53.082 INFO:tasks.workunit.client.3.smithi157.stdout: 9.00 127.2k 115.6k 0.0k 1.2M 1.1M 0.0k nvme8n6 2024-03-26T17:06:53.082 INFO:tasks.workunit.client.3.smithi157.stdout: 9.00 172.8k 87.6k 0.0k 1.7M 876.0k 0.0k nvme8n7 2024-03-26T17:06:53.082 INFO:tasks.workunit.client.3.smithi157.stdout: 9.00 103.2k 122.8k 0.0k 1.0M 1.2M 0.0k nvme8n8 2024-03-26T17:06:53.082 INFO:tasks.workunit.client.3.smithi157.stdout: 9.10 103.2k 132.4k 0.0k 1.0M 1.3M 0.0k nvme8n9 2024-03-26T17:06:53.082 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:06:53.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:06:53 smithi064 ceph-mon[34420]: pgmap v629: 33 pgs: 33 active+clean; 1.0 GiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 7.3 MiB/s rd, 7.3 MiB/s wr, 551 op/s 2024-03-26T17:06:53.355 INFO:tasks.workunit.client.3.smithi157.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-26T17:06:53.355 INFO:tasks.workunit.client.3.smithi157.stdout:myimage38 6/s 4/s 123 KiB/s 116 KiB/s 1.90 ms 355.42 us 2024-03-26T17:06:53.355 INFO:tasks.workunit.client.3.smithi157.stdout:myimage14 5/s 3/s 209 KiB/s 114 KiB/s 2.21 ms 363.03 us 2024-03-26T17:06:53.355 INFO:tasks.workunit.client.3.smithi157.stdout:myimage52 5/s 3/s 162 KiB/s 100 KiB/s 2.47 ms 333.35 us 2024-03-26T17:06:53.355 INFO:tasks.workunit.client.3.smithi157.stdout:myimage57 5/s 3/s 142 KiB/s 91 KiB/s 2.23 ms 382.01 us 2024-03-26T17:06:53.355 INFO:tasks.workunit.client.3.smithi157.stdout:myimage12 5/s 3/s 159 KiB/s 110 KiB/s 2.22 ms 323.87 us 2024-03-26T17:06:53.355 INFO:tasks.workunit.client.3.smithi157.stdout:myimage15 5/s 3/s 139 KiB/s 84 KiB/s 1.94 ms 334.01 us 2024-03-26T17:06:53.356 INFO:tasks.workunit.client.3.smithi157.stdout:myimage29 5/s 3/s 128 KiB/s 84 KiB/s 1.97 ms 340.97 us 2024-03-26T17:06:53.356 INFO:tasks.workunit.client.3.smithi157.stdout:myimage13 5/s 3/s 128 KiB/s 102 KiB/s 1.93 ms 320.96 us 2024-03-26T17:06:53.356 INFO:tasks.workunit.client.3.smithi157.stdout:myimage34 5/s 4/s 122 KiB/s 115 KiB/s 2.04 ms 355.05 us 2024-03-26T17:06:53.356 INFO:tasks.workunit.client.3.smithi157.stdout:myimage49 5/s 3/s 127 KiB/s 93 KiB/s 2.20 ms 345.17 us 2024-03-26T17:06:53.356 INFO:tasks.workunit.client.3.smithi157.stdout:myimage60 5/s 4/s 176 KiB/s 83 KiB/s 2.30 ms 388.28 us 2024-03-26T17:06:53.356 INFO:tasks.workunit.client.3.smithi157.stdout:myimage30 5/s 3/s 146 KiB/s 96 KiB/s 2.65 ms 364.15 us 2024-03-26T17:06:53.356 INFO:tasks.workunit.client.3.smithi157.stdout:myimage24 5/s 3/s 150 KiB/s 113 KiB/s 2.19 ms 509.74 us 2024-03-26T17:06:53.356 INFO:tasks.workunit.client.3.smithi157.stdout:myimage41 5/s 5/s 152 KiB/s 114 KiB/s 2.17 ms 307.98 us 2024-03-26T17:06:53.356 INFO:tasks.workunit.client.3.smithi157.stdout:myimage35 5/s 3/s 137 KiB/s 92 KiB/s 1.97 ms 318.00 us 2024-03-26T17:06:53.356 INFO:tasks.workunit.client.3.smithi157.stdout:myimage6 5/s 3/s 113 KiB/s 90 KiB/s 2.49 ms 452.57 us 2024-03-26T17:06:53.356 INFO:tasks.workunit.client.3.smithi157.stdout:myimage9 5/s 3/s 131 KiB/s 89 KiB/s 2.37 ms 327.48 us 2024-03-26T17:06:53.356 INFO:tasks.workunit.client.3.smithi157.stdout:myimage11 5/s 5/s 123 KiB/s 120 KiB/s 2.42 ms 325.35 us 2024-03-26T17:06:53.356 INFO:tasks.workunit.client.3.smithi157.stdout:myimage36 5/s 4/s 134 KiB/s 98 KiB/s 2.09 ms 358.03 us 2024-03-26T17:06:53.356 INFO:tasks.workunit.client.3.smithi157.stdout:myimage39 5/s 4/s 135 KiB/s 130 KiB/s 2.00 ms 383.01 us 2024-03-26T17:06:53.356 INFO:tasks.workunit.client.3.smithi157.stdout:myimage42 5/s 4/s 140 KiB/s 99 KiB/s 2.15 ms 346.99 us 2024-03-26T17:06:53.357 INFO:tasks.workunit.client.3.smithi157.stdout:myimage21 4/s 4/s 111 KiB/s 80 KiB/s 2.56 ms 430.65 us 2024-03-26T17:06:53.357 INFO:tasks.workunit.client.3.smithi157.stdout:myimage27 4/s 4/s 111 KiB/s 120 KiB/s 1.93 ms 362.55 us 2024-03-26T17:06:53.357 INFO:tasks.workunit.client.3.smithi157.stdout:myimage28 4/s 4/s 122 KiB/s 102 KiB/s 2.63 ms 404.11 us 2024-03-26T17:06:53.357 INFO:tasks.workunit.client.3.smithi157.stdout:myimage33 4/s 4/s 123 KiB/s 141 KiB/s 2.10 ms 350.32 us 2024-03-26T17:06:53.357 INFO:tasks.workunit.client.3.smithi157.stdout:myimage53 4/s 5/s 132 KiB/s 124 KiB/s 2.08 ms 321.77 us 2024-03-26T17:06:53.357 INFO:tasks.workunit.client.3.smithi157.stdout:myimage10 4/s 4/s 110 KiB/s 94 KiB/s 1.98 ms 458.72 us 2024-03-26T17:06:53.357 INFO:tasks.workunit.client.3.smithi157.stdout:myimage48 4/s 3/s 126 KiB/s 79 KiB/s 2.34 ms 340.35 us 2024-03-26T17:06:53.357 INFO:tasks.workunit.client.3.smithi157.stdout:myimage4 4/s 4/s 88 KiB/s 142 KiB/s 2.08 ms 342.86 us 2024-03-26T17:06:53.357 INFO:tasks.workunit.client.3.smithi157.stdout:myimage20 4/s 3/s 111 KiB/s 109 KiB/s 2.00 ms 432.69 us 2024-03-26T17:06:53.357 INFO:tasks.workunit.client.3.smithi157.stdout:myimage51 4/s 4/s 114 KiB/s 117 KiB/s 2.25 ms 390.15 us 2024-03-26T17:06:53.357 INFO:tasks.workunit.client.3.smithi157.stdout:myimage32 4/s 4/s 102 KiB/s 130 KiB/s 2.28 ms 339.88 us 2024-03-26T17:06:53.357 INFO:tasks.workunit.client.3.smithi157.stdout:myimage37 4/s 4/s 90 KiB/s 97 KiB/s 2.14 ms 347.33 us 2024-03-26T17:06:53.357 INFO:tasks.workunit.client.3.smithi157.stdout:myimage40 4/s 4/s 103 KiB/s 114 KiB/s 2.10 ms 356.39 us 2024-03-26T17:06:53.357 INFO:tasks.workunit.client.3.smithi157.stdout:myimage1 4/s 4/s 126 KiB/s 107 KiB/s 1.90 ms 357.63 us 2024-03-26T17:06:53.357 INFO:tasks.workunit.client.3.smithi157.stdout:myimage8 4/s 5/s 123 KiB/s 125 KiB/s 2.14 ms 340.63 us 2024-03-26T17:06:53.358 INFO:tasks.workunit.client.3.smithi157.stdout:myimage43 4/s 4/s 113 KiB/s 120 KiB/s 2.35 ms 341.90 us 2024-03-26T17:06:53.358 INFO:tasks.workunit.client.3.smithi157.stdout:myimage46 4/s 4/s 101 KiB/s 124 KiB/s 2.08 ms 429.98 us 2024-03-26T17:06:53.358 INFO:tasks.workunit.client.3.smithi157.stdout:myimage54 4/s 4/s 104 KiB/s 109 KiB/s 2.02 ms 380.73 us 2024-03-26T17:06:53.358 INFO:tasks.workunit.client.3.smithi157.stdout:myimage2 4/s 5/s 112 KiB/s 119 KiB/s 2.28 ms 328.48 us 2024-03-26T17:06:53.358 INFO:tasks.workunit.client.3.smithi157.stdout:myimage22 4/s 6/s 110 KiB/s 146 KiB/s 2.34 ms 370.08 us 2024-03-26T17:06:53.358 INFO:tasks.workunit.client.3.smithi157.stdout:myimage23 4/s 3/s 138 KiB/s 87 KiB/s 2.15 ms 314.85 us 2024-03-26T17:06:53.358 INFO:tasks.workunit.client.3.smithi157.stdout:myimage44 4/s 4/s 103 KiB/s 91 KiB/s 2.07 ms 357.09 us 2024-03-26T17:06:53.358 INFO:tasks.workunit.client.3.smithi157.stdout:myimage17 4/s 5/s 106 KiB/s 126 KiB/s 2.10 ms 334.01 us 2024-03-26T17:06:53.358 INFO:tasks.workunit.client.3.smithi157.stdout:myimage26 4/s 4/s 101 KiB/s 113 KiB/s 2.20 ms 332.20 us 2024-03-26T17:06:53.358 INFO:tasks.workunit.client.3.smithi157.stdout:myimage56 4/s 4/s 97 KiB/s 99 KiB/s 2.52 ms 305.71 us 2024-03-26T17:06:53.358 INFO:tasks.workunit.client.3.smithi157.stdout:myimage7 4/s 4/s 113 KiB/s 117 KiB/s 2.00 ms 333.36 us 2024-03-26T17:06:53.358 INFO:tasks.workunit.client.3.smithi157.stdout:myimage59 4/s 5/s 94 KiB/s 146 KiB/s 2.34 ms 367.34 us 2024-03-26T17:06:53.358 INFO:tasks.workunit.client.3.smithi157.stdout:myimage3 3/s 5/s 80 KiB/s 130 KiB/s 1.85 ms 331.72 us 2024-03-26T17:06:53.358 INFO:tasks.workunit.client.3.smithi157.stdout:myimage31 3/s 5/s 98 KiB/s 144 KiB/s 2.29 ms 352.40 us 2024-03-26T17:06:53.359 INFO:tasks.workunit.client.3.smithi157.stdout:myimage19 3/s 4/s 94 KiB/s 132 KiB/s 2.13 ms 417.21 us 2024-03-26T17:06:53.359 INFO:tasks.workunit.client.3.smithi157.stdout:myimage25 3/s 6/s 110 KiB/s 122 KiB/s 2.61 ms 388.14 us 2024-03-26T17:06:53.359 INFO:tasks.workunit.client.3.smithi157.stdout:myimage45 3/s 5/s 107 KiB/s 150 KiB/s 2.29 ms 353.40 us 2024-03-26T17:06:53.359 INFO:tasks.workunit.client.3.smithi157.stdout:myimage55 3/s 5/s 122 KiB/s 182 KiB/s 2.42 ms 355.49 us 2024-03-26T17:06:53.359 INFO:tasks.workunit.client.3.smithi157.stdout:myimage5 3/s 6/s 84 KiB/s 172 KiB/s 1.96 ms 390.56 us 2024-03-26T17:06:53.359 INFO:tasks.workunit.client.3.smithi157.stdout:myimage58 3/s 6/s 75 KiB/s 174 KiB/s 2.04 ms 333.57 us 2024-03-26T17:06:53.359 INFO:tasks.workunit.client.3.smithi157.stdout:myimage50 3/s 4/s 72 KiB/s 142 KiB/s 2.37 ms 350.09 us 2024-03-26T17:06:53.359 INFO:tasks.workunit.client.3.smithi157.stdout:myimage18 3/s 5/s 86 KiB/s 137 KiB/s 2.04 ms 389.67 us 2024-03-26T17:06:53.359 INFO:tasks.workunit.client.3.smithi157.stdout:myimage16 3/s 5/s 74 KiB/s 131 KiB/s 2.20 ms 358.32 us 2024-03-26T17:06:53.359 INFO:tasks.workunit.client.3.smithi157.stdout:myimage47 3/s 4/s 78 KiB/s 150 KiB/s 2.37 ms 357.59 us 2024-03-26T17:06:53.359 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:06:53.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:06:53 smithi149 ceph-mon[34678]: pgmap v629: 33 pgs: 33 active+clean; 1.0 GiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 7.3 MiB/s rd, 7.3 MiB/s wr, 551 op/s 2024-03-26T17:06:53.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:06:53 smithi044 ceph-mon[30624]: pgmap v629: 33 pgs: 33 active+clean; 1.0 GiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 7.3 MiB/s rd, 7.3 MiB/s wr, 551 op/s 2024-03-26T17:06:54.274 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:06:54 smithi044 ceph-mon[30624]: Health check update: 3 slow ops, oldest one blocked for 508 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:06:54.274 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:06:54 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:06:54] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:06:54.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:06:54 smithi064 ceph-mon[34420]: Health check update: 3 slow ops, oldest one blocked for 508 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:06:54.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:06:54 smithi149 ceph-mon[34678]: Health check update: 3 slow ops, oldest one blocked for 508 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:06:54.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:06:54 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:06:54] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:06:54.766 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:06:54 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:06:54.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:06:54 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:06:54] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:06:54.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:06:54 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:06:54] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:06:54.897 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:06:54 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:06:55.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:06:55 smithi064 ceph-mon[34420]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:06:55.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:06:55 smithi064 ceph-mon[34420]: { 2024-03-26T17:06:55.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:06:55 smithi064 ceph-mon[34420]: "prefix": "rbd perf image stats", 2024-03-26T17:06:55.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:06:55 smithi064 ceph-mon[34420]: "pool_spec": "mypool", 2024-03-26T17:06:55.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:06:55 smithi064 ceph-mon[34420]: "sort_by": "write_ops", 2024-03-26T17:06:55.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:06:55 smithi064 ceph-mon[34420]: "format": "json" 2024-03-26T17:06:55.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:06:55 smithi064 ceph-mon[34420]: }"]: dispatch 2024-03-26T17:06:55.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:06:55 smithi064 ceph-mon[34420]: pgmap v630: 33 pgs: 33 active+clean; 1.0 GiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 7.5 MiB/s rd, 7.4 MiB/s wr, 571 op/s 2024-03-26T17:06:55.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:06:55 smithi149 ceph-mon[34678]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:06:55.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:06:55 smithi149 ceph-mon[34678]: { 2024-03-26T17:06:55.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:06:55 smithi149 ceph-mon[34678]: "prefix": "rbd perf image stats", 2024-03-26T17:06:55.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:06:55 smithi149 ceph-mon[34678]: "pool_spec": "mypool", 2024-03-26T17:06:55.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:06:55 smithi149 ceph-mon[34678]: "sort_by": "write_ops", 2024-03-26T17:06:55.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:06:55 smithi149 ceph-mon[34678]: "format": "json" 2024-03-26T17:06:55.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:06:55 smithi149 ceph-mon[34678]: }"]: dispatch 2024-03-26T17:06:55.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:06:55 smithi149 ceph-mon[34678]: pgmap v630: 33 pgs: 33 active+clean; 1.0 GiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 7.5 MiB/s rd, 7.4 MiB/s wr, 571 op/s 2024-03-26T17:06:55.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:06:55 smithi044 ceph-mon[30624]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:06:55.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:06:55 smithi044 ceph-mon[30624]: { 2024-03-26T17:06:55.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:06:55 smithi044 ceph-mon[30624]: "prefix": "rbd perf image stats", 2024-03-26T17:06:55.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:06:55 smithi044 ceph-mon[30624]: "pool_spec": "mypool", 2024-03-26T17:06:55.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:06:55 smithi044 ceph-mon[30624]: "sort_by": "write_ops", 2024-03-26T17:06:55.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:06:55 smithi044 ceph-mon[30624]: "format": "json" 2024-03-26T17:06:55.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:06:55 smithi044 ceph-mon[30624]: }"]: dispatch 2024-03-26T17:06:55.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:06:55 smithi044 ceph-mon[30624]: pgmap v630: 33 pgs: 33 active+clean; 1.0 GiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 7.5 MiB/s rd, 7.4 MiB/s wr, 571 op/s 2024-03-26T17:06:56.537 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:06:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 2024-03-26T17:06:56.229+0000 7fa707a55700 -1 mon.c@1(peon) e3 get_health_metrics reporting 3 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T17:06:56.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:06:56 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:06:56] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:06:56.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:06:56 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:06:56] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:06:56.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:06:56 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:06:56.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:06:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:06:56] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:06:56.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:06:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:06:56] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:06:56.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:06:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:06:57.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:06:57 smithi064 ceph-mon[34420]: pgmap v631: 33 pgs: 33 active+clean; 1.0 GiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 7.3 MiB/s rd, 7.3 MiB/s wr, 579 op/s 2024-03-26T17:06:57.395 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:06:57 smithi149 ceph-mon[34678]: pgmap v631: 33 pgs: 33 active+clean; 1.0 GiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 7.3 MiB/s rd, 7.3 MiB/s wr, 579 op/s 2024-03-26T17:06:57.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:06:57 smithi044 ceph-mon[30624]: pgmap v631: 33 pgs: 33 active+clean; 1.0 GiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 7.3 MiB/s rd, 7.3 MiB/s wr, 579 op/s 2024-03-26T17:06:58.360 INFO:tasks.workunit.client.3.smithi157.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-26T17:06:58.360 INFO:tasks.workunit.client.3.smithi157.stdout:myimage35 6/s 3/s 138 KiB/s 97 KiB/s 2.02 ms 322.24 us 2024-03-26T17:06:58.360 INFO:tasks.workunit.client.3.smithi157.stdout:myimage8 6/s 2/s 163 KiB/s 56 KiB/s 2.15 ms 316.66 us 2024-03-26T17:06:58.360 INFO:tasks.workunit.client.3.smithi157.stdout:myimage54 6/s 4/s 132 KiB/s 108 KiB/s 2.06 ms 364.43 us 2024-03-26T17:06:58.360 INFO:tasks.workunit.client.3.smithi157.stdout:myimage52 6/s 4/s 158 KiB/s 100 KiB/s 2.39 ms 424.86 us 2024-03-26T17:06:58.360 INFO:tasks.workunit.client.3.smithi157.stdout:myimage7 6/s 3/s 134 KiB/s 61 KiB/s 2.26 ms 319.78 us 2024-03-26T17:06:58.360 INFO:tasks.workunit.client.3.smithi157.stdout:myimage9 6/s 4/s 147 KiB/s 111 KiB/s 2.42 ms 338.55 us 2024-03-26T17:06:58.360 INFO:tasks.workunit.client.3.smithi157.stdout:myimage25 5/s 3/s 123 KiB/s 98 KiB/s 2.57 ms 370.33 us 2024-03-26T17:06:58.360 INFO:tasks.workunit.client.3.smithi157.stdout:myimage13 5/s 3/s 177 KiB/s 83 KiB/s 1.98 ms 414.74 us 2024-03-26T17:06:58.360 INFO:tasks.workunit.client.3.smithi157.stdout:myimage18 5/s 3/s 117 KiB/s 92 KiB/s 2.00 ms 309.29 us 2024-03-26T17:06:58.361 INFO:tasks.workunit.client.3.smithi157.stdout:myimage16 5/s 3/s 130 KiB/s 66 KiB/s 2.09 ms 294.27 us 2024-03-26T17:06:58.361 INFO:tasks.workunit.client.3.smithi157.stdout:myimage30 5/s 5/s 108 KiB/s 157 KiB/s 2.45 ms 416.52 us 2024-03-26T17:06:58.361 INFO:tasks.workunit.client.3.smithi157.stdout:myimage28 5/s 4/s 147 KiB/s 140 KiB/s 2.86 ms 477.97 us 2024-03-26T17:06:58.361 INFO:tasks.workunit.client.3.smithi157.stdout:myimage31 5/s 3/s 106 KiB/s 78 KiB/s 2.28 ms 379.03 us 2024-03-26T17:06:58.361 INFO:tasks.workunit.client.3.smithi157.stdout:myimage37 5/s 3/s 110 KiB/s 91 KiB/s 2.34 ms 367.34 us 2024-03-26T17:06:58.361 INFO:tasks.workunit.client.3.smithi157.stdout:myimage44 5/s 4/s 150 KiB/s 146 KiB/s 2.23 ms 431.85 us 2024-03-26T17:06:58.361 INFO:tasks.workunit.client.3.smithi157.stdout:myimage11 5/s 3/s 150 KiB/s 83 KiB/s 2.47 ms 341.04 us 2024-03-26T17:06:58.361 INFO:tasks.workunit.client.3.smithi157.stdout:myimage19 5/s 4/s 124 KiB/s 107 KiB/s 2.23 ms 437.88 us 2024-03-26T17:06:58.361 INFO:tasks.workunit.client.3.smithi157.stdout:myimage23 4/s 5/s 114 KiB/s 142 KiB/s 2.02 ms 401.75 us 2024-03-26T17:06:58.361 INFO:tasks.workunit.client.3.smithi157.stdout:myimage4 4/s 3/s 102 KiB/s 63 KiB/s 2.14 ms 427.84 us 2024-03-26T17:06:58.361 INFO:tasks.workunit.client.3.smithi157.stdout:myimage5 4/s 3/s 104 KiB/s 94 KiB/s 2.04 ms 327.19 us 2024-03-26T17:06:58.361 INFO:tasks.workunit.client.3.smithi157.stdout:myimage45 4/s 4/s 106 KiB/s 114 KiB/s 2.12 ms 309.82 us 2024-03-26T17:06:58.361 INFO:tasks.workunit.client.3.smithi157.stdout:myimage55 4/s 4/s 134 KiB/s 101 KiB/s 2.25 ms 341.35 us 2024-03-26T17:06:58.361 INFO:tasks.workunit.client.3.smithi157.stdout:myimage2 4/s 3/s 120 KiB/s 111 KiB/s 2.40 ms 307.34 us 2024-03-26T17:06:58.362 INFO:tasks.workunit.client.3.smithi157.stdout:myimage32 4/s 4/s 110 KiB/s 110 KiB/s 2.25 ms 386.04 us 2024-03-26T17:06:58.362 INFO:tasks.workunit.client.3.smithi157.stdout:myimage12 4/s 4/s 166 KiB/s 104 KiB/s 2.28 ms 427.93 us 2024-03-26T17:06:58.362 INFO:tasks.workunit.client.3.smithi157.stdout:myimage33 4/s 4/s 111 KiB/s 106 KiB/s 2.23 ms 351.67 us 2024-03-26T17:06:58.362 INFO:tasks.workunit.client.3.smithi157.stdout:myimage41 4/s 3/s 120 KiB/s 82 KiB/s 2.32 ms 451.57 us 2024-03-26T17:06:58.362 INFO:tasks.workunit.client.3.smithi157.stdout:myimage43 4/s 4/s 115 KiB/s 113 KiB/s 2.47 ms 541.33 us 2024-03-26T17:06:58.362 INFO:tasks.workunit.client.3.smithi157.stdout:myimage46 4/s 3/s 112 KiB/s 70 KiB/s 2.08 ms 355.08 us 2024-03-26T17:06:58.362 INFO:tasks.workunit.client.3.smithi157.stdout:myimage40 4/s 4/s 110 KiB/s 82 KiB/s 1.98 ms 354.10 us 2024-03-26T17:06:58.362 INFO:tasks.workunit.client.3.smithi157.stdout:myimage48 4/s 5/s 119 KiB/s 119 KiB/s 2.17 ms 353.57 us 2024-03-26T17:06:58.362 INFO:tasks.workunit.client.3.smithi157.stdout:myimage6 4/s 5/s 74 KiB/s 166 KiB/s 2.13 ms 345.75 us 2024-03-26T17:06:58.362 INFO:tasks.workunit.client.3.smithi157.stdout:myimage17 4/s 3/s 110 KiB/s 88 KiB/s 2.28 ms 524.10 us 2024-03-26T17:06:58.362 INFO:tasks.workunit.client.3.smithi157.stdout:myimage51 4/s 4/s 104 KiB/s 94 KiB/s 2.32 ms 328.36 us 2024-03-26T17:06:58.362 INFO:tasks.workunit.client.3.smithi157.stdout:myimage53 4/s 3/s 113 KiB/s 113 KiB/s 2.18 ms 328.68 us 2024-03-26T17:06:58.362 INFO:tasks.workunit.client.3.smithi157.stdout:myimage56 4/s 4/s 126 KiB/s 99 KiB/s 2.59 ms 315.26 us 2024-03-26T17:06:58.362 INFO:tasks.workunit.client.3.smithi157.stdout:myimage3 4/s 4/s 78 KiB/s 115 KiB/s 1.90 ms 323.17 us 2024-03-26T17:06:58.363 INFO:tasks.workunit.client.3.smithi157.stdout:myimage22 4/s 4/s 90 KiB/s 109 KiB/s 2.11 ms 321.21 us 2024-03-26T17:06:58.363 INFO:tasks.workunit.client.3.smithi157.stdout:myimage34 4/s 4/s 122 KiB/s 94 KiB/s 2.05 ms 333.11 us 2024-03-26T17:06:58.363 INFO:tasks.workunit.client.3.smithi157.stdout:myimage47 4/s 5/s 102 KiB/s 154 KiB/s 2.20 ms 383.85 us 2024-03-26T17:06:58.363 INFO:tasks.workunit.client.3.smithi157.stdout:myimage21 4/s 4/s 98 KiB/s 118 KiB/s 2.70 ms 445.21 us 2024-03-26T17:06:58.363 INFO:tasks.workunit.client.3.smithi157.stdout:myimage36 4/s 4/s 90 KiB/s 142 KiB/s 2.13 ms 379.64 us 2024-03-26T17:06:58.363 INFO:tasks.workunit.client.3.smithi157.stdout:myimage50 4/s 4/s 102 KiB/s 158 KiB/s 2.25 ms 477.18 us 2024-03-26T17:06:58.363 INFO:tasks.workunit.client.3.smithi157.stdout:myimage60 4/s 3/s 114 KiB/s 82 KiB/s 2.32 ms 433.92 us 2024-03-26T17:06:58.363 INFO:tasks.workunit.client.3.smithi157.stdout:myimage10 4/s 5/s 130 KiB/s 78 KiB/s 2.13 ms 290.30 us 2024-03-26T17:06:58.363 INFO:tasks.workunit.client.3.smithi157.stdout:myimage59 4/s 4/s 102 KiB/s 107 KiB/s 2.46 ms 384.77 us 2024-03-26T17:06:58.363 INFO:tasks.workunit.client.3.smithi157.stdout:myimage14 4/s 5/s 122 KiB/s 139 KiB/s 2.34 ms 382.86 us 2024-03-26T17:06:58.363 INFO:tasks.workunit.client.3.smithi157.stdout:myimage49 4/s 4/s 108 KiB/s 146 KiB/s 2.31 ms 441.46 us 2024-03-26T17:06:58.363 INFO:tasks.workunit.client.3.smithi157.stdout:myimage1 4/s 4/s 117 KiB/s 105 KiB/s 1.88 ms 300.28 us 2024-03-26T17:06:58.363 INFO:tasks.workunit.client.3.smithi157.stdout:myimage15 4/s 4/s 105 KiB/s 95 KiB/s 1.99 ms 328.18 us 2024-03-26T17:06:58.363 INFO:tasks.workunit.client.3.smithi157.stdout:myimage29 3/s 5/s 86 KiB/s 116 KiB/s 2.01 ms 398.05 us 2024-03-26T17:06:58.364 INFO:tasks.workunit.client.3.smithi157.stdout:myimage57 3/s 4/s 100 KiB/s 109 KiB/s 2.10 ms 315.34 us 2024-03-26T17:06:58.364 INFO:tasks.workunit.client.3.smithi157.stdout:myimage38 3/s 4/s 64 KiB/s 139 KiB/s 2.00 ms 400.89 us 2024-03-26T17:06:58.364 INFO:tasks.workunit.client.3.smithi157.stdout:myimage58 3/s 4/s 87 KiB/s 117 KiB/s 2.05 ms 381.04 us 2024-03-26T17:06:58.364 INFO:tasks.workunit.client.3.smithi157.stdout:myimage20 3/s 6/s 50 KiB/s 206 KiB/s 1.99 ms 446.63 us 2024-03-26T17:06:58.364 INFO:tasks.workunit.client.3.smithi157.stdout:myimage42 3/s 5/s 93 KiB/s 121 KiB/s 2.11 ms 345.57 us 2024-03-26T17:06:58.364 INFO:tasks.workunit.client.3.smithi157.stdout:myimage39 3/s 5/s 51 KiB/s 145 KiB/s 2.05 ms 380.71 us 2024-03-26T17:06:58.364 INFO:tasks.workunit.client.3.smithi157.stdout:myimage26 3/s 5/s 86 KiB/s 159 KiB/s 2.12 ms 395.98 us 2024-03-26T17:06:58.364 INFO:tasks.workunit.client.3.smithi157.stdout:myimage27 3/s 5/s 79 KiB/s 121 KiB/s 2.03 ms 323.92 us 2024-03-26T17:06:58.364 INFO:tasks.workunit.client.3.smithi157.stdout:myimage24 3/s 5/s 61 KiB/s 125 KiB/s 2.29 ms 395.59 us 2024-03-26T17:06:58.364 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:06:58.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:06:58 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:06:58] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:06:58.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:06:58 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:06:58] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:06:58.766 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:06:58 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:06:58.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:06:58 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:06:58] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:06:58.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:06:58 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:06:58] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:06:58.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:06:58 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:06:59.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:06:59 smithi064 ceph-mon[34420]: pgmap v632: 33 pgs: 33 active+clean; 1.0 GiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 6.7 MiB/s rd, 6.7 MiB/s wr, 542 op/s 2024-03-26T17:06:59.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:06:59 smithi064 ceph-mon[34420]: Health check update: 3 slow ops, oldest one blocked for 513 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:06:59.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:06:59 smithi149 ceph-mon[34678]: pgmap v632: 33 pgs: 33 active+clean; 1.0 GiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 6.7 MiB/s rd, 6.7 MiB/s wr, 542 op/s 2024-03-26T17:06:59.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:06:59 smithi149 ceph-mon[34678]: Health check update: 3 slow ops, oldest one blocked for 513 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:06:59.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:06:59 smithi044 ceph-mon[30624]: pgmap v632: 33 pgs: 33 active+clean; 1.0 GiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 6.7 MiB/s rd, 6.7 MiB/s wr, 542 op/s 2024-03-26T17:06:59.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:06:59 smithi044 ceph-mon[30624]: Health check update: 3 slow ops, oldest one blocked for 513 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:07:00.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:07:00 smithi064 ceph-mon[34420]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:07:00.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:07:00 smithi064 ceph-mon[34420]: { 2024-03-26T17:07:00.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:07:00 smithi064 ceph-mon[34420]: "prefix": "rbd perf image stats", 2024-03-26T17:07:00.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:07:00 smithi064 ceph-mon[34420]: "pool_spec": "mypool", 2024-03-26T17:07:00.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:07:00 smithi064 ceph-mon[34420]: "sort_by": "write_ops", 2024-03-26T17:07:00.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:07:00 smithi064 ceph-mon[34420]: "format": "json" 2024-03-26T17:07:00.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:07:00 smithi064 ceph-mon[34420]: }"]: dispatch 2024-03-26T17:07:00.312 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:07:00 smithi044 ceph-mon[30624]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:07:00.312 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:07:00 smithi044 ceph-mon[30624]: { 2024-03-26T17:07:00.312 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:07:00 smithi044 ceph-mon[30624]: "prefix": "rbd perf image stats", 2024-03-26T17:07:00.312 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:07:00 smithi044 ceph-mon[30624]: "pool_spec": "mypool", 2024-03-26T17:07:00.312 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:07:00 smithi044 ceph-mon[30624]: "sort_by": "write_ops", 2024-03-26T17:07:00.312 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:07:00 smithi044 ceph-mon[30624]: "format": "json" 2024-03-26T17:07:00.313 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:07:00 smithi044 ceph-mon[30624]: }"]: dispatch 2024-03-26T17:07:00.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:07:00 smithi149 ceph-mon[34678]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:07:00.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:07:00 smithi149 ceph-mon[34678]: { 2024-03-26T17:07:00.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:07:00 smithi149 ceph-mon[34678]: "prefix": "rbd perf image stats", 2024-03-26T17:07:00.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:07:00 smithi149 ceph-mon[34678]: "pool_spec": "mypool", 2024-03-26T17:07:00.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:07:00 smithi149 ceph-mon[34678]: "sort_by": "write_ops", 2024-03-26T17:07:00.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:07:00 smithi149 ceph-mon[34678]: "format": "json" 2024-03-26T17:07:00.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:07:00 smithi149 ceph-mon[34678]: }"]: dispatch 2024-03-26T17:07:00.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:07:00 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:07:00] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:07:00.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:07:00 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:07:00] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:07:00.766 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:07:00 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:07:00.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:07:00 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:07:00] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:07:00.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:07:00 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:07:00] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:07:00.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:07:00 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:07:01.230 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:07:01 smithi149 ceph-mon[34678]: pgmap v633: 33 pgs: 33 active+clean; 1.0 GiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 6.4 MiB/s rd, 6.5 MiB/s wr, 531 op/s 2024-03-26T17:07:01.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:07:01 smithi064 ceph-mon[34420]: pgmap v633: 33 pgs: 33 active+clean; 1.0 GiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 6.4 MiB/s rd, 6.5 MiB/s wr, 531 op/s 2024-03-26T17:07:01.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:07:01 smithi044 ceph-mon[30624]: pgmap v633: 33 pgs: 33 active+clean; 1.0 GiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 6.4 MiB/s rd, 6.5 MiB/s wr, 531 op/s 2024-03-26T17:07:01.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:07:01 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 2024-03-26T17:07:01.229+0000 7fa707a55700 -1 mon.c@1(peon) e3 get_health_metrics reporting 3 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T17:07:02.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:07:02 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:07:02] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:07:02.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:07:02 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:07:02] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:07:02.766 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:07:02 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:07:02.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:07:02 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:07:02] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:07:02.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:07:02 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:07:02] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:07:02.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:07:02 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:07:03.062 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:07:03.072 INFO:tasks.workunit.client.3.smithi157.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2024-03-26T17:07:03.072 INFO:tasks.workunit.client.3.smithi157.stdout: 9.00 80.0k 130.0k 0.0k 800.0k 1.3M 0.0k nvme2n1 2024-03-26T17:07:03.072 INFO:tasks.workunit.client.3.smithi157.stdout: 9.00 101.2k 113.2k 0.0k 1012.0k 1.1M 0.0k nvme2n10 2024-03-26T17:07:03.072 INFO:tasks.workunit.client.3.smithi157.stdout: 9.00 116.8k 105.6k 0.0k 1.1M 1.0M 0.0k nvme2n11 2024-03-26T17:07:03.072 INFO:tasks.workunit.client.3.smithi157.stdout: 9.00 108.0k 130.8k 0.0k 1.1M 1.3M 0.0k nvme2n12 2024-03-26T17:07:03.072 INFO:tasks.workunit.client.3.smithi157.stdout: 8.90 84.8k 133.2k 0.0k 848.0k 1.3M 0.0k nvme2n13 2024-03-26T17:07:03.072 INFO:tasks.workunit.client.3.smithi157.stdout: 8.90 125.6k 108.4k 0.0k 1.2M 1.1M 0.0k nvme2n14 2024-03-26T17:07:03.072 INFO:tasks.workunit.client.3.smithi157.stdout: 8.90 120.8k 108.0k 0.0k 1.2M 1.1M 0.0k nvme2n15 2024-03-26T17:07:03.072 INFO:tasks.workunit.client.3.smithi157.stdout: 8.90 119.2k 112.8k 0.0k 1.2M 1.1M 0.0k nvme2n16 2024-03-26T17:07:03.072 INFO:tasks.workunit.client.3.smithi157.stdout: 8.90 99.6k 123.6k 0.0k 996.0k 1.2M 0.0k nvme2n17 2024-03-26T17:07:03.073 INFO:tasks.workunit.client.3.smithi157.stdout: 8.90 103.6k 98.0k 0.0k 1.0M 980.0k 0.0k nvme2n18 2024-03-26T17:07:03.073 INFO:tasks.workunit.client.3.smithi157.stdout: 8.90 107.2k 111.6k 0.0k 1.0M 1.1M 0.0k nvme2n19 2024-03-26T17:07:03.073 INFO:tasks.workunit.client.3.smithi157.stdout: 9.00 122.0k 124.8k 0.0k 1.2M 1.2M 0.0k nvme2n2 2024-03-26T17:07:03.073 INFO:tasks.workunit.client.3.smithi157.stdout: 8.90 122.4k 93.6k 0.0k 1.2M 936.0k 0.0k nvme2n20 2024-03-26T17:07:03.073 INFO:tasks.workunit.client.3.smithi157.stdout: 9.00 108.8k 92.0k 0.0k 1.1M 920.0k 0.0k nvme2n3 2024-03-26T17:07:03.073 INFO:tasks.workunit.client.3.smithi157.stdout: 9.00 112.8k 94.8k 0.0k 1.1M 948.0k 0.0k nvme2n4 2024-03-26T17:07:03.073 INFO:tasks.workunit.client.3.smithi157.stdout: 9.00 97.6k 98.8k 0.0k 976.0k 988.0k 0.0k nvme2n5 2024-03-26T17:07:03.073 INFO:tasks.workunit.client.3.smithi157.stdout: 9.00 137.6k 105.6k 0.0k 1.3M 1.0M 0.0k nvme2n6 2024-03-26T17:07:03.073 INFO:tasks.workunit.client.3.smithi157.stdout: 9.00 97.6k 105.6k 0.0k 976.0k 1.0M 0.0k nvme2n7 2024-03-26T17:07:03.073 INFO:tasks.workunit.client.3.smithi157.stdout: 9.00 82.8k 118.8k 0.0k 828.0k 1.2M 0.0k nvme2n8 2024-03-26T17:07:03.073 INFO:tasks.workunit.client.3.smithi157.stdout: 9.00 94.0k 95.2k 0.0k 940.0k 952.0k 0.0k nvme2n9 2024-03-26T17:07:03.073 INFO:tasks.workunit.client.3.smithi157.stdout: 8.90 106.4k 124.4k 0.0k 1.0M 1.2M 0.0k nvme5n1 2024-03-26T17:07:03.073 INFO:tasks.workunit.client.3.smithi157.stdout: 9.00 106.8k 102.0k 0.0k 1.0M 1020.0k 0.0k nvme5n10 2024-03-26T17:07:03.073 INFO:tasks.workunit.client.3.smithi157.stdout: 9.00 89.2k 119.2k 0.0k 892.0k 1.2M 0.0k nvme5n11 2024-03-26T17:07:03.074 INFO:tasks.workunit.client.3.smithi157.stdout: 9.00 89.2k 132.8k 0.0k 892.0k 1.3M 0.0k nvme5n12 2024-03-26T17:07:03.074 INFO:tasks.workunit.client.3.smithi157.stdout: 8.90 114.8k 122.8k 0.0k 1.1M 1.2M 0.0k nvme5n13 2024-03-26T17:07:03.074 INFO:tasks.workunit.client.3.smithi157.stdout: 8.90 122.4k 129.6k 0.0k 1.2M 1.3M 0.0k nvme5n14 2024-03-26T17:07:03.074 INFO:tasks.workunit.client.3.smithi157.stdout: 8.90 92.4k 114.0k 0.0k 924.0k 1.1M 0.0k nvme5n15 2024-03-26T17:07:03.074 INFO:tasks.workunit.client.3.smithi157.stdout: 8.90 102.8k 99.2k 0.0k 1.0M 992.0k 0.0k nvme5n16 2024-03-26T17:07:03.074 INFO:tasks.workunit.client.3.smithi157.stdout: 8.90 102.0k 107.6k 0.0k 1020.0k 1.1M 0.0k nvme5n17 2024-03-26T17:07:03.074 INFO:tasks.workunit.client.3.smithi157.stdout: 8.90 102.0k 106.8k 0.0k 1020.0k 1.0M 0.0k nvme5n18 2024-03-26T17:07:03.074 INFO:tasks.workunit.client.3.smithi157.stdout: 8.90 104.4k 106.8k 0.0k 1.0M 1.0M 0.0k nvme5n19 2024-03-26T17:07:03.074 INFO:tasks.workunit.client.3.smithi157.stdout: 9.00 97.6k 104.4k 0.0k 976.0k 1.0M 0.0k nvme5n2 2024-03-26T17:07:03.074 INFO:tasks.workunit.client.3.smithi157.stdout: 8.90 96.0k 125.6k 0.0k 960.0k 1.2M 0.0k nvme5n20 2024-03-26T17:07:03.074 INFO:tasks.workunit.client.3.smithi157.stdout: 9.00 140.0k 76.4k 0.0k 1.4M 764.0k 0.0k nvme5n3 2024-03-26T17:07:03.074 INFO:tasks.workunit.client.3.smithi157.stdout: 9.00 135.6k 95.2k 0.0k 1.3M 952.0k 0.0k nvme5n4 2024-03-26T17:07:03.074 INFO:tasks.workunit.client.3.smithi157.stdout: 9.00 101.6k 103.6k 0.0k 1016.0k 1.0M 0.0k nvme5n5 2024-03-26T17:07:03.075 INFO:tasks.workunit.client.3.smithi157.stdout: 9.00 104.0k 118.8k 0.0k 1.0M 1.2M 0.0k nvme5n6 2024-03-26T17:07:03.075 INFO:tasks.workunit.client.3.smithi157.stdout: 9.00 106.4k 116.8k 0.0k 1.0M 1.1M 0.0k nvme5n7 2024-03-26T17:07:03.075 INFO:tasks.workunit.client.3.smithi157.stdout: 9.00 91.6k 116.0k 0.0k 916.0k 1.1M 0.0k nvme5n8 2024-03-26T17:07:03.075 INFO:tasks.workunit.client.3.smithi157.stdout: 9.00 86.0k 94.8k 0.0k 860.0k 948.0k 0.0k nvme5n9 2024-03-26T17:07:03.075 INFO:tasks.workunit.client.3.smithi157.stdout: 9.00 93.2k 106.0k 0.0k 932.0k 1.0M 0.0k nvme8n1 2024-03-26T17:07:03.075 INFO:tasks.workunit.client.3.smithi157.stdout: 9.00 125.2k 93.2k 0.0k 1.2M 932.0k 0.0k nvme8n10 2024-03-26T17:07:03.075 INFO:tasks.workunit.client.3.smithi157.stdout: 9.00 113.6k 78.8k 0.0k 1.1M 788.0k 0.0k nvme8n11 2024-03-26T17:07:03.075 INFO:tasks.workunit.client.3.smithi157.stdout: 8.90 101.2k 109.2k 0.0k 1012.0k 1.1M 0.0k nvme8n12 2024-03-26T17:07:03.075 INFO:tasks.workunit.client.3.smithi157.stdout: 8.90 104.4k 104.4k 0.0k 1.0M 1.0M 0.0k nvme8n13 2024-03-26T17:07:03.075 INFO:tasks.workunit.client.3.smithi157.stdout: 8.90 118.0k 80.0k 0.0k 1.2M 800.0k 0.0k nvme8n14 2024-03-26T17:07:03.075 INFO:tasks.workunit.client.3.smithi157.stdout: 8.90 109.6k 123.2k 0.0k 1.1M 1.2M 0.0k nvme8n15 2024-03-26T17:07:03.075 INFO:tasks.workunit.client.3.smithi157.stdout: 8.90 125.2k 74.8k 0.0k 1.2M 748.0k 0.0k nvme8n16 2024-03-26T17:07:03.075 INFO:tasks.workunit.client.3.smithi157.stdout: 8.90 110.0k 99.6k 0.0k 1.1M 996.0k 0.0k nvme8n17 2024-03-26T17:07:03.075 INFO:tasks.workunit.client.3.smithi157.stdout: 8.90 101.2k 125.6k 0.0k 1012.0k 1.2M 0.0k nvme8n18 2024-03-26T17:07:03.076 INFO:tasks.workunit.client.3.smithi157.stdout: 8.90 132.4k 84.0k 0.0k 1.3M 840.0k 0.0k nvme8n19 2024-03-26T17:07:03.076 INFO:tasks.workunit.client.3.smithi157.stdout: 9.00 116.0k 108.0k 0.0k 1.1M 1.1M 0.0k nvme8n2 2024-03-26T17:07:03.076 INFO:tasks.workunit.client.3.smithi157.stdout: 8.90 106.4k 109.2k 0.0k 1.0M 1.1M 0.0k nvme8n20 2024-03-26T17:07:03.076 INFO:tasks.workunit.client.3.smithi157.stdout: 9.00 121.2k 121.6k 0.0k 1.2M 1.2M 0.0k nvme8n3 2024-03-26T17:07:03.076 INFO:tasks.workunit.client.3.smithi157.stdout: 9.00 125.6k 116.8k 0.0k 1.2M 1.1M 0.0k nvme8n4 2024-03-26T17:07:03.076 INFO:tasks.workunit.client.3.smithi157.stdout: 9.00 130.4k 122.8k 0.0k 1.3M 1.2M 0.0k nvme8n5 2024-03-26T17:07:03.076 INFO:tasks.workunit.client.3.smithi157.stdout: 9.00 91.2k 116.0k 0.0k 912.0k 1.1M 0.0k nvme8n6 2024-03-26T17:07:03.076 INFO:tasks.workunit.client.3.smithi157.stdout: 9.00 110.0k 107.2k 0.0k 1.1M 1.0M 0.0k nvme8n7 2024-03-26T17:07:03.076 INFO:tasks.workunit.client.3.smithi157.stdout: 9.00 98.8k 111.6k 0.0k 988.0k 1.1M 0.0k nvme8n8 2024-03-26T17:07:03.076 INFO:tasks.workunit.client.3.smithi157.stdout: 9.00 140.8k 95.2k 0.0k 1.4M 952.0k 0.0k nvme8n9 2024-03-26T17:07:03.076 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:07:03.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:07:03 smithi064 ceph-mon[34420]: pgmap v634: 33 pgs: 33 active+clean; 1.0 GiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 6.4 MiB/s rd, 6.5 MiB/s wr, 536 op/s 2024-03-26T17:07:03.365 INFO:tasks.workunit.client.3.smithi157.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-26T17:07:03.365 INFO:tasks.workunit.client.3.smithi157.stdout:myimage48 5/s 3/s 113 KiB/s 110 KiB/s 2.26 ms 349.75 us 2024-03-26T17:07:03.365 INFO:tasks.workunit.client.3.smithi157.stdout:myimage42 5/s 5/s 134 KiB/s 137 KiB/s 2.09 ms 418.65 us 2024-03-26T17:07:03.365 INFO:tasks.workunit.client.3.smithi157.stdout:myimage38 5/s 4/s 114 KiB/s 100 KiB/s 1.84 ms 313.10 us 2024-03-26T17:07:03.365 INFO:tasks.workunit.client.3.smithi157.stdout:myimage12 5/s 3/s 134 KiB/s 89 KiB/s 2.16 ms 361.09 us 2024-03-26T17:07:03.365 INFO:tasks.workunit.client.3.smithi157.stdout:myimage46 5/s 4/s 133 KiB/s 74 KiB/s 2.08 ms 344.79 us 2024-03-26T17:07:03.365 INFO:tasks.workunit.client.3.smithi157.stdout:myimage26 5/s 3/s 138 KiB/s 64 KiB/s 2.32 ms 389.36 us 2024-03-26T17:07:03.365 INFO:tasks.workunit.client.3.smithi157.stdout:myimage32 5/s 3/s 160 KiB/s 89 KiB/s 2.32 ms 351.11 us 2024-03-26T17:07:03.365 INFO:tasks.workunit.client.3.smithi157.stdout:myimage19 5/s 3/s 131 KiB/s 97 KiB/s 2.20 ms 458.83 us 2024-03-26T17:07:03.365 INFO:tasks.workunit.client.3.smithi157.stdout:myimage51 5/s 4/s 101 KiB/s 95 KiB/s 2.37 ms 342.19 us 2024-03-26T17:07:03.365 INFO:tasks.workunit.client.3.smithi157.stdout:myimage53 5/s 4/s 122 KiB/s 106 KiB/s 2.08 ms 375.01 us 2024-03-26T17:07:03.366 INFO:tasks.workunit.client.3.smithi157.stdout:myimage13 5/s 5/s 107 KiB/s 115 KiB/s 2.04 ms 417.06 us 2024-03-26T17:07:03.366 INFO:tasks.workunit.client.3.smithi157.stdout:myimage23 5/s 4/s 100 KiB/s 108 KiB/s 2.04 ms 309.40 us 2024-03-26T17:07:03.366 INFO:tasks.workunit.client.3.smithi157.stdout:myimage44 5/s 5/s 118 KiB/s 165 KiB/s 2.19 ms 465.49 us 2024-03-26T17:07:03.366 INFO:tasks.workunit.client.3.smithi157.stdout:myimage4 5/s 4/s 118 KiB/s 113 KiB/s 2.08 ms 285.98 us 2024-03-26T17:07:03.366 INFO:tasks.workunit.client.3.smithi157.stdout:myimage6 5/s 4/s 109 KiB/s 150 KiB/s 2.35 ms 326.01 us 2024-03-26T17:07:03.366 INFO:tasks.workunit.client.3.smithi157.stdout:myimage17 5/s 5/s 148 KiB/s 97 KiB/s 2.27 ms 306.65 us 2024-03-26T17:07:03.366 INFO:tasks.workunit.client.3.smithi157.stdout:myimage20 5/s 3/s 114 KiB/s 98 KiB/s 1.89 ms 361.68 us 2024-03-26T17:07:03.366 INFO:tasks.workunit.client.3.smithi157.stdout:myimage28 5/s 3/s 114 KiB/s 62 KiB/s 2.75 ms 412.34 us 2024-03-26T17:07:03.366 INFO:tasks.workunit.client.3.smithi157.stdout:myimage57 5/s 4/s 121 KiB/s 83 KiB/s 2.24 ms 331.86 us 2024-03-26T17:07:03.366 INFO:tasks.workunit.client.3.smithi157.stdout:myimage10 5/s 4/s 126 KiB/s 103 KiB/s 2.04 ms 315.53 us 2024-03-26T17:07:03.366 INFO:tasks.workunit.client.3.smithi157.stdout:myimage22 4/s 4/s 114 KiB/s 94 KiB/s 2.09 ms 321.72 us 2024-03-26T17:07:03.366 INFO:tasks.workunit.client.3.smithi157.stdout:myimage31 4/s 4/s 122 KiB/s 105 KiB/s 2.45 ms 318.67 us 2024-03-26T17:07:03.367 INFO:tasks.workunit.client.3.smithi157.stdout:myimage58 4/s 3/s 126 KiB/s 85 KiB/s 2.01 ms 392.91 us 2024-03-26T17:07:03.367 INFO:tasks.workunit.client.3.smithi157.stdout:myimage21 4/s 4/s 140 KiB/s 90 KiB/s 2.80 ms 450.75 us 2024-03-26T17:07:03.367 INFO:tasks.workunit.client.3.smithi157.stdout:myimage39 4/s 4/s 130 KiB/s 118 KiB/s 2.09 ms 333.70 us 2024-03-26T17:07:03.367 INFO:tasks.workunit.client.3.smithi157.stdout:myimage41 4/s 5/s 105 KiB/s 109 KiB/s 2.34 ms 341.30 us 2024-03-26T17:07:03.367 INFO:tasks.workunit.client.3.smithi157.stdout:myimage3 4/s 4/s 107 KiB/s 94 KiB/s 1.85 ms 327.44 us 2024-03-26T17:07:03.367 INFO:tasks.workunit.client.3.smithi157.stdout:myimage40 4/s 3/s 124 KiB/s 93 KiB/s 2.09 ms 431.50 us 2024-03-26T17:07:03.367 INFO:tasks.workunit.client.3.smithi157.stdout:myimage1 4/s 3/s 137 KiB/s 74 KiB/s 1.77 ms 346.04 us 2024-03-26T17:07:03.367 INFO:tasks.workunit.client.3.smithi157.stdout:myimage29 4/s 4/s 107 KiB/s 90 KiB/s 2.08 ms 336.30 us 2024-03-26T17:07:03.367 INFO:tasks.workunit.client.3.smithi157.stdout:myimage33 4/s 4/s 105 KiB/s 130 KiB/s 2.41 ms 365.02 us 2024-03-26T17:07:03.367 INFO:tasks.workunit.client.3.smithi157.stdout:myimage36 4/s 4/s 101 KiB/s 110 KiB/s 2.12 ms 373.48 us 2024-03-26T17:07:03.367 INFO:tasks.workunit.client.3.smithi157.stdout:myimage47 4/s 4/s 92 KiB/s 93 KiB/s 2.37 ms 432.03 us 2024-03-26T17:07:03.367 INFO:tasks.workunit.client.3.smithi157.stdout:myimage8 4/s 3/s 92 KiB/s 78 KiB/s 2.26 ms 389.24 us 2024-03-26T17:07:03.367 INFO:tasks.workunit.client.3.smithi157.stdout:myimage18 4/s 4/s 95 KiB/s 110 KiB/s 2.11 ms 463.21 us 2024-03-26T17:07:03.367 INFO:tasks.workunit.client.3.smithi157.stdout:myimage43 4/s 5/s 105 KiB/s 146 KiB/s 2.68 ms 450.91 us 2024-03-26T17:07:03.367 INFO:tasks.workunit.client.3.smithi157.stdout:myimage45 4/s 4/s 119 KiB/s 116 KiB/s 2.20 ms 359.08 us 2024-03-26T17:07:03.368 INFO:tasks.workunit.client.3.smithi157.stdout:myimage50 4/s 4/s 102 KiB/s 92 KiB/s 2.43 ms 406.07 us 2024-03-26T17:07:03.368 INFO:tasks.workunit.client.3.smithi157.stdout:myimage2 4/s 4/s 140 KiB/s 134 KiB/s 2.08 ms 433.06 us 2024-03-26T17:07:03.368 INFO:tasks.workunit.client.3.smithi157.stdout:myimage34 4/s 4/s 126 KiB/s 118 KiB/s 2.20 ms 461.61 us 2024-03-26T17:07:03.368 INFO:tasks.workunit.client.3.smithi157.stdout:myimage37 4/s 4/s 102 KiB/s 94 KiB/s 2.17 ms 341.65 us 2024-03-26T17:07:03.368 INFO:tasks.workunit.client.3.smithi157.stdout:myimage7 4/s 3/s 101 KiB/s 102 KiB/s 2.30 ms 386.04 us 2024-03-26T17:07:03.368 INFO:tasks.workunit.client.3.smithi157.stdout:myimage9 4/s 4/s 87 KiB/s 81 KiB/s 2.36 ms 333.83 us 2024-03-26T17:07:03.368 INFO:tasks.workunit.client.3.smithi157.stdout:myimage24 4/s 4/s 98 KiB/s 107 KiB/s 2.06 ms 350.72 us 2024-03-26T17:07:03.368 INFO:tasks.workunit.client.3.smithi157.stdout:myimage27 4/s 5/s 135 KiB/s 104 KiB/s 2.11 ms 456.98 us 2024-03-26T17:07:03.368 INFO:tasks.workunit.client.3.smithi157.stdout:myimage55 4/s 4/s 102 KiB/s 116 KiB/s 2.41 ms 340.59 us 2024-03-26T17:07:03.368 INFO:tasks.workunit.client.3.smithi157.stdout:myimage14 4/s 4/s 107 KiB/s 108 KiB/s 2.54 ms 355.82 us 2024-03-26T17:07:03.368 INFO:tasks.workunit.client.3.smithi157.stdout:myimage11 4/s 5/s 103 KiB/s 126 KiB/s 2.39 ms 333.42 us 2024-03-26T17:07:03.368 INFO:tasks.workunit.client.3.smithi157.stdout:myimage15 4/s 6/s 105 KiB/s 166 KiB/s 1.95 ms 337.80 us 2024-03-26T17:07:03.368 INFO:tasks.workunit.client.3.smithi157.stdout:myimage60 4/s 5/s 86 KiB/s 116 KiB/s 2.38 ms 422.62 us 2024-03-26T17:07:03.368 INFO:tasks.workunit.client.3.smithi157.stdout:myimage16 3/s 4/s 103 KiB/s 119 KiB/s 2.07 ms 330.31 us 2024-03-26T17:07:03.368 INFO:tasks.workunit.client.3.smithi157.stdout:myimage30 3/s 3/s 89 KiB/s 85 KiB/s 2.46 ms 340.00 us 2024-03-26T17:07:03.369 INFO:tasks.workunit.client.3.smithi157.stdout:myimage35 3/s 4/s 94 KiB/s 110 KiB/s 2.20 ms 416.57 us 2024-03-26T17:07:03.369 INFO:tasks.workunit.client.3.smithi157.stdout:myimage5 3/s 4/s 90 KiB/s 111 KiB/s 2.08 ms 338.96 us 2024-03-26T17:07:03.369 INFO:tasks.workunit.client.3.smithi157.stdout:myimage25 3/s 4/s 80 KiB/s 104 KiB/s 2.97 ms 303.63 us 2024-03-26T17:07:03.369 INFO:tasks.workunit.client.3.smithi157.stdout:myimage56 3/s 5/s 72 KiB/s 122 KiB/s 2.69 ms 323.21 us 2024-03-26T17:07:03.369 INFO:tasks.workunit.client.3.smithi157.stdout:myimage59 3/s 6/s 77 KiB/s 142 KiB/s 2.30 ms 332.53 us 2024-03-26T17:07:03.369 INFO:tasks.workunit.client.3.smithi157.stdout:myimage49 3/s 5/s 95 KiB/s 120 KiB/s 2.31 ms 398.27 us 2024-03-26T17:07:03.369 INFO:tasks.workunit.client.3.smithi157.stdout:myimage54 3/s 5/s 62 KiB/s 101 KiB/s 2.15 ms 389.85 us 2024-03-26T17:07:03.369 INFO:tasks.workunit.client.3.smithi157.stdout:myimage52 3/s 4/s 47 KiB/s 107 KiB/s 2.39 ms 393.32 us 2024-03-26T17:07:03.369 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:07:03.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:07:03 smithi149 ceph-mon[34678]: pgmap v634: 33 pgs: 33 active+clean; 1.0 GiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 6.4 MiB/s rd, 6.5 MiB/s wr, 536 op/s 2024-03-26T17:07:03.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:07:03 smithi044 ceph-mon[30624]: pgmap v634: 33 pgs: 33 active+clean; 1.0 GiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 6.4 MiB/s rd, 6.5 MiB/s wr, 536 op/s 2024-03-26T17:07:04.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:07:04 smithi064 ceph-mon[34420]: Health check update: 3 slow ops, oldest one blocked for 518 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:07:04.341 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:07:04 smithi044 ceph-mon[30624]: Health check update: 3 slow ops, oldest one blocked for 518 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:07:04.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:07:04 smithi149 ceph-mon[34678]: Health check update: 3 slow ops, oldest one blocked for 518 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:07:04.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:07:04 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:07:04] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:07:04.766 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:07:04 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:07:04] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:07:04.766 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:07:04 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:07:04.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:07:04 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:07:04] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:07:04.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:07:04 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:07:04] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:07:04.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:07:04 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:07:05.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:07:05 smithi064 ceph-mon[34420]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:07:05.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:07:05 smithi064 ceph-mon[34420]: { 2024-03-26T17:07:05.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:07:05 smithi064 ceph-mon[34420]: "prefix": "rbd perf image stats", 2024-03-26T17:07:05.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:07:05 smithi064 ceph-mon[34420]: "pool_spec": "mypool", 2024-03-26T17:07:05.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:07:05 smithi064 ceph-mon[34420]: "sort_by": "write_ops", 2024-03-26T17:07:05.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:07:05 smithi064 ceph-mon[34420]: "format": "json" 2024-03-26T17:07:05.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:07:05 smithi064 ceph-mon[34420]: }"]: dispatch 2024-03-26T17:07:05.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:07:05 smithi064 ceph-mon[34420]: pgmap v635: 33 pgs: 33 active+clean; 1.0 GiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 6.6 MiB/s rd, 6.8 MiB/s wr, 573 op/s 2024-03-26T17:07:05.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:07:05 smithi149 ceph-mon[34678]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:07:05.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:07:05 smithi149 ceph-mon[34678]: { 2024-03-26T17:07:05.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:07:05 smithi149 ceph-mon[34678]: "prefix": "rbd perf image stats", 2024-03-26T17:07:05.398 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:07:05 smithi149 ceph-mon[34678]: "pool_spec": "mypool", 2024-03-26T17:07:05.398 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:07:05 smithi149 ceph-mon[34678]: "sort_by": "write_ops", 2024-03-26T17:07:05.398 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:07:05 smithi149 ceph-mon[34678]: "format": "json" 2024-03-26T17:07:05.398 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:07:05 smithi149 ceph-mon[34678]: }"]: dispatch 2024-03-26T17:07:05.398 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:07:05 smithi149 ceph-mon[34678]: pgmap v635: 33 pgs: 33 active+clean; 1.0 GiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 6.6 MiB/s rd, 6.8 MiB/s wr, 573 op/s 2024-03-26T17:07:05.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:07:05 smithi044 ceph-mon[30624]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:07:05.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:07:05 smithi044 ceph-mon[30624]: { 2024-03-26T17:07:05.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:07:05 smithi044 ceph-mon[30624]: "prefix": "rbd perf image stats", 2024-03-26T17:07:05.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:07:05 smithi044 ceph-mon[30624]: "pool_spec": "mypool", 2024-03-26T17:07:05.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:07:05 smithi044 ceph-mon[30624]: "sort_by": "write_ops", 2024-03-26T17:07:05.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:07:05 smithi044 ceph-mon[30624]: "format": "json" 2024-03-26T17:07:05.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:07:05 smithi044 ceph-mon[30624]: }"]: dispatch 2024-03-26T17:07:05.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:07:05 smithi044 ceph-mon[30624]: pgmap v635: 33 pgs: 33 active+clean; 1.0 GiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 6.6 MiB/s rd, 6.8 MiB/s wr, 573 op/s 2024-03-26T17:07:06.598 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:07:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 2024-03-26T17:07:06.230+0000 7fa707a55700 -1 mon.c@1(peon) e3 get_health_metrics reporting 3 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T17:07:06.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:07:06 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:07:06] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:07:06.766 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:07:06 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:07:06] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:07:06.766 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:07:06 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:07:06.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:07:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:07:06] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:07:06.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:07:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:07:06] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:07:06.897 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:07:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:07:07.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:07:07 smithi064 ceph-mon[34420]: pgmap v636: 33 pgs: 33 active+clean; 1.0 GiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 6.6 MiB/s rd, 6.8 MiB/s wr, 583 op/s 2024-03-26T17:07:07.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:07:07 smithi149 ceph-mon[34678]: pgmap v636: 33 pgs: 33 active+clean; 1.0 GiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 6.6 MiB/s rd, 6.8 MiB/s wr, 583 op/s 2024-03-26T17:07:07.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:07:07 smithi044 ceph-mon[30624]: pgmap v636: 33 pgs: 33 active+clean; 1.0 GiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 6.6 MiB/s rd, 6.8 MiB/s wr, 583 op/s 2024-03-26T17:07:08.370 INFO:tasks.workunit.client.3.smithi157.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-26T17:07:08.370 INFO:tasks.workunit.client.3.smithi157.stdout:myimage5 6/s 4/s 155 KiB/s 65 KiB/s 2.02 ms 378.83 us 2024-03-26T17:07:08.370 INFO:tasks.workunit.client.3.smithi157.stdout:myimage58 5/s 3/s 148 KiB/s 114 KiB/s 1.96 ms 377.26 us 2024-03-26T17:07:08.370 INFO:tasks.workunit.client.3.smithi157.stdout:myimage37 5/s 5/s 122 KiB/s 114 KiB/s 2.33 ms 313.01 us 2024-03-26T17:07:08.370 INFO:tasks.workunit.client.3.smithi157.stdout:myimage20 5/s 4/s 136 KiB/s 88 KiB/s 2.10 ms 334.48 us 2024-03-26T17:07:08.371 INFO:tasks.workunit.client.3.smithi157.stdout:myimage1 5/s 4/s 104 KiB/s 86 KiB/s 1.81 ms 279.14 us 2024-03-26T17:07:08.371 INFO:tasks.workunit.client.3.smithi157.stdout:myimage21 5/s 4/s 134 KiB/s 97 KiB/s 2.85 ms 400.84 us 2024-03-26T17:07:08.371 INFO:tasks.workunit.client.3.smithi157.stdout:myimage55 5/s 4/s 123 KiB/s 115 KiB/s 2.37 ms 431.67 us 2024-03-26T17:07:08.371 INFO:tasks.workunit.client.3.smithi157.stdout:myimage14 5/s 4/s 101 KiB/s 78 KiB/s 2.50 ms 411.19 us 2024-03-26T17:07:08.371 INFO:tasks.workunit.client.3.smithi157.stdout:myimage38 5/s 4/s 139 KiB/s 79 KiB/s 1.85 ms 325.46 us 2024-03-26T17:07:08.371 INFO:tasks.workunit.client.3.smithi157.stdout:myimage48 5/s 2/s 107 KiB/s 66 KiB/s 2.37 ms 357.53 us 2024-03-26T17:07:08.371 INFO:tasks.workunit.client.3.smithi157.stdout:myimage49 5/s 4/s 112 KiB/s 87 KiB/s 2.16 ms 347.06 us 2024-03-26T17:07:08.371 INFO:tasks.workunit.client.3.smithi157.stdout:myimage17 5/s 3/s 120 KiB/s 84 KiB/s 2.30 ms 516.29 us 2024-03-26T17:07:08.371 INFO:tasks.workunit.client.3.smithi157.stdout:myimage29 5/s 3/s 94 KiB/s 60 KiB/s 2.01 ms 434.23 us 2024-03-26T17:07:08.371 INFO:tasks.workunit.client.3.smithi157.stdout:myimage34 5/s 4/s 106 KiB/s 126 KiB/s 2.00 ms 288.10 us 2024-03-26T17:07:08.371 INFO:tasks.workunit.client.3.smithi157.stdout:myimage11 5/s 4/s 120 KiB/s 120 KiB/s 2.31 ms 325.07 us 2024-03-26T17:07:08.371 INFO:tasks.workunit.client.3.smithi157.stdout:myimage25 5/s 4/s 132 KiB/s 111 KiB/s 2.66 ms 420.73 us 2024-03-26T17:07:08.371 INFO:tasks.workunit.client.3.smithi157.stdout:myimage43 5/s 4/s 108 KiB/s 115 KiB/s 2.45 ms 345.79 us 2024-03-26T17:07:08.372 INFO:tasks.workunit.client.3.smithi157.stdout:myimage50 5/s 4/s 88 KiB/s 100 KiB/s 2.19 ms 343.19 us 2024-03-26T17:07:08.372 INFO:tasks.workunit.client.3.smithi157.stdout:myimage13 4/s 4/s 114 KiB/s 66 KiB/s 1.94 ms 292.27 us 2024-03-26T17:07:08.372 INFO:tasks.workunit.client.3.smithi157.stdout:myimage35 4/s 4/s 109 KiB/s 112 KiB/s 2.16 ms 375.77 us 2024-03-26T17:07:08.372 INFO:tasks.workunit.client.3.smithi157.stdout:myimage8 4/s 4/s 99 KiB/s 102 KiB/s 2.13 ms 337.79 us 2024-03-26T17:07:08.372 INFO:tasks.workunit.client.3.smithi157.stdout:myimage24 4/s 4/s 138 KiB/s 134 KiB/s 2.35 ms 381.29 us 2024-03-26T17:07:08.372 INFO:tasks.workunit.client.3.smithi157.stdout:myimage33 4/s 4/s 135 KiB/s 71 KiB/s 2.20 ms 372.14 us 2024-03-26T17:07:08.372 INFO:tasks.workunit.client.3.smithi157.stdout:myimage45 4/s 4/s 128 KiB/s 118 KiB/s 2.18 ms 373.98 us 2024-03-26T17:07:08.372 INFO:tasks.workunit.client.3.smithi157.stdout:myimage54 4/s 5/s 89 KiB/s 122 KiB/s 2.10 ms 375.37 us 2024-03-26T17:07:08.372 INFO:tasks.workunit.client.3.smithi157.stdout:myimage2 4/s 4/s 87 KiB/s 94 KiB/s 2.44 ms 415.65 us 2024-03-26T17:07:08.372 INFO:tasks.workunit.client.3.smithi157.stdout:myimage3 4/s 4/s 114 KiB/s 97 KiB/s 1.83 ms 330.96 us 2024-03-26T17:07:08.372 INFO:tasks.workunit.client.3.smithi157.stdout:myimage44 4/s 5/s 116 KiB/s 94 KiB/s 2.24 ms 401.04 us 2024-03-26T17:07:08.373 INFO:tasks.workunit.client.3.smithi157.stdout:myimage47 4/s 4/s 138 KiB/s 103 KiB/s 2.38 ms 330.75 us 2024-03-26T17:07:08.373 INFO:tasks.workunit.client.3.smithi157.stdout:myimage7 4/s 4/s 102 KiB/s 100 KiB/s 2.17 ms 338.35 us 2024-03-26T17:07:08.373 INFO:tasks.workunit.client.3.smithi157.stdout:myimage12 4/s 4/s 122 KiB/s 110 KiB/s 2.25 ms 319.08 us 2024-03-26T17:07:08.373 INFO:tasks.workunit.client.3.smithi157.stdout:myimage36 4/s 4/s 92 KiB/s 62 KiB/s 2.03 ms 337.31 us 2024-03-26T17:07:08.373 INFO:tasks.workunit.client.3.smithi157.stdout:myimage60 4/s 4/s 114 KiB/s 94 KiB/s 2.41 ms 323.53 us 2024-03-26T17:07:08.373 INFO:tasks.workunit.client.3.smithi157.stdout:myimage16 4/s 5/s 123 KiB/s 143 KiB/s 2.17 ms 302.26 us 2024-03-26T17:07:08.373 INFO:tasks.workunit.client.3.smithi157.stdout:myimage30 4/s 5/s 97 KiB/s 118 KiB/s 2.73 ms 401.61 us 2024-03-26T17:07:08.373 INFO:tasks.workunit.client.3.smithi157.stdout:myimage52 4/s 4/s 119 KiB/s 97 KiB/s 2.80 ms 310.66 us 2024-03-26T17:07:08.373 INFO:tasks.workunit.client.3.smithi157.stdout:myimage18 4/s 3/s 106 KiB/s 82 KiB/s 2.07 ms 330.05 us 2024-03-26T17:07:08.373 INFO:tasks.workunit.client.3.smithi157.stdout:myimage26 4/s 5/s 82 KiB/s 138 KiB/s 2.29 ms 427.26 us 2024-03-26T17:07:08.373 INFO:tasks.workunit.client.3.smithi157.stdout:myimage39 4/s 4/s 118 KiB/s 86 KiB/s 2.25 ms 403.01 us 2024-03-26T17:07:08.373 INFO:tasks.workunit.client.3.smithi157.stdout:myimage53 4/s 4/s 85 KiB/s 124 KiB/s 2.11 ms 351.01 us 2024-03-26T17:07:08.373 INFO:tasks.workunit.client.3.smithi157.stdout:myimage10 4/s 5/s 103 KiB/s 99 KiB/s 2.12 ms 299.82 us 2024-03-26T17:07:08.374 INFO:tasks.workunit.client.3.smithi157.stdout:myimage31 4/s 4/s 97 KiB/s 90 KiB/s 2.40 ms 367.86 us 2024-03-26T17:07:08.374 INFO:tasks.workunit.client.3.smithi157.stdout:myimage28 4/s 4/s 100 KiB/s 106 KiB/s 2.76 ms 400.18 us 2024-03-26T17:07:08.374 INFO:tasks.workunit.client.3.smithi157.stdout:myimage41 4/s 6/s 96 KiB/s 165 KiB/s 2.29 ms 339.64 us 2024-03-26T17:07:08.374 INFO:tasks.workunit.client.3.smithi157.stdout:myimage59 4/s 5/s 110 KiB/s 128 KiB/s 2.45 ms 345.12 us 2024-03-26T17:07:08.374 INFO:tasks.workunit.client.3.smithi157.stdout:myimage9 4/s 5/s 73 KiB/s 115 KiB/s 2.38 ms 361.00 us 2024-03-26T17:07:08.374 INFO:tasks.workunit.client.3.smithi157.stdout:myimage15 3/s 5/s 89 KiB/s 92 KiB/s 2.09 ms 336.73 us 2024-03-26T17:07:08.374 INFO:tasks.workunit.client.3.smithi157.stdout:myimage42 3/s 3/s 98 KiB/s 88 KiB/s 2.13 ms 300.58 us 2024-03-26T17:07:08.374 INFO:tasks.workunit.client.3.smithi157.stdout:myimage46 3/s 4/s 82 KiB/s 107 KiB/s 2.17 ms 324.22 us 2024-03-26T17:07:08.374 INFO:tasks.workunit.client.3.smithi157.stdout:myimage23 3/s 4/s 96 KiB/s 126 KiB/s 1.99 ms 468.54 us 2024-03-26T17:07:08.374 INFO:tasks.workunit.client.3.smithi157.stdout:myimage32 3/s 4/s 63 KiB/s 77 KiB/s 2.41 ms 321.85 us 2024-03-26T17:07:08.374 INFO:tasks.workunit.client.3.smithi157.stdout:myimage40 3/s 6/s 93 KiB/s 111 KiB/s 2.02 ms 390.68 us 2024-03-26T17:07:08.374 INFO:tasks.workunit.client.3.smithi157.stdout:myimage56 3/s 5/s 78 KiB/s 117 KiB/s 2.62 ms 352.72 us 2024-03-26T17:07:08.374 INFO:tasks.workunit.client.3.smithi157.stdout:myimage22 3/s 5/s 79 KiB/s 106 KiB/s 2.22 ms 292.22 us 2024-03-26T17:07:08.375 INFO:tasks.workunit.client.3.smithi157.stdout:myimage4 3/s 5/s 70 KiB/s 122 KiB/s 2.08 ms 387.70 us 2024-03-26T17:07:08.375 INFO:tasks.workunit.client.3.smithi157.stdout:myimage6 3/s 4/s 89 KiB/s 94 KiB/s 2.46 ms 340.80 us 2024-03-26T17:07:08.375 INFO:tasks.workunit.client.3.smithi157.stdout:myimage27 3/s 4/s 80 KiB/s 106 KiB/s 2.03 ms 323.22 us 2024-03-26T17:07:08.375 INFO:tasks.workunit.client.3.smithi157.stdout:myimage57 3/s 6/s 92 KiB/s 144 KiB/s 2.28 ms 329.04 us 2024-03-26T17:07:08.375 INFO:tasks.workunit.client.3.smithi157.stdout:myimage19 3/s 5/s 58 KiB/s 138 KiB/s 2.29 ms 359.91 us 2024-03-26T17:07:08.375 INFO:tasks.workunit.client.3.smithi157.stdout:myimage51 2/s 6/s 58 KiB/s 137 KiB/s 2.30 ms 329.45 us 2024-03-26T17:07:08.375 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:07:08.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:07:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:07:08] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:07:08.766 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:07:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:07:08] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:07:08.766 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:07:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:07:08.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:07:08 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:07:08] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:07:08.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:07:08 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:07:08] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:07:08.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:07:08 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:07:09.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:07:09 smithi064 ceph-mon[34420]: pgmap v637: 33 pgs: 33 active+clean; 1.0 GiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 6.1 MiB/s rd, 6.3 MiB/s wr, 551 op/s 2024-03-26T17:07:09.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:07:09 smithi064 ceph-mon[34420]: Health check update: 3 slow ops, oldest one blocked for 523 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:07:09.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:07:09 smithi149 ceph-mon[34678]: pgmap v637: 33 pgs: 33 active+clean; 1.0 GiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 6.1 MiB/s rd, 6.3 MiB/s wr, 551 op/s 2024-03-26T17:07:09.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:07:09 smithi149 ceph-mon[34678]: Health check update: 3 slow ops, oldest one blocked for 523 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:07:09.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:07:09 smithi044 ceph-mon[30624]: pgmap v637: 33 pgs: 33 active+clean; 1.0 GiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 6.1 MiB/s rd, 6.3 MiB/s wr, 551 op/s 2024-03-26T17:07:09.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:07:09 smithi044 ceph-mon[30624]: Health check update: 3 slow ops, oldest one blocked for 523 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:07:10.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:07:10 smithi064 ceph-mon[34420]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:07:10.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:07:10 smithi064 ceph-mon[34420]: { 2024-03-26T17:07:10.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:07:10 smithi064 ceph-mon[34420]: "prefix": "rbd perf image stats", 2024-03-26T17:07:10.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:07:10 smithi064 ceph-mon[34420]: "pool_spec": "mypool", 2024-03-26T17:07:10.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:07:10 smithi064 ceph-mon[34420]: "sort_by": "write_ops", 2024-03-26T17:07:10.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:07:10 smithi064 ceph-mon[34420]: "format": "json" 2024-03-26T17:07:10.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:07:10 smithi064 ceph-mon[34420]: }"]: dispatch 2024-03-26T17:07:10.390 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:07:10 smithi044 ceph-mon[30624]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:07:10.390 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:07:10 smithi044 ceph-mon[30624]: { 2024-03-26T17:07:10.390 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:07:10 smithi044 ceph-mon[30624]: "prefix": "rbd perf image stats", 2024-03-26T17:07:10.390 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:07:10 smithi044 ceph-mon[30624]: "pool_spec": "mypool", 2024-03-26T17:07:10.390 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:07:10 smithi044 ceph-mon[30624]: "sort_by": "write_ops", 2024-03-26T17:07:10.390 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:07:10 smithi044 ceph-mon[30624]: "format": "json" 2024-03-26T17:07:10.390 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:07:10 smithi044 ceph-mon[30624]: }"]: dispatch 2024-03-26T17:07:10.395 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:07:10 smithi149 ceph-mon[34678]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:07:10.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:07:10 smithi149 ceph-mon[34678]: { 2024-03-26T17:07:10.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:07:10 smithi149 ceph-mon[34678]: "prefix": "rbd perf image stats", 2024-03-26T17:07:10.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:07:10 smithi149 ceph-mon[34678]: "pool_spec": "mypool", 2024-03-26T17:07:10.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:07:10 smithi149 ceph-mon[34678]: "sort_by": "write_ops", 2024-03-26T17:07:10.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:07:10 smithi149 ceph-mon[34678]: "format": "json" 2024-03-26T17:07:10.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:07:10 smithi149 ceph-mon[34678]: }"]: dispatch 2024-03-26T17:07:10.766 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:07:10 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:07:10] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:07:10.766 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:07:10 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:07:10] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:07:10.766 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:07:10 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:07:10.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:07:10 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:07:10] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:07:10.897 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:07:10 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:07:10] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:07:10.897 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:07:10 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:07:11.231 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:07:11 smithi149 ceph-mon[34678]: pgmap v638: 33 pgs: 33 active+clean; 1.0 GiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 5.9 MiB/s rd, 6.0 MiB/s wr, 533 op/s 2024-03-26T17:07:11.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:07:11 smithi064 ceph-mon[34420]: pgmap v638: 33 pgs: 33 active+clean; 1.0 GiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 5.9 MiB/s rd, 6.0 MiB/s wr, 533 op/s 2024-03-26T17:07:11.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:07:11 smithi044 ceph-mon[30624]: pgmap v638: 33 pgs: 33 active+clean; 1.0 GiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 5.9 MiB/s rd, 6.0 MiB/s wr, 533 op/s 2024-03-26T17:07:11.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:07:11 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 2024-03-26T17:07:11.230+0000 7fa707a55700 -1 mon.c@1(peon) e3 get_health_metrics reporting 3 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T17:07:12.767 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:07:12 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:07:12] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:07:12.767 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:07:12 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:07:12] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:07:12.767 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:07:12 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:07:12.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:07:12 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:07:12] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:07:12.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:07:12 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:07:12] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:07:12.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:07:12 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:07:13.062 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:07:13.070 INFO:tasks.workunit.client.3.smithi157.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2024-03-26T17:07:13.070 INFO:tasks.workunit.client.3.smithi157.stdout: 8.80 80.0k 110.8k 0.0k 800.0k 1.1M 0.0k nvme2n1 2024-03-26T17:07:13.070 INFO:tasks.workunit.client.3.smithi157.stdout: 8.80 78.4k 102.4k 0.0k 784.0k 1.0M 0.0k nvme2n10 2024-03-26T17:07:13.070 INFO:tasks.workunit.client.3.smithi157.stdout: 8.80 113.2k 110.0k 0.0k 1.1M 1.1M 0.0k nvme2n11 2024-03-26T17:07:13.070 INFO:tasks.workunit.client.3.smithi157.stdout: 8.80 89.6k 125.2k 0.0k 896.0k 1.2M 0.0k nvme2n12 2024-03-26T17:07:13.070 INFO:tasks.workunit.client.3.smithi157.stdout: 8.90 90.0k 93.2k 0.0k 900.0k 932.0k 0.0k nvme2n13 2024-03-26T17:07:13.070 INFO:tasks.workunit.client.3.smithi157.stdout: 8.80 73.6k 104.0k 0.0k 736.0k 1.0M 0.0k nvme2n14 2024-03-26T17:07:13.070 INFO:tasks.workunit.client.3.smithi157.stdout: 8.80 112.4k 81.6k 0.0k 1.1M 816.0k 0.0k nvme2n15 2024-03-26T17:07:13.070 INFO:tasks.workunit.client.3.smithi157.stdout: 8.80 86.8k 104.8k 0.0k 868.0k 1.0M 0.0k nvme2n16 2024-03-26T17:07:13.070 INFO:tasks.workunit.client.3.smithi157.stdout: 8.80 96.8k 103.2k 0.0k 968.0k 1.0M 0.0k nvme2n17 2024-03-26T17:07:13.070 INFO:tasks.workunit.client.3.smithi157.stdout: 8.80 93.2k 114.0k 0.0k 932.0k 1.1M 0.0k nvme2n18 2024-03-26T17:07:13.071 INFO:tasks.workunit.client.3.smithi157.stdout: 8.80 110.4k 113.6k 0.0k 1.1M 1.1M 0.0k nvme2n19 2024-03-26T17:07:13.071 INFO:tasks.workunit.client.3.smithi157.stdout: 8.80 89.2k 116.4k 0.0k 892.0k 1.1M 0.0k nvme2n2 2024-03-26T17:07:13.071 INFO:tasks.workunit.client.3.smithi157.stdout: 8.80 88.0k 100.4k 0.0k 880.0k 1004.0k 0.0k nvme2n20 2024-03-26T17:07:13.071 INFO:tasks.workunit.client.3.smithi157.stdout: 8.80 80.4k 106.8k 0.0k 804.0k 1.0M 0.0k nvme2n3 2024-03-26T17:07:13.071 INFO:tasks.workunit.client.3.smithi157.stdout: 8.80 80.4k 96.4k 0.0k 804.0k 964.0k 0.0k nvme2n4 2024-03-26T17:07:13.071 INFO:tasks.workunit.client.3.smithi157.stdout: 8.80 68.8k 116.0k 0.0k 688.0k 1.1M 0.0k nvme2n5 2024-03-26T17:07:13.071 INFO:tasks.workunit.client.3.smithi157.stdout: 8.80 88.8k 106.8k 0.0k 888.0k 1.0M 0.0k nvme2n6 2024-03-26T17:07:13.071 INFO:tasks.workunit.client.3.smithi157.stdout: 8.80 82.4k 105.2k 0.0k 824.0k 1.0M 0.0k nvme2n7 2024-03-26T17:07:13.071 INFO:tasks.workunit.client.3.smithi157.stdout: 8.80 101.6k 96.8k 0.0k 1016.0k 968.0k 0.0k nvme2n8 2024-03-26T17:07:13.071 INFO:tasks.workunit.client.3.smithi157.stdout: 8.80 138.4k 74.8k 0.0k 1.4M 748.0k 0.0k nvme2n9 2024-03-26T17:07:13.071 INFO:tasks.workunit.client.3.smithi157.stdout: 8.80 80.8k 101.6k 0.0k 808.0k 1016.0k 0.0k nvme5n1 2024-03-26T17:07:13.071 INFO:tasks.workunit.client.3.smithi157.stdout: 8.80 84.4k 94.4k 0.0k 844.0k 944.0k 0.0k nvme5n10 2024-03-26T17:07:13.071 INFO:tasks.workunit.client.3.smithi157.stdout: 8.80 108.0k 95.2k 0.0k 1.1M 952.0k 0.0k nvme5n11 2024-03-26T17:07:13.071 INFO:tasks.workunit.client.3.smithi157.stdout: 8.80 97.2k 95.2k 0.0k 972.0k 952.0k 0.0k nvme5n12 2024-03-26T17:07:13.072 INFO:tasks.workunit.client.3.smithi157.stdout: 8.90 72.8k 100.0k 0.0k 728.0k 1000.0k 0.0k nvme5n13 2024-03-26T17:07:13.072 INFO:tasks.workunit.client.3.smithi157.stdout: 8.90 128.0k 86.4k 0.0k 1.2M 864.0k 0.0k nvme5n14 2024-03-26T17:07:13.072 INFO:tasks.workunit.client.3.smithi157.stdout: 8.80 108.0k 87.6k 0.0k 1.1M 876.0k 0.0k nvme5n15 2024-03-26T17:07:13.072 INFO:tasks.workunit.client.3.smithi157.stdout: 8.80 76.4k 106.4k 0.0k 764.0k 1.0M 0.0k nvme5n16 2024-03-26T17:07:13.072 INFO:tasks.workunit.client.3.smithi157.stdout: 8.80 110.0k 97.2k 0.0k 1.1M 972.0k 0.0k nvme5n17 2024-03-26T17:07:13.072 INFO:tasks.workunit.client.3.smithi157.stdout: 8.80 70.4k 123.6k 0.0k 704.0k 1.2M 0.0k nvme5n18 2024-03-26T17:07:13.072 INFO:tasks.workunit.client.3.smithi157.stdout: 8.80 91.2k 108.4k 0.0k 912.0k 1.1M 0.0k nvme5n19 2024-03-26T17:07:13.072 INFO:tasks.workunit.client.3.smithi157.stdout: 8.80 108.4k 107.2k 0.0k 1.1M 1.0M 0.0k nvme5n2 2024-03-26T17:07:13.072 INFO:tasks.workunit.client.3.smithi157.stdout: 8.80 123.2k 70.4k 0.0k 1.2M 704.0k 0.0k nvme5n20 2024-03-26T17:07:13.072 INFO:tasks.workunit.client.3.smithi157.stdout: 8.80 83.2k 116.8k 0.0k 832.0k 1.1M 0.0k nvme5n3 2024-03-26T17:07:13.072 INFO:tasks.workunit.client.3.smithi157.stdout: 8.80 126.0k 98.8k 0.0k 1.2M 988.0k 0.0k nvme5n4 2024-03-26T17:07:13.072 INFO:tasks.workunit.client.3.smithi157.stdout: 8.80 106.4k 106.0k 0.0k 1.0M 1.0M 0.0k nvme5n5 2024-03-26T17:07:13.072 INFO:tasks.workunit.client.3.smithi157.stdout: 8.80 111.2k 80.4k 0.0k 1.1M 804.0k 0.0k nvme5n6 2024-03-26T17:07:13.072 INFO:tasks.workunit.client.3.smithi157.stdout: 8.80 93.2k 110.4k 0.0k 932.0k 1.1M 0.0k nvme5n7 2024-03-26T17:07:13.073 INFO:tasks.workunit.client.3.smithi157.stdout: 8.80 102.4k 111.2k 0.0k 1.0M 1.1M 0.0k nvme5n8 2024-03-26T17:07:13.073 INFO:tasks.workunit.client.3.smithi157.stdout: 8.80 99.2k 114.8k 0.0k 992.0k 1.1M 0.0k nvme5n9 2024-03-26T17:07:13.073 INFO:tasks.workunit.client.3.smithi157.stdout: 8.80 112.8k 81.6k 0.0k 1.1M 816.0k 0.0k nvme8n1 2024-03-26T17:07:13.073 INFO:tasks.workunit.client.3.smithi157.stdout: 8.80 97.2k 101.6k 0.0k 972.0k 1016.0k 0.0k nvme8n10 2024-03-26T17:07:13.073 INFO:tasks.workunit.client.3.smithi157.stdout: 8.80 77.2k 124.8k 0.0k 772.0k 1.2M 0.0k nvme8n11 2024-03-26T17:07:13.073 INFO:tasks.workunit.client.3.smithi157.stdout: 8.90 72.4k 93.6k 0.0k 724.0k 936.0k 0.0k nvme8n12 2024-03-26T17:07:13.073 INFO:tasks.workunit.client.3.smithi157.stdout: 8.90 112.8k 94.0k 0.0k 1.1M 940.0k 0.0k nvme8n13 2024-03-26T17:07:13.073 INFO:tasks.workunit.client.3.smithi157.stdout: 8.80 70.0k 101.2k 0.0k 700.0k 1012.0k 0.0k nvme8n14 2024-03-26T17:07:13.073 INFO:tasks.workunit.client.3.smithi157.stdout: 8.80 104.0k 90.0k 0.0k 1.0M 900.0k 0.0k nvme8n15 2024-03-26T17:07:13.073 INFO:tasks.workunit.client.3.smithi157.stdout: 8.80 74.8k 92.4k 0.0k 748.0k 924.0k 0.0k nvme8n16 2024-03-26T17:07:13.073 INFO:tasks.workunit.client.3.smithi157.stdout: 8.80 114.4k 102.8k 0.0k 1.1M 1.0M 0.0k nvme8n17 2024-03-26T17:07:13.073 INFO:tasks.workunit.client.3.smithi157.stdout: 8.80 107.6k 94.4k 0.0k 1.1M 944.0k 0.0k nvme8n18 2024-03-26T17:07:13.073 INFO:tasks.workunit.client.3.smithi157.stdout: 8.80 83.6k 100.4k 0.0k 836.0k 1004.0k 0.0k nvme8n19 2024-03-26T17:07:13.073 INFO:tasks.workunit.client.3.smithi157.stdout: 8.80 93.6k 112.4k 0.0k 936.0k 1.1M 0.0k nvme8n2 2024-03-26T17:07:13.073 INFO:tasks.workunit.client.3.smithi157.stdout: 8.80 89.6k 92.4k 0.0k 896.0k 924.0k 0.0k nvme8n20 2024-03-26T17:07:13.074 INFO:tasks.workunit.client.3.smithi157.stdout: 8.80 95.6k 104.8k 0.0k 956.0k 1.0M 0.0k nvme8n3 2024-03-26T17:07:13.074 INFO:tasks.workunit.client.3.smithi157.stdout: 8.80 120.4k 95.6k 0.0k 1.2M 956.0k 0.0k nvme8n4 2024-03-26T17:07:13.074 INFO:tasks.workunit.client.3.smithi157.stdout: 8.80 102.0k 98.8k 0.0k 1020.0k 988.0k 0.0k nvme8n5 2024-03-26T17:07:13.074 INFO:tasks.workunit.client.3.smithi157.stdout: 8.80 88.4k 102.4k 0.0k 884.0k 1.0M 0.0k nvme8n6 2024-03-26T17:07:13.074 INFO:tasks.workunit.client.3.smithi157.stdout: 8.80 95.2k 112.0k 0.0k 952.0k 1.1M 0.0k nvme8n7 2024-03-26T17:07:13.074 INFO:tasks.workunit.client.3.smithi157.stdout: 8.80 95.6k 95.2k 0.0k 956.0k 952.0k 0.0k nvme8n8 2024-03-26T17:07:13.074 INFO:tasks.workunit.client.3.smithi157.stdout: 8.80 96.0k 96.0k 0.0k 960.0k 960.0k 0.0k nvme8n9 2024-03-26T17:07:13.074 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:07:13.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:07:13 smithi064 ceph-mon[34420]: pgmap v639: 33 pgs: 33 active+clean; 1.0 GiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 5.8 MiB/s rd, 6.0 MiB/s wr, 532 op/s 2024-03-26T17:07:13.375 INFO:tasks.workunit.client.3.smithi157.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-26T17:07:13.375 INFO:tasks.workunit.client.3.smithi157.stdout:myimage4 6/s 4/s 123 KiB/s 82 KiB/s 2.05 ms 311.49 us 2024-03-26T17:07:13.375 INFO:tasks.workunit.client.3.smithi157.stdout:myimage14 5/s 3/s 107 KiB/s 89 KiB/s 2.49 ms 333.67 us 2024-03-26T17:07:13.375 INFO:tasks.workunit.client.3.smithi157.stdout:myimage7 5/s 3/s 119 KiB/s 87 KiB/s 2.38 ms 433.65 us 2024-03-26T17:07:13.375 INFO:tasks.workunit.client.3.smithi157.stdout:myimage39 5/s 3/s 145 KiB/s 60 KiB/s 2.13 ms 376.67 us 2024-03-26T17:07:13.375 INFO:tasks.workunit.client.3.smithi157.stdout:myimage42 5/s 3/s 127 KiB/s 77 KiB/s 2.14 ms 429.60 us 2024-03-26T17:07:13.375 INFO:tasks.workunit.client.3.smithi157.stdout:myimage48 5/s 4/s 111 KiB/s 94 KiB/s 2.36 ms 330.57 us 2024-03-26T17:07:13.376 INFO:tasks.workunit.client.3.smithi157.stdout:myimage33 5/s 3/s 129 KiB/s 65 KiB/s 2.25 ms 319.92 us 2024-03-26T17:07:13.376 INFO:tasks.workunit.client.3.smithi157.stdout:myimage45 5/s 3/s 132 KiB/s 85 KiB/s 2.11 ms 335.16 us 2024-03-26T17:07:13.376 INFO:tasks.workunit.client.3.smithi157.stdout:myimage51 5/s 3/s 153 KiB/s 68 KiB/s 2.47 ms 395.05 us 2024-03-26T17:07:13.376 INFO:tasks.workunit.client.3.smithi157.stdout:myimage22 5/s 4/s 136 KiB/s 115 KiB/s 2.12 ms 331.85 us 2024-03-26T17:07:13.376 INFO:tasks.workunit.client.3.smithi157.stdout:myimage19 5/s 4/s 141 KiB/s 105 KiB/s 2.21 ms 340.17 us 2024-03-26T17:07:13.376 INFO:tasks.workunit.client.3.smithi157.stdout:myimage2 5/s 5/s 133 KiB/s 126 KiB/s 2.38 ms 444.00 us 2024-03-26T17:07:13.376 INFO:tasks.workunit.client.3.smithi157.stdout:myimage23 5/s 4/s 130 KiB/s 91 KiB/s 1.98 ms 330.94 us 2024-03-26T17:07:13.376 INFO:tasks.workunit.client.3.smithi157.stdout:myimage36 5/s 4/s 106 KiB/s 115 KiB/s 2.16 ms 370.99 us 2024-03-26T17:07:13.376 INFO:tasks.workunit.client.3.smithi157.stdout:myimage43 5/s 3/s 110 KiB/s 86 KiB/s 2.47 ms 542.62 us 2024-03-26T17:07:13.376 INFO:tasks.workunit.client.3.smithi157.stdout:myimage56 5/s 3/s 101 KiB/s 72 KiB/s 2.66 ms 338.29 us 2024-03-26T17:07:13.376 INFO:tasks.workunit.client.3.smithi157.stdout:myimage52 5/s 4/s 102 KiB/s 59 KiB/s 2.30 ms 390.92 us 2024-03-26T17:07:13.376 INFO:tasks.workunit.client.3.smithi157.stdout:myimage1 5/s 3/s 119 KiB/s 62 KiB/s 2.02 ms 315.75 us 2024-03-26T17:07:13.376 INFO:tasks.workunit.client.3.smithi157.stdout:myimage12 5/s 3/s 118 KiB/s 89 KiB/s 2.21 ms 335.26 us 2024-03-26T17:07:13.376 INFO:tasks.workunit.client.3.smithi157.stdout:myimage27 5/s 4/s 134 KiB/s 101 KiB/s 2.06 ms 409.85 us 2024-03-26T17:07:13.377 INFO:tasks.workunit.client.3.smithi157.stdout:myimage57 5/s 4/s 118 KiB/s 114 KiB/s 2.22 ms 367.64 us 2024-03-26T17:07:13.377 INFO:tasks.workunit.client.3.smithi157.stdout:myimage35 4/s 4/s 84 KiB/s 86 KiB/s 2.18 ms 325.71 us 2024-03-26T17:07:13.377 INFO:tasks.workunit.client.3.smithi157.stdout:myimage38 4/s 3/s 122 KiB/s 65 KiB/s 2.07 ms 411.61 us 2024-03-26T17:07:13.377 INFO:tasks.workunit.client.3.smithi157.stdout:myimage47 4/s 4/s 110 KiB/s 97 KiB/s 2.44 ms 288.72 us 2024-03-26T17:07:13.377 INFO:tasks.workunit.client.3.smithi157.stdout:myimage25 4/s 5/s 112 KiB/s 124 KiB/s 2.83 ms 375.48 us 2024-03-26T17:07:13.377 INFO:tasks.workunit.client.3.smithi157.stdout:myimage54 4/s 2/s 101 KiB/s 54 KiB/s 2.11 ms 349.82 us 2024-03-26T17:07:13.377 INFO:tasks.workunit.client.3.smithi157.stdout:myimage18 4/s 4/s 110 KiB/s 106 KiB/s 2.16 ms 329.71 us 2024-03-26T17:07:13.377 INFO:tasks.workunit.client.3.smithi157.stdout:myimage26 4/s 3/s 100 KiB/s 100 KiB/s 2.29 ms 357.55 us 2024-03-26T17:07:13.377 INFO:tasks.workunit.client.3.smithi157.stdout:myimage10 4/s 3/s 80 KiB/s 62 KiB/s 2.16 ms 424.58 us 2024-03-26T17:07:13.377 INFO:tasks.workunit.client.3.smithi157.stdout:myimage3 4/s 4/s 90 KiB/s 83 KiB/s 1.90 ms 324.33 us 2024-03-26T17:07:13.377 INFO:tasks.workunit.client.3.smithi157.stdout:myimage13 4/s 4/s 90 KiB/s 90 KiB/s 2.03 ms 375.15 us 2024-03-26T17:07:13.377 INFO:tasks.workunit.client.3.smithi157.stdout:myimage32 4/s 5/s 97 KiB/s 141 KiB/s 2.18 ms 324.78 us 2024-03-26T17:07:13.377 INFO:tasks.workunit.client.3.smithi157.stdout:myimage49 4/s 5/s 96 KiB/s 106 KiB/s 2.20 ms 322.56 us 2024-03-26T17:07:13.377 INFO:tasks.workunit.client.3.smithi157.stdout:myimage17 4/s 3/s 78 KiB/s 83 KiB/s 2.29 ms 366.90 us 2024-03-26T17:07:13.378 INFO:tasks.workunit.client.3.smithi157.stdout:myimage28 4/s 4/s 106 KiB/s 107 KiB/s 2.72 ms 434.19 us 2024-03-26T17:07:13.378 INFO:tasks.workunit.client.3.smithi157.stdout:myimage29 4/s 4/s 94 KiB/s 114 KiB/s 1.97 ms 439.34 us 2024-03-26T17:07:13.378 INFO:tasks.workunit.client.3.smithi157.stdout:myimage46 4/s 4/s 108 KiB/s 99 KiB/s 2.36 ms 329.81 us 2024-03-26T17:07:13.378 INFO:tasks.workunit.client.3.smithi157.stdout:myimage50 4/s 4/s 117 KiB/s 105 KiB/s 2.45 ms 352.46 us 2024-03-26T17:07:13.378 INFO:tasks.workunit.client.3.smithi157.stdout:myimage55 4/s 3/s 67 KiB/s 66 KiB/s 2.32 ms 324.15 us 2024-03-26T17:07:13.378 INFO:tasks.workunit.client.3.smithi157.stdout:myimage59 4/s 4/s 85 KiB/s 80 KiB/s 2.48 ms 403.95 us 2024-03-26T17:07:13.378 INFO:tasks.workunit.client.3.smithi157.stdout:myimage16 4/s 4/s 95 KiB/s 98 KiB/s 2.29 ms 346.95 us 2024-03-26T17:07:13.378 INFO:tasks.workunit.client.3.smithi157.stdout:myimage6 4/s 3/s 113 KiB/s 72 KiB/s 2.52 ms 333.61 us 2024-03-26T17:07:13.378 INFO:tasks.workunit.client.3.smithi157.stdout:myimage30 4/s 3/s 96 KiB/s 64 KiB/s 2.65 ms 336.98 us 2024-03-26T17:07:13.378 INFO:tasks.workunit.client.3.smithi157.stdout:myimage31 4/s 5/s 94 KiB/s 110 KiB/s 2.61 ms 397.50 us 2024-03-26T17:07:13.378 INFO:tasks.workunit.client.3.smithi157.stdout:myimage21 4/s 4/s 110 KiB/s 76 KiB/s 2.76 ms 400.64 us 2024-03-26T17:07:13.378 INFO:tasks.workunit.client.3.smithi157.stdout:myimage53 4/s 5/s 104 KiB/s 109 KiB/s 2.04 ms 316.95 us 2024-03-26T17:07:13.378 INFO:tasks.workunit.client.3.smithi157.stdout:myimage60 4/s 4/s 83 KiB/s 89 KiB/s 2.33 ms 327.30 us 2024-03-26T17:07:13.378 INFO:tasks.workunit.client.3.smithi157.stdout:myimage8 3/s 4/s 79 KiB/s 106 KiB/s 2.36 ms 344.01 us 2024-03-26T17:07:13.378 INFO:tasks.workunit.client.3.smithi157.stdout:myimage34 3/s 4/s 77 KiB/s 130 KiB/s 2.01 ms 494.38 us 2024-03-26T17:07:13.379 INFO:tasks.workunit.client.3.smithi157.stdout:myimage15 3/s 4/s 87 KiB/s 105 KiB/s 1.92 ms 496.21 us 2024-03-26T17:07:13.379 INFO:tasks.workunit.client.3.smithi157.stdout:myimage41 3/s 4/s 62 KiB/s 90 KiB/s 2.30 ms 428.96 us 2024-03-26T17:07:13.379 INFO:tasks.workunit.client.3.smithi157.stdout:myimage5 3/s 4/s 66 KiB/s 76 KiB/s 2.12 ms 326.64 us 2024-03-26T17:07:13.379 INFO:tasks.workunit.client.3.smithi157.stdout:myimage11 3/s 4/s 100 KiB/s 118 KiB/s 2.87 ms 371.09 us 2024-03-26T17:07:13.379 INFO:tasks.workunit.client.3.smithi157.stdout:myimage37 3/s 3/s 77 KiB/s 98 KiB/s 2.23 ms 353.69 us 2024-03-26T17:07:13.379 INFO:tasks.workunit.client.3.smithi157.stdout:myimage44 3/s 5/s 76 KiB/s 159 KiB/s 2.36 ms 333.50 us 2024-03-26T17:07:13.379 INFO:tasks.workunit.client.3.smithi157.stdout:myimage9 3/s 5/s 72 KiB/s 146 KiB/s 2.38 ms 399.99 us 2024-03-26T17:07:13.379 INFO:tasks.workunit.client.3.smithi157.stdout:myimage40 3/s 5/s 75 KiB/s 135 KiB/s 2.10 ms 354.24 us 2024-03-26T17:07:13.379 INFO:tasks.workunit.client.3.smithi157.stdout:myimage20 3/s 3/s 51 KiB/s 82 KiB/s 2.11 ms 388.55 us 2024-03-26T17:07:13.379 INFO:tasks.workunit.client.3.smithi157.stdout:myimage24 3/s 6/s 85 KiB/s 130 KiB/s 2.61 ms 365.99 us 2024-03-26T17:07:13.379 INFO:tasks.workunit.client.3.smithi157.stdout:myimage58 2/s 4/s 74 KiB/s 106 KiB/s 2.14 ms 385.45 us 2024-03-26T17:07:13.379 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:07:13.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:07:13 smithi149 ceph-mon[34678]: pgmap v639: 33 pgs: 33 active+clean; 1.0 GiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 5.8 MiB/s rd, 6.0 MiB/s wr, 532 op/s 2024-03-26T17:07:13.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:07:13 smithi044 ceph-mon[30624]: pgmap v639: 33 pgs: 33 active+clean; 1.0 GiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 5.8 MiB/s rd, 6.0 MiB/s wr, 532 op/s 2024-03-26T17:07:14.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:07:14 smithi149 ceph-mon[34678]: Health check update: 3 slow ops, oldest one blocked for 528 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:07:14.415 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:07:14 smithi044 ceph-mon[30624]: Health check update: 3 slow ops, oldest one blocked for 528 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:07:14.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:07:14 smithi064 ceph-mon[34420]: Health check update: 3 slow ops, oldest one blocked for 528 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:07:14.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:07:14 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:07:14] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:07:14.766 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:07:14 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:07:14] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:07:14.766 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:07:14 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:07:15.061 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:07:14 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:07:14] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:07:15.062 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:07:14 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:07:14] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:07:15.062 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:07:14 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:07:15.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:07:15 smithi149 ceph-mon[34678]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:07:15.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:07:15 smithi149 ceph-mon[34678]: { 2024-03-26T17:07:15.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:07:15 smithi149 ceph-mon[34678]: "prefix": "rbd perf image stats", 2024-03-26T17:07:15.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:07:15 smithi149 ceph-mon[34678]: "pool_spec": "mypool", 2024-03-26T17:07:15.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:07:15 smithi149 ceph-mon[34678]: "sort_by": "write_ops", 2024-03-26T17:07:15.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:07:15 smithi149 ceph-mon[34678]: "format": "json" 2024-03-26T17:07:15.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:07:15 smithi149 ceph-mon[34678]: }"]: dispatch 2024-03-26T17:07:15.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:07:15 smithi149 ceph-mon[34678]: pgmap v640: 33 pgs: 33 active+clean; 1.0 GiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 6.1 MiB/s rd, 6.3 MiB/s wr, 564 op/s 2024-03-26T17:07:15.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:07:15 smithi044 ceph-mon[30624]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:07:15.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:07:15 smithi044 ceph-mon[30624]: { 2024-03-26T17:07:15.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:07:15 smithi044 ceph-mon[30624]: "prefix": "rbd perf image stats", 2024-03-26T17:07:15.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:07:15 smithi044 ceph-mon[30624]: "pool_spec": "mypool", 2024-03-26T17:07:15.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:07:15 smithi044 ceph-mon[30624]: "sort_by": "write_ops", 2024-03-26T17:07:15.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:07:15 smithi044 ceph-mon[30624]: "format": "json" 2024-03-26T17:07:15.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:07:15 smithi044 ceph-mon[30624]: }"]: dispatch 2024-03-26T17:07:15.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:07:15 smithi044 ceph-mon[30624]: pgmap v640: 33 pgs: 33 active+clean; 1.0 GiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 6.1 MiB/s rd, 6.3 MiB/s wr, 564 op/s 2024-03-26T17:07:15.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:07:15 smithi064 ceph-mon[34420]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:07:15.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:07:15 smithi064 ceph-mon[34420]: { 2024-03-26T17:07:15.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:07:15 smithi064 ceph-mon[34420]: "prefix": "rbd perf image stats", 2024-03-26T17:07:15.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:07:15 smithi064 ceph-mon[34420]: "pool_spec": "mypool", 2024-03-26T17:07:15.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:07:15 smithi064 ceph-mon[34420]: "sort_by": "write_ops", 2024-03-26T17:07:15.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:07:15 smithi064 ceph-mon[34420]: "format": "json" 2024-03-26T17:07:15.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:07:15 smithi064 ceph-mon[34420]: }"]: dispatch 2024-03-26T17:07:15.557 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:07:15 smithi064 ceph-mon[34420]: pgmap v640: 33 pgs: 33 active+clean; 1.0 GiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 6.1 MiB/s rd, 6.3 MiB/s wr, 564 op/s 2024-03-26T17:07:16.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:07:16 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 2024-03-26T17:07:16.229+0000 7fa707a55700 -1 mon.c@1(peon) e3 get_health_metrics reporting 3 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T17:07:16.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:07:16 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:07:16] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:07:16.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:07:16 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:07:16] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:07:16.766 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:07:16 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:07:17.063 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:07:16 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:07:16] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:07:17.064 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:07:16 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:07:16] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:07:17.064 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:07:16 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:07:17.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:07:17 smithi149 ceph-mon[34678]: pgmap v641: 33 pgs: 33 active+clean; 1.0 GiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 6.0 MiB/s rd, 6.3 MiB/s wr, 567 op/s 2024-03-26T17:07:17.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:07:17 smithi044 ceph-mon[30624]: pgmap v641: 33 pgs: 33 active+clean; 1.0 GiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 6.0 MiB/s rd, 6.3 MiB/s wr, 567 op/s 2024-03-26T17:07:17.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:07:17 smithi064 ceph-mon[34420]: pgmap v641: 33 pgs: 33 active+clean; 1.0 GiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 6.0 MiB/s rd, 6.3 MiB/s wr, 567 op/s 2024-03-26T17:07:18.381 INFO:tasks.workunit.client.3.smithi157.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-26T17:07:18.381 INFO:tasks.workunit.client.3.smithi157.stdout:myimage29 6/s 3/s 168 KiB/s 65 KiB/s 2.08 ms 342.15 us 2024-03-26T17:07:18.381 INFO:tasks.workunit.client.3.smithi157.stdout:myimage32 5/s 3/s 138 KiB/s 78 KiB/s 2.31 ms 404.17 us 2024-03-26T17:07:18.381 INFO:tasks.workunit.client.3.smithi157.stdout:myimage52 5/s 3/s 90 KiB/s 71 KiB/s 2.50 ms 323.33 us 2024-03-26T17:07:18.381 INFO:tasks.workunit.client.3.smithi157.stdout:myimage7 5/s 3/s 120 KiB/s 57 KiB/s 2.45 ms 348.09 us 2024-03-26T17:07:18.381 INFO:tasks.workunit.client.3.smithi157.stdout:myimage18 5/s 3/s 119 KiB/s 103 KiB/s 2.09 ms 339.53 us 2024-03-26T17:07:18.381 INFO:tasks.workunit.client.3.smithi157.stdout:myimage46 5/s 3/s 102 KiB/s 70 KiB/s 2.18 ms 375.62 us 2024-03-26T17:07:18.381 INFO:tasks.workunit.client.3.smithi157.stdout:myimage54 5/s 3/s 95 KiB/s 58 KiB/s 2.20 ms 379.42 us 2024-03-26T17:07:18.381 INFO:tasks.workunit.client.3.smithi157.stdout:myimage16 5/s 3/s 104 KiB/s 54 KiB/s 2.10 ms 314.28 us 2024-03-26T17:07:18.382 INFO:tasks.workunit.client.3.smithi157.stdout:myimage6 5/s 5/s 96 KiB/s 98 KiB/s 2.30 ms 319.49 us 2024-03-26T17:07:18.382 INFO:tasks.workunit.client.3.smithi157.stdout:myimage30 5/s 3/s 79 KiB/s 81 KiB/s 2.86 ms 312.72 us 2024-03-26T17:07:18.382 INFO:tasks.workunit.client.3.smithi157.stdout:myimage11 5/s 3/s 114 KiB/s 109 KiB/s 2.27 ms 305.81 us 2024-03-26T17:07:18.382 INFO:tasks.workunit.client.3.smithi157.stdout:myimage41 5/s 2/s 106 KiB/s 54 KiB/s 2.63 ms 324.00 us 2024-03-26T17:07:18.382 INFO:tasks.workunit.client.3.smithi157.stdout:myimage31 5/s 3/s 102 KiB/s 91 KiB/s 2.52 ms 342.44 us 2024-03-26T17:07:18.382 INFO:tasks.workunit.client.3.smithi157.stdout:myimage12 5/s 4/s 130 KiB/s 99 KiB/s 2.19 ms 366.54 us 2024-03-26T17:07:18.382 INFO:tasks.workunit.client.3.smithi157.stdout:myimage21 5/s 4/s 100 KiB/s 95 KiB/s 2.85 ms 318.82 us 2024-03-26T17:07:18.382 INFO:tasks.workunit.client.3.smithi157.stdout:myimage59 5/s 4/s 114 KiB/s 87 KiB/s 2.35 ms 403.38 us 2024-03-26T17:07:18.382 INFO:tasks.workunit.client.3.smithi157.stdout:myimage2 4/s 3/s 102 KiB/s 85 KiB/s 2.50 ms 451.12 us 2024-03-26T17:07:18.382 INFO:tasks.workunit.client.3.smithi157.stdout:myimage3 4/s 4/s 97 KiB/s 87 KiB/s 1.97 ms 409.43 us 2024-03-26T17:07:18.383 INFO:tasks.workunit.client.3.smithi157.stdout:myimage37 4/s 4/s 100 KiB/s 83 KiB/s 2.24 ms 420.67 us 2024-03-26T17:07:18.383 INFO:tasks.workunit.client.3.smithi157.stdout:myimage1 4/s 4/s 114 KiB/s 86 KiB/s 1.97 ms 356.91 us 2024-03-26T17:07:18.383 INFO:tasks.workunit.client.3.smithi157.stdout:myimage51 4/s 3/s 125 KiB/s 62 KiB/s 2.44 ms 304.75 us 2024-03-26T17:07:18.383 INFO:tasks.workunit.client.3.smithi157.stdout:myimage55 4/s 5/s 114 KiB/s 149 KiB/s 2.53 ms 397.66 us 2024-03-26T17:07:18.383 INFO:tasks.workunit.client.3.smithi157.stdout:myimage13 4/s 4/s 79 KiB/s 96 KiB/s 2.04 ms 399.89 us 2024-03-26T17:07:18.383 INFO:tasks.workunit.client.3.smithi157.stdout:myimage58 4/s 5/s 80 KiB/s 116 KiB/s 1.99 ms 292.55 us 2024-03-26T17:07:18.383 INFO:tasks.workunit.client.3.smithi157.stdout:myimage5 4/s 4/s 94 KiB/s 98 KiB/s 2.25 ms 323.81 us 2024-03-26T17:07:18.383 INFO:tasks.workunit.client.3.smithi157.stdout:myimage9 4/s 4/s 82 KiB/s 120 KiB/s 2.47 ms 517.84 us 2024-03-26T17:07:18.383 INFO:tasks.workunit.client.3.smithi157.stdout:myimage28 4/s 4/s 100 KiB/s 97 KiB/s 2.99 ms 420.54 us 2024-03-26T17:07:18.383 INFO:tasks.workunit.client.3.smithi157.stdout:myimage35 4/s 4/s 82 KiB/s 101 KiB/s 2.16 ms 310.06 us 2024-03-26T17:07:18.383 INFO:tasks.workunit.client.3.smithi157.stdout:myimage40 4/s 5/s 82 KiB/s 122 KiB/s 2.09 ms 345.93 us 2024-03-26T17:07:18.383 INFO:tasks.workunit.client.3.smithi157.stdout:myimage44 4/s 4/s 101 KiB/s 83 KiB/s 2.23 ms 399.76 us 2024-03-26T17:07:18.383 INFO:tasks.workunit.client.3.smithi157.stdout:myimage47 4/s 4/s 111 KiB/s 73 KiB/s 2.33 ms 339.12 us 2024-03-26T17:07:18.383 INFO:tasks.workunit.client.3.smithi157.stdout:myimage8 4/s 5/s 89 KiB/s 102 KiB/s 2.32 ms 336.81 us 2024-03-26T17:07:18.383 INFO:tasks.workunit.client.3.smithi157.stdout:myimage17 4/s 4/s 78 KiB/s 128 KiB/s 2.31 ms 375.21 us 2024-03-26T17:07:18.384 INFO:tasks.workunit.client.3.smithi157.stdout:myimage56 4/s 5/s 80 KiB/s 93 KiB/s 2.50 ms 432.97 us 2024-03-26T17:07:18.384 INFO:tasks.workunit.client.3.smithi157.stdout:myimage10 4/s 4/s 95 KiB/s 85 KiB/s 2.22 ms 378.22 us 2024-03-26T17:07:18.384 INFO:tasks.workunit.client.3.smithi157.stdout:myimage23 4/s 4/s 77 KiB/s 75 KiB/s 1.95 ms 307.44 us 2024-03-26T17:07:18.384 INFO:tasks.workunit.client.3.smithi157.stdout:myimage19 4/s 4/s 98 KiB/s 117 KiB/s 2.35 ms 358.76 us 2024-03-26T17:07:18.384 INFO:tasks.workunit.client.3.smithi157.stdout:myimage43 4/s 2/s 76 KiB/s 73 KiB/s 2.46 ms 528.49 us 2024-03-26T17:07:18.384 INFO:tasks.workunit.client.3.smithi157.stdout:myimage57 4/s 3/s 95 KiB/s 94 KiB/s 2.13 ms 343.82 us 2024-03-26T17:07:18.384 INFO:tasks.workunit.client.3.smithi157.stdout:myimage38 4/s 4/s 84 KiB/s 78 KiB/s 1.86 ms 409.89 us 2024-03-26T17:07:18.384 INFO:tasks.workunit.client.3.smithi157.stdout:myimage49 4/s 4/s 122 KiB/s 93 KiB/s 2.35 ms 382.64 us 2024-03-26T17:07:18.384 INFO:tasks.workunit.client.3.smithi157.stdout:myimage20 4/s 5/s 96 KiB/s 102 KiB/s 2.28 ms 322.61 us 2024-03-26T17:07:18.384 INFO:tasks.workunit.client.3.smithi157.stdout:myimage26 4/s 5/s 73 KiB/s 98 KiB/s 2.27 ms 349.70 us 2024-03-26T17:07:18.384 INFO:tasks.workunit.client.3.smithi157.stdout:myimage33 4/s 4/s 55 KiB/s 91 KiB/s 2.21 ms 421.47 us 2024-03-26T17:07:18.384 INFO:tasks.workunit.client.3.smithi157.stdout:myimage36 4/s 3/s 110 KiB/s 35 KiB/s 2.21 ms 337.99 us 2024-03-26T17:07:18.384 INFO:tasks.workunit.client.3.smithi157.stdout:myimage53 4/s 4/s 83 KiB/s 98 KiB/s 2.25 ms 432.82 us 2024-03-26T17:07:18.384 INFO:tasks.workunit.client.3.smithi157.stdout:myimage14 3/s 5/s 79 KiB/s 128 KiB/s 2.35 ms 467.64 us 2024-03-26T17:07:18.384 INFO:tasks.workunit.client.3.smithi157.stdout:myimage4 3/s 4/s 97 KiB/s 89 KiB/s 2.23 ms 312.71 us 2024-03-26T17:07:18.385 INFO:tasks.workunit.client.3.smithi157.stdout:myimage24 3/s 4/s 88 KiB/s 117 KiB/s 2.52 ms 419.25 us 2024-03-26T17:07:18.385 INFO:tasks.workunit.client.3.smithi157.stdout:myimage27 3/s 4/s 91 KiB/s 91 KiB/s 2.04 ms 307.24 us 2024-03-26T17:07:18.385 INFO:tasks.workunit.client.3.smithi157.stdout:myimage42 3/s 4/s 78 KiB/s 95 KiB/s 2.24 ms 406.04 us 2024-03-26T17:07:18.385 INFO:tasks.workunit.client.3.smithi157.stdout:myimage50 3/s 5/s 82 KiB/s 94 KiB/s 2.30 ms 337.42 us 2024-03-26T17:07:18.385 INFO:tasks.workunit.client.3.smithi157.stdout:myimage15 3/s 5/s 74 KiB/s 118 KiB/s 2.02 ms 335.12 us 2024-03-26T17:07:18.385 INFO:tasks.workunit.client.3.smithi157.stdout:myimage25 3/s 3/s 72 KiB/s 82 KiB/s 2.79 ms 349.08 us 2024-03-26T17:07:18.385 INFO:tasks.workunit.client.3.smithi157.stdout:myimage39 3/s 5/s 73 KiB/s 119 KiB/s 2.09 ms 368.25 us 2024-03-26T17:07:18.385 INFO:tasks.workunit.client.3.smithi157.stdout:myimage34 3/s 5/s 87 KiB/s 137 KiB/s 2.15 ms 401.88 us 2024-03-26T17:07:18.385 INFO:tasks.workunit.client.3.smithi157.stdout:myimage60 3/s 5/s 79 KiB/s 102 KiB/s 2.42 ms 309.22 us 2024-03-26T17:07:18.385 INFO:tasks.workunit.client.3.smithi157.stdout:myimage22 3/s 5/s 92 KiB/s 112 KiB/s 2.09 ms 323.14 us 2024-03-26T17:07:18.385 INFO:tasks.workunit.client.3.smithi157.stdout:myimage45 3/s 5/s 43 KiB/s 120 KiB/s 2.15 ms 417.64 us 2024-03-26T17:07:18.385 INFO:tasks.workunit.client.3.smithi157.stdout:myimage48 2/s 6/s 37 KiB/s 125 KiB/s 1.98 ms 301.17 us 2024-03-26T17:07:18.385 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:07:18.766 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:07:18 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:07:18] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:07:18.766 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:07:18 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:07:18] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:07:18.766 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:07:18 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:07:19.065 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:07:18 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:07:18] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:07:19.065 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:07:18 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:07:18] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:07:19.066 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:07:18 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:07:19.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:07:19 smithi149 ceph-mon[34678]: pgmap v642: 33 pgs: 33 active+clean; 1.0 GiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 5.5 MiB/s rd, 5.7 MiB/s wr, 523 op/s 2024-03-26T17:07:19.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:07:19 smithi149 ceph-mon[34678]: Health check update: 3 slow ops, oldest one blocked for 533 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:07:19.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:07:19 smithi044 ceph-mon[30624]: pgmap v642: 33 pgs: 33 active+clean; 1.0 GiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 5.5 MiB/s rd, 5.7 MiB/s wr, 523 op/s 2024-03-26T17:07:19.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:07:19 smithi044 ceph-mon[30624]: Health check update: 3 slow ops, oldest one blocked for 533 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:07:19.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:07:19 smithi064 ceph-mon[34420]: pgmap v642: 33 pgs: 33 active+clean; 1.0 GiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 5.5 MiB/s rd, 5.7 MiB/s wr, 523 op/s 2024-03-26T17:07:19.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:07:19 smithi064 ceph-mon[34420]: Health check update: 3 slow ops, oldest one blocked for 533 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:07:20.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:07:20 smithi149 ceph-mon[34678]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:07:20.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:07:20 smithi149 ceph-mon[34678]: { 2024-03-26T17:07:20.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:07:20 smithi149 ceph-mon[34678]: "prefix": "rbd perf image stats", 2024-03-26T17:07:20.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:07:20 smithi149 ceph-mon[34678]: "pool_spec": "mypool", 2024-03-26T17:07:20.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:07:20 smithi149 ceph-mon[34678]: "sort_by": "write_ops", 2024-03-26T17:07:20.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:07:20 smithi149 ceph-mon[34678]: "format": "json" 2024-03-26T17:07:20.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:07:20 smithi149 ceph-mon[34678]: }"]: dispatch 2024-03-26T17:07:20.452 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:07:20 smithi044 ceph-mon[30624]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:07:20.452 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:07:20 smithi044 ceph-mon[30624]: { 2024-03-26T17:07:20.452 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:07:20 smithi044 ceph-mon[30624]: "prefix": "rbd perf image stats", 2024-03-26T17:07:20.452 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:07:20 smithi044 ceph-mon[30624]: "pool_spec": "mypool", 2024-03-26T17:07:20.452 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:07:20 smithi044 ceph-mon[30624]: "sort_by": "write_ops", 2024-03-26T17:07:20.452 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:07:20 smithi044 ceph-mon[30624]: "format": "json" 2024-03-26T17:07:20.452 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:07:20 smithi044 ceph-mon[30624]: }"]: dispatch 2024-03-26T17:07:20.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:07:20 smithi064 ceph-mon[34420]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:07:20.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:07:20 smithi064 ceph-mon[34420]: { 2024-03-26T17:07:20.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:07:20 smithi064 ceph-mon[34420]: "prefix": "rbd perf image stats", 2024-03-26T17:07:20.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:07:20 smithi064 ceph-mon[34420]: "pool_spec": "mypool", 2024-03-26T17:07:20.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:07:20 smithi064 ceph-mon[34420]: "sort_by": "write_ops", 2024-03-26T17:07:20.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:07:20 smithi064 ceph-mon[34420]: "format": "json" 2024-03-26T17:07:20.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:07:20 smithi064 ceph-mon[34420]: }"]: dispatch 2024-03-26T17:07:20.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:07:20 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:07:20] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:07:20.766 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:07:20 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:07:20] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:07:20.766 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:07:20 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:07:21.072 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:07:20 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:07:20] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:07:21.073 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:07:20 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:07:20] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:07:21.073 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:07:20 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:07:21.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:07:21 smithi149 ceph-mon[34678]: pgmap v643: 33 pgs: 33 active+clean; 1.0 GiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 5.4 MiB/s rd, 5.4 MiB/s wr, 508 op/s 2024-03-26T17:07:21.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:07:21 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 2024-03-26T17:07:21.231+0000 7fa707a55700 -1 mon.c@1(peon) e3 get_health_metrics reporting 3 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T17:07:21.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:07:21 smithi044 ceph-mon[30624]: pgmap v643: 33 pgs: 33 active+clean; 1.0 GiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 5.4 MiB/s rd, 5.4 MiB/s wr, 508 op/s 2024-03-26T17:07:21.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:07:21 smithi064 ceph-mon[34420]: pgmap v643: 33 pgs: 33 active+clean; 1.0 GiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 5.4 MiB/s rd, 5.4 MiB/s wr, 508 op/s 2024-03-26T17:07:22.766 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:07:22 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:07:22] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:07:22.766 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:07:22 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:07:22] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:07:22.766 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:07:22 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:07:23.062 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:07:23.070 INFO:tasks.workunit.client.3.smithi157.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2024-03-26T17:07:23.070 INFO:tasks.workunit.client.3.smithi157.stdout: 8.90 82.0k 83.6k 0.0k 820.0k 836.0k 0.0k nvme2n1 2024-03-26T17:07:23.071 INFO:tasks.workunit.client.3.smithi157.stdout: 8.80 87.2k 94.0k 0.0k 872.0k 940.0k 0.0k nvme2n10 2024-03-26T17:07:23.071 INFO:tasks.workunit.client.3.smithi157.stdout: 8.80 90.4k 92.8k 0.0k 904.0k 928.0k 0.0k nvme2n11 2024-03-26T17:07:23.071 INFO:tasks.workunit.client.3.smithi157.stdout: 8.80 86.8k 111.2k 0.0k 868.0k 1.1M 0.0k nvme2n12 2024-03-26T17:07:23.071 INFO:tasks.workunit.client.3.smithi157.stdout: 8.80 94.0k 105.6k 0.0k 940.0k 1.0M 0.0k nvme2n13 2024-03-26T17:07:23.071 INFO:tasks.workunit.client.3.smithi157.stdout: 8.90 112.0k 102.0k 0.0k 1.1M 1020.0k 0.0k nvme2n14 2024-03-26T17:07:23.071 INFO:tasks.workunit.client.3.smithi157.stdout: 8.90 100.0k 96.8k 0.0k 1000.0k 968.0k 0.0k nvme2n15 2024-03-26T17:07:23.071 INFO:tasks.workunit.client.3.smithi157.stdout: 8.90 106.8k 90.8k 0.0k 1.0M 908.0k 0.0k nvme2n16 2024-03-26T17:07:23.071 INFO:tasks.workunit.client.3.smithi157.stdout: 8.90 98.8k 81.2k 0.0k 988.0k 812.0k 0.0k nvme2n17 2024-03-26T17:07:23.071 INFO:tasks.workunit.client.3.smithi157.stdout: 8.90 117.2k 92.8k 0.0k 1.1M 928.0k 0.0k nvme2n18 2024-03-26T17:07:23.071 INFO:tasks.workunit.client.3.smithi157.stdout: 8.90 99.2k 94.0k 0.0k 992.0k 940.0k 0.0k nvme2n19 2024-03-26T17:07:23.071 INFO:tasks.workunit.client.3.smithi157.stdout: 8.90 102.0k 79.2k 0.0k 1020.0k 792.0k 0.0k nvme2n2 2024-03-26T17:07:23.071 INFO:tasks.workunit.client.3.smithi157.stdout: 8.90 84.0k 81.2k 0.0k 840.0k 812.0k 0.0k nvme2n20 2024-03-26T17:07:23.071 INFO:tasks.workunit.client.3.smithi157.stdout: 8.90 82.4k 99.6k 0.0k 824.0k 996.0k 0.0k nvme2n3 2024-03-26T17:07:23.072 INFO:tasks.workunit.client.3.smithi157.stdout: 8.90 82.4k 96.8k 0.0k 824.0k 968.0k 0.0k nvme2n4 2024-03-26T17:07:23.072 INFO:tasks.workunit.client.3.smithi157.stdout: 8.90 116.8k 79.6k 0.0k 1.1M 796.0k 0.0k nvme2n5 2024-03-26T17:07:23.072 INFO:tasks.workunit.client.3.smithi157.stdout: 8.90 95.2k 70.0k 0.0k 952.0k 700.0k 0.0k nvme2n6 2024-03-26T17:07:23.072 INFO:tasks.workunit.client.3.smithi157.stdout: 8.90 76.8k 105.2k 0.0k 768.0k 1.0M 0.0k nvme2n7 2024-03-26T17:07:23.072 INFO:tasks.workunit.client.3.smithi157.stdout: 8.90 113.6k 61.6k 0.0k 1.1M 616.0k 0.0k nvme2n8 2024-03-26T17:07:23.072 INFO:tasks.workunit.client.3.smithi157.stdout: 8.80 90.0k 66.4k 0.0k 900.0k 664.0k 0.0k nvme2n9 2024-03-26T17:07:23.072 INFO:tasks.workunit.client.3.smithi157.stdout: 8.90 81.6k 95.6k 0.0k 816.0k 956.0k 0.0k nvme5n1 2024-03-26T17:07:23.072 INFO:tasks.workunit.client.3.smithi157.stdout: 8.80 84.8k 82.4k 0.0k 848.0k 824.0k 0.0k nvme5n10 2024-03-26T17:07:23.072 INFO:tasks.workunit.client.3.smithi157.stdout: 8.80 100.0k 94.4k 0.0k 1000.0k 944.0k 0.0k nvme5n11 2024-03-26T17:07:23.072 INFO:tasks.workunit.client.3.smithi157.stdout: 8.80 93.6k 106.0k 0.0k 936.0k 1.0M 0.0k nvme5n12 2024-03-26T17:07:23.072 INFO:tasks.workunit.client.3.smithi157.stdout: 8.80 96.8k 78.8k 0.0k 968.0k 788.0k 0.0k nvme5n13 2024-03-26T17:07:23.072 INFO:tasks.workunit.client.3.smithi157.stdout: 8.80 88.4k 121.2k 0.0k 884.0k 1.2M 0.0k nvme5n14 2024-03-26T17:07:23.072 INFO:tasks.workunit.client.3.smithi157.stdout: 8.90 106.4k 91.6k 0.0k 1.0M 916.0k 0.0k nvme5n15 2024-03-26T17:07:23.072 INFO:tasks.workunit.client.3.smithi157.stdout: 8.90 82.8k 90.0k 0.0k 828.0k 900.0k 0.0k nvme5n16 2024-03-26T17:07:23.073 INFO:tasks.workunit.client.3.smithi157.stdout: 8.90 71.2k 108.4k 0.0k 712.0k 1.1M 0.0k nvme5n17 2024-03-26T17:07:23.073 INFO:tasks.workunit.client.3.smithi157.stdout: 8.90 104.4k 79.2k 0.0k 1.0M 792.0k 0.0k nvme5n18 2024-03-26T17:07:23.073 INFO:tasks.workunit.client.3.smithi157.stdout: 8.90 107.2k 83.6k 0.0k 1.0M 836.0k 0.0k nvme5n19 2024-03-26T17:07:23.073 INFO:tasks.workunit.client.3.smithi157.stdout: 8.90 113.6k 75.2k 0.0k 1.1M 752.0k 0.0k nvme5n2 2024-03-26T17:07:23.073 INFO:tasks.workunit.client.3.smithi157.stdout: 8.90 108.8k 99.6k 0.0k 1.1M 996.0k 0.0k nvme5n20 2024-03-26T17:07:23.073 INFO:tasks.workunit.client.3.smithi157.stdout: 8.90 98.0k 100.4k 0.0k 980.0k 1004.0k 0.0k nvme5n3 2024-03-26T17:07:23.073 INFO:tasks.workunit.client.3.smithi157.stdout: 8.90 85.2k 137.6k 0.0k 852.0k 1.3M 0.0k nvme5n4 2024-03-26T17:07:23.073 INFO:tasks.workunit.client.3.smithi157.stdout: 8.90 96.8k 92.0k 0.0k 968.0k 920.0k 0.0k nvme5n5 2024-03-26T17:07:23.073 INFO:tasks.workunit.client.3.smithi157.stdout: 8.90 104.0k 95.6k 0.0k 1.0M 956.0k 0.0k nvme5n6 2024-03-26T17:07:23.073 INFO:tasks.workunit.client.3.smithi157.stdout: 8.90 85.2k 86.4k 0.0k 852.0k 864.0k 0.0k nvme5n7 2024-03-26T17:07:23.073 INFO:tasks.workunit.client.3.smithi157.stdout: 8.90 121.6k 86.8k 0.0k 1.2M 868.0k 0.0k nvme5n8 2024-03-26T17:07:23.073 INFO:tasks.workunit.client.3.smithi157.stdout: 8.80 81.6k 107.2k 0.0k 816.0k 1.0M 0.0k nvme5n9 2024-03-26T17:07:23.073 INFO:tasks.workunit.client.3.smithi157.stdout: 8.90 86.8k 101.2k 0.0k 868.0k 1012.0k 0.0k nvme8n1 2024-03-26T17:07:23.073 INFO:tasks.workunit.client.3.smithi157.stdout: 8.80 78.8k 94.0k 0.0k 788.0k 940.0k 0.0k nvme8n10 2024-03-26T17:07:23.074 INFO:tasks.workunit.client.3.smithi157.stdout: 8.80 74.8k 80.8k 0.0k 748.0k 808.0k 0.0k nvme8n11 2024-03-26T17:07:23.074 INFO:tasks.workunit.client.3.smithi157.stdout: 8.80 105.6k 77.6k 0.0k 1.0M 776.0k 0.0k nvme8n12 2024-03-26T17:07:23.074 INFO:tasks.workunit.client.3.smithi157.stdout: 8.80 102.8k 66.4k 0.0k 1.0M 664.0k 0.0k nvme8n13 2024-03-26T17:07:23.074 INFO:tasks.workunit.client.3.smithi157.stdout: 8.90 72.0k 86.0k 0.0k 720.0k 860.0k 0.0k nvme8n14 2024-03-26T17:07:23.074 INFO:tasks.workunit.client.3.smithi157.stdout: 8.90 72.8k 127.2k 0.0k 728.0k 1.2M 0.0k nvme8n15 2024-03-26T17:07:23.074 INFO:tasks.workunit.client.3.smithi157.stdout: 8.90 108.4k 82.8k 0.0k 1.1M 828.0k 0.0k nvme8n16 2024-03-26T17:07:23.074 INFO:tasks.workunit.client.3.smithi157.stdout: 8.90 108.0k 70.0k 0.0k 1.1M 700.0k 0.0k nvme8n17 2024-03-26T17:07:23.074 INFO:tasks.workunit.client.3.smithi157.stdout: 8.90 102.8k 80.4k 0.0k 1.0M 804.0k 0.0k nvme8n18 2024-03-26T17:07:23.074 INFO:tasks.workunit.client.3.smithi157.stdout: 8.90 80.0k 111.2k 0.0k 800.0k 1.1M 0.0k nvme8n19 2024-03-26T17:07:23.074 INFO:tasks.workunit.client.3.smithi157.stdout: 8.90 88.8k 108.4k 0.0k 888.0k 1.1M 0.0k nvme8n2 2024-03-26T17:07:23.074 INFO:tasks.workunit.client.3.smithi157.stdout: 8.90 100.0k 75.2k 0.0k 1000.0k 752.0k 0.0k nvme8n20 2024-03-26T17:07:23.074 INFO:tasks.workunit.client.3.smithi157.stdout: 8.90 77.6k 110.0k 0.0k 776.0k 1.1M 0.0k nvme8n3 2024-03-26T17:07:23.074 INFO:tasks.workunit.client.3.smithi157.stdout: 8.90 128.8k 77.2k 0.0k 1.3M 772.0k 0.0k nvme8n4 2024-03-26T17:07:23.074 INFO:tasks.workunit.client.3.smithi157.stdout: 8.90 90.4k 89.2k 0.0k 904.0k 892.0k 0.0k nvme8n5 2024-03-26T17:07:23.075 INFO:tasks.workunit.client.3.smithi157.stdout: 8.90 98.0k 90.4k 0.0k 980.0k 904.0k 0.0k nvme8n6 2024-03-26T17:07:23.075 INFO:tasks.workunit.client.3.smithi157.stdout: 8.90 66.8k 114.8k 0.0k 668.0k 1.1M 0.0k nvme8n7 2024-03-26T17:07:23.075 INFO:tasks.workunit.client.3.smithi157.stdout: 8.90 83.6k 70.4k 0.0k 836.0k 704.0k 0.0k nvme8n8 2024-03-26T17:07:23.075 INFO:tasks.workunit.client.3.smithi157.stdout: 8.80 101.2k 112.0k 0.0k 1012.0k 1.1M 0.0k nvme8n9 2024-03-26T17:07:23.075 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:07:23.076 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:07:22 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:07:22] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:07:23.076 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:07:22 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:07:22] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:07:23.076 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:07:22 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:07:23.387 INFO:tasks.workunit.client.3.smithi157.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-26T17:07:23.387 INFO:tasks.workunit.client.3.smithi157.stdout:myimage24 6/s 3/s 153 KiB/s 78 KiB/s 2.43 ms 303.77 us 2024-03-26T17:07:23.387 INFO:tasks.workunit.client.3.smithi157.stdout:myimage50 6/s 4/s 134 KiB/s 74 KiB/s 2.25 ms 345.21 us 2024-03-26T17:07:23.387 INFO:tasks.workunit.client.3.smithi157.stdout:myimage43 6/s 4/s 142 KiB/s 86 KiB/s 2.49 ms 355.01 us 2024-03-26T17:07:23.387 INFO:tasks.workunit.client.3.smithi157.stdout:myimage34 5/s 3/s 170 KiB/s 64 KiB/s 2.11 ms 329.70 us 2024-03-26T17:07:23.387 INFO:tasks.workunit.client.3.smithi157.stdout:myimage37 5/s 3/s 114 KiB/s 71 KiB/s 2.45 ms 347.81 us 2024-03-26T17:07:23.387 INFO:tasks.workunit.client.3.smithi157.stdout:myimage7 5/s 4/s 122 KiB/s 98 KiB/s 2.28 ms 377.87 us 2024-03-26T17:07:23.388 INFO:tasks.workunit.client.3.smithi157.stdout:myimage41 5/s 4/s 122 KiB/s 110 KiB/s 2.30 ms 322.50 us 2024-03-26T17:07:23.388 INFO:tasks.workunit.client.3.smithi157.stdout:myimage13 5/s 3/s 131 KiB/s 89 KiB/s 1.96 ms 365.57 us 2024-03-26T17:07:23.388 INFO:tasks.workunit.client.3.smithi157.stdout:myimage17 5/s 4/s 110 KiB/s 105 KiB/s 2.33 ms 342.18 us 2024-03-26T17:07:23.388 INFO:tasks.workunit.client.3.smithi157.stdout:myimage20 5/s 4/s 92 KiB/s 86 KiB/s 2.42 ms 313.22 us 2024-03-26T17:07:23.388 INFO:tasks.workunit.client.3.smithi157.stdout:myimage47 5/s 3/s 120 KiB/s 55 KiB/s 2.60 ms 378.65 us 2024-03-26T17:07:23.388 INFO:tasks.workunit.client.3.smithi157.stdout:myimage15 5/s 4/s 106 KiB/s 89 KiB/s 2.23 ms 337.50 us 2024-03-26T17:07:23.388 INFO:tasks.workunit.client.3.smithi157.stdout:myimage27 5/s 5/s 119 KiB/s 81 KiB/s 2.06 ms 309.65 us 2024-03-26T17:07:23.388 INFO:tasks.workunit.client.3.smithi157.stdout:myimage55 5/s 3/s 126 KiB/s 53 KiB/s 2.15 ms 319.82 us 2024-03-26T17:07:23.388 INFO:tasks.workunit.client.3.smithi157.stdout:myimage30 5/s 4/s 106 KiB/s 63 KiB/s 2.91 ms 413.24 us 2024-03-26T17:07:23.388 INFO:tasks.workunit.client.3.smithi157.stdout:myimage60 5/s 4/s 83 KiB/s 95 KiB/s 2.54 ms 331.03 us 2024-03-26T17:07:23.388 INFO:tasks.workunit.client.3.smithi157.stdout:myimage3 4/s 4/s 99 KiB/s 76 KiB/s 2.02 ms 375.09 us 2024-03-26T17:07:23.388 INFO:tasks.workunit.client.3.smithi157.stdout:myimage31 4/s 4/s 78 KiB/s 126 KiB/s 2.60 ms 344.16 us 2024-03-26T17:07:23.388 INFO:tasks.workunit.client.3.smithi157.stdout:myimage40 4/s 3/s 120 KiB/s 91 KiB/s 2.14 ms 368.43 us 2024-03-26T17:07:23.388 INFO:tasks.workunit.client.3.smithi157.stdout:myimage42 4/s 4/s 102 KiB/s 127 KiB/s 2.20 ms 341.38 us 2024-03-26T17:07:23.388 INFO:tasks.workunit.client.3.smithi157.stdout:myimage45 4/s 4/s 90 KiB/s 97 KiB/s 2.08 ms 313.80 us 2024-03-26T17:07:23.388 INFO:tasks.workunit.client.3.smithi157.stdout:myimage46 4/s 4/s 98 KiB/s 102 KiB/s 2.14 ms 432.54 us 2024-03-26T17:07:23.389 INFO:tasks.workunit.client.3.smithi157.stdout:myimage22 4/s 5/s 83 KiB/s 109 KiB/s 2.55 ms 379.59 us 2024-03-26T17:07:23.389 INFO:tasks.workunit.client.3.smithi157.stdout:myimage32 4/s 4/s 113 KiB/s 104 KiB/s 2.41 ms 386.11 us 2024-03-26T17:07:23.389 INFO:tasks.workunit.client.3.smithi157.stdout:myimage35 4/s 4/s 114 KiB/s 114 KiB/s 2.35 ms 410.40 us 2024-03-26T17:07:23.389 INFO:tasks.workunit.client.3.smithi157.stdout:myimage25 4/s 4/s 106 KiB/s 102 KiB/s 2.82 ms 365.43 us 2024-03-26T17:07:23.389 INFO:tasks.workunit.client.3.smithi157.stdout:myimage29 4/s 3/s 71 KiB/s 90 KiB/s 1.98 ms 381.18 us 2024-03-26T17:07:23.389 INFO:tasks.workunit.client.3.smithi157.stdout:myimage14 4/s 4/s 115 KiB/s 98 KiB/s 2.34 ms 349.84 us 2024-03-26T17:07:23.389 INFO:tasks.workunit.client.3.smithi157.stdout:myimage23 4/s 5/s 93 KiB/s 124 KiB/s 1.82 ms 465.08 us 2024-03-26T17:07:23.389 INFO:tasks.workunit.client.3.smithi157.stdout:myimage26 4/s 4/s 103 KiB/s 114 KiB/s 2.34 ms 358.62 us 2024-03-26T17:07:23.389 INFO:tasks.workunit.client.3.smithi157.stdout:myimage53 4/s 4/s 78 KiB/s 101 KiB/s 2.10 ms 286.35 us 2024-03-26T17:07:23.389 INFO:tasks.workunit.client.3.smithi157.stdout:myimage54 4/s 4/s 77 KiB/s 89 KiB/s 2.27 ms 369.74 us 2024-03-26T17:07:23.389 INFO:tasks.workunit.client.3.smithi157.stdout:myimage59 4/s 3/s 87 KiB/s 76 KiB/s 2.42 ms 335.23 us 2024-03-26T17:07:23.389 INFO:tasks.workunit.client.3.smithi157.stdout:myimage48 4/s 3/s 86 KiB/s 52 KiB/s 2.30 ms 284.54 us 2024-03-26T17:07:23.389 INFO:tasks.workunit.client.3.smithi157.stdout:myimage11 4/s 5/s 92 KiB/s 86 KiB/s 2.49 ms 355.11 us 2024-03-26T17:07:23.389 INFO:tasks.workunit.client.3.smithi157.stdout:myimage18 4/s 5/s 116 KiB/s 132 KiB/s 2.36 ms 355.40 us 2024-03-26T17:07:23.390 INFO:tasks.workunit.client.3.smithi157.stdout:myimage33 4/s 5/s 88 KiB/s 107 KiB/s 2.25 ms 333.25 us 2024-03-26T17:07:23.390 INFO:tasks.workunit.client.3.smithi157.stdout:myimage52 4/s 4/s 74 KiB/s 122 KiB/s 2.91 ms 340.21 us 2024-03-26T17:07:23.390 INFO:tasks.workunit.client.3.smithi157.stdout:myimage5 4/s 4/s 63 KiB/s 122 KiB/s 1.98 ms 368.23 us 2024-03-26T17:07:23.390 INFO:tasks.workunit.client.3.smithi157.stdout:myimage12 4/s 5/s 97 KiB/s 95 KiB/s 2.28 ms 323.65 us 2024-03-26T17:07:23.390 INFO:tasks.workunit.client.3.smithi157.stdout:myimage21 4/s 4/s 66 KiB/s 78 KiB/s 2.88 ms 351.35 us 2024-03-26T17:07:23.390 INFO:tasks.workunit.client.3.smithi157.stdout:myimage39 4/s 5/s 83 KiB/s 119 KiB/s 2.28 ms 349.60 us 2024-03-26T17:07:23.390 INFO:tasks.workunit.client.3.smithi157.stdout:myimage10 4/s 4/s 93 KiB/s 106 KiB/s 2.15 ms 341.93 us 2024-03-26T17:07:23.390 INFO:tasks.workunit.client.3.smithi157.stdout:myimage2 3/s 4/s 71 KiB/s 88 KiB/s 2.33 ms 363.85 us 2024-03-26T17:07:23.390 INFO:tasks.workunit.client.3.smithi157.stdout:myimage16 3/s 6/s 98 KiB/s 125 KiB/s 2.28 ms 329.58 us 2024-03-26T17:07:23.390 INFO:tasks.workunit.client.3.smithi157.stdout:myimage49 3/s 5/s 94 KiB/s 118 KiB/s 2.24 ms 401.06 us 2024-03-26T17:07:23.390 INFO:tasks.workunit.client.3.smithi157.stdout:myimage4 3/s 3/s 55 KiB/s 83 KiB/s 2.27 ms 363.55 us 2024-03-26T17:07:23.390 INFO:tasks.workunit.client.3.smithi157.stdout:myimage19 3/s 4/s 84 KiB/s 109 KiB/s 2.34 ms 326.34 us 2024-03-26T17:07:23.390 INFO:tasks.workunit.client.3.smithi157.stdout:myimage36 3/s 5/s 85 KiB/s 100 KiB/s 2.16 ms 347.64 us 2024-03-26T17:07:23.390 INFO:tasks.workunit.client.3.smithi157.stdout:myimage57 3/s 5/s 53 KiB/s 114 KiB/s 2.17 ms 334.15 us 2024-03-26T17:07:23.391 INFO:tasks.workunit.client.3.smithi157.stdout:myimage38 3/s 5/s 85 KiB/s 107 KiB/s 1.87 ms 285.73 us 2024-03-26T17:07:23.391 INFO:tasks.workunit.client.3.smithi157.stdout:myimage44 3/s 5/s 80 KiB/s 134 KiB/s 2.28 ms 411.38 us 2024-03-26T17:07:23.391 INFO:tasks.workunit.client.3.smithi157.stdout:myimage58 3/s 5/s 74 KiB/s 102 KiB/s 2.09 ms 468.03 us 2024-03-26T17:07:23.391 INFO:tasks.workunit.client.3.smithi157.stdout:myimage1 3/s 5/s 60 KiB/s 100 KiB/s 1.95 ms 309.48 us 2024-03-26T17:07:23.391 INFO:tasks.workunit.client.3.smithi157.stdout:myimage8 3/s 5/s 70 KiB/s 138 KiB/s 2.33 ms 334.19 us 2024-03-26T17:07:23.391 INFO:tasks.workunit.client.3.smithi157.stdout:myimage6 3/s 4/s 74 KiB/s 90 KiB/s 2.58 ms 307.11 us 2024-03-26T17:07:23.391 INFO:tasks.workunit.client.3.smithi157.stdout:myimage51 3/s 5/s 62 KiB/s 83 KiB/s 2.52 ms 302.36 us 2024-03-26T17:07:23.391 INFO:tasks.workunit.client.3.smithi157.stdout:myimage28 3/s 5/s 77 KiB/s 125 KiB/s 3.09 ms 458.88 us 2024-03-26T17:07:23.391 INFO:tasks.workunit.client.3.smithi157.stdout:myimage56 3/s 5/s 53 KiB/s 129 KiB/s 2.66 ms 363.86 us 2024-03-26T17:07:23.391 INFO:tasks.workunit.client.3.smithi157.stdout:myimage9 3/s 5/s 44 KiB/s 89 KiB/s 2.50 ms 343.41 us 2024-03-26T17:07:23.391 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:07:23.395 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:07:23 smithi149 ceph-mon[34678]: pgmap v644: 33 pgs: 33 active+clean; 1.0 GiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 5.5 MiB/s rd, 5.5 MiB/s wr, 518 op/s 2024-03-26T17:07:23.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:07:23 smithi044 ceph-mon[30624]: pgmap v644: 33 pgs: 33 active+clean; 1.0 GiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 5.5 MiB/s rd, 5.5 MiB/s wr, 518 op/s 2024-03-26T17:07:23.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:07:23 smithi064 ceph-mon[34420]: pgmap v644: 33 pgs: 33 active+clean; 1.0 GiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 5.5 MiB/s rd, 5.5 MiB/s wr, 518 op/s 2024-03-26T17:07:24.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:07:24 smithi149 ceph-mon[34678]: Health check update: 3 slow ops, oldest one blocked for 538 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:07:24.477 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:07:24 smithi044 ceph-mon[30624]: Health check update: 3 slow ops, oldest one blocked for 538 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:07:24.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:07:24 smithi064 ceph-mon[34420]: Health check update: 3 slow ops, oldest one blocked for 538 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:07:24.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:07:24 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:07:24] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:07:24.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:07:24 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:07:24] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:07:24.766 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:07:24 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:07:25.076 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:07:24 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:07:24] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:07:25.076 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:07:24 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:07:24] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:07:25.076 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:07:24 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:07:25.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:07:25 smithi149 ceph-mon[34678]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:07:25.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:07:25 smithi149 ceph-mon[34678]: { 2024-03-26T17:07:25.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:07:25 smithi149 ceph-mon[34678]: "prefix": "rbd perf image stats", 2024-03-26T17:07:25.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:07:25 smithi149 ceph-mon[34678]: "pool_spec": "mypool", 2024-03-26T17:07:25.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:07:25 smithi149 ceph-mon[34678]: "sort_by": "write_ops", 2024-03-26T17:07:25.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:07:25 smithi149 ceph-mon[34678]: "format": "json" 2024-03-26T17:07:25.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:07:25 smithi149 ceph-mon[34678]: }"]: dispatch 2024-03-26T17:07:25.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:07:25 smithi149 ceph-mon[34678]: pgmap v645: 33 pgs: 33 active+clean; 1.0 GiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 5.8 MiB/s rd, 5.7 MiB/s wr, 553 op/s 2024-03-26T17:07:25.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:07:25 smithi044 ceph-mon[30624]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:07:25.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:07:25 smithi044 ceph-mon[30624]: { 2024-03-26T17:07:25.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:07:25 smithi044 ceph-mon[30624]: "prefix": "rbd perf image stats", 2024-03-26T17:07:25.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:07:25 smithi044 ceph-mon[30624]: "pool_spec": "mypool", 2024-03-26T17:07:25.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:07:25 smithi044 ceph-mon[30624]: "sort_by": "write_ops", 2024-03-26T17:07:25.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:07:25 smithi044 ceph-mon[30624]: "format": "json" 2024-03-26T17:07:25.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:07:25 smithi044 ceph-mon[30624]: }"]: dispatch 2024-03-26T17:07:25.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:07:25 smithi044 ceph-mon[30624]: pgmap v645: 33 pgs: 33 active+clean; 1.0 GiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 5.8 MiB/s rd, 5.7 MiB/s wr, 553 op/s 2024-03-26T17:07:25.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:07:25 smithi064 ceph-mon[34420]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:07:25.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:07:25 smithi064 ceph-mon[34420]: { 2024-03-26T17:07:25.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:07:25 smithi064 ceph-mon[34420]: "prefix": "rbd perf image stats", 2024-03-26T17:07:25.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:07:25 smithi064 ceph-mon[34420]: "pool_spec": "mypool", 2024-03-26T17:07:25.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:07:25 smithi064 ceph-mon[34420]: "sort_by": "write_ops", 2024-03-26T17:07:25.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:07:25 smithi064 ceph-mon[34420]: "format": "json" 2024-03-26T17:07:25.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:07:25 smithi064 ceph-mon[34420]: }"]: dispatch 2024-03-26T17:07:25.557 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:07:25 smithi064 ceph-mon[34420]: pgmap v645: 33 pgs: 33 active+clean; 1.0 GiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 5.8 MiB/s rd, 5.7 MiB/s wr, 553 op/s 2024-03-26T17:07:26.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:07:26 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 2024-03-26T17:07:26.231+0000 7fa707a55700 -1 mon.c@1(peon) e3 get_health_metrics reporting 3 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T17:07:26.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:07:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:07:26] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:07:26.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:07:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:07:26] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:07:26.766 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:07:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:07:27.078 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:07:26 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:07:26] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:07:27.078 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:07:26 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:07:26] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:07:27.078 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:07:26 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:07:27.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:07:27 smithi149 ceph-mon[34678]: pgmap v646: 33 pgs: 33 active+clean; 1.0 GiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 5.8 MiB/s rd, 5.6 MiB/s wr, 561 op/s 2024-03-26T17:07:27.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:07:27 smithi044 ceph-mon[30624]: pgmap v646: 33 pgs: 33 active+clean; 1.0 GiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 5.8 MiB/s rd, 5.6 MiB/s wr, 561 op/s 2024-03-26T17:07:27.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:07:27 smithi064 ceph-mon[34420]: pgmap v646: 33 pgs: 33 active+clean; 1.0 GiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 5.8 MiB/s rd, 5.6 MiB/s wr, 561 op/s 2024-03-26T17:07:28.392 INFO:tasks.workunit.client.3.smithi157.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-26T17:07:28.392 INFO:tasks.workunit.client.3.smithi157.stdout:myimage4 6/s 2/s 129 KiB/s 64 KiB/s 2.22 ms 332.01 us 2024-03-26T17:07:28.392 INFO:tasks.workunit.client.3.smithi157.stdout:myimage31 6/s 3/s 126 KiB/s 59 KiB/s 2.54 ms 414.69 us 2024-03-26T17:07:28.392 INFO:tasks.workunit.client.3.smithi157.stdout:myimage2 5/s 4/s 111 KiB/s 85 KiB/s 2.31 ms 314.62 us 2024-03-26T17:07:28.393 INFO:tasks.workunit.client.3.smithi157.stdout:myimage52 5/s 4/s 116 KiB/s 78 KiB/s 2.59 ms 316.88 us 2024-03-26T17:07:28.393 INFO:tasks.workunit.client.3.smithi157.stdout:myimage19 5/s 5/s 126 KiB/s 87 KiB/s 2.26 ms 357.11 us 2024-03-26T17:07:28.393 INFO:tasks.workunit.client.3.smithi157.stdout:myimage59 5/s 4/s 132 KiB/s 79 KiB/s 2.34 ms 378.08 us 2024-03-26T17:07:28.393 INFO:tasks.workunit.client.3.smithi157.stdout:myimage49 5/s 4/s 79 KiB/s 86 KiB/s 2.22 ms 309.86 us 2024-03-26T17:07:28.393 INFO:tasks.workunit.client.3.smithi157.stdout:myimage25 5/s 3/s 105 KiB/s 69 KiB/s 2.66 ms 312.74 us 2024-03-26T17:07:28.393 INFO:tasks.workunit.client.3.smithi157.stdout:myimage28 5/s 4/s 109 KiB/s 101 KiB/s 2.81 ms 335.90 us 2024-03-26T17:07:28.393 INFO:tasks.workunit.client.3.smithi157.stdout:myimage29 5/s 4/s 112 KiB/s 71 KiB/s 2.11 ms 342.26 us 2024-03-26T17:07:28.393 INFO:tasks.workunit.client.3.smithi157.stdout:myimage55 5/s 4/s 110 KiB/s 79 KiB/s 2.33 ms 352.39 us 2024-03-26T17:07:28.393 INFO:tasks.workunit.client.3.smithi157.stdout:myimage34 5/s 4/s 118 KiB/s 76 KiB/s 1.91 ms 294.43 us 2024-03-26T17:07:28.393 INFO:tasks.workunit.client.3.smithi157.stdout:myimage9 5/s 3/s 95 KiB/s 78 KiB/s 2.46 ms 333.01 us 2024-03-26T17:07:28.393 INFO:tasks.workunit.client.3.smithi157.stdout:myimage23 4/s 5/s 124 KiB/s 112 KiB/s 2.04 ms 404.59 us 2024-03-26T17:07:28.393 INFO:tasks.workunit.client.3.smithi157.stdout:myimage48 4/s 5/s 75 KiB/s 99 KiB/s 2.33 ms 374.82 us 2024-03-26T17:07:28.393 INFO:tasks.workunit.client.3.smithi157.stdout:myimage5 4/s 4/s 99 KiB/s 84 KiB/s 2.26 ms 322.55 us 2024-03-26T17:07:28.394 INFO:tasks.workunit.client.3.smithi157.stdout:myimage8 4/s 4/s 82 KiB/s 61 KiB/s 2.58 ms 344.45 us 2024-03-26T17:07:28.394 INFO:tasks.workunit.client.3.smithi157.stdout:myimage12 4/s 4/s 110 KiB/s 82 KiB/s 2.34 ms 349.89 us 2024-03-26T17:07:28.394 INFO:tasks.workunit.client.3.smithi157.stdout:myimage21 4/s 4/s 96 KiB/s 91 KiB/s 3.11 ms 320.91 us 2024-03-26T17:07:28.394 INFO:tasks.workunit.client.3.smithi157.stdout:myimage33 4/s 4/s 100 KiB/s 94 KiB/s 2.16 ms 333.90 us 2024-03-26T17:07:28.394 INFO:tasks.workunit.client.3.smithi157.stdout:myimage46 4/s 4/s 105 KiB/s 83 KiB/s 2.10 ms 337.42 us 2024-03-26T17:07:28.394 INFO:tasks.workunit.client.3.smithi157.stdout:myimage3 4/s 4/s 96 KiB/s 82 KiB/s 2.41 ms 411.76 us 2024-03-26T17:07:28.394 INFO:tasks.workunit.client.3.smithi157.stdout:myimage1 4/s 4/s 106 KiB/s 68 KiB/s 1.99 ms 326.28 us 2024-03-26T17:07:28.394 INFO:tasks.workunit.client.3.smithi157.stdout:myimage15 4/s 4/s 81 KiB/s 85 KiB/s 2.06 ms 336.26 us 2024-03-26T17:07:28.394 INFO:tasks.workunit.client.3.smithi157.stdout:myimage43 4/s 4/s 98 KiB/s 85 KiB/s 2.32 ms 372.36 us 2024-03-26T17:07:28.394 INFO:tasks.workunit.client.3.smithi157.stdout:myimage45 4/s 4/s 119 KiB/s 71 KiB/s 2.25 ms 309.66 us 2024-03-26T17:07:28.394 INFO:tasks.workunit.client.3.smithi157.stdout:myimage53 4/s 5/s 75 KiB/s 108 KiB/s 2.28 ms 378.43 us 2024-03-26T17:07:28.394 INFO:tasks.workunit.client.3.smithi157.stdout:myimage10 4/s 3/s 87 KiB/s 68 KiB/s 2.17 ms 401.64 us 2024-03-26T17:07:28.394 INFO:tasks.workunit.client.3.smithi157.stdout:myimage38 4/s 5/s 87 KiB/s 113 KiB/s 2.04 ms 311.82 us 2024-03-26T17:07:28.394 INFO:tasks.workunit.client.3.smithi157.stdout:myimage40 4/s 4/s 101 KiB/s 107 KiB/s 2.12 ms 349.66 us 2024-03-26T17:07:28.395 INFO:tasks.workunit.client.3.smithi157.stdout:myimage7 4/s 5/s 62 KiB/s 90 KiB/s 2.32 ms 345.94 us 2024-03-26T17:07:28.395 INFO:tasks.workunit.client.3.smithi157.stdout:myimage24 4/s 3/s 126 KiB/s 86 KiB/s 2.44 ms 456.70 us 2024-03-26T17:07:28.395 INFO:tasks.workunit.client.3.smithi157.stdout:myimage14 4/s 3/s 111 KiB/s 72 KiB/s 2.46 ms 337.77 us 2024-03-26T17:07:28.395 INFO:tasks.workunit.client.3.smithi157.stdout:myimage16 4/s 4/s 78 KiB/s 90 KiB/s 2.36 ms 414.85 us 2024-03-26T17:07:28.395 INFO:tasks.workunit.client.3.smithi157.stdout:myimage37 4/s 4/s 106 KiB/s 82 KiB/s 2.53 ms 327.46 us 2024-03-26T17:07:28.395 INFO:tasks.workunit.client.3.smithi157.stdout:myimage58 4/s 4/s 74 KiB/s 86 KiB/s 1.94 ms 340.17 us 2024-03-26T17:07:28.395 INFO:tasks.workunit.client.3.smithi157.stdout:myimage17 4/s 4/s 76 KiB/s 78 KiB/s 2.35 ms 361.22 us 2024-03-26T17:07:28.395 INFO:tasks.workunit.client.3.smithi157.stdout:myimage18 4/s 4/s 86 KiB/s 90 KiB/s 2.29 ms 308.53 us 2024-03-26T17:07:28.395 INFO:tasks.workunit.client.3.smithi157.stdout:myimage20 4/s 4/s 66 KiB/s 62 KiB/s 2.42 ms 325.46 us 2024-03-26T17:07:28.395 INFO:tasks.workunit.client.3.smithi157.stdout:myimage26 4/s 5/s 81 KiB/s 98 KiB/s 2.29 ms 361.96 us 2024-03-26T17:07:28.395 INFO:tasks.workunit.client.3.smithi157.stdout:myimage56 4/s 4/s 88 KiB/s 93 KiB/s 2.62 ms 333.36 us 2024-03-26T17:07:28.395 INFO:tasks.workunit.client.3.smithi157.stdout:myimage32 4/s 4/s 82 KiB/s 94 KiB/s 2.46 ms 317.10 us 2024-03-26T17:07:28.395 INFO:tasks.workunit.client.3.smithi157.stdout:myimage6 4/s 5/s 64 KiB/s 100 KiB/s 2.51 ms 312.06 us 2024-03-26T17:07:28.395 INFO:tasks.workunit.client.3.smithi157.stdout:myimage11 4/s 4/s 78 KiB/s 84 KiB/s 2.41 ms 282.10 us 2024-03-26T17:07:28.396 INFO:tasks.workunit.client.3.smithi157.stdout:myimage42 4/s 5/s 90 KiB/s 104 KiB/s 2.17 ms 355.95 us 2024-03-26T17:07:28.396 INFO:tasks.workunit.client.3.smithi157.stdout:myimage47 3/s 4/s 74 KiB/s 109 KiB/s 2.23 ms 368.21 us 2024-03-26T17:07:28.396 INFO:tasks.workunit.client.3.smithi157.stdout:myimage36 3/s 5/s 75 KiB/s 101 KiB/s 2.11 ms 411.21 us 2024-03-26T17:07:28.396 INFO:tasks.workunit.client.3.smithi157.stdout:myimage41 3/s 4/s 74 KiB/s 81 KiB/s 2.24 ms 325.96 us 2024-03-26T17:07:28.396 INFO:tasks.workunit.client.3.smithi157.stdout:myimage51 3/s 5/s 82 KiB/s 95 KiB/s 2.54 ms 310.41 us 2024-03-26T17:07:28.396 INFO:tasks.workunit.client.3.smithi157.stdout:myimage22 3/s 4/s 66 KiB/s 90 KiB/s 2.47 ms 307.83 us 2024-03-26T17:07:28.396 INFO:tasks.workunit.client.3.smithi157.stdout:myimage54 3/s 5/s 88 KiB/s 89 KiB/s 2.30 ms 332.04 us 2024-03-26T17:07:28.396 INFO:tasks.workunit.client.3.smithi157.stdout:myimage57 3/s 5/s 64 KiB/s 105 KiB/s 2.22 ms 313.76 us 2024-03-26T17:07:28.396 INFO:tasks.workunit.client.3.smithi157.stdout:myimage30 3/s 5/s 55 KiB/s 131 KiB/s 2.69 ms 348.70 us 2024-03-26T17:07:28.396 INFO:tasks.workunit.client.3.smithi157.stdout:myimage44 3/s 4/s 47 KiB/s 99 KiB/s 2.47 ms 358.88 us 2024-03-26T17:07:28.396 INFO:tasks.workunit.client.3.smithi157.stdout:myimage27 3/s 3/s 47 KiB/s 80 KiB/s 2.04 ms 351.21 us 2024-03-26T17:07:28.396 INFO:tasks.workunit.client.3.smithi157.stdout:myimage39 3/s 5/s 74 KiB/s 93 KiB/s 2.12 ms 342.59 us 2024-03-26T17:07:28.396 INFO:tasks.workunit.client.3.smithi157.stdout:myimage13 3/s 4/s 74 KiB/s 95 KiB/s 2.03 ms 423.85 us 2024-03-26T17:07:28.396 INFO:tasks.workunit.client.3.smithi157.stdout:myimage50 3/s 4/s 68 KiB/s 77 KiB/s 2.50 ms 307.32 us 2024-03-26T17:07:28.396 INFO:tasks.workunit.client.3.smithi157.stdout:myimage35 2/s 5/s 70 KiB/s 102 KiB/s 2.10 ms 317.26 us 2024-03-26T17:07:28.397 INFO:tasks.workunit.client.3.smithi157.stdout:myimage60 2/s 4/s 46 KiB/s 82 KiB/s 2.47 ms 419.89 us 2024-03-26T17:07:28.397 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:07:28.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:07:28 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:07:28] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:07:28.766 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:07:28 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:07:28] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:07:28.766 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:07:28 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:07:29.080 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:07:28 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:07:28] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:07:29.080 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:07:28 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:07:28] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:07:29.080 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:07:28 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:07:29.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:07:29 smithi149 ceph-mon[34678]: pgmap v647: 33 pgs: 33 active+clean; 1.0 GiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 5.4 MiB/s rd, 5.3 MiB/s wr, 527 op/s 2024-03-26T17:07:29.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:07:29 smithi149 ceph-mon[34678]: Health check update: 3 slow ops, oldest one blocked for 543 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:07:29.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:07:29 smithi044 ceph-mon[30624]: pgmap v647: 33 pgs: 33 active+clean; 1.0 GiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 5.4 MiB/s rd, 5.3 MiB/s wr, 527 op/s 2024-03-26T17:07:29.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:07:29 smithi044 ceph-mon[30624]: Health check update: 3 slow ops, oldest one blocked for 543 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:07:29.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:07:29 smithi064 ceph-mon[34420]: pgmap v647: 33 pgs: 33 active+clean; 1.0 GiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 5.4 MiB/s rd, 5.3 MiB/s wr, 527 op/s 2024-03-26T17:07:29.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:07:29 smithi064 ceph-mon[34420]: Health check update: 3 slow ops, oldest one blocked for 543 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:07:30.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:07:30 smithi149 ceph-mon[34678]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:07:30.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:07:30 smithi149 ceph-mon[34678]: { 2024-03-26T17:07:30.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:07:30 smithi149 ceph-mon[34678]: "prefix": "rbd perf image stats", 2024-03-26T17:07:30.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:07:30 smithi149 ceph-mon[34678]: "pool_spec": "mypool", 2024-03-26T17:07:30.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:07:30 smithi149 ceph-mon[34678]: "sort_by": "write_ops", 2024-03-26T17:07:30.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:07:30 smithi149 ceph-mon[34678]: "format": "json" 2024-03-26T17:07:30.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:07:30 smithi149 ceph-mon[34678]: }"]: dispatch 2024-03-26T17:07:30.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:07:30 smithi044 ceph-mon[30624]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:07:30.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:07:30 smithi044 ceph-mon[30624]: { 2024-03-26T17:07:30.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:07:30 smithi044 ceph-mon[30624]: "prefix": "rbd perf image stats", 2024-03-26T17:07:30.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:07:30 smithi044 ceph-mon[30624]: "pool_spec": "mypool", 2024-03-26T17:07:30.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:07:30 smithi044 ceph-mon[30624]: "sort_by": "write_ops", 2024-03-26T17:07:30.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:07:30 smithi044 ceph-mon[30624]: "format": "json" 2024-03-26T17:07:30.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:07:30 smithi044 ceph-mon[30624]: }"]: dispatch 2024-03-26T17:07:30.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:07:30 smithi064 ceph-mon[34420]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:07:30.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:07:30 smithi064 ceph-mon[34420]: { 2024-03-26T17:07:30.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:07:30 smithi064 ceph-mon[34420]: "prefix": "rbd perf image stats", 2024-03-26T17:07:30.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:07:30 smithi064 ceph-mon[34420]: "pool_spec": "mypool", 2024-03-26T17:07:30.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:07:30 smithi064 ceph-mon[34420]: "sort_by": "write_ops", 2024-03-26T17:07:30.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:07:30 smithi064 ceph-mon[34420]: "format": "json" 2024-03-26T17:07:30.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:07:30 smithi064 ceph-mon[34420]: }"]: dispatch 2024-03-26T17:07:31.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:07:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:07:30] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:07:31.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:07:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:07:30] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:07:31.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:07:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:07:31.085 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:07:30 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:07:30] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:07:31.085 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:07:30 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:07:30] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:07:31.085 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:07:30 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:07:31.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:07:31 smithi149 ceph-mon[34678]: pgmap v648: 33 pgs: 33 active+clean; 1.0 GiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 5.2 MiB/s rd, 5.1 MiB/s wr, 516 op/s 2024-03-26T17:07:31.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:07:31 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 2024-03-26T17:07:31.231+0000 7fa707a55700 -1 mon.c@1(peon) e3 get_health_metrics reporting 3 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T17:07:31.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:07:31 smithi044 ceph-mon[30624]: pgmap v648: 33 pgs: 33 active+clean; 1.0 GiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 5.2 MiB/s rd, 5.1 MiB/s wr, 516 op/s 2024-03-26T17:07:31.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:07:31 smithi064 ceph-mon[34420]: pgmap v648: 33 pgs: 33 active+clean; 1.0 GiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 5.2 MiB/s rd, 5.1 MiB/s wr, 516 op/s 2024-03-26T17:07:33.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:07:32 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:07:32] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:07:33.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:07:32 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:07:32] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:07:33.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:07:32 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:07:33.072 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:07:33.072 INFO:tasks.workunit.client.3.smithi157.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2024-03-26T17:07:33.072 INFO:tasks.workunit.client.3.smithi157.stdout: 8.80 80.0k 88.4k 0.0k 800.0k 884.0k 0.0k nvme2n1 2024-03-26T17:07:33.072 INFO:tasks.workunit.client.3.smithi157.stdout: 8.90 81.6k 99.2k 0.0k 816.0k 992.0k 0.0k nvme2n10 2024-03-26T17:07:33.072 INFO:tasks.workunit.client.3.smithi157.stdout: 8.90 80.8k 92.8k 0.0k 808.0k 928.0k 0.0k nvme2n11 2024-03-26T17:07:33.072 INFO:tasks.workunit.client.3.smithi157.stdout: 8.90 112.0k 76.4k 0.0k 1.1M 764.0k 0.0k nvme2n12 2024-03-26T17:07:33.072 INFO:tasks.workunit.client.3.smithi157.stdout: 8.90 102.0k 98.4k 0.0k 1020.0k 984.0k 0.0k nvme2n13 2024-03-26T17:07:33.072 INFO:tasks.workunit.client.3.smithi157.stdout: 8.90 87.2k 94.0k 0.0k 872.0k 940.0k 0.0k nvme2n14 2024-03-26T17:07:33.072 INFO:tasks.workunit.client.3.smithi157.stdout: 8.90 80.0k 84.0k 0.0k 800.0k 840.0k 0.0k nvme2n15 2024-03-26T17:07:33.073 INFO:tasks.workunit.client.3.smithi157.stdout: 8.90 75.2k 80.0k 0.0k 752.0k 800.0k 0.0k nvme2n16 2024-03-26T17:07:33.073 INFO:tasks.workunit.client.3.smithi157.stdout: 8.90 84.0k 98.4k 0.0k 840.0k 984.0k 0.0k nvme2n17 2024-03-26T17:07:33.073 INFO:tasks.workunit.client.3.smithi157.stdout: 8.80 97.2k 92.4k 0.0k 972.0k 924.0k 0.0k nvme2n18 2024-03-26T17:07:33.073 INFO:tasks.workunit.client.3.smithi157.stdout: 8.80 86.0k 92.4k 0.0k 860.0k 924.0k 0.0k nvme2n19 2024-03-26T17:07:33.073 INFO:tasks.workunit.client.3.smithi157.stdout: 8.80 89.2k 84.8k 0.0k 892.0k 848.0k 0.0k nvme2n2 2024-03-26T17:07:33.073 INFO:tasks.workunit.client.3.smithi157.stdout: 8.80 70.8k 69.6k 0.0k 708.0k 696.0k 0.0k nvme2n20 2024-03-26T17:07:33.073 INFO:tasks.workunit.client.3.smithi157.stdout: 8.80 82.4k 104.4k 0.0k 824.0k 1.0M 0.0k nvme2n3 2024-03-26T17:07:33.073 INFO:tasks.workunit.client.3.smithi157.stdout: 8.80 89.2k 85.6k 0.0k 892.0k 856.0k 0.0k nvme2n4 2024-03-26T17:07:33.073 INFO:tasks.workunit.client.3.smithi157.stdout: 8.80 64.8k 102.0k 0.0k 648.0k 1020.0k 0.0k nvme2n5 2024-03-26T17:07:33.073 INFO:tasks.workunit.client.3.smithi157.stdout: 8.80 88.8k 73.6k 0.0k 888.0k 736.0k 0.0k nvme2n6 2024-03-26T17:07:33.073 INFO:tasks.workunit.client.3.smithi157.stdout: 8.80 74.8k 96.4k 0.0k 748.0k 964.0k 0.0k nvme2n7 2024-03-26T17:07:33.073 INFO:tasks.workunit.client.3.smithi157.stdout: 8.80 75.6k 85.2k 0.0k 756.0k 852.0k 0.0k nvme2n8 2024-03-26T17:07:33.073 INFO:tasks.workunit.client.3.smithi157.stdout: 8.90 93.6k 84.8k 0.0k 936.0k 848.0k 0.0k nvme2n9 2024-03-26T17:07:33.074 INFO:tasks.workunit.client.3.smithi157.stdout: 8.80 83.6k 78.0k 0.0k 836.0k 780.0k 0.0k nvme5n1 2024-03-26T17:07:33.074 INFO:tasks.workunit.client.3.smithi157.stdout: 8.90 83.2k 84.0k 0.0k 832.0k 840.0k 0.0k nvme5n10 2024-03-26T17:07:33.074 INFO:tasks.workunit.client.3.smithi157.stdout: 8.90 76.8k 95.6k 0.0k 768.0k 956.0k 0.0k nvme5n11 2024-03-26T17:07:33.074 INFO:tasks.workunit.client.3.smithi157.stdout: 8.90 95.6k 80.8k 0.0k 956.0k 808.0k 0.0k nvme5n12 2024-03-26T17:07:33.074 INFO:tasks.workunit.client.3.smithi157.stdout: 8.90 72.4k 104.8k 0.0k 724.0k 1.0M 0.0k nvme5n13 2024-03-26T17:07:33.074 INFO:tasks.workunit.client.3.smithi157.stdout: 8.90 98.0k 112.4k 0.0k 980.0k 1.1M 0.0k nvme5n14 2024-03-26T17:07:33.074 INFO:tasks.workunit.client.3.smithi157.stdout: 8.90 90.0k 96.0k 0.0k 900.0k 960.0k 0.0k nvme5n15 2024-03-26T17:07:33.074 INFO:tasks.workunit.client.3.smithi157.stdout: 8.90 89.2k 85.2k 0.0k 892.0k 852.0k 0.0k nvme5n16 2024-03-26T17:07:33.074 INFO:tasks.workunit.client.3.smithi157.stdout: 8.90 96.8k 98.0k 0.0k 968.0k 980.0k 0.0k nvme5n17 2024-03-26T17:07:33.074 INFO:tasks.workunit.client.3.smithi157.stdout: 8.90 59.6k 119.6k 0.0k 596.0k 1.2M 0.0k nvme5n18 2024-03-26T17:07:33.074 INFO:tasks.workunit.client.3.smithi157.stdout: 8.80 76.0k 73.6k 0.0k 760.0k 736.0k 0.0k nvme5n19 2024-03-26T17:07:33.074 INFO:tasks.workunit.client.3.smithi157.stdout: 8.80 103.6k 80.4k 0.0k 1.0M 804.0k 0.0k nvme5n2 2024-03-26T17:07:33.074 INFO:tasks.workunit.client.3.smithi157.stdout: 8.80 84.8k 103.2k 0.0k 848.0k 1.0M 0.0k nvme5n20 2024-03-26T17:07:33.075 INFO:tasks.workunit.client.3.smithi157.stdout: 8.80 102.4k 85.6k 0.0k 1.0M 856.0k 0.0k nvme5n3 2024-03-26T17:07:33.075 INFO:tasks.workunit.client.3.smithi157.stdout: 8.80 90.0k 102.4k 0.0k 900.0k 1.0M 0.0k nvme5n4 2024-03-26T17:07:33.075 INFO:tasks.workunit.client.3.smithi157.stdout: 8.80 60.8k 104.4k 0.0k 608.0k 1.0M 0.0k nvme5n5 2024-03-26T17:07:33.075 INFO:tasks.workunit.client.3.smithi157.stdout: 8.80 92.8k 78.0k 0.0k 928.0k 780.0k 0.0k nvme5n6 2024-03-26T17:07:33.075 INFO:tasks.workunit.client.3.smithi157.stdout: 8.80 109.6k 70.0k 0.0k 1.1M 700.0k 0.0k nvme5n7 2024-03-26T17:07:33.075 INFO:tasks.workunit.client.3.smithi157.stdout: 8.80 93.2k 88.8k 0.0k 932.0k 888.0k 0.0k nvme5n8 2024-03-26T17:07:33.075 INFO:tasks.workunit.client.3.smithi157.stdout: 8.90 93.6k 68.0k 0.0k 936.0k 680.0k 0.0k nvme5n9 2024-03-26T17:07:33.075 INFO:tasks.workunit.client.3.smithi157.stdout: 8.80 78.8k 91.6k 0.0k 788.0k 916.0k 0.0k nvme8n1 2024-03-26T17:07:33.075 INFO:tasks.workunit.client.3.smithi157.stdout: 8.90 80.4k 81.2k 0.0k 804.0k 812.0k 0.0k nvme8n10 2024-03-26T17:07:33.075 INFO:tasks.workunit.client.3.smithi157.stdout: 8.90 93.2k 80.8k 0.0k 932.0k 808.0k 0.0k nvme8n11 2024-03-26T17:07:33.075 INFO:tasks.workunit.client.3.smithi157.stdout: 8.90 86.4k 100.8k 0.0k 864.0k 1008.0k 0.0k nvme8n12 2024-03-26T17:07:33.075 INFO:tasks.workunit.client.3.smithi157.stdout: 8.90 82.4k 107.6k 0.0k 824.0k 1.1M 0.0k nvme8n13 2024-03-26T17:07:33.075 INFO:tasks.workunit.client.3.smithi157.stdout: 8.90 85.6k 83.2k 0.0k 856.0k 832.0k 0.0k nvme8n14 2024-03-26T17:07:33.075 INFO:tasks.workunit.client.3.smithi157.stdout: 8.90 84.0k 86.0k 0.0k 840.0k 860.0k 0.0k nvme8n15 2024-03-26T17:07:33.076 INFO:tasks.workunit.client.3.smithi157.stdout: 8.90 108.4k 59.6k 0.0k 1.1M 596.0k 0.0k nvme8n16 2024-03-26T17:07:33.076 INFO:tasks.workunit.client.3.smithi157.stdout: 8.90 87.2k 87.2k 0.0k 872.0k 872.0k 0.0k nvme8n17 2024-03-26T17:07:33.076 INFO:tasks.workunit.client.3.smithi157.stdout: 8.80 78.8k 94.4k 0.0k 788.0k 944.0k 0.0k nvme8n18 2024-03-26T17:07:33.076 INFO:tasks.workunit.client.3.smithi157.stdout: 8.80 95.6k 92.8k 0.0k 956.0k 928.0k 0.0k nvme8n19 2024-03-26T17:07:33.076 INFO:tasks.workunit.client.3.smithi157.stdout: 8.80 105.2k 66.0k 0.0k 1.0M 660.0k 0.0k nvme8n2 2024-03-26T17:07:33.076 INFO:tasks.workunit.client.3.smithi157.stdout: 8.80 69.6k 81.6k 0.0k 696.0k 816.0k 0.0k nvme8n20 2024-03-26T17:07:33.076 INFO:tasks.workunit.client.3.smithi157.stdout: 8.80 102.8k 94.8k 0.0k 1.0M 948.0k 0.0k nvme8n3 2024-03-26T17:07:33.076 INFO:tasks.workunit.client.3.smithi157.stdout: 8.80 77.6k 100.8k 0.0k 776.0k 1008.0k 0.0k nvme8n4 2024-03-26T17:07:33.076 INFO:tasks.workunit.client.3.smithi157.stdout: 8.80 70.4k 79.6k 0.0k 704.0k 796.0k 0.0k nvme8n5 2024-03-26T17:07:33.076 INFO:tasks.workunit.client.3.smithi157.stdout: 8.80 76.0k 86.4k 0.0k 760.0k 864.0k 0.0k nvme8n6 2024-03-26T17:07:33.076 INFO:tasks.workunit.client.3.smithi157.stdout: 8.80 88.0k 73.6k 0.0k 880.0k 736.0k 0.0k nvme8n7 2024-03-26T17:07:33.076 INFO:tasks.workunit.client.3.smithi157.stdout: 8.80 70.4k 94.8k 0.0k 704.0k 948.0k 0.0k nvme8n8 2024-03-26T17:07:33.076 INFO:tasks.workunit.client.3.smithi157.stdout: 8.90 79.6k 75.6k 0.0k 796.0k 756.0k 0.0k nvme8n9 2024-03-26T17:07:33.076 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:07:33.086 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:07:32 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:07:32] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:07:33.087 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:07:32 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:07:32] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:07:33.087 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:07:32 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:07:33.395 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:07:33 smithi149 ceph-mon[34678]: pgmap v649: 33 pgs: 33 active+clean; 1.0 GiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 5.1 MiB/s rd, 5.2 MiB/s wr, 525 op/s 2024-03-26T17:07:33.397 INFO:tasks.workunit.client.3.smithi157.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-26T17:07:33.397 INFO:tasks.workunit.client.3.smithi157.stdout:myimage25 6/s 3/s 110 KiB/s 54 KiB/s 2.94 ms 324.29 us 2024-03-26T17:07:33.397 INFO:tasks.workunit.client.3.smithi157.stdout:myimage14 5/s 4/s 106 KiB/s 109 KiB/s 2.51 ms 367.91 us 2024-03-26T17:07:33.397 INFO:tasks.workunit.client.3.smithi157.stdout:myimage38 5/s 3/s 126 KiB/s 59 KiB/s 1.88 ms 287.33 us 2024-03-26T17:07:33.397 INFO:tasks.workunit.client.3.smithi157.stdout:myimage58 5/s 3/s 100 KiB/s 59 KiB/s 1.86 ms 318.97 us 2024-03-26T17:07:33.397 INFO:tasks.workunit.client.3.smithi157.stdout:myimage60 5/s 4/s 115 KiB/s 64 KiB/s 2.56 ms 331.15 us 2024-03-26T17:07:33.398 INFO:tasks.workunit.client.3.smithi157.stdout:myimage48 5/s 3/s 106 KiB/s 53 KiB/s 2.13 ms 317.86 us 2024-03-26T17:07:33.398 INFO:tasks.workunit.client.3.smithi157.stdout:myimage3 5/s 4/s 116 KiB/s 79 KiB/s 2.19 ms 401.81 us 2024-03-26T17:07:33.398 INFO:tasks.workunit.client.3.smithi157.stdout:myimage31 5/s 3/s 103 KiB/s 68 KiB/s 2.51 ms 313.38 us 2024-03-26T17:07:33.398 INFO:tasks.workunit.client.3.smithi157.stdout:myimage32 5/s 4/s 82 KiB/s 94 KiB/s 2.39 ms 379.36 us 2024-03-26T17:07:33.398 INFO:tasks.workunit.client.3.smithi157.stdout:myimage34 5/s 4/s 104 KiB/s 106 KiB/s 2.10 ms 322.13 us 2024-03-26T17:07:33.398 INFO:tasks.workunit.client.3.smithi157.stdout:myimage1 5/s 4/s 90 KiB/s 66 KiB/s 1.98 ms 296.61 us 2024-03-26T17:07:33.398 INFO:tasks.workunit.client.3.smithi157.stdout:myimage11 5/s 4/s 109 KiB/s 82 KiB/s 2.50 ms 403.59 us 2024-03-26T17:07:33.398 INFO:tasks.workunit.client.3.smithi157.stdout:myimage24 5/s 4/s 95 KiB/s 107 KiB/s 2.15 ms 415.82 us 2024-03-26T17:07:33.398 INFO:tasks.workunit.client.3.smithi157.stdout:myimage33 5/s 3/s 94 KiB/s 58 KiB/s 2.20 ms 327.10 us 2024-03-26T17:07:33.398 INFO:tasks.workunit.client.3.smithi157.stdout:myimage36 5/s 4/s 89 KiB/s 91 KiB/s 2.14 ms 336.46 us 2024-03-26T17:07:33.398 INFO:tasks.workunit.client.3.smithi157.stdout:myimage51 5/s 4/s 83 KiB/s 81 KiB/s 2.45 ms 306.09 us 2024-03-26T17:07:33.398 INFO:tasks.workunit.client.3.smithi157.stdout:myimage10 5/s 3/s 116 KiB/s 78 KiB/s 2.20 ms 462.84 us 2024-03-26T17:07:33.398 INFO:tasks.workunit.client.3.smithi157.stdout:myimage4 4/s 3/s 81 KiB/s 80 KiB/s 2.27 ms 312.64 us 2024-03-26T17:07:33.399 INFO:tasks.workunit.client.3.smithi157.stdout:myimage15 4/s 4/s 102 KiB/s 63 KiB/s 2.21 ms 316.80 us 2024-03-26T17:07:33.399 INFO:tasks.workunit.client.3.smithi157.stdout:myimage57 4/s 5/s 104 KiB/s 93 KiB/s 2.26 ms 314.40 us 2024-03-26T17:07:33.399 INFO:tasks.workunit.client.3.smithi157.stdout:myimage30 4/s 3/s 72 KiB/s 74 KiB/s 2.88 ms 331.80 us 2024-03-26T17:07:33.399 INFO:tasks.workunit.client.3.smithi157.stdout:myimage44 4/s 4/s 117 KiB/s 74 KiB/s 2.32 ms 315.32 us 2024-03-26T17:07:33.399 INFO:tasks.workunit.client.3.smithi157.stdout:myimage17 4/s 3/s 93 KiB/s 71 KiB/s 2.46 ms 305.95 us 2024-03-26T17:07:33.399 INFO:tasks.workunit.client.3.smithi157.stdout:myimage21 4/s 4/s 80 KiB/s 98 KiB/s 2.57 ms 346.81 us 2024-03-26T17:07:33.399 INFO:tasks.workunit.client.3.smithi157.stdout:myimage27 4/s 6/s 74 KiB/s 115 KiB/s 2.13 ms 352.02 us 2024-03-26T17:07:33.399 INFO:tasks.workunit.client.3.smithi157.stdout:myimage53 4/s 3/s 78 KiB/s 78 KiB/s 2.26 ms 449.59 us 2024-03-26T17:07:33.399 INFO:tasks.workunit.client.3.smithi157.stdout:myimage54 4/s 4/s 86 KiB/s 67 KiB/s 2.19 ms 333.34 us 2024-03-26T17:07:33.399 INFO:tasks.workunit.client.3.smithi157.stdout:myimage40 4/s 4/s 92 KiB/s 96 KiB/s 2.16 ms 343.99 us 2024-03-26T17:07:33.399 INFO:tasks.workunit.client.3.smithi157.stdout:myimage19 4/s 3/s 102 KiB/s 58 KiB/s 2.57 ms 346.01 us 2024-03-26T17:07:33.399 INFO:tasks.workunit.client.3.smithi157.stdout:myimage45 4/s 4/s 73 KiB/s 88 KiB/s 2.17 ms 322.70 us 2024-03-26T17:07:33.399 INFO:tasks.workunit.client.3.smithi157.stdout:myimage59 4/s 3/s 84 KiB/s 73 KiB/s 2.59 ms 308.94 us 2024-03-26T17:07:33.399 INFO:tasks.workunit.client.3.smithi157.stdout:myimage13 4/s 5/s 103 KiB/s 129 KiB/s 2.05 ms 387.54 us 2024-03-26T17:07:33.400 INFO:tasks.workunit.client.3.smithi157.stdout:myimage16 4/s 4/s 75 KiB/s 77 KiB/s 2.43 ms 314.47 us 2024-03-26T17:07:33.400 INFO:tasks.workunit.client.3.smithi157.stdout:myimage22 4/s 4/s 73 KiB/s 94 KiB/s 2.31 ms 308.62 us 2024-03-26T17:07:33.400 INFO:tasks.workunit.client.3.smithi157.stdout:myimage8 4/s 3/s 72 KiB/s 72 KiB/s 2.56 ms 355.76 us 2024-03-26T17:07:33.400 INFO:tasks.workunit.client.3.smithi157.stdout:myimage9 4/s 4/s 84 KiB/s 86 KiB/s 2.67 ms 450.68 us 2024-03-26T17:07:33.400 INFO:tasks.workunit.client.3.smithi157.stdout:myimage41 4/s 3/s 90 KiB/s 63 KiB/s 2.37 ms 359.20 us 2024-03-26T17:07:33.400 INFO:tasks.workunit.client.3.smithi157.stdout:myimage42 4/s 4/s 48 KiB/s 86 KiB/s 2.06 ms 343.63 us 2024-03-26T17:07:33.400 INFO:tasks.workunit.client.3.smithi157.stdout:myimage43 4/s 4/s 104 KiB/s 94 KiB/s 2.28 ms 423.30 us 2024-03-26T17:07:33.400 INFO:tasks.workunit.client.3.smithi157.stdout:myimage55 4/s 4/s 79 KiB/s 65 KiB/s 2.42 ms 353.40 us 2024-03-26T17:07:33.400 INFO:tasks.workunit.client.3.smithi157.stdout:myimage56 4/s 5/s 76 KiB/s 122 KiB/s 2.90 ms 382.02 us 2024-03-26T17:07:33.400 INFO:tasks.workunit.client.3.smithi157.stdout:myimage35 4/s 5/s 83 KiB/s 86 KiB/s 2.23 ms 310.56 us 2024-03-26T17:07:33.400 INFO:tasks.workunit.client.3.smithi157.stdout:myimage52 4/s 5/s 86 KiB/s 122 KiB/s 2.39 ms 304.22 us 2024-03-26T17:07:33.400 INFO:tasks.workunit.client.3.smithi157.stdout:myimage5 4/s 4/s 102 KiB/s 73 KiB/s 2.32 ms 385.96 us 2024-03-26T17:07:33.400 INFO:tasks.workunit.client.3.smithi157.stdout:myimage39 4/s 5/s 86 KiB/s 88 KiB/s 2.06 ms 328.27 us 2024-03-26T17:07:33.400 INFO:tasks.workunit.client.3.smithi157.stdout:myimage23 3/s 4/s 70 KiB/s 84 KiB/s 1.77 ms 268.89 us 2024-03-26T17:07:33.400 INFO:tasks.workunit.client.3.smithi157.stdout:myimage49 3/s 5/s 54 KiB/s 77 KiB/s 2.22 ms 370.45 us 2024-03-26T17:07:33.401 INFO:tasks.workunit.client.3.smithi157.stdout:myimage28 3/s 3/s 94 KiB/s 89 KiB/s 2.76 ms 334.05 us 2024-03-26T17:07:33.401 INFO:tasks.workunit.client.3.smithi157.stdout:myimage37 3/s 4/s 71 KiB/s 110 KiB/s 2.47 ms 338.29 us 2024-03-26T17:07:33.401 INFO:tasks.workunit.client.3.smithi157.stdout:myimage47 3/s 5/s 80 KiB/s 77 KiB/s 2.26 ms 338.88 us 2024-03-26T17:07:33.401 INFO:tasks.workunit.client.3.smithi157.stdout:myimage18 3/s 5/s 83 KiB/s 100 KiB/s 2.41 ms 298.77 us 2024-03-26T17:07:33.401 INFO:tasks.workunit.client.3.smithi157.stdout:myimage20 3/s 2/s 50 KiB/s 34 KiB/s 2.64 ms 276.14 us 2024-03-26T17:07:33.401 INFO:tasks.workunit.client.3.smithi157.stdout:myimage26 3/s 5/s 74 KiB/s 118 KiB/s 2.27 ms 368.90 us 2024-03-26T17:07:33.401 INFO:tasks.workunit.client.3.smithi157.stdout:myimage46 3/s 5/s 82 KiB/s 84 KiB/s 2.18 ms 300.69 us 2024-03-26T17:07:33.401 INFO:tasks.workunit.client.3.smithi157.stdout:myimage7 3/s 4/s 80 KiB/s 70 KiB/s 2.77 ms 340.88 us 2024-03-26T17:07:33.401 INFO:tasks.workunit.client.3.smithi157.stdout:myimage29 3/s 5/s 57 KiB/s 90 KiB/s 2.07 ms 363.19 us 2024-03-26T17:07:33.401 INFO:tasks.workunit.client.3.smithi157.stdout:myimage50 3/s 5/s 78 KiB/s 92 KiB/s 2.70 ms 369.49 us 2024-03-26T17:07:33.401 INFO:tasks.workunit.client.3.smithi157.stdout:myimage2 2/s 5/s 56 KiB/s 98 KiB/s 2.44 ms 349.78 us 2024-03-26T17:07:33.401 INFO:tasks.workunit.client.3.smithi157.stdout:myimage6 2/s 4/s 49 KiB/s 66 KiB/s 2.13 ms 290.60 us 2024-03-26T17:07:33.401 INFO:tasks.workunit.client.3.smithi157.stdout:myimage12 2/s 5/s 51 KiB/s 121 KiB/s 2.44 ms 413.61 us 2024-03-26T17:07:33.401 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:07:33.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:07:33 smithi044 ceph-mon[30624]: pgmap v649: 33 pgs: 33 active+clean; 1.0 GiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 5.1 MiB/s rd, 5.2 MiB/s wr, 525 op/s 2024-03-26T17:07:33.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:07:33 smithi064 ceph-mon[34420]: pgmap v649: 33 pgs: 33 active+clean; 1.0 GiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 5.1 MiB/s rd, 5.2 MiB/s wr, 525 op/s 2024-03-26T17:07:34.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:07:34 smithi149 ceph-mon[34678]: Health check update: 3 slow ops, oldest one blocked for 548 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:07:34.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:07:34 smithi044 ceph-mon[30624]: Health check update: 3 slow ops, oldest one blocked for 548 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:07:34.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:07:34 smithi064 ceph-mon[34420]: Health check update: 3 slow ops, oldest one blocked for 548 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:07:35.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:07:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:07:34] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:07:35.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:07:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:07:34] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:07:35.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:07:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:07:35.092 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:07:34 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:07:34] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:07:35.092 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:07:34 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:07:34] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:07:35.092 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:07:34 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:07:35.395 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:07:35 smithi149 ceph-mon[34678]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:07:35.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:07:35 smithi149 ceph-mon[34678]: { 2024-03-26T17:07:35.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:07:35 smithi149 ceph-mon[34678]: "prefix": "rbd perf image stats", 2024-03-26T17:07:35.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:07:35 smithi149 ceph-mon[34678]: "pool_spec": "mypool", 2024-03-26T17:07:35.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:07:35 smithi149 ceph-mon[34678]: "sort_by": "write_ops", 2024-03-26T17:07:35.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:07:35 smithi149 ceph-mon[34678]: "format": "json" 2024-03-26T17:07:35.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:07:35 smithi149 ceph-mon[34678]: }"]: dispatch 2024-03-26T17:07:35.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:07:35 smithi149 ceph-mon[34678]: pgmap v650: 33 pgs: 33 active+clean; 1.0 GiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 5.3 MiB/s rd, 5.4 MiB/s wr, 552 op/s 2024-03-26T17:07:35.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:07:35 smithi044 ceph-mon[30624]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:07:35.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:07:35 smithi044 ceph-mon[30624]: { 2024-03-26T17:07:35.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:07:35 smithi044 ceph-mon[30624]: "prefix": "rbd perf image stats", 2024-03-26T17:07:35.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:07:35 smithi044 ceph-mon[30624]: "pool_spec": "mypool", 2024-03-26T17:07:35.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:07:35 smithi044 ceph-mon[30624]: "sort_by": "write_ops", 2024-03-26T17:07:35.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:07:35 smithi044 ceph-mon[30624]: "format": "json" 2024-03-26T17:07:35.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:07:35 smithi044 ceph-mon[30624]: }"]: dispatch 2024-03-26T17:07:35.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:07:35 smithi044 ceph-mon[30624]: pgmap v650: 33 pgs: 33 active+clean; 1.0 GiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 5.3 MiB/s rd, 5.4 MiB/s wr, 552 op/s 2024-03-26T17:07:35.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:07:35 smithi064 ceph-mon[34420]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:07:35.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:07:35 smithi064 ceph-mon[34420]: { 2024-03-26T17:07:35.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:07:35 smithi064 ceph-mon[34420]: "prefix": "rbd perf image stats", 2024-03-26T17:07:35.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:07:35 smithi064 ceph-mon[34420]: "pool_spec": "mypool", 2024-03-26T17:07:35.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:07:35 smithi064 ceph-mon[34420]: "sort_by": "write_ops", 2024-03-26T17:07:35.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:07:35 smithi064 ceph-mon[34420]: "format": "json" 2024-03-26T17:07:35.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:07:35 smithi064 ceph-mon[34420]: }"]: dispatch 2024-03-26T17:07:35.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:07:35 smithi064 ceph-mon[34420]: pgmap v650: 33 pgs: 33 active+clean; 1.0 GiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 5.3 MiB/s rd, 5.4 MiB/s wr, 552 op/s 2024-03-26T17:07:36.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:07:36 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 2024-03-26T17:07:36.232+0000 7fa707a55700 -1 mon.c@1(peon) e3 get_health_metrics reporting 3 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T17:07:37.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:07:36 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:07:36] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:07:37.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:07:36 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:07:36] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:07:37.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:07:36 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:07:37.094 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:07:36 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:07:36] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:07:37.094 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:07:36 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:07:36] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:07:37.094 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:07:36 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:07:37.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:07:37 smithi149 ceph-mon[34678]: pgmap v651: 33 pgs: 33 active+clean; 1.0 GiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 5.4 MiB/s rd, 5.4 MiB/s wr, 562 op/s 2024-03-26T17:07:37.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:07:37 smithi044 ceph-mon[30624]: pgmap v651: 33 pgs: 33 active+clean; 1.0 GiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 5.4 MiB/s rd, 5.4 MiB/s wr, 562 op/s 2024-03-26T17:07:37.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:07:37 smithi064 ceph-mon[34420]: pgmap v651: 33 pgs: 33 active+clean; 1.0 GiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 5.4 MiB/s rd, 5.4 MiB/s wr, 562 op/s 2024-03-26T17:07:38.403 INFO:tasks.workunit.client.3.smithi157.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-26T17:07:38.403 INFO:tasks.workunit.client.3.smithi157.stdout:myimage37 6/s 4/s 128 KiB/s 85 KiB/s 2.81 ms 394.41 us 2024-03-26T17:07:38.403 INFO:tasks.workunit.client.3.smithi157.stdout:myimage24 6/s 3/s 125 KiB/s 55 KiB/s 2.38 ms 312.16 us 2024-03-26T17:07:38.403 INFO:tasks.workunit.client.3.smithi157.stdout:myimage53 6/s 3/s 146 KiB/s 98 KiB/s 2.33 ms 386.37 us 2024-03-26T17:07:38.403 INFO:tasks.workunit.client.3.smithi157.stdout:myimage50 6/s 3/s 98 KiB/s 60 KiB/s 2.54 ms 313.34 us 2024-03-26T17:07:38.403 INFO:tasks.workunit.client.3.smithi157.stdout:myimage60 6/s 3/s 93 KiB/s 69 KiB/s 2.53 ms 313.82 us 2024-03-26T17:07:38.403 INFO:tasks.workunit.client.3.smithi157.stdout:myimage58 5/s 3/s 112 KiB/s 78 KiB/s 2.04 ms 303.42 us 2024-03-26T17:07:38.403 INFO:tasks.workunit.client.3.smithi157.stdout:myimage13 5/s 3/s 138 KiB/s 80 KiB/s 2.15 ms 351.96 us 2024-03-26T17:07:38.404 INFO:tasks.workunit.client.3.smithi157.stdout:myimage35 5/s 4/s 144 KiB/s 82 KiB/s 2.34 ms 306.24 us 2024-03-26T17:07:38.404 INFO:tasks.workunit.client.3.smithi157.stdout:myimage38 5/s 3/s 106 KiB/s 60 KiB/s 1.86 ms 324.73 us 2024-03-26T17:07:38.404 INFO:tasks.workunit.client.3.smithi157.stdout:myimage6 5/s 6/s 126 KiB/s 142 KiB/s 2.36 ms 363.97 us 2024-03-26T17:07:38.404 INFO:tasks.workunit.client.3.smithi157.stdout:myimage44 5/s 4/s 100 KiB/s 75 KiB/s 2.23 ms 317.73 us 2024-03-26T17:07:38.404 INFO:tasks.workunit.client.3.smithi157.stdout:myimage7 5/s 4/s 136 KiB/s 135 KiB/s 2.39 ms 386.96 us 2024-03-26T17:07:38.404 INFO:tasks.workunit.client.3.smithi157.stdout:myimage20 5/s 7/s 154 KiB/s 218 KiB/s 1.99 ms 308.80 us 2024-03-26T17:07:38.404 INFO:tasks.workunit.client.3.smithi157.stdout:myimage36 5/s 5/s 100 KiB/s 86 KiB/s 2.22 ms 362.54 us 2024-03-26T17:07:38.404 INFO:tasks.workunit.client.3.smithi157.stdout:myimage39 5/s 3/s 70 KiB/s 70 KiB/s 2.26 ms 339.62 us 2024-03-26T17:07:38.404 INFO:tasks.workunit.client.3.smithi157.stdout:myimage10 5/s 6/s 94 KiB/s 122 KiB/s 2.27 ms 386.74 us 2024-03-26T17:07:38.404 INFO:tasks.workunit.client.3.smithi157.stdout:myimage40 5/s 3/s 90 KiB/s 68 KiB/s 2.12 ms 335.98 us 2024-03-26T17:07:38.404 INFO:tasks.workunit.client.3.smithi157.stdout:myimage48 5/s 4/s 113 KiB/s 82 KiB/s 2.35 ms 414.76 us 2024-03-26T17:07:38.404 INFO:tasks.workunit.client.3.smithi157.stdout:myimage49 5/s 4/s 109 KiB/s 85 KiB/s 2.31 ms 311.14 us 2024-03-26T17:07:38.404 INFO:tasks.workunit.client.3.smithi157.stdout:myimage52 5/s 3/s 102 KiB/s 88 KiB/s 2.59 ms 315.01 us 2024-03-26T17:07:38.405 INFO:tasks.workunit.client.3.smithi157.stdout:myimage12 5/s 4/s 122 KiB/s 74 KiB/s 2.26 ms 380.62 us 2024-03-26T17:07:38.405 INFO:tasks.workunit.client.3.smithi157.stdout:myimage41 5/s 4/s 79 KiB/s 90 KiB/s 2.38 ms 319.80 us 2024-03-26T17:07:38.405 INFO:tasks.workunit.client.3.smithi157.stdout:myimage46 5/s 4/s 96 KiB/s 67 KiB/s 2.15 ms 291.58 us 2024-03-26T17:07:38.405 INFO:tasks.workunit.client.3.smithi157.stdout:myimage30 4/s 4/s 105 KiB/s 81 KiB/s 2.90 ms 315.73 us 2024-03-26T17:07:38.405 INFO:tasks.workunit.client.3.smithi157.stdout:myimage34 4/s 3/s 88 KiB/s 75 KiB/s 2.21 ms 344.02 us 2024-03-26T17:07:38.405 INFO:tasks.workunit.client.3.smithi157.stdout:myimage26 4/s 4/s 82 KiB/s 64 KiB/s 2.26 ms 306.62 us 2024-03-26T17:07:38.405 INFO:tasks.workunit.client.3.smithi157.stdout:myimage33 4/s 4/s 99 KiB/s 86 KiB/s 2.40 ms 318.20 us 2024-03-26T17:07:38.405 INFO:tasks.workunit.client.3.smithi157.stdout:myimage2 4/s 3/s 82 KiB/s 71 KiB/s 2.81 ms 377.37 us 2024-03-26T17:07:38.405 INFO:tasks.workunit.client.3.smithi157.stdout:myimage16 4/s 4/s 95 KiB/s 75 KiB/s 2.14 ms 321.24 us 2024-03-26T17:07:38.405 INFO:tasks.workunit.client.3.smithi157.stdout:myimage4 4/s 5/s 103 KiB/s 119 KiB/s 2.30 ms 381.13 us 2024-03-26T17:07:38.405 INFO:tasks.workunit.client.3.smithi157.stdout:myimage21 4/s 4/s 89 KiB/s 94 KiB/s 3.05 ms 364.76 us 2024-03-26T17:07:38.405 INFO:tasks.workunit.client.3.smithi157.stdout:myimage3 4/s 4/s 93 KiB/s 114 KiB/s 1.99 ms 314.84 us 2024-03-26T17:07:38.405 INFO:tasks.workunit.client.3.smithi157.stdout:myimage14 4/s 4/s 57 KiB/s 72 KiB/s 2.24 ms 391.31 us 2024-03-26T17:07:38.405 INFO:tasks.workunit.client.3.smithi157.stdout:myimage47 4/s 5/s 75 KiB/s 91 KiB/s 2.44 ms 347.91 us 2024-03-26T17:07:38.406 INFO:tasks.workunit.client.3.smithi157.stdout:myimage5 4/s 4/s 68 KiB/s 92 KiB/s 2.28 ms 311.83 us 2024-03-26T17:07:38.406 INFO:tasks.workunit.client.3.smithi157.stdout:myimage11 4/s 3/s 100 KiB/s 68 KiB/s 2.31 ms 302.10 us 2024-03-26T17:07:38.406 INFO:tasks.workunit.client.3.smithi157.stdout:myimage18 4/s 4/s 97 KiB/s 86 KiB/s 2.48 ms 324.52 us 2024-03-26T17:07:38.406 INFO:tasks.workunit.client.3.smithi157.stdout:myimage42 4/s 3/s 79 KiB/s 89 KiB/s 2.04 ms 348.38 us 2024-03-26T17:07:38.406 INFO:tasks.workunit.client.3.smithi157.stdout:myimage1 4/s 5/s 76 KiB/s 121 KiB/s 1.95 ms 327.21 us 2024-03-26T17:07:38.406 INFO:tasks.workunit.client.3.smithi157.stdout:myimage15 4/s 5/s 73 KiB/s 111 KiB/s 1.99 ms 367.95 us 2024-03-26T17:07:38.406 INFO:tasks.workunit.client.3.smithi157.stdout:myimage29 4/s 5/s 68 KiB/s 117 KiB/s 2.05 ms 338.22 us 2024-03-26T17:07:38.406 INFO:tasks.workunit.client.3.smithi157.stdout:myimage59 4/s 4/s 85 KiB/s 109 KiB/s 2.40 ms 423.95 us 2024-03-26T17:07:38.406 INFO:tasks.workunit.client.3.smithi157.stdout:myimage31 4/s 5/s 84 KiB/s 85 KiB/s 2.77 ms 336.37 us 2024-03-26T17:07:38.406 INFO:tasks.workunit.client.3.smithi157.stdout:myimage8 4/s 5/s 82 KiB/s 78 KiB/s 2.55 ms 326.94 us 2024-03-26T17:07:38.406 INFO:tasks.workunit.client.3.smithi157.stdout:myimage32 3/s 3/s 71 KiB/s 59 KiB/s 2.40 ms 311.81 us 2024-03-26T17:07:38.406 INFO:tasks.workunit.client.3.smithi157.stdout:myimage17 3/s 5/s 81 KiB/s 95 KiB/s 2.27 ms 396.49 us 2024-03-26T17:07:38.406 INFO:tasks.workunit.client.3.smithi157.stdout:myimage56 3/s 4/s 60 KiB/s 79 KiB/s 2.81 ms 297.11 us 2024-03-26T17:07:38.407 INFO:tasks.workunit.client.3.smithi157.stdout:myimage22 3/s 4/s 105 KiB/s 97 KiB/s 2.47 ms 285.30 us 2024-03-26T17:07:38.407 INFO:tasks.workunit.client.3.smithi157.stdout:myimage43 3/s 4/s 68 KiB/s 101 KiB/s 2.20 ms 348.68 us 2024-03-26T17:07:38.407 INFO:tasks.workunit.client.3.smithi157.stdout:myimage45 3/s 5/s 58 KiB/s 83 KiB/s 2.38 ms 388.19 us 2024-03-26T17:07:38.407 INFO:tasks.workunit.client.3.smithi157.stdout:myimage51 3/s 5/s 47 KiB/s 93 KiB/s 2.61 ms 314.66 us 2024-03-26T17:07:38.407 INFO:tasks.workunit.client.3.smithi157.stdout:myimage55 3/s 4/s 66 KiB/s 98 KiB/s 2.50 ms 346.88 us 2024-03-26T17:07:38.407 INFO:tasks.workunit.client.3.smithi157.stdout:myimage23 3/s 5/s 68 KiB/s 92 KiB/s 2.13 ms 304.83 us 2024-03-26T17:07:38.407 INFO:tasks.workunit.client.3.smithi157.stdout:myimage28 3/s 6/s 72 KiB/s 116 KiB/s 2.93 ms 383.92 us 2024-03-26T17:07:38.407 INFO:tasks.workunit.client.3.smithi157.stdout:myimage9 3/s 5/s 61 KiB/s 93 KiB/s 2.68 ms 330.12 us 2024-03-26T17:07:38.407 INFO:tasks.workunit.client.3.smithi157.stdout:myimage25 3/s 4/s 56 KiB/s 80 KiB/s 3.37 ms 367.35 us 2024-03-26T17:07:38.407 INFO:tasks.workunit.client.3.smithi157.stdout:myimage54 3/s 5/s 57 KiB/s 91 KiB/s 1.94 ms 317.72 us 2024-03-26T17:07:38.407 INFO:tasks.workunit.client.3.smithi157.stdout:myimage57 3/s 4/s 65 KiB/s 87 KiB/s 2.63 ms 388.47 us 2024-03-26T17:07:38.407 INFO:tasks.workunit.client.3.smithi157.stdout:myimage27 2/s 3/s 65 KiB/s 101 KiB/s 2.26 ms 324.53 us 2024-03-26T17:07:38.407 INFO:tasks.workunit.client.3.smithi157.stdout:myimage19 2/s 4/s 50 KiB/s 92 KiB/s 2.30 ms 348.96 us 2024-03-26T17:07:38.407 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:07:39.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:07:38 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:07:38] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:07:39.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:07:38 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:07:38] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:07:39.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:07:38 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:07:39.096 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:07:38 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:07:38] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:07:39.096 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:07:38 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:07:38] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:07:39.096 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:07:38 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:07:39.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:07:39 smithi149 ceph-mon[34678]: pgmap v652: 33 pgs: 33 active+clean; 1.0 GiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 5.1 MiB/s rd, 5.1 MiB/s wr, 530 op/s 2024-03-26T17:07:39.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:07:39 smithi149 ceph-mon[34678]: Health check update: 3 slow ops, oldest one blocked for 553 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:07:39.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:07:39 smithi044 ceph-mon[30624]: pgmap v652: 33 pgs: 33 active+clean; 1.0 GiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 5.1 MiB/s rd, 5.1 MiB/s wr, 530 op/s 2024-03-26T17:07:39.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:07:39 smithi044 ceph-mon[30624]: Health check update: 3 slow ops, oldest one blocked for 553 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:07:39.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:07:39 smithi064 ceph-mon[34420]: pgmap v652: 33 pgs: 33 active+clean; 1.0 GiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 5.1 MiB/s rd, 5.1 MiB/s wr, 530 op/s 2024-03-26T17:07:39.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:07:39 smithi064 ceph-mon[34420]: Health check update: 3 slow ops, oldest one blocked for 553 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:07:40.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:07:40 smithi149 ceph-mon[34678]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:07:40.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:07:40 smithi149 ceph-mon[34678]: { 2024-03-26T17:07:40.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:07:40 smithi149 ceph-mon[34678]: "prefix": "rbd perf image stats", 2024-03-26T17:07:40.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:07:40 smithi149 ceph-mon[34678]: "pool_spec": "mypool", 2024-03-26T17:07:40.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:07:40 smithi149 ceph-mon[34678]: "sort_by": "write_ops", 2024-03-26T17:07:40.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:07:40 smithi149 ceph-mon[34678]: "format": "json" 2024-03-26T17:07:40.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:07:40 smithi149 ceph-mon[34678]: }"]: dispatch 2024-03-26T17:07:40.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:07:40 smithi044 ceph-mon[30624]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:07:40.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:07:40 smithi044 ceph-mon[30624]: { 2024-03-26T17:07:40.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:07:40 smithi044 ceph-mon[30624]: "prefix": "rbd perf image stats", 2024-03-26T17:07:40.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:07:40 smithi044 ceph-mon[30624]: "pool_spec": "mypool", 2024-03-26T17:07:40.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:07:40 smithi044 ceph-mon[30624]: "sort_by": "write_ops", 2024-03-26T17:07:40.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:07:40 smithi044 ceph-mon[30624]: "format": "json" 2024-03-26T17:07:40.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:07:40 smithi044 ceph-mon[30624]: }"]: dispatch 2024-03-26T17:07:40.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:07:40 smithi064 ceph-mon[34420]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:07:40.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:07:40 smithi064 ceph-mon[34420]: { 2024-03-26T17:07:40.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:07:40 smithi064 ceph-mon[34420]: "prefix": "rbd perf image stats", 2024-03-26T17:07:40.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:07:40 smithi064 ceph-mon[34420]: "pool_spec": "mypool", 2024-03-26T17:07:40.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:07:40 smithi064 ceph-mon[34420]: "sort_by": "write_ops", 2024-03-26T17:07:40.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:07:40 smithi064 ceph-mon[34420]: "format": "json" 2024-03-26T17:07:40.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:07:40 smithi064 ceph-mon[34420]: }"]: dispatch 2024-03-26T17:07:41.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:07:40 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:07:40] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:07:41.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:07:40 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:07:40] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:07:41.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:07:40 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:07:41.101 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:07:40 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:07:40] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:07:41.101 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:07:40 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:07:40] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:07:41.101 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:07:40 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:07:41.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:07:41 smithi149 ceph-mon[34678]: pgmap v653: 33 pgs: 33 active+clean; 1.0 GiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 5.0 MiB/s rd, 5.0 MiB/s wr, 518 op/s 2024-03-26T17:07:41.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:07:41 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 2024-03-26T17:07:41.232+0000 7fa707a55700 -1 mon.c@1(peon) e3 get_health_metrics reporting 3 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T17:07:41.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:07:41 smithi044 ceph-mon[30624]: pgmap v653: 33 pgs: 33 active+clean; 1.0 GiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 5.0 MiB/s rd, 5.0 MiB/s wr, 518 op/s 2024-03-26T17:07:41.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:07:41 smithi064 ceph-mon[34420]: pgmap v653: 33 pgs: 33 active+clean; 1.0 GiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 5.0 MiB/s rd, 5.0 MiB/s wr, 518 op/s 2024-03-26T17:07:43.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:07:42 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:07:42] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:07:43.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:07:42 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:07:42] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:07:43.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:07:42 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:07:43.062 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:07:43.077 INFO:tasks.workunit.client.3.smithi157.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2024-03-26T17:07:43.078 INFO:tasks.workunit.client.3.smithi157.stdout: 8.90 140.8k 118.4k 0.0k 1.4M 1.2M 0.0k nvme2n1 2024-03-26T17:07:43.078 INFO:tasks.workunit.client.3.smithi157.stdout: 8.90 127.2k 106.0k 0.0k 1.2M 1.0M 0.0k nvme2n10 2024-03-26T17:07:43.078 INFO:tasks.workunit.client.3.smithi157.stdout: 8.80 87.2k 95.6k 0.0k 872.0k 956.0k 0.0k nvme2n11 2024-03-26T17:07:43.078 INFO:tasks.workunit.client.3.smithi157.stdout: 8.80 79.6k 96.0k 0.0k 796.0k 960.0k 0.0k nvme2n12 2024-03-26T17:07:43.078 INFO:tasks.workunit.client.3.smithi157.stdout: 8.80 108.0k 153.6k 0.0k 1.1M 1.5M 0.0k nvme2n13 2024-03-26T17:07:43.078 INFO:tasks.workunit.client.3.smithi157.stdout: 8.80 105.2k 58.8k 0.0k 1.0M 588.0k 0.0k nvme2n14 2024-03-26T17:07:43.078 INFO:tasks.workunit.client.3.smithi157.stdout: 8.80 116.4k 95.2k 0.0k 1.1M 952.0k 0.0k nvme2n15 2024-03-26T17:07:43.078 INFO:tasks.workunit.client.3.smithi157.stdout: 8.80 76.0k 76.0k 0.0k 760.0k 760.0k 0.0k nvme2n16 2024-03-26T17:07:43.078 INFO:tasks.workunit.client.3.smithi157.stdout: 8.80 110.8k 61.6k 0.0k 1.1M 616.0k 0.0k nvme2n17 2024-03-26T17:07:43.078 INFO:tasks.workunit.client.3.smithi157.stdout: 8.90 98.0k 136.8k 0.0k 980.0k 1.3M 0.0k nvme2n18 2024-03-26T17:07:43.078 INFO:tasks.workunit.client.3.smithi157.stdout: 8.90 95.2k 95.2k 0.0k 952.0k 952.0k 0.0k nvme2n19 2024-03-26T17:07:43.078 INFO:tasks.workunit.client.3.smithi157.stdout: 8.90 88.0k 95.2k 0.0k 880.0k 952.0k 0.0k nvme2n2 2024-03-26T17:07:43.078 INFO:tasks.workunit.client.3.smithi157.stdout: 8.90 164.4k 141.2k 0.0k 1.6M 1.4M 0.0k nvme2n20 2024-03-26T17:07:43.079 INFO:tasks.workunit.client.3.smithi157.stdout: 8.90 91.2k 94.8k 0.0k 912.0k 948.0k 0.0k nvme2n3 2024-03-26T17:07:43.079 INFO:tasks.workunit.client.3.smithi157.stdout: 8.90 115.2k 132.0k 0.0k 1.1M 1.3M 0.0k nvme2n4 2024-03-26T17:07:43.079 INFO:tasks.workunit.client.3.smithi157.stdout: 8.90 84.0k 60.8k 0.0k 840.0k 608.0k 0.0k nvme2n5 2024-03-26T17:07:43.079 INFO:tasks.workunit.client.3.smithi157.stdout: 8.90 146.0k 140.4k 0.0k 1.4M 1.4M 0.0k nvme2n6 2024-03-26T17:07:43.079 INFO:tasks.workunit.client.3.smithi157.stdout: 8.90 155.2k 127.6k 0.0k 1.5M 1.2M 0.0k nvme2n7 2024-03-26T17:07:43.079 INFO:tasks.workunit.client.3.smithi157.stdout: 8.90 64.8k 75.6k 0.0k 648.0k 756.0k 0.0k nvme2n8 2024-03-26T17:07:43.079 INFO:tasks.workunit.client.3.smithi157.stdout: 8.90 68.4k 83.2k 0.0k 684.0k 832.0k 0.0k nvme2n9 2024-03-26T17:07:43.079 INFO:tasks.workunit.client.3.smithi157.stdout: 8.90 125.6k 126.0k 0.0k 1.2M 1.2M 0.0k nvme5n1 2024-03-26T17:07:43.079 INFO:tasks.workunit.client.3.smithi157.stdout: 8.90 97.2k 80.4k 0.0k 972.0k 804.0k 0.0k nvme5n10 2024-03-26T17:07:43.079 INFO:tasks.workunit.client.3.smithi157.stdout: 8.90 94.0k 93.6k 0.0k 940.0k 936.0k 0.0k nvme5n11 2024-03-26T17:07:43.079 INFO:tasks.workunit.client.3.smithi157.stdout: 8.80 80.8k 95.6k 0.0k 808.0k 956.0k 0.0k nvme5n12 2024-03-26T17:07:43.079 INFO:tasks.workunit.client.3.smithi157.stdout: 8.80 106.0k 78.4k 0.0k 1.0M 784.0k 0.0k nvme5n13 2024-03-26T17:07:43.079 INFO:tasks.workunit.client.3.smithi157.stdout: 8.80 90.4k 88.4k 0.0k 904.0k 884.0k 0.0k nvme5n14 2024-03-26T17:07:43.079 INFO:tasks.workunit.client.3.smithi157.stdout: 8.80 94.4k 84.8k 0.0k 944.0k 848.0k 0.0k nvme5n15 2024-03-26T17:07:43.080 INFO:tasks.workunit.client.3.smithi157.stdout: 8.80 89.6k 109.2k 0.0k 896.0k 1.1M 0.0k nvme5n16 2024-03-26T17:07:43.080 INFO:tasks.workunit.client.3.smithi157.stdout: 8.80 132.4k 129.6k 0.0k 1.3M 1.3M 0.0k nvme5n17 2024-03-26T17:07:43.080 INFO:tasks.workunit.client.3.smithi157.stdout: 8.80 100.8k 65.6k 0.0k 1008.0k 656.0k 0.0k nvme5n18 2024-03-26T17:07:43.080 INFO:tasks.workunit.client.3.smithi157.stdout: 8.90 83.2k 86.8k 0.0k 832.0k 868.0k 0.0k nvme5n19 2024-03-26T17:07:43.080 INFO:tasks.workunit.client.3.smithi157.stdout: 8.90 106.4k 136.8k 0.0k 1.0M 1.3M 0.0k nvme5n2 2024-03-26T17:07:43.080 INFO:tasks.workunit.client.3.smithi157.stdout: 8.90 76.4k 97.6k 0.0k 764.0k 976.0k 0.0k nvme5n20 2024-03-26T17:07:43.080 INFO:tasks.workunit.client.3.smithi157.stdout: 8.90 104.0k 72.4k 0.0k 1.0M 724.0k 0.0k nvme5n3 2024-03-26T17:07:43.080 INFO:tasks.workunit.client.3.smithi157.stdout: 8.90 78.0k 95.6k 0.0k 780.0k 956.0k 0.0k nvme5n4 2024-03-26T17:07:43.080 INFO:tasks.workunit.client.3.smithi157.stdout: 8.90 119.2k 85.2k 0.0k 1.2M 852.0k 0.0k nvme5n5 2024-03-26T17:07:43.080 INFO:tasks.workunit.client.3.smithi157.stdout: 8.90 90.0k 82.4k 0.0k 900.0k 824.0k 0.0k nvme5n6 2024-03-26T17:07:43.080 INFO:tasks.workunit.client.3.smithi157.stdout: 8.90 116.8k 134.4k 0.0k 1.1M 1.3M 0.0k nvme5n7 2024-03-26T17:07:43.080 INFO:tasks.workunit.client.3.smithi157.stdout: 8.90 94.8k 64.8k 0.0k 948.0k 648.0k 0.0k nvme5n8 2024-03-26T17:07:43.080 INFO:tasks.workunit.client.3.smithi157.stdout: 8.90 109.2k 97.6k 0.0k 1.1M 976.0k 0.0k nvme5n9 2024-03-26T17:07:43.080 INFO:tasks.workunit.client.3.smithi157.stdout: 8.90 82.8k 52.8k 0.0k 828.0k 528.0k 0.0k nvme8n1 2024-03-26T17:07:43.081 INFO:tasks.workunit.client.3.smithi157.stdout: 8.90 102.8k 94.0k 0.0k 1.0M 940.0k 0.0k nvme8n10 2024-03-26T17:07:43.081 INFO:tasks.workunit.client.3.smithi157.stdout: 8.80 67.6k 78.0k 0.0k 676.0k 780.0k 0.0k nvme8n11 2024-03-26T17:07:43.081 INFO:tasks.workunit.client.3.smithi157.stdout: 8.80 80.4k 115.2k 0.0k 804.0k 1.1M 0.0k nvme8n12 2024-03-26T17:07:43.081 INFO:tasks.workunit.client.3.smithi157.stdout: 8.80 105.6k 81.6k 0.0k 1.0M 816.0k 0.0k nvme8n13 2024-03-26T17:07:43.081 INFO:tasks.workunit.client.3.smithi157.stdout: 8.80 140.8k 114.8k 0.0k 1.4M 1.1M 0.0k nvme8n14 2024-03-26T17:07:43.081 INFO:tasks.workunit.client.3.smithi157.stdout: 8.80 92.8k 86.4k 0.0k 928.0k 864.0k 0.0k nvme8n15 2024-03-26T17:07:43.081 INFO:tasks.workunit.client.3.smithi157.stdout: 8.80 157.2k 112.4k 0.0k 1.5M 1.1M 0.0k nvme8n16 2024-03-26T17:07:43.081 INFO:tasks.workunit.client.3.smithi157.stdout: 8.80 96.8k 73.2k 0.0k 968.0k 732.0k 0.0k nvme8n17 2024-03-26T17:07:43.081 INFO:tasks.workunit.client.3.smithi157.stdout: 8.90 75.6k 87.6k 0.0k 756.0k 876.0k 0.0k nvme8n18 2024-03-26T17:07:43.081 INFO:tasks.workunit.client.3.smithi157.stdout: 8.90 86.4k 81.2k 0.0k 864.0k 812.0k 0.0k nvme8n19 2024-03-26T17:07:43.081 INFO:tasks.workunit.client.3.smithi157.stdout: 8.90 106.4k 82.8k 0.0k 1.0M 828.0k 0.0k nvme8n2 2024-03-26T17:07:43.081 INFO:tasks.workunit.client.3.smithi157.stdout: 8.90 89.6k 75.6k 0.0k 896.0k 756.0k 0.0k nvme8n20 2024-03-26T17:07:43.081 INFO:tasks.workunit.client.3.smithi157.stdout: 8.90 106.8k 76.0k 0.0k 1.0M 760.0k 0.0k nvme8n3 2024-03-26T17:07:43.081 INFO:tasks.workunit.client.3.smithi157.stdout: 8.90 55.6k 94.4k 0.0k 556.0k 944.0k 0.0k nvme8n4 2024-03-26T17:07:43.081 INFO:tasks.workunit.client.3.smithi157.stdout: 8.90 104.8k 57.2k 0.0k 1.0M 572.0k 0.0k nvme8n5 2024-03-26T17:07:43.082 INFO:tasks.workunit.client.3.smithi157.stdout: 8.90 92.4k 88.8k 0.0k 924.0k 888.0k 0.0k nvme8n6 2024-03-26T17:07:43.082 INFO:tasks.workunit.client.3.smithi157.stdout: 8.90 106.4k 87.6k 0.0k 1.0M 876.0k 0.0k nvme8n7 2024-03-26T17:07:43.082 INFO:tasks.workunit.client.3.smithi157.stdout: 8.90 99.6k 100.0k 0.0k 996.0k 1000.0k 0.0k nvme8n8 2024-03-26T17:07:43.082 INFO:tasks.workunit.client.3.smithi157.stdout: 8.90 82.8k 80.0k 0.0k 828.0k 800.0k 0.0k nvme8n9 2024-03-26T17:07:43.082 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:07:43.104 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:07:42 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:07:42] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:07:43.104 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:07:42 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:07:42] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:07:43.104 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:07:42 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:07:43.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:07:43 smithi149 ceph-mon[34678]: pgmap v654: 33 pgs: 33 active+clean; 1.0 GiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 5.3 MiB/s rd, 5.1 MiB/s wr, 525 op/s 2024-03-26T17:07:43.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:07:43 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-26T17:07:43.408 INFO:tasks.workunit.client.3.smithi157.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-26T17:07:43.408 INFO:tasks.workunit.client.3.smithi157.stdout:myimage40 7/s 4/s 135 KiB/s 88 KiB/s 2.24 ms 325.84 us 2024-03-26T17:07:43.408 INFO:tasks.workunit.client.3.smithi157.stdout:myimage8 5/s 4/s 87 KiB/s 58 KiB/s 2.40 ms 300.21 us 2024-03-26T17:07:43.409 INFO:tasks.workunit.client.3.smithi157.stdout:myimage18 5/s 3/s 118 KiB/s 69 KiB/s 2.09 ms 302.75 us 2024-03-26T17:07:43.409 INFO:tasks.workunit.client.3.smithi157.stdout:myimage22 5/s 5/s 149 KiB/s 124 KiB/s 2.58 ms 300.67 us 2024-03-26T17:07:43.409 INFO:tasks.workunit.client.3.smithi157.stdout:myimage13 5/s 4/s 186 KiB/s 125 KiB/s 2.12 ms 398.07 us 2024-03-26T17:07:43.409 INFO:tasks.workunit.client.3.smithi157.stdout:myimage52 5/s 4/s 98 KiB/s 57 KiB/s 2.49 ms 480.63 us 2024-03-26T17:07:43.409 INFO:tasks.workunit.client.3.smithi157.stdout:myimage9 5/s 4/s 102 KiB/s 81 KiB/s 2.63 ms 335.00 us 2024-03-26T17:07:43.409 INFO:tasks.workunit.client.3.smithi157.stdout:myimage27 5/s 4/s 145 KiB/s 150 KiB/s 2.27 ms 369.89 us 2024-03-26T17:07:43.409 INFO:tasks.workunit.client.3.smithi157.stdout:myimage30 5/s 4/s 80 KiB/s 90 KiB/s 2.82 ms 335.57 us 2024-03-26T17:07:43.409 INFO:tasks.workunit.client.3.smithi157.stdout:myimage38 4/s 3/s 77 KiB/s 58 KiB/s 1.77 ms 319.68 us 2024-03-26T17:07:43.409 INFO:tasks.workunit.client.3.smithi157.stdout:myimage11 4/s 5/s 97 KiB/s 118 KiB/s 2.34 ms 314.11 us 2024-03-26T17:07:43.409 INFO:tasks.workunit.client.3.smithi157.stdout:myimage19 4/s 5/s 106 KiB/s 124 KiB/s 2.39 ms 348.65 us 2024-03-26T17:07:43.409 INFO:tasks.workunit.client.3.smithi157.stdout:myimage21 4/s 3/s 153 KiB/s 114 KiB/s 2.77 ms 316.32 us 2024-03-26T17:07:43.409 INFO:tasks.workunit.client.3.smithi157.stdout:myimage42 4/s 6/s 96 KiB/s 126 KiB/s 2.12 ms 310.97 us 2024-03-26T17:07:43.409 INFO:tasks.workunit.client.3.smithi157.stdout:myimage55 4/s 5/s 118 KiB/s 108 KiB/s 2.55 ms 350.08 us 2024-03-26T17:07:43.410 INFO:tasks.workunit.client.3.smithi157.stdout:myimage2 4/s 4/s 78 KiB/s 85 KiB/s 2.27 ms 286.26 us 2024-03-26T17:07:43.410 INFO:tasks.workunit.client.3.smithi157.stdout:myimage3 4/s 4/s 101 KiB/s 81 KiB/s 1.64 ms 305.82 us 2024-03-26T17:07:43.410 INFO:tasks.workunit.client.3.smithi157.stdout:myimage32 4/s 5/s 94 KiB/s 107 KiB/s 2.28 ms 408.49 us 2024-03-26T17:07:43.410 INFO:tasks.workunit.client.3.smithi157.stdout:myimage34 4/s 4/s 88 KiB/s 113 KiB/s 2.33 ms 311.24 us 2024-03-26T17:07:43.410 INFO:tasks.workunit.client.3.smithi157.stdout:myimage4 4/s 3/s 106 KiB/s 126 KiB/s 2.16 ms 329.08 us 2024-03-26T17:07:43.410 INFO:tasks.workunit.client.3.smithi157.stdout:myimage5 4/s 5/s 78 KiB/s 65 KiB/s 2.15 ms 291.02 us 2024-03-26T17:07:43.410 INFO:tasks.workunit.client.3.smithi157.stdout:myimage15 4/s 4/s 109 KiB/s 119 KiB/s 1.94 ms 418.68 us 2024-03-26T17:07:43.410 INFO:tasks.workunit.client.3.smithi157.stdout:myimage25 4/s 5/s 82 KiB/s 95 KiB/s 3.15 ms 416.82 us 2024-03-26T17:07:43.410 INFO:tasks.workunit.client.3.smithi157.stdout:myimage39 4/s 3/s 86 KiB/s 87 KiB/s 2.25 ms 348.53 us 2024-03-26T17:07:43.410 INFO:tasks.workunit.client.3.smithi157.stdout:myimage41 4/s 5/s 53 KiB/s 86 KiB/s 2.53 ms 300.14 us 2024-03-26T17:07:43.410 INFO:tasks.workunit.client.3.smithi157.stdout:myimage54 4/s 5/s 128 KiB/s 166 KiB/s 2.28 ms 426.10 us 2024-03-26T17:07:43.410 INFO:tasks.workunit.client.3.smithi157.stdout:myimage31 4/s 3/s 64 KiB/s 103 KiB/s 2.89 ms 347.36 us 2024-03-26T17:07:43.410 INFO:tasks.workunit.client.3.smithi157.stdout:myimage37 4/s 4/s 142 KiB/s 138 KiB/s 2.51 ms 323.73 us 2024-03-26T17:07:43.411 INFO:tasks.workunit.client.3.smithi157.stdout:myimage58 4/s 4/s 80 KiB/s 82 KiB/s 2.03 ms 308.12 us 2024-03-26T17:07:43.411 INFO:tasks.workunit.client.3.smithi157.stdout:myimage12 4/s 4/s 91 KiB/s 87 KiB/s 2.61 ms 362.60 us 2024-03-26T17:07:43.411 INFO:tasks.workunit.client.3.smithi157.stdout:myimage24 4/s 5/s 91 KiB/s 105 KiB/s 2.07 ms 300.97 us 2024-03-26T17:07:43.411 INFO:tasks.workunit.client.3.smithi157.stdout:myimage26 4/s 5/s 78 KiB/s 116 KiB/s 2.28 ms 331.73 us 2024-03-26T17:07:43.411 INFO:tasks.workunit.client.3.smithi157.stdout:myimage29 4/s 4/s 94 KiB/s 83 KiB/s 2.10 ms 345.83 us 2024-03-26T17:07:43.411 INFO:tasks.workunit.client.3.smithi157.stdout:myimage46 4/s 5/s 70 KiB/s 122 KiB/s 2.35 ms 427.28 us 2024-03-26T17:07:43.411 INFO:tasks.workunit.client.3.smithi157.stdout:myimage23 4/s 4/s 89 KiB/s 118 KiB/s 2.04 ms 318.04 us 2024-03-26T17:07:43.411 INFO:tasks.workunit.client.3.smithi157.stdout:myimage35 4/s 4/s 75 KiB/s 89 KiB/s 2.11 ms 322.69 us 2024-03-26T17:07:43.411 INFO:tasks.workunit.client.3.smithi157.stdout:myimage20 4/s 3/s 133 KiB/s 105 KiB/s 2.30 ms 450.26 us 2024-03-26T17:07:43.411 INFO:tasks.workunit.client.3.smithi157.stdout:myimage43 4/s 5/s 69 KiB/s 123 KiB/s 2.39 ms 378.13 us 2024-03-26T17:07:43.411 INFO:tasks.workunit.client.3.smithi157.stdout:myimage56 4/s 5/s 125 KiB/s 192 KiB/s 2.69 ms 433.03 us 2024-03-26T17:07:43.411 INFO:tasks.workunit.client.3.smithi157.stdout:myimage10 4/s 3/s 92 KiB/s 102 KiB/s 2.42 ms 364.15 us 2024-03-26T17:07:43.411 INFO:tasks.workunit.client.3.smithi157.stdout:myimage44 3/s 4/s 70 KiB/s 62 KiB/s 2.34 ms 391.53 us 2024-03-26T17:07:43.412 INFO:tasks.workunit.client.3.smithi157.stdout:myimage49 3/s 4/s 70 KiB/s 80 KiB/s 2.16 ms 396.78 us 2024-03-26T17:07:43.412 INFO:tasks.workunit.client.3.smithi157.stdout:myimage1 3/s 4/s 100 KiB/s 133 KiB/s 2.09 ms 335.16 us 2024-03-26T17:07:43.412 INFO:tasks.workunit.client.3.smithi157.stdout:myimage7 3/s 4/s 110 KiB/s 159 KiB/s 2.53 ms 424.31 us 2024-03-26T17:07:43.412 INFO:tasks.workunit.client.3.smithi157.stdout:myimage50 3/s 5/s 67 KiB/s 100 KiB/s 2.40 ms 336.45 us 2024-03-26T17:07:43.412 INFO:tasks.workunit.client.3.smithi157.stdout:myimage57 3/s 5/s 79 KiB/s 99 KiB/s 2.56 ms 387.85 us 2024-03-26T17:07:43.412 INFO:tasks.workunit.client.3.smithi157.stdout:myimage6 3/s 3/s 100 KiB/s 97 KiB/s 2.53 ms 312.76 us 2024-03-26T17:07:43.412 INFO:tasks.workunit.client.3.smithi157.stdout:myimage28 3/s 4/s 68 KiB/s 62 KiB/s 2.84 ms 318.04 us 2024-03-26T17:07:43.412 INFO:tasks.workunit.client.3.smithi157.stdout:myimage16 3/s 3/s 64 KiB/s 63 KiB/s 2.32 ms 300.96 us 2024-03-26T17:07:43.412 INFO:tasks.workunit.client.3.smithi157.stdout:myimage33 3/s 4/s 70 KiB/s 87 KiB/s 2.53 ms 301.89 us 2024-03-26T17:07:43.412 INFO:tasks.workunit.client.3.smithi157.stdout:myimage36 3/s 3/s 92 KiB/s 86 KiB/s 2.23 ms 309.20 us 2024-03-26T17:07:43.412 INFO:tasks.workunit.client.3.smithi157.stdout:myimage45 3/s 6/s 50 KiB/s 124 KiB/s 2.07 ms 312.42 us 2024-03-26T17:07:43.412 INFO:tasks.workunit.client.3.smithi157.stdout:myimage51 3/s 3/s 66 KiB/s 54 KiB/s 2.57 ms 294.80 us 2024-03-26T17:07:43.412 INFO:tasks.workunit.client.3.smithi157.stdout:myimage60 3/s 4/s 54 KiB/s 85 KiB/s 2.32 ms 407.33 us 2024-03-26T17:07:43.412 INFO:tasks.workunit.client.3.smithi157.stdout:myimage59 3/s 6/s 79 KiB/s 120 KiB/s 2.76 ms 336.39 us 2024-03-26T17:07:43.412 INFO:tasks.workunit.client.3.smithi157.stdout:myimage48 3/s 3/s 58 KiB/s 80 KiB/s 2.24 ms 355.34 us 2024-03-26T17:07:43.413 INFO:tasks.workunit.client.3.smithi157.stdout:myimage53 3/s 5/s 75 KiB/s 93 KiB/s 2.31 ms 306.79 us 2024-03-26T17:07:43.413 INFO:tasks.workunit.client.3.smithi157.stdout:myimage14 2/s 4/s 53 KiB/s 84 KiB/s 2.58 ms 369.66 us 2024-03-26T17:07:43.413 INFO:tasks.workunit.client.3.smithi157.stdout:myimage47 2/s 4/s 43 KiB/s 82 KiB/s 2.27 ms 414.55 us 2024-03-26T17:07:43.413 INFO:tasks.workunit.client.3.smithi157.stdout:myimage17 2/s 5/s 50 KiB/s 122 KiB/s 2.49 ms 353.58 us 2024-03-26T17:07:43.413 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:07:43.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:07:43 smithi044 ceph-mon[30624]: pgmap v654: 33 pgs: 33 active+clean; 1.0 GiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 5.3 MiB/s rd, 5.1 MiB/s wr, 525 op/s 2024-03-26T17:07:43.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:07:43 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-26T17:07:43.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:07:43 smithi064 ceph-mon[34420]: pgmap v654: 33 pgs: 33 active+clean; 1.0 GiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 5.3 MiB/s rd, 5.1 MiB/s wr, 525 op/s 2024-03-26T17:07:43.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:07:43 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-26T17:07:44.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:07:44 smithi149 ceph-mon[34678]: Health check update: 3 slow ops, oldest one blocked for 558 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:07:44.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:07:44 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T17:07:44.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:07:44 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-26T17:07:44.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:07:44 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T17:07:44.456 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:07:44 smithi064 ceph-mon[34420]: Health check update: 3 slow ops, oldest one blocked for 558 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:07:44.456 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:07:44 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T17:07:44.456 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:07:44 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-26T17:07:44.456 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:07:44 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T17:07:44.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:07:44 smithi044 ceph-mon[30624]: Health check update: 3 slow ops, oldest one blocked for 558 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:07:44.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:07:44 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T17:07:44.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:07:44 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-26T17:07:44.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:07:44 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T17:07:45.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:07:44 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:07:44] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:07:45.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:07:44 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:07:44] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:07:45.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:07:44 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:07:45.109 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:07:44 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:07:44] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:07:45.109 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:07:44 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:07:44] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:07:45.109 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:07:44 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:07:45.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:07:45 smithi149 ceph-mon[34678]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:07:45.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:07:45 smithi149 ceph-mon[34678]: { 2024-03-26T17:07:45.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:07:45 smithi149 ceph-mon[34678]: "prefix": "rbd perf image stats", 2024-03-26T17:07:45.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:07:45 smithi149 ceph-mon[34678]: "pool_spec": "mypool", 2024-03-26T17:07:45.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:07:45 smithi149 ceph-mon[34678]: "sort_by": "write_ops", 2024-03-26T17:07:45.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:07:45 smithi149 ceph-mon[34678]: "format": "json" 2024-03-26T17:07:45.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:07:45 smithi149 ceph-mon[34678]: }"]: dispatch 2024-03-26T17:07:45.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:07:45 smithi149 ceph-mon[34678]: pgmap v655: 33 pgs: 33 active+clean; 1.0 GiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 5.8 MiB/s rd, 5.5 MiB/s wr, 554 op/s 2024-03-26T17:07:45.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:07:45 smithi149 ceph-mon[34678]: pgmap v656: 33 pgs: 33 active+clean; 1.0 GiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 5.7 MiB/s rd, 5.4 MiB/s wr, 536 op/s 2024-03-26T17:07:45.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:07:45 smithi149 ceph-mon[34678]: pgmap v657: 33 pgs: 33 active+clean; 1.0 GiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 5.4 MiB/s rd, 5.0 MiB/s wr, 495 op/s 2024-03-26T17:07:45.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:07:45 smithi044 ceph-mon[30624]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:07:45.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:07:45 smithi044 ceph-mon[30624]: { 2024-03-26T17:07:45.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:07:45 smithi044 ceph-mon[30624]: "prefix": "rbd perf image stats", 2024-03-26T17:07:45.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:07:45 smithi044 ceph-mon[30624]: "pool_spec": "mypool", 2024-03-26T17:07:45.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:07:45 smithi044 ceph-mon[30624]: "sort_by": "write_ops", 2024-03-26T17:07:45.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:07:45 smithi044 ceph-mon[30624]: "format": "json" 2024-03-26T17:07:45.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:07:45 smithi044 ceph-mon[30624]: }"]: dispatch 2024-03-26T17:07:45.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:07:45 smithi044 ceph-mon[30624]: pgmap v655: 33 pgs: 33 active+clean; 1.0 GiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 5.8 MiB/s rd, 5.5 MiB/s wr, 554 op/s 2024-03-26T17:07:45.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:07:45 smithi044 ceph-mon[30624]: pgmap v656: 33 pgs: 33 active+clean; 1.0 GiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 5.7 MiB/s rd, 5.4 MiB/s wr, 536 op/s 2024-03-26T17:07:45.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:07:45 smithi044 ceph-mon[30624]: pgmap v657: 33 pgs: 33 active+clean; 1.0 GiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 5.4 MiB/s rd, 5.0 MiB/s wr, 495 op/s 2024-03-26T17:07:45.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:07:45 smithi064 ceph-mon[34420]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:07:45.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:07:45 smithi064 ceph-mon[34420]: { 2024-03-26T17:07:45.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:07:45 smithi064 ceph-mon[34420]: "prefix": "rbd perf image stats", 2024-03-26T17:07:45.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:07:45 smithi064 ceph-mon[34420]: "pool_spec": "mypool", 2024-03-26T17:07:45.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:07:45 smithi064 ceph-mon[34420]: "sort_by": "write_ops", 2024-03-26T17:07:45.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:07:45 smithi064 ceph-mon[34420]: "format": "json" 2024-03-26T17:07:45.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:07:45 smithi064 ceph-mon[34420]: }"]: dispatch 2024-03-26T17:07:45.557 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:07:45 smithi064 ceph-mon[34420]: pgmap v655: 33 pgs: 33 active+clean; 1.0 GiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 5.8 MiB/s rd, 5.5 MiB/s wr, 554 op/s 2024-03-26T17:07:45.557 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:07:45 smithi064 ceph-mon[34420]: pgmap v656: 33 pgs: 33 active+clean; 1.0 GiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 5.7 MiB/s rd, 5.4 MiB/s wr, 536 op/s 2024-03-26T17:07:45.557 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:07:45 smithi064 ceph-mon[34420]: pgmap v657: 33 pgs: 33 active+clean; 1.0 GiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 5.4 MiB/s rd, 5.0 MiB/s wr, 495 op/s 2024-03-26T17:07:46.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:07:46 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 2024-03-26T17:07:46.232+0000 7fa707a55700 -1 mon.c@1(peon) e3 get_health_metrics reporting 3 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T17:07:47.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:07:46 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:07:46] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:07:47.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:07:46 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:07:46] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:07:47.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:07:46 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:07:47.114 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:07:46 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:07:46] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:07:47.115 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:07:46 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:07:46] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:07:47.115 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:07:46 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:07:47.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:07:47 smithi149 ceph-mon[34678]: pgmap v658: 33 pgs: 33 active+clean; 1.0 GiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 6.3 MiB/s rd, 5.8 MiB/s wr, 541 op/s 2024-03-26T17:07:47.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:07:47 smithi044 ceph-mon[30624]: pgmap v658: 33 pgs: 33 active+clean; 1.0 GiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 6.3 MiB/s rd, 5.8 MiB/s wr, 541 op/s 2024-03-26T17:07:47.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:07:47 smithi064 ceph-mon[34420]: pgmap v658: 33 pgs: 33 active+clean; 1.0 GiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 6.3 MiB/s rd, 5.8 MiB/s wr, 541 op/s 2024-03-26T17:07:48.412 INFO:tasks.workunit.client.3.smithi157.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-26T17:07:48.412 INFO:tasks.workunit.client.3.smithi157.stdout:myimage45 6/s 3/s 96 KiB/s 65 KiB/s 2.27 ms 319.59 us 2024-03-26T17:07:48.412 INFO:tasks.workunit.client.3.smithi157.stdout:myimage23 5/s 5/s 102 KiB/s 86 KiB/s 1.92 ms 314.13 us 2024-03-26T17:07:48.412 INFO:tasks.workunit.client.3.smithi157.stdout:myimage44 5/s 3/s 101 KiB/s 55 KiB/s 2.45 ms 320.67 us 2024-03-26T17:07:48.412 INFO:tasks.workunit.client.3.smithi157.stdout:myimage58 5/s 5/s 132 KiB/s 107 KiB/s 2.27 ms 349.03 us 2024-03-26T17:07:48.412 INFO:tasks.workunit.client.3.smithi157.stdout:myimage1 5/s 4/s 157 KiB/s 133 KiB/s 2.14 ms 364.68 us 2024-03-26T17:07:48.413 INFO:tasks.workunit.client.3.smithi157.stdout:myimage51 5/s 5/s 138 KiB/s 113 KiB/s 2.45 ms 331.38 us 2024-03-26T17:07:48.413 INFO:tasks.workunit.client.3.smithi157.stdout:myimage2 5/s 4/s 129 KiB/s 122 KiB/s 2.66 ms 349.35 us 2024-03-26T17:07:48.413 INFO:tasks.workunit.client.3.smithi157.stdout:myimage47 5/s 3/s 190 KiB/s 143 KiB/s 2.52 ms 368.75 us 2024-03-26T17:07:48.413 INFO:tasks.workunit.client.3.smithi157.stdout:myimage60 5/s 3/s 148 KiB/s 124 KiB/s 2.45 ms 419.06 us 2024-03-26T17:07:48.413 INFO:tasks.workunit.client.3.smithi157.stdout:myimage54 5/s 4/s 169 KiB/s 146 KiB/s 2.27 ms 381.28 us 2024-03-26T17:07:48.413 INFO:tasks.workunit.client.3.smithi157.stdout:myimage31 5/s 3/s 139 KiB/s 121 KiB/s 2.75 ms 458.67 us 2024-03-26T17:07:48.413 INFO:tasks.workunit.client.3.smithi157.stdout:myimage38 5/s 6/s 118 KiB/s 123 KiB/s 2.01 ms 327.81 us 2024-03-26T17:07:48.413 INFO:tasks.workunit.client.3.smithi157.stdout:myimage4 5/s 4/s 154 KiB/s 105 KiB/s 2.39 ms 350.51 us 2024-03-26T17:07:48.413 INFO:tasks.workunit.client.3.smithi157.stdout:myimage21 5/s 4/s 137 KiB/s 118 KiB/s 2.81 ms 370.86 us 2024-03-26T17:07:48.413 INFO:tasks.workunit.client.3.smithi157.stdout:myimage3 4/s 3/s 142 KiB/s 127 KiB/s 1.92 ms 327.55 us 2024-03-26T17:07:48.413 INFO:tasks.workunit.client.3.smithi157.stdout:myimage7 4/s 4/s 156 KiB/s 119 KiB/s 2.40 ms 350.53 us 2024-03-26T17:07:48.413 INFO:tasks.workunit.client.3.smithi157.stdout:myimage19 4/s 3/s 102 KiB/s 58 KiB/s 2.60 ms 349.77 us 2024-03-26T17:07:48.413 INFO:tasks.workunit.client.3.smithi157.stdout:myimage43 4/s 3/s 122 KiB/s 48 KiB/s 2.26 ms 457.68 us 2024-03-26T17:07:48.414 INFO:tasks.workunit.client.3.smithi157.stdout:myimage14 4/s 6/s 87 KiB/s 135 KiB/s 2.69 ms 460.82 us 2024-03-26T17:07:48.414 INFO:tasks.workunit.client.3.smithi157.stdout:myimage40 4/s 3/s 81 KiB/s 113 KiB/s 2.39 ms 366.62 us 2024-03-26T17:07:48.414 INFO:tasks.workunit.client.3.smithi157.stdout:myimage48 4/s 5/s 158 KiB/s 154 KiB/s 2.63 ms 321.35 us 2024-03-26T17:07:48.414 INFO:tasks.workunit.client.3.smithi157.stdout:myimage5 4/s 4/s 108 KiB/s 103 KiB/s 2.60 ms 391.73 us 2024-03-26T17:07:48.414 INFO:tasks.workunit.client.3.smithi157.stdout:myimage6 4/s 5/s 171 KiB/s 203 KiB/s 2.61 ms 361.41 us 2024-03-26T17:07:48.414 INFO:tasks.workunit.client.3.smithi157.stdout:myimage17 4/s 5/s 72 KiB/s 114 KiB/s 2.44 ms 398.60 us 2024-03-26T17:07:48.414 INFO:tasks.workunit.client.3.smithi157.stdout:myimage26 4/s 4/s 90 KiB/s 62 KiB/s 2.40 ms 326.23 us 2024-03-26T17:07:48.414 INFO:tasks.workunit.client.3.smithi157.stdout:myimage28 4/s 5/s 95 KiB/s 109 KiB/s 3.15 ms 327.97 us 2024-03-26T17:07:48.414 INFO:tasks.workunit.client.3.smithi157.stdout:myimage18 4/s 4/s 153 KiB/s 170 KiB/s 2.27 ms 369.49 us 2024-03-26T17:07:48.414 INFO:tasks.workunit.client.3.smithi157.stdout:myimage24 4/s 5/s 90 KiB/s 85 KiB/s 2.04 ms 450.82 us 2024-03-26T17:07:48.414 INFO:tasks.workunit.client.3.smithi157.stdout:myimage36 4/s 4/s 145 KiB/s 101 KiB/s 2.24 ms 394.35 us 2024-03-26T17:07:48.414 INFO:tasks.workunit.client.3.smithi157.stdout:myimage42 4/s 3/s 125 KiB/s 90 KiB/s 2.15 ms 334.26 us 2024-03-26T17:07:48.414 INFO:tasks.workunit.client.3.smithi157.stdout:myimage50 4/s 4/s 137 KiB/s 162 KiB/s 2.51 ms 386.35 us 2024-03-26T17:07:48.414 INFO:tasks.workunit.client.3.smithi157.stdout:myimage57 4/s 4/s 72 KiB/s 80 KiB/s 2.37 ms 330.64 us 2024-03-26T17:07:48.415 INFO:tasks.workunit.client.3.smithi157.stdout:myimage59 4/s 2/s 76 KiB/s 41 KiB/s 3.21 ms 292.55 us 2024-03-26T17:07:48.415 INFO:tasks.workunit.client.3.smithi157.stdout:myimage16 4/s 5/s 54 KiB/s 98 KiB/s 2.42 ms 403.33 us 2024-03-26T17:07:48.415 INFO:tasks.workunit.client.3.smithi157.stdout:myimage52 4/s 4/s 166 KiB/s 155 KiB/s 2.57 ms 421.72 us 2024-03-26T17:07:48.415 INFO:tasks.workunit.client.3.smithi157.stdout:myimage27 4/s 4/s 140 KiB/s 101 KiB/s 2.13 ms 352.97 us 2024-03-26T17:07:48.415 INFO:tasks.workunit.client.3.smithi157.stdout:myimage33 4/s 5/s 95 KiB/s 94 KiB/s 2.21 ms 390.37 us 2024-03-26T17:07:48.415 INFO:tasks.workunit.client.3.smithi157.stdout:myimage13 3/s 3/s 120 KiB/s 154 KiB/s 2.11 ms 408.96 us 2024-03-26T17:07:48.415 INFO:tasks.workunit.client.3.smithi157.stdout:myimage32 3/s 3/s 81 KiB/s 62 KiB/s 2.33 ms 355.87 us 2024-03-26T17:07:48.415 INFO:tasks.workunit.client.3.smithi157.stdout:myimage37 3/s 3/s 134 KiB/s 118 KiB/s 2.44 ms 368.27 us 2024-03-26T17:07:48.415 INFO:tasks.workunit.client.3.smithi157.stdout:myimage12 3/s 5/s 66 KiB/s 84 KiB/s 2.63 ms 340.02 us 2024-03-26T17:07:48.415 INFO:tasks.workunit.client.3.smithi157.stdout:myimage15 3/s 4/s 154 KiB/s 120 KiB/s 2.19 ms 395.19 us 2024-03-26T17:07:48.415 INFO:tasks.workunit.client.3.smithi157.stdout:myimage20 3/s 4/s 119 KiB/s 140 KiB/s 2.21 ms 377.32 us 2024-03-26T17:07:48.415 INFO:tasks.workunit.client.3.smithi157.stdout:myimage29 3/s 4/s 98 KiB/s 147 KiB/s 2.22 ms 402.36 us 2024-03-26T17:07:48.415 INFO:tasks.workunit.client.3.smithi157.stdout:myimage56 3/s 4/s 122 KiB/s 174 KiB/s 2.91 ms 505.37 us 2024-03-26T17:07:48.415 INFO:tasks.workunit.client.3.smithi157.stdout:myimage22 3/s 5/s 105 KiB/s 153 KiB/s 2.43 ms 324.54 us 2024-03-26T17:07:48.416 INFO:tasks.workunit.client.3.smithi157.stdout:myimage53 3/s 5/s 76 KiB/s 100 KiB/s 2.32 ms 500.77 us 2024-03-26T17:07:48.416 INFO:tasks.workunit.client.3.smithi157.stdout:myimage10 3/s 4/s 99 KiB/s 140 KiB/s 2.26 ms 316.00 us 2024-03-26T17:07:48.416 INFO:tasks.workunit.client.3.smithi157.stdout:myimage30 3/s 3/s 61 KiB/s 71 KiB/s 3.10 ms 574.24 us 2024-03-26T17:07:48.416 INFO:tasks.workunit.client.3.smithi157.stdout:myimage34 3/s 3/s 49 KiB/s 60 KiB/s 2.44 ms 478.10 us 2024-03-26T17:07:48.416 INFO:tasks.workunit.client.3.smithi157.stdout:myimage49 3/s 5/s 74 KiB/s 94 KiB/s 2.39 ms 334.98 us 2024-03-26T17:07:48.416 INFO:tasks.workunit.client.3.smithi157.stdout:myimage9 3/s 6/s 57 KiB/s 147 KiB/s 2.46 ms 321.98 us 2024-03-26T17:07:48.416 INFO:tasks.workunit.client.3.smithi157.stdout:myimage25 3/s 5/s 149 KiB/s 164 KiB/s 3.39 ms 352.31 us 2024-03-26T17:07:48.416 INFO:tasks.workunit.client.3.smithi157.stdout:myimage11 3/s 4/s 50 KiB/s 87 KiB/s 2.35 ms 317.44 us 2024-03-26T17:07:48.416 INFO:tasks.workunit.client.3.smithi157.stdout:myimage39 3/s 2/s 58 KiB/s 43 KiB/s 2.27 ms 327.51 us 2024-03-26T17:07:48.416 INFO:tasks.workunit.client.3.smithi157.stdout:myimage41 3/s 3/s 54 KiB/s 74 KiB/s 2.55 ms 370.93 us 2024-03-26T17:07:48.417 INFO:tasks.workunit.client.3.smithi157.stdout:myimage46 3/s 4/s 118 KiB/s 114 KiB/s 2.36 ms 351.11 us 2024-03-26T17:07:48.417 INFO:tasks.workunit.client.3.smithi157.stdout:myimage35 3/s 5/s 66 KiB/s 79 KiB/s 2.32 ms 381.21 us 2024-03-26T17:07:48.417 INFO:tasks.workunit.client.3.smithi157.stdout:myimage8 2/s 5/s 37 KiB/s 91 KiB/s 2.08 ms 281.91 us 2024-03-26T17:07:48.417 INFO:tasks.workunit.client.3.smithi157.stdout:myimage55 2/s 5/s 46 KiB/s 99 KiB/s 2.62 ms 319.66 us 2024-03-26T17:07:48.417 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:07:49.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:07:48 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:07:48] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:07:49.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:07:48 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:07:48] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:07:49.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:07:48 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:07:49.116 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:07:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:07:48] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:07:49.117 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:07:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:07:48] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:07:49.117 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:07:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:07:49.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:07:49 smithi149 ceph-mon[34678]: pgmap v659: 33 pgs: 33 active+clean; 1.0 GiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 6.6 MiB/s rd, 6.3 MiB/s wr, 554 op/s 2024-03-26T17:07:49.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:07:49 smithi149 ceph-mon[34678]: Health check update: 3 slow ops, oldest one blocked for 563 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:07:49.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:07:49 smithi044 ceph-mon[30624]: pgmap v659: 33 pgs: 33 active+clean; 1.0 GiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 6.6 MiB/s rd, 6.3 MiB/s wr, 554 op/s 2024-03-26T17:07:49.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:07:49 smithi044 ceph-mon[30624]: Health check update: 3 slow ops, oldest one blocked for 563 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:07:49.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:07:49 smithi064 ceph-mon[34420]: pgmap v659: 33 pgs: 33 active+clean; 1.0 GiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 6.6 MiB/s rd, 6.3 MiB/s wr, 554 op/s 2024-03-26T17:07:49.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:07:49 smithi064 ceph-mon[34420]: Health check update: 3 slow ops, oldest one blocked for 563 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:07:50.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:07:50 smithi149 ceph-mon[34678]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:07:50.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:07:50 smithi149 ceph-mon[34678]: { 2024-03-26T17:07:50.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:07:50 smithi149 ceph-mon[34678]: "prefix": "rbd perf image stats", 2024-03-26T17:07:50.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:07:50 smithi149 ceph-mon[34678]: "pool_spec": "mypool", 2024-03-26T17:07:50.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:07:50 smithi149 ceph-mon[34678]: "sort_by": "write_ops", 2024-03-26T17:07:50.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:07:50 smithi149 ceph-mon[34678]: "format": "json" 2024-03-26T17:07:50.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:07:50 smithi149 ceph-mon[34678]: }"]: dispatch 2024-03-26T17:07:50.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:07:50 smithi044 ceph-mon[30624]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:07:50.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:07:50 smithi044 ceph-mon[30624]: { 2024-03-26T17:07:50.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:07:50 smithi044 ceph-mon[30624]: "prefix": "rbd perf image stats", 2024-03-26T17:07:50.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:07:50 smithi044 ceph-mon[30624]: "pool_spec": "mypool", 2024-03-26T17:07:50.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:07:50 smithi044 ceph-mon[30624]: "sort_by": "write_ops", 2024-03-26T17:07:50.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:07:50 smithi044 ceph-mon[30624]: "format": "json" 2024-03-26T17:07:50.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:07:50 smithi044 ceph-mon[30624]: }"]: dispatch 2024-03-26T17:07:50.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:07:50 smithi064 ceph-mon[34420]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:07:50.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:07:50 smithi064 ceph-mon[34420]: { 2024-03-26T17:07:50.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:07:50 smithi064 ceph-mon[34420]: "prefix": "rbd perf image stats", 2024-03-26T17:07:50.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:07:50 smithi064 ceph-mon[34420]: "pool_spec": "mypool", 2024-03-26T17:07:50.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:07:50 smithi064 ceph-mon[34420]: "sort_by": "write_ops", 2024-03-26T17:07:50.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:07:50 smithi064 ceph-mon[34420]: "format": "json" 2024-03-26T17:07:50.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:07:50 smithi064 ceph-mon[34420]: }"]: dispatch 2024-03-26T17:07:51.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:07:50 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:07:50] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:07:51.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:07:50 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:07:50] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:07:51.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:07:50 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:07:51.146 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:07:51 smithi149 ceph-mon[34678]: pgmap v660: 33 pgs: 33 active+clean; 1.0 GiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 6.7 MiB/s rd, 6.5 MiB/s wr, 549 op/s 2024-03-26T17:07:51.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:07:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:07:50] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:07:51.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:07:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:07:50] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:07:51.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:07:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:07:51.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:07:51 smithi044 ceph-mon[30624]: pgmap v660: 33 pgs: 33 active+clean; 1.0 GiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 6.7 MiB/s rd, 6.5 MiB/s wr, 549 op/s 2024-03-26T17:07:51.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:07:51 smithi064 ceph-mon[34420]: pgmap v660: 33 pgs: 33 active+clean; 1.0 GiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 6.7 MiB/s rd, 6.5 MiB/s wr, 549 op/s 2024-03-26T17:07:51.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:07:51 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 2024-03-26T17:07:51.233+0000 7fa707a55700 -1 mon.c@1(peon) e3 get_health_metrics reporting 3 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T17:07:53.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:07:52 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:07:52] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:07:53.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:07:52 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:07:52] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:07:53.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:07:52 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:07:53.062 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:07:53.070 INFO:tasks.workunit.client.3.smithi157.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2024-03-26T17:07:53.070 INFO:tasks.workunit.client.3.smithi157.stdout: 8.50 113.2k 175.2k 0.0k 1.1M 1.7M 0.0k nvme2n1 2024-03-26T17:07:53.070 INFO:tasks.workunit.client.3.smithi157.stdout: 8.50 132.0k 110.8k 0.0k 1.3M 1.1M 0.0k nvme2n10 2024-03-26T17:07:53.070 INFO:tasks.workunit.client.3.smithi157.stdout: 8.60 70.4k 67.2k 0.0k 704.0k 672.0k 0.0k nvme2n11 2024-03-26T17:07:53.070 INFO:tasks.workunit.client.3.smithi157.stdout: 8.60 96.8k 73.6k 0.0k 968.0k 736.0k 0.0k nvme2n12 2024-03-26T17:07:53.070 INFO:tasks.workunit.client.3.smithi157.stdout: 8.60 158.0k 142.8k 0.0k 1.5M 1.4M 0.0k nvme2n13 2024-03-26T17:07:53.070 INFO:tasks.workunit.client.3.smithi157.stdout: 8.60 114.4k 127.2k 0.0k 1.1M 1.2M 0.0k nvme2n14 2024-03-26T17:07:53.070 INFO:tasks.workunit.client.3.smithi157.stdout: 8.60 112.8k 158.4k 0.0k 1.1M 1.5M 0.0k nvme2n15 2024-03-26T17:07:53.070 INFO:tasks.workunit.client.3.smithi157.stdout: 8.60 124.4k 121.2k 0.0k 1.2M 1.2M 0.0k nvme2n16 2024-03-26T17:07:53.071 INFO:tasks.workunit.client.3.smithi157.stdout: 8.60 134.8k 112.4k 0.0k 1.3M 1.1M 0.0k nvme2n17 2024-03-26T17:07:53.071 INFO:tasks.workunit.client.3.smithi157.stdout: 8.60 141.6k 108.8k 0.0k 1.4M 1.1M 0.0k nvme2n18 2024-03-26T17:07:53.071 INFO:tasks.workunit.client.3.smithi157.stdout: 8.60 151.2k 125.6k 0.0k 1.5M 1.2M 0.0k nvme2n19 2024-03-26T17:07:53.071 INFO:tasks.workunit.client.3.smithi157.stdout: 8.50 157.6k 110.8k 0.0k 1.5M 1.1M 0.0k nvme2n2 2024-03-26T17:07:53.071 INFO:tasks.workunit.client.3.smithi157.stdout: 8.50 137.6k 142.4k 0.0k 1.3M 1.4M 0.0k nvme2n20 2024-03-26T17:07:53.071 INFO:tasks.workunit.client.3.smithi157.stdout: 8.50 127.6k 157.6k 0.0k 1.2M 1.5M 0.0k nvme2n3 2024-03-26T17:07:53.071 INFO:tasks.workunit.client.3.smithi157.stdout: 8.50 120.0k 107.2k 0.0k 1.2M 1.0M 0.0k nvme2n4 2024-03-26T17:07:53.071 INFO:tasks.workunit.client.3.smithi157.stdout: 8.50 152.0k 124.8k 0.0k 1.5M 1.2M 0.0k nvme2n5 2024-03-26T17:07:53.071 INFO:tasks.workunit.client.3.smithi157.stdout: 8.50 118.4k 150.4k 0.0k 1.2M 1.5M 0.0k nvme2n6 2024-03-26T17:07:53.071 INFO:tasks.workunit.client.3.smithi157.stdout: 8.50 146.0k 131.2k 0.0k 1.4M 1.3M 0.0k nvme2n7 2024-03-26T17:07:53.071 INFO:tasks.workunit.client.3.smithi157.stdout: 8.50 119.2k 133.2k 0.0k 1.2M 1.3M 0.0k nvme2n8 2024-03-26T17:07:53.071 INFO:tasks.workunit.client.3.smithi157.stdout: 8.50 166.0k 106.8k 0.0k 1.6M 1.0M 0.0k nvme2n9 2024-03-26T17:07:53.071 INFO:tasks.workunit.client.3.smithi157.stdout: 8.50 101.2k 146.0k 0.0k 1012.0k 1.4M 0.0k nvme5n1 2024-03-26T17:07:53.071 INFO:tasks.workunit.client.3.smithi157.stdout: 8.50 78.0k 98.8k 0.0k 780.0k 988.0k 0.0k nvme5n10 2024-03-26T17:07:53.071 INFO:tasks.workunit.client.3.smithi157.stdout: 8.50 164.0k 117.6k 0.0k 1.6M 1.1M 0.0k nvme5n11 2024-03-26T17:07:53.072 INFO:tasks.workunit.client.3.smithi157.stdout: 8.60 100.0k 87.6k 0.0k 1000.0k 876.0k 0.0k nvme5n12 2024-03-26T17:07:53.072 INFO:tasks.workunit.client.3.smithi157.stdout: 8.60 132.0k 91.2k 0.0k 1.3M 912.0k 0.0k nvme5n13 2024-03-26T17:07:53.072 INFO:tasks.workunit.client.3.smithi157.stdout: 8.60 82.0k 73.2k 0.0k 820.0k 732.0k 0.0k nvme5n14 2024-03-26T17:07:53.072 INFO:tasks.workunit.client.3.smithi157.stdout: 8.60 89.6k 100.8k 0.0k 896.0k 1008.0k 0.0k nvme5n15 2024-03-26T17:07:53.072 INFO:tasks.workunit.client.3.smithi157.stdout: 8.60 168.0k 108.8k 0.0k 1.6M 1.1M 0.0k nvme5n16 2024-03-26T17:07:53.072 INFO:tasks.workunit.client.3.smithi157.stdout: 8.60 92.8k 143.2k 0.0k 928.0k 1.4M 0.0k nvme5n17 2024-03-26T17:07:53.072 INFO:tasks.workunit.client.3.smithi157.stdout: 8.60 112.8k 126.0k 0.0k 1.1M 1.2M 0.0k nvme5n18 2024-03-26T17:07:53.072 INFO:tasks.workunit.client.3.smithi157.stdout: 8.60 122.8k 112.0k 0.0k 1.2M 1.1M 0.0k nvme5n19 2024-03-26T17:07:53.072 INFO:tasks.workunit.client.3.smithi157.stdout: 8.50 137.6k 116.4k 0.0k 1.3M 1.1M 0.0k nvme5n2 2024-03-26T17:07:53.072 INFO:tasks.workunit.client.3.smithi157.stdout: 8.50 142.4k 110.4k 0.0k 1.4M 1.1M 0.0k nvme5n20 2024-03-26T17:07:53.072 INFO:tasks.workunit.client.3.smithi157.stdout: 8.50 85.6k 105.2k 0.0k 856.0k 1.0M 0.0k nvme5n3 2024-03-26T17:07:53.072 INFO:tasks.workunit.client.3.smithi157.stdout: 8.50 76.4k 108.0k 0.0k 764.0k 1.1M 0.0k nvme5n4 2024-03-26T17:07:53.072 INFO:tasks.workunit.client.3.smithi157.stdout: 8.50 136.0k 132.8k 0.0k 1.3M 1.3M 0.0k nvme5n5 2024-03-26T17:07:53.072 INFO:tasks.workunit.client.3.smithi157.stdout: 8.50 74.4k 117.6k 0.0k 744.0k 1.1M 0.0k nvme5n6 2024-03-26T17:07:53.073 INFO:tasks.workunit.client.3.smithi157.stdout: 8.50 136.4k 136.4k 0.0k 1.3M 1.3M 0.0k nvme5n7 2024-03-26T17:07:53.073 INFO:tasks.workunit.client.3.smithi157.stdout: 8.50 108.4k 131.6k 0.0k 1.1M 1.3M 0.0k nvme5n8 2024-03-26T17:07:53.073 INFO:tasks.workunit.client.3.smithi157.stdout: 8.50 136.8k 132.8k 0.0k 1.3M 1.3M 0.0k nvme5n9 2024-03-26T17:07:53.073 INFO:tasks.workunit.client.3.smithi157.stdout: 8.50 102.0k 113.2k 0.0k 1020.0k 1.1M 0.0k nvme8n1 2024-03-26T17:07:53.073 INFO:tasks.workunit.client.3.smithi157.stdout: 8.50 150.8k 142.0k 0.0k 1.5M 1.4M 0.0k nvme8n10 2024-03-26T17:07:53.073 INFO:tasks.workunit.client.3.smithi157.stdout: 8.60 130.4k 142.4k 0.0k 1.3M 1.4M 0.0k nvme8n11 2024-03-26T17:07:53.073 INFO:tasks.workunit.client.3.smithi157.stdout: 8.60 184.4k 137.6k 0.0k 1.8M 1.3M 0.0k nvme8n12 2024-03-26T17:07:53.073 INFO:tasks.workunit.client.3.smithi157.stdout: 8.60 85.2k 76.0k 0.0k 852.0k 760.0k 0.0k nvme8n13 2024-03-26T17:07:53.073 INFO:tasks.workunit.client.3.smithi157.stdout: 8.60 130.0k 133.6k 0.0k 1.3M 1.3M 0.0k nvme8n14 2024-03-26T17:07:53.073 INFO:tasks.workunit.client.3.smithi157.stdout: 8.60 81.6k 54.4k 0.0k 816.0k 544.0k 0.0k nvme8n15 2024-03-26T17:07:53.073 INFO:tasks.workunit.client.3.smithi157.stdout: 8.60 150.8k 141.6k 0.0k 1.5M 1.4M 0.0k nvme8n16 2024-03-26T17:07:53.073 INFO:tasks.workunit.client.3.smithi157.stdout: 8.60 132.4k 114.4k 0.0k 1.3M 1.1M 0.0k nvme8n17 2024-03-26T17:07:53.073 INFO:tasks.workunit.client.3.smithi157.stdout: 8.60 117.6k 142.4k 0.0k 1.1M 1.4M 0.0k nvme8n18 2024-03-26T17:07:53.073 INFO:tasks.workunit.client.3.smithi157.stdout: 8.60 140.4k 135.2k 0.0k 1.4M 1.3M 0.0k nvme8n19 2024-03-26T17:07:53.073 INFO:tasks.workunit.client.3.smithi157.stdout: 8.50 113.2k 141.6k 0.0k 1.1M 1.4M 0.0k nvme8n2 2024-03-26T17:07:53.074 INFO:tasks.workunit.client.3.smithi157.stdout: 8.50 135.6k 146.8k 0.0k 1.3M 1.4M 0.0k nvme8n20 2024-03-26T17:07:53.074 INFO:tasks.workunit.client.3.smithi157.stdout: 8.50 58.8k 75.2k 0.0k 588.0k 752.0k 0.0k nvme8n3 2024-03-26T17:07:53.074 INFO:tasks.workunit.client.3.smithi157.stdout: 8.50 132.8k 109.2k 0.0k 1.3M 1.1M 0.0k nvme8n4 2024-03-26T17:07:53.074 INFO:tasks.workunit.client.3.smithi157.stdout: 8.50 105.6k 116.0k 0.0k 1.0M 1.1M 0.0k nvme8n5 2024-03-26T17:07:53.074 INFO:tasks.workunit.client.3.smithi157.stdout: 8.50 144.0k 130.4k 0.0k 1.4M 1.3M 0.0k nvme8n6 2024-03-26T17:07:53.074 INFO:tasks.workunit.client.3.smithi157.stdout: 8.50 94.0k 167.2k 0.0k 940.0k 1.6M 0.0k nvme8n7 2024-03-26T17:07:53.074 INFO:tasks.workunit.client.3.smithi157.stdout: 8.50 120.8k 172.0k 0.0k 1.2M 1.7M 0.0k nvme8n8 2024-03-26T17:07:53.074 INFO:tasks.workunit.client.3.smithi157.stdout: 8.50 84.8k 64.8k 0.0k 848.0k 648.0k 0.0k nvme8n9 2024-03-26T17:07:53.074 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:07:53.146 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:07:53 smithi149 ceph-mon[34678]: pgmap v661: 33 pgs: 33 active+clean; 1.0 GiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 6.2 MiB/s rd, 6.2 MiB/s wr, 495 op/s 2024-03-26T17:07:53.147 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:07:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:07:52] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:07:53.147 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:07:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:07:52] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:07:53.147 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:07:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:07:53.416 INFO:tasks.workunit.client.3.smithi157.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-26T17:07:53.416 INFO:tasks.workunit.client.3.smithi157.stdout:myimage34 6/s 4/s 101 KiB/s 99 KiB/s 2.49 ms 320.49 us 2024-03-26T17:07:53.416 INFO:tasks.workunit.client.3.smithi157.stdout:myimage30 5/s 4/s 123 KiB/s 95 KiB/s 2.95 ms 329.69 us 2024-03-26T17:07:53.416 INFO:tasks.workunit.client.3.smithi157.stdout:myimage44 5/s 4/s 139 KiB/s 146 KiB/s 2.46 ms 348.40 us 2024-03-26T17:07:53.416 INFO:tasks.workunit.client.3.smithi157.stdout:myimage1 5/s 2/s 186 KiB/s 88 KiB/s 2.03 ms 348.08 us 2024-03-26T17:07:53.416 INFO:tasks.workunit.client.3.smithi157.stdout:myimage39 5/s 5/s 128 KiB/s 157 KiB/s 2.22 ms 467.10 us 2024-03-26T17:07:53.417 INFO:tasks.workunit.client.3.smithi157.stdout:myimage27 5/s 3/s 155 KiB/s 116 KiB/s 2.20 ms 326.79 us 2024-03-26T17:07:53.417 INFO:tasks.workunit.client.3.smithi157.stdout:myimage32 5/s 7/s 90 KiB/s 151 KiB/s 2.33 ms 384.85 us 2024-03-26T17:07:53.417 INFO:tasks.workunit.client.3.smithi157.stdout:myimage15 5/s 4/s 149 KiB/s 122 KiB/s 2.29 ms 335.77 us 2024-03-26T17:07:53.417 INFO:tasks.workunit.client.3.smithi157.stdout:myimage24 5/s 2/s 115 KiB/s 56 KiB/s 2.06 ms 412.78 us 2024-03-26T17:07:53.417 INFO:tasks.workunit.client.3.smithi157.stdout:myimage26 5/s 3/s 166 KiB/s 51 KiB/s 2.26 ms 331.54 us 2024-03-26T17:07:53.417 INFO:tasks.workunit.client.3.smithi157.stdout:myimage37 5/s 4/s 130 KiB/s 104 KiB/s 2.89 ms 380.07 us 2024-03-26T17:07:53.417 INFO:tasks.workunit.client.3.smithi157.stdout:myimage48 5/s 3/s 166 KiB/s 110 KiB/s 2.70 ms 403.04 us 2024-03-26T17:07:53.417 INFO:tasks.workunit.client.3.smithi157.stdout:myimage43 5/s 5/s 72 KiB/s 81 KiB/s 2.43 ms 445.40 us 2024-03-26T17:07:53.417 INFO:tasks.workunit.client.3.smithi157.stdout:myimage51 5/s 3/s 158 KiB/s 118 KiB/s 2.64 ms 355.26 us 2024-03-26T17:07:53.417 INFO:tasks.workunit.client.3.smithi157.stdout:myimage16 4/s 4/s 144 KiB/s 109 KiB/s 2.37 ms 340.43 us 2024-03-26T17:07:53.417 INFO:tasks.workunit.client.3.smithi157.stdout:myimage54 4/s 4/s 137 KiB/s 133 KiB/s 2.32 ms 364.93 us 2024-03-26T17:07:53.417 INFO:tasks.workunit.client.3.smithi157.stdout:myimage57 4/s 4/s 124 KiB/s 149 KiB/s 2.34 ms 401.04 us 2024-03-26T17:07:53.417 INFO:tasks.workunit.client.3.smithi157.stdout:myimage10 4/s 4/s 114 KiB/s 126 KiB/s 2.34 ms 333.30 us 2024-03-26T17:07:53.417 INFO:tasks.workunit.client.3.smithi157.stdout:myimage3 4/s 4/s 156 KiB/s 134 KiB/s 2.14 ms 448.52 us 2024-03-26T17:07:53.417 INFO:tasks.workunit.client.3.smithi157.stdout:myimage8 4/s 4/s 192 KiB/s 117 KiB/s 2.51 ms 323.39 us 2024-03-26T17:07:53.417 INFO:tasks.workunit.client.3.smithi157.stdout:myimage12 4/s 4/s 60 KiB/s 62 KiB/s 2.27 ms 327.37 us 2024-03-26T17:07:53.418 INFO:tasks.workunit.client.3.smithi157.stdout:myimage19 4/s 5/s 146 KiB/s 182 KiB/s 2.47 ms 483.71 us 2024-03-26T17:07:53.418 INFO:tasks.workunit.client.3.smithi157.stdout:myimage6 4/s 3/s 138 KiB/s 103 KiB/s 2.65 ms 395.65 us 2024-03-26T17:07:53.418 INFO:tasks.workunit.client.3.smithi157.stdout:myimage20 4/s 4/s 142 KiB/s 163 KiB/s 2.43 ms 311.94 us 2024-03-26T17:07:53.418 INFO:tasks.workunit.client.3.smithi157.stdout:myimage25 4/s 4/s 132 KiB/s 122 KiB/s 2.80 ms 301.68 us 2024-03-26T17:07:53.418 INFO:tasks.workunit.client.3.smithi157.stdout:myimage36 4/s 4/s 100 KiB/s 162 KiB/s 2.32 ms 345.44 us 2024-03-26T17:07:53.418 INFO:tasks.workunit.client.3.smithi157.stdout:myimage41 4/s 4/s 110 KiB/s 122 KiB/s 2.46 ms 390.24 us 2024-03-26T17:07:53.418 INFO:tasks.workunit.client.3.smithi157.stdout:myimage45 4/s 3/s 130 KiB/s 76 KiB/s 2.41 ms 442.93 us 2024-03-26T17:07:53.418 INFO:tasks.workunit.client.3.smithi157.stdout:myimage56 4/s 4/s 145 KiB/s 111 KiB/s 2.80 ms 420.05 us 2024-03-26T17:07:53.418 INFO:tasks.workunit.client.3.smithi157.stdout:myimage47 4/s 3/s 163 KiB/s 85 KiB/s 2.43 ms 286.13 us 2024-03-26T17:07:53.418 INFO:tasks.workunit.client.3.smithi157.stdout:myimage58 4/s 2/s 133 KiB/s 99 KiB/s 2.26 ms 325.11 us 2024-03-26T17:07:53.418 INFO:tasks.workunit.client.3.smithi157.stdout:myimage11 4/s 4/s 66 KiB/s 64 KiB/s 2.40 ms 324.11 us 2024-03-26T17:07:53.418 INFO:tasks.workunit.client.3.smithi157.stdout:myimage18 4/s 4/s 109 KiB/s 113 KiB/s 2.15 ms 465.08 us 2024-03-26T17:07:53.418 INFO:tasks.workunit.client.3.smithi157.stdout:myimage21 4/s 3/s 138 KiB/s 98 KiB/s 3.25 ms 505.30 us 2024-03-26T17:07:53.418 INFO:tasks.workunit.client.3.smithi157.stdout:myimage28 4/s 3/s 138 KiB/s 98 KiB/s 2.91 ms 351.54 us 2024-03-26T17:07:53.419 INFO:tasks.workunit.client.3.smithi157.stdout:myimage14 4/s 4/s 116 KiB/s 134 KiB/s 2.50 ms 375.58 us 2024-03-26T17:07:53.419 INFO:tasks.workunit.client.3.smithi157.stdout:myimage49 4/s 3/s 62 KiB/s 58 KiB/s 2.66 ms 335.35 us 2024-03-26T17:07:53.419 INFO:tasks.workunit.client.3.smithi157.stdout:myimage42 4/s 4/s 124 KiB/s 147 KiB/s 2.25 ms 343.44 us 2024-03-26T17:07:53.419 INFO:tasks.workunit.client.3.smithi157.stdout:myimage46 4/s 4/s 149 KiB/s 138 KiB/s 2.34 ms 533.63 us 2024-03-26T17:07:53.419 INFO:tasks.workunit.client.3.smithi157.stdout:myimage55 4/s 3/s 61 KiB/s 43 KiB/s 2.68 ms 365.34 us 2024-03-26T17:07:53.419 INFO:tasks.workunit.client.3.smithi157.stdout:myimage60 4/s 5/s 127 KiB/s 183 KiB/s 2.70 ms 351.25 us 2024-03-26T17:07:53.419 INFO:tasks.workunit.client.3.smithi157.stdout:myimage59 4/s 5/s 133 KiB/s 140 KiB/s 2.40 ms 371.73 us 2024-03-26T17:07:53.419 INFO:tasks.workunit.client.3.smithi157.stdout:myimage13 3/s 4/s 121 KiB/s 134 KiB/s 2.13 ms 417.13 us 2024-03-26T17:07:53.419 INFO:tasks.workunit.client.3.smithi157.stdout:myimage22 3/s 5/s 148 KiB/s 138 KiB/s 2.34 ms 451.72 us 2024-03-26T17:07:53.419 INFO:tasks.workunit.client.3.smithi157.stdout:myimage31 3/s 5/s 107 KiB/s 191 KiB/s 2.37 ms 371.89 us 2024-03-26T17:07:53.419 INFO:tasks.workunit.client.3.smithi157.stdout:myimage52 3/s 5/s 142 KiB/s 194 KiB/s 2.70 ms 354.20 us 2024-03-26T17:07:53.419 INFO:tasks.workunit.client.3.smithi157.stdout:myimage17 3/s 4/s 115 KiB/s 160 KiB/s 2.35 ms 354.77 us 2024-03-26T17:07:53.419 INFO:tasks.workunit.client.3.smithi157.stdout:myimage38 3/s 3/s 82 KiB/s 108 KiB/s 2.03 ms 453.00 us 2024-03-26T17:07:53.419 INFO:tasks.workunit.client.3.smithi157.stdout:myimage7 3/s 4/s 122 KiB/s 136 KiB/s 2.32 ms 374.89 us 2024-03-26T17:07:53.419 INFO:tasks.workunit.client.3.smithi157.stdout:myimage33 3/s 5/s 85 KiB/s 162 KiB/s 2.59 ms 417.73 us 2024-03-26T17:07:53.419 INFO:tasks.workunit.client.3.smithi157.stdout:myimage35 3/s 3/s 88 KiB/s 105 KiB/s 3.00 ms 353.48 us 2024-03-26T17:07:53.419 INFO:tasks.workunit.client.3.smithi157.stdout:myimage9 3/s 4/s 98 KiB/s 169 KiB/s 2.60 ms 443.14 us 2024-03-26T17:07:53.420 INFO:tasks.workunit.client.3.smithi157.stdout:myimage29 3/s 4/s 111 KiB/s 141 KiB/s 2.17 ms 347.19 us 2024-03-26T17:07:53.420 INFO:tasks.workunit.client.3.smithi157.stdout:myimage50 3/s 4/s 130 KiB/s 124 KiB/s 2.57 ms 423.59 us 2024-03-26T17:07:53.420 INFO:tasks.workunit.client.3.smithi157.stdout:myimage2 3/s 6/s 103 KiB/s 186 KiB/s 2.51 ms 346.53 us 2024-03-26T17:07:53.420 INFO:tasks.workunit.client.3.smithi157.stdout:myimage4 3/s 4/s 90 KiB/s 130 KiB/s 2.58 ms 374.55 us 2024-03-26T17:07:53.420 INFO:tasks.workunit.client.3.smithi157.stdout:myimage53 3/s 5/s 52 KiB/s 91 KiB/s 2.44 ms 496.22 us 2024-03-26T17:07:53.420 INFO:tasks.workunit.client.3.smithi157.stdout:myimage23 3/s 2/s 66 KiB/s 51 KiB/s 2.24 ms 322.23 us 2024-03-26T17:07:53.420 INFO:tasks.workunit.client.3.smithi157.stdout:myimage40 3/s 4/s 110 KiB/s 138 KiB/s 2.25 ms 329.11 us 2024-03-26T17:07:53.420 INFO:tasks.workunit.client.3.smithi157.stdout:myimage5 3/s 4/s 114 KiB/s 162 KiB/s 2.00 ms 332.84 us 2024-03-26T17:07:53.420 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:07:53.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:07:53 smithi044 ceph-mon[30624]: pgmap v661: 33 pgs: 33 active+clean; 1.0 GiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 6.2 MiB/s rd, 6.2 MiB/s wr, 495 op/s 2024-03-26T17:07:53.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:07:53 smithi064 ceph-mon[34420]: pgmap v661: 33 pgs: 33 active+clean; 1.0 GiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 6.2 MiB/s rd, 6.2 MiB/s wr, 495 op/s 2024-03-26T17:07:54.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:07:54 smithi149 ceph-mon[34678]: Health check update: 3 slow ops, oldest one blocked for 568 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:07:54.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:07:54 smithi044 ceph-mon[30624]: Health check update: 3 slow ops, oldest one blocked for 568 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:07:54.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:07:54 smithi064 ceph-mon[34420]: Health check update: 3 slow ops, oldest one blocked for 568 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:07:55.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:07:54 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:07:54] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:07:55.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:07:54 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:07:54] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:07:55.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:07:54 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:07:55.297 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:07:55 smithi149 ceph-mon[34678]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:07:55.297 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:07:55 smithi149 ceph-mon[34678]: { 2024-03-26T17:07:55.298 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:07:55 smithi149 ceph-mon[34678]: "prefix": "rbd perf image stats", 2024-03-26T17:07:55.298 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:07:55 smithi149 ceph-mon[34678]: "pool_spec": "mypool", 2024-03-26T17:07:55.298 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:07:55 smithi149 ceph-mon[34678]: "sort_by": "write_ops", 2024-03-26T17:07:55.298 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:07:55 smithi149 ceph-mon[34678]: "format": "json" 2024-03-26T17:07:55.298 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:07:55 smithi149 ceph-mon[34678]: }"]: dispatch 2024-03-26T17:07:55.298 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:07:55 smithi149 ceph-mon[34678]: pgmap v662: 33 pgs: 33 active+clean; 1.0 GiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 6.9 MiB/s rd, 6.8 MiB/s wr, 522 op/s 2024-03-26T17:07:55.299 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:07:54 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:07:54] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:07:55.299 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:07:54 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:07:54] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:07:55.299 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:07:54 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:07:55.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:07:55 smithi044 ceph-mon[30624]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:07:55.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:07:55 smithi044 ceph-mon[30624]: { 2024-03-26T17:07:55.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:07:55 smithi044 ceph-mon[30624]: "prefix": "rbd perf image stats", 2024-03-26T17:07:55.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:07:55 smithi044 ceph-mon[30624]: "pool_spec": "mypool", 2024-03-26T17:07:55.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:07:55 smithi044 ceph-mon[30624]: "sort_by": "write_ops", 2024-03-26T17:07:55.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:07:55 smithi044 ceph-mon[30624]: "format": "json" 2024-03-26T17:07:55.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:07:55 smithi044 ceph-mon[30624]: }"]: dispatch 2024-03-26T17:07:55.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:07:55 smithi044 ceph-mon[30624]: pgmap v662: 33 pgs: 33 active+clean; 1.0 GiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 6.9 MiB/s rd, 6.8 MiB/s wr, 522 op/s 2024-03-26T17:07:55.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:07:55 smithi064 ceph-mon[34420]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:07:55.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:07:55 smithi064 ceph-mon[34420]: { 2024-03-26T17:07:55.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:07:55 smithi064 ceph-mon[34420]: "prefix": "rbd perf image stats", 2024-03-26T17:07:55.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:07:55 smithi064 ceph-mon[34420]: "pool_spec": "mypool", 2024-03-26T17:07:55.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:07:55 smithi064 ceph-mon[34420]: "sort_by": "write_ops", 2024-03-26T17:07:55.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:07:55 smithi064 ceph-mon[34420]: "format": "json" 2024-03-26T17:07:55.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:07:55 smithi064 ceph-mon[34420]: }"]: dispatch 2024-03-26T17:07:55.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:07:55 smithi064 ceph-mon[34420]: pgmap v662: 33 pgs: 33 active+clean; 1.0 GiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 6.9 MiB/s rd, 6.8 MiB/s wr, 522 op/s 2024-03-26T17:07:56.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:07:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 2024-03-26T17:07:56.233+0000 7fa707a55700 -1 mon.c@1(peon) e3 get_health_metrics reporting 3 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T17:07:57.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:07:56 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:07:56] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:07:57.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:07:56 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:07:56] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:07:57.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:07:56 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:07:57.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:07:57 smithi149 ceph-mon[34678]: pgmap v663: 33 pgs: 33 active+clean; 1.0 GiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 7.3 MiB/s rd, 7.2 MiB/s wr, 543 op/s 2024-03-26T17:07:57.396 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:07:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:07:56] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:07:57.396 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:07:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:07:56] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:07:57.396 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:07:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:07:57.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:07:57 smithi044 ceph-mon[30624]: pgmap v663: 33 pgs: 33 active+clean; 1.0 GiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 7.3 MiB/s rd, 7.2 MiB/s wr, 543 op/s 2024-03-26T17:07:57.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:07:57 smithi064 ceph-mon[34420]: pgmap v663: 33 pgs: 33 active+clean; 1.0 GiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 7.3 MiB/s rd, 7.2 MiB/s wr, 543 op/s 2024-03-26T17:07:58.421 INFO:tasks.workunit.client.3.smithi157.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-26T17:07:58.421 INFO:tasks.workunit.client.3.smithi157.stdout:myimage37 5/s 3/s 177 KiB/s 98 KiB/s 2.38 ms 432.70 us 2024-03-26T17:07:58.422 INFO:tasks.workunit.client.3.smithi157.stdout:myimage55 5/s 4/s 128 KiB/s 114 KiB/s 2.46 ms 442.74 us 2024-03-26T17:07:58.422 INFO:tasks.workunit.client.3.smithi157.stdout:myimage47 5/s 4/s 143 KiB/s 107 KiB/s 2.62 ms 390.81 us 2024-03-26T17:07:58.422 INFO:tasks.workunit.client.3.smithi157.stdout:myimage48 5/s 3/s 174 KiB/s 114 KiB/s 2.57 ms 355.08 us 2024-03-26T17:07:58.422 INFO:tasks.workunit.client.3.smithi157.stdout:myimage20 5/s 3/s 179 KiB/s 98 KiB/s 2.39 ms 524.61 us 2024-03-26T17:07:58.422 INFO:tasks.workunit.client.3.smithi157.stdout:myimage42 5/s 3/s 182 KiB/s 102 KiB/s 2.32 ms 453.17 us 2024-03-26T17:07:58.422 INFO:tasks.workunit.client.3.smithi157.stdout:myimage30 5/s 3/s 153 KiB/s 119 KiB/s 3.02 ms 375.02 us 2024-03-26T17:07:58.422 INFO:tasks.workunit.client.3.smithi157.stdout:myimage6 5/s 2/s 175 KiB/s 83 KiB/s 2.91 ms 324.32 us 2024-03-26T17:07:58.422 INFO:tasks.workunit.client.3.smithi157.stdout:myimage10 5/s 3/s 156 KiB/s 109 KiB/s 2.36 ms 344.75 us 2024-03-26T17:07:58.422 INFO:tasks.workunit.client.3.smithi157.stdout:myimage35 5/s 4/s 146 KiB/s 93 KiB/s 2.64 ms 386.64 us 2024-03-26T17:07:58.422 INFO:tasks.workunit.client.3.smithi157.stdout:myimage29 5/s 4/s 135 KiB/s 118 KiB/s 2.16 ms 351.55 us 2024-03-26T17:07:58.422 INFO:tasks.workunit.client.3.smithi157.stdout:myimage41 5/s 3/s 174 KiB/s 121 KiB/s 2.50 ms 330.68 us 2024-03-26T17:07:58.422 INFO:tasks.workunit.client.3.smithi157.stdout:myimage53 5/s 4/s 100 KiB/s 122 KiB/s 2.58 ms 461.70 us 2024-03-26T17:07:58.422 INFO:tasks.workunit.client.3.smithi157.stdout:myimage14 4/s 3/s 168 KiB/s 93 KiB/s 2.58 ms 366.48 us 2024-03-26T17:07:58.423 INFO:tasks.workunit.client.3.smithi157.stdout:myimage31 4/s 3/s 147 KiB/s 109 KiB/s 2.54 ms 369.79 us 2024-03-26T17:07:58.423 INFO:tasks.workunit.client.3.smithi157.stdout:myimage39 4/s 4/s 142 KiB/s 154 KiB/s 2.32 ms 570.51 us 2024-03-26T17:07:58.423 INFO:tasks.workunit.client.3.smithi157.stdout:myimage50 4/s 4/s 150 KiB/s 167 KiB/s 2.53 ms 402.37 us 2024-03-26T17:07:58.423 INFO:tasks.workunit.client.3.smithi157.stdout:myimage21 4/s 3/s 114 KiB/s 105 KiB/s 2.94 ms 332.33 us 2024-03-26T17:07:58.423 INFO:tasks.workunit.client.3.smithi157.stdout:myimage16 4/s 4/s 146 KiB/s 178 KiB/s 2.47 ms 504.00 us 2024-03-26T17:07:58.423 INFO:tasks.workunit.client.3.smithi157.stdout:myimage22 4/s 4/s 113 KiB/s 120 KiB/s 2.26 ms 302.42 us 2024-03-26T17:07:58.423 INFO:tasks.workunit.client.3.smithi157.stdout:myimage4 4/s 5/s 124 KiB/s 117 KiB/s 2.29 ms 384.60 us 2024-03-26T17:07:58.423 INFO:tasks.workunit.client.3.smithi157.stdout:myimage17 4/s 4/s 130 KiB/s 124 KiB/s 2.55 ms 403.47 us 2024-03-26T17:07:58.423 INFO:tasks.workunit.client.3.smithi157.stdout:myimage19 4/s 4/s 110 KiB/s 156 KiB/s 2.40 ms 476.40 us 2024-03-26T17:07:58.423 INFO:tasks.workunit.client.3.smithi157.stdout:myimage28 4/s 4/s 120 KiB/s 126 KiB/s 3.15 ms 338.60 us 2024-03-26T17:07:58.423 INFO:tasks.workunit.client.3.smithi157.stdout:myimage59 4/s 4/s 162 KiB/s 191 KiB/s 2.63 ms 471.09 us 2024-03-26T17:07:58.423 INFO:tasks.workunit.client.3.smithi157.stdout:myimage1 4/s 4/s 158 KiB/s 138 KiB/s 2.04 ms 327.93 us 2024-03-26T17:07:58.423 INFO:tasks.workunit.client.3.smithi157.stdout:myimage8 4/s 4/s 110 KiB/s 141 KiB/s 2.41 ms 324.00 us 2024-03-26T17:07:58.423 INFO:tasks.workunit.client.3.smithi157.stdout:myimage9 4/s 3/s 138 KiB/s 84 KiB/s 2.72 ms 324.08 us 2024-03-26T17:07:58.424 INFO:tasks.workunit.client.3.smithi157.stdout:myimage15 4/s 4/s 166 KiB/s 122 KiB/s 2.09 ms 327.20 us 2024-03-26T17:07:58.424 INFO:tasks.workunit.client.3.smithi157.stdout:myimage3 4/s 4/s 126 KiB/s 129 KiB/s 1.94 ms 337.73 us 2024-03-26T17:07:58.424 INFO:tasks.workunit.client.3.smithi157.stdout:myimage23 4/s 5/s 124 KiB/s 173 KiB/s 2.35 ms 296.49 us 2024-03-26T17:07:58.424 INFO:tasks.workunit.client.3.smithi157.stdout:myimage32 4/s 2/s 121 KiB/s 83 KiB/s 2.47 ms 353.93 us 2024-03-26T17:07:58.424 INFO:tasks.workunit.client.3.smithi157.stdout:myimage38 4/s 4/s 147 KiB/s 158 KiB/s 2.05 ms 376.17 us 2024-03-26T17:07:58.424 INFO:tasks.workunit.client.3.smithi157.stdout:myimage49 4/s 5/s 102 KiB/s 181 KiB/s 2.46 ms 370.78 us 2024-03-26T17:07:58.424 INFO:tasks.workunit.client.3.smithi157.stdout:myimage52 4/s 4/s 91 KiB/s 168 KiB/s 2.52 ms 444.07 us 2024-03-26T17:07:58.424 INFO:tasks.workunit.client.3.smithi157.stdout:myimage12 4/s 4/s 119 KiB/s 134 KiB/s 2.39 ms 357.24 us 2024-03-26T17:07:58.424 INFO:tasks.workunit.client.3.smithi157.stdout:myimage24 4/s 4/s 130 KiB/s 127 KiB/s 2.35 ms 419.90 us 2024-03-26T17:07:58.424 INFO:tasks.workunit.client.3.smithi157.stdout:myimage45 4/s 4/s 125 KiB/s 150 KiB/s 2.37 ms 353.91 us 2024-03-26T17:07:58.424 INFO:tasks.workunit.client.3.smithi157.stdout:myimage51 4/s 4/s 121 KiB/s 146 KiB/s 2.63 ms 370.87 us 2024-03-26T17:07:58.424 INFO:tasks.workunit.client.3.smithi157.stdout:myimage2 3/s 3/s 102 KiB/s 123 KiB/s 2.32 ms 447.18 us 2024-03-26T17:07:58.424 INFO:tasks.workunit.client.3.smithi157.stdout:myimage34 3/s 5/s 135 KiB/s 148 KiB/s 2.32 ms 325.56 us 2024-03-26T17:07:58.424 INFO:tasks.workunit.client.3.smithi157.stdout:myimage58 3/s 4/s 121 KiB/s 126 KiB/s 2.25 ms 325.08 us 2024-03-26T17:07:58.424 INFO:tasks.workunit.client.3.smithi157.stdout:myimage18 3/s 4/s 102 KiB/s 135 KiB/s 2.25 ms 370.87 us 2024-03-26T17:07:58.424 INFO:tasks.workunit.client.3.smithi157.stdout:myimage25 3/s 4/s 102 KiB/s 163 KiB/s 3.16 ms 519.06 us 2024-03-26T17:07:58.425 INFO:tasks.workunit.client.3.smithi157.stdout:myimage26 3/s 4/s 94 KiB/s 147 KiB/s 2.53 ms 374.45 us 2024-03-26T17:07:58.425 INFO:tasks.workunit.client.3.smithi157.stdout:myimage56 3/s 5/s 130 KiB/s 152 KiB/s 3.00 ms 350.03 us 2024-03-26T17:07:58.425 INFO:tasks.workunit.client.3.smithi157.stdout:myimage7 3/s 5/s 112 KiB/s 187 KiB/s 2.50 ms 536.75 us 2024-03-26T17:07:58.425 INFO:tasks.workunit.client.3.smithi157.stdout:myimage27 3/s 4/s 107 KiB/s 174 KiB/s 2.23 ms 357.23 us 2024-03-26T17:07:58.425 INFO:tasks.workunit.client.3.smithi157.stdout:myimage43 3/s 3/s 130 KiB/s 69 KiB/s 2.43 ms 498.27 us 2024-03-26T17:07:58.425 INFO:tasks.workunit.client.3.smithi157.stdout:myimage54 3/s 4/s 118 KiB/s 104 KiB/s 2.32 ms 357.52 us 2024-03-26T17:07:58.425 INFO:tasks.workunit.client.3.smithi157.stdout:myimage57 3/s 4/s 135 KiB/s 129 KiB/s 2.43 ms 371.70 us 2024-03-26T17:07:58.425 INFO:tasks.workunit.client.3.smithi157.stdout:myimage60 3/s 4/s 114 KiB/s 109 KiB/s 2.57 ms 445.82 us 2024-03-26T17:07:58.425 INFO:tasks.workunit.client.3.smithi157.stdout:myimage13 3/s 4/s 118 KiB/s 152 KiB/s 2.23 ms 358.08 us 2024-03-26T17:07:58.425 INFO:tasks.workunit.client.3.smithi157.stdout:myimage33 3/s 4/s 94 KiB/s 163 KiB/s 2.44 ms 327.94 us 2024-03-26T17:07:58.425 INFO:tasks.workunit.client.3.smithi157.stdout:myimage46 3/s 5/s 88 KiB/s 164 KiB/s 2.30 ms 348.45 us 2024-03-26T17:07:58.425 INFO:tasks.workunit.client.3.smithi157.stdout:myimage40 3/s 4/s 122 KiB/s 118 KiB/s 2.30 ms 340.04 us 2024-03-26T17:07:58.425 INFO:tasks.workunit.client.3.smithi157.stdout:myimage11 3/s 4/s 57 KiB/s 50 KiB/s 2.34 ms 285.54 us 2024-03-26T17:07:58.425 INFO:tasks.workunit.client.3.smithi157.stdout:myimage5 2/s 4/s 76 KiB/s 124 KiB/s 2.40 ms 405.97 us 2024-03-26T17:07:58.425 INFO:tasks.workunit.client.3.smithi157.stdout:myimage36 2/s 5/s 88 KiB/s 163 KiB/s 2.40 ms 464.67 us 2024-03-26T17:07:58.425 INFO:tasks.workunit.client.3.smithi157.stdout:myimage44 2/s 4/s 89 KiB/s 129 KiB/s 2.43 ms 333.69 us 2024-03-26T17:07:58.426 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:07:59.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:07:58 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:07:58] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:07:59.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:07:58 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:07:58] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:07:59.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:07:58 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:07:59.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:07:59 smithi149 ceph-mon[34678]: pgmap v664: 33 pgs: 33 active+clean; 1.0 GiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 7.1 MiB/s rd, 7.1 MiB/s wr, 511 op/s 2024-03-26T17:07:59.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:07:59 smithi149 ceph-mon[34678]: Health check update: 3 slow ops, oldest one blocked for 573 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:07:59.396 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:07:58 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:07:58] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:07:59.397 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:07:58 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:07:58] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:07:59.397 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:07:58 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:07:59.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:07:59 smithi044 ceph-mon[30624]: pgmap v664: 33 pgs: 33 active+clean; 1.0 GiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 7.1 MiB/s rd, 7.1 MiB/s wr, 511 op/s 2024-03-26T17:07:59.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:07:59 smithi044 ceph-mon[30624]: Health check update: 3 slow ops, oldest one blocked for 573 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:07:59.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:07:59 smithi064 ceph-mon[34420]: pgmap v664: 33 pgs: 33 active+clean; 1.0 GiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 7.1 MiB/s rd, 7.1 MiB/s wr, 511 op/s 2024-03-26T17:07:59.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:07:59 smithi064 ceph-mon[34420]: Health check update: 3 slow ops, oldest one blocked for 573 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:08:00.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:08:00 smithi149 ceph-mon[34678]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:08:00.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:08:00 smithi149 ceph-mon[34678]: { 2024-03-26T17:08:00.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:08:00 smithi149 ceph-mon[34678]: "prefix": "rbd perf image stats", 2024-03-26T17:08:00.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:08:00 smithi149 ceph-mon[34678]: "pool_spec": "mypool", 2024-03-26T17:08:00.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:08:00 smithi149 ceph-mon[34678]: "sort_by": "write_ops", 2024-03-26T17:08:00.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:08:00 smithi149 ceph-mon[34678]: "format": "json" 2024-03-26T17:08:00.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:08:00 smithi149 ceph-mon[34678]: }"]: dispatch 2024-03-26T17:08:00.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:08:00 smithi044 ceph-mon[30624]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:08:00.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:08:00 smithi044 ceph-mon[30624]: { 2024-03-26T17:08:00.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:08:00 smithi044 ceph-mon[30624]: "prefix": "rbd perf image stats", 2024-03-26T17:08:00.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:08:00 smithi044 ceph-mon[30624]: "pool_spec": "mypool", 2024-03-26T17:08:00.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:08:00 smithi044 ceph-mon[30624]: "sort_by": "write_ops", 2024-03-26T17:08:00.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:08:00 smithi044 ceph-mon[30624]: "format": "json" 2024-03-26T17:08:00.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:08:00 smithi044 ceph-mon[30624]: }"]: dispatch 2024-03-26T17:08:00.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:08:00 smithi064 ceph-mon[34420]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:08:00.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:08:00 smithi064 ceph-mon[34420]: { 2024-03-26T17:08:00.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:08:00 smithi064 ceph-mon[34420]: "prefix": "rbd perf image stats", 2024-03-26T17:08:00.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:08:00 smithi064 ceph-mon[34420]: "pool_spec": "mypool", 2024-03-26T17:08:00.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:08:00 smithi064 ceph-mon[34420]: "sort_by": "write_ops", 2024-03-26T17:08:00.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:08:00 smithi064 ceph-mon[34420]: "format": "json" 2024-03-26T17:08:00.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:08:00 smithi064 ceph-mon[34420]: }"]: dispatch 2024-03-26T17:08:01.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:08:00 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:08:00] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:08:01.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:08:00 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:08:00] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:08:01.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:08:00 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:08:01.234 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:08:01 smithi149 ceph-mon[34678]: pgmap v665: 33 pgs: 33 active+clean; 1.0 GiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 7.1 MiB/s rd, 7.1 MiB/s wr, 502 op/s 2024-03-26T17:08:01.235 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:08:00 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:08:00] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:08:01.235 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:08:00 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:08:00] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:08:01.235 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:08:00 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:08:01.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:08:01 smithi044 ceph-mon[30624]: pgmap v665: 33 pgs: 33 active+clean; 1.0 GiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 7.1 MiB/s rd, 7.1 MiB/s wr, 502 op/s 2024-03-26T17:08:01.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:08:01 smithi064 ceph-mon[34420]: pgmap v665: 33 pgs: 33 active+clean; 1.0 GiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 7.1 MiB/s rd, 7.1 MiB/s wr, 502 op/s 2024-03-26T17:08:01.645 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:08:01 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 2024-03-26T17:08:01.233+0000 7fa707a55700 -1 mon.c@1(peon) e3 get_health_metrics reporting 3 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T17:08:03.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:08:02 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:08:02] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:08:03.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:08:02 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:08:02] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:08:03.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:08:02 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:08:03.062 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:08:03.070 INFO:tasks.workunit.client.3.smithi157.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2024-03-26T17:08:03.071 INFO:tasks.workunit.client.3.smithi157.stdout: 8.60 108.8k 129.6k 0.0k 1.1M 1.3M 0.0k nvme2n1 2024-03-26T17:08:03.071 INFO:tasks.workunit.client.3.smithi157.stdout: 8.60 98.0k 120.8k 0.0k 980.0k 1.2M 0.0k nvme2n10 2024-03-26T17:08:03.071 INFO:tasks.workunit.client.3.smithi157.stdout: 8.60 130.0k 91.2k 0.0k 1.3M 912.0k 0.0k nvme2n11 2024-03-26T17:08:03.071 INFO:tasks.workunit.client.3.smithi157.stdout: 8.60 116.4k 140.0k 0.0k 1.1M 1.4M 0.0k nvme2n12 2024-03-26T17:08:03.071 INFO:tasks.workunit.client.3.smithi157.stdout: 8.60 146.8k 106.4k 0.0k 1.4M 1.0M 0.0k nvme2n13 2024-03-26T17:08:03.071 INFO:tasks.workunit.client.3.smithi157.stdout: 8.50 116.4k 146.8k 0.0k 1.1M 1.4M 0.0k nvme2n14 2024-03-26T17:08:03.071 INFO:tasks.workunit.client.3.smithi157.stdout: 8.50 132.0k 145.2k 0.0k 1.3M 1.4M 0.0k nvme2n15 2024-03-26T17:08:03.071 INFO:tasks.workunit.client.3.smithi157.stdout: 8.50 148.0k 136.4k 0.0k 1.4M 1.3M 0.0k nvme2n16 2024-03-26T17:08:03.071 INFO:tasks.workunit.client.3.smithi157.stdout: 8.50 129.2k 120.8k 0.0k 1.3M 1.2M 0.0k nvme2n17 2024-03-26T17:08:03.071 INFO:tasks.workunit.client.3.smithi157.stdout: 8.50 118.8k 131.2k 0.0k 1.2M 1.3M 0.0k nvme2n18 2024-03-26T17:08:03.072 INFO:tasks.workunit.client.3.smithi157.stdout: 8.50 151.2k 116.4k 0.0k 1.5M 1.1M 0.0k nvme2n19 2024-03-26T17:08:03.072 INFO:tasks.workunit.client.3.smithi157.stdout: 8.60 132.4k 108.8k 0.0k 1.3M 1.1M 0.0k nvme2n2 2024-03-26T17:08:03.072 INFO:tasks.workunit.client.3.smithi157.stdout: 8.60 87.2k 143.2k 0.0k 872.0k 1.4M 0.0k nvme2n20 2024-03-26T17:08:03.072 INFO:tasks.workunit.client.3.smithi157.stdout: 8.60 124.0k 111.2k 0.0k 1.2M 1.1M 0.0k nvme2n3 2024-03-26T17:08:03.072 INFO:tasks.workunit.client.3.smithi157.stdout: 8.60 108.4k 116.8k 0.0k 1.1M 1.1M 0.0k nvme2n4 2024-03-26T17:08:03.072 INFO:tasks.workunit.client.3.smithi157.stdout: 8.60 125.2k 119.6k 0.0k 1.2M 1.2M 0.0k nvme2n5 2024-03-26T17:08:03.072 INFO:tasks.workunit.client.3.smithi157.stdout: 8.60 89.6k 138.4k 0.0k 896.0k 1.4M 0.0k nvme2n6 2024-03-26T17:08:03.072 INFO:tasks.workunit.client.3.smithi157.stdout: 8.60 143.6k 123.2k 0.0k 1.4M 1.2M 0.0k nvme2n7 2024-03-26T17:08:03.072 INFO:tasks.workunit.client.3.smithi157.stdout: 8.60 148.4k 106.0k 0.0k 1.4M 1.0M 0.0k nvme2n8 2024-03-26T17:08:03.072 INFO:tasks.workunit.client.3.smithi157.stdout: 8.60 116.8k 116.0k 0.0k 1.1M 1.1M 0.0k nvme2n9 2024-03-26T17:08:03.072 INFO:tasks.workunit.client.3.smithi157.stdout: 8.60 130.4k 105.6k 0.0k 1.3M 1.0M 0.0k nvme5n1 2024-03-26T17:08:03.072 INFO:tasks.workunit.client.3.smithi157.stdout: 8.60 131.2k 149.6k 0.0k 1.3M 1.5M 0.0k nvme5n10 2024-03-26T17:08:03.073 INFO:tasks.workunit.client.3.smithi157.stdout: 8.60 133.2k 117.2k 0.0k 1.3M 1.1M 0.0k nvme5n11 2024-03-26T17:08:03.073 INFO:tasks.workunit.client.3.smithi157.stdout: 8.60 118.0k 152.0k 0.0k 1.2M 1.5M 0.0k nvme5n12 2024-03-26T17:08:03.073 INFO:tasks.workunit.client.3.smithi157.stdout: 8.60 134.8k 135.2k 0.0k 1.3M 1.3M 0.0k nvme5n13 2024-03-26T17:08:03.073 INFO:tasks.workunit.client.3.smithi157.stdout: 8.60 123.2k 148.8k 0.0k 1.2M 1.5M 0.0k nvme5n14 2024-03-26T17:08:03.073 INFO:tasks.workunit.client.3.smithi157.stdout: 8.50 112.8k 134.8k 0.0k 1.1M 1.3M 0.0k nvme5n15 2024-03-26T17:08:03.073 INFO:tasks.workunit.client.3.smithi157.stdout: 8.50 105.6k 105.2k 0.0k 1.0M 1.0M 0.0k nvme5n16 2024-03-26T17:08:03.073 INFO:tasks.workunit.client.3.smithi157.stdout: 8.50 105.2k 128.0k 0.0k 1.0M 1.2M 0.0k nvme5n17 2024-03-26T17:08:03.073 INFO:tasks.workunit.client.3.smithi157.stdout: 8.50 120.8k 147.6k 0.0k 1.2M 1.4M 0.0k nvme5n18 2024-03-26T17:08:03.073 INFO:tasks.workunit.client.3.smithi157.stdout: 8.50 134.8k 125.2k 0.0k 1.3M 1.2M 0.0k nvme5n19 2024-03-26T17:08:03.073 INFO:tasks.workunit.client.3.smithi157.stdout: 8.60 102.0k 149.2k 0.0k 1020.0k 1.5M 0.0k nvme5n2 2024-03-26T17:08:03.073 INFO:tasks.workunit.client.3.smithi157.stdout: 8.60 83.6k 150.4k 0.0k 836.0k 1.5M 0.0k nvme5n20 2024-03-26T17:08:03.073 INFO:tasks.workunit.client.3.smithi157.stdout: 8.60 178.0k 145.2k 0.0k 1.7M 1.4M 0.0k nvme5n3 2024-03-26T17:08:03.074 INFO:tasks.workunit.client.3.smithi157.stdout: 8.60 112.8k 156.8k 0.0k 1.1M 1.5M 0.0k nvme5n4 2024-03-26T17:08:03.074 INFO:tasks.workunit.client.3.smithi157.stdout: 8.60 170.4k 87.2k 0.0k 1.7M 872.0k 0.0k nvme5n5 2024-03-26T17:08:03.074 INFO:tasks.workunit.client.3.smithi157.stdout: 8.60 129.6k 123.6k 0.0k 1.3M 1.2M 0.0k nvme5n6 2024-03-26T17:08:03.074 INFO:tasks.workunit.client.3.smithi157.stdout: 8.60 134.4k 98.8k 0.0k 1.3M 988.0k 0.0k nvme5n7 2024-03-26T17:08:03.074 INFO:tasks.workunit.client.3.smithi157.stdout: 8.60 128.8k 117.6k 0.0k 1.3M 1.1M 0.0k nvme5n8 2024-03-26T17:08:03.074 INFO:tasks.workunit.client.3.smithi157.stdout: 8.60 104.4k 94.8k 0.0k 1.0M 948.0k 0.0k nvme5n9 2024-03-26T17:08:03.074 INFO:tasks.workunit.client.3.smithi157.stdout: 8.60 157.2k 133.6k 0.0k 1.5M 1.3M 0.0k nvme8n1 2024-03-26T17:08:03.074 INFO:tasks.workunit.client.3.smithi157.stdout: 8.60 131.6k 139.2k 0.0k 1.3M 1.4M 0.0k nvme8n10 2024-03-26T17:08:03.074 INFO:tasks.workunit.client.3.smithi157.stdout: 8.60 112.8k 145.2k 0.0k 1.1M 1.4M 0.0k nvme8n11 2024-03-26T17:08:03.074 INFO:tasks.workunit.client.3.smithi157.stdout: 8.60 117.2k 117.6k 0.0k 1.1M 1.1M 0.0k nvme8n12 2024-03-26T17:08:03.074 INFO:tasks.workunit.client.3.smithi157.stdout: 8.60 131.6k 138.8k 0.0k 1.3M 1.4M 0.0k nvme8n13 2024-03-26T17:08:03.075 INFO:tasks.workunit.client.3.smithi157.stdout: 8.50 120.0k 120.0k 0.0k 1.2M 1.2M 0.0k nvme8n14 2024-03-26T17:08:03.075 INFO:tasks.workunit.client.3.smithi157.stdout: 8.50 122.8k 148.4k 0.0k 1.2M 1.4M 0.0k nvme8n15 2024-03-26T17:08:03.075 INFO:tasks.workunit.client.3.smithi157.stdout: 8.50 129.2k 111.6k 0.0k 1.3M 1.1M 0.0k nvme8n16 2024-03-26T17:08:03.075 INFO:tasks.workunit.client.3.smithi157.stdout: 8.50 115.2k 133.2k 0.0k 1.1M 1.3M 0.0k nvme8n17 2024-03-26T17:08:03.075 INFO:tasks.workunit.client.3.smithi157.stdout: 8.50 151.6k 117.2k 0.0k 1.5M 1.1M 0.0k nvme8n18 2024-03-26T17:08:03.075 INFO:tasks.workunit.client.3.smithi157.stdout: 8.50 145.2k 115.2k 0.0k 1.4M 1.1M 0.0k nvme8n19 2024-03-26T17:08:03.075 INFO:tasks.workunit.client.3.smithi157.stdout: 8.60 109.2k 151.2k 0.0k 1.1M 1.5M 0.0k nvme8n2 2024-03-26T17:08:03.075 INFO:tasks.workunit.client.3.smithi157.stdout: 8.60 110.4k 125.2k 0.0k 1.1M 1.2M 0.0k nvme8n20 2024-03-26T17:08:03.075 INFO:tasks.workunit.client.3.smithi157.stdout: 8.60 108.8k 174.8k 0.0k 1.1M 1.7M 0.0k nvme8n3 2024-03-26T17:08:03.075 INFO:tasks.workunit.client.3.smithi157.stdout: 8.60 161.2k 122.8k 0.0k 1.6M 1.2M 0.0k nvme8n4 2024-03-26T17:08:03.075 INFO:tasks.workunit.client.3.smithi157.stdout: 8.60 120.0k 141.6k 0.0k 1.2M 1.4M 0.0k nvme8n5 2024-03-26T17:08:03.075 INFO:tasks.workunit.client.3.smithi157.stdout: 8.60 141.6k 132.4k 0.0k 1.4M 1.3M 0.0k nvme8n6 2024-03-26T17:08:03.075 INFO:tasks.workunit.client.3.smithi157.stdout: 8.60 116.8k 119.2k 0.0k 1.1M 1.2M 0.0k nvme8n7 2024-03-26T17:08:03.076 INFO:tasks.workunit.client.3.smithi157.stdout: 8.60 132.4k 125.6k 0.0k 1.3M 1.2M 0.0k nvme8n8 2024-03-26T17:08:03.076 INFO:tasks.workunit.client.3.smithi157.stdout: 8.60 173.6k 102.8k 0.0k 1.7M 1.0M 0.0k nvme8n9 2024-03-26T17:08:03.076 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:08:03.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:08:03 smithi149 ceph-mon[34678]: pgmap v666: 33 pgs: 33 active+clean; 1.0 GiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 7.4 MiB/s rd, 7.5 MiB/s wr, 524 op/s 2024-03-26T17:08:03.396 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:08:02 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:08:02] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:08:03.396 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:08:02 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:08:02] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:08:03.396 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:08:02 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:08:03.426 INFO:tasks.workunit.client.3.smithi157.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-26T17:08:03.427 INFO:tasks.workunit.client.3.smithi157.stdout:myimage40 6/s 3/s 190 KiB/s 66 KiB/s 2.29 ms 450.35 us 2024-03-26T17:08:03.427 INFO:tasks.workunit.client.3.smithi157.stdout:myimage12 5/s 3/s 165 KiB/s 127 KiB/s 2.48 ms 339.32 us 2024-03-26T17:08:03.427 INFO:tasks.workunit.client.3.smithi157.stdout:myimage24 5/s 3/s 169 KiB/s 98 KiB/s 2.43 ms 349.11 us 2024-03-26T17:08:03.427 INFO:tasks.workunit.client.3.smithi157.stdout:myimage16 5/s 3/s 170 KiB/s 124 KiB/s 2.42 ms 458.79 us 2024-03-26T17:08:03.427 INFO:tasks.workunit.client.3.smithi157.stdout:myimage6 5/s 4/s 155 KiB/s 94 KiB/s 2.53 ms 372.47 us 2024-03-26T17:08:03.427 INFO:tasks.workunit.client.3.smithi157.stdout:myimage17 5/s 4/s 138 KiB/s 145 KiB/s 2.75 ms 553.78 us 2024-03-26T17:08:03.427 INFO:tasks.workunit.client.3.smithi157.stdout:myimage36 5/s 3/s 116 KiB/s 90 KiB/s 2.27 ms 326.91 us 2024-03-26T17:08:03.427 INFO:tasks.workunit.client.3.smithi157.stdout:myimage43 5/s 3/s 173 KiB/s 113 KiB/s 2.64 ms 512.39 us 2024-03-26T17:08:03.427 INFO:tasks.workunit.client.3.smithi157.stdout:myimage51 5/s 4/s 162 KiB/s 84 KiB/s 2.66 ms 301.67 us 2024-03-26T17:08:03.427 INFO:tasks.workunit.client.3.smithi157.stdout:myimage3 5/s 3/s 119 KiB/s 86 KiB/s 2.05 ms 425.28 us 2024-03-26T17:08:03.427 INFO:tasks.workunit.client.3.smithi157.stdout:myimage23 5/s 5/s 185 KiB/s 217 KiB/s 2.01 ms 377.17 us 2024-03-26T17:08:03.427 INFO:tasks.workunit.client.3.smithi157.stdout:myimage44 5/s 5/s 141 KiB/s 206 KiB/s 2.36 ms 356.98 us 2024-03-26T17:08:03.427 INFO:tasks.workunit.client.3.smithi157.stdout:myimage52 5/s 2/s 137 KiB/s 39 KiB/s 2.49 ms 317.66 us 2024-03-26T17:08:03.428 INFO:tasks.workunit.client.3.smithi157.stdout:myimage1 5/s 4/s 162 KiB/s 106 KiB/s 2.05 ms 307.90 us 2024-03-26T17:08:03.428 INFO:tasks.workunit.client.3.smithi157.stdout:myimage5 5/s 3/s 149 KiB/s 142 KiB/s 2.25 ms 341.19 us 2024-03-26T17:08:03.428 INFO:tasks.workunit.client.3.smithi157.stdout:myimage30 4/s 3/s 166 KiB/s 114 KiB/s 3.06 ms 415.11 us 2024-03-26T17:08:03.428 INFO:tasks.workunit.client.3.smithi157.stdout:myimage48 4/s 4/s 132 KiB/s 118 KiB/s 2.38 ms 335.27 us 2024-03-26T17:08:03.428 INFO:tasks.workunit.client.3.smithi157.stdout:myimage29 4/s 4/s 110 KiB/s 116 KiB/s 2.24 ms 371.78 us 2024-03-26T17:08:03.428 INFO:tasks.workunit.client.3.smithi157.stdout:myimage35 4/s 3/s 131 KiB/s 111 KiB/s 2.40 ms 457.25 us 2024-03-26T17:08:03.428 INFO:tasks.workunit.client.3.smithi157.stdout:myimage38 4/s 4/s 134 KiB/s 117 KiB/s 2.04 ms 310.28 us 2024-03-26T17:08:03.428 INFO:tasks.workunit.client.3.smithi157.stdout:myimage20 4/s 3/s 129 KiB/s 88 KiB/s 2.27 ms 363.31 us 2024-03-26T17:08:03.428 INFO:tasks.workunit.client.3.smithi157.stdout:myimage25 4/s 4/s 75 KiB/s 167 KiB/s 2.92 ms 441.79 us 2024-03-26T17:08:03.428 INFO:tasks.workunit.client.3.smithi157.stdout:myimage26 4/s 3/s 118 KiB/s 80 KiB/s 2.51 ms 398.01 us 2024-03-26T17:08:03.428 INFO:tasks.workunit.client.3.smithi157.stdout:myimage54 4/s 3/s 112 KiB/s 134 KiB/s 2.21 ms 415.12 us 2024-03-26T17:08:03.428 INFO:tasks.workunit.client.3.smithi157.stdout:myimage57 4/s 3/s 126 KiB/s 100 KiB/s 2.57 ms 397.31 us 2024-03-26T17:08:03.428 INFO:tasks.workunit.client.3.smithi157.stdout:myimage10 4/s 3/s 127 KiB/s 81 KiB/s 2.35 ms 314.23 us 2024-03-26T17:08:03.428 INFO:tasks.workunit.client.3.smithi157.stdout:myimage22 4/s 3/s 148 KiB/s 100 KiB/s 2.26 ms 288.09 us 2024-03-26T17:08:03.429 INFO:tasks.workunit.client.3.smithi157.stdout:myimage47 4/s 3/s 118 KiB/s 104 KiB/s 2.59 ms 349.32 us 2024-03-26T17:08:03.429 INFO:tasks.workunit.client.3.smithi157.stdout:myimage4 4/s 4/s 112 KiB/s 90 KiB/s 2.14 ms 320.55 us 2024-03-26T17:08:03.429 INFO:tasks.workunit.client.3.smithi157.stdout:myimage9 4/s 4/s 125 KiB/s 128 KiB/s 2.73 ms 352.37 us 2024-03-26T17:08:03.429 INFO:tasks.workunit.client.3.smithi157.stdout:myimage21 4/s 4/s 106 KiB/s 131 KiB/s 3.03 ms 691.01 us 2024-03-26T17:08:03.429 INFO:tasks.workunit.client.3.smithi157.stdout:myimage60 4/s 4/s 123 KiB/s 98 KiB/s 2.51 ms 401.49 us 2024-03-26T17:08:03.429 INFO:tasks.workunit.client.3.smithi157.stdout:myimage13 4/s 5/s 106 KiB/s 150 KiB/s 2.13 ms 341.07 us 2024-03-26T17:08:03.429 INFO:tasks.workunit.client.3.smithi157.stdout:myimage32 4/s 4/s 145 KiB/s 112 KiB/s 2.44 ms 341.50 us 2024-03-26T17:08:03.429 INFO:tasks.workunit.client.3.smithi157.stdout:myimage18 4/s 5/s 110 KiB/s 153 KiB/s 2.24 ms 414.54 us 2024-03-26T17:08:03.429 INFO:tasks.workunit.client.3.smithi157.stdout:myimage41 4/s 5/s 114 KiB/s 201 KiB/s 2.38 ms 385.99 us 2024-03-26T17:08:03.429 INFO:tasks.workunit.client.3.smithi157.stdout:myimage45 4/s 4/s 128 KiB/s 88 KiB/s 2.46 ms 283.70 us 2024-03-26T17:08:03.429 INFO:tasks.workunit.client.3.smithi157.stdout:myimage50 4/s 4/s 112 KiB/s 155 KiB/s 2.46 ms 426.76 us 2024-03-26T17:08:03.429 INFO:tasks.workunit.client.3.smithi157.stdout:myimage53 4/s 3/s 141 KiB/s 115 KiB/s 2.39 ms 404.86 us 2024-03-26T17:08:03.429 INFO:tasks.workunit.client.3.smithi157.stdout:myimage55 4/s 4/s 150 KiB/s 133 KiB/s 2.67 ms 381.83 us 2024-03-26T17:08:03.429 INFO:tasks.workunit.client.3.smithi157.stdout:myimage34 4/s 3/s 115 KiB/s 96 KiB/s 2.30 ms 309.96 us 2024-03-26T17:08:03.430 INFO:tasks.workunit.client.3.smithi157.stdout:myimage37 4/s 3/s 119 KiB/s 99 KiB/s 2.34 ms 351.85 us 2024-03-26T17:08:03.430 INFO:tasks.workunit.client.3.smithi157.stdout:myimage7 4/s 4/s 126 KiB/s 137 KiB/s 2.52 ms 468.70 us 2024-03-26T17:08:03.430 INFO:tasks.workunit.client.3.smithi157.stdout:myimage15 4/s 4/s 124 KiB/s 146 KiB/s 2.26 ms 355.56 us 2024-03-26T17:08:03.430 INFO:tasks.workunit.client.3.smithi157.stdout:myimage42 4/s 3/s 126 KiB/s 90 KiB/s 2.37 ms 345.69 us 2024-03-26T17:08:03.430 INFO:tasks.workunit.client.3.smithi157.stdout:myimage56 4/s 4/s 139 KiB/s 114 KiB/s 2.88 ms 370.76 us 2024-03-26T17:08:03.430 INFO:tasks.workunit.client.3.smithi157.stdout:myimage14 3/s 4/s 143 KiB/s 133 KiB/s 2.73 ms 340.70 us 2024-03-26T17:08:03.430 INFO:tasks.workunit.client.3.smithi157.stdout:myimage58 3/s 5/s 130 KiB/s 194 KiB/s 2.17 ms 340.48 us 2024-03-26T17:08:03.430 INFO:tasks.workunit.client.3.smithi157.stdout:myimage33 3/s 4/s 122 KiB/s 150 KiB/s 2.50 ms 370.20 us 2024-03-26T17:08:03.430 INFO:tasks.workunit.client.3.smithi157.stdout:myimage39 3/s 4/s 142 KiB/s 106 KiB/s 2.32 ms 322.15 us 2024-03-26T17:08:03.430 INFO:tasks.workunit.client.3.smithi157.stdout:myimage2 3/s 4/s 109 KiB/s 136 KiB/s 2.43 ms 318.64 us 2024-03-26T17:08:03.430 INFO:tasks.workunit.client.3.smithi157.stdout:myimage49 3/s 5/s 87 KiB/s 161 KiB/s 2.52 ms 355.96 us 2024-03-26T17:08:03.430 INFO:tasks.workunit.client.3.smithi157.stdout:myimage28 3/s 4/s 121 KiB/s 120 KiB/s 3.22 ms 356.00 us 2024-03-26T17:08:03.430 INFO:tasks.workunit.client.3.smithi157.stdout:myimage46 3/s 4/s 126 KiB/s 126 KiB/s 2.38 ms 445.75 us 2024-03-26T17:08:03.430 INFO:tasks.workunit.client.3.smithi157.stdout:myimage8 3/s 4/s 101 KiB/s 146 KiB/s 2.47 ms 396.07 us 2024-03-26T17:08:03.431 INFO:tasks.workunit.client.3.smithi157.stdout:myimage19 3/s 5/s 126 KiB/s 134 KiB/s 2.39 ms 389.45 us 2024-03-26T17:08:03.431 INFO:tasks.workunit.client.3.smithi157.stdout:myimage59 3/s 5/s 109 KiB/s 152 KiB/s 2.75 ms 375.14 us 2024-03-26T17:08:03.431 INFO:tasks.workunit.client.3.smithi157.stdout:myimage31 3/s 5/s 106 KiB/s 158 KiB/s 2.67 ms 487.45 us 2024-03-26T17:08:03.431 INFO:tasks.workunit.client.3.smithi157.stdout:myimage11 3/s 5/s 75 KiB/s 146 KiB/s 2.64 ms 370.93 us 2024-03-26T17:08:03.431 INFO:tasks.workunit.client.3.smithi157.stdout:myimage27 3/s 6/s 85 KiB/s 170 KiB/s 2.31 ms 340.50 us 2024-03-26T17:08:03.431 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:08:03.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:08:03 smithi044 ceph-mon[30624]: pgmap v666: 33 pgs: 33 active+clean; 1.0 GiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 7.4 MiB/s rd, 7.5 MiB/s wr, 524 op/s 2024-03-26T17:08:03.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:08:03 smithi064 ceph-mon[34420]: pgmap v666: 33 pgs: 33 active+clean; 1.0 GiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 7.4 MiB/s rd, 7.5 MiB/s wr, 524 op/s 2024-03-26T17:08:04.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:08:04 smithi044 ceph-mon[30624]: Health check update: 3 slow ops, oldest one blocked for 578 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:08:04.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:08:04 smithi064 ceph-mon[34420]: Health check update: 3 slow ops, oldest one blocked for 578 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:08:04.645 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:08:04 smithi149 ceph-mon[34678]: Health check update: 3 slow ops, oldest one blocked for 578 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:08:05.149 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:08:04 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:08:04] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:08:05.149 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:08:04 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:08:04] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:08:05.149 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:08:04 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:08:05.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:08:05 smithi149 ceph-mon[34678]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:08:05.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:08:05 smithi149 ceph-mon[34678]: { 2024-03-26T17:08:05.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:08:05 smithi149 ceph-mon[34678]: "prefix": "rbd perf image stats", 2024-03-26T17:08:05.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:08:05 smithi149 ceph-mon[34678]: "pool_spec": "mypool", 2024-03-26T17:08:05.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:08:05 smithi149 ceph-mon[34678]: "sort_by": "write_ops", 2024-03-26T17:08:05.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:08:05 smithi149 ceph-mon[34678]: "format": "json" 2024-03-26T17:08:05.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:08:05 smithi149 ceph-mon[34678]: }"]: dispatch 2024-03-26T17:08:05.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:08:05 smithi149 ceph-mon[34678]: pgmap v667: 33 pgs: 33 active+clean; 1.0 GiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 7.7 MiB/s rd, 7.8 MiB/s wr, 546 op/s 2024-03-26T17:08:05.397 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:08:04 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:08:04] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:08:05.397 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:08:04 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:08:04] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:08:05.397 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:08:04 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:08:05.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:08:05 smithi044 ceph-mon[30624]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:08:05.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:08:05 smithi044 ceph-mon[30624]: { 2024-03-26T17:08:05.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:08:05 smithi044 ceph-mon[30624]: "prefix": "rbd perf image stats", 2024-03-26T17:08:05.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:08:05 smithi044 ceph-mon[30624]: "pool_spec": "mypool", 2024-03-26T17:08:05.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:08:05 smithi044 ceph-mon[30624]: "sort_by": "write_ops", 2024-03-26T17:08:05.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:08:05 smithi044 ceph-mon[30624]: "format": "json" 2024-03-26T17:08:05.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:08:05 smithi044 ceph-mon[30624]: }"]: dispatch 2024-03-26T17:08:05.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:08:05 smithi044 ceph-mon[30624]: pgmap v667: 33 pgs: 33 active+clean; 1.0 GiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 7.7 MiB/s rd, 7.8 MiB/s wr, 546 op/s 2024-03-26T17:08:05.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:08:05 smithi064 ceph-mon[34420]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:08:05.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:08:05 smithi064 ceph-mon[34420]: { 2024-03-26T17:08:05.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:08:05 smithi064 ceph-mon[34420]: "prefix": "rbd perf image stats", 2024-03-26T17:08:05.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:08:05 smithi064 ceph-mon[34420]: "pool_spec": "mypool", 2024-03-26T17:08:05.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:08:05 smithi064 ceph-mon[34420]: "sort_by": "write_ops", 2024-03-26T17:08:05.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:08:05 smithi064 ceph-mon[34420]: "format": "json" 2024-03-26T17:08:05.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:08:05 smithi064 ceph-mon[34420]: }"]: dispatch 2024-03-26T17:08:05.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:08:05 smithi064 ceph-mon[34420]: pgmap v667: 33 pgs: 33 active+clean; 1.0 GiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 7.7 MiB/s rd, 7.8 MiB/s wr, 546 op/s 2024-03-26T17:08:06.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:08:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 2024-03-26T17:08:06.233+0000 7fa707a55700 -1 mon.c@1(peon) e3 get_health_metrics reporting 3 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T17:08:07.151 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:08:06 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:08:06] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:08:07.151 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:08:06 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:08:06] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:08:07.151 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:08:06 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:08:07.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:08:07 smithi149 ceph-mon[34678]: pgmap v668: 33 pgs: 33 active+clean; 1.0 GiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 7.8 MiB/s rd, 7.8 MiB/s wr, 556 op/s 2024-03-26T17:08:07.396 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:08:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:08:06] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:08:07.396 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:08:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:08:06] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:08:07.397 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:08:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:08:07.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:08:07 smithi044 ceph-mon[30624]: pgmap v668: 33 pgs: 33 active+clean; 1.0 GiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 7.8 MiB/s rd, 7.8 MiB/s wr, 556 op/s 2024-03-26T17:08:07.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:08:07 smithi064 ceph-mon[34420]: pgmap v668: 33 pgs: 33 active+clean; 1.0 GiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 7.8 MiB/s rd, 7.8 MiB/s wr, 556 op/s 2024-03-26T17:08:08.432 INFO:tasks.workunit.client.3.smithi157.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-26T17:08:08.432 INFO:tasks.workunit.client.3.smithi157.stdout:myimage14 5/s 4/s 156 KiB/s 117 KiB/s 2.54 ms 353.37 us 2024-03-26T17:08:08.432 INFO:tasks.workunit.client.3.smithi157.stdout:myimage5 5/s 4/s 171 KiB/s 119 KiB/s 2.34 ms 341.46 us 2024-03-26T17:08:08.432 INFO:tasks.workunit.client.3.smithi157.stdout:myimage2 5/s 4/s 152 KiB/s 142 KiB/s 2.60 ms 352.75 us 2024-03-26T17:08:08.432 INFO:tasks.workunit.client.3.smithi157.stdout:myimage21 5/s 3/s 142 KiB/s 97 KiB/s 2.81 ms 486.63 us 2024-03-26T17:08:08.433 INFO:tasks.workunit.client.3.smithi157.stdout:myimage22 5/s 3/s 144 KiB/s 69 KiB/s 2.18 ms 334.03 us 2024-03-26T17:08:08.433 INFO:tasks.workunit.client.3.smithi157.stdout:myimage34 5/s 3/s 176 KiB/s 114 KiB/s 2.17 ms 363.46 us 2024-03-26T17:08:08.433 INFO:tasks.workunit.client.3.smithi157.stdout:myimage47 5/s 4/s 141 KiB/s 98 KiB/s 2.61 ms 321.67 us 2024-03-26T17:08:08.433 INFO:tasks.workunit.client.3.smithi157.stdout:myimage7 5/s 4/s 126 KiB/s 116 KiB/s 2.32 ms 389.85 us 2024-03-26T17:08:08.433 INFO:tasks.workunit.client.3.smithi157.stdout:myimage44 5/s 2/s 172 KiB/s 106 KiB/s 2.49 ms 359.91 us 2024-03-26T17:08:08.433 INFO:tasks.workunit.client.3.smithi157.stdout:myimage11 5/s 4/s 146 KiB/s 166 KiB/s 2.24 ms 465.34 us 2024-03-26T17:08:08.434 INFO:tasks.workunit.client.3.smithi157.stdout:myimage17 5/s 3/s 157 KiB/s 111 KiB/s 2.54 ms 372.58 us 2024-03-26T17:08:08.434 INFO:tasks.workunit.client.3.smithi157.stdout:myimage18 5/s 3/s 150 KiB/s 96 KiB/s 2.26 ms 358.90 us 2024-03-26T17:08:08.434 INFO:tasks.workunit.client.3.smithi157.stdout:myimage24 5/s 3/s 102 KiB/s 125 KiB/s 2.44 ms 415.82 us 2024-03-26T17:08:08.434 INFO:tasks.workunit.client.3.smithi157.stdout:myimage3 4/s 3/s 128 KiB/s 110 KiB/s 2.04 ms 350.95 us 2024-03-26T17:08:08.434 INFO:tasks.workunit.client.3.smithi157.stdout:myimage9 4/s 3/s 130 KiB/s 124 KiB/s 2.62 ms 367.17 us 2024-03-26T17:08:08.435 INFO:tasks.workunit.client.3.smithi157.stdout:myimage29 4/s 3/s 96 KiB/s 107 KiB/s 2.12 ms 381.67 us 2024-03-26T17:08:08.435 INFO:tasks.workunit.client.3.smithi157.stdout:myimage50 4/s 3/s 153 KiB/s 66 KiB/s 2.75 ms 416.85 us 2024-03-26T17:08:08.435 INFO:tasks.workunit.client.3.smithi157.stdout:myimage53 4/s 4/s 158 KiB/s 132 KiB/s 2.42 ms 425.60 us 2024-03-26T17:08:08.435 INFO:tasks.workunit.client.3.smithi157.stdout:myimage57 4/s 5/s 152 KiB/s 162 KiB/s 2.41 ms 338.12 us 2024-03-26T17:08:08.436 INFO:tasks.workunit.client.3.smithi157.stdout:myimage13 4/s 4/s 128 KiB/s 116 KiB/s 2.00 ms 363.10 us 2024-03-26T17:08:08.436 INFO:tasks.workunit.client.3.smithi157.stdout:myimage32 4/s 3/s 158 KiB/s 109 KiB/s 2.45 ms 450.20 us 2024-03-26T17:08:08.436 INFO:tasks.workunit.client.3.smithi157.stdout:myimage8 4/s 4/s 134 KiB/s 165 KiB/s 2.33 ms 370.62 us 2024-03-26T17:08:08.436 INFO:tasks.workunit.client.3.smithi157.stdout:myimage41 4/s 3/s 150 KiB/s 79 KiB/s 2.42 ms 382.24 us 2024-03-26T17:08:08.436 INFO:tasks.workunit.client.3.smithi157.stdout:myimage46 4/s 4/s 129 KiB/s 114 KiB/s 2.25 ms 326.26 us 2024-03-26T17:08:08.437 INFO:tasks.workunit.client.3.smithi157.stdout:myimage51 4/s 3/s 127 KiB/s 121 KiB/s 2.50 ms 378.50 us 2024-03-26T17:08:08.437 INFO:tasks.workunit.client.3.smithi157.stdout:myimage55 4/s 4/s 119 KiB/s 146 KiB/s 2.44 ms 467.43 us 2024-03-26T17:08:08.437 INFO:tasks.workunit.client.3.smithi157.stdout:myimage23 4/s 2/s 122 KiB/s 101 KiB/s 2.00 ms 335.00 us 2024-03-26T17:08:08.437 INFO:tasks.workunit.client.3.smithi157.stdout:myimage38 4/s 3/s 150 KiB/s 102 KiB/s 1.98 ms 339.64 us 2024-03-26T17:08:08.438 INFO:tasks.workunit.client.3.smithi157.stdout:myimage48 4/s 4/s 100 KiB/s 121 KiB/s 2.41 ms 335.68 us 2024-03-26T17:08:08.438 INFO:tasks.workunit.client.3.smithi157.stdout:myimage12 4/s 4/s 102 KiB/s 119 KiB/s 2.38 ms 446.78 us 2024-03-26T17:08:08.438 INFO:tasks.workunit.client.3.smithi157.stdout:myimage15 4/s 3/s 150 KiB/s 83 KiB/s 2.12 ms 339.36 us 2024-03-26T17:08:08.438 INFO:tasks.workunit.client.3.smithi157.stdout:myimage19 4/s 4/s 106 KiB/s 150 KiB/s 2.32 ms 383.46 us 2024-03-26T17:08:08.438 INFO:tasks.workunit.client.3.smithi157.stdout:myimage27 4/s 3/s 133 KiB/s 63 KiB/s 2.24 ms 490.97 us 2024-03-26T17:08:08.439 INFO:tasks.workunit.client.3.smithi157.stdout:myimage42 4/s 5/s 115 KiB/s 162 KiB/s 2.58 ms 379.67 us 2024-03-26T17:08:08.439 INFO:tasks.workunit.client.3.smithi157.stdout:myimage45 4/s 5/s 125 KiB/s 168 KiB/s 2.43 ms 354.04 us 2024-03-26T17:08:08.439 INFO:tasks.workunit.client.3.smithi157.stdout:myimage59 4/s 4/s 138 KiB/s 126 KiB/s 2.63 ms 417.97 us 2024-03-26T17:08:08.439 INFO:tasks.workunit.client.3.smithi157.stdout:myimage16 4/s 4/s 99 KiB/s 134 KiB/s 2.24 ms 334.14 us 2024-03-26T17:08:08.439 INFO:tasks.workunit.client.3.smithi157.stdout:myimage40 4/s 5/s 86 KiB/s 136 KiB/s 2.27 ms 333.04 us 2024-03-26T17:08:08.439 INFO:tasks.workunit.client.3.smithi157.stdout:myimage4 4/s 3/s 114 KiB/s 99 KiB/s 2.20 ms 327.62 us 2024-03-26T17:08:08.440 INFO:tasks.workunit.client.3.smithi157.stdout:myimage33 4/s 4/s 131 KiB/s 143 KiB/s 2.45 ms 324.68 us 2024-03-26T17:08:08.440 INFO:tasks.workunit.client.3.smithi157.stdout:myimage43 4/s 4/s 133 KiB/s 158 KiB/s 2.64 ms 342.25 us 2024-03-26T17:08:08.440 INFO:tasks.workunit.client.3.smithi157.stdout:myimage31 4/s 4/s 106 KiB/s 144 KiB/s 2.82 ms 376.39 us 2024-03-26T17:08:08.440 INFO:tasks.workunit.client.3.smithi157.stdout:myimage35 4/s 5/s 102 KiB/s 145 KiB/s 2.17 ms 313.96 us 2024-03-26T17:08:08.440 INFO:tasks.workunit.client.3.smithi157.stdout:myimage58 4/s 4/s 123 KiB/s 121 KiB/s 2.19 ms 344.49 us 2024-03-26T17:08:08.440 INFO:tasks.workunit.client.3.smithi157.stdout:myimage26 4/s 5/s 150 KiB/s 155 KiB/s 2.49 ms 489.20 us 2024-03-26T17:08:08.441 INFO:tasks.workunit.client.3.smithi157.stdout:myimage36 4/s 5/s 78 KiB/s 170 KiB/s 2.30 ms 407.49 us 2024-03-26T17:08:08.441 INFO:tasks.workunit.client.3.smithi157.stdout:myimage60 4/s 4/s 115 KiB/s 143 KiB/s 2.77 ms 357.79 us 2024-03-26T17:08:08.441 INFO:tasks.workunit.client.3.smithi157.stdout:myimage37 3/s 4/s 79 KiB/s 98 KiB/s 2.53 ms 348.04 us 2024-03-26T17:08:08.441 INFO:tasks.workunit.client.3.smithi157.stdout:myimage20 3/s 5/s 74 KiB/s 131 KiB/s 2.37 ms 391.11 us 2024-03-26T17:08:08.441 INFO:tasks.workunit.client.3.smithi157.stdout:myimage49 3/s 4/s 110 KiB/s 158 KiB/s 2.48 ms 344.59 us 2024-03-26T17:08:08.442 INFO:tasks.workunit.client.3.smithi157.stdout:myimage1 3/s 4/s 83 KiB/s 152 KiB/s 2.12 ms 330.12 us 2024-03-26T17:08:08.442 INFO:tasks.workunit.client.3.smithi157.stdout:myimage25 3/s 5/s 98 KiB/s 166 KiB/s 2.80 ms 343.80 us 2024-03-26T17:08:08.442 INFO:tasks.workunit.client.3.smithi157.stdout:myimage54 3/s 4/s 85 KiB/s 123 KiB/s 2.47 ms 329.66 us 2024-03-26T17:08:08.442 INFO:tasks.workunit.client.3.smithi157.stdout:myimage56 3/s 6/s 74 KiB/s 130 KiB/s 2.71 ms 350.61 us 2024-03-26T17:08:08.442 INFO:tasks.workunit.client.3.smithi157.stdout:myimage10 3/s 5/s 84 KiB/s 131 KiB/s 2.30 ms 390.71 us 2024-03-26T17:08:08.443 INFO:tasks.workunit.client.3.smithi157.stdout:myimage52 3/s 4/s 97 KiB/s 146 KiB/s 2.75 ms 335.90 us 2024-03-26T17:08:08.443 INFO:tasks.workunit.client.3.smithi157.stdout:myimage28 3/s 5/s 87 KiB/s 135 KiB/s 3.34 ms 354.64 us 2024-03-26T17:08:08.443 INFO:tasks.workunit.client.3.smithi157.stdout:myimage39 3/s 5/s 88 KiB/s 185 KiB/s 2.28 ms 383.14 us 2024-03-26T17:08:08.443 INFO:tasks.workunit.client.3.smithi157.stdout:myimage6 3/s 5/s 102 KiB/s 113 KiB/s 2.76 ms 333.99 us 2024-03-26T17:08:08.443 INFO:tasks.workunit.client.3.smithi157.stdout:myimage30 2/s 5/s 74 KiB/s 146 KiB/s 2.93 ms 391.30 us 2024-03-26T17:08:08.443 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:08:09.153 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:08:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:08:08] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:08:09.153 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:08:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:08:08] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:08:09.153 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:08:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:08:09.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:08:09 smithi149 ceph-mon[34678]: pgmap v669: 33 pgs: 33 active+clean; 1.0 GiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 7.3 MiB/s rd, 7.3 MiB/s wr, 529 op/s 2024-03-26T17:08:09.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:08:09 smithi149 ceph-mon[34678]: Health check update: 3 slow ops, oldest one blocked for 583 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:08:09.397 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:08:08 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:08:08] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:08:09.398 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:08:09 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:08:09] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:08:09.398 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:08:09 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:08:09.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:08:09 smithi044 ceph-mon[30624]: pgmap v669: 33 pgs: 33 active+clean; 1.0 GiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 7.3 MiB/s rd, 7.3 MiB/s wr, 529 op/s 2024-03-26T17:08:09.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:08:09 smithi044 ceph-mon[30624]: Health check update: 3 slow ops, oldest one blocked for 583 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:08:09.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:08:09 smithi064 ceph-mon[34420]: pgmap v669: 33 pgs: 33 active+clean; 1.0 GiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 7.3 MiB/s rd, 7.3 MiB/s wr, 529 op/s 2024-03-26T17:08:09.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:08:09 smithi064 ceph-mon[34420]: Health check update: 3 slow ops, oldest one blocked for 583 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:08:10.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:08:10 smithi044 ceph-mon[30624]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:08:10.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:08:10 smithi044 ceph-mon[30624]: { 2024-03-26T17:08:10.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:08:10 smithi044 ceph-mon[30624]: "prefix": "rbd perf image stats", 2024-03-26T17:08:10.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:08:10 smithi044 ceph-mon[30624]: "pool_spec": "mypool", 2024-03-26T17:08:10.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:08:10 smithi044 ceph-mon[30624]: "sort_by": "write_ops", 2024-03-26T17:08:10.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:08:10 smithi044 ceph-mon[30624]: "format": "json" 2024-03-26T17:08:10.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:08:10 smithi044 ceph-mon[30624]: }"]: dispatch 2024-03-26T17:08:10.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:08:10 smithi064 ceph-mon[34420]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:08:10.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:08:10 smithi064 ceph-mon[34420]: { 2024-03-26T17:08:10.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:08:10 smithi064 ceph-mon[34420]: "prefix": "rbd perf image stats", 2024-03-26T17:08:10.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:08:10 smithi064 ceph-mon[34420]: "pool_spec": "mypool", 2024-03-26T17:08:10.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:08:10 smithi064 ceph-mon[34420]: "sort_by": "write_ops", 2024-03-26T17:08:10.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:08:10 smithi064 ceph-mon[34420]: "format": "json" 2024-03-26T17:08:10.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:08:10 smithi064 ceph-mon[34420]: }"]: dispatch 2024-03-26T17:08:10.645 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:08:10 smithi149 ceph-mon[34678]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:08:10.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:08:10 smithi149 ceph-mon[34678]: { 2024-03-26T17:08:10.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:08:10 smithi149 ceph-mon[34678]: "prefix": "rbd perf image stats", 2024-03-26T17:08:10.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:08:10 smithi149 ceph-mon[34678]: "pool_spec": "mypool", 2024-03-26T17:08:10.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:08:10 smithi149 ceph-mon[34678]: "sort_by": "write_ops", 2024-03-26T17:08:10.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:08:10 smithi149 ceph-mon[34678]: "format": "json" 2024-03-26T17:08:10.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:08:10 smithi149 ceph-mon[34678]: }"]: dispatch 2024-03-26T17:08:11.158 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:08:10 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:08:10] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:08:11.158 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:08:10 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:08:10] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:08:11.158 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:08:10 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:08:11.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:08:11 smithi149 ceph-mon[34678]: pgmap v670: 33 pgs: 33 active+clean; 1.0 GiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 7.0 MiB/s rd, 7.0 MiB/s wr, 514 op/s 2024-03-26T17:08:11.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:08:11 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 2024-03-26T17:08:11.234+0000 7fa707a55700 -1 mon.c@1(peon) e3 get_health_metrics reporting 3 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T17:08:11.396 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:08:11 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:08:11] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:08:11.397 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:08:11 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:08:11] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:08:11.397 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:08:11 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:08:11.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:08:11 smithi044 ceph-mon[30624]: pgmap v670: 33 pgs: 33 active+clean; 1.0 GiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 7.0 MiB/s rd, 7.0 MiB/s wr, 514 op/s 2024-03-26T17:08:11.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:08:11 smithi064 ceph-mon[34420]: pgmap v670: 33 pgs: 33 active+clean; 1.0 GiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 7.0 MiB/s rd, 7.0 MiB/s wr, 514 op/s 2024-03-26T17:08:13.063 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:08:13.073 INFO:tasks.workunit.client.3.smithi157.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2024-03-26T17:08:13.073 INFO:tasks.workunit.client.3.smithi157.stdout: 8.50 114.0k 100.4k 0.0k 1.1M 1004.0k 0.0k nvme2n1 2024-03-26T17:08:13.073 INFO:tasks.workunit.client.3.smithi157.stdout: 8.50 101.2k 134.0k 0.0k 1012.0k 1.3M 0.0k nvme2n10 2024-03-26T17:08:13.073 INFO:tasks.workunit.client.3.smithi157.stdout: 8.50 140.8k 127.6k 0.0k 1.4M 1.2M 0.0k nvme2n11 2024-03-26T17:08:13.073 INFO:tasks.workunit.client.3.smithi157.stdout: 8.50 102.0k 119.6k 0.0k 1020.0k 1.2M 0.0k nvme2n12 2024-03-26T17:08:13.073 INFO:tasks.workunit.client.3.smithi157.stdout: 8.50 92.0k 123.6k 0.0k 920.0k 1.2M 0.0k nvme2n13 2024-03-26T17:08:13.073 INFO:tasks.workunit.client.3.smithi157.stdout: 8.60 115.2k 124.8k 0.0k 1.1M 1.2M 0.0k nvme2n14 2024-03-26T17:08:13.073 INFO:tasks.workunit.client.3.smithi157.stdout: 8.60 78.8k 158.4k 0.0k 788.0k 1.5M 0.0k nvme2n15 2024-03-26T17:08:13.073 INFO:tasks.workunit.client.3.smithi157.stdout: 8.60 123.6k 100.8k 0.0k 1.2M 1008.0k 0.0k nvme2n16 2024-03-26T17:08:13.073 INFO:tasks.workunit.client.3.smithi157.stdout: 8.60 118.0k 126.8k 0.0k 1.2M 1.2M 0.0k nvme2n17 2024-03-26T17:08:13.073 INFO:tasks.workunit.client.3.smithi157.stdout: 8.60 132.4k 128.4k 0.0k 1.3M 1.3M 0.0k nvme2n18 2024-03-26T17:08:13.074 INFO:tasks.workunit.client.3.smithi157.stdout: 8.50 106.0k 100.8k 0.0k 1.0M 1008.0k 0.0k nvme2n19 2024-03-26T17:08:13.074 INFO:tasks.workunit.client.3.smithi157.stdout: 8.50 110.4k 129.2k 0.0k 1.1M 1.3M 0.0k nvme2n2 2024-03-26T17:08:13.074 INFO:tasks.workunit.client.3.smithi157.stdout: 8.50 105.6k 103.2k 0.0k 1.0M 1.0M 0.0k nvme2n20 2024-03-26T17:08:13.074 INFO:tasks.workunit.client.3.smithi157.stdout: 8.50 112.8k 119.6k 0.0k 1.1M 1.2M 0.0k nvme2n3 2024-03-26T17:08:13.074 INFO:tasks.workunit.client.3.smithi157.stdout: 8.50 80.8k 124.0k 0.0k 808.0k 1.2M 0.0k nvme2n4 2024-03-26T17:08:13.074 INFO:tasks.workunit.client.3.smithi157.stdout: 8.50 108.0k 128.4k 0.0k 1.1M 1.3M 0.0k nvme2n5 2024-03-26T17:08:13.074 INFO:tasks.workunit.client.3.smithi157.stdout: 8.50 137.6k 108.0k 0.0k 1.3M 1.1M 0.0k nvme2n6 2024-03-26T17:08:13.074 INFO:tasks.workunit.client.3.smithi157.stdout: 8.50 102.4k 127.6k 0.0k 1.0M 1.2M 0.0k nvme2n7 2024-03-26T17:08:13.074 INFO:tasks.workunit.client.3.smithi157.stdout: 8.50 132.8k 153.6k 0.0k 1.3M 1.5M 0.0k nvme2n8 2024-03-26T17:08:13.074 INFO:tasks.workunit.client.3.smithi157.stdout: 8.50 153.6k 92.4k 0.0k 1.5M 924.0k 0.0k nvme2n9 2024-03-26T17:08:13.074 INFO:tasks.workunit.client.3.smithi157.stdout: 8.50 102.0k 106.0k 0.0k 1020.0k 1.0M 0.0k nvme5n1 2024-03-26T17:08:13.075 INFO:tasks.workunit.client.3.smithi157.stdout: 8.50 117.6k 124.0k 0.0k 1.1M 1.2M 0.0k nvme5n10 2024-03-26T17:08:13.075 INFO:tasks.workunit.client.3.smithi157.stdout: 8.50 112.0k 114.8k 0.0k 1.1M 1.1M 0.0k nvme5n11 2024-03-26T17:08:13.075 INFO:tasks.workunit.client.3.smithi157.stdout: 8.50 100.0k 159.2k 0.0k 1000.0k 1.6M 0.0k nvme5n12 2024-03-26T17:08:13.075 INFO:tasks.workunit.client.3.smithi157.stdout: 8.50 144.4k 99.2k 0.0k 1.4M 992.0k 0.0k nvme5n13 2024-03-26T17:08:13.075 INFO:tasks.workunit.client.3.smithi157.stdout: 8.50 93.6k 124.8k 0.0k 936.0k 1.2M 0.0k nvme5n14 2024-03-26T17:08:13.075 INFO:tasks.workunit.client.3.smithi157.stdout: 8.60 129.2k 108.0k 0.0k 1.3M 1.1M 0.0k nvme5n15 2024-03-26T17:08:13.075 INFO:tasks.workunit.client.3.smithi157.stdout: 8.60 115.2k 98.0k 0.0k 1.1M 980.0k 0.0k nvme5n16 2024-03-26T17:08:13.075 INFO:tasks.workunit.client.3.smithi157.stdout: 8.60 86.0k 96.0k 0.0k 860.0k 960.0k 0.0k nvme5n17 2024-03-26T17:08:13.075 INFO:tasks.workunit.client.3.smithi157.stdout: 8.60 124.4k 103.2k 0.0k 1.2M 1.0M 0.0k nvme5n18 2024-03-26T17:08:13.075 INFO:tasks.workunit.client.3.smithi157.stdout: 8.50 139.6k 107.2k 0.0k 1.4M 1.0M 0.0k nvme5n19 2024-03-26T17:08:13.075 INFO:tasks.workunit.client.3.smithi157.stdout: 8.50 91.6k 103.2k 0.0k 916.0k 1.0M 0.0k nvme5n2 2024-03-26T17:08:13.075 INFO:tasks.workunit.client.3.smithi157.stdout: 8.50 122.8k 142.4k 0.0k 1.2M 1.4M 0.0k nvme5n20 2024-03-26T17:08:13.075 INFO:tasks.workunit.client.3.smithi157.stdout: 8.50 150.4k 125.2k 0.0k 1.5M 1.2M 0.0k nvme5n3 2024-03-26T17:08:13.075 INFO:tasks.workunit.client.3.smithi157.stdout: 8.50 132.0k 105.6k 0.0k 1.3M 1.0M 0.0k nvme5n4 2024-03-26T17:08:13.075 INFO:tasks.workunit.client.3.smithi157.stdout: 8.50 94.4k 113.6k 0.0k 944.0k 1.1M 0.0k nvme5n5 2024-03-26T17:08:13.076 INFO:tasks.workunit.client.3.smithi157.stdout: 8.50 124.8k 144.8k 0.0k 1.2M 1.4M 0.0k nvme5n6 2024-03-26T17:08:13.076 INFO:tasks.workunit.client.3.smithi157.stdout: 8.50 108.0k 113.2k 0.0k 1.1M 1.1M 0.0k nvme5n7 2024-03-26T17:08:13.076 INFO:tasks.workunit.client.3.smithi157.stdout: 8.50 104.8k 118.8k 0.0k 1.0M 1.2M 0.0k nvme5n8 2024-03-26T17:08:13.076 INFO:tasks.workunit.client.3.smithi157.stdout: 8.50 104.4k 107.2k 0.0k 1.0M 1.0M 0.0k nvme5n9 2024-03-26T17:08:13.076 INFO:tasks.workunit.client.3.smithi157.stdout: 8.50 97.2k 145.6k 0.0k 972.0k 1.4M 0.0k nvme8n1 2024-03-26T17:08:13.076 INFO:tasks.workunit.client.3.smithi157.stdout: 8.50 90.0k 118.4k 0.0k 900.0k 1.2M 0.0k nvme8n10 2024-03-26T17:08:13.076 INFO:tasks.workunit.client.3.smithi157.stdout: 8.50 96.0k 126.4k 0.0k 960.0k 1.2M 0.0k nvme8n11 2024-03-26T17:08:13.076 INFO:tasks.workunit.client.3.smithi157.stdout: 8.50 102.0k 126.4k 0.0k 1020.0k 1.2M 0.0k nvme8n12 2024-03-26T17:08:13.076 INFO:tasks.workunit.client.3.smithi157.stdout: 8.50 121.6k 134.4k 0.0k 1.2M 1.3M 0.0k nvme8n13 2024-03-26T17:08:13.076 INFO:tasks.workunit.client.3.smithi157.stdout: 8.60 108.4k 115.6k 0.0k 1.1M 1.1M 0.0k nvme8n14 2024-03-26T17:08:13.076 INFO:tasks.workunit.client.3.smithi157.stdout: 8.60 120.4k 116.0k 0.0k 1.2M 1.1M 0.0k nvme8n15 2024-03-26T17:08:13.076 INFO:tasks.workunit.client.3.smithi157.stdout: 8.60 118.0k 55.2k 0.0k 1.2M 552.0k 0.0k nvme8n16 2024-03-26T17:08:13.076 INFO:tasks.workunit.client.3.smithi157.stdout: 8.60 100.8k 139.6k 0.0k 1008.0k 1.4M 0.0k nvme8n17 2024-03-26T17:08:13.076 INFO:tasks.workunit.client.3.smithi157.stdout: 8.60 104.4k 144.4k 0.0k 1.0M 1.4M 0.0k nvme8n18 2024-03-26T17:08:13.076 INFO:tasks.workunit.client.3.smithi157.stdout: 8.50 123.6k 119.6k 0.0k 1.2M 1.2M 0.0k nvme8n19 2024-03-26T17:08:13.076 INFO:tasks.workunit.client.3.smithi157.stdout: 8.50 144.4k 65.2k 0.0k 1.4M 652.0k 0.0k nvme8n2 2024-03-26T17:08:13.077 INFO:tasks.workunit.client.3.smithi157.stdout: 8.50 139.6k 91.2k 0.0k 1.4M 912.0k 0.0k nvme8n20 2024-03-26T17:08:13.077 INFO:tasks.workunit.client.3.smithi157.stdout: 8.50 146.4k 104.0k 0.0k 1.4M 1.0M 0.0k nvme8n3 2024-03-26T17:08:13.077 INFO:tasks.workunit.client.3.smithi157.stdout: 8.50 100.4k 141.6k 0.0k 1004.0k 1.4M 0.0k nvme8n4 2024-03-26T17:08:13.077 INFO:tasks.workunit.client.3.smithi157.stdout: 8.50 138.0k 97.6k 0.0k 1.3M 976.0k 0.0k nvme8n5 2024-03-26T17:08:13.077 INFO:tasks.workunit.client.3.smithi157.stdout: 8.50 109.6k 110.4k 0.0k 1.1M 1.1M 0.0k nvme8n6 2024-03-26T17:08:13.077 INFO:tasks.workunit.client.3.smithi157.stdout: 8.50 100.0k 118.0k 0.0k 1000.0k 1.2M 0.0k nvme8n7 2024-03-26T17:08:13.077 INFO:tasks.workunit.client.3.smithi157.stdout: 8.50 96.8k 111.2k 0.0k 968.0k 1.1M 0.0k nvme8n8 2024-03-26T17:08:13.077 INFO:tasks.workunit.client.3.smithi157.stdout: 8.50 119.2k 119.6k 0.0k 1.2M 1.2M 0.0k nvme8n9 2024-03-26T17:08:13.077 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:08:13.160 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:08:12 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:08:12] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:08:13.160 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:08:12 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:08:12] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:08:13.160 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:08:12 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:08:13.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:08:13 smithi149 ceph-mon[34678]: pgmap v671: 33 pgs: 33 active+clean; 1.0 GiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 7.0 MiB/s rd, 7.0 MiB/s wr, 516 op/s 2024-03-26T17:08:13.396 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:08:13 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:08:13] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:08:13.397 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:08:13 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:08:13] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:08:13.397 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:08:13 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:08:13.435 INFO:tasks.workunit.client.3.smithi157.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-26T17:08:13.436 INFO:tasks.workunit.client.3.smithi157.stdout:myimage54 6/s 3/s 158 KiB/s 98 KiB/s 2.35 ms 346.98 us 2024-03-26T17:08:13.436 INFO:tasks.workunit.client.3.smithi157.stdout:myimage7 5/s 3/s 151 KiB/s 84 KiB/s 2.39 ms 361.83 us 2024-03-26T17:08:13.436 INFO:tasks.workunit.client.3.smithi157.stdout:myimage18 5/s 3/s 169 KiB/s 106 KiB/s 2.35 ms 367.72 us 2024-03-26T17:08:13.436 INFO:tasks.workunit.client.3.smithi157.stdout:myimage20 5/s 3/s 161 KiB/s 70 KiB/s 2.26 ms 417.18 us 2024-03-26T17:08:13.436 INFO:tasks.workunit.client.3.smithi157.stdout:myimage15 5/s 3/s 156 KiB/s 70 KiB/s 2.48 ms 404.21 us 2024-03-26T17:08:13.436 INFO:tasks.workunit.client.3.smithi157.stdout:myimage10 5/s 3/s 149 KiB/s 111 KiB/s 2.41 ms 418.25 us 2024-03-26T17:08:13.436 INFO:tasks.workunit.client.3.smithi157.stdout:myimage49 5/s 3/s 133 KiB/s 95 KiB/s 2.42 ms 311.79 us 2024-03-26T17:08:13.436 INFO:tasks.workunit.client.3.smithi157.stdout:myimage31 5/s 4/s 109 KiB/s 98 KiB/s 2.77 ms 341.60 us 2024-03-26T17:08:13.436 INFO:tasks.workunit.client.3.smithi157.stdout:myimage37 5/s 4/s 103 KiB/s 78 KiB/s 2.89 ms 462.64 us 2024-03-26T17:08:13.436 INFO:tasks.workunit.client.3.smithi157.stdout:myimage44 5/s 4/s 129 KiB/s 122 KiB/s 2.35 ms 432.32 us 2024-03-26T17:08:13.437 INFO:tasks.workunit.client.3.smithi157.stdout:myimage4 5/s 3/s 118 KiB/s 77 KiB/s 2.53 ms 329.45 us 2024-03-26T17:08:13.437 INFO:tasks.workunit.client.3.smithi157.stdout:myimage46 5/s 4/s 117 KiB/s 141 KiB/s 2.26 ms 352.74 us 2024-03-26T17:08:13.437 INFO:tasks.workunit.client.3.smithi157.stdout:myimage57 5/s 3/s 154 KiB/s 84 KiB/s 2.46 ms 324.39 us 2024-03-26T17:08:13.437 INFO:tasks.workunit.client.3.smithi157.stdout:myimage13 4/s 3/s 130 KiB/s 93 KiB/s 2.25 ms 385.44 us 2024-03-26T17:08:13.437 INFO:tasks.workunit.client.3.smithi157.stdout:myimage58 4/s 3/s 155 KiB/s 101 KiB/s 2.19 ms 342.82 us 2024-03-26T17:08:13.437 INFO:tasks.workunit.client.3.smithi157.stdout:myimage6 4/s 4/s 111 KiB/s 114 KiB/s 2.63 ms 464.23 us 2024-03-26T17:08:13.437 INFO:tasks.workunit.client.3.smithi157.stdout:myimage25 4/s 3/s 129 KiB/s 78 KiB/s 3.04 ms 331.98 us 2024-03-26T17:08:13.437 INFO:tasks.workunit.client.3.smithi157.stdout:myimage53 4/s 3/s 134 KiB/s 108 KiB/s 2.16 ms 324.85 us 2024-03-26T17:08:13.437 INFO:tasks.workunit.client.3.smithi157.stdout:myimage60 4/s 5/s 106 KiB/s 138 KiB/s 2.39 ms 409.80 us 2024-03-26T17:08:13.437 INFO:tasks.workunit.client.3.smithi157.stdout:myimage30 4/s 4/s 170 KiB/s 94 KiB/s 3.04 ms 407.70 us 2024-03-26T17:08:13.437 INFO:tasks.workunit.client.3.smithi157.stdout:myimage32 4/s 3/s 136 KiB/s 98 KiB/s 2.42 ms 360.05 us 2024-03-26T17:08:13.437 INFO:tasks.workunit.client.3.smithi157.stdout:myimage5 4/s 4/s 104 KiB/s 117 KiB/s 2.29 ms 345.37 us 2024-03-26T17:08:13.437 INFO:tasks.workunit.client.3.smithi157.stdout:myimage21 4/s 4/s 92 KiB/s 121 KiB/s 3.18 ms 366.93 us 2024-03-26T17:08:13.438 INFO:tasks.workunit.client.3.smithi157.stdout:myimage28 4/s 4/s 150 KiB/s 113 KiB/s 3.34 ms 306.00 us 2024-03-26T17:08:13.438 INFO:tasks.workunit.client.3.smithi157.stdout:myimage36 4/s 3/s 106 KiB/s 94 KiB/s 2.41 ms 341.69 us 2024-03-26T17:08:13.438 INFO:tasks.workunit.client.3.smithi157.stdout:myimage51 4/s 3/s 125 KiB/s 102 KiB/s 2.79 ms 295.47 us 2024-03-26T17:08:13.438 INFO:tasks.workunit.client.3.smithi157.stdout:myimage3 4/s 4/s 104 KiB/s 121 KiB/s 1.99 ms 339.47 us 2024-03-26T17:08:13.438 INFO:tasks.workunit.client.3.smithi157.stdout:myimage22 4/s 4/s 82 KiB/s 103 KiB/s 2.42 ms 298.87 us 2024-03-26T17:08:13.438 INFO:tasks.workunit.client.3.smithi157.stdout:myimage35 4/s 4/s 102 KiB/s 117 KiB/s 2.51 ms 323.59 us 2024-03-26T17:08:13.438 INFO:tasks.workunit.client.3.smithi157.stdout:myimage48 4/s 4/s 91 KiB/s 100 KiB/s 2.47 ms 375.49 us 2024-03-26T17:08:13.438 INFO:tasks.workunit.client.3.smithi157.stdout:myimage8 4/s 3/s 144 KiB/s 114 KiB/s 2.60 ms 336.30 us 2024-03-26T17:08:13.438 INFO:tasks.workunit.client.3.smithi157.stdout:myimage11 4/s 4/s 146 KiB/s 134 KiB/s 2.57 ms 385.04 us 2024-03-26T17:08:13.438 INFO:tasks.workunit.client.3.smithi157.stdout:myimage29 4/s 4/s 87 KiB/s 86 KiB/s 2.21 ms 369.57 us 2024-03-26T17:08:13.438 INFO:tasks.workunit.client.3.smithi157.stdout:myimage41 4/s 2/s 126 KiB/s 82 KiB/s 2.70 ms 293.42 us 2024-03-26T17:08:13.439 INFO:tasks.workunit.client.3.smithi157.stdout:myimage50 4/s 4/s 108 KiB/s 111 KiB/s 2.69 ms 591.46 us 2024-03-26T17:08:13.439 INFO:tasks.workunit.client.3.smithi157.stdout:myimage59 4/s 4/s 140 KiB/s 98 KiB/s 2.61 ms 359.95 us 2024-03-26T17:08:13.439 INFO:tasks.workunit.client.3.smithi157.stdout:myimage14 4/s 3/s 108 KiB/s 89 KiB/s 2.87 ms 444.43 us 2024-03-26T17:08:13.439 INFO:tasks.workunit.client.3.smithi157.stdout:myimage16 4/s 4/s 101 KiB/s 112 KiB/s 2.46 ms 354.22 us 2024-03-26T17:08:13.439 INFO:tasks.workunit.client.3.smithi157.stdout:myimage40 4/s 3/s 156 KiB/s 103 KiB/s 2.40 ms 357.69 us 2024-03-26T17:08:13.439 INFO:tasks.workunit.client.3.smithi157.stdout:myimage17 4/s 3/s 86 KiB/s 101 KiB/s 2.49 ms 347.23 us 2024-03-26T17:08:13.439 INFO:tasks.workunit.client.3.smithi157.stdout:myimage34 4/s 4/s 82 KiB/s 99 KiB/s 2.29 ms 413.10 us 2024-03-26T17:08:13.439 INFO:tasks.workunit.client.3.smithi157.stdout:myimage52 4/s 5/s 121 KiB/s 128 KiB/s 2.78 ms 327.12 us 2024-03-26T17:08:13.439 INFO:tasks.workunit.client.3.smithi157.stdout:myimage1 4/s 5/s 106 KiB/s 118 KiB/s 2.04 ms 355.81 us 2024-03-26T17:08:13.439 INFO:tasks.workunit.client.3.smithi157.stdout:myimage26 4/s 4/s 133 KiB/s 152 KiB/s 2.46 ms 355.19 us 2024-03-26T17:08:13.439 INFO:tasks.workunit.client.3.smithi157.stdout:myimage33 4/s 4/s 114 KiB/s 113 KiB/s 2.72 ms 330.13 us 2024-03-26T17:08:13.439 INFO:tasks.workunit.client.3.smithi157.stdout:myimage12 3/s 4/s 126 KiB/s 94 KiB/s 2.44 ms 315.45 us 2024-03-26T17:08:13.439 INFO:tasks.workunit.client.3.smithi157.stdout:myimage19 3/s 5/s 93 KiB/s 143 KiB/s 2.53 ms 434.88 us 2024-03-26T17:08:13.439 INFO:tasks.workunit.client.3.smithi157.stdout:myimage2 3/s 4/s 136 KiB/s 86 KiB/s 2.84 ms 402.20 us 2024-03-26T17:08:13.440 INFO:tasks.workunit.client.3.smithi157.stdout:myimage24 3/s 4/s 114 KiB/s 138 KiB/s 2.67 ms 350.14 us 2024-03-26T17:08:13.440 INFO:tasks.workunit.client.3.smithi157.stdout:myimage27 3/s 5/s 106 KiB/s 123 KiB/s 2.24 ms 398.01 us 2024-03-26T17:08:13.440 INFO:tasks.workunit.client.3.smithi157.stdout:myimage39 3/s 4/s 109 KiB/s 95 KiB/s 2.36 ms 409.21 us 2024-03-26T17:08:13.440 INFO:tasks.workunit.client.3.smithi157.stdout:myimage23 3/s 5/s 126 KiB/s 195 KiB/s 2.10 ms 366.94 us 2024-03-26T17:08:13.440 INFO:tasks.workunit.client.3.smithi157.stdout:myimage38 3/s 4/s 90 KiB/s 130 KiB/s 1.91 ms 306.55 us 2024-03-26T17:08:13.440 INFO:tasks.workunit.client.3.smithi157.stdout:myimage55 3/s 4/s 79 KiB/s 104 KiB/s 2.56 ms 329.04 us 2024-03-26T17:08:13.440 INFO:tasks.workunit.client.3.smithi157.stdout:myimage47 3/s 5/s 86 KiB/s 125 KiB/s 2.61 ms 372.50 us 2024-03-26T17:08:13.440 INFO:tasks.workunit.client.3.smithi157.stdout:myimage9 3/s 6/s 87 KiB/s 187 KiB/s 2.49 ms 338.49 us 2024-03-26T17:08:13.440 INFO:tasks.workunit.client.3.smithi157.stdout:myimage45 3/s 4/s 94 KiB/s 118 KiB/s 2.38 ms 357.61 us 2024-03-26T17:08:13.440 INFO:tasks.workunit.client.3.smithi157.stdout:myimage56 3/s 5/s 51 KiB/s 132 KiB/s 3.05 ms 332.28 us 2024-03-26T17:08:13.440 INFO:tasks.workunit.client.3.smithi157.stdout:myimage42 3/s 4/s 55 KiB/s 109 KiB/s 2.48 ms 350.87 us 2024-03-26T17:08:13.440 INFO:tasks.workunit.client.3.smithi157.stdout:myimage43 2/s 6/s 75 KiB/s 148 KiB/s 2.49 ms 371.44 us 2024-03-26T17:08:13.440 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:08:13.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:08:13 smithi044 ceph-mon[30624]: pgmap v671: 33 pgs: 33 active+clean; 1.0 GiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 7.0 MiB/s rd, 7.0 MiB/s wr, 516 op/s 2024-03-26T17:08:13.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:08:13 smithi064 ceph-mon[34420]: pgmap v671: 33 pgs: 33 active+clean; 1.0 GiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 7.0 MiB/s rd, 7.0 MiB/s wr, 516 op/s 2024-03-26T17:08:14.456 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:08:14 smithi064 ceph-mon[34420]: Health check update: 3 slow ops, oldest one blocked for 588 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:08:14.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:08:14 smithi044 ceph-mon[30624]: Health check update: 3 slow ops, oldest one blocked for 588 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:08:14.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:08:14 smithi149 ceph-mon[34678]: Health check update: 3 slow ops, oldest one blocked for 588 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:08:15.165 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:08:14 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:08:14] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:08:15.165 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:08:14 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:08:14] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:08:15.165 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:08:14 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:08:15.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:08:15 smithi149 ceph-mon[34678]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:08:15.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:08:15 smithi149 ceph-mon[34678]: { 2024-03-26T17:08:15.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:08:15 smithi149 ceph-mon[34678]: "prefix": "rbd perf image stats", 2024-03-26T17:08:15.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:08:15 smithi149 ceph-mon[34678]: "pool_spec": "mypool", 2024-03-26T17:08:15.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:08:15 smithi149 ceph-mon[34678]: "sort_by": "write_ops", 2024-03-26T17:08:15.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:08:15 smithi149 ceph-mon[34678]: "format": "json" 2024-03-26T17:08:15.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:08:15 smithi149 ceph-mon[34678]: }"]: dispatch 2024-03-26T17:08:15.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:08:15 smithi149 ceph-mon[34678]: pgmap v672: 33 pgs: 33 active+clean; 1.0 GiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 7.0 MiB/s rd, 7.1 MiB/s wr, 525 op/s 2024-03-26T17:08:15.397 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:08:15 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:08:15] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:08:15.397 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:08:15 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:08:15] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:08:15.397 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:08:15 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:08:15.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:08:15 smithi044 ceph-mon[30624]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:08:15.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:08:15 smithi044 ceph-mon[30624]: { 2024-03-26T17:08:15.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:08:15 smithi044 ceph-mon[30624]: "prefix": "rbd perf image stats", 2024-03-26T17:08:15.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:08:15 smithi044 ceph-mon[30624]: "pool_spec": "mypool", 2024-03-26T17:08:15.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:08:15 smithi044 ceph-mon[30624]: "sort_by": "write_ops", 2024-03-26T17:08:15.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:08:15 smithi044 ceph-mon[30624]: "format": "json" 2024-03-26T17:08:15.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:08:15 smithi044 ceph-mon[30624]: }"]: dispatch 2024-03-26T17:08:15.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:08:15 smithi044 ceph-mon[30624]: pgmap v672: 33 pgs: 33 active+clean; 1.0 GiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 7.0 MiB/s rd, 7.1 MiB/s wr, 525 op/s 2024-03-26T17:08:15.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:08:15 smithi064 ceph-mon[34420]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:08:15.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:08:15 smithi064 ceph-mon[34420]: { 2024-03-26T17:08:15.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:08:15 smithi064 ceph-mon[34420]: "prefix": "rbd perf image stats", 2024-03-26T17:08:15.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:08:15 smithi064 ceph-mon[34420]: "pool_spec": "mypool", 2024-03-26T17:08:15.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:08:15 smithi064 ceph-mon[34420]: "sort_by": "write_ops", 2024-03-26T17:08:15.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:08:15 smithi064 ceph-mon[34420]: "format": "json" 2024-03-26T17:08:15.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:08:15 smithi064 ceph-mon[34420]: }"]: dispatch 2024-03-26T17:08:15.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:08:15 smithi064 ceph-mon[34420]: pgmap v672: 33 pgs: 33 active+clean; 1.0 GiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 7.0 MiB/s rd, 7.1 MiB/s wr, 525 op/s 2024-03-26T17:08:16.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:08:16 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 2024-03-26T17:08:16.234+0000 7fa707a55700 -1 mon.c@1(peon) e3 get_health_metrics reporting 3 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T17:08:17.167 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:08:16 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:08:16] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:08:17.167 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:08:16 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:08:16] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:08:17.167 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:08:16 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:08:17.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:08:17 smithi149 ceph-mon[34678]: pgmap v673: 33 pgs: 33 active+clean; 1.0 GiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 7.1 MiB/s rd, 7.3 MiB/s wr, 547 op/s 2024-03-26T17:08:17.396 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:08:17 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:08:17] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:08:17.397 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:08:17 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:08:17] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:08:17.397 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:08:17 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:08:17.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:08:17 smithi044 ceph-mon[30624]: pgmap v673: 33 pgs: 33 active+clean; 1.0 GiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 7.1 MiB/s rd, 7.3 MiB/s wr, 547 op/s 2024-03-26T17:08:17.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:08:17 smithi064 ceph-mon[34420]: pgmap v673: 33 pgs: 33 active+clean; 1.0 GiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 7.1 MiB/s rd, 7.3 MiB/s wr, 547 op/s 2024-03-26T17:08:18.439 INFO:tasks.workunit.client.3.smithi157.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-26T17:08:18.439 INFO:tasks.workunit.client.3.smithi157.stdout:myimage32 6/s 3/s 193 KiB/s 105 KiB/s 2.55 ms 367.31 us 2024-03-26T17:08:18.439 INFO:tasks.workunit.client.3.smithi157.stdout:myimage52 6/s 2/s 157 KiB/s 62 KiB/s 2.84 ms 458.98 us 2024-03-26T17:08:18.439 INFO:tasks.workunit.client.3.smithi157.stdout:myimage34 6/s 3/s 148 KiB/s 78 KiB/s 2.36 ms 303.80 us 2024-03-26T17:08:18.439 INFO:tasks.workunit.client.3.smithi157.stdout:myimage33 6/s 2/s 145 KiB/s 97 KiB/s 2.43 ms 340.94 us 2024-03-26T17:08:18.439 INFO:tasks.workunit.client.3.smithi157.stdout:myimage47 5/s 3/s 131 KiB/s 71 KiB/s 2.63 ms 353.75 us 2024-03-26T17:08:18.439 INFO:tasks.workunit.client.3.smithi157.stdout:myimage24 5/s 3/s 126 KiB/s 106 KiB/s 2.51 ms 317.48 us 2024-03-26T17:08:18.439 INFO:tasks.workunit.client.3.smithi157.stdout:myimage5 5/s 3/s 157 KiB/s 54 KiB/s 2.24 ms 322.12 us 2024-03-26T17:08:18.439 INFO:tasks.workunit.client.3.smithi157.stdout:myimage26 5/s 3/s 158 KiB/s 69 KiB/s 2.65 ms 318.67 us 2024-03-26T17:08:18.439 INFO:tasks.workunit.client.3.smithi157.stdout:myimage22 5/s 3/s 128 KiB/s 93 KiB/s 2.37 ms 350.65 us 2024-03-26T17:08:18.439 INFO:tasks.workunit.client.3.smithi157.stdout:myimage1 5/s 2/s 107 KiB/s 56 KiB/s 2.13 ms 284.87 us 2024-03-26T17:08:18.439 INFO:tasks.workunit.client.3.smithi157.stdout:myimage36 5/s 3/s 104 KiB/s 82 KiB/s 2.41 ms 356.34 us 2024-03-26T17:08:18.439 INFO:tasks.workunit.client.3.smithi157.stdout:myimage39 5/s 4/s 120 KiB/s 126 KiB/s 2.16 ms 382.98 us 2024-03-26T17:08:18.439 INFO:tasks.workunit.client.3.smithi157.stdout:myimage41 5/s 5/s 138 KiB/s 174 KiB/s 2.55 ms 342.86 us 2024-03-26T17:08:18.440 INFO:tasks.workunit.client.3.smithi157.stdout:myimage55 5/s 4/s 158 KiB/s 94 KiB/s 2.64 ms 339.03 us 2024-03-26T17:08:18.440 INFO:tasks.workunit.client.3.smithi157.stdout:myimage4 4/s 4/s 127 KiB/s 96 KiB/s 2.25 ms 397.36 us 2024-03-26T17:08:18.440 INFO:tasks.workunit.client.3.smithi157.stdout:myimage11 4/s 3/s 156 KiB/s 101 KiB/s 2.74 ms 338.65 us 2024-03-26T17:08:18.440 INFO:tasks.workunit.client.3.smithi157.stdout:myimage25 4/s 4/s 103 KiB/s 102 KiB/s 3.09 ms 342.53 us 2024-03-26T17:08:18.440 INFO:tasks.workunit.client.3.smithi157.stdout:myimage46 4/s 3/s 138 KiB/s 90 KiB/s 2.35 ms 432.66 us 2024-03-26T17:08:18.440 INFO:tasks.workunit.client.3.smithi157.stdout:myimage50 4/s 4/s 122 KiB/s 124 KiB/s 2.66 ms 349.94 us 2024-03-26T17:08:18.440 INFO:tasks.workunit.client.3.smithi157.stdout:myimage57 4/s 3/s 110 KiB/s 110 KiB/s 2.72 ms 392.01 us 2024-03-26T17:08:18.440 INFO:tasks.workunit.client.3.smithi157.stdout:myimage23 4/s 4/s 126 KiB/s 110 KiB/s 2.13 ms 317.99 us 2024-03-26T17:08:18.440 INFO:tasks.workunit.client.3.smithi157.stdout:myimage31 4/s 3/s 114 KiB/s 108 KiB/s 2.73 ms 429.14 us 2024-03-26T17:08:18.440 INFO:tasks.workunit.client.3.smithi157.stdout:myimage37 4/s 4/s 105 KiB/s 90 KiB/s 2.70 ms 360.31 us 2024-03-26T17:08:18.440 INFO:tasks.workunit.client.3.smithi157.stdout:myimage38 4/s 4/s 133 KiB/s 94 KiB/s 2.16 ms 348.31 us 2024-03-26T17:08:18.440 INFO:tasks.workunit.client.3.smithi157.stdout:myimage15 4/s 3/s 138 KiB/s 74 KiB/s 2.32 ms 335.91 us 2024-03-26T17:08:18.440 INFO:tasks.workunit.client.3.smithi157.stdout:myimage18 4/s 5/s 108 KiB/s 152 KiB/s 2.46 ms 393.11 us 2024-03-26T17:08:18.440 INFO:tasks.workunit.client.3.smithi157.stdout:myimage27 4/s 5/s 110 KiB/s 106 KiB/s 2.37 ms 398.24 us 2024-03-26T17:08:18.440 INFO:tasks.workunit.client.3.smithi157.stdout:myimage43 4/s 4/s 142 KiB/s 92 KiB/s 2.61 ms 357.28 us 2024-03-26T17:08:18.440 INFO:tasks.workunit.client.3.smithi157.stdout:myimage53 4/s 4/s 113 KiB/s 130 KiB/s 2.21 ms 384.33 us 2024-03-26T17:08:18.441 INFO:tasks.workunit.client.3.smithi157.stdout:myimage10 4/s 5/s 110 KiB/s 106 KiB/s 2.48 ms 339.74 us 2024-03-26T17:08:18.441 INFO:tasks.workunit.client.3.smithi157.stdout:myimage59 4/s 4/s 90 KiB/s 130 KiB/s 4.46 ms 374.97 us 2024-03-26T17:08:18.441 INFO:tasks.workunit.client.3.smithi157.stdout:myimage3 4/s 4/s 127 KiB/s 133 KiB/s 2.04 ms 354.24 us 2024-03-26T17:08:18.441 INFO:tasks.workunit.client.3.smithi157.stdout:myimage35 4/s 5/s 133 KiB/s 124 KiB/s 2.64 ms 316.35 us 2024-03-26T17:08:18.441 INFO:tasks.workunit.client.3.smithi157.stdout:myimage44 4/s 4/s 94 KiB/s 114 KiB/s 2.52 ms 355.30 us 2024-03-26T17:08:18.441 INFO:tasks.workunit.client.3.smithi157.stdout:myimage20 4/s 3/s 91 KiB/s 73 KiB/s 2.17 ms 353.28 us 2024-03-26T17:08:18.441 INFO:tasks.workunit.client.3.smithi157.stdout:myimage29 4/s 4/s 120 KiB/s 103 KiB/s 2.18 ms 343.26 us 2024-03-26T17:08:18.441 INFO:tasks.workunit.client.3.smithi157.stdout:myimage54 4/s 4/s 108 KiB/s 118 KiB/s 2.40 ms 422.20 us 2024-03-26T17:08:18.441 INFO:tasks.workunit.client.3.smithi157.stdout:myimage16 4/s 3/s 98 KiB/s 138 KiB/s 2.56 ms 379.15 us 2024-03-26T17:08:18.441 INFO:tasks.workunit.client.3.smithi157.stdout:myimage58 4/s 4/s 124 KiB/s 109 KiB/s 2.18 ms 415.49 us 2024-03-26T17:08:18.441 INFO:tasks.workunit.client.3.smithi157.stdout:myimage17 4/s 5/s 109 KiB/s 141 KiB/s 2.75 ms 365.01 us 2024-03-26T17:08:18.441 INFO:tasks.workunit.client.3.smithi157.stdout:myimage28 4/s 3/s 123 KiB/s 74 KiB/s 3.20 ms 344.95 us 2024-03-26T17:08:18.441 INFO:tasks.workunit.client.3.smithi157.stdout:myimage30 3/s 4/s 99 KiB/s 130 KiB/s 2.99 ms 374.08 us 2024-03-26T17:08:18.441 INFO:tasks.workunit.client.3.smithi157.stdout:myimage49 3/s 4/s 96 KiB/s 147 KiB/s 2.51 ms 431.17 us 2024-03-26T17:08:18.442 INFO:tasks.workunit.client.3.smithi157.stdout:myimage8 3/s 4/s 130 KiB/s 110 KiB/s 2.78 ms 338.89 us 2024-03-26T17:08:18.442 INFO:tasks.workunit.client.3.smithi157.stdout:myimage12 3/s 4/s 96 KiB/s 116 KiB/s 2.54 ms 324.42 us 2024-03-26T17:08:18.442 INFO:tasks.workunit.client.3.smithi157.stdout:myimage19 3/s 4/s 78 KiB/s 94 KiB/s 2.42 ms 313.15 us 2024-03-26T17:08:18.442 INFO:tasks.workunit.client.3.smithi157.stdout:myimage21 3/s 4/s 82 KiB/s 104 KiB/s 3.03 ms 397.24 us 2024-03-26T17:08:18.442 INFO:tasks.workunit.client.3.smithi157.stdout:myimage51 3/s 4/s 117 KiB/s 125 KiB/s 2.61 ms 324.15 us 2024-03-26T17:08:18.442 INFO:tasks.workunit.client.3.smithi157.stdout:myimage13 3/s 4/s 96 KiB/s 106 KiB/s 2.23 ms 338.53 us 2024-03-26T17:08:18.442 INFO:tasks.workunit.client.3.smithi157.stdout:myimage14 3/s 4/s 110 KiB/s 114 KiB/s 2.58 ms 345.35 us 2024-03-26T17:08:18.442 INFO:tasks.workunit.client.3.smithi157.stdout:myimage40 3/s 5/s 112 KiB/s 146 KiB/s 2.42 ms 355.94 us 2024-03-26T17:08:18.442 INFO:tasks.workunit.client.3.smithi157.stdout:myimage7 3/s 4/s 94 KiB/s 113 KiB/s 2.57 ms 364.77 us 2024-03-26T17:08:18.442 INFO:tasks.workunit.client.3.smithi157.stdout:myimage9 3/s 4/s 120 KiB/s 110 KiB/s 2.44 ms 331.66 us 2024-03-26T17:08:18.442 INFO:tasks.workunit.client.3.smithi157.stdout:myimage42 3/s 5/s 72 KiB/s 137 KiB/s 2.39 ms 365.46 us 2024-03-26T17:08:18.442 INFO:tasks.workunit.client.3.smithi157.stdout:myimage45 3/s 5/s 117 KiB/s 123 KiB/s 2.50 ms 327.06 us 2024-03-26T17:08:18.442 INFO:tasks.workunit.client.3.smithi157.stdout:myimage2 3/s 5/s 92 KiB/s 122 KiB/s 2.73 ms 301.82 us 2024-03-26T17:08:18.442 INFO:tasks.workunit.client.3.smithi157.stdout:myimage56 3/s 4/s 53 KiB/s 100 KiB/s 3.08 ms 347.06 us 2024-03-26T17:08:18.443 INFO:tasks.workunit.client.3.smithi157.stdout:myimage48 3/s 4/s 79 KiB/s 121 KiB/s 2.66 ms 338.71 us 2024-03-26T17:08:18.443 INFO:tasks.workunit.client.3.smithi157.stdout:myimage6 3/s 4/s 82 KiB/s 138 KiB/s 2.67 ms 359.09 us 2024-03-26T17:08:18.443 INFO:tasks.workunit.client.3.smithi157.stdout:myimage60 3/s 4/s 62 KiB/s 102 KiB/s 2.82 ms 413.27 us 2024-03-26T17:08:18.443 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:08:19.169 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:08:18 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:08:18] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:08:19.169 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:08:18 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:08:18] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:08:19.169 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:08:18 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:08:19.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:08:19 smithi149 ceph-mon[34678]: pgmap v674: 33 pgs: 33 active+clean; 1.0 GiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 6.5 MiB/s rd, 6.7 MiB/s wr, 511 op/s 2024-03-26T17:08:19.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:08:19 smithi149 ceph-mon[34678]: Health check update: 3 slow ops, oldest one blocked for 593 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:08:19.396 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:08:19 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:08:19] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:08:19.396 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:08:19 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:08:19] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:08:19.397 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:08:19 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:08:19.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:08:19 smithi044 ceph-mon[30624]: pgmap v674: 33 pgs: 33 active+clean; 1.0 GiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 6.5 MiB/s rd, 6.7 MiB/s wr, 511 op/s 2024-03-26T17:08:19.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:08:19 smithi044 ceph-mon[30624]: Health check update: 3 slow ops, oldest one blocked for 593 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:08:19.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:08:19 smithi064 ceph-mon[34420]: pgmap v674: 33 pgs: 33 active+clean; 1.0 GiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 6.5 MiB/s rd, 6.7 MiB/s wr, 511 op/s 2024-03-26T17:08:19.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:08:19 smithi064 ceph-mon[34420]: Health check update: 3 slow ops, oldest one blocked for 593 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:08:20.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:08:20 smithi044 ceph-mon[30624]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:08:20.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:08:20 smithi044 ceph-mon[30624]: { 2024-03-26T17:08:20.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:08:20 smithi044 ceph-mon[30624]: "prefix": "rbd perf image stats", 2024-03-26T17:08:20.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:08:20 smithi044 ceph-mon[30624]: "pool_spec": "mypool", 2024-03-26T17:08:20.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:08:20 smithi044 ceph-mon[30624]: "sort_by": "write_ops", 2024-03-26T17:08:20.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:08:20 smithi044 ceph-mon[30624]: "format": "json" 2024-03-26T17:08:20.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:08:20 smithi044 ceph-mon[30624]: }"]: dispatch 2024-03-26T17:08:20.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:08:20 smithi064 ceph-mon[34420]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:08:20.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:08:20 smithi064 ceph-mon[34420]: { 2024-03-26T17:08:20.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:08:20 smithi064 ceph-mon[34420]: "prefix": "rbd perf image stats", 2024-03-26T17:08:20.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:08:20 smithi064 ceph-mon[34420]: "pool_spec": "mypool", 2024-03-26T17:08:20.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:08:20 smithi064 ceph-mon[34420]: "sort_by": "write_ops", 2024-03-26T17:08:20.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:08:20 smithi064 ceph-mon[34420]: "format": "json" 2024-03-26T17:08:20.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:08:20 smithi064 ceph-mon[34420]: }"]: dispatch 2024-03-26T17:08:20.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:08:20 smithi149 ceph-mon[34678]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:08:20.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:08:20 smithi149 ceph-mon[34678]: { 2024-03-26T17:08:20.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:08:20 smithi149 ceph-mon[34678]: "prefix": "rbd perf image stats", 2024-03-26T17:08:20.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:08:20 smithi149 ceph-mon[34678]: "pool_spec": "mypool", 2024-03-26T17:08:20.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:08:20 smithi149 ceph-mon[34678]: "sort_by": "write_ops", 2024-03-26T17:08:20.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:08:20 smithi149 ceph-mon[34678]: "format": "json" 2024-03-26T17:08:20.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:08:20 smithi149 ceph-mon[34678]: }"]: dispatch 2024-03-26T17:08:21.174 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:08:20 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:08:20] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:08:21.174 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:08:20 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:08:20] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:08:21.174 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:08:20 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:08:21.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:08:21 smithi149 ceph-mon[34678]: pgmap v675: 33 pgs: 33 active+clean; 1.0 GiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 6.1 MiB/s rd, 6.3 MiB/s wr, 491 op/s 2024-03-26T17:08:21.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:08:21 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 2024-03-26T17:08:21.234+0000 7fa707a55700 -1 mon.c@1(peon) e3 get_health_metrics reporting 3 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T17:08:21.396 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:08:21 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:08:21] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:08:21.396 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:08:21 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:08:21] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:08:21.397 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:08:21 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:08:21.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:08:21 smithi044 ceph-mon[30624]: pgmap v675: 33 pgs: 33 active+clean; 1.0 GiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 6.1 MiB/s rd, 6.3 MiB/s wr, 491 op/s 2024-03-26T17:08:21.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:08:21 smithi064 ceph-mon[34420]: pgmap v675: 33 pgs: 33 active+clean; 1.0 GiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 6.1 MiB/s rd, 6.3 MiB/s wr, 491 op/s 2024-03-26T17:08:23.062 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:08:23.071 INFO:tasks.workunit.client.3.smithi157.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2024-03-26T17:08:23.071 INFO:tasks.workunit.client.3.smithi157.stdout: 8.40 107.2k 101.2k 0.0k 1.0M 1012.0k 0.0k nvme2n1 2024-03-26T17:08:23.071 INFO:tasks.workunit.client.3.smithi157.stdout: 8.40 124.8k 97.6k 0.0k 1.2M 976.0k 0.0k nvme2n10 2024-03-26T17:08:23.071 INFO:tasks.workunit.client.3.smithi157.stdout: 8.40 103.6k 134.4k 0.0k 1.0M 1.3M 0.0k nvme2n11 2024-03-26T17:08:23.072 INFO:tasks.workunit.client.3.smithi157.stdout: 8.40 104.8k 99.2k 0.0k 1.0M 992.0k 0.0k nvme2n12 2024-03-26T17:08:23.072 INFO:tasks.workunit.client.3.smithi157.stdout: 8.40 107.6k 83.2k 0.0k 1.1M 832.0k 0.0k nvme2n13 2024-03-26T17:08:23.072 INFO:tasks.workunit.client.3.smithi157.stdout: 8.40 102.8k 102.8k 0.0k 1.0M 1.0M 0.0k nvme2n14 2024-03-26T17:08:23.072 INFO:tasks.workunit.client.3.smithi157.stdout: 8.30 103.2k 98.0k 0.0k 1.0M 980.0k 0.0k nvme2n15 2024-03-26T17:08:23.072 INFO:tasks.workunit.client.3.smithi157.stdout: 8.30 91.6k 105.6k 0.0k 916.0k 1.0M 0.0k nvme2n16 2024-03-26T17:08:23.072 INFO:tasks.workunit.client.3.smithi157.stdout: 8.30 107.2k 113.2k 0.0k 1.0M 1.1M 0.0k nvme2n17 2024-03-26T17:08:23.072 INFO:tasks.workunit.client.3.smithi157.stdout: 8.30 91.2k 95.6k 0.0k 912.0k 956.0k 0.0k nvme2n18 2024-03-26T17:08:23.072 INFO:tasks.workunit.client.3.smithi157.stdout: 8.40 96.8k 100.0k 0.0k 968.0k 1000.0k 0.0k nvme2n19 2024-03-26T17:08:23.072 INFO:tasks.workunit.client.3.smithi157.stdout: 8.40 122.0k 97.6k 0.0k 1.2M 976.0k 0.0k nvme2n2 2024-03-26T17:08:23.072 INFO:tasks.workunit.client.3.smithi157.stdout: 8.40 102.8k 88.8k 0.0k 1.0M 888.0k 0.0k nvme2n20 2024-03-26T17:08:23.072 INFO:tasks.workunit.client.3.smithi157.stdout: 8.40 107.2k 104.4k 0.0k 1.0M 1.0M 0.0k nvme2n3 2024-03-26T17:08:23.072 INFO:tasks.workunit.client.3.smithi157.stdout: 8.40 80.8k 120.8k 0.0k 808.0k 1.2M 0.0k nvme2n4 2024-03-26T17:08:23.072 INFO:tasks.workunit.client.3.smithi157.stdout: 8.40 94.8k 115.2k 0.0k 948.0k 1.1M 0.0k nvme2n5 2024-03-26T17:08:23.072 INFO:tasks.workunit.client.3.smithi157.stdout: 8.40 86.8k 79.6k 0.0k 868.0k 796.0k 0.0k nvme2n6 2024-03-26T17:08:23.073 INFO:tasks.workunit.client.3.smithi157.stdout: 8.40 104.8k 92.0k 0.0k 1.0M 920.0k 0.0k nvme2n7 2024-03-26T17:08:23.073 INFO:tasks.workunit.client.3.smithi157.stdout: 8.40 132.0k 89.6k 0.0k 1.3M 896.0k 0.0k nvme2n8 2024-03-26T17:08:23.073 INFO:tasks.workunit.client.3.smithi157.stdout: 8.40 78.0k 120.0k 0.0k 780.0k 1.2M 0.0k nvme2n9 2024-03-26T17:08:23.073 INFO:tasks.workunit.client.3.smithi157.stdout: 8.40 70.0k 137.2k 0.0k 700.0k 1.3M 0.0k nvme5n1 2024-03-26T17:08:23.073 INFO:tasks.workunit.client.3.smithi157.stdout: 8.40 116.0k 86.4k 0.0k 1.1M 864.0k 0.0k nvme5n10 2024-03-26T17:08:23.073 INFO:tasks.workunit.client.3.smithi157.stdout: 8.40 117.2k 94.0k 0.0k 1.1M 940.0k 0.0k nvme5n11 2024-03-26T17:08:23.073 INFO:tasks.workunit.client.3.smithi157.stdout: 8.40 108.0k 118.4k 0.0k 1.1M 1.2M 0.0k nvme5n12 2024-03-26T17:08:23.073 INFO:tasks.workunit.client.3.smithi157.stdout: 8.40 92.8k 130.8k 0.0k 928.0k 1.3M 0.0k nvme5n13 2024-03-26T17:08:23.073 INFO:tasks.workunit.client.3.smithi157.stdout: 8.40 97.6k 120.0k 0.0k 976.0k 1.2M 0.0k nvme5n14 2024-03-26T17:08:23.073 INFO:tasks.workunit.client.3.smithi157.stdout: 8.30 124.4k 99.2k 0.0k 1.2M 992.0k 0.0k nvme5n15 2024-03-26T17:08:23.074 INFO:tasks.workunit.client.3.smithi157.stdout: 8.30 89.6k 95.6k 0.0k 896.0k 956.0k 0.0k nvme5n16 2024-03-26T17:08:23.074 INFO:tasks.workunit.client.3.smithi157.stdout: 8.30 89.2k 112.0k 0.0k 892.0k 1.1M 0.0k nvme5n17 2024-03-26T17:08:23.074 INFO:tasks.workunit.client.3.smithi157.stdout: 8.30 88.4k 130.4k 0.0k 884.0k 1.3M 0.0k nvme5n18 2024-03-26T17:08:23.074 INFO:tasks.workunit.client.3.smithi157.stdout: 8.40 101.6k 100.0k 0.0k 1016.0k 1000.0k 0.0k nvme5n19 2024-03-26T17:08:23.074 INFO:tasks.workunit.client.3.smithi157.stdout: 8.40 100.4k 90.0k 0.0k 1004.0k 900.0k 0.0k nvme5n2 2024-03-26T17:08:23.074 INFO:tasks.workunit.client.3.smithi157.stdout: 8.40 131.2k 96.4k 0.0k 1.3M 964.0k 0.0k nvme5n20 2024-03-26T17:08:23.074 INFO:tasks.workunit.client.3.smithi157.stdout: 8.40 111.6k 112.0k 0.0k 1.1M 1.1M 0.0k nvme5n3 2024-03-26T17:08:23.074 INFO:tasks.workunit.client.3.smithi157.stdout: 8.40 90.0k 138.8k 0.0k 900.0k 1.4M 0.0k nvme5n4 2024-03-26T17:08:23.074 INFO:tasks.workunit.client.3.smithi157.stdout: 8.40 92.4k 108.4k 0.0k 924.0k 1.1M 0.0k nvme5n5 2024-03-26T17:08:23.074 INFO:tasks.workunit.client.3.smithi157.stdout: 8.40 88.8k 137.2k 0.0k 888.0k 1.3M 0.0k nvme5n6 2024-03-26T17:08:23.074 INFO:tasks.workunit.client.3.smithi157.stdout: 8.40 108.8k 86.0k 0.0k 1.1M 860.0k 0.0k nvme5n7 2024-03-26T17:08:23.074 INFO:tasks.workunit.client.3.smithi157.stdout: 8.40 85.6k 142.4k 0.0k 856.0k 1.4M 0.0k nvme5n8 2024-03-26T17:08:23.075 INFO:tasks.workunit.client.3.smithi157.stdout: 8.40 126.0k 83.6k 0.0k 1.2M 836.0k 0.0k nvme5n9 2024-03-26T17:08:23.075 INFO:tasks.workunit.client.3.smithi157.stdout: 8.40 156.0k 77.6k 0.0k 1.5M 776.0k 0.0k nvme8n1 2024-03-26T17:08:23.075 INFO:tasks.workunit.client.3.smithi157.stdout: 8.40 118.4k 77.6k 0.0k 1.2M 776.0k 0.0k nvme8n10 2024-03-26T17:08:23.075 INFO:tasks.workunit.client.3.smithi157.stdout: 8.40 128.0k 92.4k 0.0k 1.2M 924.0k 0.0k nvme8n11 2024-03-26T17:08:23.075 INFO:tasks.workunit.client.3.smithi157.stdout: 8.40 88.4k 129.6k 0.0k 884.0k 1.3M 0.0k nvme8n12 2024-03-26T17:08:23.075 INFO:tasks.workunit.client.3.smithi157.stdout: 8.40 114.0k 83.2k 0.0k 1.1M 832.0k 0.0k nvme8n13 2024-03-26T17:08:23.075 INFO:tasks.workunit.client.3.smithi157.stdout: 8.40 97.2k 136.0k 0.0k 972.0k 1.3M 0.0k nvme8n14 2024-03-26T17:08:23.075 INFO:tasks.workunit.client.3.smithi157.stdout: 8.30 135.2k 103.2k 0.0k 1.3M 1.0M 0.0k nvme8n15 2024-03-26T17:08:23.075 INFO:tasks.workunit.client.3.smithi157.stdout: 8.30 86.4k 110.8k 0.0k 864.0k 1.1M 0.0k nvme8n16 2024-03-26T17:08:23.075 INFO:tasks.workunit.client.3.smithi157.stdout: 8.30 119.2k 102.8k 0.0k 1.2M 1.0M 0.0k nvme8n17 2024-03-26T17:08:23.075 INFO:tasks.workunit.client.3.smithi157.stdout: 8.30 120.4k 100.0k 0.0k 1.2M 1000.0k 0.0k nvme8n18 2024-03-26T17:08:23.075 INFO:tasks.workunit.client.3.smithi157.stdout: 8.40 110.4k 74.8k 0.0k 1.1M 748.0k 0.0k nvme8n19 2024-03-26T17:08:23.075 INFO:tasks.workunit.client.3.smithi157.stdout: 8.40 110.0k 72.4k 0.0k 1.1M 724.0k 0.0k nvme8n2 2024-03-26T17:08:23.075 INFO:tasks.workunit.client.3.smithi157.stdout: 8.40 106.0k 64.8k 0.0k 1.0M 648.0k 0.0k nvme8n20 2024-03-26T17:08:23.076 INFO:tasks.workunit.client.3.smithi157.stdout: 8.40 98.4k 114.0k 0.0k 984.0k 1.1M 0.0k nvme8n3 2024-03-26T17:08:23.076 INFO:tasks.workunit.client.3.smithi157.stdout: 8.40 139.2k 101.6k 0.0k 1.4M 1016.0k 0.0k nvme8n4 2024-03-26T17:08:23.076 INFO:tasks.workunit.client.3.smithi157.stdout: 8.40 113.6k 89.6k 0.0k 1.1M 896.0k 0.0k nvme8n5 2024-03-26T17:08:23.076 INFO:tasks.workunit.client.3.smithi157.stdout: 8.40 98.0k 116.4k 0.0k 980.0k 1.1M 0.0k nvme8n6 2024-03-26T17:08:23.076 INFO:tasks.workunit.client.3.smithi157.stdout: 8.40 90.8k 87.6k 0.0k 908.0k 876.0k 0.0k nvme8n7 2024-03-26T17:08:23.076 INFO:tasks.workunit.client.3.smithi157.stdout: 8.40 121.2k 91.2k 0.0k 1.2M 912.0k 0.0k nvme8n8 2024-03-26T17:08:23.076 INFO:tasks.workunit.client.3.smithi157.stdout: 8.40 134.0k 112.0k 0.0k 1.3M 1.1M 0.0k nvme8n9 2024-03-26T17:08:23.076 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:08:23.176 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:08:22 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:08:22] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:08:23.176 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:08:22 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:08:22] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:08:23.176 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:08:22 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:08:23.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:08:23 smithi149 ceph-mon[34678]: pgmap v676: 33 pgs: 33 active+clean; 1.0 GiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 6.4 MiB/s rd, 6.5 MiB/s wr, 514 op/s 2024-03-26T17:08:23.396 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:08:23 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:08:23] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:08:23.396 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:08:23 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:08:23] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:08:23.397 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:08:23 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:08:23.442 INFO:tasks.workunit.client.3.smithi157.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-26T17:08:23.442 INFO:tasks.workunit.client.3.smithi157.stdout:myimage21 5/s 2/s 166 KiB/s 70 KiB/s 3.13 ms 381.98 us 2024-03-26T17:08:23.443 INFO:tasks.workunit.client.3.smithi157.stdout:myimage54 5/s 3/s 165 KiB/s 81 KiB/s 2.40 ms 357.00 us 2024-03-26T17:08:23.443 INFO:tasks.workunit.client.3.smithi157.stdout:myimage6 5/s 4/s 89 KiB/s 86 KiB/s 2.78 ms 296.57 us 2024-03-26T17:08:23.443 INFO:tasks.workunit.client.3.smithi157.stdout:myimage26 5/s 3/s 153 KiB/s 94 KiB/s 2.57 ms 441.85 us 2024-03-26T17:08:23.443 INFO:tasks.workunit.client.3.smithi157.stdout:myimage23 5/s 3/s 118 KiB/s 117 KiB/s 1.95 ms 328.95 us 2024-03-26T17:08:23.443 INFO:tasks.workunit.client.3.smithi157.stdout:myimage3 4/s 3/s 97 KiB/s 89 KiB/s 2.10 ms 336.40 us 2024-03-26T17:08:23.443 INFO:tasks.workunit.client.3.smithi157.stdout:myimage38 4/s 4/s 122 KiB/s 106 KiB/s 2.07 ms 326.93 us 2024-03-26T17:08:23.443 INFO:tasks.workunit.client.3.smithi157.stdout:myimage52 4/s 4/s 99 KiB/s 122 KiB/s 2.75 ms 357.59 us 2024-03-26T17:08:23.443 INFO:tasks.workunit.client.3.smithi157.stdout:myimage17 4/s 3/s 122 KiB/s 104 KiB/s 2.70 ms 350.42 us 2024-03-26T17:08:23.443 INFO:tasks.workunit.client.3.smithi157.stdout:myimage46 4/s 3/s 114 KiB/s 96 KiB/s 2.23 ms 317.63 us 2024-03-26T17:08:23.443 INFO:tasks.workunit.client.3.smithi157.stdout:myimage56 4/s 4/s 110 KiB/s 104 KiB/s 3.08 ms 361.61 us 2024-03-26T17:08:23.443 INFO:tasks.workunit.client.3.smithi157.stdout:myimage14 4/s 4/s 123 KiB/s 94 KiB/s 2.77 ms 397.23 us 2024-03-26T17:08:23.443 INFO:tasks.workunit.client.3.smithi157.stdout:myimage16 4/s 5/s 118 KiB/s 99 KiB/s 2.36 ms 391.24 us 2024-03-26T17:08:23.443 INFO:tasks.workunit.client.3.smithi157.stdout:myimage37 4/s 4/s 122 KiB/s 98 KiB/s 2.46 ms 369.80 us 2024-03-26T17:08:23.444 INFO:tasks.workunit.client.3.smithi157.stdout:myimage4 4/s 3/s 112 KiB/s 87 KiB/s 2.45 ms 311.59 us 2024-03-26T17:08:23.444 INFO:tasks.workunit.client.3.smithi157.stdout:myimage8 4/s 4/s 104 KiB/s 127 KiB/s 2.46 ms 413.63 us 2024-03-26T17:08:23.444 INFO:tasks.workunit.client.3.smithi157.stdout:myimage24 4/s 2/s 134 KiB/s 63 KiB/s 2.49 ms 315.85 us 2024-03-26T17:08:23.444 INFO:tasks.workunit.client.3.smithi157.stdout:myimage25 4/s 4/s 110 KiB/s 94 KiB/s 2.88 ms 341.60 us 2024-03-26T17:08:23.444 INFO:tasks.workunit.client.3.smithi157.stdout:myimage36 4/s 4/s 111 KiB/s 101 KiB/s 2.34 ms 325.89 us 2024-03-26T17:08:23.444 INFO:tasks.workunit.client.3.smithi157.stdout:myimage43 4/s 4/s 93 KiB/s 126 KiB/s 2.53 ms 343.99 us 2024-03-26T17:08:23.444 INFO:tasks.workunit.client.3.smithi157.stdout:myimage40 4/s 4/s 111 KiB/s 130 KiB/s 2.31 ms 361.97 us 2024-03-26T17:08:23.444 INFO:tasks.workunit.client.3.smithi157.stdout:myimage49 4/s 4/s 124 KiB/s 117 KiB/s 2.46 ms 339.54 us 2024-03-26T17:08:23.444 INFO:tasks.workunit.client.3.smithi157.stdout:myimage11 4/s 4/s 104 KiB/s 125 KiB/s 2.66 ms 372.57 us 2024-03-26T17:08:23.444 INFO:tasks.workunit.client.3.smithi157.stdout:myimage20 4/s 3/s 90 KiB/s 115 KiB/s 2.54 ms 389.68 us 2024-03-26T17:08:23.444 INFO:tasks.workunit.client.3.smithi157.stdout:myimage30 4/s 4/s 91 KiB/s 94 KiB/s 3.08 ms 488.01 us 2024-03-26T17:08:23.444 INFO:tasks.workunit.client.3.smithi157.stdout:myimage48 4/s 5/s 128 KiB/s 120 KiB/s 2.53 ms 523.73 us 2024-03-26T17:08:23.444 INFO:tasks.workunit.client.3.smithi157.stdout:myimage12 4/s 4/s 103 KiB/s 111 KiB/s 2.73 ms 343.05 us 2024-03-26T17:08:23.444 INFO:tasks.workunit.client.3.smithi157.stdout:myimage15 4/s 4/s 90 KiB/s 94 KiB/s 2.43 ms 436.21 us 2024-03-26T17:08:23.445 INFO:tasks.workunit.client.3.smithi157.stdout:myimage28 4/s 3/s 122 KiB/s 61 KiB/s 3.14 ms 328.49 us 2024-03-26T17:08:23.445 INFO:tasks.workunit.client.3.smithi157.stdout:myimage29 4/s 4/s 111 KiB/s 108 KiB/s 2.28 ms 347.00 us 2024-03-26T17:08:23.445 INFO:tasks.workunit.client.3.smithi157.stdout:myimage33 4/s 5/s 120 KiB/s 132 KiB/s 2.47 ms 398.63 us 2024-03-26T17:08:23.445 INFO:tasks.workunit.client.3.smithi157.stdout:myimage22 4/s 4/s 109 KiB/s 84 KiB/s 2.24 ms 298.71 us 2024-03-26T17:08:23.445 INFO:tasks.workunit.client.3.smithi157.stdout:myimage1 4/s 4/s 90 KiB/s 139 KiB/s 2.10 ms 368.55 us 2024-03-26T17:08:23.445 INFO:tasks.workunit.client.3.smithi157.stdout:myimage9 4/s 3/s 89 KiB/s 59 KiB/s 2.74 ms 297.61 us 2024-03-26T17:08:23.445 INFO:tasks.workunit.client.3.smithi157.stdout:myimage19 4/s 4/s 126 KiB/s 88 KiB/s 2.53 ms 313.58 us 2024-03-26T17:08:23.445 INFO:tasks.workunit.client.3.smithi157.stdout:myimage60 4/s 5/s 91 KiB/s 118 KiB/s 2.69 ms 382.99 us 2024-03-26T17:08:23.445 INFO:tasks.workunit.client.3.smithi157.stdout:myimage10 4/s 3/s 113 KiB/s 107 KiB/s 2.50 ms 335.75 us 2024-03-26T17:08:23.445 INFO:tasks.workunit.client.3.smithi157.stdout:myimage47 3/s 4/s 90 KiB/s 105 KiB/s 2.57 ms 355.01 us 2024-03-26T17:08:23.445 INFO:tasks.workunit.client.3.smithi157.stdout:myimage7 3/s 4/s 73 KiB/s 118 KiB/s 2.57 ms 356.75 us 2024-03-26T17:08:23.445 INFO:tasks.workunit.client.3.smithi157.stdout:myimage55 3/s 4/s 110 KiB/s 128 KiB/s 2.68 ms 406.14 us 2024-03-26T17:08:23.445 INFO:tasks.workunit.client.3.smithi157.stdout:myimage32 3/s 4/s 104 KiB/s 131 KiB/s 2.55 ms 357.74 us 2024-03-26T17:08:23.445 INFO:tasks.workunit.client.3.smithi157.stdout:myimage34 3/s 4/s 107 KiB/s 107 KiB/s 2.51 ms 418.20 us 2024-03-26T17:08:23.446 INFO:tasks.workunit.client.3.smithi157.stdout:myimage44 3/s 5/s 91 KiB/s 140 KiB/s 2.38 ms 329.47 us 2024-03-26T17:08:23.446 INFO:tasks.workunit.client.3.smithi157.stdout:myimage42 3/s 5/s 70 KiB/s 102 KiB/s 2.37 ms 396.35 us 2024-03-26T17:08:23.446 INFO:tasks.workunit.client.3.smithi157.stdout:myimage50 3/s 4/s 64 KiB/s 122 KiB/s 2.88 ms 352.20 us 2024-03-26T17:08:23.446 INFO:tasks.workunit.client.3.smithi157.stdout:myimage2 3/s 4/s 101 KiB/s 142 KiB/s 2.74 ms 341.45 us 2024-03-26T17:08:23.446 INFO:tasks.workunit.client.3.smithi157.stdout:myimage13 3/s 4/s 82 KiB/s 110 KiB/s 2.21 ms 331.62 us 2024-03-26T17:08:23.446 INFO:tasks.workunit.client.3.smithi157.stdout:myimage39 3/s 5/s 98 KiB/s 130 KiB/s 2.40 ms 405.40 us 2024-03-26T17:08:23.446 INFO:tasks.workunit.client.3.smithi157.stdout:myimage45 3/s 6/s 58 KiB/s 158 KiB/s 2.16 ms 325.88 us 2024-03-26T17:08:23.446 INFO:tasks.workunit.client.3.smithi157.stdout:myimage51 3/s 3/s 85 KiB/s 86 KiB/s 2.90 ms 329.64 us 2024-03-26T17:08:23.446 INFO:tasks.workunit.client.3.smithi157.stdout:myimage57 3/s 4/s 97 KiB/s 125 KiB/s 2.62 ms 355.36 us 2024-03-26T17:08:23.446 INFO:tasks.workunit.client.3.smithi157.stdout:myimage31 3/s 4/s 78 KiB/s 130 KiB/s 2.73 ms 355.04 us 2024-03-26T17:08:23.446 INFO:tasks.workunit.client.3.smithi157.stdout:myimage58 3/s 4/s 75 KiB/s 113 KiB/s 2.33 ms 356.69 us 2024-03-26T17:08:23.446 INFO:tasks.workunit.client.3.smithi157.stdout:myimage59 3/s 4/s 47 KiB/s 125 KiB/s 2.67 ms 375.46 us 2024-03-26T17:08:23.446 INFO:tasks.workunit.client.3.smithi157.stdout:myimage35 3/s 4/s 67 KiB/s 142 KiB/s 2.48 ms 324.20 us 2024-03-26T17:08:23.446 INFO:tasks.workunit.client.3.smithi157.stdout:myimage53 3/s 5/s 66 KiB/s 129 KiB/s 2.34 ms 314.56 us 2024-03-26T17:08:23.447 INFO:tasks.workunit.client.3.smithi157.stdout:myimage18 2/s 4/s 66 KiB/s 102 KiB/s 2.35 ms 322.23 us 2024-03-26T17:08:23.447 INFO:tasks.workunit.client.3.smithi157.stdout:myimage5 2/s 4/s 72 KiB/s 130 KiB/s 2.43 ms 334.57 us 2024-03-26T17:08:23.447 INFO:tasks.workunit.client.3.smithi157.stdout:myimage27 2/s 4/s 64 KiB/s 95 KiB/s 2.25 ms 323.28 us 2024-03-26T17:08:23.447 INFO:tasks.workunit.client.3.smithi157.stdout:myimage41 2/s 5/s 46 KiB/s 122 KiB/s 2.57 ms 309.81 us 2024-03-26T17:08:23.447 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:08:23.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:08:23 smithi044 ceph-mon[30624]: pgmap v676: 33 pgs: 33 active+clean; 1.0 GiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 6.4 MiB/s rd, 6.5 MiB/s wr, 514 op/s 2024-03-26T17:08:23.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:08:23 smithi064 ceph-mon[34420]: pgmap v676: 33 pgs: 33 active+clean; 1.0 GiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 6.4 MiB/s rd, 6.5 MiB/s wr, 514 op/s 2024-03-26T17:08:24.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:08:24 smithi044 ceph-mon[30624]: Health check update: 3 slow ops, oldest one blocked for 598 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:08:24.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:08:24 smithi064 ceph-mon[34420]: Health check update: 3 slow ops, oldest one blocked for 598 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:08:24.645 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:08:24 smithi149 ceph-mon[34678]: Health check update: 3 slow ops, oldest one blocked for 598 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:08:25.181 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:08:24 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:08:24] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:08:25.181 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:08:24 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:08:24] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:08:25.181 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:08:24 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:08:25.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:08:25 smithi149 ceph-mon[34678]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:08:25.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:08:25 smithi149 ceph-mon[34678]: { 2024-03-26T17:08:25.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:08:25 smithi149 ceph-mon[34678]: "prefix": "rbd perf image stats", 2024-03-26T17:08:25.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:08:25 smithi149 ceph-mon[34678]: "pool_spec": "mypool", 2024-03-26T17:08:25.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:08:25 smithi149 ceph-mon[34678]: "sort_by": "write_ops", 2024-03-26T17:08:25.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:08:25 smithi149 ceph-mon[34678]: "format": "json" 2024-03-26T17:08:25.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:08:25 smithi149 ceph-mon[34678]: }"]: dispatch 2024-03-26T17:08:25.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:08:25 smithi149 ceph-mon[34678]: pgmap v677: 33 pgs: 33 active+clean; 1.0 GiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 6.5 MiB/s rd, 6.5 MiB/s wr, 526 op/s 2024-03-26T17:08:25.397 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:08:25 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:08:25] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:08:25.397 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:08:25 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:08:25] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:08:25.397 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:08:25 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:08:25.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:08:25 smithi044 ceph-mon[30624]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:08:25.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:08:25 smithi044 ceph-mon[30624]: { 2024-03-26T17:08:25.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:08:25 smithi044 ceph-mon[30624]: "prefix": "rbd perf image stats", 2024-03-26T17:08:25.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:08:25 smithi044 ceph-mon[30624]: "pool_spec": "mypool", 2024-03-26T17:08:25.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:08:25 smithi044 ceph-mon[30624]: "sort_by": "write_ops", 2024-03-26T17:08:25.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:08:25 smithi044 ceph-mon[30624]: "format": "json" 2024-03-26T17:08:25.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:08:25 smithi044 ceph-mon[30624]: }"]: dispatch 2024-03-26T17:08:25.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:08:25 smithi044 ceph-mon[30624]: pgmap v677: 33 pgs: 33 active+clean; 1.0 GiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 6.5 MiB/s rd, 6.5 MiB/s wr, 526 op/s 2024-03-26T17:08:25.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:08:25 smithi064 ceph-mon[34420]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:08:25.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:08:25 smithi064 ceph-mon[34420]: { 2024-03-26T17:08:25.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:08:25 smithi064 ceph-mon[34420]: "prefix": "rbd perf image stats", 2024-03-26T17:08:25.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:08:25 smithi064 ceph-mon[34420]: "pool_spec": "mypool", 2024-03-26T17:08:25.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:08:25 smithi064 ceph-mon[34420]: "sort_by": "write_ops", 2024-03-26T17:08:25.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:08:25 smithi064 ceph-mon[34420]: "format": "json" 2024-03-26T17:08:25.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:08:25 smithi064 ceph-mon[34420]: }"]: dispatch 2024-03-26T17:08:25.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:08:25 smithi064 ceph-mon[34420]: pgmap v677: 33 pgs: 33 active+clean; 1.0 GiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 6.5 MiB/s rd, 6.5 MiB/s wr, 526 op/s 2024-03-26T17:08:26.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:08:26 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 2024-03-26T17:08:26.235+0000 7fa707a55700 -1 mon.c@1(peon) e3 get_health_metrics reporting 3 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T17:08:27.183 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:08:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:08:26] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:08:27.183 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:08:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:08:26] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:08:27.183 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:08:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:08:27.398 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:08:27 smithi149 ceph-mon[34678]: pgmap v678: 33 pgs: 33 active+clean; 1.0 GiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 6.5 MiB/s rd, 6.5 MiB/s wr, 530 op/s 2024-03-26T17:08:27.399 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:08:27 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:08:27] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:08:27.399 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:08:27 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:08:27] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:08:27.399 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:08:27 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:08:27.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:08:27 smithi044 ceph-mon[30624]: pgmap v678: 33 pgs: 33 active+clean; 1.0 GiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 6.5 MiB/s rd, 6.5 MiB/s wr, 530 op/s 2024-03-26T17:08:27.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:08:27 smithi064 ceph-mon[34420]: pgmap v678: 33 pgs: 33 active+clean; 1.0 GiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 6.5 MiB/s rd, 6.5 MiB/s wr, 530 op/s 2024-03-26T17:08:28.447 INFO:tasks.workunit.client.3.smithi157.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-26T17:08:28.447 INFO:tasks.workunit.client.3.smithi157.stdout:myimage21 5/s 3/s 114 KiB/s 62 KiB/s 3.04 ms 422.26 us 2024-03-26T17:08:28.448 INFO:tasks.workunit.client.3.smithi157.stdout:myimage57 5/s 3/s 151 KiB/s 71 KiB/s 2.81 ms 328.04 us 2024-03-26T17:08:28.448 INFO:tasks.workunit.client.3.smithi157.stdout:myimage58 5/s 3/s 113 KiB/s 84 KiB/s 2.33 ms 327.89 us 2024-03-26T17:08:28.448 INFO:tasks.workunit.client.3.smithi157.stdout:myimage34 5/s 3/s 166 KiB/s 69 KiB/s 2.33 ms 328.46 us 2024-03-26T17:08:28.448 INFO:tasks.workunit.client.3.smithi157.stdout:myimage48 5/s 3/s 145 KiB/s 90 KiB/s 2.44 ms 550.37 us 2024-03-26T17:08:28.448 INFO:tasks.workunit.client.3.smithi157.stdout:myimage12 5/s 3/s 106 KiB/s 80 KiB/s 2.52 ms 435.44 us 2024-03-26T17:08:28.448 INFO:tasks.workunit.client.3.smithi157.stdout:myimage43 5/s 3/s 114 KiB/s 100 KiB/s 2.65 ms 304.68 us 2024-03-26T17:08:28.448 INFO:tasks.workunit.client.3.smithi157.stdout:myimage36 5/s 2/s 89 KiB/s 76 KiB/s 2.45 ms 412.93 us 2024-03-26T17:08:28.448 INFO:tasks.workunit.client.3.smithi157.stdout:myimage38 4/s 3/s 132 KiB/s 89 KiB/s 2.18 ms 313.33 us 2024-03-26T17:08:28.448 INFO:tasks.workunit.client.3.smithi157.stdout:myimage44 4/s 4/s 149 KiB/s 109 KiB/s 2.69 ms 407.84 us 2024-03-26T17:08:28.448 INFO:tasks.workunit.client.3.smithi157.stdout:myimage49 4/s 3/s 133 KiB/s 73 KiB/s 2.45 ms 347.73 us 2024-03-26T17:08:28.448 INFO:tasks.workunit.client.3.smithi157.stdout:myimage1 4/s 4/s 111 KiB/s 91 KiB/s 2.16 ms 323.63 us 2024-03-26T17:08:28.448 INFO:tasks.workunit.client.3.smithi157.stdout:myimage4 4/s 3/s 122 KiB/s 75 KiB/s 2.49 ms 355.43 us 2024-03-26T17:08:28.448 INFO:tasks.workunit.client.3.smithi157.stdout:myimage7 4/s 4/s 121 KiB/s 69 KiB/s 2.57 ms 365.13 us 2024-03-26T17:08:28.448 INFO:tasks.workunit.client.3.smithi157.stdout:myimage15 4/s 3/s 98 KiB/s 99 KiB/s 2.13 ms 363.99 us 2024-03-26T17:08:28.449 INFO:tasks.workunit.client.3.smithi157.stdout:myimage17 4/s 3/s 147 KiB/s 74 KiB/s 2.71 ms 317.40 us 2024-03-26T17:08:28.449 INFO:tasks.workunit.client.3.smithi157.stdout:myimage18 4/s 3/s 106 KiB/s 71 KiB/s 2.47 ms 351.79 us 2024-03-26T17:08:28.449 INFO:tasks.workunit.client.3.smithi157.stdout:myimage28 4/s 3/s 134 KiB/s 109 KiB/s 3.11 ms 354.12 us 2024-03-26T17:08:28.449 INFO:tasks.workunit.client.3.smithi157.stdout:myimage50 4/s 2/s 126 KiB/s 57 KiB/s 2.71 ms 367.76 us 2024-03-26T17:08:28.449 INFO:tasks.workunit.client.3.smithi157.stdout:myimage31 4/s 3/s 100 KiB/s 65 KiB/s 2.75 ms 358.85 us 2024-03-26T17:08:28.449 INFO:tasks.workunit.client.3.smithi157.stdout:myimage32 4/s 3/s 101 KiB/s 78 KiB/s 2.66 ms 436.96 us 2024-03-26T17:08:28.449 INFO:tasks.workunit.client.3.smithi157.stdout:myimage35 4/s 4/s 103 KiB/s 114 KiB/s 2.57 ms 342.71 us 2024-03-26T17:08:28.449 INFO:tasks.workunit.client.3.smithi157.stdout:myimage11 4/s 3/s 118 KiB/s 97 KiB/s 2.70 ms 406.08 us 2024-03-26T17:08:28.449 INFO:tasks.workunit.client.3.smithi157.stdout:myimage39 4/s 3/s 118 KiB/s 70 KiB/s 2.25 ms 430.35 us 2024-03-26T17:08:28.449 INFO:tasks.workunit.client.3.smithi157.stdout:myimage13 4/s 4/s 95 KiB/s 83 KiB/s 2.18 ms 328.52 us 2024-03-26T17:08:28.449 INFO:tasks.workunit.client.3.smithi157.stdout:myimage24 4/s 4/s 102 KiB/s 125 KiB/s 2.56 ms 362.21 us 2024-03-26T17:08:28.449 INFO:tasks.workunit.client.3.smithi157.stdout:myimage41 4/s 3/s 110 KiB/s 134 KiB/s 2.57 ms 381.40 us 2024-03-26T17:08:28.449 INFO:tasks.workunit.client.3.smithi157.stdout:myimage45 4/s 3/s 119 KiB/s 88 KiB/s 2.32 ms 292.42 us 2024-03-26T17:08:28.449 INFO:tasks.workunit.client.3.smithi157.stdout:myimage46 4/s 3/s 102 KiB/s 78 KiB/s 2.41 ms 332.40 us 2024-03-26T17:08:28.450 INFO:tasks.workunit.client.3.smithi157.stdout:myimage2 4/s 4/s 76 KiB/s 76 KiB/s 2.29 ms 281.20 us 2024-03-26T17:08:28.450 INFO:tasks.workunit.client.3.smithi157.stdout:myimage3 4/s 4/s 107 KiB/s 111 KiB/s 2.12 ms 338.33 us 2024-03-26T17:08:28.450 INFO:tasks.workunit.client.3.smithi157.stdout:myimage30 4/s 4/s 108 KiB/s 107 KiB/s 2.96 ms 420.29 us 2024-03-26T17:08:28.450 INFO:tasks.workunit.client.3.smithi157.stdout:myimage52 4/s 2/s 100 KiB/s 66 KiB/s 2.90 ms 311.49 us 2024-03-26T17:08:28.450 INFO:tasks.workunit.client.3.smithi157.stdout:myimage5 4/s 5/s 109 KiB/s 106 KiB/s 2.26 ms 334.76 us 2024-03-26T17:08:28.450 INFO:tasks.workunit.client.3.smithi157.stdout:myimage9 4/s 5/s 91 KiB/s 129 KiB/s 2.83 ms 322.06 us 2024-03-26T17:08:28.450 INFO:tasks.workunit.client.3.smithi157.stdout:myimage19 4/s 3/s 90 KiB/s 79 KiB/s 2.62 ms 338.75 us 2024-03-26T17:08:28.450 INFO:tasks.workunit.client.3.smithi157.stdout:myimage25 4/s 3/s 84 KiB/s 69 KiB/s 3.21 ms 327.54 us 2024-03-26T17:08:28.450 INFO:tasks.workunit.client.3.smithi157.stdout:myimage27 4/s 4/s 105 KiB/s 101 KiB/s 2.33 ms 405.98 us 2024-03-26T17:08:28.450 INFO:tasks.workunit.client.3.smithi157.stdout:myimage33 4/s 3/s 106 KiB/s 93 KiB/s 2.55 ms 326.70 us 2024-03-26T17:08:28.450 INFO:tasks.workunit.client.3.smithi157.stdout:myimage6 4/s 4/s 86 KiB/s 88 KiB/s 2.67 ms 353.25 us 2024-03-26T17:08:28.451 INFO:tasks.workunit.client.3.smithi157.stdout:myimage29 4/s 5/s 67 KiB/s 158 KiB/s 2.29 ms 450.51 us 2024-03-26T17:08:28.451 INFO:tasks.workunit.client.3.smithi157.stdout:myimage53 4/s 3/s 78 KiB/s 85 KiB/s 2.18 ms 345.53 us 2024-03-26T17:08:28.451 INFO:tasks.workunit.client.3.smithi157.stdout:myimage56 4/s 3/s 104 KiB/s 71 KiB/s 2.89 ms 337.04 us 2024-03-26T17:08:28.451 INFO:tasks.workunit.client.3.smithi157.stdout:myimage59 4/s 4/s 74 KiB/s 120 KiB/s 2.60 ms 408.75 us 2024-03-26T17:08:28.451 INFO:tasks.workunit.client.3.smithi157.stdout:myimage37 3/s 4/s 108 KiB/s 94 KiB/s 2.57 ms 413.14 us 2024-03-26T17:08:28.451 INFO:tasks.workunit.client.3.smithi157.stdout:myimage20 3/s 4/s 74 KiB/s 78 KiB/s 2.49 ms 259.65 us 2024-03-26T17:08:28.451 INFO:tasks.workunit.client.3.smithi157.stdout:myimage10 3/s 3/s 74 KiB/s 98 KiB/s 2.48 ms 336.98 us 2024-03-26T17:08:28.451 INFO:tasks.workunit.client.3.smithi157.stdout:myimage14 3/s 5/s 82 KiB/s 131 KiB/s 2.66 ms 496.06 us 2024-03-26T17:08:28.451 INFO:tasks.workunit.client.3.smithi157.stdout:myimage40 3/s 5/s 97 KiB/s 97 KiB/s 2.40 ms 404.04 us 2024-03-26T17:08:28.451 INFO:tasks.workunit.client.3.smithi157.stdout:myimage8 3/s 3/s 90 KiB/s 122 KiB/s 2.59 ms 401.59 us 2024-03-26T17:08:28.452 INFO:tasks.workunit.client.3.smithi157.stdout:myimage26 3/s 4/s 70 KiB/s 91 KiB/s 2.53 ms 311.55 us 2024-03-26T17:08:28.452 INFO:tasks.workunit.client.3.smithi157.stdout:myimage42 3/s 3/s 102 KiB/s 81 KiB/s 2.29 ms 320.48 us 2024-03-26T17:08:28.452 INFO:tasks.workunit.client.3.smithi157.stdout:myimage23 3/s 3/s 78 KiB/s 97 KiB/s 2.17 ms 320.08 us 2024-03-26T17:08:28.452 INFO:tasks.workunit.client.3.smithi157.stdout:myimage47 3/s 5/s 70 KiB/s 96 KiB/s 2.79 ms 396.02 us 2024-03-26T17:08:28.452 INFO:tasks.workunit.client.3.smithi157.stdout:myimage60 3/s 5/s 52 KiB/s 90 KiB/s 2.61 ms 395.26 us 2024-03-26T17:08:28.452 INFO:tasks.workunit.client.3.smithi157.stdout:myimage16 3/s 4/s 71 KiB/s 101 KiB/s 2.21 ms 333.87 us 2024-03-26T17:08:28.452 INFO:tasks.workunit.client.3.smithi157.stdout:myimage22 3/s 4/s 71 KiB/s 121 KiB/s 2.65 ms 443.91 us 2024-03-26T17:08:28.452 INFO:tasks.workunit.client.3.smithi157.stdout:myimage51 3/s 5/s 98 KiB/s 118 KiB/s 2.72 ms 367.59 us 2024-03-26T17:08:28.452 INFO:tasks.workunit.client.3.smithi157.stdout:myimage55 2/s 5/s 72 KiB/s 163 KiB/s 2.50 ms 398.58 us 2024-03-26T17:08:28.452 INFO:tasks.workunit.client.3.smithi157.stdout:myimage54 2/s 4/s 62 KiB/s 93 KiB/s 2.43 ms 359.41 us 2024-03-26T17:08:28.452 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:08:29.185 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:08:28 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:08:28] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:08:29.185 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:08:28 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:08:28] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:08:29.185 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:08:28 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:08:29.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:08:29 smithi149 ceph-mon[34678]: pgmap v679: 33 pgs: 33 active+clean; 1.0 GiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 5.9 MiB/s rd, 5.9 MiB/s wr, 494 op/s 2024-03-26T17:08:29.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:08:29 smithi149 ceph-mon[34678]: Health check update: 3 slow ops, oldest one blocked for 603 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:08:29.396 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:08:29 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:08:29] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:08:29.396 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:08:29 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:08:29] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:08:29.397 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:08:29 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:08:29.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:08:29 smithi044 ceph-mon[30624]: pgmap v679: 33 pgs: 33 active+clean; 1.0 GiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 5.9 MiB/s rd, 5.9 MiB/s wr, 494 op/s 2024-03-26T17:08:29.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:08:29 smithi044 ceph-mon[30624]: Health check update: 3 slow ops, oldest one blocked for 603 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:08:29.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:08:29 smithi064 ceph-mon[34420]: pgmap v679: 33 pgs: 33 active+clean; 1.0 GiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 5.9 MiB/s rd, 5.9 MiB/s wr, 494 op/s 2024-03-26T17:08:29.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:08:29 smithi064 ceph-mon[34420]: Health check update: 3 slow ops, oldest one blocked for 603 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:08:30.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:08:30 smithi044 ceph-mon[30624]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:08:30.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:08:30 smithi044 ceph-mon[30624]: { 2024-03-26T17:08:30.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:08:30 smithi044 ceph-mon[30624]: "prefix": "rbd perf image stats", 2024-03-26T17:08:30.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:08:30 smithi044 ceph-mon[30624]: "pool_spec": "mypool", 2024-03-26T17:08:30.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:08:30 smithi044 ceph-mon[30624]: "sort_by": "write_ops", 2024-03-26T17:08:30.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:08:30 smithi044 ceph-mon[30624]: "format": "json" 2024-03-26T17:08:30.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:08:30 smithi044 ceph-mon[30624]: }"]: dispatch 2024-03-26T17:08:30.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:08:30 smithi064 ceph-mon[34420]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:08:30.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:08:30 smithi064 ceph-mon[34420]: { 2024-03-26T17:08:30.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:08:30 smithi064 ceph-mon[34420]: "prefix": "rbd perf image stats", 2024-03-26T17:08:30.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:08:30 smithi064 ceph-mon[34420]: "pool_spec": "mypool", 2024-03-26T17:08:30.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:08:30 smithi064 ceph-mon[34420]: "sort_by": "write_ops", 2024-03-26T17:08:30.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:08:30 smithi064 ceph-mon[34420]: "format": "json" 2024-03-26T17:08:30.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:08:30 smithi064 ceph-mon[34420]: }"]: dispatch 2024-03-26T17:08:30.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:08:30 smithi149 ceph-mon[34678]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:08:30.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:08:30 smithi149 ceph-mon[34678]: { 2024-03-26T17:08:30.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:08:30 smithi149 ceph-mon[34678]: "prefix": "rbd perf image stats", 2024-03-26T17:08:30.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:08:30 smithi149 ceph-mon[34678]: "pool_spec": "mypool", 2024-03-26T17:08:30.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:08:30 smithi149 ceph-mon[34678]: "sort_by": "write_ops", 2024-03-26T17:08:30.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:08:30 smithi149 ceph-mon[34678]: "format": "json" 2024-03-26T17:08:30.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:08:30 smithi149 ceph-mon[34678]: }"]: dispatch 2024-03-26T17:08:31.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:08:31 smithi044 ceph-mon[30624]: pgmap v680: 33 pgs: 33 active+clean; 1.0 GiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 5.8 MiB/s rd, 5.7 MiB/s wr, 486 op/s 2024-03-26T17:08:31.266 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:08:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:08:30] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:08:31.266 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:08:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:08:30] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:08:31.266 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:08:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:08:31.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:08:31 smithi149 ceph-mon[34678]: pgmap v680: 33 pgs: 33 active+clean; 1.0 GiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 5.8 MiB/s rd, 5.7 MiB/s wr, 486 op/s 2024-03-26T17:08:31.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:08:31 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 2024-03-26T17:08:31.235+0000 7fa707a55700 -1 mon.c@1(peon) e3 get_health_metrics reporting 3 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T17:08:31.396 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:08:31 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:08:31] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:08:31.397 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:08:31 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:08:31] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:08:31.397 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:08:31 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:08:31.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:08:31 smithi064 ceph-mon[34420]: pgmap v680: 33 pgs: 33 active+clean; 1.0 GiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 5.8 MiB/s rd, 5.7 MiB/s wr, 486 op/s 2024-03-26T17:08:33.062 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:08:33.071 INFO:tasks.workunit.client.3.smithi157.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2024-03-26T17:08:33.071 INFO:tasks.workunit.client.3.smithi157.stdout: 8.60 112.8k 103.2k 0.0k 1.1M 1.0M 0.0k nvme2n1 2024-03-26T17:08:33.071 INFO:tasks.workunit.client.3.smithi157.stdout: 8.50 93.6k 105.2k 0.0k 936.0k 1.0M 0.0k nvme2n10 2024-03-26T17:08:33.071 INFO:tasks.workunit.client.3.smithi157.stdout: 8.50 102.4k 109.6k 0.0k 1.0M 1.1M 0.0k nvme2n11 2024-03-26T17:08:33.071 INFO:tasks.workunit.client.3.smithi157.stdout: 8.50 132.0k 63.2k 0.0k 1.3M 632.0k 0.0k nvme2n12 2024-03-26T17:08:33.072 INFO:tasks.workunit.client.3.smithi157.stdout: 8.50 81.2k 111.2k 0.0k 812.0k 1.1M 0.0k nvme2n13 2024-03-26T17:08:33.072 INFO:tasks.workunit.client.3.smithi157.stdout: 8.50 106.4k 75.2k 0.0k 1.0M 752.0k 0.0k nvme2n14 2024-03-26T17:08:33.072 INFO:tasks.workunit.client.3.smithi157.stdout: 8.60 92.4k 110.8k 0.0k 924.0k 1.1M 0.0k nvme2n15 2024-03-26T17:08:33.072 INFO:tasks.workunit.client.3.smithi157.stdout: 8.60 83.2k 120.0k 0.0k 832.0k 1.2M 0.0k nvme2n16 2024-03-26T17:08:33.072 INFO:tasks.workunit.client.3.smithi157.stdout: 8.60 78.4k 121.2k 0.0k 784.0k 1.2M 0.0k nvme2n17 2024-03-26T17:08:33.072 INFO:tasks.workunit.client.3.smithi157.stdout: 8.60 116.0k 70.8k 0.0k 1.1M 708.0k 0.0k nvme2n18 2024-03-26T17:08:33.072 INFO:tasks.workunit.client.3.smithi157.stdout: 8.60 96.4k 90.0k 0.0k 964.0k 900.0k 0.0k nvme2n19 2024-03-26T17:08:33.072 INFO:tasks.workunit.client.3.smithi157.stdout: 8.60 78.4k 102.4k 0.0k 784.0k 1.0M 0.0k nvme2n2 2024-03-26T17:08:33.072 INFO:tasks.workunit.client.3.smithi157.stdout: 8.60 98.4k 84.8k 0.0k 984.0k 848.0k 0.0k nvme2n20 2024-03-26T17:08:33.072 INFO:tasks.workunit.client.3.smithi157.stdout: 8.60 96.8k 112.8k 0.0k 968.0k 1.1M 0.0k nvme2n3 2024-03-26T17:08:33.072 INFO:tasks.workunit.client.3.smithi157.stdout: 8.60 70.8k 90.4k 0.0k 708.0k 904.0k 0.0k nvme2n4 2024-03-26T17:08:33.072 INFO:tasks.workunit.client.3.smithi157.stdout: 8.60 86.8k 102.4k 0.0k 868.0k 1.0M 0.0k nvme2n5 2024-03-26T17:08:33.072 INFO:tasks.workunit.client.3.smithi157.stdout: 8.60 116.4k 55.2k 0.0k 1.1M 552.0k 0.0k nvme2n6 2024-03-26T17:08:33.073 INFO:tasks.workunit.client.3.smithi157.stdout: 8.50 96.8k 94.4k 0.0k 968.0k 944.0k 0.0k nvme2n7 2024-03-26T17:08:33.073 INFO:tasks.workunit.client.3.smithi157.stdout: 8.50 83.2k 119.2k 0.0k 832.0k 1.2M 0.0k nvme2n8 2024-03-26T17:08:33.073 INFO:tasks.workunit.client.3.smithi157.stdout: 8.50 104.0k 97.2k 0.0k 1.0M 972.0k 0.0k nvme2n9 2024-03-26T17:08:33.073 INFO:tasks.workunit.client.3.smithi157.stdout: 8.60 92.8k 104.4k 0.0k 928.0k 1.0M 0.0k nvme5n1 2024-03-26T17:08:33.073 INFO:tasks.workunit.client.3.smithi157.stdout: 8.50 79.6k 112.8k 0.0k 796.0k 1.1M 0.0k nvme5n10 2024-03-26T17:08:33.073 INFO:tasks.workunit.client.3.smithi157.stdout: 8.50 62.0k 127.6k 0.0k 620.0k 1.2M 0.0k nvme5n11 2024-03-26T17:08:33.073 INFO:tasks.workunit.client.3.smithi157.stdout: 8.50 93.2k 124.8k 0.0k 932.0k 1.2M 0.0k nvme5n12 2024-03-26T17:08:33.073 INFO:tasks.workunit.client.3.smithi157.stdout: 8.50 104.4k 105.6k 0.0k 1.0M 1.0M 0.0k nvme5n13 2024-03-26T17:08:33.073 INFO:tasks.workunit.client.3.smithi157.stdout: 8.50 136.0k 124.8k 0.0k 1.3M 1.2M 0.0k nvme5n14 2024-03-26T17:08:33.073 INFO:tasks.workunit.client.3.smithi157.stdout: 8.60 112.8k 96.4k 0.0k 1.1M 964.0k 0.0k nvme5n15 2024-03-26T17:08:33.073 INFO:tasks.workunit.client.3.smithi157.stdout: 8.60 77.6k 96.8k 0.0k 776.0k 968.0k 0.0k nvme5n16 2024-03-26T17:08:33.073 INFO:tasks.workunit.client.3.smithi157.stdout: 8.60 82.8k 91.2k 0.0k 828.0k 912.0k 0.0k nvme5n17 2024-03-26T17:08:33.073 INFO:tasks.workunit.client.3.smithi157.stdout: 8.60 80.0k 111.2k 0.0k 800.0k 1.1M 0.0k nvme5n18 2024-03-26T17:08:33.073 INFO:tasks.workunit.client.3.smithi157.stdout: 8.60 122.0k 88.8k 0.0k 1.2M 888.0k 0.0k nvme5n19 2024-03-26T17:08:33.074 INFO:tasks.workunit.client.3.smithi157.stdout: 8.60 80.8k 131.2k 0.0k 808.0k 1.3M 0.0k nvme5n2 2024-03-26T17:08:33.074 INFO:tasks.workunit.client.3.smithi157.stdout: 8.60 78.4k 90.8k 0.0k 784.0k 908.0k 0.0k nvme5n20 2024-03-26T17:08:33.074 INFO:tasks.workunit.client.3.smithi157.stdout: 8.60 112.8k 115.2k 0.0k 1.1M 1.1M 0.0k nvme5n3 2024-03-26T17:08:33.074 INFO:tasks.workunit.client.3.smithi157.stdout: 8.60 131.2k 91.6k 0.0k 1.3M 916.0k 0.0k nvme5n4 2024-03-26T17:08:33.074 INFO:tasks.workunit.client.3.smithi157.stdout: 8.60 78.4k 96.0k 0.0k 784.0k 960.0k 0.0k nvme5n5 2024-03-26T17:08:33.074 INFO:tasks.workunit.client.3.smithi157.stdout: 8.60 107.6k 97.6k 0.0k 1.1M 976.0k 0.0k nvme5n6 2024-03-26T17:08:33.074 INFO:tasks.workunit.client.3.smithi157.stdout: 8.50 95.2k 98.8k 0.0k 952.0k 988.0k 0.0k nvme5n7 2024-03-26T17:08:33.074 INFO:tasks.workunit.client.3.smithi157.stdout: 8.50 103.2k 83.6k 0.0k 1.0M 836.0k 0.0k nvme5n8 2024-03-26T17:08:33.074 INFO:tasks.workunit.client.3.smithi157.stdout: 8.50 99.6k 102.8k 0.0k 996.0k 1.0M 0.0k nvme5n9 2024-03-26T17:08:33.074 INFO:tasks.workunit.client.3.smithi157.stdout: 8.60 78.0k 118.4k 0.0k 780.0k 1.2M 0.0k nvme8n1 2024-03-26T17:08:33.074 INFO:tasks.workunit.client.3.smithi157.stdout: 8.50 90.8k 110.0k 0.0k 908.0k 1.1M 0.0k nvme8n10 2024-03-26T17:08:33.074 INFO:tasks.workunit.client.3.smithi157.stdout: 8.50 90.8k 104.0k 0.0k 908.0k 1.0M 0.0k nvme8n11 2024-03-26T17:08:33.074 INFO:tasks.workunit.client.3.smithi157.stdout: 8.50 86.8k 106.4k 0.0k 868.0k 1.0M 0.0k nvme8n12 2024-03-26T17:08:33.074 INFO:tasks.workunit.client.3.smithi157.stdout: 8.50 108.4k 96.0k 0.0k 1.1M 960.0k 0.0k nvme8n13 2024-03-26T17:08:33.075 INFO:tasks.workunit.client.3.smithi157.stdout: 8.50 105.2k 82.0k 0.0k 1.0M 820.0k 0.0k nvme8n14 2024-03-26T17:08:33.075 INFO:tasks.workunit.client.3.smithi157.stdout: 8.60 112.0k 88.0k 0.0k 1.1M 880.0k 0.0k nvme8n15 2024-03-26T17:08:33.075 INFO:tasks.workunit.client.3.smithi157.stdout: 8.60 117.2k 70.8k 0.0k 1.1M 708.0k 0.0k nvme8n16 2024-03-26T17:08:33.075 INFO:tasks.workunit.client.3.smithi157.stdout: 8.60 83.2k 131.2k 0.0k 832.0k 1.3M 0.0k nvme8n17 2024-03-26T17:08:33.075 INFO:tasks.workunit.client.3.smithi157.stdout: 8.60 86.4k 132.8k 0.0k 864.0k 1.3M 0.0k nvme8n18 2024-03-26T17:08:33.075 INFO:tasks.workunit.client.3.smithi157.stdout: 8.60 108.8k 92.4k 0.0k 1.1M 924.0k 0.0k nvme8n19 2024-03-26T17:08:33.075 INFO:tasks.workunit.client.3.smithi157.stdout: 8.60 87.2k 124.0k 0.0k 872.0k 1.2M 0.0k nvme8n2 2024-03-26T17:08:33.075 INFO:tasks.workunit.client.3.smithi157.stdout: 8.60 118.4k 84.0k 0.0k 1.2M 840.0k 0.0k nvme8n20 2024-03-26T17:08:33.075 INFO:tasks.workunit.client.3.smithi157.stdout: 8.60 129.2k 104.0k 0.0k 1.3M 1.0M 0.0k nvme8n3 2024-03-26T17:08:33.075 INFO:tasks.workunit.client.3.smithi157.stdout: 8.60 94.8k 105.6k 0.0k 948.0k 1.0M 0.0k nvme8n4 2024-03-26T17:08:33.075 INFO:tasks.workunit.client.3.smithi157.stdout: 8.60 101.6k 100.0k 0.0k 1016.0k 1000.0k 0.0k nvme8n5 2024-03-26T17:08:33.075 INFO:tasks.workunit.client.3.smithi157.stdout: 8.50 89.6k 107.2k 0.0k 896.0k 1.0M 0.0k nvme8n6 2024-03-26T17:08:33.075 INFO:tasks.workunit.client.3.smithi157.stdout: 8.50 84.0k 86.8k 0.0k 840.0k 868.0k 0.0k nvme8n7 2024-03-26T17:08:33.075 INFO:tasks.workunit.client.3.smithi157.stdout: 8.50 82.4k 101.6k 0.0k 824.0k 1016.0k 0.0k nvme8n8 2024-03-26T17:08:33.075 INFO:tasks.workunit.client.3.smithi157.stdout: 8.50 92.8k 106.4k 0.0k 928.0k 1.0M 0.0k nvme8n9 2024-03-26T17:08:33.076 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:08:33.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:08:33 smithi044 ceph-mon[30624]: pgmap v681: 33 pgs: 33 active+clean; 1.0 GiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 6.0 MiB/s rd, 6.1 MiB/s wr, 517 op/s 2024-03-26T17:08:33.265 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:08:32 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:08:32] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:08:33.266 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:08:32 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:08:32] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:08:33.266 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:08:32 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:08:33.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:08:33 smithi149 ceph-mon[34678]: pgmap v681: 33 pgs: 33 active+clean; 1.0 GiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 6.0 MiB/s rd, 6.1 MiB/s wr, 517 op/s 2024-03-26T17:08:33.396 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:08:33 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:08:33] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:08:33.396 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:08:33 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:08:33] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:08:33.397 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:08:33 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:08:33.450 INFO:tasks.workunit.client.3.smithi157.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-26T17:08:33.450 INFO:tasks.workunit.client.3.smithi157.stdout:myimage31 5/s 4/s 140 KiB/s 85 KiB/s 2.63 ms 328.31 us 2024-03-26T17:08:33.450 INFO:tasks.workunit.client.3.smithi157.stdout:myimage41 5/s 4/s 148 KiB/s 82 KiB/s 2.56 ms 329.55 us 2024-03-26T17:08:33.450 INFO:tasks.workunit.client.3.smithi157.stdout:myimage50 5/s 3/s 106 KiB/s 94 KiB/s 2.57 ms 341.39 us 2024-03-26T17:08:33.451 INFO:tasks.workunit.client.3.smithi157.stdout:myimage10 5/s 5/s 135 KiB/s 129 KiB/s 2.31 ms 326.50 us 2024-03-26T17:08:33.451 INFO:tasks.workunit.client.3.smithi157.stdout:myimage36 5/s 4/s 97 KiB/s 82 KiB/s 2.40 ms 310.17 us 2024-03-26T17:08:33.451 INFO:tasks.workunit.client.3.smithi157.stdout:myimage2 5/s 5/s 131 KiB/s 110 KiB/s 2.57 ms 319.51 us 2024-03-26T17:08:33.451 INFO:tasks.workunit.client.3.smithi157.stdout:myimage23 5/s 4/s 129 KiB/s 128 KiB/s 2.16 ms 356.05 us 2024-03-26T17:08:33.451 INFO:tasks.workunit.client.3.smithi157.stdout:myimage52 5/s 3/s 135 KiB/s 74 KiB/s 2.82 ms 319.77 us 2024-03-26T17:08:33.451 INFO:tasks.workunit.client.3.smithi157.stdout:myimage8 5/s 4/s 121 KiB/s 78 KiB/s 2.65 ms 252.42 us 2024-03-26T17:08:33.451 INFO:tasks.workunit.client.3.smithi157.stdout:myimage55 5/s 3/s 100 KiB/s 98 KiB/s 2.70 ms 344.49 us 2024-03-26T17:08:33.451 INFO:tasks.workunit.client.3.smithi157.stdout:myimage16 5/s 3/s 145 KiB/s 58 KiB/s 2.41 ms 320.52 us 2024-03-26T17:08:33.451 INFO:tasks.workunit.client.3.smithi157.stdout:myimage30 5/s 3/s 94 KiB/s 71 KiB/s 3.07 ms 351.59 us 2024-03-26T17:08:33.451 INFO:tasks.workunit.client.3.smithi157.stdout:myimage58 5/s 3/s 137 KiB/s 92 KiB/s 2.19 ms 334.25 us 2024-03-26T17:08:33.451 INFO:tasks.workunit.client.3.smithi157.stdout:myimage4 5/s 3/s 72 KiB/s 92 KiB/s 2.26 ms 405.50 us 2024-03-26T17:08:33.451 INFO:tasks.workunit.client.3.smithi157.stdout:myimage11 5/s 5/s 134 KiB/s 113 KiB/s 2.44 ms 323.41 us 2024-03-26T17:08:33.451 INFO:tasks.workunit.client.3.smithi157.stdout:myimage25 5/s 3/s 110 KiB/s 67 KiB/s 3.00 ms 319.45 us 2024-03-26T17:08:33.452 INFO:tasks.workunit.client.3.smithi157.stdout:myimage56 5/s 4/s 101 KiB/s 100 KiB/s 2.85 ms 343.63 us 2024-03-26T17:08:33.452 INFO:tasks.workunit.client.3.smithi157.stdout:myimage38 4/s 4/s 106 KiB/s 91 KiB/s 2.04 ms 384.46 us 2024-03-26T17:08:33.452 INFO:tasks.workunit.client.3.smithi157.stdout:myimage1 4/s 3/s 110 KiB/s 101 KiB/s 2.03 ms 352.61 us 2024-03-26T17:08:33.452 INFO:tasks.workunit.client.3.smithi157.stdout:myimage15 4/s 4/s 120 KiB/s 112 KiB/s 2.21 ms 342.25 us 2024-03-26T17:08:33.452 INFO:tasks.workunit.client.3.smithi157.stdout:myimage17 4/s 3/s 111 KiB/s 74 KiB/s 2.38 ms 363.74 us 2024-03-26T17:08:33.452 INFO:tasks.workunit.client.3.smithi157.stdout:myimage26 4/s 4/s 104 KiB/s 126 KiB/s 2.72 ms 392.89 us 2024-03-26T17:08:33.452 INFO:tasks.workunit.client.3.smithi157.stdout:myimage42 4/s 3/s 128 KiB/s 82 KiB/s 2.54 ms 356.89 us 2024-03-26T17:08:33.452 INFO:tasks.workunit.client.3.smithi157.stdout:myimage54 4/s 5/s 111 KiB/s 124 KiB/s 2.35 ms 304.18 us 2024-03-26T17:08:33.452 INFO:tasks.workunit.client.3.smithi157.stdout:myimage13 4/s 4/s 114 KiB/s 87 KiB/s 2.17 ms 325.28 us 2024-03-26T17:08:33.452 INFO:tasks.workunit.client.3.smithi157.stdout:myimage27 4/s 4/s 108 KiB/s 118 KiB/s 2.20 ms 366.05 us 2024-03-26T17:08:33.452 INFO:tasks.workunit.client.3.smithi157.stdout:myimage29 4/s 4/s 115 KiB/s 110 KiB/s 2.37 ms 341.82 us 2024-03-26T17:08:33.452 INFO:tasks.workunit.client.3.smithi157.stdout:myimage22 4/s 3/s 128 KiB/s 42 KiB/s 2.46 ms 277.82 us 2024-03-26T17:08:33.452 INFO:tasks.workunit.client.3.smithi157.stdout:myimage35 4/s 4/s 106 KiB/s 110 KiB/s 2.39 ms 327.96 us 2024-03-26T17:08:33.452 INFO:tasks.workunit.client.3.smithi157.stdout:myimage37 4/s 4/s 83 KiB/s 82 KiB/s 2.41 ms 329.45 us 2024-03-26T17:08:33.452 INFO:tasks.workunit.client.3.smithi157.stdout:myimage44 4/s 3/s 104 KiB/s 70 KiB/s 2.39 ms 363.04 us 2024-03-26T17:08:33.453 INFO:tasks.workunit.client.3.smithi157.stdout:myimage5 4/s 4/s 94 KiB/s 63 KiB/s 2.19 ms 316.21 us 2024-03-26T17:08:33.453 INFO:tasks.workunit.client.3.smithi157.stdout:myimage18 4/s 5/s 87 KiB/s 133 KiB/s 2.42 ms 337.41 us 2024-03-26T17:08:33.453 INFO:tasks.workunit.client.3.smithi157.stdout:myimage19 4/s 4/s 93 KiB/s 107 KiB/s 2.61 ms 342.51 us 2024-03-26T17:08:33.453 INFO:tasks.workunit.client.3.smithi157.stdout:myimage45 4/s 4/s 108 KiB/s 90 KiB/s 2.64 ms 390.12 us 2024-03-26T17:08:33.453 INFO:tasks.workunit.client.3.smithi157.stdout:myimage57 4/s 3/s 107 KiB/s 94 KiB/s 2.43 ms 358.60 us 2024-03-26T17:08:33.453 INFO:tasks.workunit.client.3.smithi157.stdout:myimage9 4/s 3/s 103 KiB/s 74 KiB/s 3.03 ms 425.23 us 2024-03-26T17:08:33.453 INFO:tasks.workunit.client.3.smithi157.stdout:myimage28 4/s 5/s 100 KiB/s 130 KiB/s 3.10 ms 446.38 us 2024-03-26T17:08:33.453 INFO:tasks.workunit.client.3.smithi157.stdout:myimage46 4/s 4/s 108 KiB/s 85 KiB/s 2.41 ms 336.35 us 2024-03-26T17:08:33.453 INFO:tasks.workunit.client.3.smithi157.stdout:myimage59 4/s 4/s 119 KiB/s 81 KiB/s 2.53 ms 324.99 us 2024-03-26T17:08:33.453 INFO:tasks.workunit.client.3.smithi157.stdout:myimage32 4/s 4/s 127 KiB/s 98 KiB/s 2.57 ms 432.20 us 2024-03-26T17:08:33.453 INFO:tasks.workunit.client.3.smithi157.stdout:myimage40 4/s 3/s 86 KiB/s 64 KiB/s 2.34 ms 303.21 us 2024-03-26T17:08:33.453 INFO:tasks.workunit.client.3.smithi157.stdout:myimage21 4/s 5/s 107 KiB/s 122 KiB/s 3.27 ms 450.51 us 2024-03-26T17:08:33.453 INFO:tasks.workunit.client.3.smithi157.stdout:myimage51 4/s 5/s 97 KiB/s 111 KiB/s 2.60 ms 325.06 us 2024-03-26T17:08:33.453 INFO:tasks.workunit.client.3.smithi157.stdout:myimage47 3/s 4/s 70 KiB/s 86 KiB/s 2.54 ms 344.83 us 2024-03-26T17:08:33.454 INFO:tasks.workunit.client.3.smithi157.stdout:myimage48 3/s 5/s 63 KiB/s 90 KiB/s 2.59 ms 427.36 us 2024-03-26T17:08:33.454 INFO:tasks.workunit.client.3.smithi157.stdout:myimage7 3/s 4/s 106 KiB/s 96 KiB/s 2.52 ms 392.88 us 2024-03-26T17:08:33.454 INFO:tasks.workunit.client.3.smithi157.stdout:myimage33 3/s 4/s 101 KiB/s 103 KiB/s 2.36 ms 338.08 us 2024-03-26T17:08:33.454 INFO:tasks.workunit.client.3.smithi157.stdout:myimage43 3/s 5/s 119 KiB/s 117 KiB/s 2.80 ms 441.33 us 2024-03-26T17:08:33.454 INFO:tasks.workunit.client.3.smithi157.stdout:myimage60 3/s 5/s 85 KiB/s 123 KiB/s 2.64 ms 327.71 us 2024-03-26T17:08:33.454 INFO:tasks.workunit.client.3.smithi157.stdout:myimage3 3/s 5/s 97 KiB/s 93 KiB/s 2.05 ms 402.33 us 2024-03-26T17:08:33.454 INFO:tasks.workunit.client.3.smithi157.stdout:myimage49 3/s 5/s 86 KiB/s 114 KiB/s 2.57 ms 341.38 us 2024-03-26T17:08:33.454 INFO:tasks.workunit.client.3.smithi157.stdout:myimage20 3/s 5/s 93 KiB/s 123 KiB/s 2.11 ms 309.60 us 2024-03-26T17:08:33.454 INFO:tasks.workunit.client.3.smithi157.stdout:myimage24 3/s 5/s 98 KiB/s 130 KiB/s 2.74 ms 425.65 us 2024-03-26T17:08:33.454 INFO:tasks.workunit.client.3.smithi157.stdout:myimage53 3/s 5/s 93 KiB/s 106 KiB/s 2.55 ms 408.50 us 2024-03-26T17:08:33.454 INFO:tasks.workunit.client.3.smithi157.stdout:myimage12 3/s 5/s 50 KiB/s 166 KiB/s 2.49 ms 415.73 us 2024-03-26T17:08:33.454 INFO:tasks.workunit.client.3.smithi157.stdout:myimage34 3/s 5/s 86 KiB/s 174 KiB/s 2.48 ms 382.29 us 2024-03-26T17:08:33.454 INFO:tasks.workunit.client.3.smithi157.stdout:myimage39 2/s 5/s 72 KiB/s 141 KiB/s 2.24 ms 361.17 us 2024-03-26T17:08:33.455 INFO:tasks.workunit.client.3.smithi157.stdout:myimage14 2/s 5/s 58 KiB/s 114 KiB/s 2.71 ms 342.30 us 2024-03-26T17:08:33.455 INFO:tasks.workunit.client.3.smithi157.stdout:myimage6 2/s 6/s 30 KiB/s 113 KiB/s 2.77 ms 370.15 us 2024-03-26T17:08:33.455 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:08:33.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:08:33 smithi064 ceph-mon[34420]: pgmap v681: 33 pgs: 33 active+clean; 1.0 GiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 6.0 MiB/s rd, 6.1 MiB/s wr, 517 op/s 2024-03-26T17:08:34.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:08:34 smithi044 ceph-mon[30624]: Health check update: 3 slow ops, oldest one blocked for 608 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:08:34.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:08:34 smithi064 ceph-mon[34420]: Health check update: 3 slow ops, oldest one blocked for 608 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:08:34.645 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:08:34 smithi149 ceph-mon[34678]: Health check update: 3 slow ops, oldest one blocked for 608 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:08:35.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:08:35 smithi044 ceph-mon[30624]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:08:35.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:08:35 smithi044 ceph-mon[30624]: { 2024-03-26T17:08:35.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:08:35 smithi044 ceph-mon[30624]: "prefix": "rbd perf image stats", 2024-03-26T17:08:35.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:08:35 smithi044 ceph-mon[30624]: "pool_spec": "mypool", 2024-03-26T17:08:35.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:08:35 smithi044 ceph-mon[30624]: "sort_by": "write_ops", 2024-03-26T17:08:35.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:08:35 smithi044 ceph-mon[30624]: "format": "json" 2024-03-26T17:08:35.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:08:35 smithi044 ceph-mon[30624]: }"]: dispatch 2024-03-26T17:08:35.266 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:08:35 smithi044 ceph-mon[30624]: pgmap v682: 33 pgs: 33 active+clean; 1.0 GiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 5.8 MiB/s rd, 6.0 MiB/s wr, 514 op/s 2024-03-26T17:08:35.266 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:08:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:08:34] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:08:35.266 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:08:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:08:34] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:08:35.266 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:08:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:08:35.547 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:08:35 smithi149 ceph-mon[34678]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:08:35.547 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:08:35 smithi149 ceph-mon[34678]: { 2024-03-26T17:08:35.547 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:08:35 smithi149 ceph-mon[34678]: "prefix": "rbd perf image stats", 2024-03-26T17:08:35.547 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:08:35 smithi149 ceph-mon[34678]: "pool_spec": "mypool", 2024-03-26T17:08:35.548 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:08:35 smithi149 ceph-mon[34678]: "sort_by": "write_ops", 2024-03-26T17:08:35.548 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:08:35 smithi149 ceph-mon[34678]: "format": "json" 2024-03-26T17:08:35.548 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:08:35 smithi149 ceph-mon[34678]: }"]: dispatch 2024-03-26T17:08:35.548 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:08:35 smithi149 ceph-mon[34678]: pgmap v682: 33 pgs: 33 active+clean; 1.0 GiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 5.8 MiB/s rd, 6.0 MiB/s wr, 514 op/s 2024-03-26T17:08:35.548 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:08:35 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:08:35] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:08:35.548 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:08:35 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:08:35] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:08:35.548 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:08:35 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:08:35.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:08:35 smithi064 ceph-mon[34420]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:08:35.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:08:35 smithi064 ceph-mon[34420]: { 2024-03-26T17:08:35.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:08:35 smithi064 ceph-mon[34420]: "prefix": "rbd perf image stats", 2024-03-26T17:08:35.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:08:35 smithi064 ceph-mon[34420]: "pool_spec": "mypool", 2024-03-26T17:08:35.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:08:35 smithi064 ceph-mon[34420]: "sort_by": "write_ops", 2024-03-26T17:08:35.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:08:35 smithi064 ceph-mon[34420]: "format": "json" 2024-03-26T17:08:35.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:08:35 smithi064 ceph-mon[34420]: }"]: dispatch 2024-03-26T17:08:35.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:08:35 smithi064 ceph-mon[34420]: pgmap v682: 33 pgs: 33 active+clean; 1.0 GiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 5.8 MiB/s rd, 6.0 MiB/s wr, 514 op/s 2024-03-26T17:08:36.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:08:36 smithi044 ceph-mon[30624]: pgmap v683: 33 pgs: 33 active+clean; 1.0 GiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 5.9 MiB/s rd, 6.2 MiB/s wr, 537 op/s 2024-03-26T17:08:36.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:08:36 smithi064 ceph-mon[34420]: pgmap v683: 33 pgs: 33 active+clean; 1.0 GiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 5.9 MiB/s rd, 6.2 MiB/s wr, 537 op/s 2024-03-26T17:08:36.645 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:08:36 smithi149 ceph-mon[34678]: pgmap v683: 33 pgs: 33 active+clean; 1.0 GiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 5.9 MiB/s rd, 6.2 MiB/s wr, 537 op/s 2024-03-26T17:08:36.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:08:36 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 2024-03-26T17:08:36.235+0000 7fa707a55700 -1 mon.c@1(peon) e3 get_health_metrics reporting 3 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T17:08:37.265 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:08:36 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:08:36] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:08:37.266 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:08:36 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:08:36] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:08:37.266 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:08:36 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:08:37.547 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:08:37 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:08:37] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:08:37.548 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:08:37 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:08:37] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:08:37.548 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:08:37 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:08:38.454 INFO:tasks.workunit.client.3.smithi157.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-26T17:08:38.455 INFO:tasks.workunit.client.3.smithi157.stdout:myimage25 5/s 4/s 93 KiB/s 117 KiB/s 3.27 ms 351.51 us 2024-03-26T17:08:38.455 INFO:tasks.workunit.client.3.smithi157.stdout:myimage31 5/s 2/s 135 KiB/s 46 KiB/s 2.93 ms 389.74 us 2024-03-26T17:08:38.455 INFO:tasks.workunit.client.3.smithi157.stdout:myimage40 5/s 3/s 113 KiB/s 80 KiB/s 2.31 ms 311.49 us 2024-03-26T17:08:38.455 INFO:tasks.workunit.client.3.smithi157.stdout:myimage13 5/s 3/s 117 KiB/s 55 KiB/s 2.22 ms 328.58 us 2024-03-26T17:08:38.455 INFO:tasks.workunit.client.3.smithi157.stdout:myimage32 5/s 3/s 118 KiB/s 119 KiB/s 2.62 ms 363.45 us 2024-03-26T17:08:38.455 INFO:tasks.workunit.client.3.smithi157.stdout:myimage57 5/s 3/s 107 KiB/s 76 KiB/s 2.37 ms 369.05 us 2024-03-26T17:08:38.455 INFO:tasks.workunit.client.3.smithi157.stdout:myimage30 5/s 3/s 122 KiB/s 83 KiB/s 3.21 ms 328.43 us 2024-03-26T17:08:38.455 INFO:tasks.workunit.client.3.smithi157.stdout:myimage1 5/s 4/s 102 KiB/s 137 KiB/s 2.02 ms 374.55 us 2024-03-26T17:08:38.455 INFO:tasks.workunit.client.3.smithi157.stdout:myimage33 5/s 4/s 97 KiB/s 122 KiB/s 2.39 ms 341.14 us 2024-03-26T17:08:38.455 INFO:tasks.workunit.client.3.smithi157.stdout:myimage51 5/s 3/s 107 KiB/s 76 KiB/s 2.76 ms 317.08 us 2024-03-26T17:08:38.455 INFO:tasks.workunit.client.3.smithi157.stdout:myimage16 4/s 3/s 129 KiB/s 83 KiB/s 2.29 ms 338.44 us 2024-03-26T17:08:38.456 INFO:tasks.workunit.client.3.smithi157.stdout:myimage22 4/s 5/s 118 KiB/s 118 KiB/s 2.34 ms 389.77 us 2024-03-26T17:08:38.456 INFO:tasks.workunit.client.3.smithi157.stdout:myimage58 4/s 4/s 131 KiB/s 90 KiB/s 2.53 ms 313.65 us 2024-03-26T17:08:38.456 INFO:tasks.workunit.client.3.smithi157.stdout:myimage4 4/s 3/s 96 KiB/s 44 KiB/s 2.49 ms 289.83 us 2024-03-26T17:08:38.456 INFO:tasks.workunit.client.3.smithi157.stdout:myimage15 4/s 3/s 106 KiB/s 102 KiB/s 2.15 ms 341.69 us 2024-03-26T17:08:38.456 INFO:tasks.workunit.client.3.smithi157.stdout:myimage14 4/s 4/s 74 KiB/s 99 KiB/s 2.73 ms 433.92 us 2024-03-26T17:08:38.456 INFO:tasks.workunit.client.3.smithi157.stdout:myimage37 4/s 3/s 109 KiB/s 62 KiB/s 2.61 ms 333.67 us 2024-03-26T17:08:38.456 INFO:tasks.workunit.client.3.smithi157.stdout:myimage49 4/s 4/s 117 KiB/s 92 KiB/s 2.37 ms 392.08 us 2024-03-26T17:08:38.456 INFO:tasks.workunit.client.3.smithi157.stdout:myimage9 4/s 4/s 116 KiB/s 86 KiB/s 2.75 ms 357.70 us 2024-03-26T17:08:38.456 INFO:tasks.workunit.client.3.smithi157.stdout:myimage20 4/s 3/s 80 KiB/s 96 KiB/s 2.50 ms 435.51 us 2024-03-26T17:08:38.456 INFO:tasks.workunit.client.3.smithi157.stdout:myimage24 4/s 4/s 111 KiB/s 85 KiB/s 2.56 ms 332.48 us 2024-03-26T17:08:38.456 INFO:tasks.workunit.client.3.smithi157.stdout:myimage59 4/s 3/s 95 KiB/s 101 KiB/s 2.84 ms 365.64 us 2024-03-26T17:08:38.456 INFO:tasks.workunit.client.3.smithi157.stdout:myimage23 4/s 2/s 102 KiB/s 58 KiB/s 2.21 ms 286.82 us 2024-03-26T17:08:38.457 INFO:tasks.workunit.client.3.smithi157.stdout:myimage52 4/s 5/s 92 KiB/s 141 KiB/s 3.08 ms 364.74 us 2024-03-26T17:08:38.457 INFO:tasks.workunit.client.3.smithi157.stdout:myimage5 4/s 4/s 115 KiB/s 89 KiB/s 2.30 ms 332.72 us 2024-03-26T17:08:38.457 INFO:tasks.workunit.client.3.smithi157.stdout:myimage17 4/s 4/s 103 KiB/s 110 KiB/s 2.74 ms 414.93 us 2024-03-26T17:08:38.457 INFO:tasks.workunit.client.3.smithi157.stdout:myimage41 4/s 3/s 95 KiB/s 78 KiB/s 2.73 ms 359.31 us 2024-03-26T17:08:38.457 INFO:tasks.workunit.client.3.smithi157.stdout:myimage43 4/s 4/s 88 KiB/s 111 KiB/s 2.74 ms 346.02 us 2024-03-26T17:08:38.457 INFO:tasks.workunit.client.3.smithi157.stdout:myimage55 4/s 3/s 79 KiB/s 72 KiB/s 2.64 ms 355.01 us 2024-03-26T17:08:38.457 INFO:tasks.workunit.client.3.smithi157.stdout:myimage12 4/s 4/s 76 KiB/s 80 KiB/s 2.41 ms 323.99 us 2024-03-26T17:08:38.457 INFO:tasks.workunit.client.3.smithi157.stdout:myimage21 4/s 3/s 91 KiB/s 70 KiB/s 3.17 ms 338.41 us 2024-03-26T17:08:38.457 INFO:tasks.workunit.client.3.smithi157.stdout:myimage26 4/s 4/s 105 KiB/s 81 KiB/s 2.69 ms 332.71 us 2024-03-26T17:08:38.457 INFO:tasks.workunit.client.3.smithi157.stdout:myimage29 4/s 2/s 94 KiB/s 60 KiB/s 2.34 ms 404.69 us 2024-03-26T17:08:38.457 INFO:tasks.workunit.client.3.smithi157.stdout:myimage39 4/s 3/s 79 KiB/s 94 KiB/s 2.32 ms 356.89 us 2024-03-26T17:08:38.457 INFO:tasks.workunit.client.3.smithi157.stdout:myimage10 4/s 3/s 82 KiB/s 72 KiB/s 2.50 ms 321.21 us 2024-03-26T17:08:38.457 INFO:tasks.workunit.client.3.smithi157.stdout:myimage34 4/s 4/s 90 KiB/s 146 KiB/s 2.38 ms 329.54 us 2024-03-26T17:08:38.457 INFO:tasks.workunit.client.3.smithi157.stdout:myimage8 4/s 4/s 99 KiB/s 80 KiB/s 2.69 ms 303.66 us 2024-03-26T17:08:38.457 INFO:tasks.workunit.client.3.smithi157.stdout:myimage27 4/s 4/s 66 KiB/s 100 KiB/s 2.34 ms 361.81 us 2024-03-26T17:08:38.458 INFO:tasks.workunit.client.3.smithi157.stdout:myimage36 4/s 3/s 74 KiB/s 86 KiB/s 2.36 ms 368.15 us 2024-03-26T17:08:38.458 INFO:tasks.workunit.client.3.smithi157.stdout:myimage11 3/s 3/s 86 KiB/s 70 KiB/s 2.54 ms 314.79 us 2024-03-26T17:08:38.458 INFO:tasks.workunit.client.3.smithi157.stdout:myimage42 3/s 4/s 89 KiB/s 102 KiB/s 2.35 ms 349.11 us 2024-03-26T17:08:38.458 INFO:tasks.workunit.client.3.smithi157.stdout:myimage46 3/s 4/s 80 KiB/s 102 KiB/s 2.51 ms 400.17 us 2024-03-26T17:08:38.458 INFO:tasks.workunit.client.3.smithi157.stdout:myimage53 3/s 4/s 105 KiB/s 121 KiB/s 2.24 ms 356.53 us 2024-03-26T17:08:38.458 INFO:tasks.workunit.client.3.smithi157.stdout:myimage54 3/s 4/s 72 KiB/s 62 KiB/s 2.42 ms 344.30 us 2024-03-26T17:08:38.458 INFO:tasks.workunit.client.3.smithi157.stdout:myimage2 3/s 3/s 71 KiB/s 58 KiB/s 2.80 ms 362.61 us 2024-03-26T17:08:38.458 INFO:tasks.workunit.client.3.smithi157.stdout:myimage3 3/s 4/s 98 KiB/s 94 KiB/s 2.19 ms 378.74 us 2024-03-26T17:08:38.458 INFO:tasks.workunit.client.3.smithi157.stdout:myimage38 3/s 4/s 82 KiB/s 66 KiB/s 2.47 ms 285.74 us 2024-03-26T17:08:38.458 INFO:tasks.workunit.client.3.smithi157.stdout:myimage47 3/s 4/s 90 KiB/s 105 KiB/s 3.03 ms 395.36 us 2024-03-26T17:08:38.458 INFO:tasks.workunit.client.3.smithi157.stdout:myimage19 3/s 4/s 69 KiB/s 102 KiB/s 2.53 ms 412.02 us 2024-03-26T17:08:38.458 INFO:tasks.workunit.client.3.smithi157.stdout:myimage45 3/s 4/s 83 KiB/s 116 KiB/s 2.58 ms 356.17 us 2024-03-26T17:08:38.458 INFO:tasks.workunit.client.3.smithi157.stdout:myimage35 3/s 5/s 81 KiB/s 88 KiB/s 2.54 ms 306.58 us 2024-03-26T17:08:38.458 INFO:tasks.workunit.client.3.smithi157.stdout:myimage48 3/s 4/s 86 KiB/s 100 KiB/s 2.42 ms 439.48 us 2024-03-26T17:08:38.459 INFO:tasks.workunit.client.3.smithi157.stdout:myimage28 3/s 4/s 50 KiB/s 102 KiB/s 3.40 ms 369.42 us 2024-03-26T17:08:38.459 INFO:tasks.workunit.client.3.smithi157.stdout:myimage44 3/s 4/s 63 KiB/s 133 KiB/s 2.57 ms 361.34 us 2024-03-26T17:08:38.459 INFO:tasks.workunit.client.3.smithi157.stdout:myimage6 3/s 5/s 85 KiB/s 140 KiB/s 2.64 ms 450.83 us 2024-03-26T17:08:38.459 INFO:tasks.workunit.client.3.smithi157.stdout:myimage7 3/s 4/s 58 KiB/s 88 KiB/s 2.64 ms 314.42 us 2024-03-26T17:08:38.459 INFO:tasks.workunit.client.3.smithi157.stdout:myimage18 3/s 5/s 72 KiB/s 108 KiB/s 2.53 ms 361.51 us 2024-03-26T17:08:38.459 INFO:tasks.workunit.client.3.smithi157.stdout:myimage50 3/s 5/s 66 KiB/s 117 KiB/s 2.58 ms 338.59 us 2024-03-26T17:08:38.459 INFO:tasks.workunit.client.3.smithi157.stdout:myimage60 3/s 4/s 98 KiB/s 110 KiB/s 2.70 ms 405.57 us 2024-03-26T17:08:38.459 INFO:tasks.workunit.client.3.smithi157.stdout:myimage56 2/s 5/s 54 KiB/s 151 KiB/s 3.02 ms 393.90 us 2024-03-26T17:08:38.459 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:08:39.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:08:39 smithi044 ceph-mon[30624]: pgmap v684: 33 pgs: 33 active+clean; 1.0 GiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 5.6 MiB/s rd, 5.7 MiB/s wr, 506 op/s 2024-03-26T17:08:39.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:08:39 smithi044 ceph-mon[30624]: Health check update: 3 slow ops, oldest one blocked for 613 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:08:39.266 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:08:38 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:08:38] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:08:39.266 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:08:39 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:08:39] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:08:39.266 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:08:39 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:08:39.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:08:39 smithi149 ceph-mon[34678]: pgmap v684: 33 pgs: 33 active+clean; 1.0 GiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 5.6 MiB/s rd, 5.7 MiB/s wr, 506 op/s 2024-03-26T17:08:39.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:08:39 smithi149 ceph-mon[34678]: Health check update: 3 slow ops, oldest one blocked for 613 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:08:39.397 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:08:39 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:08:39] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:08:39.397 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:08:39 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:08:39] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:08:39.397 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:08:39 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:08:39.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:08:39 smithi064 ceph-mon[34420]: pgmap v684: 33 pgs: 33 active+clean; 1.0 GiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 5.6 MiB/s rd, 5.7 MiB/s wr, 506 op/s 2024-03-26T17:08:39.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:08:39 smithi064 ceph-mon[34420]: Health check update: 3 slow ops, oldest one blocked for 613 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:08:40.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:08:40 smithi149 ceph-mon[34678]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:08:40.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:08:40 smithi149 ceph-mon[34678]: { 2024-03-26T17:08:40.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:08:40 smithi149 ceph-mon[34678]: "prefix": "rbd perf image stats", 2024-03-26T17:08:40.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:08:40 smithi149 ceph-mon[34678]: "pool_spec": "mypool", 2024-03-26T17:08:40.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:08:40 smithi149 ceph-mon[34678]: "sort_by": "write_ops", 2024-03-26T17:08:40.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:08:40 smithi149 ceph-mon[34678]: "format": "json" 2024-03-26T17:08:40.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:08:40 smithi149 ceph-mon[34678]: }"]: dispatch 2024-03-26T17:08:40.517 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:08:40 smithi044 ceph-mon[30624]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:08:40.518 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:08:40 smithi044 ceph-mon[30624]: { 2024-03-26T17:08:40.518 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:08:40 smithi044 ceph-mon[30624]: "prefix": "rbd perf image stats", 2024-03-26T17:08:40.518 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:08:40 smithi044 ceph-mon[30624]: "pool_spec": "mypool", 2024-03-26T17:08:40.518 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:08:40 smithi044 ceph-mon[30624]: "sort_by": "write_ops", 2024-03-26T17:08:40.518 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:08:40 smithi044 ceph-mon[30624]: "format": "json" 2024-03-26T17:08:40.518 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:08:40 smithi044 ceph-mon[30624]: }"]: dispatch 2024-03-26T17:08:40.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:08:40 smithi064 ceph-mon[34420]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:08:40.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:08:40 smithi064 ceph-mon[34420]: { 2024-03-26T17:08:40.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:08:40 smithi064 ceph-mon[34420]: "prefix": "rbd perf image stats", 2024-03-26T17:08:40.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:08:40 smithi064 ceph-mon[34420]: "pool_spec": "mypool", 2024-03-26T17:08:40.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:08:40 smithi064 ceph-mon[34420]: "sort_by": "write_ops", 2024-03-26T17:08:40.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:08:40 smithi064 ceph-mon[34420]: "format": "json" 2024-03-26T17:08:40.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:08:40 smithi064 ceph-mon[34420]: }"]: dispatch 2024-03-26T17:08:41.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:08:41 smithi044 ceph-mon[30624]: pgmap v685: 33 pgs: 33 active+clean; 1.0 GiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 5.4 MiB/s rd, 5.5 MiB/s wr, 494 op/s 2024-03-26T17:08:41.265 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:08:41 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:08:41] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:08:41.265 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:08:41 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:08:41] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:08:41.266 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:08:41 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:08:41.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:08:41 smithi149 ceph-mon[34678]: pgmap v685: 33 pgs: 33 active+clean; 1.0 GiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 5.4 MiB/s rd, 5.5 MiB/s wr, 494 op/s 2024-03-26T17:08:41.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:08:41 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 2024-03-26T17:08:41.236+0000 7fa707a55700 -1 mon.c@1(peon) e3 get_health_metrics reporting 3 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T17:08:41.396 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:08:41 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:08:41] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:08:41.396 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:08:41 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:08:41] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:08:41.397 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:08:41 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:08:41.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:08:41 smithi064 ceph-mon[34420]: pgmap v685: 33 pgs: 33 active+clean; 1.0 GiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 5.4 MiB/s rd, 5.5 MiB/s wr, 494 op/s 2024-03-26T17:08:43.063 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:08:43.072 INFO:tasks.workunit.client.3.smithi157.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2024-03-26T17:08:43.072 INFO:tasks.workunit.client.3.smithi157.stdout: 8.40 83.2k 92.4k 0.0k 832.0k 924.0k 0.0k nvme2n1 2024-03-26T17:08:43.072 INFO:tasks.workunit.client.3.smithi157.stdout: 8.40 95.6k 83.6k 0.0k 956.0k 836.0k 0.0k nvme2n10 2024-03-26T17:08:43.072 INFO:tasks.workunit.client.3.smithi157.stdout: 8.40 71.6k 92.4k 0.0k 716.0k 924.0k 0.0k nvme2n11 2024-03-26T17:08:43.072 INFO:tasks.workunit.client.3.smithi157.stdout: 8.40 60.0k 104.0k 0.0k 600.0k 1.0M 0.0k nvme2n12 2024-03-26T17:08:43.072 INFO:tasks.workunit.client.3.smithi157.stdout: 8.40 69.2k 75.2k 0.0k 692.0k 752.0k 0.0k nvme2n13 2024-03-26T17:08:43.072 INFO:tasks.workunit.client.3.smithi157.stdout: 8.40 94.4k 89.2k 0.0k 944.0k 892.0k 0.0k nvme2n14 2024-03-26T17:08:43.073 INFO:tasks.workunit.client.3.smithi157.stdout: 8.40 103.6k 89.2k 0.0k 1.0M 892.0k 0.0k nvme2n15 2024-03-26T17:08:43.073 INFO:tasks.workunit.client.3.smithi157.stdout: 8.40 97.6k 93.2k 0.0k 976.0k 932.0k 0.0k nvme2n16 2024-03-26T17:08:43.073 INFO:tasks.workunit.client.3.smithi157.stdout: 8.40 95.2k 86.8k 0.0k 952.0k 868.0k 0.0k nvme2n17 2024-03-26T17:08:43.073 INFO:tasks.workunit.client.3.smithi157.stdout: 8.40 86.0k 93.6k 0.0k 860.0k 936.0k 0.0k nvme2n18 2024-03-26T17:08:43.073 INFO:tasks.workunit.client.3.smithi157.stdout: 8.40 106.8k 85.2k 0.0k 1.0M 852.0k 0.0k nvme2n19 2024-03-26T17:08:43.073 INFO:tasks.workunit.client.3.smithi157.stdout: 8.40 70.0k 81.2k 0.0k 700.0k 812.0k 0.0k nvme2n2 2024-03-26T17:08:43.073 INFO:tasks.workunit.client.3.smithi157.stdout: 8.40 76.0k 84.4k 0.0k 760.0k 844.0k 0.0k nvme2n20 2024-03-26T17:08:43.073 INFO:tasks.workunit.client.3.smithi157.stdout: 8.40 87.6k 95.2k 0.0k 876.0k 952.0k 0.0k nvme2n3 2024-03-26T17:08:43.073 INFO:tasks.workunit.client.3.smithi157.stdout: 8.40 96.4k 83.2k 0.0k 964.0k 832.0k 0.0k nvme2n4 2024-03-26T17:08:43.073 INFO:tasks.workunit.client.3.smithi157.stdout: 8.30 61.6k 97.2k 0.0k 616.0k 972.0k 0.0k nvme2n5 2024-03-26T17:08:43.073 INFO:tasks.workunit.client.3.smithi157.stdout: 8.30 105.2k 86.0k 0.0k 1.0M 860.0k 0.0k nvme2n6 2024-03-26T17:08:43.074 INFO:tasks.workunit.client.3.smithi157.stdout: 8.40 74.4k 75.2k 0.0k 744.0k 752.0k 0.0k nvme2n7 2024-03-26T17:08:43.074 INFO:tasks.workunit.client.3.smithi157.stdout: 8.40 81.6k 82.8k 0.0k 816.0k 828.0k 0.0k nvme2n8 2024-03-26T17:08:43.074 INFO:tasks.workunit.client.3.smithi157.stdout: 8.40 87.6k 95.6k 0.0k 876.0k 956.0k 0.0k nvme2n9 2024-03-26T17:08:43.074 INFO:tasks.workunit.client.3.smithi157.stdout: 8.40 79.6k 102.8k 0.0k 796.0k 1.0M 0.0k nvme5n1 2024-03-26T17:08:43.074 INFO:tasks.workunit.client.3.smithi157.stdout: 8.40 99.2k 107.2k 0.0k 992.0k 1.0M 0.0k nvme5n10 2024-03-26T17:08:43.074 INFO:tasks.workunit.client.3.smithi157.stdout: 8.40 54.8k 103.2k 0.0k 548.0k 1.0M 0.0k nvme5n11 2024-03-26T17:08:43.074 INFO:tasks.workunit.client.3.smithi157.stdout: 8.40 109.6k 85.6k 0.0k 1.1M 856.0k 0.0k nvme5n12 2024-03-26T17:08:43.074 INFO:tasks.workunit.client.3.smithi157.stdout: 8.40 102.0k 104.0k 0.0k 1020.0k 1.0M 0.0k nvme5n13 2024-03-26T17:08:43.074 INFO:tasks.workunit.client.3.smithi157.stdout: 8.40 116.0k 79.6k 0.0k 1.1M 796.0k 0.0k nvme5n14 2024-03-26T17:08:43.074 INFO:tasks.workunit.client.3.smithi157.stdout: 8.40 84.8k 78.4k 0.0k 848.0k 784.0k 0.0k nvme5n15 2024-03-26T17:08:43.074 INFO:tasks.workunit.client.3.smithi157.stdout: 8.40 101.6k 79.2k 0.0k 1016.0k 792.0k 0.0k nvme5n16 2024-03-26T17:08:43.074 INFO:tasks.workunit.client.3.smithi157.stdout: 8.40 87.2k 89.6k 0.0k 872.0k 896.0k 0.0k nvme5n17 2024-03-26T17:08:43.075 INFO:tasks.workunit.client.3.smithi157.stdout: 8.40 83.2k 96.4k 0.0k 832.0k 964.0k 0.0k nvme5n18 2024-03-26T17:08:43.075 INFO:tasks.workunit.client.3.smithi157.stdout: 8.40 80.8k 88.0k 0.0k 808.0k 880.0k 0.0k nvme5n19 2024-03-26T17:08:43.075 INFO:tasks.workunit.client.3.smithi157.stdout: 8.40 89.2k 89.2k 0.0k 892.0k 892.0k 0.0k nvme5n2 2024-03-26T17:08:43.075 INFO:tasks.workunit.client.3.smithi157.stdout: 8.40 101.2k 82.0k 0.0k 1012.0k 820.0k 0.0k nvme5n20 2024-03-26T17:08:43.075 INFO:tasks.workunit.client.3.smithi157.stdout: 8.40 74.8k 99.6k 0.0k 748.0k 996.0k 0.0k nvme5n3 2024-03-26T17:08:43.075 INFO:tasks.workunit.client.3.smithi157.stdout: 8.40 118.0k 103.6k 0.0k 1.2M 1.0M 0.0k nvme5n4 2024-03-26T17:08:43.075 INFO:tasks.workunit.client.3.smithi157.stdout: 8.30 84.4k 77.6k 0.0k 844.0k 776.0k 0.0k nvme5n5 2024-03-26T17:08:43.075 INFO:tasks.workunit.client.3.smithi157.stdout: 8.30 80.0k 102.4k 0.0k 800.0k 1.0M 0.0k nvme5n6 2024-03-26T17:08:43.075 INFO:tasks.workunit.client.3.smithi157.stdout: 8.40 101.6k 60.8k 0.0k 1016.0k 608.0k 0.0k nvme5n7 2024-03-26T17:08:43.075 INFO:tasks.workunit.client.3.smithi157.stdout: 8.40 94.4k 84.0k 0.0k 944.0k 840.0k 0.0k nvme5n8 2024-03-26T17:08:43.075 INFO:tasks.workunit.client.3.smithi157.stdout: 8.40 65.2k 95.2k 0.0k 652.0k 952.0k 0.0k nvme5n9 2024-03-26T17:08:43.075 INFO:tasks.workunit.client.3.smithi157.stdout: 8.40 108.8k 67.6k 0.0k 1.1M 676.0k 0.0k nvme8n1 2024-03-26T17:08:43.075 INFO:tasks.workunit.client.3.smithi157.stdout: 8.40 82.4k 79.6k 0.0k 824.0k 796.0k 0.0k nvme8n10 2024-03-26T17:08:43.075 INFO:tasks.workunit.client.3.smithi157.stdout: 8.40 84.4k 93.6k 0.0k 844.0k 936.0k 0.0k nvme8n11 2024-03-26T17:08:43.075 INFO:tasks.workunit.client.3.smithi157.stdout: 8.40 119.6k 75.6k 0.0k 1.2M 756.0k 0.0k nvme8n12 2024-03-26T17:08:43.076 INFO:tasks.workunit.client.3.smithi157.stdout: 8.40 106.8k 89.2k 0.0k 1.0M 892.0k 0.0k nvme8n13 2024-03-26T17:08:43.076 INFO:tasks.workunit.client.3.smithi157.stdout: 8.40 73.2k 72.0k 0.0k 732.0k 720.0k 0.0k nvme8n14 2024-03-26T17:08:43.076 INFO:tasks.workunit.client.3.smithi157.stdout: 8.40 92.8k 95.2k 0.0k 928.0k 952.0k 0.0k nvme8n15 2024-03-26T17:08:43.076 INFO:tasks.workunit.client.3.smithi157.stdout: 8.40 116.8k 65.6k 0.0k 1.1M 656.0k 0.0k nvme8n16 2024-03-26T17:08:43.076 INFO:tasks.workunit.client.3.smithi157.stdout: 8.40 82.0k 96.0k 0.0k 820.0k 960.0k 0.0k nvme8n17 2024-03-26T17:08:43.076 INFO:tasks.workunit.client.3.smithi157.stdout: 8.40 80.0k 92.4k 0.0k 800.0k 924.0k 0.0k nvme8n18 2024-03-26T17:08:43.076 INFO:tasks.workunit.client.3.smithi157.stdout: 8.40 91.6k 86.4k 0.0k 916.0k 864.0k 0.0k nvme8n19 2024-03-26T17:08:43.076 INFO:tasks.workunit.client.3.smithi157.stdout: 8.40 78.0k 96.8k 0.0k 780.0k 968.0k 0.0k nvme8n2 2024-03-26T17:08:43.076 INFO:tasks.workunit.client.3.smithi157.stdout: 8.40 93.6k 95.6k 0.0k 936.0k 956.0k 0.0k nvme8n20 2024-03-26T17:08:43.076 INFO:tasks.workunit.client.3.smithi157.stdout: 8.40 113.2k 102.4k 0.0k 1.1M 1.0M 0.0k nvme8n3 2024-03-26T17:08:43.076 INFO:tasks.workunit.client.3.smithi157.stdout: 8.40 112.0k 93.2k 0.0k 1.1M 932.0k 0.0k nvme8n4 2024-03-26T17:08:43.076 INFO:tasks.workunit.client.3.smithi157.stdout: 8.30 84.8k 102.0k 0.0k 848.0k 1020.0k 0.0k nvme8n5 2024-03-26T17:08:43.076 INFO:tasks.workunit.client.3.smithi157.stdout: 8.40 86.0k 87.2k 0.0k 860.0k 872.0k 0.0k nvme8n6 2024-03-26T17:08:43.076 INFO:tasks.workunit.client.3.smithi157.stdout: 8.40 98.0k 74.4k 0.0k 980.0k 744.0k 0.0k nvme8n7 2024-03-26T17:08:43.076 INFO:tasks.workunit.client.3.smithi157.stdout: 8.40 96.8k 79.2k 0.0k 968.0k 792.0k 0.0k nvme8n8 2024-03-26T17:08:43.077 INFO:tasks.workunit.client.3.smithi157.stdout: 8.40 79.2k 104.0k 0.0k 792.0k 1.0M 0.0k nvme8n9 2024-03-26T17:08:43.077 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:08:43.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:08:43 smithi149 ceph-mon[34678]: pgmap v686: 33 pgs: 33 active+clean; 1.0 GiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 5.5 MiB/s rd, 5.6 MiB/s wr, 513 op/s 2024-03-26T17:08:43.396 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:08:43 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:08:43] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:08:43.396 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:08:43 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:08:43] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:08:43.396 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:08:43 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:08:43.459 INFO:tasks.workunit.client.3.smithi157.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-26T17:08:43.459 INFO:tasks.workunit.client.3.smithi157.stdout:myimage31 6/s 2/s 102 KiB/s 46 KiB/s 2.62 ms 379.15 us 2024-03-26T17:08:43.459 INFO:tasks.workunit.client.3.smithi157.stdout:myimage19 5/s 3/s 101 KiB/s 82 KiB/s 2.52 ms 363.83 us 2024-03-26T17:08:43.459 INFO:tasks.workunit.client.3.smithi157.stdout:myimage9 5/s 4/s 106 KiB/s 94 KiB/s 2.94 ms 344.29 us 2024-03-26T17:08:43.459 INFO:tasks.workunit.client.3.smithi157.stdout:myimage53 5/s 4/s 98 KiB/s 104 KiB/s 2.83 ms 417.93 us 2024-03-26T17:08:43.459 INFO:tasks.workunit.client.3.smithi157.stdout:myimage23 5/s 4/s 142 KiB/s 90 KiB/s 2.14 ms 350.82 us 2024-03-26T17:08:43.459 INFO:tasks.workunit.client.3.smithi157.stdout:myimage51 5/s 3/s 87 KiB/s 93 KiB/s 2.79 ms 325.66 us 2024-03-26T17:08:43.459 INFO:tasks.workunit.client.3.smithi157.stdout:myimage2 4/s 3/s 90 KiB/s 55 KiB/s 2.46 ms 307.67 us 2024-03-26T17:08:43.459 INFO:tasks.workunit.client.3.smithi157.stdout:myimage35 4/s 4/s 82 KiB/s 89 KiB/s 2.36 ms 325.45 us 2024-03-26T17:08:43.459 INFO:tasks.workunit.client.3.smithi157.stdout:myimage33 4/s 3/s 111 KiB/s 72 KiB/s 2.50 ms 345.12 us 2024-03-26T17:08:43.460 INFO:tasks.workunit.client.3.smithi157.stdout:myimage45 4/s 3/s 116 KiB/s 81 KiB/s 2.66 ms 322.38 us 2024-03-26T17:08:43.460 INFO:tasks.workunit.client.3.smithi157.stdout:myimage49 4/s 4/s 106 KiB/s 80 KiB/s 2.36 ms 407.46 us 2024-03-26T17:08:43.460 INFO:tasks.workunit.client.3.smithi157.stdout:myimage5 4/s 4/s 95 KiB/s 65 KiB/s 2.41 ms 405.59 us 2024-03-26T17:08:43.460 INFO:tasks.workunit.client.3.smithi157.stdout:myimage11 4/s 3/s 80 KiB/s 71 KiB/s 2.84 ms 312.03 us 2024-03-26T17:08:43.460 INFO:tasks.workunit.client.3.smithi157.stdout:myimage12 4/s 4/s 91 KiB/s 84 KiB/s 2.55 ms 318.53 us 2024-03-26T17:08:43.460 INFO:tasks.workunit.client.3.smithi157.stdout:myimage26 4/s 4/s 103 KiB/s 90 KiB/s 2.60 ms 388.82 us 2024-03-26T17:08:43.460 INFO:tasks.workunit.client.3.smithi157.stdout:myimage60 4/s 4/s 113 KiB/s 82 KiB/s 2.80 ms 326.43 us 2024-03-26T17:08:43.460 INFO:tasks.workunit.client.3.smithi157.stdout:myimage34 4/s 4/s 79 KiB/s 102 KiB/s 2.40 ms 330.29 us 2024-03-26T17:08:43.460 INFO:tasks.workunit.client.3.smithi157.stdout:myimage38 4/s 3/s 101 KiB/s 72 KiB/s 2.06 ms 450.38 us 2024-03-26T17:08:43.460 INFO:tasks.workunit.client.3.smithi157.stdout:myimage48 4/s 5/s 83 KiB/s 98 KiB/s 2.64 ms 398.48 us 2024-03-26T17:08:43.460 INFO:tasks.workunit.client.3.smithi157.stdout:myimage58 4/s 4/s 82 KiB/s 84 KiB/s 2.47 ms 337.29 us 2024-03-26T17:08:43.460 INFO:tasks.workunit.client.3.smithi157.stdout:myimage4 4/s 4/s 69 KiB/s 107 KiB/s 2.48 ms 285.30 us 2024-03-26T17:08:43.460 INFO:tasks.workunit.client.3.smithi157.stdout:myimage7 4/s 4/s 75 KiB/s 67 KiB/s 2.62 ms 346.36 us 2024-03-26T17:08:43.460 INFO:tasks.workunit.client.3.smithi157.stdout:myimage21 4/s 4/s 97 KiB/s 90 KiB/s 3.27 ms 328.52 us 2024-03-26T17:08:43.460 INFO:tasks.workunit.client.3.smithi157.stdout:myimage27 4/s 5/s 83 KiB/s 114 KiB/s 2.29 ms 338.70 us 2024-03-26T17:08:43.461 INFO:tasks.workunit.client.3.smithi157.stdout:myimage42 4/s 4/s 88 KiB/s 103 KiB/s 2.30 ms 344.40 us 2024-03-26T17:08:43.461 INFO:tasks.workunit.client.3.smithi157.stdout:myimage50 4/s 3/s 81 KiB/s 64 KiB/s 2.63 ms 319.40 us 2024-03-26T17:08:43.461 INFO:tasks.workunit.client.3.smithi157.stdout:myimage10 4/s 4/s 82 KiB/s 107 KiB/s 2.34 ms 335.26 us 2024-03-26T17:08:43.461 INFO:tasks.workunit.client.3.smithi157.stdout:myimage16 4/s 4/s 98 KiB/s 76 KiB/s 2.74 ms 486.74 us 2024-03-26T17:08:43.461 INFO:tasks.workunit.client.3.smithi157.stdout:myimage22 4/s 3/s 106 KiB/s 78 KiB/s 2.71 ms 341.30 us 2024-03-26T17:08:43.461 INFO:tasks.workunit.client.3.smithi157.stdout:myimage30 4/s 3/s 102 KiB/s 94 KiB/s 3.18 ms 349.97 us 2024-03-26T17:08:43.461 INFO:tasks.workunit.client.3.smithi157.stdout:myimage37 4/s 4/s 75 KiB/s 107 KiB/s 2.55 ms 335.39 us 2024-03-26T17:08:43.461 INFO:tasks.workunit.client.3.smithi157.stdout:myimage8 4/s 5/s 90 KiB/s 106 KiB/s 2.55 ms 356.18 us 2024-03-26T17:08:43.461 INFO:tasks.workunit.client.3.smithi157.stdout:myimage18 4/s 3/s 97 KiB/s 63 KiB/s 2.38 ms 328.46 us 2024-03-26T17:08:43.461 INFO:tasks.workunit.client.3.smithi157.stdout:myimage20 4/s 3/s 77 KiB/s 79 KiB/s 2.49 ms 417.85 us 2024-03-26T17:08:43.461 INFO:tasks.workunit.client.3.smithi157.stdout:myimage3 4/s 4/s 85 KiB/s 75 KiB/s 2.13 ms 400.09 us 2024-03-26T17:08:43.461 INFO:tasks.workunit.client.3.smithi157.stdout:myimage6 4/s 3/s 95 KiB/s 73 KiB/s 2.54 ms 338.66 us 2024-03-26T17:08:43.461 INFO:tasks.workunit.client.3.smithi157.stdout:myimage28 4/s 3/s 89 KiB/s 67 KiB/s 3.43 ms 465.67 us 2024-03-26T17:08:43.461 INFO:tasks.workunit.client.3.smithi157.stdout:myimage44 3/s 5/s 84 KiB/s 134 KiB/s 2.73 ms 386.60 us 2024-03-26T17:08:43.462 INFO:tasks.workunit.client.3.smithi157.stdout:myimage17 3/s 3/s 62 KiB/s 73 KiB/s 2.63 ms 351.37 us 2024-03-26T17:08:43.462 INFO:tasks.workunit.client.3.smithi157.stdout:myimage39 3/s 4/s 84 KiB/s 85 KiB/s 2.85 ms 334.09 us 2024-03-26T17:08:43.462 INFO:tasks.workunit.client.3.smithi157.stdout:myimage46 3/s 4/s 72 KiB/s 89 KiB/s 2.51 ms 324.15 us 2024-03-26T17:08:43.462 INFO:tasks.workunit.client.3.smithi157.stdout:myimage54 3/s 4/s 74 KiB/s 78 KiB/s 2.62 ms 357.17 us 2024-03-26T17:08:43.462 INFO:tasks.workunit.client.3.smithi157.stdout:myimage57 3/s 4/s 98 KiB/s 90 KiB/s 2.70 ms 351.53 us 2024-03-26T17:08:43.462 INFO:tasks.workunit.client.3.smithi157.stdout:myimage13 3/s 4/s 61 KiB/s 70 KiB/s 2.23 ms 381.70 us 2024-03-26T17:08:43.462 INFO:tasks.workunit.client.3.smithi157.stdout:myimage47 3/s 5/s 86 KiB/s 98 KiB/s 3.06 ms 468.28 us 2024-03-26T17:08:43.462 INFO:tasks.workunit.client.3.smithi157.stdout:myimage15 3/s 4/s 62 KiB/s 111 KiB/s 2.27 ms 340.10 us 2024-03-26T17:08:43.462 INFO:tasks.workunit.client.3.smithi157.stdout:myimage25 3/s 4/s 62 KiB/s 62 KiB/s 3.25 ms 337.45 us 2024-03-26T17:08:43.462 INFO:tasks.workunit.client.3.smithi157.stdout:myimage55 3/s 4/s 82 KiB/s 146 KiB/s 2.81 ms 347.64 us 2024-03-26T17:08:43.462 INFO:tasks.workunit.client.3.smithi157.stdout:myimage14 3/s 4/s 85 KiB/s 58 KiB/s 3.17 ms 327.26 us 2024-03-26T17:08:43.462 INFO:tasks.workunit.client.3.smithi157.stdout:myimage32 3/s 4/s 80 KiB/s 96 KiB/s 2.60 ms 429.98 us 2024-03-26T17:08:43.462 INFO:tasks.workunit.client.3.smithi157.stdout:myimage40 3/s 4/s 66 KiB/s 97 KiB/s 2.40 ms 345.41 us 2024-03-26T17:08:43.462 INFO:tasks.workunit.client.3.smithi157.stdout:myimage1 3/s 4/s 78 KiB/s 79 KiB/s 2.29 ms 338.99 us 2024-03-26T17:08:43.463 INFO:tasks.workunit.client.3.smithi157.stdout:myimage24 3/s 5/s 98 KiB/s 146 KiB/s 2.61 ms 340.34 us 2024-03-26T17:08:43.463 INFO:tasks.workunit.client.3.smithi157.stdout:myimage36 3/s 5/s 74 KiB/s 114 KiB/s 2.51 ms 345.57 us 2024-03-26T17:08:43.463 INFO:tasks.workunit.client.3.smithi157.stdout:myimage43 3/s 4/s 93 KiB/s 111 KiB/s 2.95 ms 404.97 us 2024-03-26T17:08:43.463 INFO:tasks.workunit.client.3.smithi157.stdout:myimage59 3/s 5/s 61 KiB/s 105 KiB/s 2.54 ms 363.83 us 2024-03-26T17:08:43.463 INFO:tasks.workunit.client.3.smithi157.stdout:myimage56 3/s 5/s 56 KiB/s 136 KiB/s 3.08 ms 434.08 us 2024-03-26T17:08:43.463 INFO:tasks.workunit.client.3.smithi157.stdout:myimage52 3/s 4/s 71 KiB/s 78 KiB/s 2.92 ms 301.24 us 2024-03-26T17:08:43.463 INFO:tasks.workunit.client.3.smithi157.stdout:myimage29 3/s 5/s 62 KiB/s 63 KiB/s 2.28 ms 314.72 us 2024-03-26T17:08:43.463 INFO:tasks.workunit.client.3.smithi157.stdout:myimage41 2/s 5/s 38 KiB/s 86 KiB/s 2.72 ms 376.84 us 2024-03-26T17:08:43.463 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:08:43.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:08:43 smithi044 ceph-mon[30624]: pgmap v686: 33 pgs: 33 active+clean; 1.0 GiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 5.5 MiB/s rd, 5.6 MiB/s wr, 513 op/s 2024-03-26T17:08:43.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:08:43 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:08:43] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:08:43.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:08:43 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:08:43] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:08:43.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:08:43 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:08:43.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:08:43 smithi064 ceph-mon[34420]: pgmap v686: 33 pgs: 33 active+clean; 1.0 GiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 5.5 MiB/s rd, 5.6 MiB/s wr, 513 op/s 2024-03-26T17:08:44.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:08:44 smithi149 ceph-mon[34678]: Health check update: 3 slow ops, oldest one blocked for 618 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:08:44.456 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:08:44 smithi064 ceph-mon[34420]: Health check update: 3 slow ops, oldest one blocked for 618 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:08:44.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:08:44 smithi044 ceph-mon[30624]: Health check update: 3 slow ops, oldest one blocked for 618 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:08:45.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:08:45 smithi149 ceph-mon[34678]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:08:45.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:08:45 smithi149 ceph-mon[34678]: { 2024-03-26T17:08:45.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:08:45 smithi149 ceph-mon[34678]: "prefix": "rbd perf image stats", 2024-03-26T17:08:45.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:08:45 smithi149 ceph-mon[34678]: "pool_spec": "mypool", 2024-03-26T17:08:45.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:08:45 smithi149 ceph-mon[34678]: "sort_by": "write_ops", 2024-03-26T17:08:45.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:08:45 smithi149 ceph-mon[34678]: "format": "json" 2024-03-26T17:08:45.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:08:45 smithi149 ceph-mon[34678]: }"]: dispatch 2024-03-26T17:08:45.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:08:45 smithi149 ceph-mon[34678]: pgmap v687: 33 pgs: 33 active+clean; 1.0 GiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 5.4 MiB/s rd, 5.3 MiB/s wr, 509 op/s 2024-03-26T17:08:45.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:08:45 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-26T17:08:45.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:08:45 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T17:08:45.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:08:45 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T17:08:45.397 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:08:45 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:08:45] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:08:45.397 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:08:45 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:08:45] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:08:45.397 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:08:45 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:08:45.416 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:08:45 smithi044 ceph-mon[30624]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:08:45.416 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:08:45 smithi044 ceph-mon[30624]: { 2024-03-26T17:08:45.416 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:08:45 smithi044 ceph-mon[30624]: "prefix": "rbd perf image stats", 2024-03-26T17:08:45.416 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:08:45 smithi044 ceph-mon[30624]: "pool_spec": "mypool", 2024-03-26T17:08:45.416 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:08:45 smithi044 ceph-mon[30624]: "sort_by": "write_ops", 2024-03-26T17:08:45.416 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:08:45 smithi044 ceph-mon[30624]: "format": "json" 2024-03-26T17:08:45.416 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:08:45 smithi044 ceph-mon[30624]: }"]: dispatch 2024-03-26T17:08:45.416 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:08:45 smithi044 ceph-mon[30624]: pgmap v687: 33 pgs: 33 active+clean; 1.0 GiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 5.4 MiB/s rd, 5.3 MiB/s wr, 509 op/s 2024-03-26T17:08:45.416 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:08:45 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-26T17:08:45.416 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:08:45 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T17:08:45.416 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:08:45 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T17:08:45.417 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:08:45 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:08:45] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:08:45.417 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:08:45 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:08:45] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:08:45.417 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:08:45 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:08:45.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:08:45 smithi064 ceph-mon[34420]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:08:45.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:08:45 smithi064 ceph-mon[34420]: { 2024-03-26T17:08:45.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:08:45 smithi064 ceph-mon[34420]: "prefix": "rbd perf image stats", 2024-03-26T17:08:45.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:08:45 smithi064 ceph-mon[34420]: "pool_spec": "mypool", 2024-03-26T17:08:45.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:08:45 smithi064 ceph-mon[34420]: "sort_by": "write_ops", 2024-03-26T17:08:45.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:08:45 smithi064 ceph-mon[34420]: "format": "json" 2024-03-26T17:08:45.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:08:45 smithi064 ceph-mon[34420]: }"]: dispatch 2024-03-26T17:08:45.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:08:45 smithi064 ceph-mon[34420]: pgmap v687: 33 pgs: 33 active+clean; 1.0 GiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 5.4 MiB/s rd, 5.3 MiB/s wr, 509 op/s 2024-03-26T17:08:45.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:08:45 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-26T17:08:45.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:08:45 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T17:08:45.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:08:45 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T17:08:46.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:08:46 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T17:08:46.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:08:46 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-26T17:08:46.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:08:46 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T17:08:46.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:08:46 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 2024-03-26T17:08:46.236+0000 7fa707a55700 -1 mon.c@1(peon) e3 get_health_metrics reporting 3 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T17:08:46.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:08:46 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T17:08:46.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:08:46 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-26T17:08:46.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:08:46 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T17:08:46.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:08:46 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T17:08:46.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:08:46 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-26T17:08:46.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:08:46 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T17:08:47.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:08:47 smithi149 ceph-mon[34678]: pgmap v688: 33 pgs: 33 active+clean; 1.0 GiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 5.7 MiB/s rd, 5.6 MiB/s wr, 544 op/s 2024-03-26T17:08:47.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:08:47 smithi149 ceph-mon[34678]: pgmap v689: 33 pgs: 33 active+clean; 1.0 GiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 5.4 MiB/s rd, 5.4 MiB/s wr, 525 op/s 2024-03-26T17:08:47.396 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:08:47 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:08:47] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:08:47.396 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:08:47 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:08:47] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:08:47.396 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:08:47 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:08:47.474 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:08:47 smithi044 ceph-mon[30624]: pgmap v688: 33 pgs: 33 active+clean; 1.0 GiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 5.7 MiB/s rd, 5.6 MiB/s wr, 544 op/s 2024-03-26T17:08:47.475 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:08:47 smithi044 ceph-mon[30624]: pgmap v689: 33 pgs: 33 active+clean; 1.0 GiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 5.4 MiB/s rd, 5.4 MiB/s wr, 525 op/s 2024-03-26T17:08:47.475 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:08:47 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:08:47] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:08:47.475 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:08:47 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:08:47] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:08:47.475 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:08:47 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:08:47.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:08:47 smithi064 ceph-mon[34420]: pgmap v688: 33 pgs: 33 active+clean; 1.0 GiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 5.7 MiB/s rd, 5.6 MiB/s wr, 544 op/s 2024-03-26T17:08:47.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:08:47 smithi064 ceph-mon[34420]: pgmap v689: 33 pgs: 33 active+clean; 1.0 GiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 5.4 MiB/s rd, 5.4 MiB/s wr, 525 op/s 2024-03-26T17:08:48.462 INFO:tasks.workunit.client.3.smithi157.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-26T17:08:48.463 INFO:tasks.workunit.client.3.smithi157.stdout:myimage12 6/s 2/s 118 KiB/s 42 KiB/s 2.62 ms 403.95 us 2024-03-26T17:08:48.463 INFO:tasks.workunit.client.3.smithi157.stdout:myimage22 5/s 4/s 89 KiB/s 69 KiB/s 2.71 ms 365.31 us 2024-03-26T17:08:48.463 INFO:tasks.workunit.client.3.smithi157.stdout:myimage58 5/s 3/s 84 KiB/s 82 KiB/s 2.53 ms 336.98 us 2024-03-26T17:08:48.463 INFO:tasks.workunit.client.3.smithi157.stdout:myimage29 5/s 4/s 134 KiB/s 72 KiB/s 2.30 ms 420.82 us 2024-03-26T17:08:48.463 INFO:tasks.workunit.client.3.smithi157.stdout:myimage46 5/s 2/s 121 KiB/s 47 KiB/s 2.53 ms 324.81 us 2024-03-26T17:08:48.463 INFO:tasks.workunit.client.3.smithi157.stdout:myimage13 5/s 3/s 69 KiB/s 56 KiB/s 2.49 ms 339.24 us 2024-03-26T17:08:48.463 INFO:tasks.workunit.client.3.smithi157.stdout:myimage15 5/s 3/s 83 KiB/s 82 KiB/s 2.35 ms 521.08 us 2024-03-26T17:08:48.463 INFO:tasks.workunit.client.3.smithi157.stdout:myimage17 5/s 3/s 116 KiB/s 74 KiB/s 2.90 ms 310.70 us 2024-03-26T17:08:48.463 INFO:tasks.workunit.client.3.smithi157.stdout:myimage42 5/s 3/s 110 KiB/s 66 KiB/s 2.43 ms 327.93 us 2024-03-26T17:08:48.463 INFO:tasks.workunit.client.3.smithi157.stdout:myimage54 5/s 3/s 106 KiB/s 62 KiB/s 2.48 ms 323.81 us 2024-03-26T17:08:48.463 INFO:tasks.workunit.client.3.smithi157.stdout:myimage10 5/s 4/s 112 KiB/s 90 KiB/s 2.42 ms 426.03 us 2024-03-26T17:08:48.463 INFO:tasks.workunit.client.3.smithi157.stdout:myimage59 5/s 3/s 98 KiB/s 92 KiB/s 2.74 ms 371.98 us 2024-03-26T17:08:48.463 INFO:tasks.workunit.client.3.smithi157.stdout:myimage2 4/s 4/s 79 KiB/s 93 KiB/s 2.53 ms 336.80 us 2024-03-26T17:08:48.464 INFO:tasks.workunit.client.3.smithi157.stdout:myimage40 4/s 3/s 94 KiB/s 90 KiB/s 2.46 ms 438.18 us 2024-03-26T17:08:48.464 INFO:tasks.workunit.client.3.smithi157.stdout:myimage5 4/s 3/s 102 KiB/s 50 KiB/s 2.44 ms 470.53 us 2024-03-26T17:08:48.464 INFO:tasks.workunit.client.3.smithi157.stdout:myimage3 4/s 3/s 90 KiB/s 90 KiB/s 2.31 ms 446.07 us 2024-03-26T17:08:48.464 INFO:tasks.workunit.client.3.smithi157.stdout:myimage52 4/s 4/s 111 KiB/s 94 KiB/s 3.18 ms 327.19 us 2024-03-26T17:08:48.464 INFO:tasks.workunit.client.3.smithi157.stdout:myimage11 4/s 3/s 80 KiB/s 74 KiB/s 2.56 ms 305.46 us 2024-03-26T17:08:48.464 INFO:tasks.workunit.client.3.smithi157.stdout:myimage21 4/s 4/s 110 KiB/s 74 KiB/s 3.21 ms 346.64 us 2024-03-26T17:08:48.464 INFO:tasks.workunit.client.3.smithi157.stdout:myimage24 4/s 4/s 106 KiB/s 82 KiB/s 2.25 ms 370.97 us 2024-03-26T17:08:48.464 INFO:tasks.workunit.client.3.smithi157.stdout:myimage36 4/s 4/s 98 KiB/s 95 KiB/s 2.61 ms 454.53 us 2024-03-26T17:08:48.464 INFO:tasks.workunit.client.3.smithi157.stdout:myimage41 4/s 5/s 85 KiB/s 144 KiB/s 2.70 ms 366.82 us 2024-03-26T17:08:48.464 INFO:tasks.workunit.client.3.smithi157.stdout:myimage50 4/s 4/s 86 KiB/s 82 KiB/s 2.81 ms 347.92 us 2024-03-26T17:08:48.464 INFO:tasks.workunit.client.3.smithi157.stdout:myimage4 4/s 3/s 118 KiB/s 81 KiB/s 2.65 ms 330.72 us 2024-03-26T17:08:48.464 INFO:tasks.workunit.client.3.smithi157.stdout:myimage26 4/s 4/s 107 KiB/s 70 KiB/s 2.69 ms 337.35 us 2024-03-26T17:08:48.464 INFO:tasks.workunit.client.3.smithi157.stdout:myimage28 4/s 5/s 105 KiB/s 117 KiB/s 3.48 ms 446.01 us 2024-03-26T17:08:48.464 INFO:tasks.workunit.client.3.smithi157.stdout:myimage43 4/s 4/s 99 KiB/s 116 KiB/s 2.81 ms 397.66 us 2024-03-26T17:08:48.465 INFO:tasks.workunit.client.3.smithi157.stdout:myimage55 4/s 3/s 104 KiB/s 74 KiB/s 2.86 ms 399.32 us 2024-03-26T17:08:48.465 INFO:tasks.workunit.client.3.smithi157.stdout:myimage16 4/s 5/s 55 KiB/s 106 KiB/s 2.70 ms 324.67 us 2024-03-26T17:08:48.465 INFO:tasks.workunit.client.3.smithi157.stdout:myimage32 4/s 3/s 88 KiB/s 70 KiB/s 2.60 ms 309.97 us 2024-03-26T17:08:48.465 INFO:tasks.workunit.client.3.smithi157.stdout:myimage44 4/s 3/s 106 KiB/s 72 KiB/s 2.69 ms 424.71 us 2024-03-26T17:08:48.465 INFO:tasks.workunit.client.3.smithi157.stdout:myimage20 4/s 5/s 67 KiB/s 113 KiB/s 2.26 ms 395.23 us 2024-03-26T17:08:48.465 INFO:tasks.workunit.client.3.smithi157.stdout:myimage45 4/s 4/s 75 KiB/s 93 KiB/s 2.77 ms 366.82 us 2024-03-26T17:08:48.465 INFO:tasks.workunit.client.3.smithi157.stdout:myimage51 4/s 4/s 103 KiB/s 80 KiB/s 2.67 ms 320.20 us 2024-03-26T17:08:48.465 INFO:tasks.workunit.client.3.smithi157.stdout:myimage60 4/s 3/s 70 KiB/s 97 KiB/s 2.73 ms 566.30 us 2024-03-26T17:08:48.465 INFO:tasks.workunit.client.3.smithi157.stdout:myimage34 4/s 4/s 77 KiB/s 84 KiB/s 2.62 ms 334.08 us 2024-03-26T17:08:48.465 INFO:tasks.workunit.client.3.smithi157.stdout:myimage38 4/s 4/s 82 KiB/s 83 KiB/s 2.34 ms 309.59 us 2024-03-26T17:08:48.465 INFO:tasks.workunit.client.3.smithi157.stdout:myimage27 4/s 4/s 61 KiB/s 72 KiB/s 2.33 ms 374.50 us 2024-03-26T17:08:48.465 INFO:tasks.workunit.client.3.smithi157.stdout:myimage39 4/s 4/s 71 KiB/s 90 KiB/s 2.33 ms 342.41 us 2024-03-26T17:08:48.465 INFO:tasks.workunit.client.3.smithi157.stdout:myimage53 4/s 3/s 89 KiB/s 86 KiB/s 2.45 ms 331.53 us 2024-03-26T17:08:48.465 INFO:tasks.workunit.client.3.smithi157.stdout:myimage30 3/s 4/s 73 KiB/s 109 KiB/s 3.13 ms 358.48 us 2024-03-26T17:08:48.465 INFO:tasks.workunit.client.3.smithi157.stdout:myimage31 3/s 4/s 78 KiB/s 96 KiB/s 2.74 ms 393.24 us 2024-03-26T17:08:48.466 INFO:tasks.workunit.client.3.smithi157.stdout:myimage35 3/s 4/s 79 KiB/s 70 KiB/s 2.71 ms 385.77 us 2024-03-26T17:08:48.466 INFO:tasks.workunit.client.3.smithi157.stdout:myimage37 3/s 4/s 83 KiB/s 101 KiB/s 2.92 ms 374.93 us 2024-03-26T17:08:48.466 INFO:tasks.workunit.client.3.smithi157.stdout:myimage49 3/s 3/s 78 KiB/s 57 KiB/s 2.40 ms 312.04 us 2024-03-26T17:08:48.466 INFO:tasks.workunit.client.3.smithi157.stdout:myimage1 3/s 3/s 76 KiB/s 67 KiB/s 2.43 ms 271.30 us 2024-03-26T17:08:48.466 INFO:tasks.workunit.client.3.smithi157.stdout:myimage57 3/s 4/s 79 KiB/s 99 KiB/s 2.71 ms 470.61 us 2024-03-26T17:08:48.466 INFO:tasks.workunit.client.3.smithi157.stdout:myimage47 3/s 4/s 56 KiB/s 94 KiB/s 2.55 ms 338.43 us 2024-03-26T17:08:48.466 INFO:tasks.workunit.client.3.smithi157.stdout:myimage6 3/s 5/s 58 KiB/s 118 KiB/s 2.80 ms 360.04 us 2024-03-26T17:08:48.466 INFO:tasks.workunit.client.3.smithi157.stdout:myimage7 3/s 5/s 78 KiB/s 97 KiB/s 2.49 ms 385.39 us 2024-03-26T17:08:48.466 INFO:tasks.workunit.client.3.smithi157.stdout:myimage18 3/s 4/s 70 KiB/s 102 KiB/s 2.31 ms 336.46 us 2024-03-26T17:08:48.466 INFO:tasks.workunit.client.3.smithi157.stdout:myimage19 3/s 4/s 71 KiB/s 116 KiB/s 2.48 ms 350.53 us 2024-03-26T17:08:48.466 INFO:tasks.workunit.client.3.smithi157.stdout:myimage25 3/s 3/s 81 KiB/s 84 KiB/s 3.33 ms 367.32 us 2024-03-26T17:08:48.466 INFO:tasks.workunit.client.3.smithi157.stdout:myimage56 3/s 4/s 70 KiB/s 66 KiB/s 3.03 ms 359.64 us 2024-03-26T17:08:48.466 INFO:tasks.workunit.client.3.smithi157.stdout:myimage14 3/s 4/s 95 KiB/s 118 KiB/s 2.55 ms 365.39 us 2024-03-26T17:08:48.466 INFO:tasks.workunit.client.3.smithi157.stdout:myimage23 3/s 4/s 29 KiB/s 78 KiB/s 1.96 ms 316.55 us 2024-03-26T17:08:48.467 INFO:tasks.workunit.client.3.smithi157.stdout:myimage9 3/s 5/s 70 KiB/s 114 KiB/s 2.80 ms 305.68 us 2024-03-26T17:08:48.467 INFO:tasks.workunit.client.3.smithi157.stdout:myimage8 3/s 4/s 69 KiB/s 54 KiB/s 2.80 ms 348.94 us 2024-03-26T17:08:48.467 INFO:tasks.workunit.client.3.smithi157.stdout:myimage48 2/s 4/s 51 KiB/s 110 KiB/s 2.74 ms 331.94 us 2024-03-26T17:08:48.467 INFO:tasks.workunit.client.3.smithi157.stdout:myimage33 2/s 3/s 73 KiB/s 122 KiB/s 2.67 ms 401.20 us 2024-03-26T17:08:48.467 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:08:49.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:08:49 smithi149 ceph-mon[34678]: pgmap v690: 33 pgs: 33 active+clean; 1.0 GiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 5.1 MiB/s rd, 5.0 MiB/s wr, 499 op/s 2024-03-26T17:08:49.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:08:49 smithi149 ceph-mon[34678]: Health check update: 3 slow ops, oldest one blocked for 623 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:08:49.396 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:08:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:08:49] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:08:49.396 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:08:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:08:49] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:08:49.396 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:08:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:08:49.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:08:49 smithi044 ceph-mon[30624]: pgmap v690: 33 pgs: 33 active+clean; 1.0 GiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 5.1 MiB/s rd, 5.0 MiB/s wr, 499 op/s 2024-03-26T17:08:49.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:08:49 smithi044 ceph-mon[30624]: Health check update: 3 slow ops, oldest one blocked for 623 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:08:49.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:08:49 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:08:49] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:08:49.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:08:49 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:08:49] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:08:49.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:08:49 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:08:49.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:08:49 smithi064 ceph-mon[34420]: pgmap v690: 33 pgs: 33 active+clean; 1.0 GiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 5.1 MiB/s rd, 5.0 MiB/s wr, 499 op/s 2024-03-26T17:08:49.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:08:49 smithi064 ceph-mon[34420]: Health check update: 3 slow ops, oldest one blocked for 623 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:08:50.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:08:50 smithi149 ceph-mon[34678]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:08:50.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:08:50 smithi149 ceph-mon[34678]: { 2024-03-26T17:08:50.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:08:50 smithi149 ceph-mon[34678]: "prefix": "rbd perf image stats", 2024-03-26T17:08:50.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:08:50 smithi149 ceph-mon[34678]: "pool_spec": "mypool", 2024-03-26T17:08:50.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:08:50 smithi149 ceph-mon[34678]: "sort_by": "write_ops", 2024-03-26T17:08:50.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:08:50 smithi149 ceph-mon[34678]: "format": "json" 2024-03-26T17:08:50.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:08:50 smithi149 ceph-mon[34678]: }"]: dispatch 2024-03-26T17:08:50.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:08:50 smithi044 ceph-mon[30624]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:08:50.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:08:50 smithi044 ceph-mon[30624]: { 2024-03-26T17:08:50.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:08:50 smithi044 ceph-mon[30624]: "prefix": "rbd perf image stats", 2024-03-26T17:08:50.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:08:50 smithi044 ceph-mon[30624]: "pool_spec": "mypool", 2024-03-26T17:08:50.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:08:50 smithi044 ceph-mon[30624]: "sort_by": "write_ops", 2024-03-26T17:08:50.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:08:50 smithi044 ceph-mon[30624]: "format": "json" 2024-03-26T17:08:50.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:08:50 smithi044 ceph-mon[30624]: }"]: dispatch 2024-03-26T17:08:50.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:08:50 smithi064 ceph-mon[34420]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:08:50.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:08:50 smithi064 ceph-mon[34420]: { 2024-03-26T17:08:50.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:08:50 smithi064 ceph-mon[34420]: "prefix": "rbd perf image stats", 2024-03-26T17:08:50.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:08:50 smithi064 ceph-mon[34420]: "pool_spec": "mypool", 2024-03-26T17:08:50.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:08:50 smithi064 ceph-mon[34420]: "sort_by": "write_ops", 2024-03-26T17:08:50.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:08:50 smithi064 ceph-mon[34420]: "format": "json" 2024-03-26T17:08:50.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:08:50 smithi064 ceph-mon[34420]: }"]: dispatch 2024-03-26T17:08:51.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:08:51 smithi149 ceph-mon[34678]: pgmap v691: 33 pgs: 33 active+clean; 1.0 GiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 5.3 MiB/s rd, 5.1 MiB/s wr, 526 op/s 2024-03-26T17:08:51.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:08:51 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 2024-03-26T17:08:51.236+0000 7fa707a55700 -1 mon.c@1(peon) e3 get_health_metrics reporting 3 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T17:08:51.396 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:08:51 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:08:51] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:08:51.397 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:08:51 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:08:51] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:08:51.397 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:08:51 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:08:51.416 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:08:51 smithi044 ceph-mon[30624]: pgmap v691: 33 pgs: 33 active+clean; 1.0 GiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 5.3 MiB/s rd, 5.1 MiB/s wr, 526 op/s 2024-03-26T17:08:51.417 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:08:51 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:08:51] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:08:51.417 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:08:51 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:08:51] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:08:51.417 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:08:51 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:08:51.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:08:51 smithi064 ceph-mon[34420]: pgmap v691: 33 pgs: 33 active+clean; 1.0 GiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 5.3 MiB/s rd, 5.1 MiB/s wr, 526 op/s 2024-03-26T17:08:53.062 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:08:53.072 INFO:tasks.workunit.client.3.smithi157.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2024-03-26T17:08:53.073 INFO:tasks.workunit.client.3.smithi157.stdout: 8.10 100.4k 43.2k 0.0k 1004.0k 432.0k 0.0k nvme2n1 2024-03-26T17:08:53.073 INFO:tasks.workunit.client.3.smithi157.stdout: 8.20 55.2k 83.6k 0.0k 552.0k 836.0k 0.0k nvme2n10 2024-03-26T17:08:53.073 INFO:tasks.workunit.client.3.smithi157.stdout: 8.20 92.0k 87.2k 0.0k 920.0k 872.0k 0.0k nvme2n11 2024-03-26T17:08:53.073 INFO:tasks.workunit.client.3.smithi157.stdout: 8.20 82.0k 87.6k 0.0k 820.0k 876.0k 0.0k nvme2n12 2024-03-26T17:08:53.073 INFO:tasks.workunit.client.3.smithi157.stdout: 8.20 60.8k 86.4k 0.0k 608.0k 864.0k 0.0k nvme2n13 2024-03-26T17:08:53.073 INFO:tasks.workunit.client.3.smithi157.stdout: 8.20 83.6k 83.6k 0.0k 836.0k 836.0k 0.0k nvme2n14 2024-03-26T17:08:53.073 INFO:tasks.workunit.client.3.smithi157.stdout: 8.20 76.0k 84.8k 0.0k 760.0k 848.0k 0.0k nvme2n15 2024-03-26T17:08:53.073 INFO:tasks.workunit.client.3.smithi157.stdout: 8.20 81.6k 73.2k 0.0k 816.0k 732.0k 0.0k nvme2n16 2024-03-26T17:08:53.073 INFO:tasks.workunit.client.3.smithi157.stdout: 8.20 97.2k 86.4k 0.0k 972.0k 864.0k 0.0k nvme2n17 2024-03-26T17:08:53.073 INFO:tasks.workunit.client.3.smithi157.stdout: 8.20 74.8k 64.0k 0.0k 748.0k 640.0k 0.0k nvme2n18 2024-03-26T17:08:53.073 INFO:tasks.workunit.client.3.smithi157.stdout: 8.20 86.8k 91.2k 0.0k 868.0k 912.0k 0.0k nvme2n19 2024-03-26T17:08:53.073 INFO:tasks.workunit.client.3.smithi157.stdout: 8.10 78.4k 93.6k 0.0k 784.0k 936.0k 0.0k nvme2n2 2024-03-26T17:08:53.073 INFO:tasks.workunit.client.3.smithi157.stdout: 8.20 100.4k 70.0k 0.0k 1004.0k 700.0k 0.0k nvme2n20 2024-03-26T17:08:53.074 INFO:tasks.workunit.client.3.smithi157.stdout: 8.10 87.6k 64.4k 0.0k 876.0k 644.0k 0.0k nvme2n3 2024-03-26T17:08:53.074 INFO:tasks.workunit.client.3.smithi157.stdout: 8.10 80.8k 68.4k 0.0k 808.0k 684.0k 0.0k nvme2n4 2024-03-26T17:08:53.074 INFO:tasks.workunit.client.3.smithi157.stdout: 8.20 80.0k 98.0k 0.0k 800.0k 980.0k 0.0k nvme2n5 2024-03-26T17:08:53.074 INFO:tasks.workunit.client.3.smithi157.stdout: 8.20 98.8k 51.2k 0.0k 988.0k 512.0k 0.0k nvme2n6 2024-03-26T17:08:53.074 INFO:tasks.workunit.client.3.smithi157.stdout: 8.20 80.0k 74.0k 0.0k 800.0k 740.0k 0.0k nvme2n7 2024-03-26T17:08:53.074 INFO:tasks.workunit.client.3.smithi157.stdout: 8.20 91.2k 69.6k 0.0k 912.0k 696.0k 0.0k nvme2n8 2024-03-26T17:08:53.074 INFO:tasks.workunit.client.3.smithi157.stdout: 8.20 80.8k 88.4k 0.0k 808.0k 884.0k 0.0k nvme2n9 2024-03-26T17:08:53.074 INFO:tasks.workunit.client.3.smithi157.stdout: 8.20 67.2k 85.2k 0.0k 672.0k 852.0k 0.0k nvme5n1 2024-03-26T17:08:53.074 INFO:tasks.workunit.client.3.smithi157.stdout: 8.20 53.6k 83.2k 0.0k 536.0k 832.0k 0.0k nvme5n10 2024-03-26T17:08:53.074 INFO:tasks.workunit.client.3.smithi157.stdout: 8.20 80.4k 73.2k 0.0k 804.0k 732.0k 0.0k nvme5n11 2024-03-26T17:08:53.074 INFO:tasks.workunit.client.3.smithi157.stdout: 8.20 70.4k 88.8k 0.0k 704.0k 888.0k 0.0k nvme5n12 2024-03-26T17:08:53.074 INFO:tasks.workunit.client.3.smithi157.stdout: 8.20 106.0k 79.2k 0.0k 1.0M 792.0k 0.0k nvme5n13 2024-03-26T17:08:53.074 INFO:tasks.workunit.client.3.smithi157.stdout: 8.20 66.8k 81.2k 0.0k 668.0k 812.0k 0.0k nvme5n14 2024-03-26T17:08:53.074 INFO:tasks.workunit.client.3.smithi157.stdout: 8.20 64.0k 84.4k 0.0k 640.0k 844.0k 0.0k nvme5n15 2024-03-26T17:08:53.075 INFO:tasks.workunit.client.3.smithi157.stdout: 8.20 101.2k 77.2k 0.0k 1012.0k 772.0k 0.0k nvme5n16 2024-03-26T17:08:53.075 INFO:tasks.workunit.client.3.smithi157.stdout: 8.20 74.0k 95.2k 0.0k 740.0k 952.0k 0.0k nvme5n17 2024-03-26T17:08:53.075 INFO:tasks.workunit.client.3.smithi157.stdout: 8.20 88.8k 79.6k 0.0k 888.0k 796.0k 0.0k nvme5n18 2024-03-26T17:08:53.075 INFO:tasks.workunit.client.3.smithi157.stdout: 8.20 68.4k 65.2k 0.0k 684.0k 652.0k 0.0k nvme5n19 2024-03-26T17:08:53.075 INFO:tasks.workunit.client.3.smithi157.stdout: 8.10 67.6k 84.0k 0.0k 676.0k 840.0k 0.0k nvme5n2 2024-03-26T17:08:53.075 INFO:tasks.workunit.client.3.smithi157.stdout: 8.20 70.0k 98.8k 0.0k 700.0k 988.0k 0.0k nvme5n20 2024-03-26T17:08:53.075 INFO:tasks.workunit.client.3.smithi157.stdout: 8.10 70.8k 80.0k 0.0k 708.0k 800.0k 0.0k nvme5n3 2024-03-26T17:08:53.075 INFO:tasks.workunit.client.3.smithi157.stdout: 8.10 58.0k 100.0k 0.0k 580.0k 1000.0k 0.0k nvme5n4 2024-03-26T17:08:53.075 INFO:tasks.workunit.client.3.smithi157.stdout: 8.20 104.0k 60.0k 0.0k 1.0M 600.0k 0.0k nvme5n5 2024-03-26T17:08:53.075 INFO:tasks.workunit.client.3.smithi157.stdout: 8.20 79.2k 91.6k 0.0k 792.0k 916.0k 0.0k nvme5n6 2024-03-26T17:08:53.075 INFO:tasks.workunit.client.3.smithi157.stdout: 8.20 56.8k 80.0k 0.0k 568.0k 800.0k 0.0k nvme5n7 2024-03-26T17:08:53.075 INFO:tasks.workunit.client.3.smithi157.stdout: 8.20 82.0k 96.4k 0.0k 820.0k 964.0k 0.0k nvme5n8 2024-03-26T17:08:53.075 INFO:tasks.workunit.client.3.smithi157.stdout: 8.20 94.8k 74.0k 0.0k 948.0k 740.0k 0.0k nvme5n9 2024-03-26T17:08:53.075 INFO:tasks.workunit.client.3.smithi157.stdout: 8.10 79.2k 90.8k 0.0k 792.0k 908.0k 0.0k nvme8n1 2024-03-26T17:08:53.075 INFO:tasks.workunit.client.3.smithi157.stdout: 8.20 69.2k 81.2k 0.0k 692.0k 812.0k 0.0k nvme8n10 2024-03-26T17:08:53.076 INFO:tasks.workunit.client.3.smithi157.stdout: 8.20 68.4k 85.6k 0.0k 684.0k 856.0k 0.0k nvme8n11 2024-03-26T17:08:53.076 INFO:tasks.workunit.client.3.smithi157.stdout: 8.20 84.0k 74.4k 0.0k 840.0k 744.0k 0.0k nvme8n12 2024-03-26T17:08:53.076 INFO:tasks.workunit.client.3.smithi157.stdout: 8.20 89.2k 92.8k 0.0k 892.0k 928.0k 0.0k nvme8n13 2024-03-26T17:08:53.076 INFO:tasks.workunit.client.3.smithi157.stdout: 8.20 69.2k 107.2k 0.0k 692.0k 1.0M 0.0k nvme8n14 2024-03-26T17:08:53.076 INFO:tasks.workunit.client.3.smithi157.stdout: 8.20 106.8k 91.6k 0.0k 1.0M 916.0k 0.0k nvme8n15 2024-03-26T17:08:53.076 INFO:tasks.workunit.client.3.smithi157.stdout: 8.20 84.4k 69.6k 0.0k 844.0k 696.0k 0.0k nvme8n16 2024-03-26T17:08:53.076 INFO:tasks.workunit.client.3.smithi157.stdout: 8.20 90.4k 87.6k 0.0k 904.0k 876.0k 0.0k nvme8n17 2024-03-26T17:08:53.076 INFO:tasks.workunit.client.3.smithi157.stdout: 8.20 80.0k 78.4k 0.0k 800.0k 784.0k 0.0k nvme8n18 2024-03-26T17:08:53.076 INFO:tasks.workunit.client.3.smithi157.stdout: 8.20 85.2k 66.8k 0.0k 852.0k 668.0k 0.0k nvme8n19 2024-03-26T17:08:53.076 INFO:tasks.workunit.client.3.smithi157.stdout: 8.10 98.0k 77.2k 0.0k 980.0k 772.0k 0.0k nvme8n2 2024-03-26T17:08:53.076 INFO:tasks.workunit.client.3.smithi157.stdout: 8.20 90.4k 76.0k 0.0k 904.0k 760.0k 0.0k nvme8n20 2024-03-26T17:08:53.076 INFO:tasks.workunit.client.3.smithi157.stdout: 8.10 88.8k 90.8k 0.0k 888.0k 908.0k 0.0k nvme8n3 2024-03-26T17:08:53.076 INFO:tasks.workunit.client.3.smithi157.stdout: 8.10 69.2k 95.6k 0.0k 692.0k 956.0k 0.0k nvme8n4 2024-03-26T17:08:53.076 INFO:tasks.workunit.client.3.smithi157.stdout: 8.20 90.0k 85.2k 0.0k 900.0k 852.0k 0.0k nvme8n5 2024-03-26T17:08:53.076 INFO:tasks.workunit.client.3.smithi157.stdout: 8.20 77.6k 88.4k 0.0k 776.0k 884.0k 0.0k nvme8n6 2024-03-26T17:08:53.077 INFO:tasks.workunit.client.3.smithi157.stdout: 8.20 94.0k 70.4k 0.0k 940.0k 704.0k 0.0k nvme8n7 2024-03-26T17:08:53.077 INFO:tasks.workunit.client.3.smithi157.stdout: 8.20 94.4k 73.2k 0.0k 944.0k 732.0k 0.0k nvme8n8 2024-03-26T17:08:53.077 INFO:tasks.workunit.client.3.smithi157.stdout: 8.20 81.6k 101.2k 0.0k 816.0k 1012.0k 0.0k nvme8n9 2024-03-26T17:08:53.077 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:08:53.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:08:53 smithi149 ceph-mon[34678]: pgmap v692: 33 pgs: 33 active+clean; 1.0 GiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 5.1 MiB/s rd, 4.8 MiB/s wr, 503 op/s 2024-03-26T17:08:53.396 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:08:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:08:53] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:08:53.397 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:08:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:08:53] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:08:53.397 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:08:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:08:53.467 INFO:tasks.workunit.client.3.smithi157.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-26T17:08:53.467 INFO:tasks.workunit.client.3.smithi157.stdout:myimage32 5/s 3/s 114 KiB/s 85 KiB/s 2.76 ms 343.98 us 2024-03-26T17:08:53.467 INFO:tasks.workunit.client.3.smithi157.stdout:myimage23 5/s 3/s 108 KiB/s 72 KiB/s 2.25 ms 343.55 us 2024-03-26T17:08:53.467 INFO:tasks.workunit.client.3.smithi157.stdout:myimage47 5/s 3/s 80 KiB/s 92 KiB/s 2.79 ms 448.36 us 2024-03-26T17:08:53.467 INFO:tasks.workunit.client.3.smithi157.stdout:myimage15 5/s 3/s 103 KiB/s 65 KiB/s 2.23 ms 496.56 us 2024-03-26T17:08:53.467 INFO:tasks.workunit.client.3.smithi157.stdout:myimage34 5/s 3/s 86 KiB/s 61 KiB/s 2.51 ms 399.97 us 2024-03-26T17:08:53.467 INFO:tasks.workunit.client.3.smithi157.stdout:myimage6 5/s 4/s 73 KiB/s 97 KiB/s 2.66 ms 427.47 us 2024-03-26T17:08:53.467 INFO:tasks.workunit.client.3.smithi157.stdout:myimage54 5/s 4/s 97 KiB/s 99 KiB/s 2.31 ms 432.97 us 2024-03-26T17:08:53.467 INFO:tasks.workunit.client.3.smithi157.stdout:myimage13 4/s 4/s 100 KiB/s 85 KiB/s 2.42 ms 414.77 us 2024-03-26T17:08:53.467 INFO:tasks.workunit.client.3.smithi157.stdout:myimage48 4/s 4/s 80 KiB/s 66 KiB/s 2.77 ms 392.44 us 2024-03-26T17:08:53.467 INFO:tasks.workunit.client.3.smithi157.stdout:myimage8 4/s 4/s 78 KiB/s 114 KiB/s 2.89 ms 409.26 us 2024-03-26T17:08:53.467 INFO:tasks.workunit.client.3.smithi157.stdout:myimage53 4/s 4/s 94 KiB/s 102 KiB/s 2.66 ms 347.72 us 2024-03-26T17:08:53.468 INFO:tasks.workunit.client.3.smithi157.stdout:myimage30 4/s 2/s 70 KiB/s 42 KiB/s 3.49 ms 337.96 us 2024-03-26T17:08:53.468 INFO:tasks.workunit.client.3.smithi157.stdout:myimage37 4/s 3/s 99 KiB/s 52 KiB/s 2.68 ms 365.93 us 2024-03-26T17:08:53.468 INFO:tasks.workunit.client.3.smithi157.stdout:myimage9 4/s 3/s 110 KiB/s 38 KiB/s 2.78 ms 513.64 us 2024-03-26T17:08:53.468 INFO:tasks.workunit.client.3.smithi157.stdout:myimage19 4/s 3/s 108 KiB/s 58 KiB/s 2.72 ms 329.19 us 2024-03-26T17:08:53.468 INFO:tasks.workunit.client.3.smithi157.stdout:myimage21 4/s 1/s 84 KiB/s 30 KiB/s 3.08 ms 312.51 us 2024-03-26T17:08:53.468 INFO:tasks.workunit.client.3.smithi157.stdout:myimage27 4/s 3/s 82 KiB/s 44 KiB/s 2.39 ms 400.41 us 2024-03-26T17:08:53.468 INFO:tasks.workunit.client.3.smithi157.stdout:myimage43 4/s 3/s 107 KiB/s 91 KiB/s 2.74 ms 375.14 us 2024-03-26T17:08:53.468 INFO:tasks.workunit.client.3.smithi157.stdout:myimage57 4/s 3/s 94 KiB/s 86 KiB/s 2.77 ms 352.49 us 2024-03-26T17:08:53.468 INFO:tasks.workunit.client.3.smithi157.stdout:myimage35 4/s 4/s 91 KiB/s 86 KiB/s 2.66 ms 398.69 us 2024-03-26T17:08:53.468 INFO:tasks.workunit.client.3.smithi157.stdout:myimage40 4/s 2/s 110 KiB/s 48 KiB/s 2.42 ms 344.95 us 2024-03-26T17:08:53.468 INFO:tasks.workunit.client.3.smithi157.stdout:myimage49 4/s 4/s 99 KiB/s 80 KiB/s 2.76 ms 324.77 us 2024-03-26T17:08:53.468 INFO:tasks.workunit.client.3.smithi157.stdout:myimage25 4/s 3/s 65 KiB/s 100 KiB/s 3.14 ms 364.70 us 2024-03-26T17:08:53.468 INFO:tasks.workunit.client.3.smithi157.stdout:myimage33 4/s 4/s 96 KiB/s 86 KiB/s 2.60 ms 309.41 us 2024-03-26T17:08:53.469 INFO:tasks.workunit.client.3.smithi157.stdout:myimage2 4/s 3/s 117 KiB/s 63 KiB/s 2.96 ms 378.21 us 2024-03-26T17:08:53.469 INFO:tasks.workunit.client.3.smithi157.stdout:myimage58 4/s 4/s 68 KiB/s 106 KiB/s 2.46 ms 377.82 us 2024-03-26T17:08:53.469 INFO:tasks.workunit.client.3.smithi157.stdout:myimage4 4/s 4/s 61 KiB/s 102 KiB/s 2.42 ms 460.17 us 2024-03-26T17:08:53.469 INFO:tasks.workunit.client.3.smithi157.stdout:myimage5 4/s 4/s 90 KiB/s 82 KiB/s 2.60 ms 344.98 us 2024-03-26T17:08:53.469 INFO:tasks.workunit.client.3.smithi157.stdout:myimage18 4/s 3/s 74 KiB/s 62 KiB/s 2.41 ms 332.76 us 2024-03-26T17:08:53.469 INFO:tasks.workunit.client.3.smithi157.stdout:myimage20 4/s 4/s 82 KiB/s 79 KiB/s 2.35 ms 350.84 us 2024-03-26T17:08:53.469 INFO:tasks.workunit.client.3.smithi157.stdout:myimage28 4/s 4/s 100 KiB/s 75 KiB/s 3.41 ms 328.49 us 2024-03-26T17:08:53.469 INFO:tasks.workunit.client.3.smithi157.stdout:myimage60 4/s 3/s 66 KiB/s 94 KiB/s 2.97 ms 364.32 us 2024-03-26T17:08:53.469 INFO:tasks.workunit.client.3.smithi157.stdout:myimage14 4/s 5/s 75 KiB/s 92 KiB/s 2.68 ms 356.30 us 2024-03-26T17:08:53.469 INFO:tasks.workunit.client.3.smithi157.stdout:myimage44 4/s 4/s 82 KiB/s 76 KiB/s 2.60 ms 312.86 us 2024-03-26T17:08:53.469 INFO:tasks.workunit.client.3.smithi157.stdout:myimage52 4/s 4/s 58 KiB/s 87 KiB/s 2.86 ms 385.69 us 2024-03-26T17:08:53.469 INFO:tasks.workunit.client.3.smithi157.stdout:myimage26 4/s 3/s 82 KiB/s 89 KiB/s 2.69 ms 360.80 us 2024-03-26T17:08:53.469 INFO:tasks.workunit.client.3.smithi157.stdout:myimage41 4/s 3/s 90 KiB/s 63 KiB/s 2.74 ms 330.30 us 2024-03-26T17:08:53.469 INFO:tasks.workunit.client.3.smithi157.stdout:myimage45 4/s 3/s 85 KiB/s 88 KiB/s 2.45 ms 364.01 us 2024-03-26T17:08:53.469 INFO:tasks.workunit.client.3.smithi157.stdout:myimage50 4/s 3/s 90 KiB/s 60 KiB/s 2.69 ms 320.06 us 2024-03-26T17:08:53.470 INFO:tasks.workunit.client.3.smithi157.stdout:myimage31 3/s 4/s 66 KiB/s 68 KiB/s 2.63 ms 350.67 us 2024-03-26T17:08:53.470 INFO:tasks.workunit.client.3.smithi157.stdout:myimage11 3/s 4/s 108 KiB/s 94 KiB/s 2.99 ms 352.41 us 2024-03-26T17:08:53.470 INFO:tasks.workunit.client.3.smithi157.stdout:myimage39 3/s 4/s 58 KiB/s 61 KiB/s 2.31 ms 334.12 us 2024-03-26T17:08:53.470 INFO:tasks.workunit.client.3.smithi157.stdout:myimage42 3/s 5/s 86 KiB/s 104 KiB/s 2.57 ms 346.90 us 2024-03-26T17:08:53.470 INFO:tasks.workunit.client.3.smithi157.stdout:myimage51 3/s 2/s 66 KiB/s 54 KiB/s 3.04 ms 320.61 us 2024-03-26T17:08:53.470 INFO:tasks.workunit.client.3.smithi157.stdout:myimage22 3/s 3/s 70 KiB/s 56 KiB/s 2.45 ms 349.11 us 2024-03-26T17:08:53.470 INFO:tasks.workunit.client.3.smithi157.stdout:myimage38 3/s 5/s 63 KiB/s 118 KiB/s 2.00 ms 315.43 us 2024-03-26T17:08:53.470 INFO:tasks.workunit.client.3.smithi157.stdout:myimage17 3/s 4/s 73 KiB/s 125 KiB/s 2.66 ms 400.52 us 2024-03-26T17:08:53.470 INFO:tasks.workunit.client.3.smithi157.stdout:myimage24 3/s 3/s 91 KiB/s 48 KiB/s 2.59 ms 299.53 us 2024-03-26T17:08:53.470 INFO:tasks.workunit.client.3.smithi157.stdout:myimage10 3/s 3/s 70 KiB/s 46 KiB/s 2.47 ms 322.09 us 2024-03-26T17:08:53.470 INFO:tasks.workunit.client.3.smithi157.stdout:myimage3 3/s 4/s 54 KiB/s 88 KiB/s 2.26 ms 377.35 us 2024-03-26T17:08:53.470 INFO:tasks.workunit.client.3.smithi157.stdout:myimage16 3/s 4/s 62 KiB/s 90 KiB/s 2.89 ms 470.32 us 2024-03-26T17:08:53.470 INFO:tasks.workunit.client.3.smithi157.stdout:myimage1 3/s 5/s 66 KiB/s 119 KiB/s 2.37 ms 367.52 us 2024-03-26T17:08:53.470 INFO:tasks.workunit.client.3.smithi157.stdout:myimage7 3/s 5/s 62 KiB/s 90 KiB/s 2.80 ms 395.93 us 2024-03-26T17:08:53.470 INFO:tasks.workunit.client.3.smithi157.stdout:myimage12 3/s 4/s 74 KiB/s 104 KiB/s 2.89 ms 366.17 us 2024-03-26T17:08:53.471 INFO:tasks.workunit.client.3.smithi157.stdout:myimage46 3/s 5/s 72 KiB/s 114 KiB/s 2.55 ms 312.28 us 2024-03-26T17:08:53.471 INFO:tasks.workunit.client.3.smithi157.stdout:myimage29 3/s 5/s 71 KiB/s 97 KiB/s 2.44 ms 350.50 us 2024-03-26T17:08:53.471 INFO:tasks.workunit.client.3.smithi157.stdout:myimage56 3/s 4/s 84 KiB/s 93 KiB/s 2.96 ms 337.93 us 2024-03-26T17:08:53.471 INFO:tasks.workunit.client.3.smithi157.stdout:myimage59 3/s 4/s 49 KiB/s 89 KiB/s 2.73 ms 439.52 us 2024-03-26T17:08:53.471 INFO:tasks.workunit.client.3.smithi157.stdout:myimage36 3/s 4/s 58 KiB/s 83 KiB/s 2.52 ms 497.84 us 2024-03-26T17:08:53.471 INFO:tasks.workunit.client.3.smithi157.stdout:myimage55 3/s 5/s 59 KiB/s 134 KiB/s 2.65 ms 339.23 us 2024-03-26T17:08:53.471 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:08:53.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:08:53 smithi044 ceph-mon[30624]: pgmap v692: 33 pgs: 33 active+clean; 1.0 GiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 5.1 MiB/s rd, 4.8 MiB/s wr, 503 op/s 2024-03-26T17:08:53.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:08:53 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:08:53] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:08:53.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:08:53 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:08:53] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:08:53.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:08:53 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:08:53.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:08:53 smithi064 ceph-mon[34420]: pgmap v692: 33 pgs: 33 active+clean; 1.0 GiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 5.1 MiB/s rd, 4.8 MiB/s wr, 503 op/s 2024-03-26T17:08:54.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:08:54 smithi149 ceph-mon[34678]: Health check update: 3 slow ops, oldest one blocked for 628 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:08:54.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:08:54 smithi044 ceph-mon[30624]: Health check update: 3 slow ops, oldest one blocked for 628 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:08:54.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:08:54 smithi064 ceph-mon[34420]: Health check update: 3 slow ops, oldest one blocked for 628 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:08:55.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:08:55 smithi149 ceph-mon[34678]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:08:55.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:08:55 smithi149 ceph-mon[34678]: { 2024-03-26T17:08:55.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:08:55 smithi149 ceph-mon[34678]: "prefix": "rbd perf image stats", 2024-03-26T17:08:55.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:08:55 smithi149 ceph-mon[34678]: "pool_spec": "mypool", 2024-03-26T17:08:55.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:08:55 smithi149 ceph-mon[34678]: "sort_by": "write_ops", 2024-03-26T17:08:55.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:08:55 smithi149 ceph-mon[34678]: "format": "json" 2024-03-26T17:08:55.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:08:55 smithi149 ceph-mon[34678]: }"]: dispatch 2024-03-26T17:08:55.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:08:55 smithi149 ceph-mon[34678]: pgmap v693: 33 pgs: 33 active+clean; 1.0 GiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 5.0 MiB/s rd, 5.1 MiB/s wr, 516 op/s 2024-03-26T17:08:55.397 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:08:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:08:55] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:08:55.397 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:08:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:08:55] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:08:55.397 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:08:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:08:55.416 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:08:55 smithi044 ceph-mon[30624]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:08:55.416 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:08:55 smithi044 ceph-mon[30624]: { 2024-03-26T17:08:55.416 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:08:55 smithi044 ceph-mon[30624]: "prefix": "rbd perf image stats", 2024-03-26T17:08:55.416 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:08:55 smithi044 ceph-mon[30624]: "pool_spec": "mypool", 2024-03-26T17:08:55.416 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:08:55 smithi044 ceph-mon[30624]: "sort_by": "write_ops", 2024-03-26T17:08:55.416 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:08:55 smithi044 ceph-mon[30624]: "format": "json" 2024-03-26T17:08:55.416 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:08:55 smithi044 ceph-mon[30624]: }"]: dispatch 2024-03-26T17:08:55.416 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:08:55 smithi044 ceph-mon[30624]: pgmap v693: 33 pgs: 33 active+clean; 1.0 GiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 5.0 MiB/s rd, 5.1 MiB/s wr, 516 op/s 2024-03-26T17:08:55.417 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:08:55 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:08:55] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:08:55.417 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:08:55 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:08:55] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:08:55.417 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:08:55 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:08:55.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:08:55 smithi064 ceph-mon[34420]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:08:55.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:08:55 smithi064 ceph-mon[34420]: { 2024-03-26T17:08:55.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:08:55 smithi064 ceph-mon[34420]: "prefix": "rbd perf image stats", 2024-03-26T17:08:55.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:08:55 smithi064 ceph-mon[34420]: "pool_spec": "mypool", 2024-03-26T17:08:55.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:08:55 smithi064 ceph-mon[34420]: "sort_by": "write_ops", 2024-03-26T17:08:55.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:08:55 smithi064 ceph-mon[34420]: "format": "json" 2024-03-26T17:08:55.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:08:55 smithi064 ceph-mon[34420]: }"]: dispatch 2024-03-26T17:08:55.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:08:55 smithi064 ceph-mon[34420]: pgmap v693: 33 pgs: 33 active+clean; 1.0 GiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 5.0 MiB/s rd, 5.1 MiB/s wr, 516 op/s 2024-03-26T17:08:56.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:08:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 2024-03-26T17:08:56.236+0000 7fa707a55700 -1 mon.c@1(peon) e3 get_health_metrics reporting 3 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T17:08:57.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:08:57 smithi149 ceph-mon[34678]: pgmap v694: 33 pgs: 33 active+clean; 1.0 GiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 4.8 MiB/s rd, 4.8 MiB/s wr, 500 op/s 2024-03-26T17:08:57.396 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:08:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:08:57] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:08:57.397 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:08:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:08:57] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:08:57.397 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:08:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:08:57.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:08:57 smithi044 ceph-mon[30624]: pgmap v694: 33 pgs: 33 active+clean; 1.0 GiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 4.8 MiB/s rd, 4.8 MiB/s wr, 500 op/s 2024-03-26T17:08:57.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:08:57 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:08:57] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:08:57.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:08:57 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:08:57] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:08:57.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:08:57 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:08:57.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:08:57 smithi064 ceph-mon[34420]: pgmap v694: 33 pgs: 33 active+clean; 1.0 GiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 4.8 MiB/s rd, 4.8 MiB/s wr, 500 op/s 2024-03-26T17:08:58.471 INFO:tasks.workunit.client.3.smithi157.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-26T17:08:58.471 INFO:tasks.workunit.client.3.smithi157.stdout:myimage30 6/s 2/s 119 KiB/s 38 KiB/s 3.40 ms 342.81 us 2024-03-26T17:08:58.471 INFO:tasks.workunit.client.3.smithi157.stdout:myimage38 5/s 2/s 112 KiB/s 58 KiB/s 2.16 ms 308.83 us 2024-03-26T17:08:58.471 INFO:tasks.workunit.client.3.smithi157.stdout:myimage55 5/s 3/s 133 KiB/s 52 KiB/s 2.73 ms 288.11 us 2024-03-26T17:08:58.471 INFO:tasks.workunit.client.3.smithi157.stdout:myimage7 5/s 2/s 138 KiB/s 70 KiB/s 2.61 ms 352.83 us 2024-03-26T17:08:58.471 INFO:tasks.workunit.client.3.smithi157.stdout:myimage42 5/s 2/s 121 KiB/s 66 KiB/s 2.55 ms 353.46 us 2024-03-26T17:08:58.472 INFO:tasks.workunit.client.3.smithi157.stdout:myimage48 5/s 3/s 114 KiB/s 61 KiB/s 2.65 ms 432.55 us 2024-03-26T17:08:58.472 INFO:tasks.workunit.client.3.smithi157.stdout:myimage58 5/s 2/s 90 KiB/s 55 KiB/s 2.26 ms 477.33 us 2024-03-26T17:08:58.472 INFO:tasks.workunit.client.3.smithi157.stdout:myimage9 5/s 4/s 106 KiB/s 68 KiB/s 2.68 ms 325.41 us 2024-03-26T17:08:58.472 INFO:tasks.workunit.client.3.smithi157.stdout:myimage25 5/s 5/s 93 KiB/s 101 KiB/s 3.24 ms 323.78 us 2024-03-26T17:08:58.472 INFO:tasks.workunit.client.3.smithi157.stdout:myimage26 5/s 3/s 94 KiB/s 68 KiB/s 2.71 ms 358.54 us 2024-03-26T17:08:58.472 INFO:tasks.workunit.client.3.smithi157.stdout:myimage39 5/s 4/s 113 KiB/s 82 KiB/s 2.60 ms 387.00 us 2024-03-26T17:08:58.472 INFO:tasks.workunit.client.3.smithi157.stdout:myimage51 5/s 4/s 109 KiB/s 74 KiB/s 2.71 ms 405.58 us 2024-03-26T17:08:58.472 INFO:tasks.workunit.client.3.smithi157.stdout:myimage60 5/s 3/s 78 KiB/s 70 KiB/s 2.70 ms 378.11 us 2024-03-26T17:08:58.472 INFO:tasks.workunit.client.3.smithi157.stdout:myimage2 4/s 4/s 102 KiB/s 92 KiB/s 2.66 ms 333.70 us 2024-03-26T17:08:58.472 INFO:tasks.workunit.client.3.smithi157.stdout:myimage44 4/s 2/s 121 KiB/s 59 KiB/s 2.56 ms 326.12 us 2024-03-26T17:08:58.472 INFO:tasks.workunit.client.3.smithi157.stdout:myimage19 4/s 5/s 82 KiB/s 118 KiB/s 2.70 ms 323.38 us 2024-03-26T17:08:58.472 INFO:tasks.workunit.client.3.smithi157.stdout:myimage59 4/s 4/s 86 KiB/s 79 KiB/s 2.84 ms 326.61 us 2024-03-26T17:08:58.472 INFO:tasks.workunit.client.3.smithi157.stdout:myimage23 4/s 4/s 88 KiB/s 64 KiB/s 2.17 ms 313.12 us 2024-03-26T17:08:58.472 INFO:tasks.workunit.client.3.smithi157.stdout:myimage12 4/s 3/s 102 KiB/s 72 KiB/s 2.71 ms 388.09 us 2024-03-26T17:08:58.473 INFO:tasks.workunit.client.3.smithi157.stdout:myimage57 4/s 3/s 65 KiB/s 82 KiB/s 2.52 ms 475.45 us 2024-03-26T17:08:58.473 INFO:tasks.workunit.client.3.smithi157.stdout:myimage16 4/s 3/s 94 KiB/s 70 KiB/s 2.73 ms 327.39 us 2024-03-26T17:08:58.473 INFO:tasks.workunit.client.3.smithi157.stdout:myimage31 4/s 4/s 76 KiB/s 76 KiB/s 2.53 ms 330.57 us 2024-03-26T17:08:58.473 INFO:tasks.workunit.client.3.smithi157.stdout:myimage47 4/s 4/s 67 KiB/s 72 KiB/s 2.74 ms 335.96 us 2024-03-26T17:08:58.473 INFO:tasks.workunit.client.3.smithi157.stdout:myimage18 4/s 4/s 71 KiB/s 92 KiB/s 2.65 ms 314.90 us 2024-03-26T17:08:58.473 INFO:tasks.workunit.client.3.smithi157.stdout:myimage29 4/s 3/s 66 KiB/s 84 KiB/s 2.50 ms 365.68 us 2024-03-26T17:08:58.473 INFO:tasks.workunit.client.3.smithi157.stdout:myimage56 4/s 2/s 53 KiB/s 53 KiB/s 3.49 ms 293.09 us 2024-03-26T17:08:58.473 INFO:tasks.workunit.client.3.smithi157.stdout:myimage14 4/s 3/s 86 KiB/s 41 KiB/s 2.95 ms 344.28 us 2024-03-26T17:08:58.473 INFO:tasks.workunit.client.3.smithi157.stdout:myimage35 4/s 4/s 86 KiB/s 82 KiB/s 2.70 ms 370.38 us 2024-03-26T17:08:58.473 INFO:tasks.workunit.client.3.smithi157.stdout:myimage52 4/s 3/s 86 KiB/s 87 KiB/s 3.13 ms 323.71 us 2024-03-26T17:08:58.473 INFO:tasks.workunit.client.3.smithi157.stdout:myimage24 4/s 5/s 84 KiB/s 103 KiB/s 2.84 ms 337.55 us 2024-03-26T17:08:58.474 INFO:tasks.workunit.client.3.smithi157.stdout:myimage36 4/s 4/s 94 KiB/s 74 KiB/s 2.55 ms 324.69 us 2024-03-26T17:08:58.474 INFO:tasks.workunit.client.3.smithi157.stdout:myimage45 4/s 4/s 82 KiB/s 80 KiB/s 2.66 ms 308.16 us 2024-03-26T17:08:58.474 INFO:tasks.workunit.client.3.smithi157.stdout:myimage53 4/s 4/s 94 KiB/s 96 KiB/s 2.57 ms 304.75 us 2024-03-26T17:08:58.474 INFO:tasks.workunit.client.3.smithi157.stdout:myimage10 4/s 4/s 54 KiB/s 61 KiB/s 2.53 ms 312.13 us 2024-03-26T17:08:58.474 INFO:tasks.workunit.client.3.smithi157.stdout:myimage32 4/s 3/s 78 KiB/s 58 KiB/s 2.75 ms 320.57 us 2024-03-26T17:08:58.474 INFO:tasks.workunit.client.3.smithi157.stdout:myimage40 4/s 4/s 66 KiB/s 106 KiB/s 2.47 ms 452.53 us 2024-03-26T17:08:58.475 INFO:tasks.workunit.client.3.smithi157.stdout:myimage21 4/s 4/s 77 KiB/s 95 KiB/s 3.31 ms 345.84 us 2024-03-26T17:08:58.475 INFO:tasks.workunit.client.3.smithi157.stdout:myimage3 3/s 4/s 61 KiB/s 93 KiB/s 2.40 ms 359.67 us 2024-03-26T17:08:58.475 INFO:tasks.workunit.client.3.smithi157.stdout:myimage13 3/s 4/s 78 KiB/s 74 KiB/s 2.36 ms 330.08 us 2024-03-26T17:08:58.475 INFO:tasks.workunit.client.3.smithi157.stdout:myimage37 3/s 3/s 65 KiB/s 64 KiB/s 2.77 ms 397.71 us 2024-03-26T17:08:58.475 INFO:tasks.workunit.client.3.smithi157.stdout:myimage49 3/s 4/s 102 KiB/s 110 KiB/s 2.59 ms 342.12 us 2024-03-26T17:08:58.475 INFO:tasks.workunit.client.3.smithi157.stdout:myimage11 3/s 3/s 91 KiB/s 76 KiB/s 2.70 ms 305.55 us 2024-03-26T17:08:58.475 INFO:tasks.workunit.client.3.smithi157.stdout:myimage15 3/s 3/s 47 KiB/s 99 KiB/s 2.51 ms 327.96 us 2024-03-26T17:08:58.475 INFO:tasks.workunit.client.3.smithi157.stdout:myimage17 3/s 5/s 104 KiB/s 86 KiB/s 2.54 ms 341.86 us 2024-03-26T17:08:58.476 INFO:tasks.workunit.client.3.smithi157.stdout:myimage46 3/s 3/s 86 KiB/s 90 KiB/s 2.41 ms 410.48 us 2024-03-26T17:08:58.476 INFO:tasks.workunit.client.3.smithi157.stdout:myimage50 3/s 5/s 79 KiB/s 111 KiB/s 2.63 ms 368.15 us 2024-03-26T17:08:58.476 INFO:tasks.workunit.client.3.smithi157.stdout:myimage22 3/s 5/s 59 KiB/s 91 KiB/s 2.76 ms 325.05 us 2024-03-26T17:08:58.476 INFO:tasks.workunit.client.3.smithi157.stdout:myimage1 3/s 5/s 37 KiB/s 90 KiB/s 2.24 ms 311.84 us 2024-03-26T17:08:58.476 INFO:tasks.workunit.client.3.smithi157.stdout:myimage4 3/s 5/s 73 KiB/s 86 KiB/s 2.43 ms 331.32 us 2024-03-26T17:08:58.477 INFO:tasks.workunit.client.3.smithi157.stdout:myimage8 3/s 3/s 67 KiB/s 69 KiB/s 2.91 ms 397.57 us 2024-03-26T17:08:58.477 INFO:tasks.workunit.client.3.smithi157.stdout:myimage43 3/s 4/s 58 KiB/s 78 KiB/s 2.96 ms 364.75 us 2024-03-26T17:08:58.477 INFO:tasks.workunit.client.3.smithi157.stdout:myimage20 3/s 4/s 94 KiB/s 79 KiB/s 2.37 ms 318.62 us 2024-03-26T17:08:58.477 INFO:tasks.workunit.client.3.smithi157.stdout:myimage28 3/s 4/s 78 KiB/s 75 KiB/s 3.22 ms 336.23 us 2024-03-26T17:08:58.477 INFO:tasks.workunit.client.3.smithi157.stdout:myimage33 3/s 4/s 78 KiB/s 102 KiB/s 2.79 ms 594.23 us 2024-03-26T17:08:58.477 INFO:tasks.workunit.client.3.smithi157.stdout:myimage34 3/s 4/s 76 KiB/s 95 KiB/s 2.77 ms 335.86 us 2024-03-26T17:08:58.478 INFO:tasks.workunit.client.3.smithi157.stdout:myimage5 3/s 4/s 62 KiB/s 88 KiB/s 2.57 ms 328.32 us 2024-03-26T17:08:58.478 INFO:tasks.workunit.client.3.smithi157.stdout:myimage6 3/s 4/s 53 KiB/s 87 KiB/s 2.95 ms 317.29 us 2024-03-26T17:08:58.478 INFO:tasks.workunit.client.3.smithi157.stdout:myimage27 3/s 4/s 56 KiB/s 67 KiB/s 2.18 ms 338.24 us 2024-03-26T17:08:58.478 INFO:tasks.workunit.client.3.smithi157.stdout:myimage41 3/s 4/s 75 KiB/s 100 KiB/s 2.59 ms 344.91 us 2024-03-26T17:08:58.478 INFO:tasks.workunit.client.3.smithi157.stdout:myimage54 3/s 2/s 50 KiB/s 53 KiB/s 2.43 ms 347.47 us 2024-03-26T17:08:58.478 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:08:59.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:08:59 smithi149 ceph-mon[34678]: pgmap v695: 33 pgs: 33 active+clean; 1.0 GiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 4.5 MiB/s rd, 4.5 MiB/s wr, 470 op/s 2024-03-26T17:08:59.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:08:59 smithi149 ceph-mon[34678]: Health check update: 3 slow ops, oldest one blocked for 633 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:08:59.396 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:08:59 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:08:59] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:08:59.396 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:08:59 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:08:59] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:08:59.397 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:08:59 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:08:59.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:08:59 smithi044 ceph-mon[30624]: pgmap v695: 33 pgs: 33 active+clean; 1.0 GiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 4.5 MiB/s rd, 4.5 MiB/s wr, 470 op/s 2024-03-26T17:08:59.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:08:59 smithi044 ceph-mon[30624]: Health check update: 3 slow ops, oldest one blocked for 633 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:08:59.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:08:59 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:08:59] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:08:59.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:08:59 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:08:59] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:08:59.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:08:59 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:08:59.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:08:59 smithi064 ceph-mon[34420]: pgmap v695: 33 pgs: 33 active+clean; 1.0 GiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 4.5 MiB/s rd, 4.5 MiB/s wr, 470 op/s 2024-03-26T17:08:59.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:08:59 smithi064 ceph-mon[34420]: Health check update: 3 slow ops, oldest one blocked for 633 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:09:00.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:09:00 smithi044 ceph-mon[30624]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:09:00.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:09:00 smithi044 ceph-mon[30624]: { 2024-03-26T17:09:00.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:09:00 smithi044 ceph-mon[30624]: "prefix": "rbd perf image stats", 2024-03-26T17:09:00.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:09:00 smithi044 ceph-mon[30624]: "pool_spec": "mypool", 2024-03-26T17:09:00.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:09:00 smithi044 ceph-mon[30624]: "sort_by": "write_ops", 2024-03-26T17:09:00.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:09:00 smithi044 ceph-mon[30624]: "format": "json" 2024-03-26T17:09:00.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:09:00 smithi044 ceph-mon[30624]: }"]: dispatch 2024-03-26T17:09:00.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:09:00 smithi064 ceph-mon[34420]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:09:00.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:09:00 smithi064 ceph-mon[34420]: { 2024-03-26T17:09:00.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:09:00 smithi064 ceph-mon[34420]: "prefix": "rbd perf image stats", 2024-03-26T17:09:00.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:09:00 smithi064 ceph-mon[34420]: "pool_spec": "mypool", 2024-03-26T17:09:00.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:09:00 smithi064 ceph-mon[34420]: "sort_by": "write_ops", 2024-03-26T17:09:00.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:09:00 smithi064 ceph-mon[34420]: "format": "json" 2024-03-26T17:09:00.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:09:00 smithi064 ceph-mon[34420]: }"]: dispatch 2024-03-26T17:09:00.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:09:00 smithi149 ceph-mon[34678]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:09:00.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:09:00 smithi149 ceph-mon[34678]: { 2024-03-26T17:09:00.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:09:00 smithi149 ceph-mon[34678]: "prefix": "rbd perf image stats", 2024-03-26T17:09:00.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:09:00 smithi149 ceph-mon[34678]: "pool_spec": "mypool", 2024-03-26T17:09:00.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:09:00 smithi149 ceph-mon[34678]: "sort_by": "write_ops", 2024-03-26T17:09:00.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:09:00 smithi149 ceph-mon[34678]: "format": "json" 2024-03-26T17:09:00.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:09:00 smithi149 ceph-mon[34678]: }"]: dispatch 2024-03-26T17:09:01.417 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:09:01 smithi044 ceph-mon[30624]: pgmap v696: 33 pgs: 33 active+clean; 1.0 GiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 4.8 MiB/s rd, 4.9 MiB/s wr, 504 op/s 2024-03-26T17:09:01.417 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:09:01 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:09:01] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:09:01.417 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:09:01 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:09:01] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:09:01.417 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:09:01 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:09:01.547 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:09:01 smithi149 ceph-mon[34678]: pgmap v696: 33 pgs: 33 active+clean; 1.0 GiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 4.8 MiB/s rd, 4.9 MiB/s wr, 504 op/s 2024-03-26T17:09:01.547 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:09:01 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 2024-03-26T17:09:01.237+0000 7fa707a55700 -1 mon.c@1(peon) e3 get_health_metrics reporting 3 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T17:09:01.548 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:09:01 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:09:01] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:09:01.548 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:09:01 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:09:01] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:09:01.548 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:09:01 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:09:01.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:09:01 smithi064 ceph-mon[34420]: pgmap v696: 33 pgs: 33 active+clean; 1.0 GiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 4.8 MiB/s rd, 4.9 MiB/s wr, 504 op/s 2024-03-26T17:09:03.062 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:09:03.073 INFO:tasks.workunit.client.3.smithi157.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2024-03-26T17:09:03.073 INFO:tasks.workunit.client.3.smithi157.stdout: 8.30 97.2k 124.8k 0.0k 972.0k 1.2M 0.0k nvme2n1 2024-03-26T17:09:03.073 INFO:tasks.workunit.client.3.smithi157.stdout: 8.20 66.8k 63.6k 0.0k 668.0k 636.0k 0.0k nvme2n10 2024-03-26T17:09:03.073 INFO:tasks.workunit.client.3.smithi157.stdout: 8.20 86.8k 77.6k 0.0k 868.0k 776.0k 0.0k nvme2n11 2024-03-26T17:09:03.073 INFO:tasks.workunit.client.3.smithi157.stdout: 8.20 79.2k 76.0k 0.0k 792.0k 760.0k 0.0k nvme2n12 2024-03-26T17:09:03.073 INFO:tasks.workunit.client.3.smithi157.stdout: 8.20 68.4k 68.4k 0.0k 684.0k 684.0k 0.0k nvme2n13 2024-03-26T17:09:03.073 INFO:tasks.workunit.client.3.smithi157.stdout: 8.20 72.0k 92.0k 0.0k 720.0k 920.0k 0.0k nvme2n14 2024-03-26T17:09:03.073 INFO:tasks.workunit.client.3.smithi157.stdout: 8.20 78.8k 68.4k 0.0k 788.0k 684.0k 0.0k nvme2n15 2024-03-26T17:09:03.073 INFO:tasks.workunit.client.3.smithi157.stdout: 8.20 71.2k 86.0k 0.0k 712.0k 860.0k 0.0k nvme2n16 2024-03-26T17:09:03.073 INFO:tasks.workunit.client.3.smithi157.stdout: 8.20 77.2k 88.8k 0.0k 772.0k 888.0k 0.0k nvme2n17 2024-03-26T17:09:03.073 INFO:tasks.workunit.client.3.smithi157.stdout: 8.20 69.6k 107.6k 0.0k 696.0k 1.1M 0.0k nvme2n18 2024-03-26T17:09:03.074 INFO:tasks.workunit.client.3.smithi157.stdout: 8.20 82.8k 68.4k 0.0k 828.0k 684.0k 0.0k nvme2n19 2024-03-26T17:09:03.074 INFO:tasks.workunit.client.3.smithi157.stdout: 8.30 72.0k 80.4k 0.0k 720.0k 804.0k 0.0k nvme2n2 2024-03-26T17:09:03.074 INFO:tasks.workunit.client.3.smithi157.stdout: 8.20 107.2k 128.0k 0.0k 1.0M 1.2M 0.0k nvme2n20 2024-03-26T17:09:03.074 INFO:tasks.workunit.client.3.smithi157.stdout: 8.20 92.8k 59.2k 0.0k 928.0k 592.0k 0.0k nvme2n3 2024-03-26T17:09:03.074 INFO:tasks.workunit.client.3.smithi157.stdout: 8.20 95.6k 66.8k 0.0k 956.0k 668.0k 0.0k nvme2n4 2024-03-26T17:09:03.074 INFO:tasks.workunit.client.3.smithi157.stdout: 8.20 83.2k 70.4k 0.0k 832.0k 704.0k 0.0k nvme2n5 2024-03-26T17:09:03.074 INFO:tasks.workunit.client.3.smithi157.stdout: 8.20 94.0k 84.4k 0.0k 940.0k 844.0k 0.0k nvme2n6 2024-03-26T17:09:03.074 INFO:tasks.workunit.client.3.smithi157.stdout: 8.20 134.8k 125.2k 0.0k 1.3M 1.2M 0.0k nvme2n7 2024-03-26T17:09:03.074 INFO:tasks.workunit.client.3.smithi157.stdout: 8.20 62.0k 85.6k 0.0k 620.0k 856.0k 0.0k nvme2n8 2024-03-26T17:09:03.074 INFO:tasks.workunit.client.3.smithi157.stdout: 8.20 36.8k 114.8k 0.0k 368.0k 1.1M 0.0k nvme2n9 2024-03-26T17:09:03.074 INFO:tasks.workunit.client.3.smithi157.stdout: 8.20 120.0k 98.0k 0.0k 1.2M 980.0k 0.0k nvme5n1 2024-03-26T17:09:03.074 INFO:tasks.workunit.client.3.smithi157.stdout: 8.20 56.4k 91.2k 0.0k 564.0k 912.0k 0.0k nvme5n10 2024-03-26T17:09:03.075 INFO:tasks.workunit.client.3.smithi157.stdout: 8.20 88.4k 76.8k 0.0k 884.0k 768.0k 0.0k nvme5n11 2024-03-26T17:09:03.075 INFO:tasks.workunit.client.3.smithi157.stdout: 8.20 72.0k 88.0k 0.0k 720.0k 880.0k 0.0k nvme5n12 2024-03-26T17:09:03.075 INFO:tasks.workunit.client.3.smithi157.stdout: 8.20 87.6k 75.6k 0.0k 876.0k 756.0k 0.0k nvme5n13 2024-03-26T17:09:03.075 INFO:tasks.workunit.client.3.smithi157.stdout: 8.20 86.0k 92.8k 0.0k 860.0k 928.0k 0.0k nvme5n14 2024-03-26T17:09:03.075 INFO:tasks.workunit.client.3.smithi157.stdout: 8.20 94.0k 76.4k 0.0k 940.0k 764.0k 0.0k nvme5n15 2024-03-26T17:09:03.075 INFO:tasks.workunit.client.3.smithi157.stdout: 8.20 91.2k 76.0k 0.0k 912.0k 760.0k 0.0k nvme5n16 2024-03-26T17:09:03.075 INFO:tasks.workunit.client.3.smithi157.stdout: 8.20 56.4k 78.4k 0.0k 564.0k 784.0k 0.0k nvme5n17 2024-03-26T17:09:03.075 INFO:tasks.workunit.client.3.smithi157.stdout: 8.20 77.2k 72.0k 0.0k 772.0k 720.0k 0.0k nvme5n18 2024-03-26T17:09:03.075 INFO:tasks.workunit.client.3.smithi157.stdout: 8.20 97.2k 89.6k 0.0k 972.0k 896.0k 0.0k nvme5n19 2024-03-26T17:09:03.075 INFO:tasks.workunit.client.3.smithi157.stdout: 8.30 65.2k 81.2k 0.0k 652.0k 812.0k 0.0k nvme5n2 2024-03-26T17:09:03.075 INFO:tasks.workunit.client.3.smithi157.stdout: 8.20 75.2k 95.6k 0.0k 752.0k 956.0k 0.0k nvme5n20 2024-03-26T17:09:03.075 INFO:tasks.workunit.client.3.smithi157.stdout: 8.30 82.0k 97.2k 0.0k 820.0k 972.0k 0.0k nvme5n3 2024-03-26T17:09:03.076 INFO:tasks.workunit.client.3.smithi157.stdout: 8.20 89.2k 71.2k 0.0k 892.0k 712.0k 0.0k nvme5n4 2024-03-26T17:09:03.076 INFO:tasks.workunit.client.3.smithi157.stdout: 8.20 66.4k 84.4k 0.0k 664.0k 844.0k 0.0k nvme5n5 2024-03-26T17:09:03.076 INFO:tasks.workunit.client.3.smithi157.stdout: 8.20 64.8k 84.4k 0.0k 648.0k 844.0k 0.0k nvme5n6 2024-03-26T17:09:03.076 INFO:tasks.workunit.client.3.smithi157.stdout: 8.20 101.6k 66.0k 0.0k 1016.0k 660.0k 0.0k nvme5n7 2024-03-26T17:09:03.076 INFO:tasks.workunit.client.3.smithi157.stdout: 8.20 77.2k 63.2k 0.0k 772.0k 632.0k 0.0k nvme5n8 2024-03-26T17:09:03.076 INFO:tasks.workunit.client.3.smithi157.stdout: 8.20 52.0k 91.6k 0.0k 520.0k 916.0k 0.0k nvme5n9 2024-03-26T17:09:03.076 INFO:tasks.workunit.client.3.smithi157.stdout: 8.30 93.6k 76.8k 0.0k 936.0k 768.0k 0.0k nvme8n1 2024-03-26T17:09:03.076 INFO:tasks.workunit.client.3.smithi157.stdout: 8.20 89.2k 68.0k 0.0k 892.0k 680.0k 0.0k nvme8n10 2024-03-26T17:09:03.076 INFO:tasks.workunit.client.3.smithi157.stdout: 8.20 84.4k 82.4k 0.0k 844.0k 824.0k 0.0k nvme8n11 2024-03-26T17:09:03.076 INFO:tasks.workunit.client.3.smithi157.stdout: 8.20 85.2k 113.2k 0.0k 852.0k 1.1M 0.0k nvme8n12 2024-03-26T17:09:03.076 INFO:tasks.workunit.client.3.smithi157.stdout: 8.20 83.6k 74.0k 0.0k 836.0k 740.0k 0.0k nvme8n13 2024-03-26T17:09:03.076 INFO:tasks.workunit.client.3.smithi157.stdout: 8.20 121.2k 86.0k 0.0k 1.2M 860.0k 0.0k nvme8n14 2024-03-26T17:09:03.076 INFO:tasks.workunit.client.3.smithi157.stdout: 8.20 63.6k 103.2k 0.0k 636.0k 1.0M 0.0k nvme8n15 2024-03-26T17:09:03.077 INFO:tasks.workunit.client.3.smithi157.stdout: 8.20 138.4k 82.8k 0.0k 1.4M 828.0k 0.0k nvme8n16 2024-03-26T17:09:03.077 INFO:tasks.workunit.client.3.smithi157.stdout: 8.20 72.0k 72.8k 0.0k 720.0k 728.0k 0.0k nvme8n17 2024-03-26T17:09:03.077 INFO:tasks.workunit.client.3.smithi157.stdout: 8.20 70.8k 89.2k 0.0k 708.0k 892.0k 0.0k nvme8n18 2024-03-26T17:09:03.077 INFO:tasks.workunit.client.3.smithi157.stdout: 8.20 86.4k 91.2k 0.0k 864.0k 912.0k 0.0k nvme8n19 2024-03-26T17:09:03.077 INFO:tasks.workunit.client.3.smithi157.stdout: 8.30 70.0k 84.0k 0.0k 700.0k 840.0k 0.0k nvme8n2 2024-03-26T17:09:03.077 INFO:tasks.workunit.client.3.smithi157.stdout: 8.20 55.6k 76.8k 0.0k 556.0k 768.0k 0.0k nvme8n20 2024-03-26T17:09:03.077 INFO:tasks.workunit.client.3.smithi157.stdout: 8.20 71.2k 91.2k 0.0k 712.0k 912.0k 0.0k nvme8n3 2024-03-26T17:09:03.077 INFO:tasks.workunit.client.3.smithi157.stdout: 8.20 82.8k 86.0k 0.0k 828.0k 860.0k 0.0k nvme8n4 2024-03-26T17:09:03.077 INFO:tasks.workunit.client.3.smithi157.stdout: 8.20 92.0k 73.6k 0.0k 920.0k 736.0k 0.0k nvme8n5 2024-03-26T17:09:03.077 INFO:tasks.workunit.client.3.smithi157.stdout: 8.20 97.2k 69.6k 0.0k 972.0k 696.0k 0.0k nvme8n6 2024-03-26T17:09:03.077 INFO:tasks.workunit.client.3.smithi157.stdout: 8.20 84.0k 84.8k 0.0k 840.0k 848.0k 0.0k nvme8n7 2024-03-26T17:09:03.077 INFO:tasks.workunit.client.3.smithi157.stdout: 8.20 68.4k 70.0k 0.0k 684.0k 700.0k 0.0k nvme8n8 2024-03-26T17:09:03.077 INFO:tasks.workunit.client.3.smithi157.stdout: 8.20 75.6k 76.0k 0.0k 756.0k 760.0k 0.0k nvme8n9 2024-03-26T17:09:03.077 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:09:03.475 INFO:tasks.workunit.client.3.smithi157.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-26T17:09:03.475 INFO:tasks.workunit.client.3.smithi157.stdout:myimage5 5/s 4/s 101 KiB/s 86 KiB/s 2.69 ms 329.47 us 2024-03-26T17:09:03.475 INFO:tasks.workunit.client.3.smithi157.stdout:myimage32 5/s 3/s 101 KiB/s 69 KiB/s 2.75 ms 359.21 us 2024-03-26T17:09:03.476 INFO:tasks.workunit.client.3.smithi157.stdout:myimage43 5/s 3/s 127 KiB/s 68 KiB/s 2.87 ms 373.62 us 2024-03-26T17:09:03.476 INFO:tasks.workunit.client.3.smithi157.stdout:myimage54 5/s 4/s 129 KiB/s 127 KiB/s 2.39 ms 433.80 us 2024-03-26T17:09:03.476 INFO:tasks.workunit.client.3.smithi157.stdout:myimage58 5/s 3/s 114 KiB/s 59 KiB/s 2.30 ms 318.00 us 2024-03-26T17:09:03.476 INFO:tasks.workunit.client.3.smithi157.stdout:myimage26 5/s 2/s 96 KiB/s 46 KiB/s 2.72 ms 298.60 us 2024-03-26T17:09:03.476 INFO:tasks.workunit.client.3.smithi157.stdout:myimage55 5/s 3/s 115 KiB/s 73 KiB/s 2.87 ms 351.35 us 2024-03-26T17:09:03.476 INFO:tasks.workunit.client.3.smithi157.stdout:myimage29 5/s 2/s 86 KiB/s 53 KiB/s 2.42 ms 323.68 us 2024-03-26T17:09:03.476 INFO:tasks.workunit.client.3.smithi157.stdout:myimage33 5/s 4/s 83 KiB/s 92 KiB/s 2.68 ms 334.70 us 2024-03-26T17:09:03.476 INFO:tasks.workunit.client.3.smithi157.stdout:myimage22 4/s 3/s 95 KiB/s 63 KiB/s 3.28 ms 291.18 us 2024-03-26T17:09:03.476 INFO:tasks.workunit.client.3.smithi157.stdout:myimage37 4/s 4/s 86 KiB/s 56 KiB/s 2.61 ms 379.08 us 2024-03-26T17:09:03.476 INFO:tasks.workunit.client.3.smithi157.stdout:myimage52 4/s 5/s 122 KiB/s 104 KiB/s 2.66 ms 319.62 us 2024-03-26T17:09:03.476 INFO:tasks.workunit.client.3.smithi157.stdout:myimage15 4/s 4/s 76 KiB/s 66 KiB/s 2.64 ms 382.09 us 2024-03-26T17:09:03.476 INFO:tasks.workunit.client.3.smithi157.stdout:myimage21 4/s 3/s 118 KiB/s 108 KiB/s 3.46 ms 462.69 us 2024-03-26T17:09:03.476 INFO:tasks.workunit.client.3.smithi157.stdout:myimage36 4/s 4/s 92 KiB/s 98 KiB/s 2.68 ms 435.81 us 2024-03-26T17:09:03.476 INFO:tasks.workunit.client.3.smithi157.stdout:myimage8 4/s 3/s 106 KiB/s 57 KiB/s 2.84 ms 306.99 us 2024-03-26T17:09:03.477 INFO:tasks.workunit.client.3.smithi157.stdout:myimage17 4/s 4/s 79 KiB/s 85 KiB/s 2.50 ms 406.01 us 2024-03-26T17:09:03.477 INFO:tasks.workunit.client.3.smithi157.stdout:myimage30 4/s 4/s 74 KiB/s 66 KiB/s 3.39 ms 343.01 us 2024-03-26T17:09:03.477 INFO:tasks.workunit.client.3.smithi157.stdout:myimage44 4/s 4/s 95 KiB/s 94 KiB/s 2.53 ms 318.85 us 2024-03-26T17:09:03.477 INFO:tasks.workunit.client.3.smithi157.stdout:myimage49 4/s 3/s 74 KiB/s 66 KiB/s 2.58 ms 363.94 us 2024-03-26T17:09:03.477 INFO:tasks.workunit.client.3.smithi157.stdout:myimage1 4/s 3/s 136 KiB/s 85 KiB/s 2.31 ms 343.53 us 2024-03-26T17:09:03.477 INFO:tasks.workunit.client.3.smithi157.stdout:myimage11 4/s 5/s 88 KiB/s 92 KiB/s 2.81 ms 415.58 us 2024-03-26T17:09:03.477 INFO:tasks.workunit.client.3.smithi157.stdout:myimage57 4/s 3/s 56 KiB/s 64 KiB/s 2.91 ms 320.75 us 2024-03-26T17:09:03.477 INFO:tasks.workunit.client.3.smithi157.stdout:myimage60 4/s 4/s 71 KiB/s 63 KiB/s 2.77 ms 287.21 us 2024-03-26T17:09:03.477 INFO:tasks.workunit.client.3.smithi157.stdout:myimage59 4/s 3/s 100 KiB/s 63 KiB/s 2.71 ms 376.15 us 2024-03-26T17:09:03.477 INFO:tasks.workunit.client.3.smithi157.stdout:myimage13 4/s 4/s 66 KiB/s 61 KiB/s 2.16 ms 338.76 us 2024-03-26T17:09:03.477 INFO:tasks.workunit.client.3.smithi157.stdout:myimage31 4/s 3/s 82 KiB/s 91 KiB/s 2.69 ms 330.29 us 2024-03-26T17:09:03.477 INFO:tasks.workunit.client.3.smithi157.stdout:myimage34 4/s 3/s 99 KiB/s 74 KiB/s 2.49 ms 310.51 us 2024-03-26T17:09:03.477 INFO:tasks.workunit.client.3.smithi157.stdout:myimage40 4/s 4/s 90 KiB/s 69 KiB/s 2.46 ms 301.18 us 2024-03-26T17:09:03.477 INFO:tasks.workunit.client.3.smithi157.stdout:myimage47 4/s 3/s 106 KiB/s 74 KiB/s 2.81 ms 321.89 us 2024-03-26T17:09:03.477 INFO:tasks.workunit.client.3.smithi157.stdout:myimage48 4/s 4/s 49 KiB/s 89 KiB/s 2.52 ms 407.32 us 2024-03-26T17:09:03.478 INFO:tasks.workunit.client.3.smithi157.stdout:myimage19 4/s 3/s 66 KiB/s 67 KiB/s 2.71 ms 368.79 us 2024-03-26T17:09:03.478 INFO:tasks.workunit.client.3.smithi157.stdout:myimage28 4/s 4/s 61 KiB/s 86 KiB/s 3.12 ms 356.76 us 2024-03-26T17:09:03.478 INFO:tasks.workunit.client.3.smithi157.stdout:myimage14 4/s 4/s 82 KiB/s 74 KiB/s 3.11 ms 329.27 us 2024-03-26T17:09:03.478 INFO:tasks.workunit.client.3.smithi157.stdout:myimage23 4/s 4/s 102 KiB/s 105 KiB/s 2.07 ms 305.47 us 2024-03-26T17:09:03.478 INFO:tasks.workunit.client.3.smithi157.stdout:myimage4 4/s 4/s 83 KiB/s 76 KiB/s 2.31 ms 545.88 us 2024-03-26T17:09:03.478 INFO:tasks.workunit.client.3.smithi157.stdout:myimage7 4/s 3/s 126 KiB/s 148 KiB/s 2.73 ms 383.75 us 2024-03-26T17:09:03.478 INFO:tasks.workunit.client.3.smithi157.stdout:myimage9 4/s 3/s 82 KiB/s 42 KiB/s 2.83 ms 328.19 us 2024-03-26T17:09:03.478 INFO:tasks.workunit.client.3.smithi157.stdout:myimage20 4/s 4/s 114 KiB/s 138 KiB/s 2.30 ms 332.33 us 2024-03-26T17:09:03.478 INFO:tasks.workunit.client.3.smithi157.stdout:myimage27 4/s 4/s 70 KiB/s 96 KiB/s 2.32 ms 332.37 us 2024-03-26T17:09:03.478 INFO:tasks.workunit.client.3.smithi157.stdout:myimage53 4/s 3/s 65 KiB/s 83 KiB/s 2.48 ms 365.00 us 2024-03-26T17:09:03.478 INFO:tasks.workunit.client.3.smithi157.stdout:myimage16 3/s 3/s 80 KiB/s 71 KiB/s 3.08 ms 347.05 us 2024-03-26T17:09:03.478 INFO:tasks.workunit.client.3.smithi157.stdout:myimage12 3/s 4/s 68 KiB/s 90 KiB/s 2.59 ms 343.12 us 2024-03-26T17:09:03.478 INFO:tasks.workunit.client.3.smithi157.stdout:myimage18 3/s 3/s 90 KiB/s 54 KiB/s 2.66 ms 341.34 us 2024-03-26T17:09:03.478 INFO:tasks.workunit.client.3.smithi157.stdout:myimage46 3/s 3/s 60 KiB/s 69 KiB/s 2.49 ms 402.50 us 2024-03-26T17:09:03.479 INFO:tasks.workunit.client.3.smithi157.stdout:myimage3 3/s 4/s 71 KiB/s 78 KiB/s 2.44 ms 402.48 us 2024-03-26T17:09:03.479 INFO:tasks.workunit.client.3.smithi157.stdout:myimage24 3/s 4/s 61 KiB/s 83 KiB/s 2.77 ms 399.35 us 2024-03-26T17:09:03.479 INFO:tasks.workunit.client.3.smithi157.stdout:myimage25 3/s 3/s 61 KiB/s 59 KiB/s 3.37 ms 345.33 us 2024-03-26T17:09:03.479 INFO:tasks.workunit.client.3.smithi157.stdout:myimage56 3/s 5/s 62 KiB/s 142 KiB/s 2.88 ms 347.40 us 2024-03-26T17:09:03.479 INFO:tasks.workunit.client.3.smithi157.stdout:myimage10 3/s 4/s 78 KiB/s 57 KiB/s 2.60 ms 319.21 us 2024-03-26T17:09:03.479 INFO:tasks.workunit.client.3.smithi157.stdout:myimage2 3/s 3/s 64 KiB/s 50 KiB/s 3.05 ms 324.57 us 2024-03-26T17:09:03.479 INFO:tasks.workunit.client.3.smithi157.stdout:myimage35 3/s 3/s 69 KiB/s 79 KiB/s 2.68 ms 333.12 us 2024-03-26T17:09:03.479 INFO:tasks.workunit.client.3.smithi157.stdout:myimage38 3/s 3/s 52 KiB/s 64 KiB/s 2.03 ms 303.61 us 2024-03-26T17:09:03.479 INFO:tasks.workunit.client.3.smithi157.stdout:myimage6 3/s 3/s 65 KiB/s 54 KiB/s 3.23 ms 339.72 us 2024-03-26T17:09:03.479 INFO:tasks.workunit.client.3.smithi157.stdout:myimage41 3/s 3/s 75 KiB/s 70 KiB/s 2.77 ms 336.16 us 2024-03-26T17:09:03.479 INFO:tasks.workunit.client.3.smithi157.stdout:myimage42 3/s 4/s 58 KiB/s 72 KiB/s 2.63 ms 329.58 us 2024-03-26T17:09:03.479 INFO:tasks.workunit.client.3.smithi157.stdout:myimage45 3/s 4/s 46 KiB/s 98 KiB/s 2.32 ms 316.02 us 2024-03-26T17:09:03.479 INFO:tasks.workunit.client.3.smithi157.stdout:myimage51 3/s 3/s 66 KiB/s 61 KiB/s 2.98 ms 333.45 us 2024-03-26T17:09:03.479 INFO:tasks.workunit.client.3.smithi157.stdout:myimage39 2/s 3/s 63 KiB/s 101 KiB/s 2.80 ms 371.39 us 2024-03-26T17:09:03.479 INFO:tasks.workunit.client.3.smithi157.stdout:myimage50 2/s 4/s 44 KiB/s 60 KiB/s 2.95 ms 361.13 us 2024-03-26T17:09:03.480 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:09:03.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:09:03 smithi044 ceph-mon[30624]: pgmap v697: 33 pgs: 33 active+clean; 1.0 GiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 4.5 MiB/s rd, 4.8 MiB/s wr, 489 op/s 2024-03-26T17:09:03.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:09:03 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:09:03] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:09:03.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:09:03 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:09:03] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:09:03.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:09:03 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:09:03.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:09:03 smithi064 ceph-mon[34420]: pgmap v697: 33 pgs: 33 active+clean; 1.0 GiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 4.5 MiB/s rd, 4.8 MiB/s wr, 489 op/s 2024-03-26T17:09:03.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:09:03 smithi149 ceph-mon[34678]: pgmap v697: 33 pgs: 33 active+clean; 1.0 GiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 4.5 MiB/s rd, 4.8 MiB/s wr, 489 op/s 2024-03-26T17:09:03.647 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:09:03 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:09:03] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:09:03.647 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:09:03 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:09:03] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:09:03.647 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:09:03 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:09:04.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:09:04 smithi044 ceph-mon[30624]: Health check update: 3 slow ops, oldest one blocked for 638 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:09:04.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:09:04 smithi064 ceph-mon[34420]: Health check update: 3 slow ops, oldest one blocked for 638 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:09:04.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:09:04 smithi149 ceph-mon[34678]: Health check update: 3 slow ops, oldest one blocked for 638 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:09:05.416 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:09:05 smithi044 ceph-mon[30624]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:09:05.416 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:09:05 smithi044 ceph-mon[30624]: { 2024-03-26T17:09:05.416 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:09:05 smithi044 ceph-mon[30624]: "prefix": "rbd perf image stats", 2024-03-26T17:09:05.417 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:09:05 smithi044 ceph-mon[30624]: "pool_spec": "mypool", 2024-03-26T17:09:05.417 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:09:05 smithi044 ceph-mon[30624]: "sort_by": "write_ops", 2024-03-26T17:09:05.417 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:09:05 smithi044 ceph-mon[30624]: "format": "json" 2024-03-26T17:09:05.417 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:09:05 smithi044 ceph-mon[30624]: }"]: dispatch 2024-03-26T17:09:05.417 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:09:05 smithi044 ceph-mon[30624]: pgmap v698: 33 pgs: 33 active+clean; 1.0 GiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 4.8 MiB/s rd, 5.1 MiB/s wr, 529 op/s 2024-03-26T17:09:05.417 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:09:05 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:09:05] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:09:05.417 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:09:05 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:09:05] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:09:05.417 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:09:05 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:09:05.547 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:09:05 smithi149 ceph-mon[34678]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:09:05.547 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:09:05 smithi149 ceph-mon[34678]: { 2024-03-26T17:09:05.548 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:09:05 smithi149 ceph-mon[34678]: "prefix": "rbd perf image stats", 2024-03-26T17:09:05.548 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:09:05 smithi149 ceph-mon[34678]: "pool_spec": "mypool", 2024-03-26T17:09:05.548 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:09:05 smithi149 ceph-mon[34678]: "sort_by": "write_ops", 2024-03-26T17:09:05.548 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:09:05 smithi149 ceph-mon[34678]: "format": "json" 2024-03-26T17:09:05.548 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:09:05 smithi149 ceph-mon[34678]: }"]: dispatch 2024-03-26T17:09:05.548 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:09:05 smithi149 ceph-mon[34678]: pgmap v698: 33 pgs: 33 active+clean; 1.0 GiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 4.8 MiB/s rd, 5.1 MiB/s wr, 529 op/s 2024-03-26T17:09:05.549 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:09:05 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:09:05] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:09:05.549 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:09:05 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:09:05] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:09:05.549 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:09:05 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:09:05.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:09:05 smithi064 ceph-mon[34420]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:09:05.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:09:05 smithi064 ceph-mon[34420]: { 2024-03-26T17:09:05.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:09:05 smithi064 ceph-mon[34420]: "prefix": "rbd perf image stats", 2024-03-26T17:09:05.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:09:05 smithi064 ceph-mon[34420]: "pool_spec": "mypool", 2024-03-26T17:09:05.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:09:05 smithi064 ceph-mon[34420]: "sort_by": "write_ops", 2024-03-26T17:09:05.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:09:05 smithi064 ceph-mon[34420]: "format": "json" 2024-03-26T17:09:05.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:09:05 smithi064 ceph-mon[34420]: }"]: dispatch 2024-03-26T17:09:05.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:09:05 smithi064 ceph-mon[34420]: pgmap v698: 33 pgs: 33 active+clean; 1.0 GiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 4.8 MiB/s rd, 5.1 MiB/s wr, 529 op/s 2024-03-26T17:09:06.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:09:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 2024-03-26T17:09:06.237+0000 7fa707a55700 -1 mon.c@1(peon) e3 get_health_metrics reporting 3 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T17:09:07.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:09:07 smithi044 ceph-mon[30624]: pgmap v699: 33 pgs: 33 active+clean; 1.0 GiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 5.1 MiB/s rd, 5.2 MiB/s wr, 539 op/s 2024-03-26T17:09:07.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:09:07 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:09:07] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:09:07.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:09:07 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:09:07] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:09:07.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:09:07 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:09:07.547 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:09:07 smithi149 ceph-mon[34678]: pgmap v699: 33 pgs: 33 active+clean; 1.0 GiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 5.1 MiB/s rd, 5.2 MiB/s wr, 539 op/s 2024-03-26T17:09:07.547 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:09:07 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:09:07] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:09:07.547 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:09:07 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:09:07] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:09:07.548 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:09:07 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:09:07.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:09:07 smithi064 ceph-mon[34420]: pgmap v699: 33 pgs: 33 active+clean; 1.0 GiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 5.1 MiB/s rd, 5.2 MiB/s wr, 539 op/s 2024-03-26T17:09:08.479 INFO:tasks.workunit.client.3.smithi157.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-26T17:09:08.479 INFO:tasks.workunit.client.3.smithi157.stdout:myimage57 6/s 3/s 124 KiB/s 60 KiB/s 2.93 ms 321.18 us 2024-03-26T17:09:08.479 INFO:tasks.workunit.client.3.smithi157.stdout:myimage18 5/s 3/s 141 KiB/s 81 KiB/s 2.41 ms 336.18 us 2024-03-26T17:09:08.479 INFO:tasks.workunit.client.3.smithi157.stdout:myimage20 5/s 3/s 159 KiB/s 132 KiB/s 2.66 ms 395.93 us 2024-03-26T17:09:08.479 INFO:tasks.workunit.client.3.smithi157.stdout:myimage53 5/s 3/s 87 KiB/s 64 KiB/s 2.40 ms 396.75 us 2024-03-26T17:09:08.479 INFO:tasks.workunit.client.3.smithi157.stdout:myimage30 5/s 3/s 99 KiB/s 57 KiB/s 3.36 ms 330.75 us 2024-03-26T17:09:08.479 INFO:tasks.workunit.client.3.smithi157.stdout:myimage34 5/s 3/s 105 KiB/s 62 KiB/s 2.29 ms 333.91 us 2024-03-26T17:09:08.479 INFO:tasks.workunit.client.3.smithi157.stdout:myimage41 5/s 4/s 98 KiB/s 91 KiB/s 2.73 ms 370.94 us 2024-03-26T17:09:08.480 INFO:tasks.workunit.client.3.smithi157.stdout:myimage38 4/s 4/s 72 KiB/s 91 KiB/s 2.15 ms 367.81 us 2024-03-26T17:09:08.480 INFO:tasks.workunit.client.3.smithi157.stdout:myimage45 4/s 4/s 96 KiB/s 91 KiB/s 2.69 ms 349.30 us 2024-03-26T17:09:08.480 INFO:tasks.workunit.client.3.smithi157.stdout:myimage46 4/s 6/s 143 KiB/s 162 KiB/s 2.65 ms 402.42 us 2024-03-26T17:09:08.480 INFO:tasks.workunit.client.3.smithi157.stdout:myimage50 4/s 4/s 110 KiB/s 93 KiB/s 2.93 ms 429.04 us 2024-03-26T17:09:08.480 INFO:tasks.workunit.client.3.smithi157.stdout:myimage16 4/s 3/s 78 KiB/s 58 KiB/s 3.30 ms 315.35 us 2024-03-26T17:09:08.480 INFO:tasks.workunit.client.3.smithi157.stdout:myimage37 4/s 3/s 106 KiB/s 93 KiB/s 2.55 ms 347.88 us 2024-03-26T17:09:08.480 INFO:tasks.workunit.client.3.smithi157.stdout:myimage27 4/s 5/s 102 KiB/s 138 KiB/s 2.40 ms 335.48 us 2024-03-26T17:09:08.480 INFO:tasks.workunit.client.3.smithi157.stdout:myimage42 4/s 5/s 73 KiB/s 92 KiB/s 2.52 ms 439.78 us 2024-03-26T17:09:08.480 INFO:tasks.workunit.client.3.smithi157.stdout:myimage35 4/s 4/s 69 KiB/s 86 KiB/s 2.61 ms 398.61 us 2024-03-26T17:09:08.480 INFO:tasks.workunit.client.3.smithi157.stdout:myimage15 4/s 3/s 136 KiB/s 127 KiB/s 2.27 ms 426.14 us 2024-03-26T17:09:08.480 INFO:tasks.workunit.client.3.smithi157.stdout:myimage59 4/s 4/s 70 KiB/s 108 KiB/s 2.53 ms 325.31 us 2024-03-26T17:09:08.480 INFO:tasks.workunit.client.3.smithi157.stdout:myimage2 4/s 4/s 73 KiB/s 78 KiB/s 3.10 ms 378.16 us 2024-03-26T17:09:08.480 INFO:tasks.workunit.client.3.smithi157.stdout:myimage3 4/s 4/s 81 KiB/s 70 KiB/s 2.24 ms 387.84 us 2024-03-26T17:09:08.480 INFO:tasks.workunit.client.3.smithi157.stdout:myimage47 4/s 4/s 76 KiB/s 95 KiB/s 2.62 ms 427.48 us 2024-03-26T17:09:08.480 INFO:tasks.workunit.client.3.smithi157.stdout:myimage21 4/s 4/s 128 KiB/s 138 KiB/s 3.60 ms 446.08 us 2024-03-26T17:09:08.481 INFO:tasks.workunit.client.3.smithi157.stdout:myimage24 4/s 3/s 102 KiB/s 72 KiB/s 2.73 ms 328.24 us 2024-03-26T17:09:08.481 INFO:tasks.workunit.client.3.smithi157.stdout:myimage14 4/s 4/s 91 KiB/s 71 KiB/s 2.68 ms 317.42 us 2024-03-26T17:09:08.481 INFO:tasks.workunit.client.3.smithi157.stdout:myimage58 4/s 3/s 73 KiB/s 79 KiB/s 2.48 ms 410.88 us 2024-03-26T17:09:08.481 INFO:tasks.workunit.client.3.smithi157.stdout:myimage6 4/s 5/s 126 KiB/s 157 KiB/s 3.07 ms 352.14 us 2024-03-26T17:09:08.481 INFO:tasks.workunit.client.3.smithi157.stdout:myimage12 4/s 4/s 78 KiB/s 71 KiB/s 2.72 ms 295.13 us 2024-03-26T17:09:08.481 INFO:tasks.workunit.client.3.smithi157.stdout:myimage25 4/s 3/s 72 KiB/s 64 KiB/s 3.10 ms 357.00 us 2024-03-26T17:09:08.481 INFO:tasks.workunit.client.3.smithi157.stdout:myimage28 4/s 4/s 66 KiB/s 73 KiB/s 3.38 ms 322.98 us 2024-03-26T17:09:08.481 INFO:tasks.workunit.client.3.smithi157.stdout:myimage29 4/s 4/s 80 KiB/s 56 KiB/s 2.45 ms 316.22 us 2024-03-26T17:09:08.481 INFO:tasks.workunit.client.3.smithi157.stdout:myimage51 4/s 4/s 81 KiB/s 102 KiB/s 3.14 ms 324.95 us 2024-03-26T17:09:08.481 INFO:tasks.workunit.client.3.smithi157.stdout:myimage60 4/s 3/s 82 KiB/s 50 KiB/s 2.82 ms 336.13 us 2024-03-26T17:09:08.481 INFO:tasks.workunit.client.3.smithi157.stdout:myimage31 3/s 2/s 67 KiB/s 47 KiB/s 3.73 ms 363.14 us 2024-03-26T17:09:08.481 INFO:tasks.workunit.client.3.smithi157.stdout:myimage32 3/s 4/s 66 KiB/s 89 KiB/s 2.70 ms 346.49 us 2024-03-26T17:09:08.481 INFO:tasks.workunit.client.3.smithi157.stdout:myimage40 3/s 2/s 70 KiB/s 51 KiB/s 2.47 ms 396.21 us 2024-03-26T17:09:08.481 INFO:tasks.workunit.client.3.smithi157.stdout:myimage49 3/s 4/s 66 KiB/s 58 KiB/s 2.75 ms 344.21 us 2024-03-26T17:09:08.481 INFO:tasks.workunit.client.3.smithi157.stdout:myimage1 3/s 3/s 113 KiB/s 118 KiB/s 2.43 ms 313.22 us 2024-03-26T17:09:08.482 INFO:tasks.workunit.client.3.smithi157.stdout:myimage7 3/s 5/s 85 KiB/s 166 KiB/s 2.60 ms 388.41 us 2024-03-26T17:09:08.482 INFO:tasks.workunit.client.3.smithi157.stdout:myimage9 3/s 2/s 92 KiB/s 56 KiB/s 3.20 ms 333.68 us 2024-03-26T17:09:08.482 INFO:tasks.workunit.client.3.smithi157.stdout:myimage19 3/s 4/s 65 KiB/s 84 KiB/s 2.82 ms 380.72 us 2024-03-26T17:09:08.482 INFO:tasks.workunit.client.3.smithi157.stdout:myimage39 3/s 3/s 74 KiB/s 65 KiB/s 2.84 ms 321.60 us 2024-03-26T17:09:08.482 INFO:tasks.workunit.client.3.smithi157.stdout:myimage43 3/s 4/s 78 KiB/s 62 KiB/s 3.12 ms 350.55 us 2024-03-26T17:09:08.482 INFO:tasks.workunit.client.3.smithi157.stdout:myimage22 3/s 4/s 85 KiB/s 86 KiB/s 2.04 ms 326.58 us 2024-03-26T17:09:08.482 INFO:tasks.workunit.client.3.smithi157.stdout:myimage11 3/s 4/s 75 KiB/s 88 KiB/s 2.87 ms 322.72 us 2024-03-26T17:09:08.482 INFO:tasks.workunit.client.3.smithi157.stdout:myimage26 3/s 3/s 71 KiB/s 91 KiB/s 2.70 ms 391.42 us 2024-03-26T17:09:08.482 INFO:tasks.workunit.client.3.smithi157.stdout:myimage55 3/s 4/s 78 KiB/s 86 KiB/s 2.66 ms 327.89 us 2024-03-26T17:09:08.482 INFO:tasks.workunit.client.3.smithi157.stdout:myimage10 3/s 5/s 42 KiB/s 95 KiB/s 2.64 ms 362.97 us 2024-03-26T17:09:08.482 INFO:tasks.workunit.client.3.smithi157.stdout:myimage54 3/s 4/s 111 KiB/s 164 KiB/s 2.62 ms 451.13 us 2024-03-26T17:09:08.482 INFO:tasks.workunit.client.3.smithi157.stdout:myimage13 3/s 3/s 62 KiB/s 58 KiB/s 2.18 ms 312.66 us 2024-03-26T17:09:08.482 INFO:tasks.workunit.client.3.smithi157.stdout:myimage52 3/s 2/s 79 KiB/s 87 KiB/s 3.00 ms 465.44 us 2024-03-26T17:09:08.482 INFO:tasks.workunit.client.3.smithi157.stdout:myimage8 3/s 4/s 42 KiB/s 84 KiB/s 2.79 ms 352.41 us 2024-03-26T17:09:08.483 INFO:tasks.workunit.client.3.smithi157.stdout:myimage17 3/s 3/s 54 KiB/s 81 KiB/s 2.56 ms 364.26 us 2024-03-26T17:09:08.483 INFO:tasks.workunit.client.3.smithi157.stdout:myimage33 3/s 3/s 54 KiB/s 47 KiB/s 2.80 ms 338.84 us 2024-03-26T17:09:08.483 INFO:tasks.workunit.client.3.smithi157.stdout:myimage23 3/s 4/s 54 KiB/s 60 KiB/s 2.40 ms 384.52 us 2024-03-26T17:09:08.483 INFO:tasks.workunit.client.3.smithi157.stdout:myimage44 3/s 4/s 54 KiB/s 93 KiB/s 2.72 ms 326.64 us 2024-03-26T17:09:08.483 INFO:tasks.workunit.client.3.smithi157.stdout:myimage5 3/s 4/s 66 KiB/s 70 KiB/s 2.54 ms 373.43 us 2024-03-26T17:09:08.483 INFO:tasks.workunit.client.3.smithi157.stdout:myimage36 2/s 3/s 43 KiB/s 97 KiB/s 2.40 ms 585.19 us 2024-03-26T17:09:08.483 INFO:tasks.workunit.client.3.smithi157.stdout:myimage56 2/s 5/s 102 KiB/s 167 KiB/s 3.12 ms 383.05 us 2024-03-26T17:09:08.483 INFO:tasks.workunit.client.3.smithi157.stdout:myimage48 2/s 3/s 83 KiB/s 61 KiB/s 3.00 ms 299.54 us 2024-03-26T17:09:08.483 INFO:tasks.workunit.client.3.smithi157.stdout:myimage4 2/s 4/s 33 KiB/s 106 KiB/s 2.11 ms 331.68 us 2024-03-26T17:09:08.483 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:09:09.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:09:09 smithi044 ceph-mon[30624]: pgmap v700: 33 pgs: 33 active+clean; 1.0 GiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 4.6 MiB/s rd, 4.6 MiB/s wr, 475 op/s 2024-03-26T17:09:09.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:09:09 smithi044 ceph-mon[30624]: Health check update: 3 slow ops, oldest one blocked for 643 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:09:09.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:09:09 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:09:09] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:09:09.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:09:09 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:09:09] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:09:09.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:09:09 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:09:09.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:09:09 smithi064 ceph-mon[34420]: pgmap v700: 33 pgs: 33 active+clean; 1.0 GiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 4.6 MiB/s rd, 4.6 MiB/s wr, 475 op/s 2024-03-26T17:09:09.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:09:09 smithi064 ceph-mon[34420]: Health check update: 3 slow ops, oldest one blocked for 643 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:09:09.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:09:09 smithi149 ceph-mon[34678]: pgmap v700: 33 pgs: 33 active+clean; 1.0 GiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 4.6 MiB/s rd, 4.6 MiB/s wr, 475 op/s 2024-03-26T17:09:09.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:09:09 smithi149 ceph-mon[34678]: Health check update: 3 slow ops, oldest one blocked for 643 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:09:09.647 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:09:09 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:09:09] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:09:09.647 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:09:09 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:09:09] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:09:09.648 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:09:09 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:09:10.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:09:10 smithi044 ceph-mon[30624]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:09:10.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:09:10 smithi044 ceph-mon[30624]: { 2024-03-26T17:09:10.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:09:10 smithi044 ceph-mon[30624]: "prefix": "rbd perf image stats", 2024-03-26T17:09:10.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:09:10 smithi044 ceph-mon[30624]: "pool_spec": "mypool", 2024-03-26T17:09:10.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:09:10 smithi044 ceph-mon[30624]: "sort_by": "write_ops", 2024-03-26T17:09:10.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:09:10 smithi044 ceph-mon[30624]: "format": "json" 2024-03-26T17:09:10.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:09:10 smithi044 ceph-mon[30624]: }"]: dispatch 2024-03-26T17:09:10.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:09:10 smithi064 ceph-mon[34420]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:09:10.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:09:10 smithi064 ceph-mon[34420]: { 2024-03-26T17:09:10.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:09:10 smithi064 ceph-mon[34420]: "prefix": "rbd perf image stats", 2024-03-26T17:09:10.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:09:10 smithi064 ceph-mon[34420]: "pool_spec": "mypool", 2024-03-26T17:09:10.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:09:10 smithi064 ceph-mon[34420]: "sort_by": "write_ops", 2024-03-26T17:09:10.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:09:10 smithi064 ceph-mon[34420]: "format": "json" 2024-03-26T17:09:10.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:09:10 smithi064 ceph-mon[34420]: }"]: dispatch 2024-03-26T17:09:10.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:09:10 smithi149 ceph-mon[34678]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:09:10.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:09:10 smithi149 ceph-mon[34678]: { 2024-03-26T17:09:10.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:09:10 smithi149 ceph-mon[34678]: "prefix": "rbd perf image stats", 2024-03-26T17:09:10.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:09:10 smithi149 ceph-mon[34678]: "pool_spec": "mypool", 2024-03-26T17:09:10.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:09:10 smithi149 ceph-mon[34678]: "sort_by": "write_ops", 2024-03-26T17:09:10.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:09:10 smithi149 ceph-mon[34678]: "format": "json" 2024-03-26T17:09:10.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:09:10 smithi149 ceph-mon[34678]: }"]: dispatch 2024-03-26T17:09:11.417 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:09:11 smithi044 ceph-mon[30624]: pgmap v701: 33 pgs: 33 active+clean; 1.0 GiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 5.1 MiB/s rd, 5.0 MiB/s wr, 513 op/s 2024-03-26T17:09:11.417 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:09:11 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:09:11] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:09:11.417 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:09:11 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:09:11] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:09:11.417 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:09:11 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:09:11.547 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:09:11 smithi149 ceph-mon[34678]: pgmap v701: 33 pgs: 33 active+clean; 1.0 GiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 5.1 MiB/s rd, 5.0 MiB/s wr, 513 op/s 2024-03-26T17:09:11.547 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:09:11 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 2024-03-26T17:09:11.237+0000 7fa707a55700 -1 mon.c@1(peon) e3 get_health_metrics reporting 3 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T17:09:11.548 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:09:11 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:09:11] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:09:11.548 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:09:11 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:09:11] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:09:11.548 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:09:11 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:09:11.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:09:11 smithi064 ceph-mon[34420]: pgmap v701: 33 pgs: 33 active+clean; 1.0 GiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 5.1 MiB/s rd, 5.0 MiB/s wr, 513 op/s 2024-03-26T17:09:13.062 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:09:13.073 INFO:tasks.workunit.client.3.smithi157.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2024-03-26T17:09:13.073 INFO:tasks.workunit.client.3.smithi157.stdout: 8.10 124.0k 106.8k 0.0k 1.2M 1.0M 0.0k nvme2n1 2024-03-26T17:09:13.073 INFO:tasks.workunit.client.3.smithi157.stdout: 8.20 147.2k 92.8k 0.0k 1.4M 928.0k 0.0k nvme2n10 2024-03-26T17:09:13.074 INFO:tasks.workunit.client.3.smithi157.stdout: 8.20 59.6k 115.6k 0.0k 596.0k 1.1M 0.0k nvme2n11 2024-03-26T17:09:13.074 INFO:tasks.workunit.client.3.smithi157.stdout: 8.10 79.6k 81.2k 0.0k 796.0k 812.0k 0.0k nvme2n12 2024-03-26T17:09:13.074 INFO:tasks.workunit.client.3.smithi157.stdout: 8.10 114.4k 115.6k 0.0k 1.1M 1.1M 0.0k nvme2n13 2024-03-26T17:09:13.074 INFO:tasks.workunit.client.3.smithi157.stdout: 8.10 78.4k 58.8k 0.0k 784.0k 588.0k 0.0k nvme2n14 2024-03-26T17:09:13.074 INFO:tasks.workunit.client.3.smithi157.stdout: 8.10 143.6k 132.4k 0.0k 1.4M 1.3M 0.0k nvme2n15 2024-03-26T17:09:13.074 INFO:tasks.workunit.client.3.smithi157.stdout: 8.10 72.8k 69.2k 0.0k 728.0k 692.0k 0.0k nvme2n16 2024-03-26T17:09:13.074 INFO:tasks.workunit.client.3.smithi157.stdout: 8.10 127.6k 104.4k 0.0k 1.2M 1.0M 0.0k nvme2n17 2024-03-26T17:09:13.074 INFO:tasks.workunit.client.3.smithi157.stdout: 8.10 136.8k 118.8k 0.0k 1.3M 1.2M 0.0k nvme2n18 2024-03-26T17:09:13.074 INFO:tasks.workunit.client.3.smithi157.stdout: 8.10 75.2k 76.8k 0.0k 752.0k 768.0k 0.0k nvme2n19 2024-03-26T17:09:13.074 INFO:tasks.workunit.client.3.smithi157.stdout: 8.10 88.8k 120.4k 0.0k 888.0k 1.2M 0.0k nvme2n2 2024-03-26T17:09:13.074 INFO:tasks.workunit.client.3.smithi157.stdout: 8.10 98.0k 150.8k 0.0k 980.0k 1.5M 0.0k nvme2n20 2024-03-26T17:09:13.075 INFO:tasks.workunit.client.3.smithi157.stdout: 8.20 114.8k 93.6k 0.0k 1.1M 936.0k 0.0k nvme2n3 2024-03-26T17:09:13.075 INFO:tasks.workunit.client.3.smithi157.stdout: 8.20 111.6k 108.8k 0.0k 1.1M 1.1M 0.0k nvme2n4 2024-03-26T17:09:13.075 INFO:tasks.workunit.client.3.smithi157.stdout: 8.20 56.4k 73.2k 0.0k 564.0k 732.0k 0.0k nvme2n5 2024-03-26T17:09:13.075 INFO:tasks.workunit.client.3.smithi157.stdout: 8.20 128.4k 116.8k 0.0k 1.3M 1.1M 0.0k nvme2n6 2024-03-26T17:09:13.075 INFO:tasks.workunit.client.3.smithi157.stdout: 8.20 127.6k 116.0k 0.0k 1.2M 1.1M 0.0k nvme2n7 2024-03-26T17:09:13.075 INFO:tasks.workunit.client.3.smithi157.stdout: 8.20 92.4k 82.0k 0.0k 924.0k 820.0k 0.0k nvme2n8 2024-03-26T17:09:13.075 INFO:tasks.workunit.client.3.smithi157.stdout: 8.20 139.2k 105.2k 0.0k 1.4M 1.0M 0.0k nvme2n9 2024-03-26T17:09:13.075 INFO:tasks.workunit.client.3.smithi157.stdout: 8.10 164.4k 116.0k 0.0k 1.6M 1.1M 0.0k nvme5n1 2024-03-26T17:09:13.075 INFO:tasks.workunit.client.3.smithi157.stdout: 8.20 71.6k 78.8k 0.0k 716.0k 788.0k 0.0k nvme5n10 2024-03-26T17:09:13.075 INFO:tasks.workunit.client.3.smithi157.stdout: 8.20 86.0k 126.0k 0.0k 860.0k 1.2M 0.0k nvme5n11 2024-03-26T17:09:13.075 INFO:tasks.workunit.client.3.smithi157.stdout: 8.10 87.6k 72.8k 0.0k 876.0k 728.0k 0.0k nvme5n12 2024-03-26T17:09:13.075 INFO:tasks.workunit.client.3.smithi157.stdout: 8.10 101.2k 107.6k 0.0k 1012.0k 1.1M 0.0k nvme5n13 2024-03-26T17:09:13.076 INFO:tasks.workunit.client.3.smithi157.stdout: 8.10 78.4k 68.0k 0.0k 784.0k 680.0k 0.0k nvme5n14 2024-03-26T17:09:13.076 INFO:tasks.workunit.client.3.smithi157.stdout: 8.10 65.6k 83.2k 0.0k 656.0k 832.0k 0.0k nvme5n15 2024-03-26T17:09:13.076 INFO:tasks.workunit.client.3.smithi157.stdout: 8.10 83.2k 167.2k 0.0k 832.0k 1.6M 0.0k nvme5n16 2024-03-26T17:09:13.076 INFO:tasks.workunit.client.3.smithi157.stdout: 8.10 102.4k 158.0k 0.0k 1.0M 1.5M 0.0k nvme5n17 2024-03-26T17:09:13.076 INFO:tasks.workunit.client.3.smithi157.stdout: 8.10 72.0k 83.6k 0.0k 720.0k 836.0k 0.0k nvme5n18 2024-03-26T17:09:13.076 INFO:tasks.workunit.client.3.smithi157.stdout: 8.10 67.6k 70.8k 0.0k 676.0k 708.0k 0.0k nvme5n19 2024-03-26T17:09:13.076 INFO:tasks.workunit.client.3.smithi157.stdout: 8.10 121.2k 113.2k 0.0k 1.2M 1.1M 0.0k nvme5n2 2024-03-26T17:09:13.076 INFO:tasks.workunit.client.3.smithi157.stdout: 8.10 104.4k 92.0k 0.0k 1.0M 920.0k 0.0k nvme5n20 2024-03-26T17:09:13.076 INFO:tasks.workunit.client.3.smithi157.stdout: 8.10 63.2k 69.6k 0.0k 632.0k 696.0k 0.0k nvme5n3 2024-03-26T17:09:13.076 INFO:tasks.workunit.client.3.smithi157.stdout: 8.20 69.6k 79.6k 0.0k 696.0k 796.0k 0.0k nvme5n4 2024-03-26T17:09:13.076 INFO:tasks.workunit.client.3.smithi157.stdout: 8.20 101.2k 110.0k 0.0k 1012.0k 1.1M 0.0k nvme5n5 2024-03-26T17:09:13.076 INFO:tasks.workunit.client.3.smithi157.stdout: 8.20 56.8k 82.8k 0.0k 568.0k 828.0k 0.0k nvme5n6 2024-03-26T17:09:13.076 INFO:tasks.workunit.client.3.smithi157.stdout: 8.20 134.0k 116.8k 0.0k 1.3M 1.1M 0.0k nvme5n7 2024-03-26T17:09:13.076 INFO:tasks.workunit.client.3.smithi157.stdout: 8.20 59.6k 73.2k 0.0k 596.0k 732.0k 0.0k nvme5n8 2024-03-26T17:09:13.077 INFO:tasks.workunit.client.3.smithi157.stdout: 8.20 77.6k 107.2k 0.0k 776.0k 1.0M 0.0k nvme5n9 2024-03-26T17:09:13.077 INFO:tasks.workunit.client.3.smithi157.stdout: 8.10 74.4k 86.8k 0.0k 744.0k 868.0k 0.0k nvme8n1 2024-03-26T17:09:13.077 INFO:tasks.workunit.client.3.smithi157.stdout: 8.20 105.2k 134.4k 0.0k 1.0M 1.3M 0.0k nvme8n10 2024-03-26T17:09:13.077 INFO:tasks.workunit.client.3.smithi157.stdout: 8.10 103.6k 106.0k 0.0k 1.0M 1.0M 0.0k nvme8n11 2024-03-26T17:09:13.077 INFO:tasks.workunit.client.3.smithi157.stdout: 8.10 116.8k 122.0k 0.0k 1.1M 1.2M 0.0k nvme8n12 2024-03-26T17:09:13.077 INFO:tasks.workunit.client.3.smithi157.stdout: 8.10 62.4k 93.6k 0.0k 624.0k 936.0k 0.0k nvme8n13 2024-03-26T17:09:13.077 INFO:tasks.workunit.client.3.smithi157.stdout: 8.10 121.6k 148.0k 0.0k 1.2M 1.4M 0.0k nvme8n14 2024-03-26T17:09:13.077 INFO:tasks.workunit.client.3.smithi157.stdout: 8.10 86.4k 84.0k 0.0k 864.0k 840.0k 0.0k nvme8n15 2024-03-26T17:09:13.077 INFO:tasks.workunit.client.3.smithi157.stdout: 8.10 117.2k 121.2k 0.0k 1.1M 1.2M 0.0k nvme8n16 2024-03-26T17:09:13.077 INFO:tasks.workunit.client.3.smithi157.stdout: 8.10 65.6k 83.6k 0.0k 656.0k 836.0k 0.0k nvme8n17 2024-03-26T17:09:13.077 INFO:tasks.workunit.client.3.smithi157.stdout: 8.10 88.0k 92.4k 0.0k 880.0k 924.0k 0.0k nvme8n18 2024-03-26T17:09:13.077 INFO:tasks.workunit.client.3.smithi157.stdout: 8.10 138.0k 63.6k 0.0k 1.3M 636.0k 0.0k nvme8n19 2024-03-26T17:09:13.077 INFO:tasks.workunit.client.3.smithi157.stdout: 8.10 81.2k 127.2k 0.0k 812.0k 1.2M 0.0k nvme8n2 2024-03-26T17:09:13.078 INFO:tasks.workunit.client.3.smithi157.stdout: 8.10 80.4k 100.0k 0.0k 804.0k 1000.0k 0.0k nvme8n20 2024-03-26T17:09:13.078 INFO:tasks.workunit.client.3.smithi157.stdout: 8.20 78.0k 75.6k 0.0k 780.0k 756.0k 0.0k nvme8n3 2024-03-26T17:09:13.078 INFO:tasks.workunit.client.3.smithi157.stdout: 8.20 125.6k 98.8k 0.0k 1.2M 988.0k 0.0k nvme8n4 2024-03-26T17:09:13.078 INFO:tasks.workunit.client.3.smithi157.stdout: 8.20 87.2k 70.4k 0.0k 872.0k 704.0k 0.0k nvme8n5 2024-03-26T17:09:13.078 INFO:tasks.workunit.client.3.smithi157.stdout: 8.20 114.4k 140.0k 0.0k 1.1M 1.4M 0.0k nvme8n6 2024-03-26T17:09:13.078 INFO:tasks.workunit.client.3.smithi157.stdout: 8.20 114.0k 114.0k 0.0k 1.1M 1.1M 0.0k nvme8n7 2024-03-26T17:09:13.078 INFO:tasks.workunit.client.3.smithi157.stdout: 8.20 119.6k 136.0k 0.0k 1.2M 1.3M 0.0k nvme8n8 2024-03-26T17:09:13.078 INFO:tasks.workunit.client.3.smithi157.stdout: 8.20 92.0k 76.4k 0.0k 920.0k 764.0k 0.0k nvme8n9 2024-03-26T17:09:13.078 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:09:13.483 INFO:tasks.workunit.client.3.smithi157.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-26T17:09:13.483 INFO:tasks.workunit.client.3.smithi157.stdout:myimage38 6/s 4/s 134 KiB/s 97 KiB/s 2.39 ms 341.78 us 2024-03-26T17:09:13.483 INFO:tasks.workunit.client.3.smithi157.stdout:myimage26 5/s 3/s 90 KiB/s 54 KiB/s 2.62 ms 370.84 us 2024-03-26T17:09:13.483 INFO:tasks.workunit.client.3.smithi157.stdout:myimage36 5/s 4/s 191 KiB/s 95 KiB/s 2.65 ms 327.17 us 2024-03-26T17:09:13.483 INFO:tasks.workunit.client.3.smithi157.stdout:myimage2 5/s 3/s 151 KiB/s 75 KiB/s 2.81 ms 325.65 us 2024-03-26T17:09:13.484 INFO:tasks.workunit.client.3.smithi157.stdout:myimage50 5/s 3/s 170 KiB/s 108 KiB/s 2.86 ms 336.77 us 2024-03-26T17:09:13.484 INFO:tasks.workunit.client.3.smithi157.stdout:myimage57 5/s 4/s 80 KiB/s 73 KiB/s 2.58 ms 361.08 us 2024-03-26T17:09:13.484 INFO:tasks.workunit.client.3.smithi157.stdout:myimage31 5/s 5/s 163 KiB/s 122 KiB/s 3.08 ms 365.74 us 2024-03-26T17:09:13.484 INFO:tasks.workunit.client.3.smithi157.stdout:myimage37 5/s 2/s 178 KiB/s 82 KiB/s 2.86 ms 374.80 us 2024-03-26T17:09:13.484 INFO:tasks.workunit.client.3.smithi157.stdout:myimage20 5/s 2/s 157 KiB/s 68 KiB/s 2.66 ms 434.70 us 2024-03-26T17:09:13.484 INFO:tasks.workunit.client.3.smithi157.stdout:myimage41 5/s 4/s 96 KiB/s 63 KiB/s 2.75 ms 307.17 us 2024-03-26T17:09:13.484 INFO:tasks.workunit.client.3.smithi157.stdout:myimage29 5/s 3/s 110 KiB/s 59 KiB/s 2.37 ms 374.94 us 2024-03-26T17:09:13.484 INFO:tasks.workunit.client.3.smithi157.stdout:myimage14 4/s 6/s 71 KiB/s 113 KiB/s 2.52 ms 402.34 us 2024-03-26T17:09:13.484 INFO:tasks.workunit.client.3.smithi157.stdout:myimage40 4/s 4/s 106 KiB/s 118 KiB/s 2.42 ms 343.30 us 2024-03-26T17:09:13.484 INFO:tasks.workunit.client.3.smithi157.stdout:myimage48 4/s 4/s 138 KiB/s 176 KiB/s 2.70 ms 345.19 us 2024-03-26T17:09:13.484 INFO:tasks.workunit.client.3.smithi157.stdout:myimage46 4/s 3/s 133 KiB/s 84 KiB/s 2.58 ms 350.74 us 2024-03-26T17:09:13.484 INFO:tasks.workunit.client.3.smithi157.stdout:myimage51 4/s 4/s 128 KiB/s 107 KiB/s 3.17 ms 304.75 us 2024-03-26T17:09:13.484 INFO:tasks.workunit.client.3.smithi157.stdout:myimage54 4/s 3/s 134 KiB/s 106 KiB/s 2.53 ms 426.28 us 2024-03-26T17:09:13.484 INFO:tasks.workunit.client.3.smithi157.stdout:myimage28 4/s 3/s 74 KiB/s 57 KiB/s 2.99 ms 333.41 us 2024-03-26T17:09:13.485 INFO:tasks.workunit.client.3.smithi157.stdout:myimage39 4/s 4/s 88 KiB/s 75 KiB/s 2.50 ms 379.14 us 2024-03-26T17:09:13.485 INFO:tasks.workunit.client.3.smithi157.stdout:myimage56 4/s 4/s 139 KiB/s 140 KiB/s 3.25 ms 408.97 us 2024-03-26T17:09:13.485 INFO:tasks.workunit.client.3.smithi157.stdout:myimage16 4/s 5/s 72 KiB/s 99 KiB/s 2.85 ms 393.05 us 2024-03-26T17:09:13.485 INFO:tasks.workunit.client.3.smithi157.stdout:myimage30 4/s 3/s 57 KiB/s 79 KiB/s 3.42 ms 351.71 us 2024-03-26T17:09:13.485 INFO:tasks.workunit.client.3.smithi157.stdout:myimage24 4/s 4/s 75 KiB/s 80 KiB/s 2.33 ms 340.42 us 2024-03-26T17:09:13.485 INFO:tasks.workunit.client.3.smithi157.stdout:myimage25 4/s 5/s 96 KiB/s 125 KiB/s 4.00 ms 407.74 us 2024-03-26T17:09:13.485 INFO:tasks.workunit.client.3.smithi157.stdout:myimage42 4/s 3/s 145 KiB/s 83 KiB/s 2.40 ms 300.79 us 2024-03-26T17:09:13.485 INFO:tasks.workunit.client.3.smithi157.stdout:myimage55 4/s 4/s 101 KiB/s 80 KiB/s 2.86 ms 345.51 us 2024-03-26T17:09:13.485 INFO:tasks.workunit.client.3.smithi157.stdout:myimage3 4/s 4/s 98 KiB/s 156 KiB/s 2.63 ms 369.56 us 2024-03-26T17:09:13.485 INFO:tasks.workunit.client.3.smithi157.stdout:myimage52 4/s 4/s 162 KiB/s 132 KiB/s 2.97 ms 586.00 us 2024-03-26T17:09:13.485 INFO:tasks.workunit.client.3.smithi157.stdout:myimage9 4/s 4/s 110 KiB/s 146 KiB/s 2.84 ms 461.89 us 2024-03-26T17:09:13.485 INFO:tasks.workunit.client.3.smithi157.stdout:myimage33 4/s 5/s 108 KiB/s 144 KiB/s 2.87 ms 356.05 us 2024-03-26T17:09:13.485 INFO:tasks.workunit.client.3.smithi157.stdout:myimage7 4/s 3/s 118 KiB/s 110 KiB/s 2.98 ms 340.27 us 2024-03-26T17:09:13.485 INFO:tasks.workunit.client.3.smithi157.stdout:myimage17 4/s 4/s 123 KiB/s 143 KiB/s 2.57 ms 314.22 us 2024-03-26T17:09:13.485 INFO:tasks.workunit.client.3.smithi157.stdout:myimage18 4/s 4/s 131 KiB/s 144 KiB/s 2.38 ms 429.78 us 2024-03-26T17:09:13.486 INFO:tasks.workunit.client.3.smithi157.stdout:myimage43 4/s 4/s 68 KiB/s 93 KiB/s 2.98 ms 374.27 us 2024-03-26T17:09:13.486 INFO:tasks.workunit.client.3.smithi157.stdout:myimage13 3/s 4/s 118 KiB/s 138 KiB/s 2.32 ms 345.25 us 2024-03-26T17:09:13.486 INFO:tasks.workunit.client.3.smithi157.stdout:myimage22 3/s 5/s 114 KiB/s 147 KiB/s 3.07 ms 324.30 us 2024-03-26T17:09:13.486 INFO:tasks.workunit.client.3.smithi157.stdout:myimage35 3/s 4/s 81 KiB/s 61 KiB/s 2.64 ms 394.52 us 2024-03-26T17:09:13.486 INFO:tasks.workunit.client.3.smithi157.stdout:myimage1 3/s 4/s 97 KiB/s 132 KiB/s 2.32 ms 415.69 us 2024-03-26T17:09:13.486 INFO:tasks.workunit.client.3.smithi157.stdout:myimage4 3/s 5/s 118 KiB/s 114 KiB/s 2.54 ms 317.59 us 2024-03-26T17:09:13.486 INFO:tasks.workunit.client.3.smithi157.stdout:myimage5 3/s 3/s 47 KiB/s 48 KiB/s 2.79 ms 347.25 us 2024-03-26T17:09:13.486 INFO:tasks.workunit.client.3.smithi157.stdout:myimage6 3/s 5/s 130 KiB/s 150 KiB/s 2.85 ms 332.98 us 2024-03-26T17:09:13.486 INFO:tasks.workunit.client.3.smithi157.stdout:myimage8 3/s 3/s 71 KiB/s 49 KiB/s 2.92 ms 300.07 us 2024-03-26T17:09:13.486 INFO:tasks.workunit.client.3.smithi157.stdout:myimage19 3/s 3/s 69 KiB/s 50 KiB/s 2.38 ms 562.17 us 2024-03-26T17:09:13.486 INFO:tasks.workunit.client.3.smithi157.stdout:myimage53 3/s 4/s 98 KiB/s 67 KiB/s 2.72 ms 299.83 us 2024-03-26T17:09:13.486 INFO:tasks.workunit.client.3.smithi157.stdout:myimage23 3/s 3/s 76 KiB/s 50 KiB/s 2.34 ms 345.81 us 2024-03-26T17:09:13.486 INFO:tasks.workunit.client.3.smithi157.stdout:myimage44 3/s 5/s 86 KiB/s 128 KiB/s 2.74 ms 316.24 us 2024-03-26T17:09:13.486 INFO:tasks.workunit.client.3.smithi157.stdout:myimage12 3/s 4/s 78 KiB/s 96 KiB/s 2.73 ms 351.33 us 2024-03-26T17:09:13.486 INFO:tasks.workunit.client.3.smithi157.stdout:myimage27 3/s 4/s 106 KiB/s 160 KiB/s 2.38 ms 347.15 us 2024-03-26T17:09:13.487 INFO:tasks.workunit.client.3.smithi157.stdout:myimage45 3/s 4/s 66 KiB/s 89 KiB/s 2.42 ms 327.71 us 2024-03-26T17:09:13.487 INFO:tasks.workunit.client.3.smithi157.stdout:myimage47 3/s 4/s 112 KiB/s 123 KiB/s 2.88 ms 331.66 us 2024-03-26T17:09:13.487 INFO:tasks.workunit.client.3.smithi157.stdout:myimage11 3/s 4/s 97 KiB/s 71 KiB/s 2.93 ms 343.74 us 2024-03-26T17:09:13.487 INFO:tasks.workunit.client.3.smithi157.stdout:myimage21 3/s 5/s 105 KiB/s 198 KiB/s 3.42 ms 393.13 us 2024-03-26T17:09:13.487 INFO:tasks.workunit.client.3.smithi157.stdout:myimage49 3/s 4/s 64 KiB/s 106 KiB/s 2.59 ms 356.97 us 2024-03-26T17:09:13.487 INFO:tasks.workunit.client.3.smithi157.stdout:myimage60 3/s 5/s 92 KiB/s 96 KiB/s 2.78 ms 379.98 us 2024-03-26T17:09:13.487 INFO:tasks.workunit.client.3.smithi157.stdout:myimage10 3/s 4/s 110 KiB/s 129 KiB/s 2.64 ms 406.47 us 2024-03-26T17:09:13.487 INFO:tasks.workunit.client.3.smithi157.stdout:myimage34 3/s 5/s 58 KiB/s 88 KiB/s 2.58 ms 318.21 us 2024-03-26T17:09:13.487 INFO:tasks.workunit.client.3.smithi157.stdout:myimage15 3/s 4/s 111 KiB/s 137 KiB/s 2.19 ms 340.74 us 2024-03-26T17:09:13.487 INFO:tasks.workunit.client.3.smithi157.stdout:myimage32 2/s 5/s 54 KiB/s 92 KiB/s 2.85 ms 322.59 us 2024-03-26T17:09:13.487 INFO:tasks.workunit.client.3.smithi157.stdout:myimage58 2/s 2/s 65 KiB/s 66 KiB/s 2.37 ms 453.22 us 2024-03-26T17:09:13.487 INFO:tasks.workunit.client.3.smithi157.stdout:myimage59 2/s 5/s 40 KiB/s 134 KiB/s 3.03 ms 429.00 us 2024-03-26T17:09:13.487 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:09:13.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:09:13 smithi044 ceph-mon[30624]: pgmap v702: 33 pgs: 33 active+clean; 1.0 GiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 5.1 MiB/s rd, 5.1 MiB/s wr, 496 op/s 2024-03-26T17:09:13.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:09:13 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:09:13] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:09:13.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:09:13 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:09:13] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:09:13.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:09:13 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:09:13.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:09:13 smithi064 ceph-mon[34420]: pgmap v702: 33 pgs: 33 active+clean; 1.0 GiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 5.1 MiB/s rd, 5.1 MiB/s wr, 496 op/s 2024-03-26T17:09:13.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:09:13 smithi149 ceph-mon[34678]: pgmap v702: 33 pgs: 33 active+clean; 1.0 GiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 5.1 MiB/s rd, 5.1 MiB/s wr, 496 op/s 2024-03-26T17:09:13.646 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:09:13 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:09:13] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:09:13.646 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:09:13 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:09:13] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:09:13.646 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:09:13 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:09:14.456 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:09:14 smithi064 ceph-mon[34420]: Health check update: 3 slow ops, oldest one blocked for 648 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:09:14.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:09:14 smithi044 ceph-mon[30624]: Health check update: 3 slow ops, oldest one blocked for 648 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:09:14.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:09:14 smithi149 ceph-mon[34678]: Health check update: 3 slow ops, oldest one blocked for 648 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:09:15.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:09:15 smithi044 ceph-mon[30624]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:09:15.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:09:15 smithi044 ceph-mon[30624]: { 2024-03-26T17:09:15.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:09:15 smithi044 ceph-mon[30624]: "prefix": "rbd perf image stats", 2024-03-26T17:09:15.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:09:15 smithi044 ceph-mon[30624]: "pool_spec": "mypool", 2024-03-26T17:09:15.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:09:15 smithi044 ceph-mon[30624]: "sort_by": "write_ops", 2024-03-26T17:09:15.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:09:15 smithi044 ceph-mon[30624]: "format": "json" 2024-03-26T17:09:15.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:09:15 smithi044 ceph-mon[30624]: }"]: dispatch 2024-03-26T17:09:15.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:09:15 smithi044 ceph-mon[30624]: pgmap v703: 33 pgs: 33 active+clean; 1.0 GiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 5.8 MiB/s rd, 5.7 MiB/s wr, 522 op/s 2024-03-26T17:09:15.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:09:15 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:09:15] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:09:15.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:09:15 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:09:15] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:09:15.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:09:15 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:09:15.547 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:09:15 smithi149 ceph-mon[34678]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:09:15.547 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:09:15 smithi149 ceph-mon[34678]: { 2024-03-26T17:09:15.547 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:09:15 smithi149 ceph-mon[34678]: "prefix": "rbd perf image stats", 2024-03-26T17:09:15.547 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:09:15 smithi149 ceph-mon[34678]: "pool_spec": "mypool", 2024-03-26T17:09:15.547 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:09:15 smithi149 ceph-mon[34678]: "sort_by": "write_ops", 2024-03-26T17:09:15.548 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:09:15 smithi149 ceph-mon[34678]: "format": "json" 2024-03-26T17:09:15.548 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:09:15 smithi149 ceph-mon[34678]: }"]: dispatch 2024-03-26T17:09:15.548 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:09:15 smithi149 ceph-mon[34678]: pgmap v703: 33 pgs: 33 active+clean; 1.0 GiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 5.8 MiB/s rd, 5.7 MiB/s wr, 522 op/s 2024-03-26T17:09:15.548 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:09:15 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:09:15] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:09:15.548 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:09:15 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:09:15] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:09:15.548 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:09:15 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:09:15.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:09:15 smithi064 ceph-mon[34420]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:09:15.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:09:15 smithi064 ceph-mon[34420]: { 2024-03-26T17:09:15.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:09:15 smithi064 ceph-mon[34420]: "prefix": "rbd perf image stats", 2024-03-26T17:09:15.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:09:15 smithi064 ceph-mon[34420]: "pool_spec": "mypool", 2024-03-26T17:09:15.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:09:15 smithi064 ceph-mon[34420]: "sort_by": "write_ops", 2024-03-26T17:09:15.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:09:15 smithi064 ceph-mon[34420]: "format": "json" 2024-03-26T17:09:15.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:09:15 smithi064 ceph-mon[34420]: }"]: dispatch 2024-03-26T17:09:15.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:09:15 smithi064 ceph-mon[34420]: pgmap v703: 33 pgs: 33 active+clean; 1.0 GiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 5.8 MiB/s rd, 5.7 MiB/s wr, 522 op/s 2024-03-26T17:09:16.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:09:16 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 2024-03-26T17:09:16.238+0000 7fa707a55700 -1 mon.c@1(peon) e3 get_health_metrics reporting 3 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T17:09:17.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:09:17 smithi044 ceph-mon[30624]: pgmap v704: 33 pgs: 33 active+clean; 1.0 GiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 6.0 MiB/s rd, 6.1 MiB/s wr, 521 op/s 2024-03-26T17:09:17.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:09:17 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:09:17] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:09:17.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:09:17 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:09:17] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:09:17.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:09:17 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:09:17.547 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:09:17 smithi149 ceph-mon[34678]: pgmap v704: 33 pgs: 33 active+clean; 1.0 GiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 6.0 MiB/s rd, 6.1 MiB/s wr, 521 op/s 2024-03-26T17:09:17.547 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:09:17 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:09:17] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:09:17.547 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:09:17 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:09:17] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:09:17.548 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:09:17 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:09:17.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:09:17 smithi064 ceph-mon[34420]: pgmap v704: 33 pgs: 33 active+clean; 1.0 GiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 6.0 MiB/s rd, 6.1 MiB/s wr, 521 op/s 2024-03-26T17:09:18.487 INFO:tasks.workunit.client.3.smithi157.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-26T17:09:18.487 INFO:tasks.workunit.client.3.smithi157.stdout:myimage5 6/s 4/s 124 KiB/s 101 KiB/s 2.75 ms 328.10 us 2024-03-26T17:09:18.487 INFO:tasks.workunit.client.3.smithi157.stdout:myimage12 5/s 2/s 96 KiB/s 38 KiB/s 2.90 ms 490.55 us 2024-03-26T17:09:18.487 INFO:tasks.workunit.client.3.smithi157.stdout:myimage32 5/s 5/s 126 KiB/s 101 KiB/s 2.55 ms 336.38 us 2024-03-26T17:09:18.487 INFO:tasks.workunit.client.3.smithi157.stdout:myimage8 5/s 4/s 153 KiB/s 174 KiB/s 2.76 ms 407.93 us 2024-03-26T17:09:18.488 INFO:tasks.workunit.client.3.smithi157.stdout:myimage54 5/s 4/s 198 KiB/s 131 KiB/s 2.54 ms 333.06 us 2024-03-26T17:09:18.488 INFO:tasks.workunit.client.3.smithi157.stdout:myimage11 5/s 3/s 104 KiB/s 52 KiB/s 3.33 ms 286.42 us 2024-03-26T17:09:18.488 INFO:tasks.workunit.client.3.smithi157.stdout:myimage58 5/s 6/s 178 KiB/s 173 KiB/s 2.33 ms 371.11 us 2024-03-26T17:09:18.488 INFO:tasks.workunit.client.3.smithi157.stdout:myimage28 5/s 3/s 95 KiB/s 88 KiB/s 3.47 ms 360.59 us 2024-03-26T17:09:18.488 INFO:tasks.workunit.client.3.smithi157.stdout:myimage55 5/s 3/s 64 KiB/s 83 KiB/s 2.38 ms 511.22 us 2024-03-26T17:09:18.488 INFO:tasks.workunit.client.3.smithi157.stdout:myimage40 5/s 3/s 175 KiB/s 146 KiB/s 2.56 ms 327.53 us 2024-03-26T17:09:18.488 INFO:tasks.workunit.client.3.smithi157.stdout:myimage21 5/s 3/s 125 KiB/s 121 KiB/s 3.12 ms 493.24 us 2024-03-26T17:09:18.488 INFO:tasks.workunit.client.3.smithi157.stdout:myimage39 5/s 4/s 112 KiB/s 102 KiB/s 2.60 ms 387.84 us 2024-03-26T17:09:18.488 INFO:tasks.workunit.client.3.smithi157.stdout:myimage45 5/s 4/s 154 KiB/s 104 KiB/s 2.52 ms 328.36 us 2024-03-26T17:09:18.488 INFO:tasks.workunit.client.3.smithi157.stdout:myimage35 4/s 3/s 114 KiB/s 69 KiB/s 2.75 ms 307.37 us 2024-03-26T17:09:18.488 INFO:tasks.workunit.client.3.smithi157.stdout:myimage9 4/s 5/s 145 KiB/s 166 KiB/s 2.89 ms 371.16 us 2024-03-26T17:09:18.488 INFO:tasks.workunit.client.3.smithi157.stdout:myimage25 4/s 3/s 157 KiB/s 119 KiB/s 3.27 ms 484.18 us 2024-03-26T17:09:18.488 INFO:tasks.workunit.client.3.smithi157.stdout:myimage60 4/s 3/s 149 KiB/s 101 KiB/s 2.97 ms 428.43 us 2024-03-26T17:09:18.488 INFO:tasks.workunit.client.3.smithi157.stdout:myimage13 4/s 4/s 167 KiB/s 139 KiB/s 2.28 ms 481.63 us 2024-03-26T17:09:18.488 INFO:tasks.workunit.client.3.smithi157.stdout:myimage34 4/s 4/s 87 KiB/s 96 KiB/s 2.21 ms 414.75 us 2024-03-26T17:09:18.489 INFO:tasks.workunit.client.3.smithi157.stdout:myimage37 4/s 3/s 170 KiB/s 116 KiB/s 2.91 ms 380.84 us 2024-03-26T17:09:18.489 INFO:tasks.workunit.client.3.smithi157.stdout:myimage44 4/s 4/s 150 KiB/s 146 KiB/s 2.84 ms 348.90 us 2024-03-26T17:09:18.489 INFO:tasks.workunit.client.3.smithi157.stdout:myimage1 4/s 4/s 165 KiB/s 107 KiB/s 2.08 ms 295.22 us 2024-03-26T17:09:18.489 INFO:tasks.workunit.client.3.smithi157.stdout:myimage4 4/s 3/s 125 KiB/s 99 KiB/s 2.77 ms 426.26 us 2024-03-26T17:09:18.489 INFO:tasks.workunit.client.3.smithi157.stdout:myimage27 4/s 3/s 121 KiB/s 89 KiB/s 2.35 ms 346.09 us 2024-03-26T17:09:18.489 INFO:tasks.workunit.client.3.smithi157.stdout:myimage22 4/s 3/s 141 KiB/s 88 KiB/s 2.94 ms 344.98 us 2024-03-26T17:09:18.489 INFO:tasks.workunit.client.3.smithi157.stdout:myimage30 4/s 4/s 86 KiB/s 77 KiB/s 3.18 ms 308.29 us 2024-03-26T17:09:18.489 INFO:tasks.workunit.client.3.smithi157.stdout:myimage19 4/s 6/s 124 KiB/s 150 KiB/s 2.79 ms 464.23 us 2024-03-26T17:09:18.489 INFO:tasks.workunit.client.3.smithi157.stdout:myimage29 4/s 4/s 123 KiB/s 126 KiB/s 2.44 ms 434.39 us 2024-03-26T17:09:18.489 INFO:tasks.workunit.client.3.smithi157.stdout:myimage33 4/s 4/s 162 KiB/s 142 KiB/s 2.58 ms 419.46 us 2024-03-26T17:09:18.489 INFO:tasks.workunit.client.3.smithi157.stdout:myimage36 4/s 3/s 174 KiB/s 106 KiB/s 2.47 ms 338.42 us 2024-03-26T17:09:18.489 INFO:tasks.workunit.client.3.smithi157.stdout:myimage42 4/s 3/s 120 KiB/s 82 KiB/s 2.58 ms 366.44 us 2024-03-26T17:09:18.489 INFO:tasks.workunit.client.3.smithi157.stdout:myimage56 4/s 3/s 125 KiB/s 79 KiB/s 3.24 ms 355.12 us 2024-03-26T17:09:18.489 INFO:tasks.workunit.client.3.smithi157.stdout:myimage23 4/s 4/s 102 KiB/s 124 KiB/s 2.25 ms 307.29 us 2024-03-26T17:09:18.490 INFO:tasks.workunit.client.3.smithi157.stdout:myimage47 4/s 3/s 159 KiB/s 90 KiB/s 3.10 ms 332.28 us 2024-03-26T17:09:18.490 INFO:tasks.workunit.client.3.smithi157.stdout:myimage48 4/s 3/s 113 KiB/s 90 KiB/s 2.88 ms 517.55 us 2024-03-26T17:09:18.490 INFO:tasks.workunit.client.3.smithi157.stdout:myimage52 4/s 4/s 113 KiB/s 122 KiB/s 3.05 ms 317.95 us 2024-03-26T17:09:18.490 INFO:tasks.workunit.client.3.smithi157.stdout:myimage24 4/s 3/s 67 KiB/s 54 KiB/s 2.24 ms 359.65 us 2024-03-26T17:09:18.490 INFO:tasks.workunit.client.3.smithi157.stdout:myimage46 4/s 3/s 114 KiB/s 83 KiB/s 2.34 ms 354.19 us 2024-03-26T17:09:18.490 INFO:tasks.workunit.client.3.smithi157.stdout:myimage51 4/s 4/s 125 KiB/s 144 KiB/s 3.08 ms 357.30 us 2024-03-26T17:09:18.490 INFO:tasks.workunit.client.3.smithi157.stdout:myimage3 4/s 4/s 122 KiB/s 187 KiB/s 2.30 ms 474.06 us 2024-03-26T17:09:18.490 INFO:tasks.workunit.client.3.smithi157.stdout:myimage49 3/s 4/s 69 KiB/s 77 KiB/s 2.85 ms 341.89 us 2024-03-26T17:09:18.490 INFO:tasks.workunit.client.3.smithi157.stdout:myimage6 3/s 3/s 104 KiB/s 74 KiB/s 2.68 ms 516.08 us 2024-03-26T17:09:18.490 INFO:tasks.workunit.client.3.smithi157.stdout:myimage7 3/s 4/s 78 KiB/s 131 KiB/s 2.83 ms 344.30 us 2024-03-26T17:09:18.490 INFO:tasks.workunit.client.3.smithi157.stdout:myimage17 3/s 4/s 138 KiB/s 122 KiB/s 2.91 ms 383.70 us 2024-03-26T17:09:18.490 INFO:tasks.workunit.client.3.smithi157.stdout:myimage26 3/s 3/s 67 KiB/s 60 KiB/s 2.61 ms 303.59 us 2024-03-26T17:09:18.490 INFO:tasks.workunit.client.3.smithi157.stdout:myimage10 3/s 4/s 110 KiB/s 166 KiB/s 2.55 ms 343.93 us 2024-03-26T17:09:18.490 INFO:tasks.workunit.client.3.smithi157.stdout:myimage14 3/s 3/s 96 KiB/s 123 KiB/s 2.77 ms 594.84 us 2024-03-26T17:09:18.490 INFO:tasks.workunit.client.3.smithi157.stdout:myimage16 3/s 3/s 96 KiB/s 65 KiB/s 2.22 ms 314.76 us 2024-03-26T17:09:18.491 INFO:tasks.workunit.client.3.smithi157.stdout:myimage18 3/s 4/s 87 KiB/s 142 KiB/s 2.40 ms 534.37 us 2024-03-26T17:09:18.491 INFO:tasks.workunit.client.3.smithi157.stdout:myimage20 3/s 3/s 98 KiB/s 100 KiB/s 2.25 ms 337.77 us 2024-03-26T17:09:18.491 INFO:tasks.workunit.client.3.smithi157.stdout:myimage53 3/s 4/s 66 KiB/s 61 KiB/s 2.71 ms 385.23 us 2024-03-26T17:09:18.491 INFO:tasks.workunit.client.3.smithi157.stdout:myimage57 3/s 2/s 98 KiB/s 90 KiB/s 2.45 ms 371.83 us 2024-03-26T17:09:18.491 INFO:tasks.workunit.client.3.smithi157.stdout:myimage15 3/s 4/s 117 KiB/s 172 KiB/s 2.20 ms 486.48 us 2024-03-26T17:09:18.491 INFO:tasks.workunit.client.3.smithi157.stdout:myimage43 3/s 4/s 65 KiB/s 78 KiB/s 2.33 ms 367.40 us 2024-03-26T17:09:18.491 INFO:tasks.workunit.client.3.smithi157.stdout:myimage41 3/s 4/s 112 KiB/s 126 KiB/s 2.82 ms 371.29 us 2024-03-26T17:09:18.491 INFO:tasks.workunit.client.3.smithi157.stdout:myimage50 3/s 2/s 79 KiB/s 106 KiB/s 2.76 ms 352.87 us 2024-03-26T17:09:18.491 INFO:tasks.workunit.client.3.smithi157.stdout:myimage59 3/s 4/s 98 KiB/s 146 KiB/s 2.86 ms 382.41 us 2024-03-26T17:09:18.491 INFO:tasks.workunit.client.3.smithi157.stdout:myimage2 3/s 4/s 96 KiB/s 148 KiB/s 2.92 ms 419.65 us 2024-03-26T17:09:18.491 INFO:tasks.workunit.client.3.smithi157.stdout:myimage38 2/s 3/s 72 KiB/s 89 KiB/s 2.30 ms 434.32 us 2024-03-26T17:09:18.491 INFO:tasks.workunit.client.3.smithi157.stdout:myimage31 2/s 5/s 86 KiB/s 169 KiB/s 3.50 ms 347.33 us 2024-03-26T17:09:18.491 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:09:19.430 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:09:19 smithi149 ceph-mon[34678]: pgmap v705: 33 pgs: 33 active+clean; 1.0 GiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 5.6 MiB/s rd, 5.7 MiB/s wr, 463 op/s 2024-03-26T17:09:19.430 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:09:19 smithi149 ceph-mon[34678]: Health check update: 3 slow ops, oldest one blocked for 653 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:09:19.431 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:09:19 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:09:19] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:09:19.431 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:09:19 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:09:19] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:09:19.431 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:09:19 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:09:19.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:09:19 smithi044 ceph-mon[30624]: pgmap v705: 33 pgs: 33 active+clean; 1.0 GiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 5.6 MiB/s rd, 5.7 MiB/s wr, 463 op/s 2024-03-26T17:09:19.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:09:19 smithi044 ceph-mon[30624]: Health check update: 3 slow ops, oldest one blocked for 653 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:09:19.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:09:19 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:09:19] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:09:19.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:09:19 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:09:19] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:09:19.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:09:19 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:09:19.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:09:19 smithi064 ceph-mon[34420]: pgmap v705: 33 pgs: 33 active+clean; 1.0 GiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 5.6 MiB/s rd, 5.7 MiB/s wr, 463 op/s 2024-03-26T17:09:19.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:09:19 smithi064 ceph-mon[34420]: Health check update: 3 slow ops, oldest one blocked for 653 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:09:20.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:09:20 smithi044 ceph-mon[30624]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:09:20.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:09:20 smithi044 ceph-mon[30624]: { 2024-03-26T17:09:20.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:09:20 smithi044 ceph-mon[30624]: "prefix": "rbd perf image stats", 2024-03-26T17:09:20.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:09:20 smithi044 ceph-mon[30624]: "pool_spec": "mypool", 2024-03-26T17:09:20.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:09:20 smithi044 ceph-mon[30624]: "sort_by": "write_ops", 2024-03-26T17:09:20.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:09:20 smithi044 ceph-mon[30624]: "format": "json" 2024-03-26T17:09:20.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:09:20 smithi044 ceph-mon[30624]: }"]: dispatch 2024-03-26T17:09:20.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:09:20 smithi064 ceph-mon[34420]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:09:20.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:09:20 smithi064 ceph-mon[34420]: { 2024-03-26T17:09:20.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:09:20 smithi064 ceph-mon[34420]: "prefix": "rbd perf image stats", 2024-03-26T17:09:20.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:09:20 smithi064 ceph-mon[34420]: "pool_spec": "mypool", 2024-03-26T17:09:20.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:09:20 smithi064 ceph-mon[34420]: "sort_by": "write_ops", 2024-03-26T17:09:20.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:09:20 smithi064 ceph-mon[34420]: "format": "json" 2024-03-26T17:09:20.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:09:20 smithi064 ceph-mon[34420]: }"]: dispatch 2024-03-26T17:09:20.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:09:20 smithi149 ceph-mon[34678]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:09:20.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:09:20 smithi149 ceph-mon[34678]: { 2024-03-26T17:09:20.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:09:20 smithi149 ceph-mon[34678]: "prefix": "rbd perf image stats", 2024-03-26T17:09:20.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:09:20 smithi149 ceph-mon[34678]: "pool_spec": "mypool", 2024-03-26T17:09:20.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:09:20 smithi149 ceph-mon[34678]: "sort_by": "write_ops", 2024-03-26T17:09:20.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:09:20 smithi149 ceph-mon[34678]: "format": "json" 2024-03-26T17:09:20.647 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:09:20 smithi149 ceph-mon[34678]: }"]: dispatch 2024-03-26T17:09:21.434 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:09:21 smithi149 ceph-mon[34678]: pgmap v706: 33 pgs: 33 active+clean; 1.0 GiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 6.4 MiB/s rd, 6.5 MiB/s wr, 502 op/s 2024-03-26T17:09:21.434 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:09:21 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 2024-03-26T17:09:21.238+0000 7fa707a55700 -1 mon.c@1(peon) e3 get_health_metrics reporting 3 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T17:09:21.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:09:21 smithi044 ceph-mon[30624]: pgmap v706: 33 pgs: 33 active+clean; 1.0 GiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 6.4 MiB/s rd, 6.5 MiB/s wr, 502 op/s 2024-03-26T17:09:21.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:09:21 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:09:21] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:09:21.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:09:21 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:09:21] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:09:21.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:09:21 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:09:21.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:09:21 smithi064 ceph-mon[34420]: pgmap v706: 33 pgs: 33 active+clean; 1.0 GiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 6.4 MiB/s rd, 6.5 MiB/s wr, 502 op/s 2024-03-26T17:09:21.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:09:21 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:09:21] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:09:21.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:09:21 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:09:21] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:09:21.897 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:09:21 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:09:23.062 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:09:23.071 INFO:tasks.workunit.client.3.smithi157.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2024-03-26T17:09:23.071 INFO:tasks.workunit.client.3.smithi157.stdout: 8.00 126.0k 128.8k 0.0k 1.2M 1.3M 0.0k nvme2n1 2024-03-26T17:09:23.071 INFO:tasks.workunit.client.3.smithi157.stdout: 8.00 125.6k 142.0k 0.0k 1.2M 1.4M 0.0k nvme2n10 2024-03-26T17:09:23.072 INFO:tasks.workunit.client.3.smithi157.stdout: 8.00 72.8k 69.6k 0.0k 728.0k 696.0k 0.0k nvme2n11 2024-03-26T17:09:23.072 INFO:tasks.workunit.client.3.smithi157.stdout: 8.00 56.4k 79.6k 0.0k 564.0k 796.0k 0.0k nvme2n12 2024-03-26T17:09:23.072 INFO:tasks.workunit.client.3.smithi157.stdout: 8.00 138.8k 119.2k 0.0k 1.4M 1.2M 0.0k nvme2n13 2024-03-26T17:09:23.072 INFO:tasks.workunit.client.3.smithi157.stdout: 8.00 128.0k 149.2k 0.0k 1.2M 1.5M 0.0k nvme2n14 2024-03-26T17:09:23.072 INFO:tasks.workunit.client.3.smithi157.stdout: 8.00 120.8k 127.2k 0.0k 1.2M 1.2M 0.0k nvme2n15 2024-03-26T17:09:23.072 INFO:tasks.workunit.client.3.smithi157.stdout: 8.00 112.8k 128.0k 0.0k 1.1M 1.2M 0.0k nvme2n16 2024-03-26T17:09:23.072 INFO:tasks.workunit.client.3.smithi157.stdout: 8.00 129.6k 113.6k 0.0k 1.3M 1.1M 0.0k nvme2n17 2024-03-26T17:09:23.072 INFO:tasks.workunit.client.3.smithi157.stdout: 8.00 123.2k 114.8k 0.0k 1.2M 1.1M 0.0k nvme2n18 2024-03-26T17:09:23.072 INFO:tasks.workunit.client.3.smithi157.stdout: 8.00 124.0k 138.8k 0.0k 1.2M 1.4M 0.0k nvme2n19 2024-03-26T17:09:23.072 INFO:tasks.workunit.client.3.smithi157.stdout: 8.00 158.4k 122.4k 0.0k 1.5M 1.2M 0.0k nvme2n2 2024-03-26T17:09:23.072 INFO:tasks.workunit.client.3.smithi157.stdout: 8.00 128.8k 84.0k 0.0k 1.3M 840.0k 0.0k nvme2n20 2024-03-26T17:09:23.072 INFO:tasks.workunit.client.3.smithi157.stdout: 8.00 136.8k 135.6k 0.0k 1.3M 1.3M 0.0k nvme2n3 2024-03-26T17:09:23.072 INFO:tasks.workunit.client.3.smithi157.stdout: 8.00 112.8k 117.6k 0.0k 1.1M 1.1M 0.0k nvme2n4 2024-03-26T17:09:23.072 INFO:tasks.workunit.client.3.smithi157.stdout: 8.00 107.6k 126.0k 0.0k 1.1M 1.2M 0.0k nvme2n5 2024-03-26T17:09:23.073 INFO:tasks.workunit.client.3.smithi157.stdout: 8.00 107.2k 99.2k 0.0k 1.0M 992.0k 0.0k nvme2n6 2024-03-26T17:09:23.073 INFO:tasks.workunit.client.3.smithi157.stdout: 8.00 128.4k 82.8k 0.0k 1.3M 828.0k 0.0k nvme2n7 2024-03-26T17:09:23.073 INFO:tasks.workunit.client.3.smithi157.stdout: 8.00 117.6k 144.4k 0.0k 1.1M 1.4M 0.0k nvme2n8 2024-03-26T17:09:23.073 INFO:tasks.workunit.client.3.smithi157.stdout: 8.00 124.0k 124.0k 0.0k 1.2M 1.2M 0.0k nvme2n9 2024-03-26T17:09:23.073 INFO:tasks.workunit.client.3.smithi157.stdout: 8.00 105.2k 97.6k 0.0k 1.0M 976.0k 0.0k nvme5n1 2024-03-26T17:09:23.073 INFO:tasks.workunit.client.3.smithi157.stdout: 8.00 92.4k 70.8k 0.0k 924.0k 708.0k 0.0k nvme5n10 2024-03-26T17:09:23.073 INFO:tasks.workunit.client.3.smithi157.stdout: 8.00 124.0k 118.0k 0.0k 1.2M 1.2M 0.0k nvme5n11 2024-03-26T17:09:23.073 INFO:tasks.workunit.client.3.smithi157.stdout: 8.10 136.0k 96.8k 0.0k 1.3M 968.0k 0.0k nvme5n12 2024-03-26T17:09:23.073 INFO:tasks.workunit.client.3.smithi157.stdout: 8.00 120.0k 97.6k 0.0k 1.2M 976.0k 0.0k nvme5n13 2024-03-26T17:09:23.073 INFO:tasks.workunit.client.3.smithi157.stdout: 8.00 109.2k 135.2k 0.0k 1.1M 1.3M 0.0k nvme5n14 2024-03-26T17:09:23.073 INFO:tasks.workunit.client.3.smithi157.stdout: 8.00 74.0k 75.2k 0.0k 740.0k 752.0k 0.0k nvme5n15 2024-03-26T17:09:23.073 INFO:tasks.workunit.client.3.smithi157.stdout: 8.00 153.6k 96.8k 0.0k 1.5M 968.0k 0.0k nvme5n16 2024-03-26T17:09:23.073 INFO:tasks.workunit.client.3.smithi157.stdout: 8.00 122.0k 132.8k 0.0k 1.2M 1.3M 0.0k nvme5n17 2024-03-26T17:09:23.074 INFO:tasks.workunit.client.3.smithi157.stdout: 8.00 136.8k 124.8k 0.0k 1.3M 1.2M 0.0k nvme5n18 2024-03-26T17:09:23.074 INFO:tasks.workunit.client.3.smithi157.stdout: 8.00 118.4k 145.2k 0.0k 1.2M 1.4M 0.0k nvme5n19 2024-03-26T17:09:23.074 INFO:tasks.workunit.client.3.smithi157.stdout: 8.00 129.6k 134.8k 0.0k 1.3M 1.3M 0.0k nvme5n2 2024-03-26T17:09:23.074 INFO:tasks.workunit.client.3.smithi157.stdout: 8.00 152.0k 108.8k 0.0k 1.5M 1.1M 0.0k nvme5n20 2024-03-26T17:09:23.074 INFO:tasks.workunit.client.3.smithi157.stdout: 8.00 118.8k 140.0k 0.0k 1.2M 1.4M 0.0k nvme5n3 2024-03-26T17:09:23.074 INFO:tasks.workunit.client.3.smithi157.stdout: 8.00 80.4k 103.6k 0.0k 804.0k 1.0M 0.0k nvme5n4 2024-03-26T17:09:23.074 INFO:tasks.workunit.client.3.smithi157.stdout: 8.00 138.4k 95.2k 0.0k 1.4M 952.0k 0.0k nvme5n5 2024-03-26T17:09:23.074 INFO:tasks.workunit.client.3.smithi157.stdout: 8.00 80.0k 136.0k 0.0k 800.0k 1.3M 0.0k nvme5n6 2024-03-26T17:09:23.074 INFO:tasks.workunit.client.3.smithi157.stdout: 8.00 106.8k 101.2k 0.0k 1.0M 1012.0k 0.0k nvme5n7 2024-03-26T17:09:23.074 INFO:tasks.workunit.client.3.smithi157.stdout: 8.00 102.0k 134.0k 0.0k 1020.0k 1.3M 0.0k nvme5n8 2024-03-26T17:09:23.074 INFO:tasks.workunit.client.3.smithi157.stdout: 8.00 98.0k 131.2k 0.0k 980.0k 1.3M 0.0k nvme5n9 2024-03-26T17:09:23.074 INFO:tasks.workunit.client.3.smithi157.stdout: 8.00 120.8k 150.4k 0.0k 1.2M 1.5M 0.0k nvme8n1 2024-03-26T17:09:23.074 INFO:tasks.workunit.client.3.smithi157.stdout: 8.00 112.0k 111.6k 0.0k 1.1M 1.1M 0.0k nvme8n10 2024-03-26T17:09:23.075 INFO:tasks.workunit.client.3.smithi157.stdout: 8.10 143.2k 118.8k 0.0k 1.4M 1.2M 0.0k nvme8n11 2024-03-26T17:09:23.075 INFO:tasks.workunit.client.3.smithi157.stdout: 8.00 127.2k 122.8k 0.0k 1.2M 1.2M 0.0k nvme8n12 2024-03-26T17:09:23.075 INFO:tasks.workunit.client.3.smithi157.stdout: 8.00 78.4k 80.8k 0.0k 784.0k 808.0k 0.0k nvme8n13 2024-03-26T17:09:23.075 INFO:tasks.workunit.client.3.smithi157.stdout: 8.00 118.8k 132.8k 0.0k 1.2M 1.3M 0.0k nvme8n14 2024-03-26T17:09:23.075 INFO:tasks.workunit.client.3.smithi157.stdout: 8.00 91.2k 98.4k 0.0k 912.0k 984.0k 0.0k nvme8n15 2024-03-26T17:09:23.075 INFO:tasks.workunit.client.3.smithi157.stdout: 8.00 83.6k 119.2k 0.0k 836.0k 1.2M 0.0k nvme8n16 2024-03-26T17:09:23.075 INFO:tasks.workunit.client.3.smithi157.stdout: 8.00 142.8k 140.8k 0.0k 1.4M 1.4M 0.0k nvme8n17 2024-03-26T17:09:23.075 INFO:tasks.workunit.client.3.smithi157.stdout: 8.00 128.0k 141.2k 0.0k 1.2M 1.4M 0.0k nvme8n18 2024-03-26T17:09:23.075 INFO:tasks.workunit.client.3.smithi157.stdout: 8.00 109.6k 106.8k 0.0k 1.1M 1.0M 0.0k nvme8n19 2024-03-26T17:09:23.075 INFO:tasks.workunit.client.3.smithi157.stdout: 8.00 132.4k 121.2k 0.0k 1.3M 1.2M 0.0k nvme8n2 2024-03-26T17:09:23.075 INFO:tasks.workunit.client.3.smithi157.stdout: 8.00 136.4k 121.2k 0.0k 1.3M 1.2M 0.0k nvme8n20 2024-03-26T17:09:23.075 INFO:tasks.workunit.client.3.smithi157.stdout: 8.00 113.2k 103.6k 0.0k 1.1M 1.0M 0.0k nvme8n3 2024-03-26T17:09:23.075 INFO:tasks.workunit.client.3.smithi157.stdout: 8.00 100.8k 143.2k 0.0k 1008.0k 1.4M 0.0k nvme8n4 2024-03-26T17:09:23.075 INFO:tasks.workunit.client.3.smithi157.stdout: 8.00 141.2k 157.6k 0.0k 1.4M 1.5M 0.0k nvme8n5 2024-03-26T17:09:23.075 INFO:tasks.workunit.client.3.smithi157.stdout: 8.00 128.4k 122.8k 0.0k 1.3M 1.2M 0.0k nvme8n6 2024-03-26T17:09:23.076 INFO:tasks.workunit.client.3.smithi157.stdout: 8.00 112.8k 144.4k 0.0k 1.1M 1.4M 0.0k nvme8n7 2024-03-26T17:09:23.076 INFO:tasks.workunit.client.3.smithi157.stdout: 8.00 114.4k 117.2k 0.0k 1.1M 1.1M 0.0k nvme8n8 2024-03-26T17:09:23.076 INFO:tasks.workunit.client.3.smithi157.stdout: 8.00 90.8k 91.2k 0.0k 908.0k 912.0k 0.0k nvme8n9 2024-03-26T17:09:23.076 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:09:23.447 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:09:23 smithi149 ceph-mon[34678]: pgmap v707: 33 pgs: 33 active+clean; 1.0 GiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 6.2 MiB/s rd, 6.5 MiB/s wr, 476 op/s 2024-03-26T17:09:23.491 INFO:tasks.workunit.client.3.smithi157.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-26T17:09:23.491 INFO:tasks.workunit.client.3.smithi157.stdout:myimage28 5/s 3/s 174 KiB/s 103 KiB/s 3.34 ms 426.49 us 2024-03-26T17:09:23.491 INFO:tasks.workunit.client.3.smithi157.stdout:myimage1 5/s 3/s 142 KiB/s 114 KiB/s 2.31 ms 347.32 us 2024-03-26T17:09:23.491 INFO:tasks.workunit.client.3.smithi157.stdout:myimage2 5/s 5/s 148 KiB/s 175 KiB/s 2.49 ms 374.98 us 2024-03-26T17:09:23.491 INFO:tasks.workunit.client.3.smithi157.stdout:myimage23 5/s 4/s 171 KiB/s 112 KiB/s 2.40 ms 316.51 us 2024-03-26T17:09:23.491 INFO:tasks.workunit.client.3.smithi157.stdout:myimage26 5/s 2/s 157 KiB/s 67 KiB/s 2.69 ms 380.91 us 2024-03-26T17:09:23.491 INFO:tasks.workunit.client.3.smithi157.stdout:myimage22 4/s 5/s 172 KiB/s 166 KiB/s 2.58 ms 388.53 us 2024-03-26T17:09:23.492 INFO:tasks.workunit.client.3.smithi157.stdout:myimage7 4/s 3/s 130 KiB/s 115 KiB/s 2.68 ms 409.74 us 2024-03-26T17:09:23.492 INFO:tasks.workunit.client.3.smithi157.stdout:myimage11 4/s 2/s 85 KiB/s 48 KiB/s 2.92 ms 338.36 us 2024-03-26T17:09:23.492 INFO:tasks.workunit.client.3.smithi157.stdout:myimage50 4/s 4/s 138 KiB/s 118 KiB/s 2.61 ms 359.67 us 2024-03-26T17:09:23.492 INFO:tasks.workunit.client.3.smithi157.stdout:myimage3 4/s 3/s 134 KiB/s 90 KiB/s 2.16 ms 480.13 us 2024-03-26T17:09:23.492 INFO:tasks.workunit.client.3.smithi157.stdout:myimage16 4/s 4/s 141 KiB/s 139 KiB/s 2.59 ms 393.30 us 2024-03-26T17:09:23.492 INFO:tasks.workunit.client.3.smithi157.stdout:myimage31 4/s 2/s 134 KiB/s 63 KiB/s 2.90 ms 349.38 us 2024-03-26T17:09:23.492 INFO:tasks.workunit.client.3.smithi157.stdout:myimage34 4/s 3/s 164 KiB/s 112 KiB/s 2.47 ms 503.15 us 2024-03-26T17:09:23.492 INFO:tasks.workunit.client.3.smithi157.stdout:myimage37 4/s 3/s 130 KiB/s 118 KiB/s 2.85 ms 361.85 us 2024-03-26T17:09:23.492 INFO:tasks.workunit.client.3.smithi157.stdout:myimage38 4/s 3/s 139 KiB/s 126 KiB/s 2.24 ms 302.83 us 2024-03-26T17:09:23.492 INFO:tasks.workunit.client.3.smithi157.stdout:myimage48 4/s 5/s 135 KiB/s 158 KiB/s 2.65 ms 388.38 us 2024-03-26T17:09:23.492 INFO:tasks.workunit.client.3.smithi157.stdout:myimage19 4/s 3/s 167 KiB/s 107 KiB/s 2.95 ms 425.46 us 2024-03-26T17:09:23.492 INFO:tasks.workunit.client.3.smithi157.stdout:myimage20 4/s 3/s 93 KiB/s 106 KiB/s 2.85 ms 493.19 us 2024-03-26T17:09:23.492 INFO:tasks.workunit.client.3.smithi157.stdout:myimage29 4/s 3/s 143 KiB/s 86 KiB/s 2.43 ms 346.12 us 2024-03-26T17:09:23.493 INFO:tasks.workunit.client.3.smithi157.stdout:myimage41 4/s 3/s 159 KiB/s 114 KiB/s 2.70 ms 384.93 us 2024-03-26T17:09:23.493 INFO:tasks.workunit.client.3.smithi157.stdout:myimage10 4/s 4/s 140 KiB/s 161 KiB/s 2.64 ms 541.03 us 2024-03-26T17:09:23.493 INFO:tasks.workunit.client.3.smithi157.stdout:myimage39 4/s 4/s 148 KiB/s 157 KiB/s 2.58 ms 364.01 us 2024-03-26T17:09:23.493 INFO:tasks.workunit.client.3.smithi157.stdout:myimage56 4/s 4/s 122 KiB/s 86 KiB/s 3.31 ms 335.89 us 2024-03-26T17:09:23.493 INFO:tasks.workunit.client.3.smithi157.stdout:myimage44 4/s 3/s 132 KiB/s 102 KiB/s 2.84 ms 434.46 us 2024-03-26T17:09:23.493 INFO:tasks.workunit.client.3.smithi157.stdout:myimage47 4/s 4/s 123 KiB/s 145 KiB/s 2.74 ms 361.00 us 2024-03-26T17:09:23.493 INFO:tasks.workunit.client.3.smithi157.stdout:myimage52 4/s 3/s 126 KiB/s 134 KiB/s 3.05 ms 405.30 us 2024-03-26T17:09:23.493 INFO:tasks.workunit.client.3.smithi157.stdout:myimage4 4/s 3/s 106 KiB/s 117 KiB/s 2.47 ms 340.62 us 2024-03-26T17:09:23.493 INFO:tasks.workunit.client.3.smithi157.stdout:myimage8 4/s 2/s 150 KiB/s 89 KiB/s 2.71 ms 410.44 us 2024-03-26T17:09:23.493 INFO:tasks.workunit.client.3.smithi157.stdout:myimage15 4/s 4/s 118 KiB/s 102 KiB/s 2.67 ms 359.00 us 2024-03-26T17:09:23.493 INFO:tasks.workunit.client.3.smithi157.stdout:myimage17 4/s 4/s 114 KiB/s 150 KiB/s 2.60 ms 565.13 us 2024-03-26T17:09:23.493 INFO:tasks.workunit.client.3.smithi157.stdout:myimage14 4/s 3/s 115 KiB/s 127 KiB/s 2.82 ms 363.12 us 2024-03-26T17:09:23.493 INFO:tasks.workunit.client.3.smithi157.stdout:myimage5 3/s 3/s 141 KiB/s 86 KiB/s 2.70 ms 345.14 us 2024-03-26T17:09:23.493 INFO:tasks.workunit.client.3.smithi157.stdout:myimage12 3/s 4/s 63 KiB/s 89 KiB/s 2.36 ms 320.67 us 2024-03-26T17:09:23.494 INFO:tasks.workunit.client.3.smithi157.stdout:myimage24 3/s 4/s 88 KiB/s 94 KiB/s 3.05 ms 420.58 us 2024-03-26T17:09:23.494 INFO:tasks.workunit.client.3.smithi157.stdout:myimage43 3/s 3/s 106 KiB/s 136 KiB/s 2.87 ms 374.98 us 2024-03-26T17:09:23.494 INFO:tasks.workunit.client.3.smithi157.stdout:myimage45 3/s 3/s 152 KiB/s 130 KiB/s 2.92 ms 341.84 us 2024-03-26T17:09:23.494 INFO:tasks.workunit.client.3.smithi157.stdout:myimage46 3/s 4/s 122 KiB/s 167 KiB/s 2.42 ms 407.16 us 2024-03-26T17:09:23.494 INFO:tasks.workunit.client.3.smithi157.stdout:myimage55 3/s 3/s 109 KiB/s 94 KiB/s 2.68 ms 470.29 us 2024-03-26T17:09:23.494 INFO:tasks.workunit.client.3.smithi157.stdout:myimage60 3/s 3/s 95 KiB/s 138 KiB/s 3.09 ms 368.59 us 2024-03-26T17:09:23.494 INFO:tasks.workunit.client.3.smithi157.stdout:myimage6 3/s 4/s 90 KiB/s 118 KiB/s 2.95 ms 293.25 us 2024-03-26T17:09:23.494 INFO:tasks.workunit.client.3.smithi157.stdout:myimage18 3/s 4/s 110 KiB/s 144 KiB/s 2.47 ms 357.87 us 2024-03-26T17:09:23.494 INFO:tasks.workunit.client.3.smithi157.stdout:myimage51 3/s 3/s 102 KiB/s 112 KiB/s 2.84 ms 358.25 us 2024-03-26T17:09:23.494 INFO:tasks.workunit.client.3.smithi157.stdout:myimage30 3/s 1/s 38 KiB/s 50 KiB/s 3.61 ms 366.00 us 2024-03-26T17:09:23.494 INFO:tasks.workunit.client.3.smithi157.stdout:myimage58 3/s 2/s 110 KiB/s 66 KiB/s 2.27 ms 329.33 us 2024-03-26T17:09:23.494 INFO:tasks.workunit.client.3.smithi157.stdout:myimage27 3/s 4/s 66 KiB/s 124 KiB/s 2.44 ms 345.47 us 2024-03-26T17:09:23.494 INFO:tasks.workunit.client.3.smithi157.stdout:myimage36 3/s 5/s 95 KiB/s 178 KiB/s 2.64 ms 384.87 us 2024-03-26T17:09:23.494 INFO:tasks.workunit.client.3.smithi157.stdout:myimage49 3/s 4/s 66 KiB/s 107 KiB/s 2.37 ms 346.42 us 2024-03-26T17:09:23.495 INFO:tasks.workunit.client.3.smithi157.stdout:myimage33 3/s 4/s 83 KiB/s 91 KiB/s 2.59 ms 302.83 us 2024-03-26T17:09:23.495 INFO:tasks.workunit.client.3.smithi157.stdout:myimage53 3/s 5/s 50 KiB/s 89 KiB/s 2.32 ms 318.80 us 2024-03-26T17:09:23.495 INFO:tasks.workunit.client.3.smithi157.stdout:myimage57 3/s 4/s 130 KiB/s 156 KiB/s 2.89 ms 427.03 us 2024-03-26T17:09:23.495 INFO:tasks.workunit.client.3.smithi157.stdout:myimage13 3/s 3/s 86 KiB/s 130 KiB/s 2.29 ms 441.54 us 2024-03-26T17:09:23.495 INFO:tasks.workunit.client.3.smithi157.stdout:myimage35 3/s 5/s 59 KiB/s 84 KiB/s 2.79 ms 387.33 us 2024-03-26T17:09:23.495 INFO:tasks.workunit.client.3.smithi157.stdout:myimage40 3/s 5/s 70 KiB/s 163 KiB/s 2.48 ms 368.63 us 2024-03-26T17:09:23.495 INFO:tasks.workunit.client.3.smithi157.stdout:myimage9 3/s 3/s 94 KiB/s 114 KiB/s 2.91 ms 393.58 us 2024-03-26T17:09:23.495 INFO:tasks.workunit.client.3.smithi157.stdout:myimage21 3/s 4/s 77 KiB/s 127 KiB/s 3.38 ms 432.11 us 2024-03-26T17:09:23.495 INFO:tasks.workunit.client.3.smithi157.stdout:myimage54 3/s 3/s 89 KiB/s 110 KiB/s 2.61 ms 338.78 us 2024-03-26T17:09:23.495 INFO:tasks.workunit.client.3.smithi157.stdout:myimage42 2/s 4/s 104 KiB/s 132 KiB/s 2.75 ms 363.55 us 2024-03-26T17:09:23.495 INFO:tasks.workunit.client.3.smithi157.stdout:myimage59 2/s 5/s 95 KiB/s 127 KiB/s 2.99 ms 355.48 us 2024-03-26T17:09:23.495 INFO:tasks.workunit.client.3.smithi157.stdout:myimage25 2/s 4/s 74 KiB/s 135 KiB/s 3.61 ms 354.84 us 2024-03-26T17:09:23.495 INFO:tasks.workunit.client.3.smithi157.stdout:myimage32 2/s 2/s 72 KiB/s 110 KiB/s 2.72 ms 375.09 us 2024-03-26T17:09:23.495 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:09:23.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:09:23 smithi044 ceph-mon[30624]: pgmap v707: 33 pgs: 33 active+clean; 1.0 GiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 6.2 MiB/s rd, 6.5 MiB/s wr, 476 op/s 2024-03-26T17:09:23.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:09:23 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:09:23] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:09:23.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:09:23 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:09:23] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:09:23.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:09:23 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:09:23.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:09:23 smithi064 ceph-mon[34420]: pgmap v707: 33 pgs: 33 active+clean; 1.0 GiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 6.2 MiB/s rd, 6.5 MiB/s wr, 476 op/s 2024-03-26T17:09:23.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:09:23 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:09:23] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:09:23.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:09:23 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:09:23] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:09:23.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:09:23 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:09:24.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:09:24 smithi044 ceph-mon[30624]: Health check update: 3 slow ops, oldest one blocked for 658 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:09:24.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:09:24 smithi064 ceph-mon[34420]: Health check update: 3 slow ops, oldest one blocked for 658 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:09:24.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:09:24 smithi149 ceph-mon[34678]: Health check update: 3 slow ops, oldest one blocked for 658 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:09:25.459 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:09:25 smithi149 ceph-mon[34678]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:09:25.459 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:09:25 smithi149 ceph-mon[34678]: { 2024-03-26T17:09:25.459 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:09:25 smithi149 ceph-mon[34678]: "prefix": "rbd perf image stats", 2024-03-26T17:09:25.459 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:09:25 smithi149 ceph-mon[34678]: "pool_spec": "mypool", 2024-03-26T17:09:25.460 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:09:25 smithi149 ceph-mon[34678]: "sort_by": "write_ops", 2024-03-26T17:09:25.460 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:09:25 smithi149 ceph-mon[34678]: "format": "json" 2024-03-26T17:09:25.460 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:09:25 smithi149 ceph-mon[34678]: }"]: dispatch 2024-03-26T17:09:25.460 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:09:25 smithi149 ceph-mon[34678]: pgmap v708: 33 pgs: 33 active+clean; 1.0 GiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 6.7 MiB/s rd, 6.9 MiB/s wr, 500 op/s 2024-03-26T17:09:25.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:09:25 smithi044 ceph-mon[30624]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:09:25.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:09:25 smithi044 ceph-mon[30624]: { 2024-03-26T17:09:25.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:09:25 smithi044 ceph-mon[30624]: "prefix": "rbd perf image stats", 2024-03-26T17:09:25.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:09:25 smithi044 ceph-mon[30624]: "pool_spec": "mypool", 2024-03-26T17:09:25.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:09:25 smithi044 ceph-mon[30624]: "sort_by": "write_ops", 2024-03-26T17:09:25.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:09:25 smithi044 ceph-mon[30624]: "format": "json" 2024-03-26T17:09:25.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:09:25 smithi044 ceph-mon[30624]: }"]: dispatch 2024-03-26T17:09:25.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:09:25 smithi044 ceph-mon[30624]: pgmap v708: 33 pgs: 33 active+clean; 1.0 GiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 6.7 MiB/s rd, 6.9 MiB/s wr, 500 op/s 2024-03-26T17:09:25.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:09:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:09:25] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:09:25.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:09:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:09:25] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:09:25.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:09:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:09:25.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:09:25 smithi064 ceph-mon[34420]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:09:25.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:09:25 smithi064 ceph-mon[34420]: { 2024-03-26T17:09:25.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:09:25 smithi064 ceph-mon[34420]: "prefix": "rbd perf image stats", 2024-03-26T17:09:25.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:09:25 smithi064 ceph-mon[34420]: "pool_spec": "mypool", 2024-03-26T17:09:25.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:09:25 smithi064 ceph-mon[34420]: "sort_by": "write_ops", 2024-03-26T17:09:25.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:09:25 smithi064 ceph-mon[34420]: "format": "json" 2024-03-26T17:09:25.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:09:25 smithi064 ceph-mon[34420]: }"]: dispatch 2024-03-26T17:09:25.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:09:25 smithi064 ceph-mon[34420]: pgmap v708: 33 pgs: 33 active+clean; 1.0 GiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 6.7 MiB/s rd, 6.9 MiB/s wr, 500 op/s 2024-03-26T17:09:25.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:09:25 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:09:25] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:09:25.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:09:25 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:09:25] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:09:25.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:09:25 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:09:26.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:09:26 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 2024-03-26T17:09:26.238+0000 7fa707a55700 -1 mon.c@1(peon) e3 get_health_metrics reporting 3 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T17:09:27.471 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:09:27 smithi149 ceph-mon[34678]: pgmap v709: 33 pgs: 33 active+clean; 1.0 GiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 7.0 MiB/s rd, 7.2 MiB/s wr, 506 op/s 2024-03-26T17:09:27.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:09:27 smithi044 ceph-mon[30624]: pgmap v709: 33 pgs: 33 active+clean; 1.0 GiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 7.0 MiB/s rd, 7.2 MiB/s wr, 506 op/s 2024-03-26T17:09:27.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:09:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:09:27] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:09:27.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:09:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:09:27] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:09:27.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:09:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:09:27.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:09:27 smithi064 ceph-mon[34420]: pgmap v709: 33 pgs: 33 active+clean; 1.0 GiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 7.0 MiB/s rd, 7.2 MiB/s wr, 506 op/s 2024-03-26T17:09:27.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:09:27 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:09:27] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:09:27.897 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:09:27 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:09:27] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:09:27.897 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:09:27 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:09:28.495 INFO:tasks.workunit.client.3.smithi157.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-26T17:09:28.495 INFO:tasks.workunit.client.3.smithi157.stdout:myimage9 5/s 3/s 197 KiB/s 106 KiB/s 3.21 ms 652.57 us 2024-03-26T17:09:28.495 INFO:tasks.workunit.client.3.smithi157.stdout:myimage26 5/s 3/s 151 KiB/s 101 KiB/s 2.86 ms 361.73 us 2024-03-26T17:09:28.495 INFO:tasks.workunit.client.3.smithi157.stdout:myimage44 5/s 2/s 159 KiB/s 66 KiB/s 2.82 ms 329.51 us 2024-03-26T17:09:28.495 INFO:tasks.workunit.client.3.smithi157.stdout:myimage53 5/s 3/s 184 KiB/s 66 KiB/s 2.49 ms 342.14 us 2024-03-26T17:09:28.495 INFO:tasks.workunit.client.3.smithi157.stdout:myimage12 5/s 2/s 103 KiB/s 63 KiB/s 2.52 ms 439.05 us 2024-03-26T17:09:28.495 INFO:tasks.workunit.client.3.smithi157.stdout:myimage23 4/s 2/s 149 KiB/s 87 KiB/s 2.45 ms 341.78 us 2024-03-26T17:09:28.496 INFO:tasks.workunit.client.3.smithi157.stdout:myimage58 4/s 4/s 148 KiB/s 135 KiB/s 2.37 ms 408.14 us 2024-03-26T17:09:28.496 INFO:tasks.workunit.client.3.smithi157.stdout:myimage13 4/s 4/s 115 KiB/s 106 KiB/s 2.32 ms 476.54 us 2024-03-26T17:09:28.496 INFO:tasks.workunit.client.3.smithi157.stdout:myimage49 4/s 3/s 165 KiB/s 153 KiB/s 2.85 ms 482.10 us 2024-03-26T17:09:28.496 INFO:tasks.workunit.client.3.smithi157.stdout:myimage46 4/s 3/s 122 KiB/s 94 KiB/s 2.52 ms 344.31 us 2024-03-26T17:09:28.496 INFO:tasks.workunit.client.3.smithi157.stdout:myimage10 4/s 4/s 144 KiB/s 146 KiB/s 2.66 ms 370.05 us 2024-03-26T17:09:28.496 INFO:tasks.workunit.client.3.smithi157.stdout:myimage14 4/s 3/s 162 KiB/s 80 KiB/s 3.33 ms 310.96 us 2024-03-26T17:09:28.496 INFO:tasks.workunit.client.3.smithi157.stdout:myimage37 4/s 4/s 116 KiB/s 118 KiB/s 2.68 ms 360.70 us 2024-03-26T17:09:28.496 INFO:tasks.workunit.client.3.smithi157.stdout:myimage8 4/s 3/s 138 KiB/s 101 KiB/s 2.92 ms 391.19 us 2024-03-26T17:09:28.496 INFO:tasks.workunit.client.3.smithi157.stdout:myimage18 4/s 3/s 138 KiB/s 97 KiB/s 2.81 ms 425.51 us 2024-03-26T17:09:28.496 INFO:tasks.workunit.client.3.smithi157.stdout:myimage27 4/s 2/s 114 KiB/s 86 KiB/s 2.43 ms 372.34 us 2024-03-26T17:09:28.496 INFO:tasks.workunit.client.3.smithi157.stdout:myimage50 4/s 3/s 124 KiB/s 92 KiB/s 2.66 ms 307.57 us 2024-03-26T17:09:28.496 INFO:tasks.workunit.client.3.smithi157.stdout:myimage57 4/s 3/s 135 KiB/s 132 KiB/s 2.78 ms 432.24 us 2024-03-26T17:09:28.497 INFO:tasks.workunit.client.3.smithi157.stdout:myimage3 4/s 4/s 122 KiB/s 115 KiB/s 2.39 ms 326.77 us 2024-03-26T17:09:28.497 INFO:tasks.workunit.client.3.smithi157.stdout:myimage47 4/s 3/s 109 KiB/s 113 KiB/s 3.05 ms 372.29 us 2024-03-26T17:09:28.497 INFO:tasks.workunit.client.3.smithi157.stdout:myimage4 4/s 4/s 110 KiB/s 123 KiB/s 2.70 ms 346.40 us 2024-03-26T17:09:28.497 INFO:tasks.workunit.client.3.smithi157.stdout:myimage11 4/s 5/s 64 KiB/s 114 KiB/s 3.29 ms 341.14 us 2024-03-26T17:09:28.497 INFO:tasks.workunit.client.3.smithi157.stdout:myimage54 4/s 3/s 116 KiB/s 102 KiB/s 2.54 ms 415.07 us 2024-03-26T17:09:28.497 INFO:tasks.workunit.client.3.smithi157.stdout:myimage31 4/s 4/s 130 KiB/s 111 KiB/s 3.14 ms 396.58 us 2024-03-26T17:09:28.497 INFO:tasks.workunit.client.3.smithi157.stdout:myimage35 4/s 3/s 83 KiB/s 88 KiB/s 2.54 ms 464.30 us 2024-03-26T17:09:28.497 INFO:tasks.workunit.client.3.smithi157.stdout:myimage6 4/s 4/s 121 KiB/s 128 KiB/s 2.81 ms 525.45 us 2024-03-26T17:09:28.497 INFO:tasks.workunit.client.3.smithi157.stdout:myimage17 4/s 3/s 128 KiB/s 79 KiB/s 2.86 ms 342.74 us 2024-03-26T17:09:28.497 INFO:tasks.workunit.client.3.smithi157.stdout:myimage19 4/s 3/s 115 KiB/s 102 KiB/s 2.86 ms 531.24 us 2024-03-26T17:09:28.497 INFO:tasks.workunit.client.3.smithi157.stdout:myimage41 4/s 4/s 163 KiB/s 111 KiB/s 2.75 ms 393.88 us 2024-03-26T17:09:28.497 INFO:tasks.workunit.client.3.smithi157.stdout:myimage43 4/s 4/s 134 KiB/s 146 KiB/s 3.03 ms 382.11 us 2024-03-26T17:09:28.497 INFO:tasks.workunit.client.3.smithi157.stdout:myimage45 4/s 3/s 126 KiB/s 130 KiB/s 2.64 ms 320.08 us 2024-03-26T17:09:28.498 INFO:tasks.workunit.client.3.smithi157.stdout:myimage55 4/s 3/s 150 KiB/s 117 KiB/s 2.64 ms 480.53 us 2024-03-26T17:09:28.498 INFO:tasks.workunit.client.3.smithi157.stdout:myimage59 4/s 4/s 117 KiB/s 115 KiB/s 3.15 ms 360.24 us 2024-03-26T17:09:28.498 INFO:tasks.workunit.client.3.smithi157.stdout:myimage32 3/s 4/s 84 KiB/s 182 KiB/s 2.79 ms 397.69 us 2024-03-26T17:09:28.498 INFO:tasks.workunit.client.3.smithi157.stdout:myimage34 3/s 3/s 129 KiB/s 116 KiB/s 2.60 ms 403.92 us 2024-03-26T17:09:28.498 INFO:tasks.workunit.client.3.smithi157.stdout:myimage5 3/s 4/s 103 KiB/s 145 KiB/s 2.59 ms 358.86 us 2024-03-26T17:09:28.498 INFO:tasks.workunit.client.3.smithi157.stdout:myimage7 3/s 4/s 86 KiB/s 86 KiB/s 2.60 ms 423.27 us 2024-03-26T17:09:28.498 INFO:tasks.workunit.client.3.smithi157.stdout:myimage21 3/s 4/s 80 KiB/s 106 KiB/s 3.42 ms 370.86 us 2024-03-26T17:09:28.498 INFO:tasks.workunit.client.3.smithi157.stdout:myimage24 3/s 3/s 133 KiB/s 111 KiB/s 2.66 ms 365.02 us 2024-03-26T17:09:28.498 INFO:tasks.workunit.client.3.smithi157.stdout:myimage29 3/s 3/s 108 KiB/s 85 KiB/s 2.36 ms 344.41 us 2024-03-26T17:09:28.498 INFO:tasks.workunit.client.3.smithi157.stdout:myimage42 3/s 4/s 151 KiB/s 131 KiB/s 2.89 ms 393.99 us 2024-03-26T17:09:28.498 INFO:tasks.workunit.client.3.smithi157.stdout:myimage56 3/s 4/s 113 KiB/s 103 KiB/s 3.35 ms 328.19 us 2024-03-26T17:09:28.498 INFO:tasks.workunit.client.3.smithi157.stdout:myimage48 3/s 3/s 106 KiB/s 75 KiB/s 2.67 ms 331.45 us 2024-03-26T17:09:28.498 INFO:tasks.workunit.client.3.smithi157.stdout:myimage52 3/s 3/s 111 KiB/s 114 KiB/s 3.00 ms 357.07 us 2024-03-26T17:09:28.498 INFO:tasks.workunit.client.3.smithi157.stdout:myimage15 3/s 4/s 122 KiB/s 78 KiB/s 2.77 ms 424.07 us 2024-03-26T17:09:28.499 INFO:tasks.workunit.client.3.smithi157.stdout:myimage20 3/s 5/s 91 KiB/s 160 KiB/s 2.92 ms 368.86 us 2024-03-26T17:09:28.499 INFO:tasks.workunit.client.3.smithi157.stdout:myimage33 3/s 4/s 80 KiB/s 125 KiB/s 2.65 ms 409.19 us 2024-03-26T17:09:28.499 INFO:tasks.workunit.client.3.smithi157.stdout:myimage36 3/s 4/s 98 KiB/s 118 KiB/s 2.66 ms 430.65 us 2024-03-26T17:09:28.499 INFO:tasks.workunit.client.3.smithi157.stdout:myimage39 3/s 3/s 106 KiB/s 90 KiB/s 2.61 ms 373.27 us 2024-03-26T17:09:28.499 INFO:tasks.workunit.client.3.smithi157.stdout:myimage30 3/s 7/s 114 KiB/s 181 KiB/s 3.26 ms 330.54 us 2024-03-26T17:09:28.499 INFO:tasks.workunit.client.3.smithi157.stdout:myimage1 3/s 3/s 84 KiB/s 122 KiB/s 2.46 ms 309.76 us 2024-03-26T17:09:28.499 INFO:tasks.workunit.client.3.smithi157.stdout:myimage51 3/s 4/s 108 KiB/s 146 KiB/s 3.10 ms 327.38 us 2024-03-26T17:09:28.499 INFO:tasks.workunit.client.3.smithi157.stdout:myimage2 3/s 3/s 86 KiB/s 122 KiB/s 2.75 ms 618.80 us 2024-03-26T17:09:28.499 INFO:tasks.workunit.client.3.smithi157.stdout:myimage22 3/s 3/s 73 KiB/s 91 KiB/s 2.75 ms 425.68 us 2024-03-26T17:09:28.499 INFO:tasks.workunit.client.3.smithi157.stdout:myimage38 3/s 4/s 90 KiB/s 132 KiB/s 2.18 ms 302.43 us 2024-03-26T17:09:28.499 INFO:tasks.workunit.client.3.smithi157.stdout:myimage60 3/s 4/s 104 KiB/s 156 KiB/s 3.04 ms 425.28 us 2024-03-26T17:09:28.499 INFO:tasks.workunit.client.3.smithi157.stdout:myimage16 2/s 4/s 79 KiB/s 134 KiB/s 2.91 ms 352.27 us 2024-03-26T17:09:28.499 INFO:tasks.workunit.client.3.smithi157.stdout:myimage25 2/s 5/s 86 KiB/s 125 KiB/s 3.64 ms 355.83 us 2024-03-26T17:09:28.499 INFO:tasks.workunit.client.3.smithi157.stdout:myimage40 2/s 4/s 76 KiB/s 143 KiB/s 2.65 ms 459.49 us 2024-03-26T17:09:28.500 INFO:tasks.workunit.client.3.smithi157.stdout:myimage28 2/s 4/s 53 KiB/s 164 KiB/s 3.35 ms 399.32 us 2024-03-26T17:09:28.500 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:09:29.483 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:09:29 smithi149 ceph-mon[34678]: pgmap v710: 33 pgs: 33 active+clean; 1.0 GiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 6.3 MiB/s rd, 6.5 MiB/s wr, 447 op/s 2024-03-26T17:09:29.483 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:09:29 smithi149 ceph-mon[34678]: Health check update: 3 slow ops, oldest one blocked for 663 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:09:29.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:09:29 smithi044 ceph-mon[30624]: pgmap v710: 33 pgs: 33 active+clean; 1.0 GiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 6.3 MiB/s rd, 6.5 MiB/s wr, 447 op/s 2024-03-26T17:09:29.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:09:29 smithi044 ceph-mon[30624]: Health check update: 3 slow ops, oldest one blocked for 663 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:09:29.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:09:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:09:29] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:09:29.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:09:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:09:29] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:09:29.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:09:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:09:29.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:09:29 smithi064 ceph-mon[34420]: pgmap v710: 33 pgs: 33 active+clean; 1.0 GiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 6.3 MiB/s rd, 6.5 MiB/s wr, 447 op/s 2024-03-26T17:09:29.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:09:29 smithi064 ceph-mon[34420]: Health check update: 3 slow ops, oldest one blocked for 663 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:09:29.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:09:29 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:09:29] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:09:29.897 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:09:29 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:09:29] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:09:29.897 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:09:29 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:09:30.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:09:30 smithi044 ceph-mon[30624]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:09:30.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:09:30 smithi044 ceph-mon[30624]: { 2024-03-26T17:09:30.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:09:30 smithi044 ceph-mon[30624]: "prefix": "rbd perf image stats", 2024-03-26T17:09:30.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:09:30 smithi044 ceph-mon[30624]: "pool_spec": "mypool", 2024-03-26T17:09:30.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:09:30 smithi044 ceph-mon[30624]: "sort_by": "write_ops", 2024-03-26T17:09:30.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:09:30 smithi044 ceph-mon[30624]: "format": "json" 2024-03-26T17:09:30.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:09:30 smithi044 ceph-mon[30624]: }"]: dispatch 2024-03-26T17:09:30.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:09:30 smithi064 ceph-mon[34420]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:09:30.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:09:30 smithi064 ceph-mon[34420]: { 2024-03-26T17:09:30.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:09:30 smithi064 ceph-mon[34420]: "prefix": "rbd perf image stats", 2024-03-26T17:09:30.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:09:30 smithi064 ceph-mon[34420]: "pool_spec": "mypool", 2024-03-26T17:09:30.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:09:30 smithi064 ceph-mon[34420]: "sort_by": "write_ops", 2024-03-26T17:09:30.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:09:30 smithi064 ceph-mon[34420]: "format": "json" 2024-03-26T17:09:30.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:09:30 smithi064 ceph-mon[34420]: }"]: dispatch 2024-03-26T17:09:30.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:09:30 smithi149 ceph-mon[34678]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:09:30.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:09:30 smithi149 ceph-mon[34678]: { 2024-03-26T17:09:30.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:09:30 smithi149 ceph-mon[34678]: "prefix": "rbd perf image stats", 2024-03-26T17:09:30.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:09:30 smithi149 ceph-mon[34678]: "pool_spec": "mypool", 2024-03-26T17:09:30.647 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:09:30 smithi149 ceph-mon[34678]: "sort_by": "write_ops", 2024-03-26T17:09:30.647 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:09:30 smithi149 ceph-mon[34678]: "format": "json" 2024-03-26T17:09:30.647 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:09:30 smithi149 ceph-mon[34678]: }"]: dispatch 2024-03-26T17:09:31.495 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:09:31 smithi149 ceph-mon[34678]: pgmap v711: 33 pgs: 33 active+clean; 1.0 GiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 6.8 MiB/s rd, 6.9 MiB/s wr, 478 op/s 2024-03-26T17:09:31.496 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:09:31 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 2024-03-26T17:09:31.239+0000 7fa707a55700 -1 mon.c@1(peon) e3 get_health_metrics reporting 3 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T17:09:31.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:09:31 smithi044 ceph-mon[30624]: pgmap v711: 33 pgs: 33 active+clean; 1.0 GiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 6.8 MiB/s rd, 6.9 MiB/s wr, 478 op/s 2024-03-26T17:09:31.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:09:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:09:31] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:09:31.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:09:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:09:31] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:09:31.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:09:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:09:31.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:09:31 smithi064 ceph-mon[34420]: pgmap v711: 33 pgs: 33 active+clean; 1.0 GiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 6.8 MiB/s rd, 6.9 MiB/s wr, 478 op/s 2024-03-26T17:09:31.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:09:31 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:09:31] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:09:31.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:09:31 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:09:31] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:09:31.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:09:31 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:09:33.062 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:09:33.072 INFO:tasks.workunit.client.3.smithi157.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2024-03-26T17:09:33.072 INFO:tasks.workunit.client.3.smithi157.stdout: 7.80 96.8k 120.0k 0.0k 968.0k 1.2M 0.0k nvme2n1 2024-03-26T17:09:33.072 INFO:tasks.workunit.client.3.smithi157.stdout: 7.80 130.0k 108.8k 0.0k 1.3M 1.1M 0.0k nvme2n10 2024-03-26T17:09:33.072 INFO:tasks.workunit.client.3.smithi157.stdout: 7.80 133.6k 104.0k 0.0k 1.3M 1.0M 0.0k nvme2n11 2024-03-26T17:09:33.072 INFO:tasks.workunit.client.3.smithi157.stdout: 7.90 107.2k 154.4k 0.0k 1.0M 1.5M 0.0k nvme2n12 2024-03-26T17:09:33.073 INFO:tasks.workunit.client.3.smithi157.stdout: 7.90 95.6k 116.0k 0.0k 956.0k 1.1M 0.0k nvme2n13 2024-03-26T17:09:33.073 INFO:tasks.workunit.client.3.smithi157.stdout: 7.90 101.6k 135.6k 0.0k 1016.0k 1.3M 0.0k nvme2n14 2024-03-26T17:09:33.073 INFO:tasks.workunit.client.3.smithi157.stdout: 7.90 116.8k 82.8k 0.0k 1.1M 828.0k 0.0k nvme2n15 2024-03-26T17:09:33.073 INFO:tasks.workunit.client.3.smithi157.stdout: 7.90 123.6k 90.8k 0.0k 1.2M 908.0k 0.0k nvme2n16 2024-03-26T17:09:33.073 INFO:tasks.workunit.client.3.smithi157.stdout: 7.90 108.0k 124.4k 0.0k 1.1M 1.2M 0.0k nvme2n17 2024-03-26T17:09:33.073 INFO:tasks.workunit.client.3.smithi157.stdout: 7.80 111.2k 132.8k 0.0k 1.1M 1.3M 0.0k nvme2n18 2024-03-26T17:09:33.073 INFO:tasks.workunit.client.3.smithi157.stdout: 7.80 89.6k 127.2k 0.0k 896.0k 1.2M 0.0k nvme2n19 2024-03-26T17:09:33.073 INFO:tasks.workunit.client.3.smithi157.stdout: 7.80 109.2k 122.8k 0.0k 1.1M 1.2M 0.0k nvme2n2 2024-03-26T17:09:33.073 INFO:tasks.workunit.client.3.smithi157.stdout: 7.80 112.4k 98.0k 0.0k 1.1M 980.0k 0.0k nvme2n20 2024-03-26T17:09:33.073 INFO:tasks.workunit.client.3.smithi157.stdout: 7.80 108.0k 128.4k 0.0k 1.1M 1.3M 0.0k nvme2n3 2024-03-26T17:09:33.073 INFO:tasks.workunit.client.3.smithi157.stdout: 7.80 116.0k 122.0k 0.0k 1.1M 1.2M 0.0k nvme2n4 2024-03-26T17:09:33.073 INFO:tasks.workunit.client.3.smithi157.stdout: 7.80 133.6k 99.6k 0.0k 1.3M 996.0k 0.0k nvme2n5 2024-03-26T17:09:33.073 INFO:tasks.workunit.client.3.smithi157.stdout: 7.80 73.2k 124.8k 0.0k 732.0k 1.2M 0.0k nvme2n6 2024-03-26T17:09:33.074 INFO:tasks.workunit.client.3.smithi157.stdout: 7.80 110.4k 113.6k 0.0k 1.1M 1.1M 0.0k nvme2n7 2024-03-26T17:09:33.074 INFO:tasks.workunit.client.3.smithi157.stdout: 7.80 89.2k 127.6k 0.0k 892.0k 1.2M 0.0k nvme2n8 2024-03-26T17:09:33.074 INFO:tasks.workunit.client.3.smithi157.stdout: 7.80 106.8k 125.6k 0.0k 1.0M 1.2M 0.0k nvme2n9 2024-03-26T17:09:33.074 INFO:tasks.workunit.client.3.smithi157.stdout: 7.80 98.8k 109.6k 0.0k 988.0k 1.1M 0.0k nvme5n1 2024-03-26T17:09:33.074 INFO:tasks.workunit.client.3.smithi157.stdout: 7.80 126.8k 116.0k 0.0k 1.2M 1.1M 0.0k nvme5n10 2024-03-26T17:09:33.074 INFO:tasks.workunit.client.3.smithi157.stdout: 7.80 106.4k 92.0k 0.0k 1.0M 920.0k 0.0k nvme5n11 2024-03-26T17:09:33.074 INFO:tasks.workunit.client.3.smithi157.stdout: 7.80 126.4k 111.6k 0.0k 1.2M 1.1M 0.0k nvme5n12 2024-03-26T17:09:33.074 INFO:tasks.workunit.client.3.smithi157.stdout: 7.90 135.2k 91.6k 0.0k 1.3M 916.0k 0.0k nvme5n13 2024-03-26T17:09:33.074 INFO:tasks.workunit.client.3.smithi157.stdout: 7.90 131.6k 135.6k 0.0k 1.3M 1.3M 0.0k nvme5n14 2024-03-26T17:09:33.074 INFO:tasks.workunit.client.3.smithi157.stdout: 7.90 102.0k 132.0k 0.0k 1020.0k 1.3M 0.0k nvme5n15 2024-03-26T17:09:33.074 INFO:tasks.workunit.client.3.smithi157.stdout: 7.90 110.4k 99.6k 0.0k 1.1M 996.0k 0.0k nvme5n16 2024-03-26T17:09:33.074 INFO:tasks.workunit.client.3.smithi157.stdout: 7.90 112.8k 92.4k 0.0k 1.1M 924.0k 0.0k nvme5n17 2024-03-26T17:09:33.074 INFO:tasks.workunit.client.3.smithi157.stdout: 7.90 130.0k 98.8k 0.0k 1.3M 988.0k 0.0k nvme5n18 2024-03-26T17:09:33.074 INFO:tasks.workunit.client.3.smithi157.stdout: 7.80 131.6k 114.0k 0.0k 1.3M 1.1M 0.0k nvme5n19 2024-03-26T17:09:33.075 INFO:tasks.workunit.client.3.smithi157.stdout: 7.80 90.8k 111.6k 0.0k 908.0k 1.1M 0.0k nvme5n2 2024-03-26T17:09:33.075 INFO:tasks.workunit.client.3.smithi157.stdout: 7.80 116.4k 111.2k 0.0k 1.1M 1.1M 0.0k nvme5n20 2024-03-26T17:09:33.075 INFO:tasks.workunit.client.3.smithi157.stdout: 7.80 99.6k 117.2k 0.0k 996.0k 1.1M 0.0k nvme5n3 2024-03-26T17:09:33.075 INFO:tasks.workunit.client.3.smithi157.stdout: 7.80 129.2k 112.0k 0.0k 1.3M 1.1M 0.0k nvme5n4 2024-03-26T17:09:33.075 INFO:tasks.workunit.client.3.smithi157.stdout: 7.80 109.2k 114.8k 0.0k 1.1M 1.1M 0.0k nvme5n5 2024-03-26T17:09:33.075 INFO:tasks.workunit.client.3.smithi157.stdout: 7.80 113.2k 94.4k 0.0k 1.1M 944.0k 0.0k nvme5n6 2024-03-26T17:09:33.075 INFO:tasks.workunit.client.3.smithi157.stdout: 7.80 104.0k 109.6k 0.0k 1.0M 1.1M 0.0k nvme5n7 2024-03-26T17:09:33.075 INFO:tasks.workunit.client.3.smithi157.stdout: 7.80 155.6k 81.6k 0.0k 1.5M 816.0k 0.0k nvme5n8 2024-03-26T17:09:33.075 INFO:tasks.workunit.client.3.smithi157.stdout: 7.80 93.2k 117.6k 0.0k 932.0k 1.1M 0.0k nvme5n9 2024-03-26T17:09:33.075 INFO:tasks.workunit.client.3.smithi157.stdout: 7.80 135.2k 120.0k 0.0k 1.3M 1.2M 0.0k nvme8n1 2024-03-26T17:09:33.075 INFO:tasks.workunit.client.3.smithi157.stdout: 7.80 93.6k 115.6k 0.0k 936.0k 1.1M 0.0k nvme8n10 2024-03-26T17:09:33.075 INFO:tasks.workunit.client.3.smithi157.stdout: 7.80 98.4k 123.2k 0.0k 984.0k 1.2M 0.0k nvme8n11 2024-03-26T17:09:33.075 INFO:tasks.workunit.client.3.smithi157.stdout: 7.90 134.0k 82.0k 0.0k 1.3M 820.0k 0.0k nvme8n12 2024-03-26T17:09:33.075 INFO:tasks.workunit.client.3.smithi157.stdout: 7.90 114.4k 150.8k 0.0k 1.1M 1.5M 0.0k nvme8n13 2024-03-26T17:09:33.075 INFO:tasks.workunit.client.3.smithi157.stdout: 7.90 132.0k 92.0k 0.0k 1.3M 920.0k 0.0k nvme8n14 2024-03-26T17:09:33.076 INFO:tasks.workunit.client.3.smithi157.stdout: 7.90 116.0k 134.0k 0.0k 1.1M 1.3M 0.0k nvme8n15 2024-03-26T17:09:33.076 INFO:tasks.workunit.client.3.smithi157.stdout: 7.90 112.8k 92.4k 0.0k 1.1M 924.0k 0.0k nvme8n16 2024-03-26T17:09:33.076 INFO:tasks.workunit.client.3.smithi157.stdout: 7.90 113.6k 108.0k 0.0k 1.1M 1.1M 0.0k nvme8n17 2024-03-26T17:09:33.076 INFO:tasks.workunit.client.3.smithi157.stdout: 7.80 85.6k 135.6k 0.0k 856.0k 1.3M 0.0k nvme8n18 2024-03-26T17:09:33.076 INFO:tasks.workunit.client.3.smithi157.stdout: 7.80 132.4k 107.6k 0.0k 1.3M 1.1M 0.0k nvme8n19 2024-03-26T17:09:33.076 INFO:tasks.workunit.client.3.smithi157.stdout: 7.80 106.4k 116.0k 0.0k 1.0M 1.1M 0.0k nvme8n2 2024-03-26T17:09:33.076 INFO:tasks.workunit.client.3.smithi157.stdout: 7.80 136.0k 98.0k 0.0k 1.3M 980.0k 0.0k nvme8n20 2024-03-26T17:09:33.076 INFO:tasks.workunit.client.3.smithi157.stdout: 7.80 124.8k 105.2k 0.0k 1.2M 1.0M 0.0k nvme8n3 2024-03-26T17:09:33.076 INFO:tasks.workunit.client.3.smithi157.stdout: 7.80 124.4k 119.6k 0.0k 1.2M 1.2M 0.0k nvme8n4 2024-03-26T17:09:33.076 INFO:tasks.workunit.client.3.smithi157.stdout: 7.80 125.6k 148.4k 0.0k 1.2M 1.4M 0.0k nvme8n5 2024-03-26T17:09:33.076 INFO:tasks.workunit.client.3.smithi157.stdout: 7.80 117.6k 85.6k 0.0k 1.1M 856.0k 0.0k nvme8n6 2024-03-26T17:09:33.076 INFO:tasks.workunit.client.3.smithi157.stdout: 7.80 123.2k 94.0k 0.0k 1.2M 940.0k 0.0k nvme8n7 2024-03-26T17:09:33.076 INFO:tasks.workunit.client.3.smithi157.stdout: 7.80 115.2k 90.4k 0.0k 1.1M 904.0k 0.0k nvme8n8 2024-03-26T17:09:33.076 INFO:tasks.workunit.client.3.smithi157.stdout: 7.80 135.6k 108.4k 0.0k 1.3M 1.1M 0.0k nvme8n9 2024-03-26T17:09:33.076 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:09:33.500 INFO:tasks.workunit.client.3.smithi157.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-26T17:09:33.500 INFO:tasks.workunit.client.3.smithi157.stdout:myimage14 5/s 3/s 193 KiB/s 103 KiB/s 3.14 ms 379.17 us 2024-03-26T17:09:33.500 INFO:tasks.workunit.client.3.smithi157.stdout:myimage22 5/s 3/s 101 KiB/s 102 KiB/s 2.79 ms 344.06 us 2024-03-26T17:09:33.500 INFO:tasks.workunit.client.3.smithi157.stdout:myimage12 5/s 2/s 203 KiB/s 82 KiB/s 2.85 ms 357.88 us 2024-03-26T17:09:33.500 INFO:tasks.workunit.client.3.smithi157.stdout:myimage21 5/s 3/s 123 KiB/s 102 KiB/s 3.33 ms 430.96 us 2024-03-26T17:09:33.501 INFO:tasks.workunit.client.3.smithi157.stdout:myimage8 4/s 3/s 117 KiB/s 89 KiB/s 2.82 ms 319.59 us 2024-03-26T17:09:33.501 INFO:tasks.workunit.client.3.smithi157.stdout:myimage42 4/s 3/s 110 KiB/s 98 KiB/s 2.82 ms 495.76 us 2024-03-26T17:09:33.501 INFO:tasks.workunit.client.3.smithi157.stdout:myimage60 4/s 4/s 150 KiB/s 144 KiB/s 2.96 ms 409.04 us 2024-03-26T17:09:33.501 INFO:tasks.workunit.client.3.smithi157.stdout:myimage13 4/s 2/s 140 KiB/s 68 KiB/s 2.45 ms 405.21 us 2024-03-26T17:09:33.501 INFO:tasks.workunit.client.3.smithi157.stdout:myimage16 4/s 5/s 106 KiB/s 142 KiB/s 2.40 ms 355.76 us 2024-03-26T17:09:33.502 INFO:tasks.workunit.client.3.smithi157.stdout:myimage18 4/s 3/s 129 KiB/s 96 KiB/s 2.60 ms 495.31 us 2024-03-26T17:09:33.502 INFO:tasks.workunit.client.3.smithi157.stdout:myimage27 4/s 4/s 116 KiB/s 115 KiB/s 2.43 ms 382.54 us 2024-03-26T17:09:33.502 INFO:tasks.workunit.client.3.smithi157.stdout:myimage51 4/s 4/s 120 KiB/s 126 KiB/s 3.12 ms 322.18 us 2024-03-26T17:09:33.502 INFO:tasks.workunit.client.3.smithi157.stdout:myimage55 4/s 4/s 136 KiB/s 129 KiB/s 3.11 ms 351.61 us 2024-03-26T17:09:33.502 INFO:tasks.workunit.client.3.smithi157.stdout:myimage2 4/s 3/s 147 KiB/s 98 KiB/s 2.94 ms 328.89 us 2024-03-26T17:09:33.503 INFO:tasks.workunit.client.3.smithi157.stdout:myimage35 4/s 3/s 132 KiB/s 89 KiB/s 2.77 ms 333.08 us 2024-03-26T17:09:33.503 INFO:tasks.workunit.client.3.smithi157.stdout:myimage40 4/s 4/s 148 KiB/s 98 KiB/s 2.51 ms 362.64 us 2024-03-26T17:09:33.503 INFO:tasks.workunit.client.3.smithi157.stdout:myimage25 4/s 3/s 133 KiB/s 102 KiB/s 3.49 ms 338.95 us 2024-03-26T17:09:33.503 INFO:tasks.workunit.client.3.smithi157.stdout:myimage50 4/s 2/s 110 KiB/s 104 KiB/s 2.65 ms 338.82 us 2024-03-26T17:09:33.503 INFO:tasks.workunit.client.3.smithi157.stdout:myimage57 4/s 3/s 128 KiB/s 113 KiB/s 2.96 ms 354.29 us 2024-03-26T17:09:33.504 INFO:tasks.workunit.client.3.smithi157.stdout:myimage44 4/s 4/s 135 KiB/s 162 KiB/s 2.61 ms 498.42 us 2024-03-26T17:09:33.504 INFO:tasks.workunit.client.3.smithi157.stdout:myimage58 4/s 3/s 126 KiB/s 90 KiB/s 2.34 ms 329.66 us 2024-03-26T17:09:33.504 INFO:tasks.workunit.client.3.smithi157.stdout:myimage39 4/s 4/s 128 KiB/s 150 KiB/s 2.72 ms 384.52 us 2024-03-26T17:09:33.504 INFO:tasks.workunit.client.3.smithi157.stdout:myimage43 4/s 2/s 98 KiB/s 63 KiB/s 3.15 ms 596.23 us 2024-03-26T17:09:33.505 INFO:tasks.workunit.client.3.smithi157.stdout:myimage3 4/s 4/s 143 KiB/s 91 KiB/s 2.39 ms 362.04 us 2024-03-26T17:09:33.505 INFO:tasks.workunit.client.3.smithi157.stdout:myimage31 4/s 4/s 94 KiB/s 97 KiB/s 3.21 ms 352.23 us 2024-03-26T17:09:33.505 INFO:tasks.workunit.client.3.smithi157.stdout:myimage49 4/s 4/s 118 KiB/s 116 KiB/s 2.74 ms 339.95 us 2024-03-26T17:09:33.505 INFO:tasks.workunit.client.3.smithi157.stdout:myimage5 4/s 4/s 105 KiB/s 138 KiB/s 2.36 ms 437.41 us 2024-03-26T17:09:33.505 INFO:tasks.workunit.client.3.smithi157.stdout:myimage6 4/s 2/s 102 KiB/s 66 KiB/s 3.16 ms 305.54 us 2024-03-26T17:09:33.505 INFO:tasks.workunit.client.3.smithi157.stdout:myimage28 4/s 4/s 108 KiB/s 109 KiB/s 3.57 ms 463.50 us 2024-03-26T17:09:33.506 INFO:tasks.workunit.client.3.smithi157.stdout:myimage29 4/s 5/s 121 KiB/s 119 KiB/s 2.58 ms 332.44 us 2024-03-26T17:09:33.506 INFO:tasks.workunit.client.3.smithi157.stdout:myimage36 4/s 3/s 109 KiB/s 87 KiB/s 2.73 ms 422.46 us 2024-03-26T17:09:33.506 INFO:tasks.workunit.client.3.smithi157.stdout:myimage45 4/s 3/s 151 KiB/s 126 KiB/s 2.71 ms 375.73 us 2024-03-26T17:09:33.506 INFO:tasks.workunit.client.3.smithi157.stdout:myimage53 4/s 3/s 122 KiB/s 150 KiB/s 2.71 ms 499.56 us 2024-03-26T17:09:33.506 INFO:tasks.workunit.client.3.smithi157.stdout:myimage32 3/s 4/s 112 KiB/s 128 KiB/s 2.82 ms 361.18 us 2024-03-26T17:09:33.507 INFO:tasks.workunit.client.3.smithi157.stdout:myimage38 3/s 4/s 93 KiB/s 145 KiB/s 2.13 ms 301.23 us 2024-03-26T17:09:33.507 INFO:tasks.workunit.client.3.smithi157.stdout:myimage7 3/s 4/s 124 KiB/s 146 KiB/s 2.74 ms 409.01 us 2024-03-26T17:09:33.507 INFO:tasks.workunit.client.3.smithi157.stdout:myimage15 3/s 4/s 88 KiB/s 124 KiB/s 2.25 ms 340.96 us 2024-03-26T17:09:33.507 INFO:tasks.workunit.client.3.smithi157.stdout:myimage19 3/s 3/s 99 KiB/s 94 KiB/s 2.68 ms 359.31 us 2024-03-26T17:09:33.507 INFO:tasks.workunit.client.3.smithi157.stdout:myimage46 3/s 4/s 74 KiB/s 126 KiB/s 2.76 ms 352.33 us 2024-03-26T17:09:33.507 INFO:tasks.workunit.client.3.smithi157.stdout:myimage30 3/s 4/s 143 KiB/s 114 KiB/s 3.35 ms 312.07 us 2024-03-26T17:09:33.508 INFO:tasks.workunit.client.3.smithi157.stdout:myimage17 3/s 4/s 114 KiB/s 131 KiB/s 2.77 ms 344.15 us 2024-03-26T17:09:33.508 INFO:tasks.workunit.client.3.smithi157.stdout:myimage9 3/s 4/s 74 KiB/s 115 KiB/s 3.11 ms 419.51 us 2024-03-26T17:09:33.508 INFO:tasks.workunit.client.3.smithi157.stdout:myimage24 3/s 4/s 119 KiB/s 146 KiB/s 2.70 ms 420.60 us 2024-03-26T17:09:33.508 INFO:tasks.workunit.client.3.smithi157.stdout:myimage56 3/s 4/s 93 KiB/s 93 KiB/s 3.30 ms 342.56 us 2024-03-26T17:09:33.508 INFO:tasks.workunit.client.3.smithi157.stdout:myimage59 3/s 4/s 107 KiB/s 130 KiB/s 3.30 ms 514.44 us 2024-03-26T17:09:33.509 INFO:tasks.workunit.client.3.smithi157.stdout:myimage47 3/s 4/s 93 KiB/s 106 KiB/s 2.97 ms 337.13 us 2024-03-26T17:09:33.509 INFO:tasks.workunit.client.3.smithi157.stdout:myimage48 3/s 4/s 76 KiB/s 115 KiB/s 2.83 ms 423.57 us 2024-03-26T17:09:33.509 INFO:tasks.workunit.client.3.smithi157.stdout:myimage52 3/s 5/s 85 KiB/s 146 KiB/s 2.91 ms 414.18 us 2024-03-26T17:09:33.509 INFO:tasks.workunit.client.3.smithi157.stdout:myimage1 3/s 5/s 84 KiB/s 143 KiB/s 2.00 ms 400.54 us 2024-03-26T17:09:33.509 INFO:tasks.workunit.client.3.smithi157.stdout:myimage11 3/s 4/s 86 KiB/s 165 KiB/s 3.34 ms 377.77 us 2024-03-26T17:09:33.509 INFO:tasks.workunit.client.3.smithi157.stdout:myimage23 3/s 4/s 79 KiB/s 102 KiB/s 2.58 ms 363.61 us 2024-03-26T17:09:33.510 INFO:tasks.workunit.client.3.smithi157.stdout:myimage34 3/s 4/s 114 KiB/s 173 KiB/s 2.63 ms 347.51 us 2024-03-26T17:09:33.510 INFO:tasks.workunit.client.3.smithi157.stdout:myimage20 3/s 4/s 102 KiB/s 82 KiB/s 2.42 ms 379.86 us 2024-03-26T17:09:33.510 INFO:tasks.workunit.client.3.smithi157.stdout:myimage26 3/s 4/s 87 KiB/s 94 KiB/s 2.83 ms 375.30 us 2024-03-26T17:09:33.510 INFO:tasks.workunit.client.3.smithi157.stdout:myimage33 3/s 5/s 95 KiB/s 139 KiB/s 2.79 ms 410.31 us 2024-03-26T17:09:33.510 INFO:tasks.workunit.client.3.smithi157.stdout:myimage37 2/s 4/s 62 KiB/s 118 KiB/s 2.98 ms 348.03 us 2024-03-26T17:09:33.511 INFO:tasks.workunit.client.3.smithi157.stdout:myimage4 2/s 4/s 68 KiB/s 150 KiB/s 2.59 ms 411.83 us 2024-03-26T17:09:33.511 INFO:tasks.workunit.client.3.smithi157.stdout:myimage54 2/s 5/s 58 KiB/s 179 KiB/s 2.73 ms 437.91 us 2024-03-26T17:09:33.511 INFO:tasks.workunit.client.3.smithi157.stdout:myimage10 2/s 3/s 82 KiB/s 90 KiB/s 2.67 ms 387.09 us 2024-03-26T17:09:33.511 INFO:tasks.workunit.client.3.smithi157.stdout:myimage41 2/s 4/s 83 KiB/s 145 KiB/s 2.94 ms 328.13 us 2024-03-26T17:09:33.511 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:09:33.512 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:09:33 smithi149 ceph-mon[34678]: pgmap v712: 33 pgs: 33 active+clean; 1.0 GiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 6.5 MiB/s rd, 6.6 MiB/s wr, 459 op/s 2024-03-26T17:09:33.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:09:33 smithi044 ceph-mon[30624]: pgmap v712: 33 pgs: 33 active+clean; 1.0 GiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 6.5 MiB/s rd, 6.6 MiB/s wr, 459 op/s 2024-03-26T17:09:33.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:09:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:09:33] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:09:33.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:09:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:09:33] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:09:33.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:09:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:09:33.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:09:33 smithi064 ceph-mon[34420]: pgmap v712: 33 pgs: 33 active+clean; 1.0 GiB data, 4.2 GiB used, 711 GiB / 715 GiB avail; 6.5 MiB/s rd, 6.6 MiB/s wr, 459 op/s 2024-03-26T17:09:33.897 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:09:33 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:09:33] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:09:33.898 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:09:33 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:09:33] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:09:33.898 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:09:33 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:09:34.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:09:34 smithi044 ceph-mon[30624]: Health check update: 3 slow ops, oldest one blocked for 668 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:09:34.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:09:34 smithi064 ceph-mon[34420]: Health check update: 3 slow ops, oldest one blocked for 668 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:09:34.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:09:34 smithi149 ceph-mon[34678]: Health check update: 3 slow ops, oldest one blocked for 668 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:09:35.517 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:09:35 smithi044 ceph-mon[30624]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:09:35.518 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:09:35 smithi044 ceph-mon[30624]: { 2024-03-26T17:09:35.518 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:09:35 smithi044 ceph-mon[30624]: "prefix": "rbd perf image stats", 2024-03-26T17:09:35.518 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:09:35 smithi044 ceph-mon[30624]: "pool_spec": "mypool", 2024-03-26T17:09:35.518 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:09:35 smithi044 ceph-mon[30624]: "sort_by": "write_ops", 2024-03-26T17:09:35.518 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:09:35 smithi044 ceph-mon[30624]: "format": "json" 2024-03-26T17:09:35.518 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:09:35 smithi044 ceph-mon[30624]: }"]: dispatch 2024-03-26T17:09:35.518 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:09:35 smithi044 ceph-mon[30624]: pgmap v713: 33 pgs: 33 active+clean; 1.0 GiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 7.1 MiB/s rd, 7.0 MiB/s wr, 492 op/s 2024-03-26T17:09:35.519 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:09:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:09:35] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:09:35.519 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:09:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:09:35] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:09:35.519 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:09:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:09:35.520 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:09:35 smithi149 ceph-mon[34678]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:09:35.520 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:09:35 smithi149 ceph-mon[34678]: { 2024-03-26T17:09:35.520 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:09:35 smithi149 ceph-mon[34678]: "prefix": "rbd perf image stats", 2024-03-26T17:09:35.520 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:09:35 smithi149 ceph-mon[34678]: "pool_spec": "mypool", 2024-03-26T17:09:35.520 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:09:35 smithi149 ceph-mon[34678]: "sort_by": "write_ops", 2024-03-26T17:09:35.520 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:09:35 smithi149 ceph-mon[34678]: "format": "json" 2024-03-26T17:09:35.520 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:09:35 smithi149 ceph-mon[34678]: }"]: dispatch 2024-03-26T17:09:35.521 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:09:35 smithi149 ceph-mon[34678]: pgmap v713: 33 pgs: 33 active+clean; 1.0 GiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 7.1 MiB/s rd, 7.0 MiB/s wr, 492 op/s 2024-03-26T17:09:35.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:09:35 smithi064 ceph-mon[34420]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:09:35.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:09:35 smithi064 ceph-mon[34420]: { 2024-03-26T17:09:35.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:09:35 smithi064 ceph-mon[34420]: "prefix": "rbd perf image stats", 2024-03-26T17:09:35.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:09:35 smithi064 ceph-mon[34420]: "pool_spec": "mypool", 2024-03-26T17:09:35.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:09:35 smithi064 ceph-mon[34420]: "sort_by": "write_ops", 2024-03-26T17:09:35.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:09:35 smithi064 ceph-mon[34420]: "format": "json" 2024-03-26T17:09:35.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:09:35 smithi064 ceph-mon[34420]: }"]: dispatch 2024-03-26T17:09:35.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:09:35 smithi064 ceph-mon[34420]: pgmap v713: 33 pgs: 33 active+clean; 1.0 GiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 7.1 MiB/s rd, 7.0 MiB/s wr, 492 op/s 2024-03-26T17:09:35.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:09:35 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:09:35] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:09:35.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:09:35 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:09:35] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:09:35.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:09:35 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:09:36.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:09:36 smithi044 ceph-mon[30624]: pgmap v714: 33 pgs: 33 active+clean; 1.0 GiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 7.1 MiB/s rd, 7.1 MiB/s wr, 501 op/s 2024-03-26T17:09:36.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:09:36 smithi064 ceph-mon[34420]: pgmap v714: 33 pgs: 33 active+clean; 1.0 GiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 7.1 MiB/s rd, 7.1 MiB/s wr, 501 op/s 2024-03-26T17:09:36.645 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:09:36 smithi149 ceph-mon[34678]: pgmap v714: 33 pgs: 33 active+clean; 1.0 GiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 7.1 MiB/s rd, 7.1 MiB/s wr, 501 op/s 2024-03-26T17:09:36.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:09:36 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 2024-03-26T17:09:36.239+0000 7fa707a55700 -1 mon.c@1(peon) e3 get_health_metrics reporting 3 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T17:09:37.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:09:37 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:09:37] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:09:37.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:09:37 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:09:37] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:09:37.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:09:37 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:09:37.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:09:37 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:09:37] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:09:37.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:09:37 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:09:37] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:09:37.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:09:37 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:09:38.502 INFO:tasks.workunit.client.3.smithi157.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-26T17:09:38.503 INFO:tasks.workunit.client.3.smithi157.stdout:myimage58 5/s 3/s 139 KiB/s 114 KiB/s 2.56 ms 360.40 us 2024-03-26T17:09:38.503 INFO:tasks.workunit.client.3.smithi157.stdout:myimage4 5/s 3/s 186 KiB/s 83 KiB/s 2.66 ms 314.70 us 2024-03-26T17:09:38.503 INFO:tasks.workunit.client.3.smithi157.stdout:myimage34 5/s 3/s 150 KiB/s 106 KiB/s 2.41 ms 396.89 us 2024-03-26T17:09:38.503 INFO:tasks.workunit.client.3.smithi157.stdout:myimage8 5/s 3/s 144 KiB/s 98 KiB/s 2.97 ms 351.63 us 2024-03-26T17:09:38.503 INFO:tasks.workunit.client.3.smithi157.stdout:myimage51 5/s 2/s 156 KiB/s 66 KiB/s 2.98 ms 336.17 us 2024-03-26T17:09:38.503 INFO:tasks.workunit.client.3.smithi157.stdout:myimage23 5/s 4/s 141 KiB/s 139 KiB/s 2.19 ms 366.69 us 2024-03-26T17:09:38.503 INFO:tasks.workunit.client.3.smithi157.stdout:myimage35 5/s 3/s 162 KiB/s 117 KiB/s 2.78 ms 356.53 us 2024-03-26T17:09:38.503 INFO:tasks.workunit.client.3.smithi157.stdout:myimage21 5/s 3/s 132 KiB/s 74 KiB/s 3.30 ms 339.92 us 2024-03-26T17:09:38.503 INFO:tasks.workunit.client.3.smithi157.stdout:myimage38 4/s 3/s 147 KiB/s 97 KiB/s 2.29 ms 329.63 us 2024-03-26T17:09:38.503 INFO:tasks.workunit.client.3.smithi157.stdout:myimage1 4/s 3/s 146 KiB/s 65 KiB/s 2.20 ms 308.75 us 2024-03-26T17:09:38.503 INFO:tasks.workunit.client.3.smithi157.stdout:myimage27 4/s 3/s 119 KiB/s 95 KiB/s 2.49 ms 492.54 us 2024-03-26T17:09:38.503 INFO:tasks.workunit.client.3.smithi157.stdout:myimage22 4/s 3/s 130 KiB/s 87 KiB/s 2.40 ms 348.72 us 2024-03-26T17:09:38.503 INFO:tasks.workunit.client.3.smithi157.stdout:myimage18 4/s 3/s 112 KiB/s 118 KiB/s 2.65 ms 354.90 us 2024-03-26T17:09:38.503 INFO:tasks.workunit.client.3.smithi157.stdout:myimage16 4/s 2/s 128 KiB/s 73 KiB/s 2.77 ms 431.75 us 2024-03-26T17:09:38.504 INFO:tasks.workunit.client.3.smithi157.stdout:myimage32 4/s 3/s 120 KiB/s 82 KiB/s 2.78 ms 377.76 us 2024-03-26T17:09:38.504 INFO:tasks.workunit.client.3.smithi157.stdout:myimage15 4/s 3/s 134 KiB/s 86 KiB/s 2.21 ms 351.94 us 2024-03-26T17:09:38.504 INFO:tasks.workunit.client.3.smithi157.stdout:myimage17 4/s 3/s 124 KiB/s 124 KiB/s 2.98 ms 386.59 us 2024-03-26T17:09:38.504 INFO:tasks.workunit.client.3.smithi157.stdout:myimage19 4/s 3/s 118 KiB/s 78 KiB/s 2.55 ms 343.18 us 2024-03-26T17:09:38.504 INFO:tasks.workunit.client.3.smithi157.stdout:myimage29 4/s 3/s 159 KiB/s 80 KiB/s 2.46 ms 334.05 us 2024-03-26T17:09:38.504 INFO:tasks.workunit.client.3.smithi157.stdout:myimage10 4/s 3/s 117 KiB/s 128 KiB/s 2.68 ms 362.79 us 2024-03-26T17:09:38.504 INFO:tasks.workunit.client.3.smithi157.stdout:myimage2 4/s 3/s 131 KiB/s 90 KiB/s 2.82 ms 347.00 us 2024-03-26T17:09:38.504 INFO:tasks.workunit.client.3.smithi157.stdout:myimage40 4/s 4/s 104 KiB/s 135 KiB/s 2.52 ms 425.36 us 2024-03-26T17:09:38.504 INFO:tasks.workunit.client.3.smithi157.stdout:myimage47 4/s 4/s 121 KiB/s 154 KiB/s 2.95 ms 425.87 us 2024-03-26T17:09:38.504 INFO:tasks.workunit.client.3.smithi157.stdout:myimage6 4/s 4/s 103 KiB/s 101 KiB/s 2.79 ms 338.25 us 2024-03-26T17:09:38.504 INFO:tasks.workunit.client.3.smithi157.stdout:myimage7 4/s 3/s 119 KiB/s 86 KiB/s 2.78 ms 444.10 us 2024-03-26T17:09:38.504 INFO:tasks.workunit.client.3.smithi157.stdout:myimage20 4/s 3/s 108 KiB/s 93 KiB/s 2.72 ms 311.88 us 2024-03-26T17:09:38.504 INFO:tasks.workunit.client.3.smithi157.stdout:myimage39 4/s 4/s 149 KiB/s 96 KiB/s 2.66 ms 396.32 us 2024-03-26T17:09:38.504 INFO:tasks.workunit.client.3.smithi157.stdout:myimage3 4/s 4/s 106 KiB/s 116 KiB/s 2.33 ms 344.49 us 2024-03-26T17:09:38.505 INFO:tasks.workunit.client.3.smithi157.stdout:myimage30 4/s 4/s 133 KiB/s 110 KiB/s 3.40 ms 342.92 us 2024-03-26T17:09:38.505 INFO:tasks.workunit.client.3.smithi157.stdout:myimage9 4/s 4/s 101 KiB/s 117 KiB/s 2.88 ms 394.71 us 2024-03-26T17:09:38.505 INFO:tasks.workunit.client.3.smithi157.stdout:myimage11 4/s 4/s 110 KiB/s 139 KiB/s 3.36 ms 339.12 us 2024-03-26T17:09:38.505 INFO:tasks.workunit.client.3.smithi157.stdout:myimage33 4/s 4/s 122 KiB/s 130 KiB/s 2.74 ms 344.98 us 2024-03-26T17:09:38.505 INFO:tasks.workunit.client.3.smithi157.stdout:myimage36 4/s 4/s 94 KiB/s 115 KiB/s 2.58 ms 348.09 us 2024-03-26T17:09:38.505 INFO:tasks.workunit.client.3.smithi157.stdout:myimage41 4/s 4/s 127 KiB/s 127 KiB/s 2.81 ms 348.38 us 2024-03-26T17:09:38.505 INFO:tasks.workunit.client.3.smithi157.stdout:myimage53 4/s 3/s 113 KiB/s 110 KiB/s 2.72 ms 362.88 us 2024-03-26T17:09:38.505 INFO:tasks.workunit.client.3.smithi157.stdout:myimage59 4/s 4/s 125 KiB/s 95 KiB/s 3.20 ms 553.89 us 2024-03-26T17:09:38.505 INFO:tasks.workunit.client.3.smithi157.stdout:myimage44 3/s 3/s 82 KiB/s 78 KiB/s 2.74 ms 316.28 us 2024-03-26T17:09:38.505 INFO:tasks.workunit.client.3.smithi157.stdout:myimage48 3/s 4/s 102 KiB/s 114 KiB/s 2.71 ms 334.43 us 2024-03-26T17:09:38.505 INFO:tasks.workunit.client.3.smithi157.stdout:myimage49 3/s 4/s 96 KiB/s 132 KiB/s 2.67 ms 358.48 us 2024-03-26T17:09:38.505 INFO:tasks.workunit.client.3.smithi157.stdout:myimage24 3/s 4/s 103 KiB/s 115 KiB/s 2.90 ms 402.48 us 2024-03-26T17:09:38.505 INFO:tasks.workunit.client.3.smithi157.stdout:myimage28 3/s 3/s 104 KiB/s 121 KiB/s 3.52 ms 500.58 us 2024-03-26T17:09:38.505 INFO:tasks.workunit.client.3.smithi157.stdout:myimage37 3/s 4/s 126 KiB/s 114 KiB/s 2.86 ms 365.79 us 2024-03-26T17:09:38.506 INFO:tasks.workunit.client.3.smithi157.stdout:myimage25 3/s 4/s 108 KiB/s 128 KiB/s 3.25 ms 347.98 us 2024-03-26T17:09:38.506 INFO:tasks.workunit.client.3.smithi157.stdout:myimage42 3/s 4/s 108 KiB/s 119 KiB/s 2.68 ms 338.27 us 2024-03-26T17:09:38.506 INFO:tasks.workunit.client.3.smithi157.stdout:myimage43 3/s 4/s 103 KiB/s 148 KiB/s 2.71 ms 475.46 us 2024-03-26T17:09:38.506 INFO:tasks.workunit.client.3.smithi157.stdout:myimage45 3/s 5/s 127 KiB/s 155 KiB/s 2.76 ms 373.58 us 2024-03-26T17:09:38.506 INFO:tasks.workunit.client.3.smithi157.stdout:myimage54 3/s 4/s 98 KiB/s 99 KiB/s 2.74 ms 369.58 us 2024-03-26T17:09:38.506 INFO:tasks.workunit.client.3.smithi157.stdout:myimage55 3/s 4/s 98 KiB/s 113 KiB/s 2.89 ms 344.76 us 2024-03-26T17:09:38.506 INFO:tasks.workunit.client.3.smithi157.stdout:myimage14 3/s 3/s 76 KiB/s 126 KiB/s 3.11 ms 373.25 us 2024-03-26T17:09:38.506 INFO:tasks.workunit.client.3.smithi157.stdout:myimage50 3/s 4/s 76 KiB/s 107 KiB/s 2.65 ms 338.42 us 2024-03-26T17:09:38.506 INFO:tasks.workunit.client.3.smithi157.stdout:myimage56 3/s 4/s 95 KiB/s 134 KiB/s 3.26 ms 337.19 us 2024-03-26T17:09:38.506 INFO:tasks.workunit.client.3.smithi157.stdout:myimage57 3/s 3/s 80 KiB/s 120 KiB/s 2.55 ms 361.46 us 2024-03-26T17:09:38.506 INFO:tasks.workunit.client.3.smithi157.stdout:myimage60 3/s 3/s 81 KiB/s 85 KiB/s 2.95 ms 318.17 us 2024-03-26T17:09:38.506 INFO:tasks.workunit.client.3.smithi157.stdout:myimage52 3/s 4/s 50 KiB/s 120 KiB/s 3.04 ms 413.50 us 2024-03-26T17:09:38.506 INFO:tasks.workunit.client.3.smithi157.stdout:myimage12 3/s 4/s 83 KiB/s 158 KiB/s 3.08 ms 376.51 us 2024-03-26T17:09:38.506 INFO:tasks.workunit.client.3.smithi157.stdout:myimage26 3/s 5/s 85 KiB/s 154 KiB/s 2.97 ms 394.27 us 2024-03-26T17:09:38.506 INFO:tasks.workunit.client.3.smithi157.stdout:myimage46 3/s 5/s 89 KiB/s 134 KiB/s 2.74 ms 361.93 us 2024-03-26T17:09:38.507 INFO:tasks.workunit.client.3.smithi157.stdout:myimage13 2/s 4/s 79 KiB/s 117 KiB/s 2.40 ms 359.00 us 2024-03-26T17:09:38.507 INFO:tasks.workunit.client.3.smithi157.stdout:myimage31 2/s 5/s 81 KiB/s 122 KiB/s 3.06 ms 340.62 us 2024-03-26T17:09:38.507 INFO:tasks.workunit.client.3.smithi157.stdout:myimage5 2/s 4/s 72 KiB/s 120 KiB/s 2.65 ms 328.39 us 2024-03-26T17:09:38.507 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:09:39.015 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:09:38 smithi044 ceph-mon[30624]: pgmap v715: 33 pgs: 33 active+clean; 1.0 GiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 6.3 MiB/s rd, 6.2 MiB/s wr, 450 op/s 2024-03-26T17:09:39.015 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:09:38 smithi044 ceph-mon[30624]: Health check update: 3 slow ops, oldest one blocked for 673 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:09:39.055 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:09:38 smithi064 ceph-mon[34420]: pgmap v715: 33 pgs: 33 active+clean; 1.0 GiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 6.3 MiB/s rd, 6.2 MiB/s wr, 450 op/s 2024-03-26T17:09:39.055 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:09:38 smithi064 ceph-mon[34420]: Health check update: 3 slow ops, oldest one blocked for 673 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:09:39.145 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:09:38 smithi149 ceph-mon[34678]: pgmap v715: 33 pgs: 33 active+clean; 1.0 GiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 6.3 MiB/s rd, 6.2 MiB/s wr, 450 op/s 2024-03-26T17:09:39.146 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:09:38 smithi149 ceph-mon[34678]: Health check update: 3 slow ops, oldest one blocked for 673 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:09:39.731 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:09:39 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:09:39] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:09:39.731 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:09:39 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:09:39] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:09:39.731 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:09:39 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:09:39.896 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:09:39 smithi149 ceph-mon[34678]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:09:39.896 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:09:39 smithi149 ceph-mon[34678]: { 2024-03-26T17:09:39.896 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:09:39 smithi149 ceph-mon[34678]: "prefix": "rbd perf image stats", 2024-03-26T17:09:39.896 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:09:39 smithi149 ceph-mon[34678]: "pool_spec": "mypool", 2024-03-26T17:09:39.896 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:09:39 smithi149 ceph-mon[34678]: "sort_by": "write_ops", 2024-03-26T17:09:39.896 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:09:39 smithi149 ceph-mon[34678]: "format": "json" 2024-03-26T17:09:39.896 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:09:39 smithi149 ceph-mon[34678]: }"]: dispatch 2024-03-26T17:09:39.897 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:09:39 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:09:39] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:09:39.897 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:09:39 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:09:39] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:09:39.897 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:09:39 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:09:40.015 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:09:39 smithi044 ceph-mon[30624]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:09:40.015 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:09:39 smithi044 ceph-mon[30624]: { 2024-03-26T17:09:40.015 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:09:39 smithi044 ceph-mon[30624]: "prefix": "rbd perf image stats", 2024-03-26T17:09:40.015 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:09:39 smithi044 ceph-mon[30624]: "pool_spec": "mypool", 2024-03-26T17:09:40.015 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:09:39 smithi044 ceph-mon[30624]: "sort_by": "write_ops", 2024-03-26T17:09:40.015 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:09:39 smithi044 ceph-mon[30624]: "format": "json" 2024-03-26T17:09:40.015 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:09:39 smithi044 ceph-mon[30624]: }"]: dispatch 2024-03-26T17:09:40.055 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:09:39 smithi064 ceph-mon[34420]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:09:40.056 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:09:39 smithi064 ceph-mon[34420]: { 2024-03-26T17:09:40.056 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:09:39 smithi064 ceph-mon[34420]: "prefix": "rbd perf image stats", 2024-03-26T17:09:40.056 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:09:39 smithi064 ceph-mon[34420]: "pool_spec": "mypool", 2024-03-26T17:09:40.056 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:09:39 smithi064 ceph-mon[34420]: "sort_by": "write_ops", 2024-03-26T17:09:40.056 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:09:39 smithi064 ceph-mon[34420]: "format": "json" 2024-03-26T17:09:40.056 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:09:39 smithi064 ceph-mon[34420]: }"]: dispatch 2024-03-26T17:09:41.015 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:09:40 smithi044 ceph-mon[30624]: pgmap v716: 33 pgs: 33 active+clean; 1.0 GiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 6.7 MiB/s rd, 6.5 MiB/s wr, 482 op/s 2024-03-26T17:09:41.055 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:09:40 smithi064 ceph-mon[34420]: pgmap v716: 33 pgs: 33 active+clean; 1.0 GiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 6.7 MiB/s rd, 6.5 MiB/s wr, 482 op/s 2024-03-26T17:09:41.145 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:09:40 smithi149 ceph-mon[34678]: pgmap v716: 33 pgs: 33 active+clean; 1.0 GiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 6.7 MiB/s rd, 6.5 MiB/s wr, 482 op/s 2024-03-26T17:09:41.557 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:09:41 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 2024-03-26T17:09:41.239+0000 7fa707a55700 -1 mon.c@1(peon) e3 get_health_metrics reporting 3 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T17:09:41.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:09:41 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:09:41] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:09:41.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:09:41 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:09:41] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:09:41.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:09:41 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:09:41.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:09:41 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:09:41] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:09:41.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:09:41 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:09:41] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:09:41.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:09:41 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:09:43.015 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:09:42 smithi044 ceph-mon[30624]: pgmap v717: 33 pgs: 33 active+clean; 1.0 GiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 6.5 MiB/s rd, 6.2 MiB/s wr, 467 op/s 2024-03-26T17:09:43.055 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:09:42 smithi064 ceph-mon[34420]: pgmap v717: 33 pgs: 33 active+clean; 1.0 GiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 6.5 MiB/s rd, 6.2 MiB/s wr, 467 op/s 2024-03-26T17:09:43.062 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:09:43.070 INFO:tasks.workunit.client.3.smithi157.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2024-03-26T17:09:43.071 INFO:tasks.workunit.client.3.smithi157.stdout: 7.90 90.0k 93.2k 0.0k 900.0k 932.0k 0.0k nvme2n1 2024-03-26T17:09:43.071 INFO:tasks.workunit.client.3.smithi157.stdout: 7.80 113.6k 94.0k 0.0k 1.1M 940.0k 0.0k nvme2n10 2024-03-26T17:09:43.071 INFO:tasks.workunit.client.3.smithi157.stdout: 7.80 132.4k 80.8k 0.0k 1.3M 808.0k 0.0k nvme2n11 2024-03-26T17:09:43.071 INFO:tasks.workunit.client.3.smithi157.stdout: 7.80 115.6k 101.2k 0.0k 1.1M 1012.0k 0.0k nvme2n12 2024-03-26T17:09:43.071 INFO:tasks.workunit.client.3.smithi157.stdout: 7.80 97.6k 108.8k 0.0k 976.0k 1.1M 0.0k nvme2n13 2024-03-26T17:09:43.071 INFO:tasks.workunit.client.3.smithi157.stdout: 7.80 107.6k 132.4k 0.0k 1.1M 1.3M 0.0k nvme2n14 2024-03-26T17:09:43.071 INFO:tasks.workunit.client.3.smithi157.stdout: 7.80 78.0k 114.8k 0.0k 780.0k 1.1M 0.0k nvme2n15 2024-03-26T17:09:43.071 INFO:tasks.workunit.client.3.smithi157.stdout: 7.80 83.6k 127.2k 0.0k 836.0k 1.2M 0.0k nvme2n16 2024-03-26T17:09:43.071 INFO:tasks.workunit.client.3.smithi157.stdout: 7.80 122.0k 96.4k 0.0k 1.2M 964.0k 0.0k nvme2n17 2024-03-26T17:09:43.071 INFO:tasks.workunit.client.3.smithi157.stdout: 7.90 88.0k 84.8k 0.0k 880.0k 848.0k 0.0k nvme2n18 2024-03-26T17:09:43.071 INFO:tasks.workunit.client.3.smithi157.stdout: 7.90 111.6k 75.6k 0.0k 1.1M 756.0k 0.0k nvme2n19 2024-03-26T17:09:43.071 INFO:tasks.workunit.client.3.smithi157.stdout: 7.90 107.2k 103.6k 0.0k 1.0M 1.0M 0.0k nvme2n2 2024-03-26T17:09:43.072 INFO:tasks.workunit.client.3.smithi157.stdout: 7.90 88.8k 91.6k 0.0k 888.0k 916.0k 0.0k nvme2n20 2024-03-26T17:09:43.072 INFO:tasks.workunit.client.3.smithi157.stdout: 7.90 88.8k 109.6k 0.0k 888.0k 1.1M 0.0k nvme2n3 2024-03-26T17:09:43.072 INFO:tasks.workunit.client.3.smithi157.stdout: 7.80 120.8k 86.4k 0.0k 1.2M 864.0k 0.0k nvme2n4 2024-03-26T17:09:43.072 INFO:tasks.workunit.client.3.smithi157.stdout: 7.80 100.4k 97.6k 0.0k 1004.0k 976.0k 0.0k nvme2n5 2024-03-26T17:09:43.072 INFO:tasks.workunit.client.3.smithi157.stdout: 7.80 100.4k 86.0k 0.0k 1004.0k 860.0k 0.0k nvme2n6 2024-03-26T17:09:43.072 INFO:tasks.workunit.client.3.smithi157.stdout: 7.80 85.2k 102.8k 0.0k 852.0k 1.0M 0.0k nvme2n7 2024-03-26T17:09:43.072 INFO:tasks.workunit.client.3.smithi157.stdout: 7.80 90.8k 108.8k 0.0k 908.0k 1.1M 0.0k nvme2n8 2024-03-26T17:09:43.072 INFO:tasks.workunit.client.3.smithi157.stdout: 7.80 122.4k 76.0k 0.0k 1.2M 760.0k 0.0k nvme2n9 2024-03-26T17:09:43.072 INFO:tasks.workunit.client.3.smithi157.stdout: 7.90 101.2k 108.0k 0.0k 1012.0k 1.1M 0.0k nvme5n1 2024-03-26T17:09:43.072 INFO:tasks.workunit.client.3.smithi157.stdout: 7.80 127.2k 134.0k 0.0k 1.2M 1.3M 0.0k nvme5n10 2024-03-26T17:09:43.072 INFO:tasks.workunit.client.3.smithi157.stdout: 7.80 90.4k 128.0k 0.0k 904.0k 1.2M 0.0k nvme5n11 2024-03-26T17:09:43.072 INFO:tasks.workunit.client.3.smithi157.stdout: 7.80 95.6k 98.0k 0.0k 956.0k 980.0k 0.0k nvme5n12 2024-03-26T17:09:43.072 INFO:tasks.workunit.client.3.smithi157.stdout: 7.80 102.8k 113.6k 0.0k 1.0M 1.1M 0.0k nvme5n13 2024-03-26T17:09:43.073 INFO:tasks.workunit.client.3.smithi157.stdout: 7.80 104.8k 97.2k 0.0k 1.0M 972.0k 0.0k nvme5n14 2024-03-26T17:09:43.073 INFO:tasks.workunit.client.3.smithi157.stdout: 7.80 110.4k 136.8k 0.0k 1.1M 1.3M 0.0k nvme5n15 2024-03-26T17:09:43.073 INFO:tasks.workunit.client.3.smithi157.stdout: 7.80 89.6k 108.0k 0.0k 896.0k 1.1M 0.0k nvme5n16 2024-03-26T17:09:43.073 INFO:tasks.workunit.client.3.smithi157.stdout: 7.80 88.0k 113.6k 0.0k 880.0k 1.1M 0.0k nvme5n17 2024-03-26T17:09:43.073 INFO:tasks.workunit.client.3.smithi157.stdout: 7.80 106.8k 116.8k 0.0k 1.0M 1.1M 0.0k nvme5n18 2024-03-26T17:09:43.073 INFO:tasks.workunit.client.3.smithi157.stdout: 7.90 116.8k 117.6k 0.0k 1.1M 1.1M 0.0k nvme5n19 2024-03-26T17:09:43.073 INFO:tasks.workunit.client.3.smithi157.stdout: 7.90 95.6k 102.4k 0.0k 956.0k 1.0M 0.0k nvme5n2 2024-03-26T17:09:43.073 INFO:tasks.workunit.client.3.smithi157.stdout: 7.90 118.0k 116.0k 0.0k 1.2M 1.1M 0.0k nvme5n20 2024-03-26T17:09:43.073 INFO:tasks.workunit.client.3.smithi157.stdout: 7.90 117.6k 101.2k 0.0k 1.1M 1012.0k 0.0k nvme5n3 2024-03-26T17:09:43.073 INFO:tasks.workunit.client.3.smithi157.stdout: 7.90 111.2k 114.8k 0.0k 1.1M 1.1M 0.0k nvme5n4 2024-03-26T17:09:43.073 INFO:tasks.workunit.client.3.smithi157.stdout: 7.80 120.8k 107.2k 0.0k 1.2M 1.0M 0.0k nvme5n5 2024-03-26T17:09:43.073 INFO:tasks.workunit.client.3.smithi157.stdout: 7.80 126.4k 123.2k 0.0k 1.2M 1.2M 0.0k nvme5n6 2024-03-26T17:09:43.073 INFO:tasks.workunit.client.3.smithi157.stdout: 7.80 108.8k 105.2k 0.0k 1.1M 1.0M 0.0k nvme5n7 2024-03-26T17:09:43.074 INFO:tasks.workunit.client.3.smithi157.stdout: 7.80 111.2k 104.8k 0.0k 1.1M 1.0M 0.0k nvme5n8 2024-03-26T17:09:43.074 INFO:tasks.workunit.client.3.smithi157.stdout: 7.80 110.4k 101.6k 0.0k 1.1M 1016.0k 0.0k nvme5n9 2024-03-26T17:09:43.074 INFO:tasks.workunit.client.3.smithi157.stdout: 7.90 93.6k 113.6k 0.0k 936.0k 1.1M 0.0k nvme8n1 2024-03-26T17:09:43.074 INFO:tasks.workunit.client.3.smithi157.stdout: 7.80 107.6k 92.4k 0.0k 1.1M 924.0k 0.0k nvme8n10 2024-03-26T17:09:43.074 INFO:tasks.workunit.client.3.smithi157.stdout: 7.80 82.0k 126.8k 0.0k 820.0k 1.2M 0.0k nvme8n11 2024-03-26T17:09:43.074 INFO:tasks.workunit.client.3.smithi157.stdout: 7.80 111.6k 90.4k 0.0k 1.1M 904.0k 0.0k nvme8n12 2024-03-26T17:09:43.074 INFO:tasks.workunit.client.3.smithi157.stdout: 7.80 129.2k 84.8k 0.0k 1.3M 848.0k 0.0k nvme8n13 2024-03-26T17:09:43.074 INFO:tasks.workunit.client.3.smithi157.stdout: 7.80 102.4k 98.4k 0.0k 1.0M 984.0k 0.0k nvme8n14 2024-03-26T17:09:43.074 INFO:tasks.workunit.client.3.smithi157.stdout: 7.80 122.8k 107.2k 0.0k 1.2M 1.0M 0.0k nvme8n15 2024-03-26T17:09:43.074 INFO:tasks.workunit.client.3.smithi157.stdout: 7.80 95.6k 94.4k 0.0k 956.0k 944.0k 0.0k nvme8n16 2024-03-26T17:09:43.074 INFO:tasks.workunit.client.3.smithi157.stdout: 7.80 120.8k 93.2k 0.0k 1.2M 932.0k 0.0k nvme8n17 2024-03-26T17:09:43.074 INFO:tasks.workunit.client.3.smithi157.stdout: 7.90 122.8k 98.8k 0.0k 1.2M 988.0k 0.0k nvme8n18 2024-03-26T17:09:43.074 INFO:tasks.workunit.client.3.smithi157.stdout: 7.90 106.0k 108.0k 0.0k 1.0M 1.1M 0.0k nvme8n19 2024-03-26T17:09:43.074 INFO:tasks.workunit.client.3.smithi157.stdout: 7.90 95.2k 115.6k 0.0k 952.0k 1.1M 0.0k nvme8n2 2024-03-26T17:09:43.075 INFO:tasks.workunit.client.3.smithi157.stdout: 7.90 99.6k 86.4k 0.0k 996.0k 864.0k 0.0k nvme8n20 2024-03-26T17:09:43.075 INFO:tasks.workunit.client.3.smithi157.stdout: 7.90 116.4k 113.6k 0.0k 1.1M 1.1M 0.0k nvme8n3 2024-03-26T17:09:43.075 INFO:tasks.workunit.client.3.smithi157.stdout: 7.80 102.4k 89.2k 0.0k 1.0M 892.0k 0.0k nvme8n4 2024-03-26T17:09:43.075 INFO:tasks.workunit.client.3.smithi157.stdout: 7.80 83.2k 108.4k 0.0k 832.0k 1.1M 0.0k nvme8n5 2024-03-26T17:09:43.075 INFO:tasks.workunit.client.3.smithi157.stdout: 7.80 98.4k 92.0k 0.0k 984.0k 920.0k 0.0k nvme8n6 2024-03-26T17:09:43.075 INFO:tasks.workunit.client.3.smithi157.stdout: 7.80 114.8k 104.0k 0.0k 1.1M 1.0M 0.0k nvme8n7 2024-03-26T17:09:43.075 INFO:tasks.workunit.client.3.smithi157.stdout: 7.80 105.6k 92.0k 0.0k 1.0M 920.0k 0.0k nvme8n8 2024-03-26T17:09:43.075 INFO:tasks.workunit.client.3.smithi157.stdout: 7.80 120.8k 96.0k 0.0k 1.2M 960.0k 0.0k nvme8n9 2024-03-26T17:09:43.075 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:09:43.146 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:09:42 smithi149 ceph-mon[34678]: pgmap v717: 33 pgs: 33 active+clean; 1.0 GiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 6.5 MiB/s rd, 6.2 MiB/s wr, 467 op/s 2024-03-26T17:09:43.506 INFO:tasks.workunit.client.3.smithi157.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-26T17:09:43.506 INFO:tasks.workunit.client.3.smithi157.stdout:myimage14 5/s 4/s 167 KiB/s 104 KiB/s 3.19 ms 356.09 us 2024-03-26T17:09:43.507 INFO:tasks.workunit.client.3.smithi157.stdout:myimage3 5/s 2/s 98 KiB/s 69 KiB/s 2.79 ms 414.60 us 2024-03-26T17:09:43.507 INFO:tasks.workunit.client.3.smithi157.stdout:myimage13 5/s 4/s 129 KiB/s 127 KiB/s 2.52 ms 489.09 us 2024-03-26T17:09:43.507 INFO:tasks.workunit.client.3.smithi157.stdout:myimage27 5/s 3/s 136 KiB/s 99 KiB/s 2.65 ms 362.69 us 2024-03-26T17:09:43.507 INFO:tasks.workunit.client.3.smithi157.stdout:myimage59 5/s 3/s 126 KiB/s 90 KiB/s 3.08 ms 402.87 us 2024-03-26T17:09:43.507 INFO:tasks.workunit.client.3.smithi157.stdout:myimage12 4/s 3/s 107 KiB/s 107 KiB/s 2.70 ms 541.97 us 2024-03-26T17:09:43.507 INFO:tasks.workunit.client.3.smithi157.stdout:myimage16 4/s 2/s 142 KiB/s 46 KiB/s 2.79 ms 337.82 us 2024-03-26T17:09:43.507 INFO:tasks.workunit.client.3.smithi157.stdout:myimage5 4/s 4/s 109 KiB/s 94 KiB/s 2.46 ms 402.11 us 2024-03-26T17:09:43.507 INFO:tasks.workunit.client.3.smithi157.stdout:myimage18 4/s 3/s 94 KiB/s 108 KiB/s 2.79 ms 410.46 us 2024-03-26T17:09:43.507 INFO:tasks.workunit.client.3.smithi157.stdout:myimage45 4/s 3/s 103 KiB/s 66 KiB/s 2.64 ms 284.85 us 2024-03-26T17:09:43.507 INFO:tasks.workunit.client.3.smithi157.stdout:myimage50 4/s 4/s 118 KiB/s 108 KiB/s 2.87 ms 348.23 us 2024-03-26T17:09:43.507 INFO:tasks.workunit.client.3.smithi157.stdout:myimage57 4/s 4/s 102 KiB/s 126 KiB/s 2.78 ms 339.03 us 2024-03-26T17:09:43.507 INFO:tasks.workunit.client.3.smithi157.stdout:myimage10 4/s 4/s 123 KiB/s 106 KiB/s 2.64 ms 332.73 us 2024-03-26T17:09:43.508 INFO:tasks.workunit.client.3.smithi157.stdout:myimage48 4/s 4/s 104 KiB/s 94 KiB/s 2.93 ms 333.24 us 2024-03-26T17:09:43.508 INFO:tasks.workunit.client.3.smithi157.stdout:myimage7 4/s 3/s 86 KiB/s 79 KiB/s 2.67 ms 501.20 us 2024-03-26T17:09:43.508 INFO:tasks.workunit.client.3.smithi157.stdout:myimage24 4/s 3/s 118 KiB/s 106 KiB/s 3.11 ms 331.10 us 2024-03-26T17:09:43.508 INFO:tasks.workunit.client.3.smithi157.stdout:myimage26 4/s 3/s 138 KiB/s 96 KiB/s 2.76 ms 392.07 us 2024-03-26T17:09:43.508 INFO:tasks.workunit.client.3.smithi157.stdout:myimage20 4/s 4/s 86 KiB/s 111 KiB/s 2.72 ms 341.40 us 2024-03-26T17:09:43.508 INFO:tasks.workunit.client.3.smithi157.stdout:myimage29 4/s 2/s 94 KiB/s 99 KiB/s 2.45 ms 508.00 us 2024-03-26T17:09:43.508 INFO:tasks.workunit.client.3.smithi157.stdout:myimage42 4/s 4/s 126 KiB/s 99 KiB/s 2.62 ms 359.68 us 2024-03-26T17:09:43.508 INFO:tasks.workunit.client.3.smithi157.stdout:myimage43 4/s 3/s 102 KiB/s 120 KiB/s 2.73 ms 350.81 us 2024-03-26T17:09:43.508 INFO:tasks.workunit.client.3.smithi157.stdout:myimage54 4/s 4/s 124 KiB/s 98 KiB/s 2.62 ms 376.07 us 2024-03-26T17:09:43.508 INFO:tasks.workunit.client.3.smithi157.stdout:myimage23 4/s 3/s 90 KiB/s 92 KiB/s 2.37 ms 423.30 us 2024-03-26T17:09:43.508 INFO:tasks.workunit.client.3.smithi157.stdout:myimage31 4/s 3/s 131 KiB/s 86 KiB/s 2.90 ms 403.79 us 2024-03-26T17:09:43.508 INFO:tasks.workunit.client.3.smithi157.stdout:myimage32 4/s 3/s 98 KiB/s 86 KiB/s 2.73 ms 373.91 us 2024-03-26T17:09:43.508 INFO:tasks.workunit.client.3.smithi157.stdout:myimage47 4/s 3/s 97 KiB/s 94 KiB/s 2.90 ms 334.02 us 2024-03-26T17:09:43.508 INFO:tasks.workunit.client.3.smithi157.stdout:myimage15 4/s 3/s 94 KiB/s 92 KiB/s 2.25 ms 355.70 us 2024-03-26T17:09:43.508 INFO:tasks.workunit.client.3.smithi157.stdout:myimage28 4/s 4/s 97 KiB/s 137 KiB/s 3.46 ms 420.77 us 2024-03-26T17:09:43.509 INFO:tasks.workunit.client.3.smithi157.stdout:myimage46 4/s 3/s 82 KiB/s 90 KiB/s 2.43 ms 504.34 us 2024-03-26T17:09:43.509 INFO:tasks.workunit.client.3.smithi157.stdout:myimage51 4/s 4/s 102 KiB/s 90 KiB/s 2.87 ms 320.48 us 2024-03-26T17:09:43.509 INFO:tasks.workunit.client.3.smithi157.stdout:myimage56 4/s 4/s 93 KiB/s 110 KiB/s 3.27 ms 350.29 us 2024-03-26T17:09:43.509 INFO:tasks.workunit.client.3.smithi157.stdout:myimage22 3/s 3/s 110 KiB/s 70 KiB/s 2.76 ms 472.75 us 2024-03-26T17:09:43.509 INFO:tasks.workunit.client.3.smithi157.stdout:myimage52 3/s 4/s 110 KiB/s 102 KiB/s 2.99 ms 451.20 us 2024-03-26T17:09:43.509 INFO:tasks.workunit.client.3.smithi157.stdout:myimage58 3/s 3/s 83 KiB/s 110 KiB/s 2.60 ms 381.16 us 2024-03-26T17:09:43.509 INFO:tasks.workunit.client.3.smithi157.stdout:myimage4 3/s 3/s 90 KiB/s 106 KiB/s 2.81 ms 445.31 us 2024-03-26T17:09:43.509 INFO:tasks.workunit.client.3.smithi157.stdout:myimage53 3/s 3/s 90 KiB/s 110 KiB/s 2.64 ms 357.84 us 2024-03-26T17:09:43.509 INFO:tasks.workunit.client.3.smithi157.stdout:myimage34 3/s 2/s 58 KiB/s 84 KiB/s 2.38 ms 498.47 us 2024-03-26T17:09:43.509 INFO:tasks.workunit.client.3.smithi157.stdout:myimage35 3/s 3/s 138 KiB/s 106 KiB/s 2.58 ms 425.27 us 2024-03-26T17:09:43.509 INFO:tasks.workunit.client.3.smithi157.stdout:myimage21 3/s 4/s 80 KiB/s 134 KiB/s 3.50 ms 369.70 us 2024-03-26T17:09:43.509 INFO:tasks.workunit.client.3.smithi157.stdout:myimage8 3/s 4/s 113 KiB/s 94 KiB/s 2.72 ms 295.86 us 2024-03-26T17:09:43.509 INFO:tasks.workunit.client.3.smithi157.stdout:myimage17 3/s 4/s 73 KiB/s 124 KiB/s 2.87 ms 430.47 us 2024-03-26T17:09:43.509 INFO:tasks.workunit.client.3.smithi157.stdout:myimage19 3/s 6/s 74 KiB/s 152 KiB/s 2.76 ms 343.52 us 2024-03-26T17:09:43.509 INFO:tasks.workunit.client.3.smithi157.stdout:myimage36 3/s 3/s 100 KiB/s 90 KiB/s 2.59 ms 379.11 us 2024-03-26T17:09:43.510 INFO:tasks.workunit.client.3.smithi157.stdout:myimage39 3/s 3/s 106 KiB/s 106 KiB/s 2.68 ms 349.13 us 2024-03-26T17:09:43.510 INFO:tasks.workunit.client.3.smithi157.stdout:myimage41 3/s 3/s 93 KiB/s 75 KiB/s 2.70 ms 419.66 us 2024-03-26T17:09:43.510 INFO:tasks.workunit.client.3.smithi157.stdout:myimage30 3/s 5/s 118 KiB/s 168 KiB/s 3.24 ms 400.92 us 2024-03-26T17:09:43.510 INFO:tasks.workunit.client.3.smithi157.stdout:myimage37 3/s 4/s 88 KiB/s 94 KiB/s 2.74 ms 415.63 us 2024-03-26T17:09:43.510 INFO:tasks.workunit.client.3.smithi157.stdout:myimage38 3/s 4/s 74 KiB/s 120 KiB/s 2.41 ms 334.65 us 2024-03-26T17:09:43.510 INFO:tasks.workunit.client.3.smithi157.stdout:myimage44 3/s 4/s 89 KiB/s 109 KiB/s 2.71 ms 517.37 us 2024-03-26T17:09:43.510 INFO:tasks.workunit.client.3.smithi157.stdout:myimage49 3/s 4/s 93 KiB/s 111 KiB/s 2.56 ms 324.67 us 2024-03-26T17:09:43.510 INFO:tasks.workunit.client.3.smithi157.stdout:myimage6 3/s 4/s 83 KiB/s 94 KiB/s 2.73 ms 294.82 us 2024-03-26T17:09:43.510 INFO:tasks.workunit.client.3.smithi157.stdout:myimage25 3/s 5/s 98 KiB/s 130 KiB/s 3.35 ms 379.59 us 2024-03-26T17:09:43.510 INFO:tasks.workunit.client.3.smithi157.stdout:myimage55 3/s 4/s 94 KiB/s 138 KiB/s 3.10 ms 357.04 us 2024-03-26T17:09:43.510 INFO:tasks.workunit.client.3.smithi157.stdout:myimage2 3/s 4/s 71 KiB/s 114 KiB/s 3.02 ms 407.40 us 2024-03-26T17:09:43.510 INFO:tasks.workunit.client.3.smithi157.stdout:myimage40 3/s 3/s 110 KiB/s 119 KiB/s 2.71 ms 370.90 us 2024-03-26T17:09:43.510 INFO:tasks.workunit.client.3.smithi157.stdout:myimage1 3/s 4/s 81 KiB/s 100 KiB/s 2.17 ms 303.27 us 2024-03-26T17:09:43.511 INFO:tasks.workunit.client.3.smithi157.stdout:myimage11 3/s 5/s 86 KiB/s 153 KiB/s 2.81 ms 319.78 us 2024-03-26T17:09:43.511 INFO:tasks.workunit.client.3.smithi157.stdout:myimage33 3/s 3/s 77 KiB/s 98 KiB/s 2.95 ms 363.39 us 2024-03-26T17:09:43.511 INFO:tasks.workunit.client.3.smithi157.stdout:myimage9 2/s 5/s 53 KiB/s 146 KiB/s 3.17 ms 358.95 us 2024-03-26T17:09:43.511 INFO:tasks.workunit.client.3.smithi157.stdout:myimage60 2/s 5/s 46 KiB/s 113 KiB/s 3.12 ms 398.41 us 2024-03-26T17:09:43.511 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:09:43.738 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:09:43 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:09:43] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:09:43.739 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:09:43 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:09:43] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:09:43.739 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:09:43 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:09:43.898 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:09:43 smithi149 ceph-mon[34678]: Health check update: 3 slow ops, oldest one blocked for 678 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:09:43.898 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:09:43 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:09:43] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:09:43.898 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:09:43 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:09:43] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:09:43.898 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:09:43 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:09:44.015 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:09:43 smithi044 ceph-mon[30624]: Health check update: 3 slow ops, oldest one blocked for 678 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:09:44.055 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:09:43 smithi064 ceph-mon[34420]: Health check update: 3 slow ops, oldest one blocked for 678 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:09:45.015 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:09:44 smithi044 ceph-mon[30624]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:09:45.015 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:09:44 smithi044 ceph-mon[30624]: { 2024-03-26T17:09:45.015 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:09:44 smithi044 ceph-mon[30624]: "prefix": "rbd perf image stats", 2024-03-26T17:09:45.015 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:09:44 smithi044 ceph-mon[30624]: "pool_spec": "mypool", 2024-03-26T17:09:45.015 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:09:44 smithi044 ceph-mon[30624]: "sort_by": "write_ops", 2024-03-26T17:09:45.015 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:09:44 smithi044 ceph-mon[30624]: "format": "json" 2024-03-26T17:09:45.015 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:09:44 smithi044 ceph-mon[30624]: }"]: dispatch 2024-03-26T17:09:45.016 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:09:44 smithi044 ceph-mon[30624]: pgmap v718: 33 pgs: 33 active+clean; 1.0 GiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 6.7 MiB/s rd, 6.5 MiB/s wr, 497 op/s 2024-03-26T17:09:45.055 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:09:44 smithi064 ceph-mon[34420]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:09:45.055 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:09:44 smithi064 ceph-mon[34420]: { 2024-03-26T17:09:45.055 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:09:44 smithi064 ceph-mon[34420]: "prefix": "rbd perf image stats", 2024-03-26T17:09:45.055 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:09:44 smithi064 ceph-mon[34420]: "pool_spec": "mypool", 2024-03-26T17:09:45.056 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:09:44 smithi064 ceph-mon[34420]: "sort_by": "write_ops", 2024-03-26T17:09:45.056 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:09:44 smithi064 ceph-mon[34420]: "format": "json" 2024-03-26T17:09:45.056 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:09:44 smithi064 ceph-mon[34420]: }"]: dispatch 2024-03-26T17:09:45.056 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:09:44 smithi064 ceph-mon[34420]: pgmap v718: 33 pgs: 33 active+clean; 1.0 GiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 6.7 MiB/s rd, 6.5 MiB/s wr, 497 op/s 2024-03-26T17:09:45.146 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:09:44 smithi149 ceph-mon[34678]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:09:45.146 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:09:44 smithi149 ceph-mon[34678]: { 2024-03-26T17:09:45.146 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:09:44 smithi149 ceph-mon[34678]: "prefix": "rbd perf image stats", 2024-03-26T17:09:45.146 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:09:44 smithi149 ceph-mon[34678]: "pool_spec": "mypool", 2024-03-26T17:09:45.146 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:09:44 smithi149 ceph-mon[34678]: "sort_by": "write_ops", 2024-03-26T17:09:45.146 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:09:44 smithi149 ceph-mon[34678]: "format": "json" 2024-03-26T17:09:45.146 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:09:44 smithi149 ceph-mon[34678]: }"]: dispatch 2024-03-26T17:09:45.147 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:09:44 smithi149 ceph-mon[34678]: pgmap v718: 33 pgs: 33 active+clean; 1.0 GiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 6.7 MiB/s rd, 6.5 MiB/s wr, 497 op/s 2024-03-26T17:09:45.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:09:45 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:09:45] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:09:45.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:09:45 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:09:45] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:09:45.766 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:09:45 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:09:45.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:09:45 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:09:45] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:09:45.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:09:45 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:09:45] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:09:45.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:09:45 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:09:46.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:09:46 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 2024-03-26T17:09:46.239+0000 7fa707a55700 -1 mon.c@1(peon) e3 get_health_metrics reporting 3 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T17:09:47.015 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:09:46 smithi044 ceph-mon[30624]: pgmap v719: 33 pgs: 33 active+clean; 1.0 GiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 6.5 MiB/s rd, 6.4 MiB/s wr, 494 op/s 2024-03-26T17:09:47.015 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:09:46 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-26T17:09:47.015 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:09:46 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T17:09:47.015 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:09:46 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T17:09:47.015 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:09:46 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T17:09:47.015 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:09:46 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T17:09:47.015 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:09:46 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T17:09:47.016 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:09:46 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T17:09:47.055 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:09:46 smithi064 ceph-mon[34420]: pgmap v719: 33 pgs: 33 active+clean; 1.0 GiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 6.5 MiB/s rd, 6.4 MiB/s wr, 494 op/s 2024-03-26T17:09:47.055 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:09:46 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-26T17:09:47.055 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:09:46 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T17:09:47.055 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:09:46 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T17:09:47.055 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:09:46 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T17:09:47.056 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:09:46 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T17:09:47.056 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:09:46 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T17:09:47.056 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:09:46 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T17:09:47.146 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:09:46 smithi149 ceph-mon[34678]: pgmap v719: 33 pgs: 33 active+clean; 1.0 GiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 6.5 MiB/s rd, 6.4 MiB/s wr, 494 op/s 2024-03-26T17:09:47.146 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:09:46 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-26T17:09:47.146 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:09:46 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T17:09:47.146 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:09:46 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T17:09:47.146 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:09:46 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T17:09:47.146 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:09:46 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T17:09:47.146 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:09:46 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T17:09:47.146 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:09:46 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T17:09:47.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:09:47 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:09:47] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:09:47.766 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:09:47 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:09:47] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:09:47.766 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:09:47 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:09:47.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:09:47 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:09:47] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:09:47.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:09:47 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:09:47] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:09:47.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:09:47 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:09:48.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:09:47 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T17:09:48.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:09:47 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T17:09:48.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:09:47 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi157", "name": "osd_memory_target"} : dispatch 2024-03-26T17:09:48.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:09:47 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T17:09:48.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:09:47 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-26T17:09:48.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:09:47 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T17:09:48.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:09:47 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T17:09:48.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:09:47 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T17:09:48.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:09:47 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi157", "name": "osd_memory_target"} : dispatch 2024-03-26T17:09:48.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:09:47 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T17:09:48.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:09:47 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-26T17:09:48.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:09:47 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T17:09:48.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:09:47 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T17:09:48.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:09:47 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T17:09:48.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:09:47 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi157", "name": "osd_memory_target"} : dispatch 2024-03-26T17:09:48.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:09:47 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T17:09:48.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:09:47 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-26T17:09:48.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:09:47 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T17:09:48.510 INFO:tasks.workunit.client.3.smithi157.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-26T17:09:48.511 INFO:tasks.workunit.client.3.smithi157.stdout:myimage41 5/s 3/s 128 KiB/s 92 KiB/s 2.91 ms 437.74 us 2024-03-26T17:09:48.511 INFO:tasks.workunit.client.3.smithi157.stdout:myimage45 5/s 3/s 138 KiB/s 47 KiB/s 2.84 ms 473.79 us 2024-03-26T17:09:48.511 INFO:tasks.workunit.client.3.smithi157.stdout:myimage60 5/s 3/s 110 KiB/s 86 KiB/s 2.99 ms 324.42 us 2024-03-26T17:09:48.511 INFO:tasks.workunit.client.3.smithi157.stdout:myimage37 4/s 3/s 118 KiB/s 85 KiB/s 2.96 ms 416.58 us 2024-03-26T17:09:48.511 INFO:tasks.workunit.client.3.smithi157.stdout:myimage47 4/s 4/s 110 KiB/s 118 KiB/s 2.90 ms 466.28 us 2024-03-26T17:09:48.511 INFO:tasks.workunit.client.3.smithi157.stdout:myimage1 4/s 2/s 115 KiB/s 76 KiB/s 2.14 ms 322.11 us 2024-03-26T17:09:48.511 INFO:tasks.workunit.client.3.smithi157.stdout:myimage36 4/s 4/s 115 KiB/s 93 KiB/s 2.62 ms 356.71 us 2024-03-26T17:09:48.511 INFO:tasks.workunit.client.3.smithi157.stdout:myimage3 4/s 3/s 134 KiB/s 92 KiB/s 2.48 ms 360.27 us 2024-03-26T17:09:48.511 INFO:tasks.workunit.client.3.smithi157.stdout:myimage16 4/s 3/s 96 KiB/s 113 KiB/s 2.65 ms 373.32 us 2024-03-26T17:09:48.511 INFO:tasks.workunit.client.3.smithi157.stdout:myimage40 4/s 3/s 124 KiB/s 96 KiB/s 2.69 ms 397.01 us 2024-03-26T17:09:48.511 INFO:tasks.workunit.client.3.smithi157.stdout:myimage7 4/s 3/s 94 KiB/s 89 KiB/s 2.94 ms 342.44 us 2024-03-26T17:09:48.511 INFO:tasks.workunit.client.3.smithi157.stdout:myimage9 4/s 3/s 108 KiB/s 77 KiB/s 3.03 ms 371.67 us 2024-03-26T17:09:48.512 INFO:tasks.workunit.client.3.smithi157.stdout:myimage51 4/s 2/s 144 KiB/s 77 KiB/s 3.23 ms 309.50 us 2024-03-26T17:09:48.512 INFO:tasks.workunit.client.3.smithi157.stdout:myimage2 4/s 4/s 137 KiB/s 148 KiB/s 3.00 ms 363.09 us 2024-03-26T17:09:48.512 INFO:tasks.workunit.client.3.smithi157.stdout:myimage34 4/s 3/s 127 KiB/s 93 KiB/s 2.68 ms 443.04 us 2024-03-26T17:09:48.512 INFO:tasks.workunit.client.3.smithi157.stdout:myimage6 4/s 2/s 86 KiB/s 50 KiB/s 2.98 ms 312.16 us 2024-03-26T17:09:48.512 INFO:tasks.workunit.client.3.smithi157.stdout:myimage42 4/s 2/s 142 KiB/s 68 KiB/s 2.87 ms 303.65 us 2024-03-26T17:09:48.512 INFO:tasks.workunit.client.3.smithi157.stdout:myimage55 4/s 2/s 117 KiB/s 59 KiB/s 3.12 ms 352.97 us 2024-03-26T17:09:48.512 INFO:tasks.workunit.client.3.smithi157.stdout:myimage31 4/s 4/s 113 KiB/s 106 KiB/s 3.62 ms 337.84 us 2024-03-26T17:09:48.512 INFO:tasks.workunit.client.3.smithi157.stdout:myimage4 4/s 4/s 93 KiB/s 120 KiB/s 2.80 ms 334.37 us 2024-03-26T17:09:48.512 INFO:tasks.workunit.client.3.smithi157.stdout:myimage12 4/s 3/s 118 KiB/s 96 KiB/s 2.86 ms 397.01 us 2024-03-26T17:09:48.512 INFO:tasks.workunit.client.3.smithi157.stdout:myimage17 4/s 4/s 90 KiB/s 109 KiB/s 3.01 ms 351.67 us 2024-03-26T17:09:48.512 INFO:tasks.workunit.client.3.smithi157.stdout:myimage13 4/s 3/s 86 KiB/s 83 KiB/s 2.51 ms 368.36 us 2024-03-26T17:09:48.512 INFO:tasks.workunit.client.3.smithi157.stdout:myimage14 4/s 3/s 112 KiB/s 100 KiB/s 3.03 ms 356.24 us 2024-03-26T17:09:48.512 INFO:tasks.workunit.client.3.smithi157.stdout:myimage32 4/s 4/s 118 KiB/s 120 KiB/s 2.72 ms 384.35 us 2024-03-26T17:09:48.513 INFO:tasks.workunit.client.3.smithi157.stdout:myimage5 4/s 3/s 119 KiB/s 89 KiB/s 2.82 ms 364.93 us 2024-03-26T17:09:48.513 INFO:tasks.workunit.client.3.smithi157.stdout:myimage18 4/s 3/s 60 KiB/s 74 KiB/s 2.42 ms 380.04 us 2024-03-26T17:09:48.513 INFO:tasks.workunit.client.3.smithi157.stdout:myimage53 4/s 3/s 86 KiB/s 118 KiB/s 2.62 ms 351.11 us 2024-03-26T17:09:48.513 INFO:tasks.workunit.client.3.smithi157.stdout:myimage20 3/s 3/s 81 KiB/s 78 KiB/s 2.23 ms 300.49 us 2024-03-26T17:09:48.513 INFO:tasks.workunit.client.3.smithi157.stdout:myimage21 3/s 3/s 91 KiB/s 89 KiB/s 3.66 ms 369.03 us 2024-03-26T17:09:48.513 INFO:tasks.workunit.client.3.smithi157.stdout:myimage46 3/s 3/s 113 KiB/s 67 KiB/s 2.80 ms 423.00 us 2024-03-26T17:09:48.513 INFO:tasks.workunit.client.3.smithi157.stdout:myimage38 3/s 3/s 101 KiB/s 98 KiB/s 2.19 ms 369.46 us 2024-03-26T17:09:48.513 INFO:tasks.workunit.client.3.smithi157.stdout:myimage44 3/s 3/s 106 KiB/s 90 KiB/s 2.74 ms 349.02 us 2024-03-26T17:09:48.513 INFO:tasks.workunit.client.3.smithi157.stdout:myimage15 3/s 4/s 82 KiB/s 78 KiB/s 2.74 ms 337.99 us 2024-03-26T17:09:48.513 INFO:tasks.workunit.client.3.smithi157.stdout:myimage19 3/s 3/s 102 KiB/s 76 KiB/s 2.97 ms 359.05 us 2024-03-26T17:09:48.513 INFO:tasks.workunit.client.3.smithi157.stdout:myimage24 3/s 3/s 110 KiB/s 126 KiB/s 2.77 ms 547.08 us 2024-03-26T17:09:48.513 INFO:tasks.workunit.client.3.smithi157.stdout:myimage26 3/s 5/s 110 KiB/s 157 KiB/s 2.89 ms 453.26 us 2024-03-26T17:09:48.513 INFO:tasks.workunit.client.3.smithi157.stdout:myimage27 3/s 4/s 80 KiB/s 124 KiB/s 2.52 ms 452.66 us 2024-03-26T17:09:48.513 INFO:tasks.workunit.client.3.smithi157.stdout:myimage29 3/s 4/s 82 KiB/s 114 KiB/s 2.55 ms 345.06 us 2024-03-26T17:09:48.513 INFO:tasks.workunit.client.3.smithi157.stdout:myimage10 3/s 3/s 86 KiB/s 100 KiB/s 2.73 ms 329.49 us 2024-03-26T17:09:48.514 INFO:tasks.workunit.client.3.smithi157.stdout:myimage59 3/s 3/s 74 KiB/s 114 KiB/s 2.98 ms 461.53 us 2024-03-26T17:09:48.514 INFO:tasks.workunit.client.3.smithi157.stdout:myimage22 3/s 3/s 74 KiB/s 125 KiB/s 3.06 ms 332.70 us 2024-03-26T17:09:48.514 INFO:tasks.workunit.client.3.smithi157.stdout:myimage35 3/s 3/s 143 KiB/s 88 KiB/s 2.78 ms 320.71 us 2024-03-26T17:09:48.514 INFO:tasks.workunit.client.3.smithi157.stdout:myimage52 3/s 3/s 90 KiB/s 87 KiB/s 3.15 ms 420.66 us 2024-03-26T17:09:48.514 INFO:tasks.workunit.client.3.smithi157.stdout:myimage28 3/s 3/s 79 KiB/s 100 KiB/s 3.52 ms 324.23 us 2024-03-26T17:09:48.514 INFO:tasks.workunit.client.3.smithi157.stdout:myimage33 3/s 5/s 146 KiB/s 123 KiB/s 2.70 ms 434.59 us 2024-03-26T17:09:48.514 INFO:tasks.workunit.client.3.smithi157.stdout:myimage43 3/s 4/s 101 KiB/s 107 KiB/s 3.04 ms 346.79 us 2024-03-26T17:09:48.514 INFO:tasks.workunit.client.3.smithi157.stdout:myimage50 3/s 4/s 62 KiB/s 98 KiB/s 2.82 ms 369.95 us 2024-03-26T17:09:48.514 INFO:tasks.workunit.client.3.smithi157.stdout:myimage54 3/s 4/s 82 KiB/s 87 KiB/s 2.88 ms 347.03 us 2024-03-26T17:09:48.514 INFO:tasks.workunit.client.3.smithi157.stdout:myimage56 3/s 3/s 93 KiB/s 74 KiB/s 3.31 ms 328.75 us 2024-03-26T17:09:48.514 INFO:tasks.workunit.client.3.smithi157.stdout:myimage58 3/s 3/s 106 KiB/s 119 KiB/s 2.75 ms 342.08 us 2024-03-26T17:09:48.514 INFO:tasks.workunit.client.3.smithi157.stdout:myimage25 3/s 3/s 97 KiB/s 110 KiB/s 3.53 ms 392.20 us 2024-03-26T17:09:48.514 INFO:tasks.workunit.client.3.smithi157.stdout:myimage23 3/s 5/s 62 KiB/s 117 KiB/s 2.35 ms 385.27 us 2024-03-26T17:09:48.514 INFO:tasks.workunit.client.3.smithi157.stdout:myimage49 3/s 4/s 65 KiB/s 107 KiB/s 2.64 ms 343.25 us 2024-03-26T17:09:48.515 INFO:tasks.workunit.client.3.smithi157.stdout:myimage11 3/s 2/s 80 KiB/s 54 KiB/s 3.18 ms 319.09 us 2024-03-26T17:09:48.515 INFO:tasks.workunit.client.3.smithi157.stdout:myimage39 3/s 4/s 62 KiB/s 150 KiB/s 2.67 ms 426.82 us 2024-03-26T17:09:48.515 INFO:tasks.workunit.client.3.smithi157.stdout:myimage57 3/s 3/s 90 KiB/s 86 KiB/s 3.43 ms 363.01 us 2024-03-26T17:09:48.515 INFO:tasks.workunit.client.3.smithi157.stdout:myimage30 2/s 3/s 97 KiB/s 94 KiB/s 3.54 ms 403.59 us 2024-03-26T17:09:48.515 INFO:tasks.workunit.client.3.smithi157.stdout:myimage8 2/s 3/s 50 KiB/s 83 KiB/s 2.92 ms 357.52 us 2024-03-26T17:09:48.515 INFO:tasks.workunit.client.3.smithi157.stdout:myimage48 2/s 3/s 74 KiB/s 117 KiB/s 2.65 ms 375.10 us 2024-03-26T17:09:48.515 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:09:49.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:09:48 smithi044 ceph-mon[30624]: pgmap v720: 33 pgs: 33 active+clean; 1.0 GiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 5.7 MiB/s rd, 5.5 MiB/s wr, 438 op/s 2024-03-26T17:09:49.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:09:48 smithi044 ceph-mon[30624]: pgmap v721: 33 pgs: 33 active+clean; 1.0 GiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 6.0 MiB/s rd, 5.9 MiB/s wr, 464 op/s 2024-03-26T17:09:49.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:09:48 smithi044 ceph-mon[30624]: Health check update: 3 slow ops, oldest one blocked for 683 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:09:49.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:09:48 smithi064 ceph-mon[34420]: pgmap v720: 33 pgs: 33 active+clean; 1.0 GiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 5.7 MiB/s rd, 5.5 MiB/s wr, 438 op/s 2024-03-26T17:09:49.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:09:48 smithi064 ceph-mon[34420]: pgmap v721: 33 pgs: 33 active+clean; 1.0 GiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 6.0 MiB/s rd, 5.9 MiB/s wr, 464 op/s 2024-03-26T17:09:49.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:09:48 smithi064 ceph-mon[34420]: Health check update: 3 slow ops, oldest one blocked for 683 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:09:49.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:09:48 smithi149 ceph-mon[34678]: pgmap v720: 33 pgs: 33 active+clean; 1.0 GiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 5.7 MiB/s rd, 5.5 MiB/s wr, 438 op/s 2024-03-26T17:09:49.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:09:48 smithi149 ceph-mon[34678]: pgmap v721: 33 pgs: 33 active+clean; 1.0 GiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 6.0 MiB/s rd, 5.9 MiB/s wr, 464 op/s 2024-03-26T17:09:49.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:09:48 smithi149 ceph-mon[34678]: Health check update: 3 slow ops, oldest one blocked for 683 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:09:49.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:09:49 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:09:49] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:09:49.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:09:49 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:09:49] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:09:49.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:09:49 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:09:49.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:09:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:09:49] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:09:49.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:09:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:09:49] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:09:49.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:09:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:09:50.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:09:50 smithi044 ceph-mon[30624]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:09:50.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:09:50 smithi044 ceph-mon[30624]: { 2024-03-26T17:09:50.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:09:50 smithi044 ceph-mon[30624]: "prefix": "rbd perf image stats", 2024-03-26T17:09:50.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:09:50 smithi044 ceph-mon[30624]: "pool_spec": "mypool", 2024-03-26T17:09:50.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:09:50 smithi044 ceph-mon[30624]: "sort_by": "write_ops", 2024-03-26T17:09:50.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:09:50 smithi044 ceph-mon[30624]: "format": "json" 2024-03-26T17:09:50.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:09:50 smithi044 ceph-mon[30624]: }"]: dispatch 2024-03-26T17:09:50.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:09:50 smithi064 ceph-mon[34420]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:09:50.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:09:50 smithi064 ceph-mon[34420]: { 2024-03-26T17:09:50.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:09:50 smithi064 ceph-mon[34420]: "prefix": "rbd perf image stats", 2024-03-26T17:09:50.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:09:50 smithi064 ceph-mon[34420]: "pool_spec": "mypool", 2024-03-26T17:09:50.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:09:50 smithi064 ceph-mon[34420]: "sort_by": "write_ops", 2024-03-26T17:09:50.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:09:50 smithi064 ceph-mon[34420]: "format": "json" 2024-03-26T17:09:50.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:09:50 smithi064 ceph-mon[34420]: }"]: dispatch 2024-03-26T17:09:50.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:09:50 smithi149 ceph-mon[34678]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:09:50.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:09:50 smithi149 ceph-mon[34678]: { 2024-03-26T17:09:50.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:09:50 smithi149 ceph-mon[34678]: "prefix": "rbd perf image stats", 2024-03-26T17:09:50.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:09:50 smithi149 ceph-mon[34678]: "pool_spec": "mypool", 2024-03-26T17:09:50.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:09:50 smithi149 ceph-mon[34678]: "sort_by": "write_ops", 2024-03-26T17:09:50.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:09:50 smithi149 ceph-mon[34678]: "format": "json" 2024-03-26T17:09:50.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:09:50 smithi149 ceph-mon[34678]: }"]: dispatch 2024-03-26T17:09:51.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:09:51 smithi044 ceph-mon[30624]: pgmap v722: 33 pgs: 33 active+clean; 1.0 GiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 5.8 MiB/s rd, 5.9 MiB/s wr, 462 op/s 2024-03-26T17:09:51.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:09:51 smithi064 ceph-mon[34420]: pgmap v722: 33 pgs: 33 active+clean; 1.0 GiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 5.8 MiB/s rd, 5.9 MiB/s wr, 462 op/s 2024-03-26T17:09:51.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:09:51 smithi149 ceph-mon[34678]: pgmap v722: 33 pgs: 33 active+clean; 1.0 GiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 5.8 MiB/s rd, 5.9 MiB/s wr, 462 op/s 2024-03-26T17:09:51.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:09:51 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 2024-03-26T17:09:51.240+0000 7fa707a55700 -1 mon.c@1(peon) e3 get_health_metrics reporting 3 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T17:09:51.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:09:51 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:09:51] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:09:51.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:09:51 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:09:51] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:09:51.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:09:51 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:09:51.897 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:09:51 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:09:51] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:09:51.897 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:09:51 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:09:51] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:09:51.897 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:09:51 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:09:53.063 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:09:53.070 INFO:tasks.workunit.client.3.smithi157.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2024-03-26T17:09:53.070 INFO:tasks.workunit.client.3.smithi157.stdout: 7.60 78.4k 83.6k 0.0k 784.0k 836.0k 0.0k nvme2n1 2024-03-26T17:09:53.070 INFO:tasks.workunit.client.3.smithi157.stdout: 7.60 92.0k 74.4k 0.0k 920.0k 744.0k 0.0k nvme2n10 2024-03-26T17:09:53.070 INFO:tasks.workunit.client.3.smithi157.stdout: 7.60 99.6k 114.8k 0.0k 996.0k 1.1M 0.0k nvme2n11 2024-03-26T17:09:53.070 INFO:tasks.workunit.client.3.smithi157.stdout: 7.60 77.2k 117.2k 0.0k 772.0k 1.1M 0.0k nvme2n12 2024-03-26T17:09:53.070 INFO:tasks.workunit.client.3.smithi157.stdout: 7.60 93.2k 85.2k 0.0k 932.0k 852.0k 0.0k nvme2n13 2024-03-26T17:09:53.070 INFO:tasks.workunit.client.3.smithi157.stdout: 7.60 98.0k 94.0k 0.0k 980.0k 940.0k 0.0k nvme2n14 2024-03-26T17:09:53.070 INFO:tasks.workunit.client.3.smithi157.stdout: 7.60 83.6k 96.8k 0.0k 836.0k 968.0k 0.0k nvme2n15 2024-03-26T17:09:53.070 INFO:tasks.workunit.client.3.smithi157.stdout: 7.60 78.0k 108.4k 0.0k 780.0k 1.1M 0.0k nvme2n16 2024-03-26T17:09:53.070 INFO:tasks.workunit.client.3.smithi157.stdout: 7.60 88.8k 103.6k 0.0k 888.0k 1.0M 0.0k nvme2n17 2024-03-26T17:09:53.071 INFO:tasks.workunit.client.3.smithi157.stdout: 7.60 57.2k 87.6k 0.0k 572.0k 876.0k 0.0k nvme2n18 2024-03-26T17:09:53.071 INFO:tasks.workunit.client.3.smithi157.stdout: 7.60 105.2k 98.4k 0.0k 1.0M 984.0k 0.0k nvme2n19 2024-03-26T17:09:53.071 INFO:tasks.workunit.client.3.smithi157.stdout: 7.60 82.4k 97.2k 0.0k 824.0k 972.0k 0.0k nvme2n2 2024-03-26T17:09:53.071 INFO:tasks.workunit.client.3.smithi157.stdout: 7.60 85.2k 91.6k 0.0k 852.0k 916.0k 0.0k nvme2n20 2024-03-26T17:09:53.071 INFO:tasks.workunit.client.3.smithi157.stdout: 7.60 91.2k 116.8k 0.0k 912.0k 1.1M 0.0k nvme2n3 2024-03-26T17:09:53.071 INFO:tasks.workunit.client.3.smithi157.stdout: 7.70 84.4k 95.6k 0.0k 844.0k 956.0k 0.0k nvme2n4 2024-03-26T17:09:53.071 INFO:tasks.workunit.client.3.smithi157.stdout: 7.70 99.6k 114.4k 0.0k 996.0k 1.1M 0.0k nvme2n5 2024-03-26T17:09:53.071 INFO:tasks.workunit.client.3.smithi157.stdout: 7.70 85.6k 115.6k 0.0k 856.0k 1.1M 0.0k nvme2n6 2024-03-26T17:09:53.071 INFO:tasks.workunit.client.3.smithi157.stdout: 7.60 90.8k 68.4k 0.0k 908.0k 684.0k 0.0k nvme2n7 2024-03-26T17:09:53.071 INFO:tasks.workunit.client.3.smithi157.stdout: 7.60 122.8k 82.8k 0.0k 1.2M 828.0k 0.0k nvme2n8 2024-03-26T17:09:53.071 INFO:tasks.workunit.client.3.smithi157.stdout: 7.60 79.2k 112.0k 0.0k 792.0k 1.1M 0.0k nvme2n9 2024-03-26T17:09:53.071 INFO:tasks.workunit.client.3.smithi157.stdout: 7.60 87.6k 94.0k 0.0k 876.0k 940.0k 0.0k nvme5n1 2024-03-26T17:09:53.071 INFO:tasks.workunit.client.3.smithi157.stdout: 7.60 97.6k 97.2k 0.0k 976.0k 972.0k 0.0k nvme5n10 2024-03-26T17:09:53.072 INFO:tasks.workunit.client.3.smithi157.stdout: 7.60 105.2k 66.4k 0.0k 1.0M 664.0k 0.0k nvme5n11 2024-03-26T17:09:53.072 INFO:tasks.workunit.client.3.smithi157.stdout: 7.60 112.8k 81.2k 0.0k 1.1M 812.0k 0.0k nvme5n12 2024-03-26T17:09:53.072 INFO:tasks.workunit.client.3.smithi157.stdout: 7.60 110.8k 78.4k 0.0k 1.1M 784.0k 0.0k nvme5n13 2024-03-26T17:09:53.072 INFO:tasks.workunit.client.3.smithi157.stdout: 7.60 98.8k 105.6k 0.0k 988.0k 1.0M 0.0k nvme5n14 2024-03-26T17:09:53.072 INFO:tasks.workunit.client.3.smithi157.stdout: 7.60 88.4k 128.4k 0.0k 884.0k 1.3M 0.0k nvme5n15 2024-03-26T17:09:53.072 INFO:tasks.workunit.client.3.smithi157.stdout: 7.60 81.6k 98.8k 0.0k 816.0k 988.0k 0.0k nvme5n16 2024-03-26T17:09:53.072 INFO:tasks.workunit.client.3.smithi157.stdout: 7.60 83.2k 100.4k 0.0k 832.0k 1004.0k 0.0k nvme5n17 2024-03-26T17:09:53.072 INFO:tasks.workunit.client.3.smithi157.stdout: 7.60 103.2k 103.2k 0.0k 1.0M 1.0M 0.0k nvme5n18 2024-03-26T17:09:53.072 INFO:tasks.workunit.client.3.smithi157.stdout: 7.60 117.2k 95.2k 0.0k 1.1M 952.0k 0.0k nvme5n19 2024-03-26T17:09:53.072 INFO:tasks.workunit.client.3.smithi157.stdout: 7.60 108.8k 59.6k 0.0k 1.1M 596.0k 0.0k nvme5n2 2024-03-26T17:09:53.072 INFO:tasks.workunit.client.3.smithi157.stdout: 7.60 116.0k 90.8k 0.0k 1.1M 908.0k 0.0k nvme5n20 2024-03-26T17:09:53.072 INFO:tasks.workunit.client.3.smithi157.stdout: 7.60 97.6k 78.8k 0.0k 976.0k 788.0k 0.0k nvme5n3 2024-03-26T17:09:53.072 INFO:tasks.workunit.client.3.smithi157.stdout: 7.60 105.2k 84.0k 0.0k 1.0M 840.0k 0.0k nvme5n4 2024-03-26T17:09:53.073 INFO:tasks.workunit.client.3.smithi157.stdout: 7.70 100.4k 88.8k 0.0k 1004.0k 888.0k 0.0k nvme5n5 2024-03-26T17:09:53.073 INFO:tasks.workunit.client.3.smithi157.stdout: 7.70 102.8k 107.2k 0.0k 1.0M 1.0M 0.0k nvme5n6 2024-03-26T17:09:53.073 INFO:tasks.workunit.client.3.smithi157.stdout: 7.60 70.8k 89.2k 0.0k 708.0k 892.0k 0.0k nvme5n7 2024-03-26T17:09:53.073 INFO:tasks.workunit.client.3.smithi157.stdout: 7.60 103.6k 88.8k 0.0k 1.0M 888.0k 0.0k nvme5n8 2024-03-26T17:09:53.073 INFO:tasks.workunit.client.3.smithi157.stdout: 7.60 88.8k 85.6k 0.0k 888.0k 856.0k 0.0k nvme5n9 2024-03-26T17:09:53.073 INFO:tasks.workunit.client.3.smithi157.stdout: 7.60 74.0k 119.2k 0.0k 740.0k 1.2M 0.0k nvme8n1 2024-03-26T17:09:53.073 INFO:tasks.workunit.client.3.smithi157.stdout: 7.60 106.4k 79.2k 0.0k 1.0M 792.0k 0.0k nvme8n10 2024-03-26T17:09:53.073 INFO:tasks.workunit.client.3.smithi157.stdout: 7.60 96.8k 102.4k 0.0k 968.0k 1.0M 0.0k nvme8n11 2024-03-26T17:09:53.073 INFO:tasks.workunit.client.3.smithi157.stdout: 7.60 58.8k 109.2k 0.0k 588.0k 1.1M 0.0k nvme8n12 2024-03-26T17:09:53.073 INFO:tasks.workunit.client.3.smithi157.stdout: 7.60 97.2k 108.4k 0.0k 972.0k 1.1M 0.0k nvme8n13 2024-03-26T17:09:53.073 INFO:tasks.workunit.client.3.smithi157.stdout: 7.60 86.4k 69.2k 0.0k 864.0k 692.0k 0.0k nvme8n14 2024-03-26T17:09:53.073 INFO:tasks.workunit.client.3.smithi157.stdout: 7.60 76.8k 120.0k 0.0k 768.0k 1.2M 0.0k nvme8n15 2024-03-26T17:09:53.073 INFO:tasks.workunit.client.3.smithi157.stdout: 7.60 93.2k 96.4k 0.0k 932.0k 964.0k 0.0k nvme8n16 2024-03-26T17:09:53.074 INFO:tasks.workunit.client.3.smithi157.stdout: 7.60 74.4k 96.4k 0.0k 744.0k 964.0k 0.0k nvme8n17 2024-03-26T17:09:53.074 INFO:tasks.workunit.client.3.smithi157.stdout: 7.60 91.6k 112.4k 0.0k 916.0k 1.1M 0.0k nvme8n18 2024-03-26T17:09:53.074 INFO:tasks.workunit.client.3.smithi157.stdout: 7.60 94.0k 82.0k 0.0k 940.0k 820.0k 0.0k nvme8n19 2024-03-26T17:09:53.074 INFO:tasks.workunit.client.3.smithi157.stdout: 7.60 85.6k 86.4k 0.0k 856.0k 864.0k 0.0k nvme8n2 2024-03-26T17:09:53.074 INFO:tasks.workunit.client.3.smithi157.stdout: 7.60 108.4k 98.8k 0.0k 1.1M 988.0k 0.0k nvme8n20 2024-03-26T17:09:53.074 INFO:tasks.workunit.client.3.smithi157.stdout: 7.60 86.4k 110.4k 0.0k 864.0k 1.1M 0.0k nvme8n3 2024-03-26T17:09:53.074 INFO:tasks.workunit.client.3.smithi157.stdout: 7.70 79.6k 112.0k 0.0k 796.0k 1.1M 0.0k nvme8n4 2024-03-26T17:09:53.074 INFO:tasks.workunit.client.3.smithi157.stdout: 7.70 80.4k 96.4k 0.0k 804.0k 964.0k 0.0k nvme8n5 2024-03-26T17:09:53.074 INFO:tasks.workunit.client.3.smithi157.stdout: 7.60 62.8k 113.6k 0.0k 628.0k 1.1M 0.0k nvme8n6 2024-03-26T17:09:53.074 INFO:tasks.workunit.client.3.smithi157.stdout: 7.60 96.0k 104.8k 0.0k 960.0k 1.0M 0.0k nvme8n7 2024-03-26T17:09:53.074 INFO:tasks.workunit.client.3.smithi157.stdout: 7.60 108.4k 94.8k 0.0k 1.1M 948.0k 0.0k nvme8n8 2024-03-26T17:09:53.074 INFO:tasks.workunit.client.3.smithi157.stdout: 7.60 114.8k 78.0k 0.0k 1.1M 780.0k 0.0k nvme8n9 2024-03-26T17:09:53.074 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:09:53.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:09:53 smithi044 ceph-mon[30624]: pgmap v723: 33 pgs: 33 active+clean; 1.0 GiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 5.5 MiB/s rd, 5.8 MiB/s wr, 456 op/s 2024-03-26T17:09:53.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:09:53 smithi064 ceph-mon[34420]: pgmap v723: 33 pgs: 33 active+clean; 1.0 GiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 5.5 MiB/s rd, 5.8 MiB/s wr, 456 op/s 2024-03-26T17:09:53.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:09:53 smithi149 ceph-mon[34678]: pgmap v723: 33 pgs: 33 active+clean; 1.0 GiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 5.5 MiB/s rd, 5.8 MiB/s wr, 456 op/s 2024-03-26T17:09:53.515 INFO:tasks.workunit.client.3.smithi157.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-26T17:09:53.515 INFO:tasks.workunit.client.3.smithi157.stdout:myimage44 5/s 3/s 122 KiB/s 109 KiB/s 2.84 ms 344.53 us 2024-03-26T17:09:53.515 INFO:tasks.workunit.client.3.smithi157.stdout:myimage53 5/s 3/s 99 KiB/s 111 KiB/s 2.84 ms 362.01 us 2024-03-26T17:09:53.515 INFO:tasks.workunit.client.3.smithi157.stdout:myimage35 4/s 3/s 134 KiB/s 114 KiB/s 2.90 ms 359.77 us 2024-03-26T17:09:53.515 INFO:tasks.workunit.client.3.smithi157.stdout:myimage58 4/s 4/s 94 KiB/s 90 KiB/s 2.45 ms 357.36 us 2024-03-26T17:09:53.515 INFO:tasks.workunit.client.3.smithi157.stdout:myimage11 4/s 4/s 143 KiB/s 122 KiB/s 2.63 ms 399.05 us 2024-03-26T17:09:53.515 INFO:tasks.workunit.client.3.smithi157.stdout:myimage18 4/s 2/s 102 KiB/s 69 KiB/s 2.68 ms 462.61 us 2024-03-26T17:09:53.515 INFO:tasks.workunit.client.3.smithi157.stdout:myimage41 4/s 2/s 119 KiB/s 46 KiB/s 2.99 ms 339.34 us 2024-03-26T17:09:53.516 INFO:tasks.workunit.client.3.smithi157.stdout:myimage43 4/s 3/s 122 KiB/s 79 KiB/s 3.09 ms 479.57 us 2024-03-26T17:09:53.516 INFO:tasks.workunit.client.3.smithi157.stdout:myimage2 4/s 3/s 99 KiB/s 51 KiB/s 2.97 ms 346.80 us 2024-03-26T17:09:53.516 INFO:tasks.workunit.client.3.smithi157.stdout:myimage38 4/s 3/s 106 KiB/s 109 KiB/s 2.21 ms 357.21 us 2024-03-26T17:09:53.516 INFO:tasks.workunit.client.3.smithi157.stdout:myimage21 4/s 2/s 130 KiB/s 67 KiB/s 3.53 ms 355.52 us 2024-03-26T17:09:53.516 INFO:tasks.workunit.client.3.smithi157.stdout:myimage46 4/s 3/s 110 KiB/s 67 KiB/s 2.64 ms 390.31 us 2024-03-26T17:09:53.516 INFO:tasks.workunit.client.3.smithi157.stdout:myimage57 4/s 3/s 98 KiB/s 74 KiB/s 3.12 ms 323.67 us 2024-03-26T17:09:53.516 INFO:tasks.workunit.client.3.smithi157.stdout:myimage16 4/s 3/s 101 KiB/s 66 KiB/s 3.17 ms 323.17 us 2024-03-26T17:09:53.516 INFO:tasks.workunit.client.3.smithi157.stdout:myimage48 4/s 4/s 114 KiB/s 114 KiB/s 3.34 ms 388.07 us 2024-03-26T17:09:53.516 INFO:tasks.workunit.client.3.smithi157.stdout:myimage28 4/s 3/s 106 KiB/s 95 KiB/s 3.54 ms 433.82 us 2024-03-26T17:09:53.516 INFO:tasks.workunit.client.3.smithi157.stdout:myimage39 4/s 3/s 92 KiB/s 115 KiB/s 2.76 ms 411.93 us 2024-03-26T17:09:53.516 INFO:tasks.workunit.client.3.smithi157.stdout:myimage52 4/s 3/s 98 KiB/s 72 KiB/s 3.23 ms 320.53 us 2024-03-26T17:09:53.516 INFO:tasks.workunit.client.3.smithi157.stdout:myimage6 4/s 3/s 108 KiB/s 94 KiB/s 2.92 ms 372.10 us 2024-03-26T17:09:53.516 INFO:tasks.workunit.client.3.smithi157.stdout:myimage15 4/s 3/s 99 KiB/s 79 KiB/s 2.61 ms 358.49 us 2024-03-26T17:09:53.517 INFO:tasks.workunit.client.3.smithi157.stdout:myimage20 4/s 3/s 106 KiB/s 82 KiB/s 2.57 ms 305.80 us 2024-03-26T17:09:53.517 INFO:tasks.workunit.client.3.smithi157.stdout:myimage25 4/s 4/s 112 KiB/s 86 KiB/s 3.33 ms 366.84 us 2024-03-26T17:09:53.517 INFO:tasks.workunit.client.3.smithi157.stdout:myimage55 4/s 3/s 126 KiB/s 78 KiB/s 2.95 ms 517.67 us 2024-03-26T17:09:53.517 INFO:tasks.workunit.client.3.smithi157.stdout:myimage3 4/s 3/s 118 KiB/s 90 KiB/s 2.29 ms 365.85 us 2024-03-26T17:09:53.517 INFO:tasks.workunit.client.3.smithi157.stdout:myimage23 4/s 3/s 80 KiB/s 90 KiB/s 2.44 ms 308.00 us 2024-03-26T17:09:53.517 INFO:tasks.workunit.client.3.smithi157.stdout:myimage30 4/s 4/s 105 KiB/s 88 KiB/s 3.56 ms 326.71 us 2024-03-26T17:09:53.517 INFO:tasks.workunit.client.3.smithi157.stdout:myimage47 4/s 3/s 114 KiB/s 78 KiB/s 2.91 ms 314.37 us 2024-03-26T17:09:53.517 INFO:tasks.workunit.client.3.smithi157.stdout:myimage1 4/s 4/s 82 KiB/s 72 KiB/s 2.39 ms 276.99 us 2024-03-26T17:09:53.517 INFO:tasks.workunit.client.3.smithi157.stdout:myimage12 4/s 3/s 99 KiB/s 66 KiB/s 3.10 ms 330.41 us 2024-03-26T17:09:53.517 INFO:tasks.workunit.client.3.smithi157.stdout:myimage17 4/s 3/s 121 KiB/s 70 KiB/s 2.97 ms 374.27 us 2024-03-26T17:09:53.517 INFO:tasks.workunit.client.3.smithi157.stdout:myimage36 4/s 3/s 110 KiB/s 100 KiB/s 2.80 ms 365.34 us 2024-03-26T17:09:53.517 INFO:tasks.workunit.client.3.smithi157.stdout:myimage34 3/s 3/s 77 KiB/s 110 KiB/s 2.69 ms 331.55 us 2024-03-26T17:09:53.517 INFO:tasks.workunit.client.3.smithi157.stdout:myimage37 3/s 3/s 110 KiB/s 56 KiB/s 2.51 ms 433.46 us 2024-03-26T17:09:53.517 INFO:tasks.workunit.client.3.smithi157.stdout:myimage4 3/s 3/s 109 KiB/s 84 KiB/s 2.74 ms 359.58 us 2024-03-26T17:09:53.517 INFO:tasks.workunit.client.3.smithi157.stdout:myimage5 3/s 4/s 132 KiB/s 118 KiB/s 2.44 ms 374.76 us 2024-03-26T17:09:53.518 INFO:tasks.workunit.client.3.smithi157.stdout:myimage8 3/s 4/s 101 KiB/s 134 KiB/s 3.01 ms 361.01 us 2024-03-26T17:09:53.518 INFO:tasks.workunit.client.3.smithi157.stdout:myimage19 3/s 3/s 80 KiB/s 102 KiB/s 2.92 ms 560.22 us 2024-03-26T17:09:53.518 INFO:tasks.workunit.client.3.smithi157.stdout:myimage27 3/s 3/s 79 KiB/s 66 KiB/s 2.56 ms 326.69 us 2024-03-26T17:09:53.518 INFO:tasks.workunit.client.3.smithi157.stdout:myimage56 3/s 3/s 76 KiB/s 91 KiB/s 3.40 ms 360.36 us 2024-03-26T17:09:53.518 INFO:tasks.workunit.client.3.smithi157.stdout:myimage13 3/s 4/s 93 KiB/s 98 KiB/s 2.55 ms 374.89 us 2024-03-26T17:09:53.518 INFO:tasks.workunit.client.3.smithi157.stdout:myimage22 3/s 5/s 58 KiB/s 108 KiB/s 2.61 ms 324.49 us 2024-03-26T17:09:53.518 INFO:tasks.workunit.client.3.smithi157.stdout:myimage40 3/s 4/s 81 KiB/s 136 KiB/s 2.71 ms 385.38 us 2024-03-26T17:09:53.518 INFO:tasks.workunit.client.3.smithi157.stdout:myimage9 3/s 3/s 98 KiB/s 86 KiB/s 3.29 ms 344.28 us 2024-03-26T17:09:53.518 INFO:tasks.workunit.client.3.smithi157.stdout:myimage26 3/s 3/s 110 KiB/s 95 KiB/s 2.91 ms 364.25 us 2024-03-26T17:09:53.518 INFO:tasks.workunit.client.3.smithi157.stdout:myimage42 3/s 4/s 70 KiB/s 91 KiB/s 2.79 ms 421.97 us 2024-03-26T17:09:53.518 INFO:tasks.workunit.client.3.smithi157.stdout:myimage54 3/s 4/s 75 KiB/s 88 KiB/s 2.88 ms 444.51 us 2024-03-26T17:09:53.518 INFO:tasks.workunit.client.3.smithi157.stdout:myimage59 3/s 4/s 77 KiB/s 126 KiB/s 3.11 ms 445.43 us 2024-03-26T17:09:53.519 INFO:tasks.workunit.client.3.smithi157.stdout:myimage14 3/s 3/s 82 KiB/s 91 KiB/s 2.89 ms 488.00 us 2024-03-26T17:09:53.519 INFO:tasks.workunit.client.3.smithi157.stdout:myimage29 3/s 3/s 78 KiB/s 102 KiB/s 2.67 ms 391.62 us 2024-03-26T17:09:53.519 INFO:tasks.workunit.client.3.smithi157.stdout:myimage45 3/s 4/s 84 KiB/s 100 KiB/s 2.79 ms 487.81 us 2024-03-26T17:09:53.519 INFO:tasks.workunit.client.3.smithi157.stdout:myimage10 3/s 3/s 58 KiB/s 102 KiB/s 2.76 ms 450.75 us 2024-03-26T17:09:53.519 INFO:tasks.workunit.client.3.smithi157.stdout:myimage49 3/s 4/s 82 KiB/s 110 KiB/s 2.93 ms 348.61 us 2024-03-26T17:09:53.519 INFO:tasks.workunit.client.3.smithi157.stdout:myimage50 3/s 4/s 71 KiB/s 107 KiB/s 2.97 ms 342.93 us 2024-03-26T17:09:53.519 INFO:tasks.workunit.client.3.smithi157.stdout:myimage51 3/s 3/s 86 KiB/s 102 KiB/s 3.18 ms 350.83 us 2024-03-26T17:09:53.519 INFO:tasks.workunit.client.3.smithi157.stdout:myimage32 2/s 5/s 64 KiB/s 123 KiB/s 3.17 ms 435.61 us 2024-03-26T17:09:53.519 INFO:tasks.workunit.client.3.smithi157.stdout:myimage7 2/s 4/s 54 KiB/s 98 KiB/s 2.90 ms 340.17 us 2024-03-26T17:09:53.519 INFO:tasks.workunit.client.3.smithi157.stdout:myimage24 2/s 3/s 53 KiB/s 78 KiB/s 2.91 ms 345.15 us 2024-03-26T17:09:53.519 INFO:tasks.workunit.client.3.smithi157.stdout:myimage33 2/s 3/s 40 KiB/s 78 KiB/s 2.99 ms 339.68 us 2024-03-26T17:09:53.519 INFO:tasks.workunit.client.3.smithi157.stdout:myimage60 2/s 4/s 78 KiB/s 109 KiB/s 3.02 ms 404.69 us 2024-03-26T17:09:53.520 INFO:tasks.workunit.client.3.smithi157.stdout:myimage31 2/s 5/s 40 KiB/s 98 KiB/s 3.42 ms 348.95 us 2024-03-26T17:09:53.520 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:09:53.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:09:53 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:09:53] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:09:53.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:09:53 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:09:53] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:09:53.766 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:09:53 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:09:53.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:09:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:09:53] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:09:53.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:09:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:09:53] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:09:53.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:09:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:09:54.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:09:54 smithi044 ceph-mon[30624]: Health check update: 3 slow ops, oldest one blocked for 688 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:09:54.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:09:54 smithi064 ceph-mon[34420]: Health check update: 3 slow ops, oldest one blocked for 688 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:09:54.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:09:54 smithi149 ceph-mon[34678]: Health check update: 3 slow ops, oldest one blocked for 688 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:09:55.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:09:55 smithi044 ceph-mon[30624]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:09:55.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:09:55 smithi044 ceph-mon[30624]: { 2024-03-26T17:09:55.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:09:55 smithi044 ceph-mon[30624]: "prefix": "rbd perf image stats", 2024-03-26T17:09:55.266 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:09:55 smithi044 ceph-mon[30624]: "pool_spec": "mypool", 2024-03-26T17:09:55.266 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:09:55 smithi044 ceph-mon[30624]: "sort_by": "write_ops", 2024-03-26T17:09:55.266 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:09:55 smithi044 ceph-mon[30624]: "format": "json" 2024-03-26T17:09:55.266 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:09:55 smithi044 ceph-mon[30624]: }"]: dispatch 2024-03-26T17:09:55.266 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:09:55 smithi044 ceph-mon[30624]: pgmap v724: 33 pgs: 33 active+clean; 1.0 GiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 5.5 MiB/s rd, 5.7 MiB/s wr, 461 op/s 2024-03-26T17:09:55.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:09:55 smithi064 ceph-mon[34420]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:09:55.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:09:55 smithi064 ceph-mon[34420]: { 2024-03-26T17:09:55.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:09:55 smithi064 ceph-mon[34420]: "prefix": "rbd perf image stats", 2024-03-26T17:09:55.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:09:55 smithi064 ceph-mon[34420]: "pool_spec": "mypool", 2024-03-26T17:09:55.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:09:55 smithi064 ceph-mon[34420]: "sort_by": "write_ops", 2024-03-26T17:09:55.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:09:55 smithi064 ceph-mon[34420]: "format": "json" 2024-03-26T17:09:55.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:09:55 smithi064 ceph-mon[34420]: }"]: dispatch 2024-03-26T17:09:55.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:09:55 smithi064 ceph-mon[34420]: pgmap v724: 33 pgs: 33 active+clean; 1.0 GiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 5.5 MiB/s rd, 5.7 MiB/s wr, 461 op/s 2024-03-26T17:09:55.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:09:55 smithi149 ceph-mon[34678]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:09:55.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:09:55 smithi149 ceph-mon[34678]: { 2024-03-26T17:09:55.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:09:55 smithi149 ceph-mon[34678]: "prefix": "rbd perf image stats", 2024-03-26T17:09:55.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:09:55 smithi149 ceph-mon[34678]: "pool_spec": "mypool", 2024-03-26T17:09:55.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:09:55 smithi149 ceph-mon[34678]: "sort_by": "write_ops", 2024-03-26T17:09:55.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:09:55 smithi149 ceph-mon[34678]: "format": "json" 2024-03-26T17:09:55.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:09:55 smithi149 ceph-mon[34678]: }"]: dispatch 2024-03-26T17:09:55.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:09:55 smithi149 ceph-mon[34678]: pgmap v724: 33 pgs: 33 active+clean; 1.0 GiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 5.5 MiB/s rd, 5.7 MiB/s wr, 461 op/s 2024-03-26T17:09:55.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:09:55 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:09:55] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:09:55.766 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:09:55 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:09:55] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:09:55.766 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:09:55 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:09:55.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:09:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:09:55] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:09:55.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:09:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:09:55] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:09:55.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:09:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:09:56.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:09:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 2024-03-26T17:09:56.240+0000 7fa707a55700 -1 mon.c@1(peon) e3 get_health_metrics reporting 3 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T17:09:57.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:09:57 smithi044 ceph-mon[30624]: pgmap v725: 33 pgs: 33 active+clean; 1.0 GiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 5.4 MiB/s rd, 5.5 MiB/s wr, 465 op/s 2024-03-26T17:09:57.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:09:57 smithi064 ceph-mon[34420]: pgmap v725: 33 pgs: 33 active+clean; 1.0 GiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 5.4 MiB/s rd, 5.5 MiB/s wr, 465 op/s 2024-03-26T17:09:57.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:09:57 smithi149 ceph-mon[34678]: pgmap v725: 33 pgs: 33 active+clean; 1.0 GiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 5.4 MiB/s rd, 5.5 MiB/s wr, 465 op/s 2024-03-26T17:09:57.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:09:57 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:09:57] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:09:57.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:09:57 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:09:57] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:09:57.766 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:09:57 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:09:58.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:09:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:09:57] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:09:58.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:09:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:09:57] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:09:58.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:09:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:09:58.519 INFO:tasks.workunit.client.3.smithi157.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-26T17:09:58.519 INFO:tasks.workunit.client.3.smithi157.stdout:myimage5 5/s 3/s 106 KiB/s 58 KiB/s 2.72 ms 338.49 us 2024-03-26T17:09:58.519 INFO:tasks.workunit.client.3.smithi157.stdout:myimage18 5/s 4/s 85 KiB/s 58 KiB/s 2.62 ms 376.53 us 2024-03-26T17:09:58.519 INFO:tasks.workunit.client.3.smithi157.stdout:myimage52 4/s 2/s 124 KiB/s 44 KiB/s 3.22 ms 338.37 us 2024-03-26T17:09:58.519 INFO:tasks.workunit.client.3.smithi157.stdout:myimage58 4/s 1/s 122 KiB/s 46 KiB/s 2.63 ms 358.58 us 2024-03-26T17:09:58.519 INFO:tasks.workunit.client.3.smithi157.stdout:myimage6 4/s 3/s 120 KiB/s 107 KiB/s 2.84 ms 328.00 us 2024-03-26T17:09:58.520 INFO:tasks.workunit.client.3.smithi157.stdout:myimage12 4/s 3/s 125 KiB/s 84 KiB/s 3.05 ms 361.86 us 2024-03-26T17:09:58.520 INFO:tasks.workunit.client.3.smithi157.stdout:myimage34 4/s 3/s 102 KiB/s 81 KiB/s 2.63 ms 295.85 us 2024-03-26T17:09:58.520 INFO:tasks.workunit.client.3.smithi157.stdout:myimage26 4/s 3/s 106 KiB/s 54 KiB/s 2.91 ms 307.34 us 2024-03-26T17:09:58.520 INFO:tasks.workunit.client.3.smithi157.stdout:myimage39 4/s 3/s 114 KiB/s 99 KiB/s 2.60 ms 379.62 us 2024-03-26T17:09:58.520 INFO:tasks.workunit.client.3.smithi157.stdout:myimage10 4/s 3/s 76 KiB/s 74 KiB/s 2.95 ms 321.27 us 2024-03-26T17:09:58.520 INFO:tasks.workunit.client.3.smithi157.stdout:myimage16 4/s 2/s 109 KiB/s 65 KiB/s 2.79 ms 320.06 us 2024-03-26T17:09:58.520 INFO:tasks.workunit.client.3.smithi157.stdout:myimage35 4/s 2/s 92 KiB/s 54 KiB/s 2.77 ms 309.92 us 2024-03-26T17:09:58.520 INFO:tasks.workunit.client.3.smithi157.stdout:myimage9 4/s 3/s 111 KiB/s 71 KiB/s 3.29 ms 348.96 us 2024-03-26T17:09:58.520 INFO:tasks.workunit.client.3.smithi157.stdout:myimage51 4/s 3/s 86 KiB/s 75 KiB/s 3.02 ms 411.75 us 2024-03-26T17:09:58.520 INFO:tasks.workunit.client.3.smithi157.stdout:myimage54 4/s 3/s 76 KiB/s 79 KiB/s 2.61 ms 339.69 us 2024-03-26T17:09:58.520 INFO:tasks.workunit.client.3.smithi157.stdout:myimage23 4/s 4/s 110 KiB/s 108 KiB/s 2.37 ms 936.85 us 2024-03-26T17:09:58.520 INFO:tasks.workunit.client.3.smithi157.stdout:myimage11 4/s 3/s 129 KiB/s 93 KiB/s 2.75 ms 412.31 us 2024-03-26T17:09:58.520 INFO:tasks.workunit.client.3.smithi157.stdout:myimage15 4/s 3/s 105 KiB/s 70 KiB/s 2.62 ms 339.60 us 2024-03-26T17:09:58.520 INFO:tasks.workunit.client.3.smithi157.stdout:myimage29 4/s 3/s 96 KiB/s 72 KiB/s 2.68 ms 356.04 us 2024-03-26T17:09:58.521 INFO:tasks.workunit.client.3.smithi157.stdout:myimage33 4/s 4/s 107 KiB/s 126 KiB/s 2.87 ms 349.99 us 2024-03-26T17:09:58.521 INFO:tasks.workunit.client.3.smithi157.stdout:myimage41 4/s 2/s 92 KiB/s 76 KiB/s 3.07 ms 339.47 us 2024-03-26T17:09:58.521 INFO:tasks.workunit.client.3.smithi157.stdout:myimage46 4/s 3/s 100 KiB/s 66 KiB/s 2.71 ms 330.57 us 2024-03-26T17:09:58.521 INFO:tasks.workunit.client.3.smithi157.stdout:myimage55 4/s 3/s 100 KiB/s 83 KiB/s 5.36 ms 481.72 us 2024-03-26T17:09:58.521 INFO:tasks.workunit.client.3.smithi157.stdout:myimage60 4/s 3/s 136 KiB/s 114 KiB/s 3.09 ms 377.87 us 2024-03-26T17:09:58.521 INFO:tasks.workunit.client.3.smithi157.stdout:myimage31 4/s 4/s 119 KiB/s 78 KiB/s 3.14 ms 366.24 us 2024-03-26T17:09:58.521 INFO:tasks.workunit.client.3.smithi157.stdout:myimage4 4/s 4/s 80 KiB/s 93 KiB/s 2.35 ms 329.83 us 2024-03-26T17:09:58.521 INFO:tasks.workunit.client.3.smithi157.stdout:myimage27 4/s 4/s 94 KiB/s 80 KiB/s 2.53 ms 333.37 us 2024-03-26T17:09:58.521 INFO:tasks.workunit.client.3.smithi157.stdout:myimage56 4/s 4/s 104 KiB/s 73 KiB/s 3.49 ms 497.74 us 2024-03-26T17:09:58.521 INFO:tasks.workunit.client.3.smithi157.stdout:myimage49 3/s 5/s 89 KiB/s 143 KiB/s 2.89 ms 374.45 us 2024-03-26T17:09:58.521 INFO:tasks.workunit.client.3.smithi157.stdout:myimage17 3/s 4/s 91 KiB/s 77 KiB/s 2.85 ms 420.21 us 2024-03-26T17:09:58.521 INFO:tasks.workunit.client.3.smithi157.stdout:myimage19 3/s 4/s 98 KiB/s 128 KiB/s 2.76 ms 435.32 us 2024-03-26T17:09:58.521 INFO:tasks.workunit.client.3.smithi157.stdout:myimage25 3/s 3/s 87 KiB/s 68 KiB/s 3.43 ms 343.74 us 2024-03-26T17:09:58.521 INFO:tasks.workunit.client.3.smithi157.stdout:myimage43 3/s 3/s 108 KiB/s 74 KiB/s 3.19 ms 350.07 us 2024-03-26T17:09:58.521 INFO:tasks.workunit.client.3.smithi157.stdout:myimage53 3/s 4/s 112 KiB/s 114 KiB/s 2.90 ms 330.35 us 2024-03-26T17:09:58.521 INFO:tasks.workunit.client.3.smithi157.stdout:myimage57 3/s 3/s 80 KiB/s 95 KiB/s 3.05 ms 405.32 us 2024-03-26T17:09:58.522 INFO:tasks.workunit.client.3.smithi157.stdout:myimage14 3/s 4/s 111 KiB/s 76 KiB/s 3.10 ms 349.98 us 2024-03-26T17:09:58.522 INFO:tasks.workunit.client.3.smithi157.stdout:myimage44 3/s 3/s 87 KiB/s 63 KiB/s 2.67 ms 288.22 us 2024-03-26T17:09:58.522 INFO:tasks.workunit.client.3.smithi157.stdout:myimage47 3/s 4/s 105 KiB/s 95 KiB/s 2.83 ms 415.51 us 2024-03-26T17:09:58.522 INFO:tasks.workunit.client.3.smithi157.stdout:myimage1 3/s 4/s 81 KiB/s 98 KiB/s 2.41 ms 345.08 us 2024-03-26T17:09:58.522 INFO:tasks.workunit.client.3.smithi157.stdout:myimage24 3/s 4/s 74 KiB/s 86 KiB/s 2.69 ms 308.89 us 2024-03-26T17:09:58.522 INFO:tasks.workunit.client.3.smithi157.stdout:myimage3 3/s 4/s 54 KiB/s 118 KiB/s 2.25 ms 484.03 us 2024-03-26T17:09:58.522 INFO:tasks.workunit.client.3.smithi157.stdout:myimage13 3/s 3/s 88 KiB/s 102 KiB/s 2.51 ms 452.23 us 2024-03-26T17:09:58.522 INFO:tasks.workunit.client.3.smithi157.stdout:myimage38 3/s 4/s 85 KiB/s 122 KiB/s 2.44 ms 317.38 us 2024-03-26T17:09:58.522 INFO:tasks.workunit.client.3.smithi157.stdout:myimage7 3/s 3/s 81 KiB/s 74 KiB/s 3.08 ms 356.91 us 2024-03-26T17:09:58.522 INFO:tasks.workunit.client.3.smithi157.stdout:myimage45 3/s 3/s 61 KiB/s 72 KiB/s 2.52 ms 529.65 us 2024-03-26T17:09:58.522 INFO:tasks.workunit.client.3.smithi157.stdout:myimage50 3/s 3/s 85 KiB/s 98 KiB/s 2.79 ms 376.69 us 2024-03-26T17:09:58.522 INFO:tasks.workunit.client.3.smithi157.stdout:myimage2 3/s 4/s 82 KiB/s 100 KiB/s 2.93 ms 338.66 us 2024-03-26T17:09:58.522 INFO:tasks.workunit.client.3.smithi157.stdout:myimage30 3/s 3/s 108 KiB/s 90 KiB/s 3.65 ms 430.56 us 2024-03-26T17:09:58.522 INFO:tasks.workunit.client.3.smithi157.stdout:myimage48 3/s 4/s 56 KiB/s 83 KiB/s 3.30 ms 353.16 us 2024-03-26T17:09:58.522 INFO:tasks.workunit.client.3.smithi157.stdout:myimage28 3/s 4/s 64 KiB/s 98 KiB/s 3.42 ms 431.01 us 2024-03-26T17:09:58.523 INFO:tasks.workunit.client.3.smithi157.stdout:myimage36 3/s 3/s 77 KiB/s 51 KiB/s 2.82 ms 353.48 us 2024-03-26T17:09:58.523 INFO:tasks.workunit.client.3.smithi157.stdout:myimage32 3/s 4/s 69 KiB/s 93 KiB/s 2.96 ms 354.60 us 2024-03-26T17:09:58.523 INFO:tasks.workunit.client.3.smithi157.stdout:myimage37 3/s 4/s 70 KiB/s 122 KiB/s 2.80 ms 372.08 us 2024-03-26T17:09:58.523 INFO:tasks.workunit.client.3.smithi157.stdout:myimage40 3/s 3/s 70 KiB/s 102 KiB/s 2.60 ms 355.83 us 2024-03-26T17:09:58.523 INFO:tasks.workunit.client.3.smithi157.stdout:myimage8 3/s 4/s 85 KiB/s 115 KiB/s 2.79 ms 399.38 us 2024-03-26T17:09:58.523 INFO:tasks.workunit.client.3.smithi157.stdout:myimage20 3/s 3/s 72 KiB/s 90 KiB/s 2.35 ms 322.82 us 2024-03-26T17:09:58.523 INFO:tasks.workunit.client.3.smithi157.stdout:myimage42 3/s 4/s 53 KiB/s 82 KiB/s 2.83 ms 324.84 us 2024-03-26T17:09:58.523 INFO:tasks.workunit.client.3.smithi157.stdout:myimage22 2/s 4/s 71 KiB/s 102 KiB/s 3.10 ms 327.75 us 2024-03-26T17:09:58.523 INFO:tasks.workunit.client.3.smithi157.stdout:myimage21 2/s 5/s 58 KiB/s 100 KiB/s 3.45 ms 353.47 us 2024-03-26T17:09:58.523 INFO:tasks.workunit.client.3.smithi157.stdout:myimage59 2/s 3/s 58 KiB/s 78 KiB/s 3.09 ms 355.28 us 2024-03-26T17:09:58.523 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:09:59.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:09:59 smithi044 ceph-mon[30624]: pgmap v726: 33 pgs: 33 active+clean; 1.0 GiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 5.3 MiB/s rd, 5.5 MiB/s wr, 467 op/s 2024-03-26T17:09:59.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:09:59 smithi044 ceph-mon[30624]: Health check update: 3 slow ops, oldest one blocked for 693 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:09:59.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:09:59 smithi064 ceph-mon[34420]: pgmap v726: 33 pgs: 33 active+clean; 1.0 GiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 5.3 MiB/s rd, 5.5 MiB/s wr, 467 op/s 2024-03-26T17:09:59.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:09:59 smithi064 ceph-mon[34420]: Health check update: 3 slow ops, oldest one blocked for 693 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:09:59.395 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:09:59 smithi149 ceph-mon[34678]: pgmap v726: 33 pgs: 33 active+clean; 1.0 GiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 5.3 MiB/s rd, 5.5 MiB/s wr, 467 op/s 2024-03-26T17:09:59.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:09:59 smithi149 ceph-mon[34678]: Health check update: 3 slow ops, oldest one blocked for 693 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:09:59.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:09:59 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:09:59] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:09:59.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:09:59 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:09:59] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:09:59.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:09:59 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:10:00.017 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:09:59 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:09:59] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:10:00.017 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:09:59 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:09:59] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:10:00.017 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:09:59 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:10:00.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:10:00 smithi064 ceph-mon[34420]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:10:00.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:10:00 smithi064 ceph-mon[34420]: { 2024-03-26T17:10:00.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:10:00 smithi064 ceph-mon[34420]: "prefix": "rbd perf image stats", 2024-03-26T17:10:00.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:10:00 smithi064 ceph-mon[34420]: "pool_spec": "mypool", 2024-03-26T17:10:00.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:10:00 smithi064 ceph-mon[34420]: "sort_by": "write_ops", 2024-03-26T17:10:00.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:10:00 smithi064 ceph-mon[34420]: "format": "json" 2024-03-26T17:10:00.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:10:00 smithi064 ceph-mon[34420]: }"]: dispatch 2024-03-26T17:10:00.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:10:00 smithi064 ceph-mon[34420]: Health detail: HEALTH_WARN 1 failed cephadm daemon(s); 3 slow ops, oldest one blocked for 693 sec, mon.c has slow ops 2024-03-26T17:10:00.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:10:00 smithi064 ceph-mon[34420]: [WRN] CEPHADM_FAILED_DAEMON: 1 failed cephadm daemon(s) 2024-03-26T17:10:00.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:10:00 smithi064 ceph-mon[34420]: daemon nvmeof.nvmeof.b on smithi064 is in error state 2024-03-26T17:10:00.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:10:00 smithi064 ceph-mon[34420]: [WRN] SLOW_OPS: 3 slow ops, oldest one blocked for 693 sec, mon.c has slow ops 2024-03-26T17:10:00.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:10:00 smithi149 ceph-mon[34678]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:10:00.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:10:00 smithi149 ceph-mon[34678]: { 2024-03-26T17:10:00.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:10:00 smithi149 ceph-mon[34678]: "prefix": "rbd perf image stats", 2024-03-26T17:10:00.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:10:00 smithi149 ceph-mon[34678]: "pool_spec": "mypool", 2024-03-26T17:10:00.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:10:00 smithi149 ceph-mon[34678]: "sort_by": "write_ops", 2024-03-26T17:10:00.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:10:00 smithi149 ceph-mon[34678]: "format": "json" 2024-03-26T17:10:00.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:10:00 smithi149 ceph-mon[34678]: }"]: dispatch 2024-03-26T17:10:00.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:10:00 smithi149 ceph-mon[34678]: Health detail: HEALTH_WARN 1 failed cephadm daemon(s); 3 slow ops, oldest one blocked for 693 sec, mon.c has slow ops 2024-03-26T17:10:00.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:10:00 smithi149 ceph-mon[34678]: [WRN] CEPHADM_FAILED_DAEMON: 1 failed cephadm daemon(s) 2024-03-26T17:10:00.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:10:00 smithi149 ceph-mon[34678]: daemon nvmeof.nvmeof.b on smithi064 is in error state 2024-03-26T17:10:00.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:10:00 smithi149 ceph-mon[34678]: [WRN] SLOW_OPS: 3 slow ops, oldest one blocked for 693 sec, mon.c has slow ops 2024-03-26T17:10:00.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:10:00 smithi044 ceph-mon[30624]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:10:00.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:10:00 smithi044 ceph-mon[30624]: { 2024-03-26T17:10:00.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:10:00 smithi044 ceph-mon[30624]: "prefix": "rbd perf image stats", 2024-03-26T17:10:00.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:10:00 smithi044 ceph-mon[30624]: "pool_spec": "mypool", 2024-03-26T17:10:00.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:10:00 smithi044 ceph-mon[30624]: "sort_by": "write_ops", 2024-03-26T17:10:00.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:10:00 smithi044 ceph-mon[30624]: "format": "json" 2024-03-26T17:10:00.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:10:00 smithi044 ceph-mon[30624]: }"]: dispatch 2024-03-26T17:10:00.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:10:00 smithi044 ceph-mon[30624]: Health detail: HEALTH_WARN 1 failed cephadm daemon(s); 3 slow ops, oldest one blocked for 693 sec, mon.c has slow ops 2024-03-26T17:10:00.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:10:00 smithi044 ceph-mon[30624]: [WRN] CEPHADM_FAILED_DAEMON: 1 failed cephadm daemon(s) 2024-03-26T17:10:00.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:10:00 smithi044 ceph-mon[30624]: daemon nvmeof.nvmeof.b on smithi064 is in error state 2024-03-26T17:10:00.516 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:10:00 smithi044 ceph-mon[30624]: [WRN] SLOW_OPS: 3 slow ops, oldest one blocked for 693 sec, mon.c has slow ops 2024-03-26T17:10:01.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:10:01 smithi064 ceph-mon[34420]: pgmap v727: 33 pgs: 33 active+clean; 1.0 GiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 5.3 MiB/s rd, 5.4 MiB/s wr, 466 op/s 2024-03-26T17:10:01.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:10:01 smithi149 ceph-mon[34678]: pgmap v727: 33 pgs: 33 active+clean; 1.0 GiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 5.3 MiB/s rd, 5.4 MiB/s wr, 466 op/s 2024-03-26T17:10:01.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:10:01 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 2024-03-26T17:10:01.241+0000 7fa707a55700 -1 mon.c@1(peon) e3 get_health_metrics reporting 3 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T17:10:01.497 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:10:01 smithi044 ceph-mon[30624]: pgmap v727: 33 pgs: 33 active+clean; 1.0 GiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 5.3 MiB/s rd, 5.4 MiB/s wr, 466 op/s 2024-03-26T17:10:01.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:10:01 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:10:01] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:10:01.766 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:10:01 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:10:01] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:10:01.766 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:10:01 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:10:02.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:10:01 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:10:01] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:10:02.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:10:01 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:10:01] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:10:02.147 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:10:01 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:10:03.062 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:10:03.071 INFO:tasks.workunit.client.3.smithi157.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2024-03-26T17:10:03.071 INFO:tasks.workunit.client.3.smithi157.stdout: 7.50 83.2k 74.8k 0.0k 832.0k 748.0k 0.0k nvme2n1 2024-03-26T17:10:03.071 INFO:tasks.workunit.client.3.smithi157.stdout: 7.50 88.0k 89.6k 0.0k 880.0k 896.0k 0.0k nvme2n10 2024-03-26T17:10:03.072 INFO:tasks.workunit.client.3.smithi157.stdout: 7.50 71.6k 115.2k 0.0k 716.0k 1.1M 0.0k nvme2n11 2024-03-26T17:10:03.072 INFO:tasks.workunit.client.3.smithi157.stdout: 7.50 100.4k 100.8k 0.0k 1004.0k 1008.0k 0.0k nvme2n12 2024-03-26T17:10:03.072 INFO:tasks.workunit.client.3.smithi157.stdout: 7.50 111.2k 75.6k 0.0k 1.1M 756.0k 0.0k nvme2n13 2024-03-26T17:10:03.072 INFO:tasks.workunit.client.3.smithi157.stdout: 7.50 87.2k 92.4k 0.0k 872.0k 924.0k 0.0k nvme2n14 2024-03-26T17:10:03.072 INFO:tasks.workunit.client.3.smithi157.stdout: 7.50 82.8k 81.6k 0.0k 828.0k 816.0k 0.0k nvme2n15 2024-03-26T17:10:03.072 INFO:tasks.workunit.client.3.smithi157.stdout: 7.50 61.2k 96.8k 0.0k 612.0k 968.0k 0.0k nvme2n16 2024-03-26T17:10:03.072 INFO:tasks.workunit.client.3.smithi157.stdout: 7.50 93.2k 72.8k 0.0k 932.0k 728.0k 0.0k nvme2n17 2024-03-26T17:10:03.072 INFO:tasks.workunit.client.3.smithi157.stdout: 7.50 72.0k 87.2k 0.0k 720.0k 872.0k 0.0k nvme2n18 2024-03-26T17:10:03.072 INFO:tasks.workunit.client.3.smithi157.stdout: 7.50 79.6k 105.2k 0.0k 796.0k 1.0M 0.0k nvme2n19 2024-03-26T17:10:03.072 INFO:tasks.workunit.client.3.smithi157.stdout: 7.50 98.8k 91.6k 0.0k 988.0k 916.0k 0.0k nvme2n2 2024-03-26T17:10:03.072 INFO:tasks.workunit.client.3.smithi157.stdout: 7.50 67.6k 104.8k 0.0k 676.0k 1.0M 0.0k nvme2n20 2024-03-26T17:10:03.072 INFO:tasks.workunit.client.3.smithi157.stdout: 7.40 113.6k 61.6k 0.0k 1.1M 616.0k 0.0k nvme2n3 2024-03-26T17:10:03.072 INFO:tasks.workunit.client.3.smithi157.stdout: 7.40 87.2k 70.4k 0.0k 872.0k 704.0k 0.0k nvme2n4 2024-03-26T17:10:03.072 INFO:tasks.workunit.client.3.smithi157.stdout: 7.40 62.4k 94.0k 0.0k 624.0k 940.0k 0.0k nvme2n5 2024-03-26T17:10:03.073 INFO:tasks.workunit.client.3.smithi157.stdout: 7.40 66.8k 63.6k 0.0k 668.0k 636.0k 0.0k nvme2n6 2024-03-26T17:10:03.073 INFO:tasks.workunit.client.3.smithi157.stdout: 7.50 56.0k 75.6k 0.0k 560.0k 756.0k 0.0k nvme2n7 2024-03-26T17:10:03.073 INFO:tasks.workunit.client.3.smithi157.stdout: 7.50 91.6k 73.2k 0.0k 916.0k 732.0k 0.0k nvme2n8 2024-03-26T17:10:03.073 INFO:tasks.workunit.client.3.smithi157.stdout: 7.50 99.2k 55.6k 0.0k 992.0k 556.0k 0.0k nvme2n9 2024-03-26T17:10:03.073 INFO:tasks.workunit.client.3.smithi157.stdout: 7.50 71.2k 67.6k 0.0k 712.0k 676.0k 0.0k nvme5n1 2024-03-26T17:10:03.073 INFO:tasks.workunit.client.3.smithi157.stdout: 7.50 90.8k 96.8k 0.0k 908.0k 968.0k 0.0k nvme5n10 2024-03-26T17:10:03.073 INFO:tasks.workunit.client.3.smithi157.stdout: 7.50 62.4k 88.0k 0.0k 624.0k 880.0k 0.0k nvme5n11 2024-03-26T17:10:03.073 INFO:tasks.workunit.client.3.smithi157.stdout: 7.50 89.2k 93.2k 0.0k 892.0k 932.0k 0.0k nvme5n12 2024-03-26T17:10:03.073 INFO:tasks.workunit.client.3.smithi157.stdout: 7.50 98.8k 95.2k 0.0k 988.0k 952.0k 0.0k nvme5n13 2024-03-26T17:10:03.073 INFO:tasks.workunit.client.3.smithi157.stdout: 7.50 95.2k 78.4k 0.0k 952.0k 784.0k 0.0k nvme5n14 2024-03-26T17:10:03.073 INFO:tasks.workunit.client.3.smithi157.stdout: 7.50 91.2k 123.6k 0.0k 912.0k 1.2M 0.0k nvme5n15 2024-03-26T17:10:03.073 INFO:tasks.workunit.client.3.smithi157.stdout: 7.50 76.0k 72.0k 0.0k 760.0k 720.0k 0.0k nvme5n16 2024-03-26T17:10:03.073 INFO:tasks.workunit.client.3.smithi157.stdout: 7.50 94.8k 68.0k 0.0k 948.0k 680.0k 0.0k nvme5n17 2024-03-26T17:10:03.073 INFO:tasks.workunit.client.3.smithi157.stdout: 7.50 118.0k 45.6k 0.0k 1.2M 456.0k 0.0k nvme5n18 2024-03-26T17:10:03.073 INFO:tasks.workunit.client.3.smithi157.stdout: 7.50 88.4k 86.0k 0.0k 884.0k 860.0k 0.0k nvme5n19 2024-03-26T17:10:03.074 INFO:tasks.workunit.client.3.smithi157.stdout: 7.50 74.0k 98.4k 0.0k 740.0k 984.0k 0.0k nvme5n2 2024-03-26T17:10:03.074 INFO:tasks.workunit.client.3.smithi157.stdout: 7.50 105.2k 88.4k 0.0k 1.0M 884.0k 0.0k nvme5n20 2024-03-26T17:10:03.074 INFO:tasks.workunit.client.3.smithi157.stdout: 7.40 94.0k 82.0k 0.0k 940.0k 820.0k 0.0k nvme5n3 2024-03-26T17:10:03.074 INFO:tasks.workunit.client.3.smithi157.stdout: 7.40 68.4k 95.2k 0.0k 684.0k 952.0k 0.0k nvme5n4 2024-03-26T17:10:03.074 INFO:tasks.workunit.client.3.smithi157.stdout: 7.40 83.2k 73.6k 0.0k 832.0k 736.0k 0.0k nvme5n5 2024-03-26T17:10:03.074 INFO:tasks.workunit.client.3.smithi157.stdout: 7.40 69.2k 88.4k 0.0k 692.0k 884.0k 0.0k nvme5n6 2024-03-26T17:10:03.074 INFO:tasks.workunit.client.3.smithi157.stdout: 7.50 84.8k 94.0k 0.0k 848.0k 940.0k 0.0k nvme5n7 2024-03-26T17:10:03.074 INFO:tasks.workunit.client.3.smithi157.stdout: 7.50 87.2k 82.4k 0.0k 872.0k 824.0k 0.0k nvme5n8 2024-03-26T17:10:03.074 INFO:tasks.workunit.client.3.smithi157.stdout: 7.50 102.4k 58.8k 0.0k 1.0M 588.0k 0.0k nvme5n9 2024-03-26T17:10:03.074 INFO:tasks.workunit.client.3.smithi157.stdout: 7.50 63.2k 101.6k 0.0k 632.0k 1016.0k 0.0k nvme8n1 2024-03-26T17:10:03.074 INFO:tasks.workunit.client.3.smithi157.stdout: 7.50 73.6k 74.4k 0.0k 736.0k 744.0k 0.0k nvme8n10 2024-03-26T17:10:03.074 INFO:tasks.workunit.client.3.smithi157.stdout: 7.50 96.0k 90.0k 0.0k 960.0k 900.0k 0.0k nvme8n11 2024-03-26T17:10:03.074 INFO:tasks.workunit.client.3.smithi157.stdout: 7.50 91.6k 86.4k 0.0k 916.0k 864.0k 0.0k nvme8n12 2024-03-26T17:10:03.074 INFO:tasks.workunit.client.3.smithi157.stdout: 7.50 106.8k 106.8k 0.0k 1.0M 1.0M 0.0k nvme8n13 2024-03-26T17:10:03.075 INFO:tasks.workunit.client.3.smithi157.stdout: 7.50 65.2k 87.2k 0.0k 652.0k 872.0k 0.0k nvme8n14 2024-03-26T17:10:03.075 INFO:tasks.workunit.client.3.smithi157.stdout: 7.50 111.2k 77.2k 0.0k 1.1M 772.0k 0.0k nvme8n15 2024-03-26T17:10:03.075 INFO:tasks.workunit.client.3.smithi157.stdout: 7.50 77.6k 80.8k 0.0k 776.0k 808.0k 0.0k nvme8n16 2024-03-26T17:10:03.075 INFO:tasks.workunit.client.3.smithi157.stdout: 7.50 92.0k 82.0k 0.0k 920.0k 820.0k 0.0k nvme8n17 2024-03-26T17:10:03.075 INFO:tasks.workunit.client.3.smithi157.stdout: 7.50 72.0k 96.8k 0.0k 720.0k 968.0k 0.0k nvme8n18 2024-03-26T17:10:03.075 INFO:tasks.workunit.client.3.smithi157.stdout: 7.50 84.4k 91.2k 0.0k 844.0k 912.0k 0.0k nvme8n19 2024-03-26T17:10:03.075 INFO:tasks.workunit.client.3.smithi157.stdout: 7.50 58.4k 92.0k 0.0k 584.0k 920.0k 0.0k nvme8n2 2024-03-26T17:10:03.075 INFO:tasks.workunit.client.3.smithi157.stdout: 7.50 75.6k 104.4k 0.0k 756.0k 1.0M 0.0k nvme8n20 2024-03-26T17:10:03.075 INFO:tasks.workunit.client.3.smithi157.stdout: 7.40 79.2k 105.2k 0.0k 792.0k 1.0M 0.0k nvme8n3 2024-03-26T17:10:03.075 INFO:tasks.workunit.client.3.smithi157.stdout: 7.40 110.8k 64.4k 0.0k 1.1M 644.0k 0.0k nvme8n4 2024-03-26T17:10:03.075 INFO:tasks.workunit.client.3.smithi157.stdout: 7.40 82.0k 91.6k 0.0k 820.0k 916.0k 0.0k nvme8n5 2024-03-26T17:10:03.075 INFO:tasks.workunit.client.3.smithi157.stdout: 7.50 74.8k 87.6k 0.0k 748.0k 876.0k 0.0k nvme8n6 2024-03-26T17:10:03.075 INFO:tasks.workunit.client.3.smithi157.stdout: 7.50 96.4k 78.4k 0.0k 964.0k 784.0k 0.0k nvme8n7 2024-03-26T17:10:03.075 INFO:tasks.workunit.client.3.smithi157.stdout: 7.50 85.6k 83.6k 0.0k 856.0k 836.0k 0.0k nvme8n8 2024-03-26T17:10:03.076 INFO:tasks.workunit.client.3.smithi157.stdout: 7.50 89.6k 84.4k 0.0k 896.0k 844.0k 0.0k nvme8n9 2024-03-26T17:10:03.076 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:10:03.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:10:03 smithi064 ceph-mon[34420]: pgmap v728: 33 pgs: 33 active+clean; 1.0 GiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 5.1 MiB/s rd, 5.1 MiB/s wr, 450 op/s 2024-03-26T17:10:03.395 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:10:03 smithi149 ceph-mon[34678]: pgmap v728: 33 pgs: 33 active+clean; 1.0 GiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 5.1 MiB/s rd, 5.1 MiB/s wr, 450 op/s 2024-03-26T17:10:03.510 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:10:03 smithi044 ceph-mon[30624]: pgmap v728: 33 pgs: 33 active+clean; 1.0 GiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 5.1 MiB/s rd, 5.1 MiB/s wr, 450 op/s 2024-03-26T17:10:03.524 INFO:tasks.workunit.client.3.smithi157.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-26T17:10:03.524 INFO:tasks.workunit.client.3.smithi157.stdout:myimage24 5/s 2/s 139 KiB/s 68 KiB/s 2.85 ms 318.24 us 2024-03-26T17:10:03.524 INFO:tasks.workunit.client.3.smithi157.stdout:myimage22 5/s 3/s 114 KiB/s 62 KiB/s 2.86 ms 318.10 us 2024-03-26T17:10:03.524 INFO:tasks.workunit.client.3.smithi157.stdout:myimage20 5/s 2/s 112 KiB/s 56 KiB/s 2.71 ms 340.58 us 2024-03-26T17:10:03.524 INFO:tasks.workunit.client.3.smithi157.stdout:myimage43 5/s 3/s 123 KiB/s 74 KiB/s 3.28 ms 358.34 us 2024-03-26T17:10:03.524 INFO:tasks.workunit.client.3.smithi157.stdout:myimage60 4/s 3/s 84 KiB/s 68 KiB/s 2.89 ms 302.77 us 2024-03-26T17:10:03.524 INFO:tasks.workunit.client.3.smithi157.stdout:myimage40 4/s 4/s 98 KiB/s 130 KiB/s 2.68 ms 356.46 us 2024-03-26T17:10:03.524 INFO:tasks.workunit.client.3.smithi157.stdout:myimage45 4/s 2/s 101 KiB/s 76 KiB/s 2.84 ms 557.53 us 2024-03-26T17:10:03.524 INFO:tasks.workunit.client.3.smithi157.stdout:myimage59 4/s 4/s 110 KiB/s 93 KiB/s 3.35 ms 325.47 us 2024-03-26T17:10:03.524 INFO:tasks.workunit.client.3.smithi157.stdout:myimage48 4/s 2/s 103 KiB/s 90 KiB/s 2.84 ms 415.80 us 2024-03-26T17:10:03.524 INFO:tasks.workunit.client.3.smithi157.stdout:myimage6 4/s 2/s 70 KiB/s 46 KiB/s 3.08 ms 313.44 us 2024-03-26T17:10:03.525 INFO:tasks.workunit.client.3.smithi157.stdout:myimage25 4/s 4/s 93 KiB/s 100 KiB/s 3.49 ms 341.72 us 2024-03-26T17:10:03.525 INFO:tasks.workunit.client.3.smithi157.stdout:myimage28 4/s 3/s 110 KiB/s 77 KiB/s 3.77 ms 458.10 us 2024-03-26T17:10:03.525 INFO:tasks.workunit.client.3.smithi157.stdout:myimage54 4/s 2/s 86 KiB/s 54 KiB/s 2.48 ms 437.32 us 2024-03-26T17:10:03.525 INFO:tasks.workunit.client.3.smithi157.stdout:myimage42 4/s 3/s 81 KiB/s 63 KiB/s 2.59 ms 427.50 us 2024-03-26T17:10:03.525 INFO:tasks.workunit.client.3.smithi157.stdout:myimage57 4/s 3/s 99 KiB/s 86 KiB/s 2.92 ms 340.64 us 2024-03-26T17:10:03.525 INFO:tasks.workunit.client.3.smithi157.stdout:myimage49 4/s 3/s 93 KiB/s 63 KiB/s 2.61 ms 377.49 us 2024-03-26T17:10:03.525 INFO:tasks.workunit.client.3.smithi157.stdout:myimage7 4/s 3/s 64 KiB/s 62 KiB/s 2.78 ms 425.04 us 2024-03-26T17:10:03.525 INFO:tasks.workunit.client.3.smithi157.stdout:myimage27 4/s 3/s 92 KiB/s 88 KiB/s 2.59 ms 454.61 us 2024-03-26T17:10:03.525 INFO:tasks.workunit.client.3.smithi157.stdout:myimage39 4/s 3/s 101 KiB/s 85 KiB/s 2.59 ms 368.23 us 2024-03-26T17:10:03.525 INFO:tasks.workunit.client.3.smithi157.stdout:myimage41 4/s 4/s 96 KiB/s 78 KiB/s 2.92 ms 337.14 us 2024-03-26T17:10:03.525 INFO:tasks.workunit.client.3.smithi157.stdout:myimage2 3/s 3/s 96 KiB/s 93 KiB/s 3.00 ms 357.30 us 2024-03-26T17:10:03.525 INFO:tasks.workunit.client.3.smithi157.stdout:myimage14 3/s 3/s 73 KiB/s 123 KiB/s 3.03 ms 427.29 us 2024-03-26T17:10:03.525 INFO:tasks.workunit.client.3.smithi157.stdout:myimage16 3/s 3/s 81 KiB/s 80 KiB/s 3.09 ms 513.46 us 2024-03-26T17:10:03.525 INFO:tasks.workunit.client.3.smithi157.stdout:myimage35 3/s 3/s 110 KiB/s 84 KiB/s 3.24 ms 342.00 us 2024-03-26T17:10:03.526 INFO:tasks.workunit.client.3.smithi157.stdout:myimage52 3/s 3/s 83 KiB/s 98 KiB/s 3.22 ms 367.91 us 2024-03-26T17:10:03.526 INFO:tasks.workunit.client.3.smithi157.stdout:myimage5 3/s 3/s 82 KiB/s 58 KiB/s 2.51 ms 305.22 us 2024-03-26T17:10:03.526 INFO:tasks.workunit.client.3.smithi157.stdout:myimage11 3/s 3/s 94 KiB/s 72 KiB/s 3.39 ms 349.70 us 2024-03-26T17:10:03.526 INFO:tasks.workunit.client.3.smithi157.stdout:myimage21 3/s 3/s 49 KiB/s 70 KiB/s 3.48 ms 339.78 us 2024-03-26T17:10:03.526 INFO:tasks.workunit.client.3.smithi157.stdout:myimage53 3/s 2/s 108 KiB/s 86 KiB/s 2.67 ms 406.68 us 2024-03-26T17:10:03.526 INFO:tasks.workunit.client.3.smithi157.stdout:myimage10 3/s 2/s 74 KiB/s 67 KiB/s 2.73 ms 342.97 us 2024-03-26T17:10:03.526 INFO:tasks.workunit.client.3.smithi157.stdout:myimage58 3/s 3/s 98 KiB/s 58 KiB/s 2.62 ms 340.06 us 2024-03-26T17:10:03.526 INFO:tasks.workunit.client.3.smithi157.stdout:myimage12 3/s 3/s 106 KiB/s 90 KiB/s 3.15 ms 502.22 us 2024-03-26T17:10:03.526 INFO:tasks.workunit.client.3.smithi157.stdout:myimage50 3/s 4/s 76 KiB/s 68 KiB/s 2.95 ms 362.31 us 2024-03-26T17:10:03.526 INFO:tasks.workunit.client.3.smithi157.stdout:myimage56 3/s 3/s 98 KiB/s 76 KiB/s 3.42 ms 320.38 us 2024-03-26T17:10:03.526 INFO:tasks.workunit.client.3.smithi157.stdout:myimage30 3/s 4/s 94 KiB/s 84 KiB/s 3.77 ms 473.01 us 2024-03-26T17:10:03.526 INFO:tasks.workunit.client.3.smithi157.stdout:myimage31 3/s 4/s 62 KiB/s 64 KiB/s 3.03 ms 383.98 us 2024-03-26T17:10:03.526 INFO:tasks.workunit.client.3.smithi157.stdout:myimage34 3/s 4/s 77 KiB/s 100 KiB/s 2.51 ms 329.21 us 2024-03-26T17:10:03.526 INFO:tasks.workunit.client.3.smithi157.stdout:myimage17 3/s 4/s 59 KiB/s 101 KiB/s 2.89 ms 375.81 us 2024-03-26T17:10:03.527 INFO:tasks.workunit.client.3.smithi157.stdout:myimage18 3/s 3/s 70 KiB/s 64 KiB/s 2.77 ms 422.69 us 2024-03-26T17:10:03.527 INFO:tasks.workunit.client.3.smithi157.stdout:myimage19 3/s 4/s 88 KiB/s 78 KiB/s 2.74 ms 353.75 us 2024-03-26T17:10:03.527 INFO:tasks.workunit.client.3.smithi157.stdout:myimage26 3/s 3/s 72 KiB/s 94 KiB/s 2.94 ms 500.67 us 2024-03-26T17:10:03.527 INFO:tasks.workunit.client.3.smithi157.stdout:myimage33 3/s 4/s 77 KiB/s 104 KiB/s 2.48 ms 320.08 us 2024-03-26T17:10:03.527 INFO:tasks.workunit.client.3.smithi157.stdout:myimage46 3/s 4/s 71 KiB/s 97 KiB/s 2.70 ms 314.97 us 2024-03-26T17:10:03.527 INFO:tasks.workunit.client.3.smithi157.stdout:myimage32 3/s 3/s 74 KiB/s 70 KiB/s 2.74 ms 332.86 us 2024-03-26T17:10:03.527 INFO:tasks.workunit.client.3.smithi157.stdout:myimage4 3/s 4/s 50 KiB/s 97 KiB/s 2.60 ms 339.29 us 2024-03-26T17:10:03.527 INFO:tasks.workunit.client.3.smithi157.stdout:myimage8 3/s 5/s 63 KiB/s 122 KiB/s 3.16 ms 406.75 us 2024-03-26T17:10:03.527 INFO:tasks.workunit.client.3.smithi157.stdout:myimage15 3/s 4/s 70 KiB/s 110 KiB/s 2.70 ms 418.86 us 2024-03-26T17:10:03.527 INFO:tasks.workunit.client.3.smithi157.stdout:myimage51 3/s 4/s 98 KiB/s 106 KiB/s 3.26 ms 338.10 us 2024-03-26T17:10:03.527 INFO:tasks.workunit.client.3.smithi157.stdout:myimage13 3/s 4/s 78 KiB/s 118 KiB/s 2.46 ms 411.98 us 2024-03-26T17:10:03.527 INFO:tasks.workunit.client.3.smithi157.stdout:myimage23 3/s 3/s 77 KiB/s 86 KiB/s 2.42 ms 340.26 us 2024-03-26T17:10:03.527 INFO:tasks.workunit.client.3.smithi157.stdout:myimage37 3/s 4/s 48 KiB/s 89 KiB/s 5.60 ms 363.78 us 2024-03-26T17:10:03.527 INFO:tasks.workunit.client.3.smithi157.stdout:myimage38 3/s 5/s 60 KiB/s 130 KiB/s 2.53 ms 327.37 us 2024-03-26T17:10:03.527 INFO:tasks.workunit.client.3.smithi157.stdout:myimage29 3/s 4/s 43 KiB/s 134 KiB/s 2.58 ms 360.38 us 2024-03-26T17:10:03.528 INFO:tasks.workunit.client.3.smithi157.stdout:myimage36 3/s 5/s 62 KiB/s 107 KiB/s 2.68 ms 341.75 us 2024-03-26T17:10:03.528 INFO:tasks.workunit.client.3.smithi157.stdout:myimage55 3/s 4/s 56 KiB/s 130 KiB/s 2.90 ms 422.35 us 2024-03-26T17:10:03.528 INFO:tasks.workunit.client.3.smithi157.stdout:myimage47 2/s 4/s 54 KiB/s 108 KiB/s 3.14 ms 344.86 us 2024-03-26T17:10:03.528 INFO:tasks.workunit.client.3.smithi157.stdout:myimage1 2/s 4/s 43 KiB/s 94 KiB/s 2.19 ms 329.18 us 2024-03-26T17:10:03.528 INFO:tasks.workunit.client.3.smithi157.stdout:myimage9 2/s 5/s 60 KiB/s 125 KiB/s 3.03 ms 377.96 us 2024-03-26T17:10:03.528 INFO:tasks.workunit.client.3.smithi157.stdout:myimage3 2/s 4/s 67 KiB/s 123 KiB/s 2.47 ms 340.76 us 2024-03-26T17:10:03.528 INFO:tasks.workunit.client.3.smithi157.stdout:myimage44 2/s 5/s 54 KiB/s 130 KiB/s 2.83 ms 357.63 us 2024-03-26T17:10:03.528 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:10:03.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:10:03 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:10:03] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:10:03.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:10:03 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:10:03] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:10:03.766 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:10:03 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:10:04.027 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:10:03 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:10:03] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:10:04.027 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:10:03 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:10:03] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:10:04.027 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:10:03 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:10:04.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:10:04 smithi064 ceph-mon[34420]: Health check update: 3 slow ops, oldest one blocked for 698 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:10:04.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:10:04 smithi149 ceph-mon[34678]: Health check update: 3 slow ops, oldest one blocked for 698 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:10:04.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:10:04 smithi044 ceph-mon[30624]: Health check update: 3 slow ops, oldest one blocked for 698 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:10:05.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:10:05 smithi064 ceph-mon[34420]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:10:05.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:10:05 smithi064 ceph-mon[34420]: { 2024-03-26T17:10:05.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:10:05 smithi064 ceph-mon[34420]: "prefix": "rbd perf image stats", 2024-03-26T17:10:05.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:10:05 smithi064 ceph-mon[34420]: "pool_spec": "mypool", 2024-03-26T17:10:05.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:10:05 smithi064 ceph-mon[34420]: "sort_by": "write_ops", 2024-03-26T17:10:05.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:10:05 smithi064 ceph-mon[34420]: "format": "json" 2024-03-26T17:10:05.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:10:05 smithi064 ceph-mon[34420]: }"]: dispatch 2024-03-26T17:10:05.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:10:05 smithi064 ceph-mon[34420]: pgmap v729: 33 pgs: 33 active+clean; 1.0 GiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 5.4 MiB/s rd, 5.3 MiB/s wr, 485 op/s 2024-03-26T17:10:05.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:10:05 smithi149 ceph-mon[34678]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:10:05.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:10:05 smithi149 ceph-mon[34678]: { 2024-03-26T17:10:05.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:10:05 smithi149 ceph-mon[34678]: "prefix": "rbd perf image stats", 2024-03-26T17:10:05.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:10:05 smithi149 ceph-mon[34678]: "pool_spec": "mypool", 2024-03-26T17:10:05.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:10:05 smithi149 ceph-mon[34678]: "sort_by": "write_ops", 2024-03-26T17:10:05.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:10:05 smithi149 ceph-mon[34678]: "format": "json" 2024-03-26T17:10:05.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:10:05 smithi149 ceph-mon[34678]: }"]: dispatch 2024-03-26T17:10:05.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:10:05 smithi149 ceph-mon[34678]: pgmap v729: 33 pgs: 33 active+clean; 1.0 GiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 5.4 MiB/s rd, 5.3 MiB/s wr, 485 op/s 2024-03-26T17:10:05.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:10:05 smithi044 ceph-mon[30624]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:10:05.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:10:05 smithi044 ceph-mon[30624]: { 2024-03-26T17:10:05.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:10:05 smithi044 ceph-mon[30624]: "prefix": "rbd perf image stats", 2024-03-26T17:10:05.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:10:05 smithi044 ceph-mon[30624]: "pool_spec": "mypool", 2024-03-26T17:10:05.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:10:05 smithi044 ceph-mon[30624]: "sort_by": "write_ops", 2024-03-26T17:10:05.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:10:05 smithi044 ceph-mon[30624]: "format": "json" 2024-03-26T17:10:05.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:10:05 smithi044 ceph-mon[30624]: }"]: dispatch 2024-03-26T17:10:05.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:10:05 smithi044 ceph-mon[30624]: pgmap v729: 33 pgs: 33 active+clean; 1.0 GiB data, 4.3 GiB used, 711 GiB / 715 GiB avail; 5.4 MiB/s rd, 5.3 MiB/s wr, 485 op/s 2024-03-26T17:10:06.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:10:05 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:10:05] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:10:06.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:10:05 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:10:05] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:10:06.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:10:05 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:10:06.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:10:05 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:10:05] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:10:06.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:10:05 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:10:05] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:10:06.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:10:05 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:10:06.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:10:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 2024-03-26T17:10:06.241+0000 7fa707a55700 -1 mon.c@1(peon) e3 get_health_metrics reporting 3 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T17:10:07.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:10:07 smithi064 ceph-mon[34420]: pgmap v730: 33 pgs: 33 active+clean; 1.0 GiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 5.3 MiB/s rd, 5.4 MiB/s wr, 489 op/s 2024-03-26T17:10:07.395 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:10:07 smithi149 ceph-mon[34678]: pgmap v730: 33 pgs: 33 active+clean; 1.0 GiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 5.3 MiB/s rd, 5.4 MiB/s wr, 489 op/s 2024-03-26T17:10:07.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:10:07 smithi044 ceph-mon[30624]: pgmap v730: 33 pgs: 33 active+clean; 1.0 GiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 5.3 MiB/s rd, 5.4 MiB/s wr, 489 op/s 2024-03-26T17:10:08.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:10:07 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:10:07] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:10:08.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:10:07 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:10:07] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:10:08.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:10:07 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:10:08.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:10:07 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:10:07] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:10:08.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:10:07 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:10:07] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:10:08.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:10:07 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:10:08.528 INFO:tasks.workunit.client.3.smithi157.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-26T17:10:08.528 INFO:tasks.workunit.client.3.smithi157.stdout:myimage32 5/s 4/s 147 KiB/s 109 KiB/s 3.04 ms 473.06 us 2024-03-26T17:10:08.528 INFO:tasks.workunit.client.3.smithi157.stdout:myimage3 5/s 3/s 134 KiB/s 71 KiB/s 2.61 ms 441.28 us 2024-03-26T17:10:08.528 INFO:tasks.workunit.client.3.smithi157.stdout:myimage26 5/s 3/s 122 KiB/s 59 KiB/s 2.94 ms 338.67 us 2024-03-26T17:10:08.528 INFO:tasks.workunit.client.3.smithi157.stdout:myimage60 5/s 2/s 118 KiB/s 54 KiB/s 2.95 ms 442.53 us 2024-03-26T17:10:08.528 INFO:tasks.workunit.client.3.smithi157.stdout:myimage16 4/s 3/s 106 KiB/s 68 KiB/s 3.07 ms 327.69 us 2024-03-26T17:10:08.528 INFO:tasks.workunit.client.3.smithi157.stdout:myimage19 4/s 2/s 139 KiB/s 41 KiB/s 3.09 ms 437.04 us 2024-03-26T17:10:08.528 INFO:tasks.workunit.client.3.smithi157.stdout:myimage49 4/s 3/s 111 KiB/s 50 KiB/s 2.66 ms 476.79 us 2024-03-26T17:10:08.529 INFO:tasks.workunit.client.3.smithi157.stdout:myimage1 4/s 2/s 107 KiB/s 50 KiB/s 2.42 ms 445.05 us 2024-03-26T17:10:08.529 INFO:tasks.workunit.client.3.smithi157.stdout:myimage55 4/s 3/s 102 KiB/s 89 KiB/s 3.24 ms 418.78 us 2024-03-26T17:10:08.529 INFO:tasks.workunit.client.3.smithi157.stdout:myimage21 4/s 3/s 101 KiB/s 54 KiB/s 3.48 ms 398.52 us 2024-03-26T17:10:08.529 INFO:tasks.workunit.client.3.smithi157.stdout:myimage42 4/s 2/s 93 KiB/s 68 KiB/s 2.80 ms 360.46 us 2024-03-26T17:10:08.529 INFO:tasks.workunit.client.3.smithi157.stdout:myimage43 4/s 3/s 116 KiB/s 93 KiB/s 2.88 ms 465.67 us 2024-03-26T17:10:08.529 INFO:tasks.workunit.client.3.smithi157.stdout:myimage22 4/s 3/s 84 KiB/s 76 KiB/s 2.62 ms 431.31 us 2024-03-26T17:10:08.529 INFO:tasks.workunit.client.3.smithi157.stdout:myimage30 4/s 4/s 123 KiB/s 99 KiB/s 3.39 ms 357.20 us 2024-03-26T17:10:08.529 INFO:tasks.workunit.client.3.smithi157.stdout:myimage35 4/s 4/s 120 KiB/s 116 KiB/s 3.21 ms 358.06 us 2024-03-26T17:10:08.529 INFO:tasks.workunit.client.3.smithi157.stdout:myimage20 4/s 4/s 91 KiB/s 86 KiB/s 2.59 ms 316.69 us 2024-03-26T17:10:08.529 INFO:tasks.workunit.client.3.smithi157.stdout:myimage39 4/s 2/s 90 KiB/s 49 KiB/s 2.74 ms 351.63 us 2024-03-26T17:10:08.529 INFO:tasks.workunit.client.3.smithi157.stdout:myimage54 4/s 4/s 71 KiB/s 67 KiB/s 2.68 ms 352.56 us 2024-03-26T17:10:08.529 INFO:tasks.workunit.client.3.smithi157.stdout:myimage10 4/s 4/s 106 KiB/s 106 KiB/s 2.51 ms 334.46 us 2024-03-26T17:10:08.529 INFO:tasks.workunit.client.3.smithi157.stdout:myimage59 4/s 2/s 102 KiB/s 67 KiB/s 3.54 ms 369.89 us 2024-03-26T17:10:08.530 INFO:tasks.workunit.client.3.smithi157.stdout:myimage2 4/s 3/s 86 KiB/s 74 KiB/s 3.22 ms 325.18 us 2024-03-26T17:10:08.530 INFO:tasks.workunit.client.3.smithi157.stdout:myimage37 4/s 3/s 76 KiB/s 69 KiB/s 2.83 ms 413.73 us 2024-03-26T17:10:08.530 INFO:tasks.workunit.client.3.smithi157.stdout:myimage8 4/s 3/s 94 KiB/s 53 KiB/s 2.90 ms 289.88 us 2024-03-26T17:10:08.530 INFO:tasks.workunit.client.3.smithi157.stdout:myimage11 4/s 2/s 112 KiB/s 55 KiB/s 3.03 ms 296.78 us 2024-03-26T17:10:08.530 INFO:tasks.workunit.client.3.smithi157.stdout:myimage15 4/s 4/s 58 KiB/s 76 KiB/s 2.97 ms 417.39 us 2024-03-26T17:10:08.530 INFO:tasks.workunit.client.3.smithi157.stdout:myimage18 4/s 2/s 98 KiB/s 60 KiB/s 2.55 ms 288.80 us 2024-03-26T17:10:08.530 INFO:tasks.workunit.client.3.smithi157.stdout:myimage33 4/s 2/s 92 KiB/s 54 KiB/s 3.12 ms 338.63 us 2024-03-26T17:10:08.530 INFO:tasks.workunit.client.3.smithi157.stdout:myimage41 4/s 3/s 93 KiB/s 61 KiB/s 2.93 ms 381.23 us 2024-03-26T17:10:08.530 INFO:tasks.workunit.client.3.smithi157.stdout:myimage14 3/s 3/s 69 KiB/s 70 KiB/s 3.02 ms 365.47 us 2024-03-26T17:10:08.530 INFO:tasks.workunit.client.3.smithi157.stdout:myimage31 3/s 3/s 102 KiB/s 48 KiB/s 3.20 ms 341.45 us 2024-03-26T17:10:08.530 INFO:tasks.workunit.client.3.smithi157.stdout:myimage12 3/s 4/s 79 KiB/s 97 KiB/s 3.18 ms 355.72 us 2024-03-26T17:10:08.530 INFO:tasks.workunit.client.3.smithi157.stdout:myimage45 3/s 2/s 72 KiB/s 82 KiB/s 2.78 ms 333.70 us 2024-03-26T17:10:08.530 INFO:tasks.workunit.client.3.smithi157.stdout:myimage13 3/s 3/s 62 KiB/s 74 KiB/s 2.39 ms 445.40 us 2024-03-26T17:10:08.531 INFO:tasks.workunit.client.3.smithi157.stdout:myimage48 3/s 4/s 75 KiB/s 75 KiB/s 2.81 ms 399.80 us 2024-03-26T17:10:08.531 INFO:tasks.workunit.client.3.smithi157.stdout:myimage5 3/s 3/s 64 KiB/s 104 KiB/s 2.73 ms 336.43 us 2024-03-26T17:10:08.531 INFO:tasks.workunit.client.3.smithi157.stdout:myimage17 3/s 3/s 104 KiB/s 78 KiB/s 2.72 ms 330.74 us 2024-03-26T17:10:08.531 INFO:tasks.workunit.client.3.smithi157.stdout:myimage24 3/s 3/s 81 KiB/s 78 KiB/s 3.13 ms 460.23 us 2024-03-26T17:10:08.531 INFO:tasks.workunit.client.3.smithi157.stdout:myimage46 3/s 3/s 70 KiB/s 61 KiB/s 2.64 ms 314.97 us 2024-03-26T17:10:08.531 INFO:tasks.workunit.client.3.smithi157.stdout:myimage50 3/s 3/s 82 KiB/s 67 KiB/s 3.41 ms 356.13 us 2024-03-26T17:10:08.531 INFO:tasks.workunit.client.3.smithi157.stdout:myimage56 3/s 4/s 54 KiB/s 101 KiB/s 3.56 ms 456.32 us 2024-03-26T17:10:08.531 INFO:tasks.workunit.client.3.smithi157.stdout:myimage25 3/s 3/s 50 KiB/s 79 KiB/s 3.58 ms 399.70 us 2024-03-26T17:10:08.531 INFO:tasks.workunit.client.3.smithi157.stdout:myimage27 3/s 3/s 78 KiB/s 70 KiB/s 2.51 ms 306.29 us 2024-03-26T17:10:08.531 INFO:tasks.workunit.client.3.smithi157.stdout:myimage36 3/s 3/s 75 KiB/s 64 KiB/s 2.62 ms 332.58 us 2024-03-26T17:10:08.531 INFO:tasks.workunit.client.3.smithi157.stdout:myimage53 3/s 4/s 95 KiB/s 138 KiB/s 3.05 ms 416.54 us 2024-03-26T17:10:08.531 INFO:tasks.workunit.client.3.smithi157.stdout:myimage23 3/s 4/s 87 KiB/s 88 KiB/s 2.47 ms 300.85 us 2024-03-26T17:10:08.531 INFO:tasks.workunit.client.3.smithi157.stdout:myimage40 3/s 4/s 72 KiB/s 69 KiB/s 2.79 ms 418.39 us 2024-03-26T17:10:08.531 INFO:tasks.workunit.client.3.smithi157.stdout:myimage44 3/s 4/s 59 KiB/s 109 KiB/s 2.74 ms 401.87 us 2024-03-26T17:10:08.532 INFO:tasks.workunit.client.3.smithi157.stdout:myimage4 3/s 4/s 65 KiB/s 101 KiB/s 2.97 ms 424.53 us 2024-03-26T17:10:08.532 INFO:tasks.workunit.client.3.smithi157.stdout:myimage7 3/s 4/s 68 KiB/s 95 KiB/s 3.11 ms 356.68 us 2024-03-26T17:10:08.532 INFO:tasks.workunit.client.3.smithi157.stdout:myimage28 3/s 4/s 88 KiB/s 97 KiB/s 3.62 ms 375.32 us 2024-03-26T17:10:08.532 INFO:tasks.workunit.client.3.smithi157.stdout:myimage51 3/s 5/s 86 KiB/s 118 KiB/s 2.91 ms 428.86 us 2024-03-26T17:10:08.532 INFO:tasks.workunit.client.3.smithi157.stdout:myimage34 3/s 4/s 90 KiB/s 104 KiB/s 2.51 ms 349.12 us 2024-03-26T17:10:08.532 INFO:tasks.workunit.client.3.smithi157.stdout:myimage47 3/s 4/s 64 KiB/s 100 KiB/s 3.31 ms 360.54 us 2024-03-26T17:10:08.532 INFO:tasks.workunit.client.3.smithi157.stdout:myimage38 2/s 5/s 63 KiB/s 126 KiB/s 2.12 ms 441.74 us 2024-03-26T17:10:08.532 INFO:tasks.workunit.client.3.smithi157.stdout:myimage52 2/s 5/s 54 KiB/s 110 KiB/s 3.25 ms 335.24 us 2024-03-26T17:10:08.532 INFO:tasks.workunit.client.3.smithi157.stdout:myimage58 2/s 5/s 73 KiB/s 101 KiB/s 3.01 ms 371.26 us 2024-03-26T17:10:08.532 INFO:tasks.workunit.client.3.smithi157.stdout:myimage29 2/s 4/s 51 KiB/s 90 KiB/s 2.60 ms 362.01 us 2024-03-26T17:10:08.532 INFO:tasks.workunit.client.3.smithi157.stdout:myimage57 2/s 4/s 60 KiB/s 78 KiB/s 2.61 ms 374.82 us 2024-03-26T17:10:08.532 INFO:tasks.workunit.client.3.smithi157.stdout:myimage9 2/s 5/s 56 KiB/s 82 KiB/s 3.19 ms 320.64 us 2024-03-26T17:10:08.532 INFO:tasks.workunit.client.3.smithi157.stdout:myimage6 2/s 5/s 53 KiB/s 99 KiB/s 2.55 ms 350.38 us 2024-03-26T17:10:08.532 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:10:09.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:10:09 smithi064 ceph-mon[34420]: pgmap v731: 33 pgs: 33 active+clean; 1.0 GiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 4.6 MiB/s rd, 4.7 MiB/s wr, 440 op/s 2024-03-26T17:10:09.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:10:09 smithi064 ceph-mon[34420]: Health check update: 3 slow ops, oldest one blocked for 703 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:10:09.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:10:09 smithi149 ceph-mon[34678]: pgmap v731: 33 pgs: 33 active+clean; 1.0 GiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 4.6 MiB/s rd, 4.7 MiB/s wr, 440 op/s 2024-03-26T17:10:09.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:10:09 smithi149 ceph-mon[34678]: Health check update: 3 slow ops, oldest one blocked for 703 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:10:09.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:10:09 smithi044 ceph-mon[30624]: pgmap v731: 33 pgs: 33 active+clean; 1.0 GiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 4.6 MiB/s rd, 4.7 MiB/s wr, 440 op/s 2024-03-26T17:10:09.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:10:09 smithi044 ceph-mon[30624]: Health check update: 3 slow ops, oldest one blocked for 703 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:10:10.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:10:09 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:10:09] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:10:10.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:10:09 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:10:09] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:10:10.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:10:09 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:10:10.036 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:10:09 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:10:09] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:10:10.036 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:10:09 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:10:09] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:10:10.036 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:10:09 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:10:10.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:10:10 smithi064 ceph-mon[34420]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:10:10.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:10:10 smithi064 ceph-mon[34420]: { 2024-03-26T17:10:10.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:10:10 smithi064 ceph-mon[34420]: "prefix": "rbd perf image stats", 2024-03-26T17:10:10.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:10:10 smithi064 ceph-mon[34420]: "pool_spec": "mypool", 2024-03-26T17:10:10.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:10:10 smithi064 ceph-mon[34420]: "sort_by": "write_ops", 2024-03-26T17:10:10.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:10:10 smithi064 ceph-mon[34420]: "format": "json" 2024-03-26T17:10:10.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:10:10 smithi064 ceph-mon[34420]: }"]: dispatch 2024-03-26T17:10:10.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:10:10 smithi149 ceph-mon[34678]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:10:10.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:10:10 smithi149 ceph-mon[34678]: { 2024-03-26T17:10:10.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:10:10 smithi149 ceph-mon[34678]: "prefix": "rbd perf image stats", 2024-03-26T17:10:10.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:10:10 smithi149 ceph-mon[34678]: "pool_spec": "mypool", 2024-03-26T17:10:10.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:10:10 smithi149 ceph-mon[34678]: "sort_by": "write_ops", 2024-03-26T17:10:10.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:10:10 smithi149 ceph-mon[34678]: "format": "json" 2024-03-26T17:10:10.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:10:10 smithi149 ceph-mon[34678]: }"]: dispatch 2024-03-26T17:10:10.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:10:10 smithi044 ceph-mon[30624]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:10:10.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:10:10 smithi044 ceph-mon[30624]: { 2024-03-26T17:10:10.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:10:10 smithi044 ceph-mon[30624]: "prefix": "rbd perf image stats", 2024-03-26T17:10:10.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:10:10 smithi044 ceph-mon[30624]: "pool_spec": "mypool", 2024-03-26T17:10:10.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:10:10 smithi044 ceph-mon[30624]: "sort_by": "write_ops", 2024-03-26T17:10:10.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:10:10 smithi044 ceph-mon[30624]: "format": "json" 2024-03-26T17:10:10.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:10:10 smithi044 ceph-mon[30624]: }"]: dispatch 2024-03-26T17:10:11.297 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:10:11 smithi149 ceph-mon[34678]: pgmap v732: 33 pgs: 33 active+clean; 1.0 GiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 5.0 MiB/s rd, 5.0 MiB/s wr, 472 op/s 2024-03-26T17:10:11.297 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:10:11 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 2024-03-26T17:10:11.241+0000 7fa707a55700 -1 mon.c@1(peon) e3 get_health_metrics reporting 3 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T17:10:11.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:10:11 smithi064 ceph-mon[34420]: pgmap v732: 33 pgs: 33 active+clean; 1.0 GiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 5.0 MiB/s rd, 5.0 MiB/s wr, 472 op/s 2024-03-26T17:10:11.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:10:11 smithi044 ceph-mon[30624]: pgmap v732: 33 pgs: 33 active+clean; 1.0 GiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 5.0 MiB/s rd, 5.0 MiB/s wr, 472 op/s 2024-03-26T17:10:12.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:10:11 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:10:11] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:10:12.102 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:10:11 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:10:11] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:10:12.103 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:10:11 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:10:12.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:10:11 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:10:11] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:10:12.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:10:11 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:10:11] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:10:12.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:10:11 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:10:13.074 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:10:13.074 INFO:tasks.workunit.client.3.smithi157.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2024-03-26T17:10:13.074 INFO:tasks.workunit.client.3.smithi157.stdout: 7.60 85.6k 79.2k 0.0k 856.0k 792.0k 0.0k nvme2n1 2024-03-26T17:10:13.074 INFO:tasks.workunit.client.3.smithi157.stdout: 7.70 60.4k 70.4k 0.0k 604.0k 704.0k 0.0k nvme2n10 2024-03-26T17:10:13.074 INFO:tasks.workunit.client.3.smithi157.stdout: 7.70 98.0k 74.8k 0.0k 980.0k 748.0k 0.0k nvme2n11 2024-03-26T17:10:13.075 INFO:tasks.workunit.client.3.smithi157.stdout: 7.70 104.8k 79.6k 0.0k 1.0M 796.0k 0.0k nvme2n12 2024-03-26T17:10:13.075 INFO:tasks.workunit.client.3.smithi157.stdout: 7.70 83.2k 62.0k 0.0k 832.0k 620.0k 0.0k nvme2n13 2024-03-26T17:10:13.075 INFO:tasks.workunit.client.3.smithi157.stdout: 7.70 88.4k 78.4k 0.0k 884.0k 784.0k 0.0k nvme2n14 2024-03-26T17:10:13.075 INFO:tasks.workunit.client.3.smithi157.stdout: 7.70 92.0k 78.0k 0.0k 920.0k 780.0k 0.0k nvme2n15 2024-03-26T17:10:13.075 INFO:tasks.workunit.client.3.smithi157.stdout: 7.70 109.2k 87.6k 0.0k 1.1M 876.0k 0.0k nvme2n16 2024-03-26T17:10:13.075 INFO:tasks.workunit.client.3.smithi157.stdout: 7.70 70.8k 115.6k 0.0k 708.0k 1.1M 0.0k nvme2n17 2024-03-26T17:10:13.075 INFO:tasks.workunit.client.3.smithi157.stdout: 7.70 73.2k 80.8k 0.0k 732.0k 808.0k 0.0k nvme2n18 2024-03-26T17:10:13.075 INFO:tasks.workunit.client.3.smithi157.stdout: 7.60 77.6k 78.8k 0.0k 776.0k 788.0k 0.0k nvme2n19 2024-03-26T17:10:13.075 INFO:tasks.workunit.client.3.smithi157.stdout: 7.60 79.6k 80.8k 0.0k 796.0k 808.0k 0.0k nvme2n2 2024-03-26T17:10:13.075 INFO:tasks.workunit.client.3.smithi157.stdout: 7.60 74.4k 60.8k 0.0k 744.0k 608.0k 0.0k nvme2n20 2024-03-26T17:10:13.075 INFO:tasks.workunit.client.3.smithi157.stdout: 7.70 71.2k 92.4k 0.0k 712.0k 924.0k 0.0k nvme2n3 2024-03-26T17:10:13.075 INFO:tasks.workunit.client.3.smithi157.stdout: 7.70 94.0k 45.2k 0.0k 940.0k 452.0k 0.0k nvme2n4 2024-03-26T17:10:13.075 INFO:tasks.workunit.client.3.smithi157.stdout: 7.70 111.2k 94.0k 0.0k 1.1M 940.0k 0.0k nvme2n5 2024-03-26T17:10:13.075 INFO:tasks.workunit.client.3.smithi157.stdout: 7.70 84.4k 83.2k 0.0k 844.0k 832.0k 0.0k nvme2n6 2024-03-26T17:10:13.076 INFO:tasks.workunit.client.3.smithi157.stdout: 7.70 82.4k 63.6k 0.0k 824.0k 636.0k 0.0k nvme2n7 2024-03-26T17:10:13.076 INFO:tasks.workunit.client.3.smithi157.stdout: 7.70 72.4k 80.8k 0.0k 724.0k 808.0k 0.0k nvme2n8 2024-03-26T17:10:13.076 INFO:tasks.workunit.client.3.smithi157.stdout: 7.70 102.8k 62.8k 0.0k 1.0M 628.0k 0.0k nvme2n9 2024-03-26T17:10:13.076 INFO:tasks.workunit.client.3.smithi157.stdout: 7.60 77.2k 85.2k 0.0k 772.0k 852.0k 0.0k nvme5n1 2024-03-26T17:10:13.076 INFO:tasks.workunit.client.3.smithi157.stdout: 7.70 83.6k 114.4k 0.0k 836.0k 1.1M 0.0k nvme5n10 2024-03-26T17:10:13.076 INFO:tasks.workunit.client.3.smithi157.stdout: 7.70 83.2k 91.6k 0.0k 832.0k 916.0k 0.0k nvme5n11 2024-03-26T17:10:13.076 INFO:tasks.workunit.client.3.smithi157.stdout: 7.70 61.6k 112.0k 0.0k 616.0k 1.1M 0.0k nvme5n12 2024-03-26T17:10:13.076 INFO:tasks.workunit.client.3.smithi157.stdout: 7.70 58.8k 116.4k 0.0k 588.0k 1.1M 0.0k nvme5n13 2024-03-26T17:10:13.076 INFO:tasks.workunit.client.3.smithi157.stdout: 7.70 108.0k 70.0k 0.0k 1.1M 700.0k 0.0k nvme5n14 2024-03-26T17:10:13.076 INFO:tasks.workunit.client.3.smithi157.stdout: 7.70 106.4k 94.4k 0.0k 1.0M 944.0k 0.0k nvme5n15 2024-03-26T17:10:13.077 INFO:tasks.workunit.client.3.smithi157.stdout: 7.70 82.0k 102.0k 0.0k 820.0k 1020.0k 0.0k nvme5n16 2024-03-26T17:10:13.077 INFO:tasks.workunit.client.3.smithi157.stdout: 7.70 92.8k 47.6k 0.0k 928.0k 476.0k 0.0k nvme5n17 2024-03-26T17:10:13.077 INFO:tasks.workunit.client.3.smithi157.stdout: 7.70 104.8k 86.8k 0.0k 1.0M 868.0k 0.0k nvme5n18 2024-03-26T17:10:13.077 INFO:tasks.workunit.client.3.smithi157.stdout: 7.60 68.8k 89.2k 0.0k 688.0k 892.0k 0.0k nvme5n19 2024-03-26T17:10:13.077 INFO:tasks.workunit.client.3.smithi157.stdout: 7.60 69.6k 63.6k 0.0k 696.0k 636.0k 0.0k nvme5n2 2024-03-26T17:10:13.077 INFO:tasks.workunit.client.3.smithi157.stdout: 7.60 72.0k 72.4k 0.0k 720.0k 724.0k 0.0k nvme5n20 2024-03-26T17:10:13.077 INFO:tasks.workunit.client.3.smithi157.stdout: 7.70 80.0k 93.6k 0.0k 800.0k 936.0k 0.0k nvme5n3 2024-03-26T17:10:13.077 INFO:tasks.workunit.client.3.smithi157.stdout: 7.70 104.0k 80.4k 0.0k 1.0M 804.0k 0.0k nvme5n4 2024-03-26T17:10:13.077 INFO:tasks.workunit.client.3.smithi157.stdout: 7.70 83.6k 57.2k 0.0k 836.0k 572.0k 0.0k nvme5n5 2024-03-26T17:10:13.077 INFO:tasks.workunit.client.3.smithi157.stdout: 7.70 65.6k 114.8k 0.0k 656.0k 1.1M 0.0k nvme5n6 2024-03-26T17:10:13.077 INFO:tasks.workunit.client.3.smithi157.stdout: 7.70 93.6k 67.2k 0.0k 936.0k 672.0k 0.0k nvme5n7 2024-03-26T17:10:13.078 INFO:tasks.workunit.client.3.smithi157.stdout: 7.70 86.8k 102.8k 0.0k 868.0k 1.0M 0.0k nvme5n8 2024-03-26T17:10:13.078 INFO:tasks.workunit.client.3.smithi157.stdout: 7.70 90.0k 69.2k 0.0k 900.0k 692.0k 0.0k nvme5n9 2024-03-26T17:10:13.078 INFO:tasks.workunit.client.3.smithi157.stdout: 7.60 64.8k 90.4k 0.0k 648.0k 904.0k 0.0k nvme8n1 2024-03-26T17:10:13.078 INFO:tasks.workunit.client.3.smithi157.stdout: 7.70 69.2k 78.0k 0.0k 692.0k 780.0k 0.0k nvme8n10 2024-03-26T17:10:13.078 INFO:tasks.workunit.client.3.smithi157.stdout: 7.70 68.8k 75.6k 0.0k 688.0k 756.0k 0.0k nvme8n11 2024-03-26T17:10:13.078 INFO:tasks.workunit.client.3.smithi157.stdout: 7.70 91.6k 58.8k 0.0k 916.0k 588.0k 0.0k nvme8n12 2024-03-26T17:10:13.078 INFO:tasks.workunit.client.3.smithi157.stdout: 7.70 95.6k 89.2k 0.0k 956.0k 892.0k 0.0k nvme8n13 2024-03-26T17:10:13.078 INFO:tasks.workunit.client.3.smithi157.stdout: 7.70 44.0k 82.0k 0.0k 440.0k 820.0k 0.0k nvme8n14 2024-03-26T17:10:13.078 INFO:tasks.workunit.client.3.smithi157.stdout: 7.70 99.6k 80.4k 0.0k 996.0k 804.0k 0.0k nvme8n15 2024-03-26T17:10:13.078 INFO:tasks.workunit.client.3.smithi157.stdout: 7.70 85.2k 83.6k 0.0k 852.0k 836.0k 0.0k nvme8n16 2024-03-26T17:10:13.078 INFO:tasks.workunit.client.3.smithi157.stdout: 7.70 116.0k 56.0k 0.0k 1.1M 560.0k 0.0k nvme8n17 2024-03-26T17:10:13.078 INFO:tasks.workunit.client.3.smithi157.stdout: 7.60 81.2k 75.2k 0.0k 812.0k 752.0k 0.0k nvme8n18 2024-03-26T17:10:13.078 INFO:tasks.workunit.client.3.smithi157.stdout: 7.60 85.2k 72.4k 0.0k 852.0k 724.0k 0.0k nvme8n19 2024-03-26T17:10:13.079 INFO:tasks.workunit.client.3.smithi157.stdout: 7.60 82.0k 90.4k 0.0k 820.0k 904.0k 0.0k nvme8n2 2024-03-26T17:10:13.079 INFO:tasks.workunit.client.3.smithi157.stdout: 7.60 51.6k 91.2k 0.0k 516.0k 912.0k 0.0k nvme8n20 2024-03-26T17:10:13.079 INFO:tasks.workunit.client.3.smithi157.stdout: 7.70 83.2k 101.2k 0.0k 832.0k 1012.0k 0.0k nvme8n3 2024-03-26T17:10:13.079 INFO:tasks.workunit.client.3.smithi157.stdout: 7.70 84.8k 60.8k 0.0k 848.0k 608.0k 0.0k nvme8n4 2024-03-26T17:10:13.079 INFO:tasks.workunit.client.3.smithi157.stdout: 7.70 77.6k 89.6k 0.0k 776.0k 896.0k 0.0k nvme8n5 2024-03-26T17:10:13.079 INFO:tasks.workunit.client.3.smithi157.stdout: 7.70 116.4k 57.2k 0.0k 1.1M 572.0k 0.0k nvme8n6 2024-03-26T17:10:13.079 INFO:tasks.workunit.client.3.smithi157.stdout: 7.70 92.0k 87.2k 0.0k 920.0k 872.0k 0.0k nvme8n7 2024-03-26T17:10:13.079 INFO:tasks.workunit.client.3.smithi157.stdout: 7.70 75.6k 95.2k 0.0k 756.0k 952.0k 0.0k nvme8n8 2024-03-26T17:10:13.079 INFO:tasks.workunit.client.3.smithi157.stdout: 7.70 80.0k 93.6k 0.0k 800.0k 936.0k 0.0k nvme8n9 2024-03-26T17:10:13.079 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:10:13.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:10:13 smithi064 ceph-mon[34420]: pgmap v733: 33 pgs: 33 active+clean; 1.0 GiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 4.8 MiB/s rd, 4.8 MiB/s wr, 458 op/s 2024-03-26T17:10:13.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:10:13 smithi149 ceph-mon[34678]: pgmap v733: 33 pgs: 33 active+clean; 1.0 GiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 4.8 MiB/s rd, 4.8 MiB/s wr, 458 op/s 2024-03-26T17:10:13.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:10:13 smithi044 ceph-mon[30624]: pgmap v733: 33 pgs: 33 active+clean; 1.0 GiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 4.8 MiB/s rd, 4.8 MiB/s wr, 458 op/s 2024-03-26T17:10:13.532 INFO:tasks.workunit.client.3.smithi157.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-26T17:10:13.532 INFO:tasks.workunit.client.3.smithi157.stdout:myimage33 5/s 2/s 129 KiB/s 58 KiB/s 2.95 ms 394.31 us 2024-03-26T17:10:13.532 INFO:tasks.workunit.client.3.smithi157.stdout:myimage23 4/s 3/s 106 KiB/s 59 KiB/s 2.28 ms 335.63 us 2024-03-26T17:10:13.532 INFO:tasks.workunit.client.3.smithi157.stdout:myimage40 4/s 3/s 83 KiB/s 86 KiB/s 2.69 ms 553.98 us 2024-03-26T17:10:13.532 INFO:tasks.workunit.client.3.smithi157.stdout:myimage29 4/s 3/s 94 KiB/s 84 KiB/s 2.56 ms 444.69 us 2024-03-26T17:10:13.532 INFO:tasks.workunit.client.3.smithi157.stdout:myimage60 4/s 2/s 79 KiB/s 55 KiB/s 2.95 ms 485.23 us 2024-03-26T17:10:13.532 INFO:tasks.workunit.client.3.smithi157.stdout:myimage30 4/s 2/s 120 KiB/s 56 KiB/s 3.43 ms 352.86 us 2024-03-26T17:10:13.532 INFO:tasks.workunit.client.3.smithi157.stdout:myimage32 4/s 2/s 94 KiB/s 46 KiB/s 2.96 ms 332.13 us 2024-03-26T17:10:13.532 INFO:tasks.workunit.client.3.smithi157.stdout:myimage18 4/s 4/s 86 KiB/s 77 KiB/s 2.54 ms 336.35 us 2024-03-26T17:10:13.532 INFO:tasks.workunit.client.3.smithi157.stdout:myimage26 4/s 3/s 102 KiB/s 53 KiB/s 2.92 ms 371.38 us 2024-03-26T17:10:13.532 INFO:tasks.workunit.client.3.smithi157.stdout:myimage46 4/s 4/s 73 KiB/s 145 KiB/s 2.62 ms 436.07 us 2024-03-26T17:10:13.532 INFO:tasks.workunit.client.3.smithi157.stdout:myimage54 4/s 2/s 89 KiB/s 37 KiB/s 2.84 ms 317.08 us 2024-03-26T17:10:13.532 INFO:tasks.workunit.client.3.smithi157.stdout:myimage31 4/s 3/s 102 KiB/s 80 KiB/s 2.99 ms 469.70 us 2024-03-26T17:10:13.533 INFO:tasks.workunit.client.3.smithi157.stdout:myimage47 4/s 4/s 94 KiB/s 84 KiB/s 3.01 ms 394.40 us 2024-03-26T17:10:13.533 INFO:tasks.workunit.client.3.smithi157.stdout:myimage49 4/s 3/s 79 KiB/s 98 KiB/s 2.62 ms 340.25 us 2024-03-26T17:10:13.533 INFO:tasks.workunit.client.3.smithi157.stdout:myimage58 4/s 4/s 79 KiB/s 100 KiB/s 2.73 ms 425.35 us 2024-03-26T17:10:13.533 INFO:tasks.workunit.client.3.smithi157.stdout:myimage6 4/s 3/s 75 KiB/s 83 KiB/s 2.93 ms 482.12 us 2024-03-26T17:10:13.533 INFO:tasks.workunit.client.3.smithi157.stdout:myimage28 4/s 4/s 95 KiB/s 105 KiB/s 4.01 ms 359.28 us 2024-03-26T17:10:13.533 INFO:tasks.workunit.client.3.smithi157.stdout:myimage39 4/s 3/s 82 KiB/s 86 KiB/s 2.60 ms 332.56 us 2024-03-26T17:10:13.533 INFO:tasks.workunit.client.3.smithi157.stdout:myimage41 4/s 2/s 104 KiB/s 46 KiB/s 3.02 ms 346.16 us 2024-03-26T17:10:13.533 INFO:tasks.workunit.client.3.smithi157.stdout:myimage43 4/s 3/s 87 KiB/s 79 KiB/s 3.12 ms 345.00 us 2024-03-26T17:10:13.533 INFO:tasks.workunit.client.3.smithi157.stdout:myimage50 4/s 5/s 85 KiB/s 92 KiB/s 3.36 ms 342.26 us 2024-03-26T17:10:13.533 INFO:tasks.workunit.client.3.smithi157.stdout:myimage10 4/s 2/s 62 KiB/s 50 KiB/s 2.69 ms 399.08 us 2024-03-26T17:10:13.533 INFO:tasks.workunit.client.3.smithi157.stdout:myimage16 4/s 3/s 104 KiB/s 95 KiB/s 2.95 ms 465.33 us 2024-03-26T17:10:13.533 INFO:tasks.workunit.client.3.smithi157.stdout:myimage8 4/s 3/s 66 KiB/s 72 KiB/s 2.87 ms 317.59 us 2024-03-26T17:10:13.533 INFO:tasks.workunit.client.3.smithi157.stdout:myimage15 4/s 3/s 82 KiB/s 106 KiB/s 2.49 ms 382.93 us 2024-03-26T17:10:13.533 INFO:tasks.workunit.client.3.smithi157.stdout:myimage21 4/s 2/s 84 KiB/s 74 KiB/s 3.83 ms 490.24 us 2024-03-26T17:10:13.533 INFO:tasks.workunit.client.3.smithi157.stdout:myimage42 4/s 4/s 110 KiB/s 91 KiB/s 2.72 ms 364.21 us 2024-03-26T17:10:13.534 INFO:tasks.workunit.client.3.smithi157.stdout:myimage51 4/s 3/s 70 KiB/s 37 KiB/s 3.29 ms 309.64 us 2024-03-26T17:10:13.534 INFO:tasks.workunit.client.3.smithi157.stdout:myimage22 3/s 3/s 66 KiB/s 53 KiB/s 2.76 ms 330.98 us 2024-03-26T17:10:13.534 INFO:tasks.workunit.client.3.smithi157.stdout:myimage35 3/s 4/s 103 KiB/s 110 KiB/s 3.13 ms 337.28 us 2024-03-26T17:10:13.534 INFO:tasks.workunit.client.3.smithi157.stdout:myimage52 3/s 4/s 74 KiB/s 74 KiB/s 3.21 ms 341.56 us 2024-03-26T17:10:13.534 INFO:tasks.workunit.client.3.smithi157.stdout:myimage53 3/s 3/s 74 KiB/s 94 KiB/s 2.78 ms 507.61 us 2024-03-26T17:10:13.534 INFO:tasks.workunit.client.3.smithi157.stdout:myimage38 3/s 3/s 81 KiB/s 70 KiB/s 2.38 ms 321.38 us 2024-03-26T17:10:13.534 INFO:tasks.workunit.client.3.smithi157.stdout:myimage5 3/s 3/s 114 KiB/s 86 KiB/s 2.88 ms 328.31 us 2024-03-26T17:10:13.534 INFO:tasks.workunit.client.3.smithi157.stdout:myimage7 3/s 3/s 57 KiB/s 70 KiB/s 2.93 ms 337.20 us 2024-03-26T17:10:13.534 INFO:tasks.workunit.client.3.smithi157.stdout:myimage36 3/s 3/s 106 KiB/s 68 KiB/s 3.18 ms 366.34 us 2024-03-26T17:10:13.534 INFO:tasks.workunit.client.3.smithi157.stdout:myimage3 3/s 4/s 56 KiB/s 79 KiB/s 2.21 ms 324.43 us 2024-03-26T17:10:13.534 INFO:tasks.workunit.client.3.smithi157.stdout:myimage34 3/s 5/s 60 KiB/s 142 KiB/s 2.75 ms 329.42 us 2024-03-26T17:10:13.534 INFO:tasks.workunit.client.3.smithi157.stdout:myimage48 3/s 3/s 102 KiB/s 73 KiB/s 3.00 ms 423.53 us 2024-03-26T17:10:13.535 INFO:tasks.workunit.client.3.smithi157.stdout:myimage12 3/s 4/s 78 KiB/s 124 KiB/s 3.03 ms 463.09 us 2024-03-26T17:10:13.535 INFO:tasks.workunit.client.3.smithi157.stdout:myimage17 3/s 4/s 71 KiB/s 84 KiB/s 2.99 ms 333.63 us 2024-03-26T17:10:13.535 INFO:tasks.workunit.client.3.smithi157.stdout:myimage20 3/s 3/s 63 KiB/s 59 KiB/s 2.75 ms 296.34 us 2024-03-26T17:10:13.535 INFO:tasks.workunit.client.3.smithi157.stdout:myimage59 3/s 4/s 69 KiB/s 92 KiB/s 3.40 ms 401.94 us 2024-03-26T17:10:13.535 INFO:tasks.workunit.client.3.smithi157.stdout:myimage1 3/s 5/s 77 KiB/s 125 KiB/s 2.18 ms 388.22 us 2024-03-26T17:10:13.535 INFO:tasks.workunit.client.3.smithi157.stdout:myimage24 3/s 5/s 81 KiB/s 120 KiB/s 3.09 ms 550.73 us 2024-03-26T17:10:13.535 INFO:tasks.workunit.client.3.smithi157.stdout:myimage27 3/s 4/s 80 KiB/s 87 KiB/s 2.70 ms 336.81 us 2024-03-26T17:10:13.535 INFO:tasks.workunit.client.3.smithi157.stdout:myimage45 3/s 5/s 84 KiB/s 104 KiB/s 2.81 ms 332.85 us 2024-03-26T17:10:13.535 INFO:tasks.workunit.client.3.smithi157.stdout:myimage55 3/s 5/s 73 KiB/s 129 KiB/s 2.82 ms 356.98 us 2024-03-26T17:10:13.535 INFO:tasks.workunit.client.3.smithi157.stdout:myimage56 3/s 5/s 76 KiB/s 90 KiB/s 3.45 ms 393.02 us 2024-03-26T17:10:13.535 INFO:tasks.workunit.client.3.smithi157.stdout:myimage13 3/s 5/s 54 KiB/s 98 KiB/s 2.69 ms 333.22 us 2024-03-26T17:10:13.535 INFO:tasks.workunit.client.3.smithi157.stdout:myimage14 3/s 4/s 69 KiB/s 98 KiB/s 2.73 ms 338.93 us 2024-03-26T17:10:13.535 INFO:tasks.workunit.client.3.smithi157.stdout:myimage4 3/s 4/s 53 KiB/s 82 KiB/s 2.76 ms 331.10 us 2024-03-26T17:10:13.535 INFO:tasks.workunit.client.3.smithi157.stdout:myimage19 3/s 5/s 62 KiB/s 107 KiB/s 2.75 ms 441.86 us 2024-03-26T17:10:13.535 INFO:tasks.workunit.client.3.smithi157.stdout:myimage25 3/s 3/s 53 KiB/s 75 KiB/s 3.63 ms 355.97 us 2024-03-26T17:10:13.535 INFO:tasks.workunit.client.3.smithi157.stdout:myimage57 3/s 5/s 58 KiB/s 142 KiB/s 2.91 ms 365.45 us 2024-03-26T17:10:13.535 INFO:tasks.workunit.client.3.smithi157.stdout:myimage9 2/s 4/s 47 KiB/s 101 KiB/s 2.94 ms 338.59 us 2024-03-26T17:10:13.536 INFO:tasks.workunit.client.3.smithi157.stdout:myimage37 2/s 4/s 42 KiB/s 82 KiB/s 3.16 ms 323.85 us 2024-03-26T17:10:13.536 INFO:tasks.workunit.client.3.smithi157.stdout:myimage44 2/s 5/s 66 KiB/s 86 KiB/s 2.91 ms 349.12 us 2024-03-26T17:10:13.536 INFO:tasks.workunit.client.3.smithi157.stdout:myimage11 2/s 5/s 74 KiB/s 123 KiB/s 2.98 ms 398.36 us 2024-03-26T17:10:13.536 INFO:tasks.workunit.client.3.smithi157.stdout:myimage2 2/s 4/s 60 KiB/s 108 KiB/s 2.60 ms 331.54 us 2024-03-26T17:10:13.536 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:10:14.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:10:13 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:10:13] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:10:14.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:10:13 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:10:13] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:10:14.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:10:13 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:10:14.040 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:10:13 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:10:13] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:10:14.040 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:10:13 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:10:13] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:10:14.040 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:10:13 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:10:14.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:10:14 smithi064 ceph-mon[34420]: Health check update: 3 slow ops, oldest one blocked for 708 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:10:14.351 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:10:14 smithi149 ceph-mon[34678]: Health check update: 3 slow ops, oldest one blocked for 708 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:10:14.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:10:14 smithi044 ceph-mon[30624]: Health check update: 3 slow ops, oldest one blocked for 708 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:10:15.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:10:15 smithi064 ceph-mon[34420]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:10:15.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:10:15 smithi064 ceph-mon[34420]: { 2024-03-26T17:10:15.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:10:15 smithi064 ceph-mon[34420]: "prefix": "rbd perf image stats", 2024-03-26T17:10:15.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:10:15 smithi064 ceph-mon[34420]: "pool_spec": "mypool", 2024-03-26T17:10:15.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:10:15 smithi064 ceph-mon[34420]: "sort_by": "write_ops", 2024-03-26T17:10:15.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:10:15 smithi064 ceph-mon[34420]: "format": "json" 2024-03-26T17:10:15.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:10:15 smithi064 ceph-mon[34420]: }"]: dispatch 2024-03-26T17:10:15.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:10:15 smithi064 ceph-mon[34420]: pgmap v734: 33 pgs: 33 active+clean; 1.0 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 5.1 MiB/s rd, 5.0 MiB/s wr, 489 op/s 2024-03-26T17:10:15.395 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:10:15 smithi149 ceph-mon[34678]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:10:15.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:10:15 smithi149 ceph-mon[34678]: { 2024-03-26T17:10:15.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:10:15 smithi149 ceph-mon[34678]: "prefix": "rbd perf image stats", 2024-03-26T17:10:15.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:10:15 smithi149 ceph-mon[34678]: "pool_spec": "mypool", 2024-03-26T17:10:15.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:10:15 smithi149 ceph-mon[34678]: "sort_by": "write_ops", 2024-03-26T17:10:15.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:10:15 smithi149 ceph-mon[34678]: "format": "json" 2024-03-26T17:10:15.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:10:15 smithi149 ceph-mon[34678]: }"]: dispatch 2024-03-26T17:10:15.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:10:15 smithi149 ceph-mon[34678]: pgmap v734: 33 pgs: 33 active+clean; 1.0 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 5.1 MiB/s rd, 5.0 MiB/s wr, 489 op/s 2024-03-26T17:10:15.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:10:15 smithi044 ceph-mon[30624]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:10:15.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:10:15 smithi044 ceph-mon[30624]: { 2024-03-26T17:10:15.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:10:15 smithi044 ceph-mon[30624]: "prefix": "rbd perf image stats", 2024-03-26T17:10:15.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:10:15 smithi044 ceph-mon[30624]: "pool_spec": "mypool", 2024-03-26T17:10:15.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:10:15 smithi044 ceph-mon[30624]: "sort_by": "write_ops", 2024-03-26T17:10:15.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:10:15 smithi044 ceph-mon[30624]: "format": "json" 2024-03-26T17:10:15.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:10:15 smithi044 ceph-mon[30624]: }"]: dispatch 2024-03-26T17:10:15.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:10:15 smithi044 ceph-mon[30624]: pgmap v734: 33 pgs: 33 active+clean; 1.0 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 5.1 MiB/s rd, 5.0 MiB/s wr, 489 op/s 2024-03-26T17:10:16.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:10:15 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:10:15] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:10:16.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:10:15 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:10:15] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:10:16.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:10:15 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:10:16.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:10:15 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:10:15] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:10:16.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:10:15 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:10:15] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:10:16.147 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:10:15 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:10:16.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:10:16 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 2024-03-26T17:10:16.242+0000 7fa707a55700 -1 mon.c@1(peon) e3 get_health_metrics reporting 3 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T17:10:17.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:10:17 smithi064 ceph-mon[34420]: pgmap v735: 33 pgs: 33 active+clean; 1.0 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 5.1 MiB/s rd, 5.1 MiB/s wr, 492 op/s 2024-03-26T17:10:17.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:10:17 smithi149 ceph-mon[34678]: pgmap v735: 33 pgs: 33 active+clean; 1.0 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 5.1 MiB/s rd, 5.1 MiB/s wr, 492 op/s 2024-03-26T17:10:17.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:10:17 smithi044 ceph-mon[30624]: pgmap v735: 33 pgs: 33 active+clean; 1.0 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 5.1 MiB/s rd, 5.1 MiB/s wr, 492 op/s 2024-03-26T17:10:18.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:10:17 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:10:17] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:10:18.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:10:17 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:10:17] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:10:18.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:10:17 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:10:18.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:10:17 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:10:17] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:10:18.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:10:17 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:10:17] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:10:18.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:10:17 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:10:18.536 INFO:tasks.workunit.client.3.smithi157.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-26T17:10:18.536 INFO:tasks.workunit.client.3.smithi157.stdout:myimage13 5/s 3/s 106 KiB/s 66 KiB/s 2.68 ms 469.40 us 2024-03-26T17:10:18.536 INFO:tasks.workunit.client.3.smithi157.stdout:myimage14 5/s 2/s 105 KiB/s 53 KiB/s 3.17 ms 317.41 us 2024-03-26T17:10:18.536 INFO:tasks.workunit.client.3.smithi157.stdout:myimage17 5/s 3/s 128 KiB/s 67 KiB/s 2.98 ms 332.71 us 2024-03-26T17:10:18.536 INFO:tasks.workunit.client.3.smithi157.stdout:myimage20 5/s 3/s 97 KiB/s 64 KiB/s 2.85 ms 286.70 us 2024-03-26T17:10:18.536 INFO:tasks.workunit.client.3.smithi157.stdout:myimage28 5/s 1/s 112 KiB/s 60 KiB/s 3.78 ms 602.85 us 2024-03-26T17:10:18.536 INFO:tasks.workunit.client.3.smithi157.stdout:myimage7 5/s 3/s 70 KiB/s 44 KiB/s 2.87 ms 415.24 us 2024-03-26T17:10:18.536 INFO:tasks.workunit.client.3.smithi157.stdout:myimage36 5/s 3/s 107 KiB/s 93 KiB/s 2.69 ms 345.66 us 2024-03-26T17:10:18.536 INFO:tasks.workunit.client.3.smithi157.stdout:myimage42 5/s 3/s 97 KiB/s 61 KiB/s 2.78 ms 336.39 us 2024-03-26T17:10:18.536 INFO:tasks.workunit.client.3.smithi157.stdout:myimage56 5/s 2/s 127 KiB/s 56 KiB/s 3.71 ms 370.68 us 2024-03-26T17:10:18.536 INFO:tasks.workunit.client.3.smithi157.stdout:myimage33 4/s 3/s 106 KiB/s 71 KiB/s 2.86 ms 325.38 us 2024-03-26T17:10:18.537 INFO:tasks.workunit.client.3.smithi157.stdout:myimage38 4/s 3/s 102 KiB/s 78 KiB/s 2.25 ms 517.79 us 2024-03-26T17:10:18.537 INFO:tasks.workunit.client.3.smithi157.stdout:myimage48 4/s 4/s 90 KiB/s 73 KiB/s 3.22 ms 319.77 us 2024-03-26T17:10:18.537 INFO:tasks.workunit.client.3.smithi157.stdout:myimage53 4/s 2/s 116 KiB/s 62 KiB/s 2.80 ms 365.03 us 2024-03-26T17:10:18.537 INFO:tasks.workunit.client.3.smithi157.stdout:myimage2 4/s 4/s 88 KiB/s 64 KiB/s 2.92 ms 298.91 us 2024-03-26T17:10:18.537 INFO:tasks.workunit.client.3.smithi157.stdout:myimage32 4/s 2/s 105 KiB/s 65 KiB/s 3.07 ms 355.42 us 2024-03-26T17:10:18.537 INFO:tasks.workunit.client.3.smithi157.stdout:myimage5 4/s 3/s 87 KiB/s 101 KiB/s 2.65 ms 353.99 us 2024-03-26T17:10:18.537 INFO:tasks.workunit.client.3.smithi157.stdout:myimage15 4/s 4/s 88 KiB/s 63 KiB/s 2.81 ms 316.14 us 2024-03-26T17:10:18.537 INFO:tasks.workunit.client.3.smithi157.stdout:myimage21 4/s 4/s 102 KiB/s 87 KiB/s 3.97 ms 341.29 us 2024-03-26T17:10:18.537 INFO:tasks.workunit.client.3.smithi157.stdout:myimage27 4/s 4/s 94 KiB/s 108 KiB/s 2.63 ms 349.50 us 2024-03-26T17:10:18.537 INFO:tasks.workunit.client.3.smithi157.stdout:myimage45 4/s 3/s 114 KiB/s 59 KiB/s 2.94 ms 307.52 us 2024-03-26T17:10:18.537 INFO:tasks.workunit.client.3.smithi157.stdout:myimage54 4/s 2/s 70 KiB/s 29 KiB/s 2.56 ms 324.02 us 2024-03-26T17:10:18.537 INFO:tasks.workunit.client.3.smithi157.stdout:myimage3 4/s 3/s 62 KiB/s 59 KiB/s 2.51 ms 370.37 us 2024-03-26T17:10:18.538 INFO:tasks.workunit.client.3.smithi157.stdout:myimage47 4/s 3/s 111 KiB/s 66 KiB/s 3.35 ms 339.61 us 2024-03-26T17:10:18.538 INFO:tasks.workunit.client.3.smithi157.stdout:myimage24 4/s 4/s 62 KiB/s 119 KiB/s 2.90 ms 423.06 us 2024-03-26T17:10:18.538 INFO:tasks.workunit.client.3.smithi157.stdout:myimage50 4/s 3/s 76 KiB/s 55 KiB/s 3.22 ms 329.67 us 2024-03-26T17:10:18.538 INFO:tasks.workunit.client.3.smithi157.stdout:myimage51 4/s 3/s 89 KiB/s 70 KiB/s 3.06 ms 356.88 us 2024-03-26T17:10:18.538 INFO:tasks.workunit.client.3.smithi157.stdout:myimage37 3/s 3/s 79 KiB/s 83 KiB/s 2.89 ms 359.63 us 2024-03-26T17:10:18.538 INFO:tasks.workunit.client.3.smithi157.stdout:myimage40 3/s 3/s 66 KiB/s 68 KiB/s 2.63 ms 335.57 us 2024-03-26T17:10:18.538 INFO:tasks.workunit.client.3.smithi157.stdout:myimage52 3/s 4/s 74 KiB/s 109 KiB/s 3.41 ms 517.53 us 2024-03-26T17:10:18.538 INFO:tasks.workunit.client.3.smithi157.stdout:myimage8 3/s 3/s 86 KiB/s 66 KiB/s 3.01 ms 295.13 us 2024-03-26T17:10:18.538 INFO:tasks.workunit.client.3.smithi157.stdout:myimage26 3/s 5/s 87 KiB/s 99 KiB/s 2.84 ms 490.50 us 2024-03-26T17:10:18.538 INFO:tasks.workunit.client.3.smithi157.stdout:myimage43 3/s 4/s 82 KiB/s 92 KiB/s 3.12 ms 329.70 us 2024-03-26T17:10:18.538 INFO:tasks.workunit.client.3.smithi157.stdout:myimage16 3/s 4/s 61 KiB/s 128 KiB/s 2.82 ms 514.60 us 2024-03-26T17:10:18.538 INFO:tasks.workunit.client.3.smithi157.stdout:myimage9 3/s 3/s 81 KiB/s 88 KiB/s 3.12 ms 343.15 us 2024-03-26T17:10:18.538 INFO:tasks.workunit.client.3.smithi157.stdout:myimage12 3/s 3/s 88 KiB/s 83 KiB/s 2.72 ms 350.76 us 2024-03-26T17:10:18.539 INFO:tasks.workunit.client.3.smithi157.stdout:myimage19 3/s 3/s 71 KiB/s 61 KiB/s 2.83 ms 347.93 us 2024-03-26T17:10:18.539 INFO:tasks.workunit.client.3.smithi157.stdout:myimage25 3/s 4/s 66 KiB/s 88 KiB/s 3.55 ms 321.32 us 2024-03-26T17:10:18.539 INFO:tasks.workunit.client.3.smithi157.stdout:myimage10 3/s 4/s 60 KiB/s 86 KiB/s 2.85 ms 337.64 us 2024-03-26T17:10:18.539 INFO:tasks.workunit.client.3.smithi157.stdout:myimage23 3/s 3/s 82 KiB/s 70 KiB/s 2.31 ms 301.97 us 2024-03-26T17:10:18.539 INFO:tasks.workunit.client.3.smithi157.stdout:myimage49 3/s 3/s 82 KiB/s 80 KiB/s 2.79 ms 359.73 us 2024-03-26T17:10:18.539 INFO:tasks.workunit.client.3.smithi157.stdout:myimage1 3/s 3/s 61 KiB/s 60 KiB/s 2.61 ms 322.46 us 2024-03-26T17:10:18.539 INFO:tasks.workunit.client.3.smithi157.stdout:myimage4 3/s 5/s 64 KiB/s 91 KiB/s 2.89 ms 342.32 us 2024-03-26T17:10:18.539 INFO:tasks.workunit.client.3.smithi157.stdout:myimage6 3/s 3/s 74 KiB/s 63 KiB/s 3.38 ms 353.14 us 2024-03-26T17:10:18.539 INFO:tasks.workunit.client.3.smithi157.stdout:myimage11 3/s 3/s 62 KiB/s 70 KiB/s 2.77 ms 349.80 us 2024-03-26T17:10:18.539 INFO:tasks.workunit.client.3.smithi157.stdout:myimage57 3/s 4/s 70 KiB/s 81 KiB/s 3.06 ms 333.08 us 2024-03-26T17:10:18.539 INFO:tasks.workunit.client.3.smithi157.stdout:myimage59 3/s 4/s 61 KiB/s 102 KiB/s 3.33 ms 338.69 us 2024-03-26T17:10:18.539 INFO:tasks.workunit.client.3.smithi157.stdout:myimage31 3/s 4/s 76 KiB/s 106 KiB/s 2.87 ms 380.40 us 2024-03-26T17:10:18.539 INFO:tasks.workunit.client.3.smithi157.stdout:myimage34 3/s 3/s 67 KiB/s 75 KiB/s 2.67 ms 301.87 us 2024-03-26T17:10:18.539 INFO:tasks.workunit.client.3.smithi157.stdout:myimage44 3/s 4/s 50 KiB/s 96 KiB/s 2.91 ms 343.25 us 2024-03-26T17:10:18.539 INFO:tasks.workunit.client.3.smithi157.stdout:myimage18 3/s 4/s 80 KiB/s 79 KiB/s 2.83 ms 302.93 us 2024-03-26T17:10:18.540 INFO:tasks.workunit.client.3.smithi157.stdout:myimage29 3/s 3/s 62 KiB/s 56 KiB/s 2.73 ms 353.47 us 2024-03-26T17:10:18.540 INFO:tasks.workunit.client.3.smithi157.stdout:myimage39 3/s 3/s 86 KiB/s 62 KiB/s 2.65 ms 379.29 us 2024-03-26T17:10:18.540 INFO:tasks.workunit.client.3.smithi157.stdout:myimage41 3/s 4/s 65 KiB/s 83 KiB/s 2.97 ms 390.14 us 2024-03-26T17:10:18.540 INFO:tasks.workunit.client.3.smithi157.stdout:myimage60 3/s 4/s 58 KiB/s 86 KiB/s 3.07 ms 413.85 us 2024-03-26T17:10:18.540 INFO:tasks.workunit.client.3.smithi157.stdout:myimage22 3/s 5/s 62 KiB/s 85 KiB/s 3.18 ms 299.34 us 2024-03-26T17:10:18.540 INFO:tasks.workunit.client.3.smithi157.stdout:myimage30 3/s 3/s 66 KiB/s 89 KiB/s 3.71 ms 336.58 us 2024-03-26T17:10:18.540 INFO:tasks.workunit.client.3.smithi157.stdout:myimage35 2/s 3/s 74 KiB/s 87 KiB/s 2.86 ms 393.14 us 2024-03-26T17:10:18.540 INFO:tasks.workunit.client.3.smithi157.stdout:myimage58 2/s 3/s 42 KiB/s 66 KiB/s 2.56 ms 328.00 us 2024-03-26T17:10:18.540 INFO:tasks.workunit.client.3.smithi157.stdout:myimage46 2/s 4/s 47 KiB/s 77 KiB/s 2.77 ms 436.03 us 2024-03-26T17:10:18.540 INFO:tasks.workunit.client.3.smithi157.stdout:myimage55 2/s 4/s 52 KiB/s 78 KiB/s 3.18 ms 373.91 us 2024-03-26T17:10:18.540 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:10:19.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:10:19 smithi064 ceph-mon[34420]: pgmap v736: 33 pgs: 33 active+clean; 1.0 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 4.5 MiB/s rd, 4.4 MiB/s wr, 438 op/s 2024-03-26T17:10:19.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:10:19 smithi064 ceph-mon[34420]: Health check update: 3 slow ops, oldest one blocked for 713 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:10:19.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:10:19 smithi149 ceph-mon[34678]: pgmap v736: 33 pgs: 33 active+clean; 1.0 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 4.5 MiB/s rd, 4.4 MiB/s wr, 438 op/s 2024-03-26T17:10:19.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:10:19 smithi149 ceph-mon[34678]: Health check update: 3 slow ops, oldest one blocked for 713 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:10:19.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:10:19 smithi044 ceph-mon[30624]: pgmap v736: 33 pgs: 33 active+clean; 1.0 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 4.5 MiB/s rd, 4.4 MiB/s wr, 438 op/s 2024-03-26T17:10:19.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:10:19 smithi044 ceph-mon[30624]: Health check update: 3 slow ops, oldest one blocked for 713 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:10:20.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:10:19 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:10:19] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:10:20.017 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:10:19 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:10:19] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:10:20.017 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:10:19 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:10:20.050 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:10:19 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:10:19] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:10:20.050 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:10:19 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:10:19] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:10:20.050 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:10:19 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:10:20.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:10:20 smithi064 ceph-mon[34420]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:10:20.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:10:20 smithi064 ceph-mon[34420]: { 2024-03-26T17:10:20.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:10:20 smithi064 ceph-mon[34420]: "prefix": "rbd perf image stats", 2024-03-26T17:10:20.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:10:20 smithi064 ceph-mon[34420]: "pool_spec": "mypool", 2024-03-26T17:10:20.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:10:20 smithi064 ceph-mon[34420]: "sort_by": "write_ops", 2024-03-26T17:10:20.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:10:20 smithi064 ceph-mon[34420]: "format": "json" 2024-03-26T17:10:20.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:10:20 smithi064 ceph-mon[34420]: }"]: dispatch 2024-03-26T17:10:20.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:10:20 smithi149 ceph-mon[34678]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:10:20.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:10:20 smithi149 ceph-mon[34678]: { 2024-03-26T17:10:20.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:10:20 smithi149 ceph-mon[34678]: "prefix": "rbd perf image stats", 2024-03-26T17:10:20.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:10:20 smithi149 ceph-mon[34678]: "pool_spec": "mypool", 2024-03-26T17:10:20.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:10:20 smithi149 ceph-mon[34678]: "sort_by": "write_ops", 2024-03-26T17:10:20.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:10:20 smithi149 ceph-mon[34678]: "format": "json" 2024-03-26T17:10:20.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:10:20 smithi149 ceph-mon[34678]: }"]: dispatch 2024-03-26T17:10:20.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:10:20 smithi044 ceph-mon[30624]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:10:20.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:10:20 smithi044 ceph-mon[30624]: { 2024-03-26T17:10:20.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:10:20 smithi044 ceph-mon[30624]: "prefix": "rbd perf image stats", 2024-03-26T17:10:20.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:10:20 smithi044 ceph-mon[30624]: "pool_spec": "mypool", 2024-03-26T17:10:20.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:10:20 smithi044 ceph-mon[30624]: "sort_by": "write_ops", 2024-03-26T17:10:20.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:10:20 smithi044 ceph-mon[30624]: "format": "json" 2024-03-26T17:10:20.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:10:20 smithi044 ceph-mon[30624]: }"]: dispatch 2024-03-26T17:10:21.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:10:21 smithi064 ceph-mon[34420]: pgmap v737: 33 pgs: 33 active+clean; 1.0 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 4.8 MiB/s rd, 4.7 MiB/s wr, 470 op/s 2024-03-26T17:10:21.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:10:21 smithi149 ceph-mon[34678]: pgmap v737: 33 pgs: 33 active+clean; 1.0 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 4.8 MiB/s rd, 4.7 MiB/s wr, 470 op/s 2024-03-26T17:10:21.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:10:21 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 2024-03-26T17:10:21.242+0000 7fa707a55700 -1 mon.c@1(peon) e3 get_health_metrics reporting 3 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T17:10:21.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:10:21 smithi044 ceph-mon[30624]: pgmap v737: 33 pgs: 33 active+clean; 1.0 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 4.8 MiB/s rd, 4.7 MiB/s wr, 470 op/s 2024-03-26T17:10:22.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:10:21 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:10:21] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:10:22.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:10:21 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:10:21] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:10:22.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:10:21 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:10:22.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:10:21 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:10:21] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:10:22.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:10:21 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:10:21] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:10:22.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:10:21 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:10:23.063 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:10:23.070 INFO:tasks.workunit.client.3.smithi157.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2024-03-26T17:10:23.070 INFO:tasks.workunit.client.3.smithi157.stdout: 7.80 80.8k 44.0k 0.0k 808.0k 440.0k 0.0k nvme2n1 2024-03-26T17:10:23.070 INFO:tasks.workunit.client.3.smithi157.stdout: 7.70 86.4k 83.2k 0.0k 864.0k 832.0k 0.0k nvme2n10 2024-03-26T17:10:23.070 INFO:tasks.workunit.client.3.smithi157.stdout: 7.70 84.0k 84.4k 0.0k 840.0k 844.0k 0.0k nvme2n11 2024-03-26T17:10:23.070 INFO:tasks.workunit.client.3.smithi157.stdout: 7.70 82.0k 88.0k 0.0k 820.0k 880.0k 0.0k nvme2n12 2024-03-26T17:10:23.070 INFO:tasks.workunit.client.3.smithi157.stdout: 7.70 60.0k 96.4k 0.0k 600.0k 964.0k 0.0k nvme2n13 2024-03-26T17:10:23.071 INFO:tasks.workunit.client.3.smithi157.stdout: 7.70 80.8k 77.2k 0.0k 808.0k 772.0k 0.0k nvme2n14 2024-03-26T17:10:23.071 INFO:tasks.workunit.client.3.smithi157.stdout: 7.70 64.4k 70.4k 0.0k 644.0k 704.0k 0.0k nvme2n15 2024-03-26T17:10:23.071 INFO:tasks.workunit.client.3.smithi157.stdout: 7.70 94.4k 65.6k 0.0k 944.0k 656.0k 0.0k nvme2n16 2024-03-26T17:10:23.071 INFO:tasks.workunit.client.3.smithi157.stdout: 7.70 91.6k 61.2k 0.0k 916.0k 612.0k 0.0k nvme2n17 2024-03-26T17:10:23.071 INFO:tasks.workunit.client.3.smithi157.stdout: 7.70 62.8k 71.6k 0.0k 628.0k 716.0k 0.0k nvme2n18 2024-03-26T17:10:23.071 INFO:tasks.workunit.client.3.smithi157.stdout: 7.80 62.0k 89.6k 0.0k 620.0k 896.0k 0.0k nvme2n19 2024-03-26T17:10:23.071 INFO:tasks.workunit.client.3.smithi157.stdout: 7.80 66.4k 88.4k 0.0k 664.0k 884.0k 0.0k nvme2n2 2024-03-26T17:10:23.071 INFO:tasks.workunit.client.3.smithi157.stdout: 7.80 84.0k 74.8k 0.0k 840.0k 748.0k 0.0k nvme2n20 2024-03-26T17:10:23.071 INFO:tasks.workunit.client.3.smithi157.stdout: 7.80 76.4k 62.8k 0.0k 764.0k 628.0k 0.0k nvme2n3 2024-03-26T17:10:23.071 INFO:tasks.workunit.client.3.smithi157.stdout: 7.80 100.0k 66.4k 0.0k 1000.0k 664.0k 0.0k nvme2n4 2024-03-26T17:10:23.071 INFO:tasks.workunit.client.3.smithi157.stdout: 7.80 58.8k 96.8k 0.0k 588.0k 968.0k 0.0k nvme2n5 2024-03-26T17:10:23.071 INFO:tasks.workunit.client.3.smithi157.stdout: 7.80 81.2k 53.6k 0.0k 812.0k 536.0k 0.0k nvme2n6 2024-03-26T17:10:23.071 INFO:tasks.workunit.client.3.smithi157.stdout: 7.80 72.4k 68.0k 0.0k 724.0k 680.0k 0.0k nvme2n7 2024-03-26T17:10:23.072 INFO:tasks.workunit.client.3.smithi157.stdout: 7.80 67.6k 95.2k 0.0k 676.0k 952.0k 0.0k nvme2n8 2024-03-26T17:10:23.072 INFO:tasks.workunit.client.3.smithi157.stdout: 7.70 76.0k 79.6k 0.0k 760.0k 796.0k 0.0k nvme2n9 2024-03-26T17:10:23.072 INFO:tasks.workunit.client.3.smithi157.stdout: 7.80 81.6k 88.4k 0.0k 816.0k 884.0k 0.0k nvme5n1 2024-03-26T17:10:23.072 INFO:tasks.workunit.client.3.smithi157.stdout: 7.70 94.4k 83.6k 0.0k 944.0k 836.0k 0.0k nvme5n10 2024-03-26T17:10:23.072 INFO:tasks.workunit.client.3.smithi157.stdout: 7.70 78.8k 83.6k 0.0k 788.0k 836.0k 0.0k nvme5n11 2024-03-26T17:10:23.072 INFO:tasks.workunit.client.3.smithi157.stdout: 7.70 74.8k 102.8k 0.0k 748.0k 1.0M 0.0k nvme5n12 2024-03-26T17:10:23.072 INFO:tasks.workunit.client.3.smithi157.stdout: 7.70 82.4k 83.2k 0.0k 824.0k 832.0k 0.0k nvme5n13 2024-03-26T17:10:23.072 INFO:tasks.workunit.client.3.smithi157.stdout: 7.70 99.2k 60.4k 0.0k 992.0k 604.0k 0.0k nvme5n14 2024-03-26T17:10:23.072 INFO:tasks.workunit.client.3.smithi157.stdout: 7.70 104.8k 84.0k 0.0k 1.0M 840.0k 0.0k nvme5n15 2024-03-26T17:10:23.072 INFO:tasks.workunit.client.3.smithi157.stdout: 7.70 66.4k 86.4k 0.0k 664.0k 864.0k 0.0k nvme5n16 2024-03-26T17:10:23.072 INFO:tasks.workunit.client.3.smithi157.stdout: 7.70 70.0k 87.2k 0.0k 700.0k 872.0k 0.0k nvme5n17 2024-03-26T17:10:23.072 INFO:tasks.workunit.client.3.smithi157.stdout: 7.70 68.4k 97.2k 0.0k 684.0k 972.0k 0.0k nvme5n18 2024-03-26T17:10:23.072 INFO:tasks.workunit.client.3.smithi157.stdout: 7.80 88.8k 104.0k 0.0k 888.0k 1.0M 0.0k nvme5n19 2024-03-26T17:10:23.072 INFO:tasks.workunit.client.3.smithi157.stdout: 7.80 60.4k 89.6k 0.0k 604.0k 896.0k 0.0k nvme5n2 2024-03-26T17:10:23.073 INFO:tasks.workunit.client.3.smithi157.stdout: 7.80 93.2k 54.0k 0.0k 932.0k 540.0k 0.0k nvme5n20 2024-03-26T17:10:23.073 INFO:tasks.workunit.client.3.smithi157.stdout: 7.80 100.8k 67.6k 0.0k 1008.0k 676.0k 0.0k nvme5n3 2024-03-26T17:10:23.073 INFO:tasks.workunit.client.3.smithi157.stdout: 7.80 104.0k 74.8k 0.0k 1.0M 748.0k 0.0k nvme5n4 2024-03-26T17:10:23.073 INFO:tasks.workunit.client.3.smithi157.stdout: 7.80 74.4k 76.8k 0.0k 744.0k 768.0k 0.0k nvme5n5 2024-03-26T17:10:23.073 INFO:tasks.workunit.client.3.smithi157.stdout: 7.80 83.6k 74.4k 0.0k 836.0k 744.0k 0.0k nvme5n6 2024-03-26T17:10:23.073 INFO:tasks.workunit.client.3.smithi157.stdout: 7.80 77.6k 72.4k 0.0k 776.0k 724.0k 0.0k nvme5n7 2024-03-26T17:10:23.073 INFO:tasks.workunit.client.3.smithi157.stdout: 7.80 80.4k 96.4k 0.0k 804.0k 964.0k 0.0k nvme5n8 2024-03-26T17:10:23.073 INFO:tasks.workunit.client.3.smithi157.stdout: 7.70 69.2k 101.6k 0.0k 692.0k 1016.0k 0.0k nvme5n9 2024-03-26T17:10:23.073 INFO:tasks.workunit.client.3.smithi157.stdout: 7.80 80.8k 82.8k 0.0k 808.0k 828.0k 0.0k nvme8n1 2024-03-26T17:10:23.073 INFO:tasks.workunit.client.3.smithi157.stdout: 7.70 69.2k 70.4k 0.0k 692.0k 704.0k 0.0k nvme8n10 2024-03-26T17:10:23.073 INFO:tasks.workunit.client.3.smithi157.stdout: 7.70 72.0k 99.2k 0.0k 720.0k 992.0k 0.0k nvme8n11 2024-03-26T17:10:23.073 INFO:tasks.workunit.client.3.smithi157.stdout: 7.70 98.0k 60.0k 0.0k 980.0k 600.0k 0.0k nvme8n12 2024-03-26T17:10:23.073 INFO:tasks.workunit.client.3.smithi157.stdout: 7.70 125.6k 76.0k 0.0k 1.2M 760.0k 0.0k nvme8n13 2024-03-26T17:10:23.073 INFO:tasks.workunit.client.3.smithi157.stdout: 7.70 90.8k 59.2k 0.0k 908.0k 592.0k 0.0k nvme8n14 2024-03-26T17:10:23.073 INFO:tasks.workunit.client.3.smithi157.stdout: 7.70 70.0k 92.0k 0.0k 700.0k 920.0k 0.0k nvme8n15 2024-03-26T17:10:23.074 INFO:tasks.workunit.client.3.smithi157.stdout: 7.70 57.6k 104.4k 0.0k 576.0k 1.0M 0.0k nvme8n16 2024-03-26T17:10:23.074 INFO:tasks.workunit.client.3.smithi157.stdout: 7.70 67.2k 78.4k 0.0k 672.0k 784.0k 0.0k nvme8n17 2024-03-26T17:10:23.074 INFO:tasks.workunit.client.3.smithi157.stdout: 7.80 64.4k 83.6k 0.0k 644.0k 836.0k 0.0k nvme8n18 2024-03-26T17:10:23.074 INFO:tasks.workunit.client.3.smithi157.stdout: 7.80 90.8k 74.0k 0.0k 908.0k 740.0k 0.0k nvme8n19 2024-03-26T17:10:23.074 INFO:tasks.workunit.client.3.smithi157.stdout: 7.80 81.6k 88.0k 0.0k 816.0k 880.0k 0.0k nvme8n2 2024-03-26T17:10:23.074 INFO:tasks.workunit.client.3.smithi157.stdout: 7.80 74.0k 75.2k 0.0k 740.0k 752.0k 0.0k nvme8n20 2024-03-26T17:10:23.074 INFO:tasks.workunit.client.3.smithi157.stdout: 7.80 87.2k 85.6k 0.0k 872.0k 856.0k 0.0k nvme8n3 2024-03-26T17:10:23.074 INFO:tasks.workunit.client.3.smithi157.stdout: 7.80 81.2k 80.4k 0.0k 812.0k 804.0k 0.0k nvme8n4 2024-03-26T17:10:23.074 INFO:tasks.workunit.client.3.smithi157.stdout: 7.80 68.0k 87.2k 0.0k 680.0k 872.0k 0.0k nvme8n5 2024-03-26T17:10:23.074 INFO:tasks.workunit.client.3.smithi157.stdout: 7.80 82.8k 59.6k 0.0k 828.0k 596.0k 0.0k nvme8n6 2024-03-26T17:10:23.074 INFO:tasks.workunit.client.3.smithi157.stdout: 7.80 56.8k 72.0k 0.0k 568.0k 720.0k 0.0k nvme8n7 2024-03-26T17:10:23.074 INFO:tasks.workunit.client.3.smithi157.stdout: 7.70 72.0k 68.8k 0.0k 720.0k 688.0k 0.0k nvme8n8 2024-03-26T17:10:23.074 INFO:tasks.workunit.client.3.smithi157.stdout: 7.70 86.0k 80.4k 0.0k 860.0k 804.0k 0.0k nvme8n9 2024-03-26T17:10:23.075 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:10:23.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:10:23 smithi064 ceph-mon[34420]: pgmap v738: 33 pgs: 33 active+clean; 1.0 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 4.6 MiB/s rd, 4.6 MiB/s wr, 452 op/s 2024-03-26T17:10:23.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:10:23 smithi149 ceph-mon[34678]: pgmap v738: 33 pgs: 33 active+clean; 1.0 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 4.6 MiB/s rd, 4.6 MiB/s wr, 452 op/s 2024-03-26T17:10:23.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:10:23 smithi044 ceph-mon[30624]: pgmap v738: 33 pgs: 33 active+clean; 1.0 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 4.6 MiB/s rd, 4.6 MiB/s wr, 452 op/s 2024-03-26T17:10:23.539 INFO:tasks.workunit.client.3.smithi157.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-26T17:10:23.539 INFO:tasks.workunit.client.3.smithi157.stdout:myimage18 6/s 5/s 108 KiB/s 89 KiB/s 2.59 ms 455.12 us 2024-03-26T17:10:23.539 INFO:tasks.workunit.client.3.smithi157.stdout:myimage29 6/s 6/s 160 KiB/s 132 KiB/s 2.51 ms 372.04 us 2024-03-26T17:10:23.539 INFO:tasks.workunit.client.3.smithi157.stdout:myimage44 6/s 4/s 115 KiB/s 83 KiB/s 2.87 ms 348.91 us 2024-03-26T17:10:23.540 INFO:tasks.workunit.client.3.smithi157.stdout:myimage58 6/s 2/s 129 KiB/s 52 KiB/s 2.49 ms 373.56 us 2024-03-26T17:10:23.540 INFO:tasks.workunit.client.3.smithi157.stdout:myimage19 5/s 4/s 126 KiB/s 74 KiB/s 2.72 ms 354.20 us 2024-03-26T17:10:23.540 INFO:tasks.workunit.client.3.smithi157.stdout:myimage55 5/s 2/s 130 KiB/s 50 KiB/s 3.13 ms 370.96 us 2024-03-26T17:10:23.540 INFO:tasks.workunit.client.3.smithi157.stdout:myimage37 5/s 3/s 99 KiB/s 78 KiB/s 3.07 ms 377.53 us 2024-03-26T17:10:23.540 INFO:tasks.workunit.client.3.smithi157.stdout:myimage6 5/s 6/s 80 KiB/s 114 KiB/s 3.03 ms 362.30 us 2024-03-26T17:10:23.540 INFO:tasks.workunit.client.3.smithi157.stdout:myimage9 5/s 4/s 106 KiB/s 74 KiB/s 3.20 ms 331.90 us 2024-03-26T17:10:23.540 INFO:tasks.workunit.client.3.smithi157.stdout:myimage10 5/s 4/s 136 KiB/s 103 KiB/s 2.72 ms 341.45 us 2024-03-26T17:10:23.540 INFO:tasks.workunit.client.3.smithi157.stdout:myimage5 5/s 3/s 108 KiB/s 57 KiB/s 2.60 ms 313.91 us 2024-03-26T17:10:23.540 INFO:tasks.workunit.client.3.smithi157.stdout:myimage8 5/s 3/s 110 KiB/s 66 KiB/s 2.85 ms 392.61 us 2024-03-26T17:10:23.540 INFO:tasks.workunit.client.3.smithi157.stdout:myimage36 5/s 4/s 90 KiB/s 70 KiB/s 2.77 ms 365.98 us 2024-03-26T17:10:23.540 INFO:tasks.workunit.client.3.smithi157.stdout:myimage39 5/s 5/s 117 KiB/s 122 KiB/s 2.67 ms 327.17 us 2024-03-26T17:10:23.540 INFO:tasks.workunit.client.3.smithi157.stdout:myimage41 5/s 3/s 114 KiB/s 80 KiB/s 2.93 ms 324.96 us 2024-03-26T17:10:23.540 INFO:tasks.workunit.client.3.smithi157.stdout:myimage48 4/s 3/s 78 KiB/s 75 KiB/s 3.06 ms 566.33 us 2024-03-26T17:10:23.540 INFO:tasks.workunit.client.3.smithi157.stdout:myimage15 4/s 3/s 75 KiB/s 73 KiB/s 2.25 ms 434.59 us 2024-03-26T17:10:23.541 INFO:tasks.workunit.client.3.smithi157.stdout:myimage45 4/s 3/s 82 KiB/s 69 KiB/s 2.75 ms 325.08 us 2024-03-26T17:10:23.541 INFO:tasks.workunit.client.3.smithi157.stdout:myimage56 4/s 3/s 106 KiB/s 55 KiB/s 3.34 ms 434.70 us 2024-03-26T17:10:23.541 INFO:tasks.workunit.client.3.smithi157.stdout:myimage21 4/s 4/s 89 KiB/s 98 KiB/s 3.47 ms 382.17 us 2024-03-26T17:10:23.541 INFO:tasks.workunit.client.3.smithi157.stdout:myimage27 4/s 6/s 82 KiB/s 111 KiB/s 2.55 ms 342.26 us 2024-03-26T17:10:23.541 INFO:tasks.workunit.client.3.smithi157.stdout:myimage33 4/s 2/s 86 KiB/s 70 KiB/s 3.35 ms 339.47 us 2024-03-26T17:10:23.541 INFO:tasks.workunit.client.3.smithi157.stdout:myimage46 4/s 5/s 74 KiB/s 107 KiB/s 2.62 ms 336.77 us 2024-03-26T17:10:23.541 INFO:tasks.workunit.client.3.smithi157.stdout:myimage32 4/s 5/s 136 KiB/s 103 KiB/s 2.92 ms 389.74 us 2024-03-26T17:10:23.541 INFO:tasks.workunit.client.3.smithi157.stdout:myimage38 4/s 4/s 101 KiB/s 94 KiB/s 2.49 ms 361.40 us 2024-03-26T17:10:23.541 INFO:tasks.workunit.client.3.smithi157.stdout:myimage49 4/s 3/s 71 KiB/s 90 KiB/s 2.96 ms 453.03 us 2024-03-26T17:10:23.541 INFO:tasks.workunit.client.3.smithi157.stdout:myimage7 4/s 2/s 81 KiB/s 70 KiB/s 3.09 ms 338.66 us 2024-03-26T17:10:23.541 INFO:tasks.workunit.client.3.smithi157.stdout:myimage26 4/s 3/s 74 KiB/s 84 KiB/s 2.77 ms 326.85 us 2024-03-26T17:10:23.541 INFO:tasks.workunit.client.3.smithi157.stdout:myimage28 4/s 3/s 90 KiB/s 71 KiB/s 3.85 ms 357.14 us 2024-03-26T17:10:23.541 INFO:tasks.workunit.client.3.smithi157.stdout:myimage43 4/s 3/s 90 KiB/s 80 KiB/s 3.07 ms 392.33 us 2024-03-26T17:10:23.541 INFO:tasks.workunit.client.3.smithi157.stdout:myimage57 4/s 4/s 93 KiB/s 84 KiB/s 2.81 ms 372.04 us 2024-03-26T17:10:23.542 INFO:tasks.workunit.client.3.smithi157.stdout:myimage35 4/s 5/s 101 KiB/s 132 KiB/s 2.73 ms 332.42 us 2024-03-26T17:10:23.542 INFO:tasks.workunit.client.3.smithi157.stdout:myimage12 4/s 4/s 86 KiB/s 86 KiB/s 3.01 ms 378.17 us 2024-03-26T17:10:23.542 INFO:tasks.workunit.client.3.smithi157.stdout:myimage42 4/s 4/s 100 KiB/s 118 KiB/s 2.74 ms 386.01 us 2024-03-26T17:10:23.542 INFO:tasks.workunit.client.3.smithi157.stdout:myimage60 4/s 3/s 86 KiB/s 59 KiB/s 3.21 ms 338.72 us 2024-03-26T17:10:23.542 INFO:tasks.workunit.client.3.smithi157.stdout:myimage16 4/s 5/s 66 KiB/s 108 KiB/s 2.99 ms 318.73 us 2024-03-26T17:10:23.542 INFO:tasks.workunit.client.3.smithi157.stdout:myimage4 4/s 5/s 69 KiB/s 151 KiB/s 2.77 ms 377.10 us 2024-03-26T17:10:23.542 INFO:tasks.workunit.client.3.smithi157.stdout:myimage25 4/s 4/s 89 KiB/s 68 KiB/s 3.60 ms 358.73 us 2024-03-26T17:10:23.542 INFO:tasks.workunit.client.3.smithi157.stdout:myimage40 3/s 5/s 51 KiB/s 101 KiB/s 2.64 ms 343.76 us 2024-03-26T17:10:23.542 INFO:tasks.workunit.client.3.smithi157.stdout:myimage47 3/s 3/s 51 KiB/s 52 KiB/s 2.98 ms 353.20 us 2024-03-26T17:10:23.542 INFO:tasks.workunit.client.3.smithi157.stdout:myimage1 3/s 5/s 52 KiB/s 91 KiB/s 2.53 ms 320.78 us 2024-03-26T17:10:23.542 INFO:tasks.workunit.client.3.smithi157.stdout:myimage24 3/s 3/s 83 KiB/s 68 KiB/s 2.86 ms 349.96 us 2024-03-26T17:10:23.542 INFO:tasks.workunit.client.3.smithi157.stdout:myimage51 3/s 3/s 92 KiB/s 88 KiB/s 3.16 ms 344.41 us 2024-03-26T17:10:23.542 INFO:tasks.workunit.client.3.smithi157.stdout:myimage53 3/s 5/s 83 KiB/s 147 KiB/s 2.82 ms 463.24 us 2024-03-26T17:10:23.542 INFO:tasks.workunit.client.3.smithi157.stdout:myimage2 3/s 3/s 74 KiB/s 74 KiB/s 2.90 ms 355.55 us 2024-03-26T17:10:23.542 INFO:tasks.workunit.client.3.smithi157.stdout:myimage3 3/s 4/s 74 KiB/s 89 KiB/s 2.72 ms 320.90 us 2024-03-26T17:10:23.543 INFO:tasks.workunit.client.3.smithi157.stdout:myimage30 3/s 4/s 92 KiB/s 104 KiB/s 4.12 ms 318.13 us 2024-03-26T17:10:23.543 INFO:tasks.workunit.client.3.smithi157.stdout:myimage31 3/s 3/s 86 KiB/s 70 KiB/s 3.12 ms 321.05 us 2024-03-26T17:10:23.543 INFO:tasks.workunit.client.3.smithi157.stdout:myimage59 3/s 5/s 98 KiB/s 102 KiB/s 2.74 ms 349.88 us 2024-03-26T17:10:23.543 INFO:tasks.workunit.client.3.smithi157.stdout:myimage13 3/s 3/s 81 KiB/s 76 KiB/s 2.71 ms 329.03 us 2024-03-26T17:10:23.543 INFO:tasks.workunit.client.3.smithi157.stdout:myimage14 3/s 4/s 74 KiB/s 94 KiB/s 3.24 ms 361.12 us 2024-03-26T17:10:23.543 INFO:tasks.workunit.client.3.smithi157.stdout:myimage34 3/s 4/s 75 KiB/s 100 KiB/s 2.32 ms 305.92 us 2024-03-26T17:10:23.543 INFO:tasks.workunit.client.3.smithi157.stdout:myimage11 3/s 5/s 87 KiB/s 128 KiB/s 3.15 ms 371.66 us 2024-03-26T17:10:23.543 INFO:tasks.workunit.client.3.smithi157.stdout:myimage22 3/s 2/s 58 KiB/s 38 KiB/s 3.00 ms 266.62 us 2024-03-26T17:10:23.543 INFO:tasks.workunit.client.3.smithi157.stdout:myimage23 3/s 5/s 63 KiB/s 139 KiB/s 2.43 ms 338.97 us 2024-03-26T17:10:23.543 INFO:tasks.workunit.client.3.smithi157.stdout:myimage50 3/s 4/s 44 KiB/s 75 KiB/s 2.96 ms 377.07 us 2024-03-26T17:10:23.543 INFO:tasks.workunit.client.3.smithi157.stdout:myimage52 2/s 4/s 42 KiB/s 108 KiB/s 3.50 ms 326.86 us 2024-03-26T17:10:23.543 INFO:tasks.workunit.client.3.smithi157.stdout:myimage20 2/s 4/s 62 KiB/s 101 KiB/s 2.85 ms 372.20 us 2024-03-26T17:10:23.543 INFO:tasks.workunit.client.3.smithi157.stdout:myimage17 2/s 4/s 48 KiB/s 105 KiB/s 3.15 ms 333.52 us 2024-03-26T17:10:23.543 INFO:tasks.workunit.client.3.smithi157.stdout:myimage54 2/s 5/s 56 KiB/s 110 KiB/s 2.87 ms 369.15 us 2024-03-26T17:10:23.543 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:10:24.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:10:23 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:10:23] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:10:24.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:10:23 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:10:23] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:10:24.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:10:23 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:10:24.146 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:10:24 smithi149 ceph-mon[34678]: Health check update: 3 slow ops, oldest one blocked for 718 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:10:24.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:10:23 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:10:23] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:10:24.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:10:23 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:10:23] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:10:24.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:10:23 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:10:24.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:10:24 smithi044 ceph-mon[30624]: Health check update: 3 slow ops, oldest one blocked for 718 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:10:24.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:10:24 smithi064 ceph-mon[34420]: Health check update: 3 slow ops, oldest one blocked for 718 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:10:25.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:10:25 smithi064 ceph-mon[34420]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:10:25.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:10:25 smithi064 ceph-mon[34420]: { 2024-03-26T17:10:25.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:10:25 smithi064 ceph-mon[34420]: "prefix": "rbd perf image stats", 2024-03-26T17:10:25.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:10:25 smithi064 ceph-mon[34420]: "pool_spec": "mypool", 2024-03-26T17:10:25.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:10:25 smithi064 ceph-mon[34420]: "sort_by": "write_ops", 2024-03-26T17:10:25.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:10:25 smithi064 ceph-mon[34420]: "format": "json" 2024-03-26T17:10:25.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:10:25 smithi064 ceph-mon[34420]: }"]: dispatch 2024-03-26T17:10:25.306 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:10:25 smithi064 ceph-mon[34420]: pgmap v739: 33 pgs: 33 active+clean; 1.0 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 4.9 MiB/s rd, 4.8 MiB/s wr, 486 op/s 2024-03-26T17:10:25.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:10:25 smithi149 ceph-mon[34678]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:10:25.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:10:25 smithi149 ceph-mon[34678]: { 2024-03-26T17:10:25.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:10:25 smithi149 ceph-mon[34678]: "prefix": "rbd perf image stats", 2024-03-26T17:10:25.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:10:25 smithi149 ceph-mon[34678]: "pool_spec": "mypool", 2024-03-26T17:10:25.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:10:25 smithi149 ceph-mon[34678]: "sort_by": "write_ops", 2024-03-26T17:10:25.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:10:25 smithi149 ceph-mon[34678]: "format": "json" 2024-03-26T17:10:25.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:10:25 smithi149 ceph-mon[34678]: }"]: dispatch 2024-03-26T17:10:25.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:10:25 smithi149 ceph-mon[34678]: pgmap v739: 33 pgs: 33 active+clean; 1.0 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 4.9 MiB/s rd, 4.8 MiB/s wr, 486 op/s 2024-03-26T17:10:25.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:10:25 smithi044 ceph-mon[30624]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:10:25.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:10:25 smithi044 ceph-mon[30624]: { 2024-03-26T17:10:25.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:10:25 smithi044 ceph-mon[30624]: "prefix": "rbd perf image stats", 2024-03-26T17:10:25.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:10:25 smithi044 ceph-mon[30624]: "pool_spec": "mypool", 2024-03-26T17:10:25.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:10:25 smithi044 ceph-mon[30624]: "sort_by": "write_ops", 2024-03-26T17:10:25.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:10:25 smithi044 ceph-mon[30624]: "format": "json" 2024-03-26T17:10:25.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:10:25 smithi044 ceph-mon[30624]: }"]: dispatch 2024-03-26T17:10:25.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:10:25 smithi044 ceph-mon[30624]: pgmap v739: 33 pgs: 33 active+clean; 1.0 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 4.9 MiB/s rd, 4.8 MiB/s wr, 486 op/s 2024-03-26T17:10:26.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:10:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:10:25] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:10:26.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:10:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:10:25] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:10:26.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:10:25 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:10:26.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:10:25 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:10:25] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:10:26.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:10:25 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:10:25] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:10:26.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:10:25 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:10:26.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:10:26 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 2024-03-26T17:10:26.242+0000 7fa707a55700 -1 mon.c@1(peon) e3 get_health_metrics reporting 3 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T17:10:27.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:10:27 smithi149 ceph-mon[34678]: pgmap v740: 33 pgs: 33 active+clean; 1.0 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 4.9 MiB/s rd, 4.9 MiB/s wr, 491 op/s 2024-03-26T17:10:27.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:10:27 smithi044 ceph-mon[30624]: pgmap v740: 33 pgs: 33 active+clean; 1.0 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 4.9 MiB/s rd, 4.9 MiB/s wr, 491 op/s 2024-03-26T17:10:27.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:10:27 smithi064 ceph-mon[34420]: pgmap v740: 33 pgs: 33 active+clean; 1.0 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 4.9 MiB/s rd, 4.9 MiB/s wr, 491 op/s 2024-03-26T17:10:28.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:10:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:10:27] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:10:28.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:10:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:10:27] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:10:28.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:10:27 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:10:28.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:10:27 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:10:27] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:10:28.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:10:27 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:10:27] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:10:28.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:10:27 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:10:28.543 INFO:tasks.workunit.client.3.smithi157.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-26T17:10:28.543 INFO:tasks.workunit.client.3.smithi157.stdout:myimage2 5/s 3/s 114 KiB/s 45 KiB/s 3.60 ms 348.47 us 2024-03-26T17:10:28.544 INFO:tasks.workunit.client.3.smithi157.stdout:myimage13 5/s 2/s 102 KiB/s 46 KiB/s 2.52 ms 320.23 us 2024-03-26T17:10:28.544 INFO:tasks.workunit.client.3.smithi157.stdout:myimage47 5/s 2/s 93 KiB/s 51 KiB/s 3.14 ms 345.81 us 2024-03-26T17:10:28.544 INFO:tasks.workunit.client.3.smithi157.stdout:myimage50 5/s 3/s 106 KiB/s 56 KiB/s 2.88 ms 354.36 us 2024-03-26T17:10:28.544 INFO:tasks.workunit.client.3.smithi157.stdout:myimage49 5/s 3/s 82 KiB/s 73 KiB/s 2.87 ms 328.60 us 2024-03-26T17:10:28.544 INFO:tasks.workunit.client.3.smithi157.stdout:myimage17 5/s 3/s 62 KiB/s 62 KiB/s 3.01 ms 316.83 us 2024-03-26T17:10:28.544 INFO:tasks.workunit.client.3.smithi157.stdout:myimage42 5/s 2/s 95 KiB/s 37 KiB/s 2.89 ms 325.88 us 2024-03-26T17:10:28.544 INFO:tasks.workunit.client.3.smithi157.stdout:myimage38 4/s 2/s 67 KiB/s 40 KiB/s 2.47 ms 288.36 us 2024-03-26T17:10:28.544 INFO:tasks.workunit.client.3.smithi157.stdout:myimage52 4/s 4/s 93 KiB/s 82 KiB/s 2.99 ms 341.13 us 2024-03-26T17:10:28.544 INFO:tasks.workunit.client.3.smithi157.stdout:myimage15 4/s 2/s 93 KiB/s 58 KiB/s 2.27 ms 349.59 us 2024-03-26T17:10:28.544 INFO:tasks.workunit.client.3.smithi157.stdout:myimage20 4/s 3/s 79 KiB/s 63 KiB/s 2.69 ms 332.41 us 2024-03-26T17:10:28.544 INFO:tasks.workunit.client.3.smithi157.stdout:myimage51 4/s 4/s 81 KiB/s 69 KiB/s 3.29 ms 408.04 us 2024-03-26T17:10:28.544 INFO:tasks.workunit.client.3.smithi157.stdout:myimage59 4/s 3/s 95 KiB/s 71 KiB/s 3.23 ms 502.30 us 2024-03-26T17:10:28.544 INFO:tasks.workunit.client.3.smithi157.stdout:myimage22 4/s 3/s 94 KiB/s 80 KiB/s 3.54 ms 432.39 us 2024-03-26T17:10:28.544 INFO:tasks.workunit.client.3.smithi157.stdout:myimage48 4/s 3/s 78 KiB/s 63 KiB/s 2.82 ms 344.64 us 2024-03-26T17:10:28.544 INFO:tasks.workunit.client.3.smithi157.stdout:myimage56 4/s 3/s 82 KiB/s 83 KiB/s 3.57 ms 397.16 us 2024-03-26T17:10:28.545 INFO:tasks.workunit.client.3.smithi157.stdout:myimage4 4/s 2/s 70 KiB/s 44 KiB/s 2.74 ms 442.50 us 2024-03-26T17:10:28.545 INFO:tasks.workunit.client.3.smithi157.stdout:myimage18 4/s 3/s 70 KiB/s 61 KiB/s 2.61 ms 305.17 us 2024-03-26T17:10:28.545 INFO:tasks.workunit.client.3.smithi157.stdout:myimage33 4/s 3/s 77 KiB/s 74 KiB/s 3.12 ms 345.20 us 2024-03-26T17:10:28.545 INFO:tasks.workunit.client.3.smithi157.stdout:myimage43 4/s 4/s 104 KiB/s 104 KiB/s 3.01 ms 398.72 us 2024-03-26T17:10:28.545 INFO:tasks.workunit.client.3.smithi157.stdout:myimage40 4/s 3/s 82 KiB/s 67 KiB/s 2.70 ms 353.64 us 2024-03-26T17:10:28.545 INFO:tasks.workunit.client.3.smithi157.stdout:myimage5 4/s 3/s 62 KiB/s 58 KiB/s 2.67 ms 433.56 us 2024-03-26T17:10:28.545 INFO:tasks.workunit.client.3.smithi157.stdout:myimage24 4/s 3/s 114 KiB/s 102 KiB/s 3.14 ms 358.74 us 2024-03-26T17:10:28.545 INFO:tasks.workunit.client.3.smithi157.stdout:myimage57 4/s 3/s 75 KiB/s 62 KiB/s 3.14 ms 327.50 us 2024-03-26T17:10:28.545 INFO:tasks.workunit.client.3.smithi157.stdout:myimage3 4/s 3/s 73 KiB/s 54 KiB/s 2.36 ms 321.93 us 2024-03-26T17:10:28.545 INFO:tasks.workunit.client.3.smithi157.stdout:myimage32 4/s 3/s 65 KiB/s 68 KiB/s 3.03 ms 329.08 us 2024-03-26T17:10:28.545 INFO:tasks.workunit.client.3.smithi157.stdout:myimage8 4/s 3/s 69 KiB/s 80 KiB/s 3.14 ms 432.61 us 2024-03-26T17:10:28.545 INFO:tasks.workunit.client.3.smithi157.stdout:myimage36 4/s 3/s 75 KiB/s 85 KiB/s 2.78 ms 333.13 us 2024-03-26T17:10:28.545 INFO:tasks.workunit.client.3.smithi157.stdout:myimage41 4/s 3/s 94 KiB/s 63 KiB/s 3.01 ms 342.59 us 2024-03-26T17:10:28.545 INFO:tasks.workunit.client.3.smithi157.stdout:myimage45 4/s 4/s 83 KiB/s 75 KiB/s 2.97 ms 288.33 us 2024-03-26T17:10:28.545 INFO:tasks.workunit.client.3.smithi157.stdout:myimage53 4/s 3/s 99 KiB/s 99 KiB/s 2.53 ms 305.66 us 2024-03-26T17:10:28.545 INFO:tasks.workunit.client.3.smithi157.stdout:myimage10 4/s 3/s 65 KiB/s 72 KiB/s 2.72 ms 400.11 us 2024-03-26T17:10:28.546 INFO:tasks.workunit.client.3.smithi157.stdout:myimage11 3/s 3/s 80 KiB/s 78 KiB/s 2.96 ms 369.10 us 2024-03-26T17:10:28.546 INFO:tasks.workunit.client.3.smithi157.stdout:myimage19 3/s 3/s 86 KiB/s 74 KiB/s 3.04 ms 418.81 us 2024-03-26T17:10:28.546 INFO:tasks.workunit.client.3.smithi157.stdout:myimage28 3/s 4/s 71 KiB/s 89 KiB/s 3.74 ms 378.62 us 2024-03-26T17:10:28.546 INFO:tasks.workunit.client.3.smithi157.stdout:myimage60 3/s 3/s 82 KiB/s 58 KiB/s 3.20 ms 322.76 us 2024-03-26T17:10:28.546 INFO:tasks.workunit.client.3.smithi157.stdout:myimage16 3/s 4/s 78 KiB/s 90 KiB/s 2.84 ms 333.24 us 2024-03-26T17:10:28.546 INFO:tasks.workunit.client.3.smithi157.stdout:myimage34 3/s 3/s 73 KiB/s 81 KiB/s 2.42 ms 287.61 us 2024-03-26T17:10:28.546 INFO:tasks.workunit.client.3.smithi157.stdout:myimage12 3/s 4/s 79 KiB/s 93 KiB/s 2.88 ms 409.55 us 2024-03-26T17:10:28.546 INFO:tasks.workunit.client.3.smithi157.stdout:myimage21 3/s 3/s 60 KiB/s 69 KiB/s 3.89 ms 500.17 us 2024-03-26T17:10:28.546 INFO:tasks.workunit.client.3.smithi157.stdout:myimage44 3/s 3/s 66 KiB/s 69 KiB/s 3.02 ms 330.99 us 2024-03-26T17:10:28.546 INFO:tasks.workunit.client.3.smithi157.stdout:myimage26 3/s 4/s 82 KiB/s 70 KiB/s 3.09 ms 333.20 us 2024-03-26T17:10:28.546 INFO:tasks.workunit.client.3.smithi157.stdout:myimage27 3/s 3/s 57 KiB/s 79 KiB/s 2.54 ms 433.56 us 2024-03-26T17:10:28.546 INFO:tasks.workunit.client.3.smithi157.stdout:myimage46 3/s 4/s 70 KiB/s 72 KiB/s 2.94 ms 428.66 us 2024-03-26T17:10:28.546 INFO:tasks.workunit.client.3.smithi157.stdout:myimage55 3/s 4/s 94 KiB/s 98 KiB/s 3.00 ms 359.68 us 2024-03-26T17:10:28.546 INFO:tasks.workunit.client.3.smithi157.stdout:myimage14 3/s 4/s 75 KiB/s 90 KiB/s 2.87 ms 429.15 us 2024-03-26T17:10:28.547 INFO:tasks.workunit.client.3.smithi157.stdout:myimage35 3/s 4/s 74 KiB/s 86 KiB/s 2.64 ms 318.44 us 2024-03-26T17:10:28.547 INFO:tasks.workunit.client.3.smithi157.stdout:myimage23 3/s 3/s 46 KiB/s 84 KiB/s 2.41 ms 307.68 us 2024-03-26T17:10:28.547 INFO:tasks.workunit.client.3.smithi157.stdout:myimage30 3/s 5/s 57 KiB/s 89 KiB/s 3.96 ms 402.07 us 2024-03-26T17:10:28.547 INFO:tasks.workunit.client.3.smithi157.stdout:myimage37 3/s 3/s 54 KiB/s 70 KiB/s 3.23 ms 337.93 us 2024-03-26T17:10:28.547 INFO:tasks.workunit.client.3.smithi157.stdout:myimage6 3/s 4/s 42 KiB/s 81 KiB/s 3.15 ms 314.84 us 2024-03-26T17:10:28.547 INFO:tasks.workunit.client.3.smithi157.stdout:myimage7 3/s 5/s 62 KiB/s 106 KiB/s 2.85 ms 365.53 us 2024-03-26T17:10:28.547 INFO:tasks.workunit.client.3.smithi157.stdout:myimage25 3/s 4/s 53 KiB/s 87 KiB/s 4.67 ms 374.84 us 2024-03-26T17:10:28.547 INFO:tasks.workunit.client.3.smithi157.stdout:myimage31 2/s 5/s 46 KiB/s 101 KiB/s 2.85 ms 330.28 us 2024-03-26T17:10:28.547 INFO:tasks.workunit.client.3.smithi157.stdout:myimage58 2/s 4/s 46 KiB/s 59 KiB/s 2.81 ms 311.57 us 2024-03-26T17:10:28.547 INFO:tasks.workunit.client.3.smithi157.stdout:myimage1 2/s 4/s 37 KiB/s 67 KiB/s 2.48 ms 321.27 us 2024-03-26T17:10:28.547 INFO:tasks.workunit.client.3.smithi157.stdout:myimage29 2/s 4/s 62 KiB/s 84 KiB/s 2.63 ms 339.20 us 2024-03-26T17:10:28.547 INFO:tasks.workunit.client.3.smithi157.stdout:myimage54 2/s 4/s 41 KiB/s 91 KiB/s 2.67 ms 333.00 us 2024-03-26T17:10:28.547 INFO:tasks.workunit.client.3.smithi157.stdout:myimage39 2/s 5/s 57 KiB/s 101 KiB/s 2.60 ms 436.13 us 2024-03-26T17:10:28.547 INFO:tasks.workunit.client.3.smithi157.stdout:myimage9 2/s 4/s 39 KiB/s 91 KiB/s 3.09 ms 443.68 us 2024-03-26T17:10:28.547 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:10:29.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:10:29 smithi149 ceph-mon[34678]: pgmap v741: 33 pgs: 33 active+clean; 1.0 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 4.4 MiB/s rd, 4.3 MiB/s wr, 442 op/s 2024-03-26T17:10:29.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:10:29 smithi149 ceph-mon[34678]: Health check update: 3 slow ops, oldest one blocked for 723 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:10:29.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:10:29 smithi044 ceph-mon[30624]: pgmap v741: 33 pgs: 33 active+clean; 1.0 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 4.4 MiB/s rd, 4.3 MiB/s wr, 442 op/s 2024-03-26T17:10:29.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:10:29 smithi044 ceph-mon[30624]: Health check update: 3 slow ops, oldest one blocked for 723 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:10:29.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:10:29 smithi064 ceph-mon[34420]: pgmap v741: 33 pgs: 33 active+clean; 1.0 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 4.4 MiB/s rd, 4.3 MiB/s wr, 442 op/s 2024-03-26T17:10:29.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:10:29 smithi064 ceph-mon[34420]: Health check update: 3 slow ops, oldest one blocked for 723 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:10:30.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:10:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:10:29] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:10:30.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:10:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:10:29] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:10:30.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:10:29 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:10:30.146 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:10:30 smithi149 ceph-mon[34678]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:10:30.146 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:10:30 smithi149 ceph-mon[34678]: { 2024-03-26T17:10:30.146 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:10:30 smithi149 ceph-mon[34678]: "prefix": "rbd perf image stats", 2024-03-26T17:10:30.146 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:10:30 smithi149 ceph-mon[34678]: "pool_spec": "mypool", 2024-03-26T17:10:30.146 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:10:30 smithi149 ceph-mon[34678]: "sort_by": "write_ops", 2024-03-26T17:10:30.146 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:10:30 smithi149 ceph-mon[34678]: "format": "json" 2024-03-26T17:10:30.146 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:10:30 smithi149 ceph-mon[34678]: }"]: dispatch 2024-03-26T17:10:30.147 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:10:29 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:10:29] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:10:30.147 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:10:29 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:10:29] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:10:30.147 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:10:29 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:10:30.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:10:30 smithi044 ceph-mon[30624]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:10:30.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:10:30 smithi044 ceph-mon[30624]: { 2024-03-26T17:10:30.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:10:30 smithi044 ceph-mon[30624]: "prefix": "rbd perf image stats", 2024-03-26T17:10:30.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:10:30 smithi044 ceph-mon[30624]: "pool_spec": "mypool", 2024-03-26T17:10:30.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:10:30 smithi044 ceph-mon[30624]: "sort_by": "write_ops", 2024-03-26T17:10:30.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:10:30 smithi044 ceph-mon[30624]: "format": "json" 2024-03-26T17:10:30.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:10:30 smithi044 ceph-mon[30624]: }"]: dispatch 2024-03-26T17:10:30.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:10:30 smithi064 ceph-mon[34420]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:10:30.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:10:30 smithi064 ceph-mon[34420]: { 2024-03-26T17:10:30.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:10:30 smithi064 ceph-mon[34420]: "prefix": "rbd perf image stats", 2024-03-26T17:10:30.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:10:30 smithi064 ceph-mon[34420]: "pool_spec": "mypool", 2024-03-26T17:10:30.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:10:30 smithi064 ceph-mon[34420]: "sort_by": "write_ops", 2024-03-26T17:10:30.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:10:30 smithi064 ceph-mon[34420]: "format": "json" 2024-03-26T17:10:30.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:10:30 smithi064 ceph-mon[34420]: }"]: dispatch 2024-03-26T17:10:31.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:10:31 smithi149 ceph-mon[34678]: pgmap v742: 33 pgs: 33 active+clean; 1.0 GiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 4.6 MiB/s rd, 4.5 MiB/s wr, 467 op/s 2024-03-26T17:10:31.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:10:31 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 2024-03-26T17:10:31.242+0000 7fa707a55700 -1 mon.c@1(peon) e3 get_health_metrics reporting 3 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T17:10:31.514 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:10:31 smithi044 ceph-mon[30624]: pgmap v742: 33 pgs: 33 active+clean; 1.0 GiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 4.6 MiB/s rd, 4.5 MiB/s wr, 467 op/s 2024-03-26T17:10:31.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:10:31 smithi064 ceph-mon[34420]: pgmap v742: 33 pgs: 33 active+clean; 1.0 GiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 4.6 MiB/s rd, 4.5 MiB/s wr, 467 op/s 2024-03-26T17:10:32.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:10:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:10:31] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:10:32.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:10:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:10:31] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:10:32.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:10:31 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:10:32.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:10:31 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:10:31] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:10:32.147 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:10:31 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:10:31] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:10:32.147 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:10:31 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:10:33.063 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:10:33.074 INFO:tasks.workunit.client.3.smithi157.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2024-03-26T17:10:33.074 INFO:tasks.workunit.client.3.smithi157.stdout: 7.60 74.0k 85.6k 0.0k 740.0k 856.0k 0.0k nvme2n1 2024-03-26T17:10:33.075 INFO:tasks.workunit.client.3.smithi157.stdout: 7.60 70.0k 79.2k 0.0k 700.0k 792.0k 0.0k nvme2n10 2024-03-26T17:10:33.075 INFO:tasks.workunit.client.3.smithi157.stdout: 7.60 91.6k 65.2k 0.0k 916.0k 652.0k 0.0k nvme2n11 2024-03-26T17:10:33.075 INFO:tasks.workunit.client.3.smithi157.stdout: 7.60 81.6k 78.4k 0.0k 816.0k 784.0k 0.0k nvme2n12 2024-03-26T17:10:33.075 INFO:tasks.workunit.client.3.smithi157.stdout: 7.60 84.0k 69.6k 0.0k 840.0k 696.0k 0.0k nvme2n13 2024-03-26T17:10:33.075 INFO:tasks.workunit.client.3.smithi157.stdout: 7.60 87.6k 65.6k 0.0k 876.0k 656.0k 0.0k nvme2n14 2024-03-26T17:10:33.075 INFO:tasks.workunit.client.3.smithi157.stdout: 7.60 80.4k 72.4k 0.0k 804.0k 724.0k 0.0k nvme2n15 2024-03-26T17:10:33.075 INFO:tasks.workunit.client.3.smithi157.stdout: 7.60 66.8k 70.0k 0.0k 668.0k 700.0k 0.0k nvme2n16 2024-03-26T17:10:33.075 INFO:tasks.workunit.client.3.smithi157.stdout: 7.60 60.0k 63.6k 0.0k 600.0k 636.0k 0.0k nvme2n17 2024-03-26T17:10:33.075 INFO:tasks.workunit.client.3.smithi157.stdout: 7.60 57.6k 62.0k 0.0k 576.0k 620.0k 0.0k nvme2n18 2024-03-26T17:10:33.075 INFO:tasks.workunit.client.3.smithi157.stdout: 7.60 82.0k 76.0k 0.0k 820.0k 760.0k 0.0k nvme2n19 2024-03-26T17:10:33.075 INFO:tasks.workunit.client.3.smithi157.stdout: 7.60 62.0k 59.6k 0.0k 620.0k 596.0k 0.0k nvme2n2 2024-03-26T17:10:33.075 INFO:tasks.workunit.client.3.smithi157.stdout: 7.60 70.0k 116.8k 0.0k 700.0k 1.1M 0.0k nvme2n20 2024-03-26T17:10:33.075 INFO:tasks.workunit.client.3.smithi157.stdout: 7.60 66.4k 69.6k 0.0k 664.0k 696.0k 0.0k nvme2n3 2024-03-26T17:10:33.075 INFO:tasks.workunit.client.3.smithi157.stdout: 7.60 64.8k 74.0k 0.0k 648.0k 740.0k 0.0k nvme2n4 2024-03-26T17:10:33.076 INFO:tasks.workunit.client.3.smithi157.stdout: 7.60 86.8k 61.6k 0.0k 868.0k 616.0k 0.0k nvme2n5 2024-03-26T17:10:33.076 INFO:tasks.workunit.client.3.smithi157.stdout: 7.60 90.4k 53.6k 0.0k 904.0k 536.0k 0.0k nvme2n6 2024-03-26T17:10:33.076 INFO:tasks.workunit.client.3.smithi157.stdout: 7.60 123.2k 90.4k 0.0k 1.2M 904.0k 0.0k nvme2n7 2024-03-26T17:10:33.076 INFO:tasks.workunit.client.3.smithi157.stdout: 7.60 68.8k 70.0k 0.0k 688.0k 700.0k 0.0k nvme2n8 2024-03-26T17:10:33.076 INFO:tasks.workunit.client.3.smithi157.stdout: 7.70 88.8k 63.6k 0.0k 888.0k 636.0k 0.0k nvme2n9 2024-03-26T17:10:33.076 INFO:tasks.workunit.client.3.smithi157.stdout: 7.60 100.4k 115.6k 0.0k 1004.0k 1.1M 0.0k nvme5n1 2024-03-26T17:10:33.076 INFO:tasks.workunit.client.3.smithi157.stdout: 7.60 86.4k 52.4k 0.0k 864.0k 524.0k 0.0k nvme5n10 2024-03-26T17:10:33.076 INFO:tasks.workunit.client.3.smithi157.stdout: 7.60 78.0k 43.2k 0.0k 780.0k 432.0k 0.0k nvme5n11 2024-03-26T17:10:33.076 INFO:tasks.workunit.client.3.smithi157.stdout: 7.60 61.6k 72.4k 0.0k 616.0k 724.0k 0.0k nvme5n12 2024-03-26T17:10:33.076 INFO:tasks.workunit.client.3.smithi157.stdout: 7.60 60.4k 77.2k 0.0k 604.0k 772.0k 0.0k nvme5n13 2024-03-26T17:10:33.076 INFO:tasks.workunit.client.3.smithi157.stdout: 7.60 66.8k 97.6k 0.0k 668.0k 976.0k 0.0k nvme5n14 2024-03-26T17:10:33.076 INFO:tasks.workunit.client.3.smithi157.stdout: 7.60 78.8k 78.0k 0.0k 788.0k 780.0k 0.0k nvme5n15 2024-03-26T17:10:33.076 INFO:tasks.workunit.client.3.smithi157.stdout: 7.60 100.8k 47.6k 0.0k 1008.0k 476.0k 0.0k nvme5n16 2024-03-26T17:10:33.076 INFO:tasks.workunit.client.3.smithi157.stdout: 7.60 89.2k 60.0k 0.0k 892.0k 600.0k 0.0k nvme5n17 2024-03-26T17:10:33.077 INFO:tasks.workunit.client.3.smithi157.stdout: 7.60 83.6k 73.2k 0.0k 836.0k 732.0k 0.0k nvme5n18 2024-03-26T17:10:33.077 INFO:tasks.workunit.client.3.smithi157.stdout: 7.60 89.2k 65.2k 0.0k 892.0k 652.0k 0.0k nvme5n19 2024-03-26T17:10:33.077 INFO:tasks.workunit.client.3.smithi157.stdout: 7.60 79.6k 61.2k 0.0k 796.0k 612.0k 0.0k nvme5n2 2024-03-26T17:10:33.077 INFO:tasks.workunit.client.3.smithi157.stdout: 7.60 65.2k 68.0k 0.0k 652.0k 680.0k 0.0k nvme5n20 2024-03-26T17:10:33.077 INFO:tasks.workunit.client.3.smithi157.stdout: 7.60 94.4k 59.2k 0.0k 944.0k 592.0k 0.0k nvme5n3 2024-03-26T17:10:33.077 INFO:tasks.workunit.client.3.smithi157.stdout: 7.60 66.8k 101.2k 0.0k 668.0k 1012.0k 0.0k nvme5n4 2024-03-26T17:10:33.077 INFO:tasks.workunit.client.3.smithi157.stdout: 7.60 70.0k 71.6k 0.0k 700.0k 716.0k 0.0k nvme5n5 2024-03-26T17:10:33.077 INFO:tasks.workunit.client.3.smithi157.stdout: 7.60 87.2k 83.6k 0.0k 872.0k 836.0k 0.0k nvme5n6 2024-03-26T17:10:33.077 INFO:tasks.workunit.client.3.smithi157.stdout: 7.60 81.2k 56.0k 0.0k 812.0k 560.0k 0.0k nvme5n7 2024-03-26T17:10:33.077 INFO:tasks.workunit.client.3.smithi157.stdout: 7.60 69.6k 72.8k 0.0k 696.0k 728.0k 0.0k nvme5n8 2024-03-26T17:10:33.077 INFO:tasks.workunit.client.3.smithi157.stdout: 7.70 80.8k 71.2k 0.0k 808.0k 712.0k 0.0k nvme5n9 2024-03-26T17:10:33.077 INFO:tasks.workunit.client.3.smithi157.stdout: 7.60 60.4k 75.2k 0.0k 604.0k 752.0k 0.0k nvme8n1 2024-03-26T17:10:33.077 INFO:tasks.workunit.client.3.smithi157.stdout: 7.60 76.0k 76.4k 0.0k 760.0k 764.0k 0.0k nvme8n10 2024-03-26T17:10:33.077 INFO:tasks.workunit.client.3.smithi157.stdout: 7.60 57.2k 88.0k 0.0k 572.0k 880.0k 0.0k nvme8n11 2024-03-26T17:10:33.077 INFO:tasks.workunit.client.3.smithi157.stdout: 7.60 90.4k 82.4k 0.0k 904.0k 824.0k 0.0k nvme8n12 2024-03-26T17:10:33.078 INFO:tasks.workunit.client.3.smithi157.stdout: 7.60 65.6k 75.6k 0.0k 656.0k 756.0k 0.0k nvme8n13 2024-03-26T17:10:33.078 INFO:tasks.workunit.client.3.smithi157.stdout: 7.60 104.0k 54.4k 0.0k 1.0M 544.0k 0.0k nvme8n14 2024-03-26T17:10:33.078 INFO:tasks.workunit.client.3.smithi157.stdout: 7.60 92.8k 86.8k 0.0k 928.0k 868.0k 0.0k nvme8n15 2024-03-26T17:10:33.078 INFO:tasks.workunit.client.3.smithi157.stdout: 7.60 74.4k 62.4k 0.0k 744.0k 624.0k 0.0k nvme8n16 2024-03-26T17:10:33.078 INFO:tasks.workunit.client.3.smithi157.stdout: 7.60 57.2k 77.2k 0.0k 572.0k 772.0k 0.0k nvme8n17 2024-03-26T17:10:33.078 INFO:tasks.workunit.client.3.smithi157.stdout: 7.60 68.0k 73.2k 0.0k 680.0k 732.0k 0.0k nvme8n18 2024-03-26T17:10:33.078 INFO:tasks.workunit.client.3.smithi157.stdout: 7.60 51.2k 84.0k 0.0k 512.0k 840.0k 0.0k nvme8n19 2024-03-26T17:10:33.078 INFO:tasks.workunit.client.3.smithi157.stdout: 7.60 65.2k 77.6k 0.0k 652.0k 776.0k 0.0k nvme8n2 2024-03-26T17:10:33.078 INFO:tasks.workunit.client.3.smithi157.stdout: 7.60 64.8k 91.2k 0.0k 648.0k 912.0k 0.0k nvme8n20 2024-03-26T17:10:33.078 INFO:tasks.workunit.client.3.smithi157.stdout: 7.60 86.8k 74.8k 0.0k 868.0k 748.0k 0.0k nvme8n3 2024-03-26T17:10:33.078 INFO:tasks.workunit.client.3.smithi157.stdout: 7.60 75.2k 83.6k 0.0k 752.0k 836.0k 0.0k nvme8n4 2024-03-26T17:10:33.078 INFO:tasks.workunit.client.3.smithi157.stdout: 7.60 67.2k 67.2k 0.0k 672.0k 672.0k 0.0k nvme8n5 2024-03-26T17:10:33.078 INFO:tasks.workunit.client.3.smithi157.stdout: 7.60 76.8k 71.2k 0.0k 768.0k 712.0k 0.0k nvme8n6 2024-03-26T17:10:33.078 INFO:tasks.workunit.client.3.smithi157.stdout: 7.60 58.8k 73.6k 0.0k 588.0k 736.0k 0.0k nvme8n7 2024-03-26T17:10:33.079 INFO:tasks.workunit.client.3.smithi157.stdout: 7.70 68.4k 85.6k 0.0k 684.0k 856.0k 0.0k nvme8n8 2024-03-26T17:10:33.079 INFO:tasks.workunit.client.3.smithi157.stdout: 7.70 70.0k 66.8k 0.0k 700.0k 668.0k 0.0k nvme8n9 2024-03-26T17:10:33.079 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:10:33.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:10:33 smithi149 ceph-mon[34678]: pgmap v743: 33 pgs: 33 active+clean; 1.0 GiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 4.4 MiB/s rd, 4.3 MiB/s wr, 448 op/s 2024-03-26T17:10:33.416 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:10:33 smithi044 ceph-mon[30624]: pgmap v743: 33 pgs: 33 active+clean; 1.0 GiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 4.4 MiB/s rd, 4.3 MiB/s wr, 448 op/s 2024-03-26T17:10:33.548 INFO:tasks.workunit.client.3.smithi157.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-26T17:10:33.548 INFO:tasks.workunit.client.3.smithi157.stdout:myimage20 5/s 2/s 145 KiB/s 94 KiB/s 3.07 ms 468.47 us 2024-03-26T17:10:33.548 INFO:tasks.workunit.client.3.smithi157.stdout:myimage32 5/s 1/s 78 KiB/s 41 KiB/s 3.28 ms 398.16 us 2024-03-26T17:10:33.549 INFO:tasks.workunit.client.3.smithi157.stdout:myimage60 5/s 3/s 115 KiB/s 74 KiB/s 3.23 ms 328.14 us 2024-03-26T17:10:33.549 INFO:tasks.workunit.client.3.smithi157.stdout:myimage48 4/s 3/s 93 KiB/s 70 KiB/s 3.11 ms 343.10 us 2024-03-26T17:10:33.549 INFO:tasks.workunit.client.3.smithi157.stdout:myimage16 4/s 4/s 86 KiB/s 69 KiB/s 3.07 ms 318.77 us 2024-03-26T17:10:33.549 INFO:tasks.workunit.client.3.smithi157.stdout:myimage58 4/s 3/s 83 KiB/s 78 KiB/s 2.70 ms 342.50 us 2024-03-26T17:10:33.549 INFO:tasks.workunit.client.3.smithi157.stdout:myimage24 4/s 2/s 92 KiB/s 22 KiB/s 2.92 ms 289.36 us 2024-03-26T17:10:33.549 INFO:tasks.workunit.client.3.smithi157.stdout:myimage25 4/s 3/s 85 KiB/s 61 KiB/s 3.73 ms 361.93 us 2024-03-26T17:10:33.549 INFO:tasks.workunit.client.3.smithi157.stdout:myimage21 4/s 2/s 134 KiB/s 81 KiB/s 4.08 ms 330.26 us 2024-03-26T17:10:33.549 INFO:tasks.workunit.client.3.smithi157.stdout:myimage39 4/s 3/s 101 KiB/s 85 KiB/s 2.74 ms 325.15 us 2024-03-26T17:10:33.549 INFO:tasks.workunit.client.3.smithi157.stdout:myimage41 4/s 3/s 75 KiB/s 76 KiB/s 3.01 ms 356.46 us 2024-03-26T17:10:33.549 INFO:tasks.workunit.client.3.smithi157.stdout:myimage35 4/s 2/s 82 KiB/s 66 KiB/s 2.96 ms 294.91 us 2024-03-26T17:10:33.549 INFO:tasks.workunit.client.3.smithi157.stdout:myimage12 4/s 3/s 93 KiB/s 62 KiB/s 3.13 ms 332.99 us 2024-03-26T17:10:33.549 INFO:tasks.workunit.client.3.smithi157.stdout:myimage27 4/s 4/s 61 KiB/s 70 KiB/s 2.50 ms 355.44 us 2024-03-26T17:10:33.550 INFO:tasks.workunit.client.3.smithi157.stdout:myimage59 4/s 3/s 74 KiB/s 52 KiB/s 3.09 ms 494.86 us 2024-03-26T17:10:33.550 INFO:tasks.workunit.client.3.smithi157.stdout:myimage3 4/s 3/s 58 KiB/s 70 KiB/s 2.25 ms 331.64 us 2024-03-26T17:10:33.550 INFO:tasks.workunit.client.3.smithi157.stdout:myimage34 4/s 4/s 97 KiB/s 76 KiB/s 2.65 ms 366.62 us 2024-03-26T17:10:33.550 INFO:tasks.workunit.client.3.smithi157.stdout:myimage1 4/s 3/s 93 KiB/s 50 KiB/s 2.81 ms 321.85 us 2024-03-26T17:10:33.550 INFO:tasks.workunit.client.3.smithi157.stdout:myimage53 4/s 4/s 46 KiB/s 86 KiB/s 2.87 ms 330.61 us 2024-03-26T17:10:33.550 INFO:tasks.workunit.client.3.smithi157.stdout:myimage10 4/s 3/s 80 KiB/s 74 KiB/s 2.54 ms 318.04 us 2024-03-26T17:10:33.550 INFO:tasks.workunit.client.3.smithi157.stdout:myimage26 3/s 3/s 99 KiB/s 103 KiB/s 3.05 ms 365.67 us 2024-03-26T17:10:33.550 INFO:tasks.workunit.client.3.smithi157.stdout:myimage28 3/s 3/s 68 KiB/s 46 KiB/s 3.85 ms 323.04 us 2024-03-26T17:10:33.550 INFO:tasks.workunit.client.3.smithi157.stdout:myimage46 3/s 4/s 72 KiB/s 91 KiB/s 3.00 ms 482.39 us 2024-03-26T17:10:33.550 INFO:tasks.workunit.client.3.smithi157.stdout:myimage51 3/s 2/s 92 KiB/s 46 KiB/s 3.32 ms 307.95 us 2024-03-26T17:10:33.550 INFO:tasks.workunit.client.3.smithi157.stdout:myimage14 3/s 3/s 66 KiB/s 82 KiB/s 3.26 ms 329.24 us 2024-03-26T17:10:33.550 INFO:tasks.workunit.client.3.smithi157.stdout:myimage23 3/s 3/s 70 KiB/s 82 KiB/s 2.50 ms 346.80 us 2024-03-26T17:10:33.551 INFO:tasks.workunit.client.3.smithi157.stdout:myimage30 3/s 5/s 67 KiB/s 102 KiB/s 3.65 ms 356.49 us 2024-03-26T17:10:33.551 INFO:tasks.workunit.client.3.smithi157.stdout:myimage37 3/s 5/s 63 KiB/s 111 KiB/s 3.44 ms 351.52 us 2024-03-26T17:10:33.551 INFO:tasks.workunit.client.3.smithi157.stdout:myimage38 3/s 3/s 82 KiB/s 89 KiB/s 2.44 ms 339.18 us 2024-03-26T17:10:33.551 INFO:tasks.workunit.client.3.smithi157.stdout:myimage8 3/s 3/s 50 KiB/s 67 KiB/s 2.97 ms 312.23 us 2024-03-26T17:10:33.551 INFO:tasks.workunit.client.3.smithi157.stdout:myimage9 3/s 4/s 72 KiB/s 76 KiB/s 3.38 ms 387.66 us 2024-03-26T17:10:33.551 INFO:tasks.workunit.client.3.smithi157.stdout:myimage17 3/s 4/s 64 KiB/s 78 KiB/s 2.70 ms 336.20 us 2024-03-26T17:10:33.551 INFO:tasks.workunit.client.3.smithi157.stdout:myimage18 3/s 4/s 61 KiB/s 45 KiB/s 3.06 ms 315.43 us 2024-03-26T17:10:33.551 INFO:tasks.workunit.client.3.smithi157.stdout:myimage43 3/s 3/s 66 KiB/s 62 KiB/s 2.95 ms 331.81 us 2024-03-26T17:10:33.551 INFO:tasks.workunit.client.3.smithi157.stdout:myimage50 3/s 3/s 83 KiB/s 75 KiB/s 2.90 ms 378.47 us 2024-03-26T17:10:33.551 INFO:tasks.workunit.client.3.smithi157.stdout:myimage57 3/s 4/s 74 KiB/s 77 KiB/s 2.77 ms 318.67 us 2024-03-26T17:10:33.551 INFO:tasks.workunit.client.3.smithi157.stdout:myimage2 3/s 4/s 47 KiB/s 82 KiB/s 2.85 ms 332.02 us 2024-03-26T17:10:33.551 INFO:tasks.workunit.client.3.smithi157.stdout:myimage13 3/s 4/s 64 KiB/s 104 KiB/s 2.75 ms 350.84 us 2024-03-26T17:10:33.551 INFO:tasks.workunit.client.3.smithi157.stdout:myimage31 3/s 3/s 36 KiB/s 61 KiB/s 3.12 ms 343.25 us 2024-03-26T17:10:33.551 INFO:tasks.workunit.client.3.smithi157.stdout:myimage47 3/s 3/s 48 KiB/s 70 KiB/s 3.27 ms 351.18 us 2024-03-26T17:10:33.552 INFO:tasks.workunit.client.3.smithi157.stdout:myimage4 3/s 3/s 78 KiB/s 67 KiB/s 2.63 ms 318.87 us 2024-03-26T17:10:33.552 INFO:tasks.workunit.client.3.smithi157.stdout:myimage6 3/s 3/s 71 KiB/s 76 KiB/s 3.49 ms 316.68 us 2024-03-26T17:10:33.552 INFO:tasks.workunit.client.3.smithi157.stdout:myimage11 3/s 4/s 61 KiB/s 86 KiB/s 3.07 ms 351.07 us 2024-03-26T17:10:33.552 INFO:tasks.workunit.client.3.smithi157.stdout:myimage42 3/s 4/s 78 KiB/s 81 KiB/s 2.65 ms 385.85 us 2024-03-26T17:10:33.552 INFO:tasks.workunit.client.3.smithi157.stdout:myimage54 3/s 5/s 65 KiB/s 118 KiB/s 2.92 ms 507.00 us 2024-03-26T17:10:33.552 INFO:tasks.workunit.client.3.smithi157.stdout:myimage40 3/s 4/s 53 KiB/s 83 KiB/s 2.82 ms 324.84 us 2024-03-26T17:10:33.552 INFO:tasks.workunit.client.3.smithi157.stdout:myimage44 3/s 3/s 86 KiB/s 49 KiB/s 3.11 ms 305.86 us 2024-03-26T17:10:33.552 INFO:tasks.workunit.client.3.smithi157.stdout:myimage49 3/s 3/s 41 KiB/s 75 KiB/s 2.95 ms 339.89 us 2024-03-26T17:10:33.552 INFO:tasks.workunit.client.3.smithi157.stdout:myimage19 3/s 3/s 69 KiB/s 63 KiB/s 2.85 ms 360.47 us 2024-03-26T17:10:33.552 INFO:tasks.workunit.client.3.smithi157.stdout:myimage45 3/s 3/s 44 KiB/s 70 KiB/s 3.02 ms 399.48 us 2024-03-26T17:10:33.553 INFO:tasks.workunit.client.3.smithi157.stdout:myimage55 3/s 4/s 60 KiB/s 91 KiB/s 3.22 ms 331.09 us 2024-03-26T17:10:33.553 INFO:tasks.workunit.client.3.smithi157.stdout:myimage22 3/s 4/s 70 KiB/s 66 KiB/s 2.79 ms 327.44 us 2024-03-26T17:10:33.553 INFO:tasks.workunit.client.3.smithi157.stdout:myimage5 3/s 4/s 66 KiB/s 107 KiB/s 3.05 ms 391.48 us 2024-03-26T17:10:33.553 INFO:tasks.workunit.client.3.smithi157.stdout:myimage15 3/s 4/s 41 KiB/s 90 KiB/s 2.43 ms 315.20 us 2024-03-26T17:10:33.553 INFO:tasks.workunit.client.3.smithi157.stdout:myimage29 3/s 4/s 70 KiB/s 67 KiB/s 2.66 ms 348.94 us 2024-03-26T17:10:33.553 INFO:tasks.workunit.client.3.smithi157.stdout:myimage36 3/s 4/s 55 KiB/s 106 KiB/s 2.68 ms 397.94 us 2024-03-26T17:10:33.554 INFO:tasks.workunit.client.3.smithi157.stdout:myimage52 2/s 3/s 63 KiB/s 84 KiB/s 2.90 ms 340.12 us 2024-03-26T17:10:33.554 INFO:tasks.workunit.client.3.smithi157.stdout:myimage7 2/s 4/s 82 KiB/s 129 KiB/s 3.09 ms 355.86 us 2024-03-26T17:10:33.554 INFO:tasks.workunit.client.3.smithi157.stdout:myimage33 2/s 4/s 45 KiB/s 75 KiB/s 3.27 ms 390.41 us 2024-03-26T17:10:33.554 INFO:tasks.workunit.client.3.smithi157.stdout:myimage56 2/s 3/s 33 KiB/s 42 KiB/s 3.63 ms 352.74 us 2024-03-26T17:10:33.554 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:10:33.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:10:33 smithi064 ceph-mon[34420]: pgmap v743: 33 pgs: 33 active+clean; 1.0 GiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 4.4 MiB/s rd, 4.3 MiB/s wr, 448 op/s 2024-03-26T17:10:34.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:10:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:10:33] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:10:34.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:10:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:10:33] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:10:34.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:10:33 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:10:34.146 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:10:34 smithi149 ceph-mon[34678]: Health check update: 3 slow ops, oldest one blocked for 728 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:10:34.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:10:33 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:10:33] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:10:34.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:10:33 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:10:33] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:10:34.147 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:10:33 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:10:34.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:10:34 smithi044 ceph-mon[30624]: Health check update: 3 slow ops, oldest one blocked for 728 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:10:34.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:10:34 smithi064 ceph-mon[34420]: Health check update: 3 slow ops, oldest one blocked for 728 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:10:35.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:10:35 smithi149 ceph-mon[34678]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:10:35.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:10:35 smithi149 ceph-mon[34678]: { 2024-03-26T17:10:35.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:10:35 smithi149 ceph-mon[34678]: "prefix": "rbd perf image stats", 2024-03-26T17:10:35.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:10:35 smithi149 ceph-mon[34678]: "pool_spec": "mypool", 2024-03-26T17:10:35.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:10:35 smithi149 ceph-mon[34678]: "sort_by": "write_ops", 2024-03-26T17:10:35.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:10:35 smithi149 ceph-mon[34678]: "format": "json" 2024-03-26T17:10:35.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:10:35 smithi149 ceph-mon[34678]: }"]: dispatch 2024-03-26T17:10:35.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:10:35 smithi149 ceph-mon[34678]: pgmap v744: 33 pgs: 33 active+clean; 1.0 GiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 4.7 MiB/s rd, 4.5 MiB/s wr, 477 op/s 2024-03-26T17:10:35.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:10:35 smithi044 ceph-mon[30624]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:10:35.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:10:35 smithi044 ceph-mon[30624]: { 2024-03-26T17:10:35.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:10:35 smithi044 ceph-mon[30624]: "prefix": "rbd perf image stats", 2024-03-26T17:10:35.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:10:35 smithi044 ceph-mon[30624]: "pool_spec": "mypool", 2024-03-26T17:10:35.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:10:35 smithi044 ceph-mon[30624]: "sort_by": "write_ops", 2024-03-26T17:10:35.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:10:35 smithi044 ceph-mon[30624]: "format": "json" 2024-03-26T17:10:35.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:10:35 smithi044 ceph-mon[30624]: }"]: dispatch 2024-03-26T17:10:35.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:10:35 smithi044 ceph-mon[30624]: pgmap v744: 33 pgs: 33 active+clean; 1.0 GiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 4.7 MiB/s rd, 4.5 MiB/s wr, 477 op/s 2024-03-26T17:10:35.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:10:35 smithi064 ceph-mon[34420]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:10:35.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:10:35 smithi064 ceph-mon[34420]: { 2024-03-26T17:10:35.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:10:35 smithi064 ceph-mon[34420]: "prefix": "rbd perf image stats", 2024-03-26T17:10:35.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:10:35 smithi064 ceph-mon[34420]: "pool_spec": "mypool", 2024-03-26T17:10:35.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:10:35 smithi064 ceph-mon[34420]: "sort_by": "write_ops", 2024-03-26T17:10:35.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:10:35 smithi064 ceph-mon[34420]: "format": "json" 2024-03-26T17:10:35.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:10:35 smithi064 ceph-mon[34420]: }"]: dispatch 2024-03-26T17:10:35.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:10:35 smithi064 ceph-mon[34420]: pgmap v744: 33 pgs: 33 active+clean; 1.0 GiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 4.7 MiB/s rd, 4.5 MiB/s wr, 477 op/s 2024-03-26T17:10:36.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:10:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:10:35] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:10:36.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:10:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:10:35] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:10:36.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:10:35 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:10:36.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:10:35 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:10:35] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:10:36.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:10:35 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:10:35] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:10:36.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:10:35 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:10:36.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:10:36 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 2024-03-26T17:10:36.243+0000 7fa707a55700 -1 mon.c@1(peon) e3 get_health_metrics reporting 3 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T17:10:37.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:10:37 smithi149 ceph-mon[34678]: pgmap v745: 33 pgs: 33 active+clean; 1.0 GiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 4.8 MiB/s rd, 4.5 MiB/s wr, 483 op/s 2024-03-26T17:10:37.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:10:37 smithi044 ceph-mon[30624]: pgmap v745: 33 pgs: 33 active+clean; 1.0 GiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 4.8 MiB/s rd, 4.5 MiB/s wr, 483 op/s 2024-03-26T17:10:37.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:10:37 smithi064 ceph-mon[34420]: pgmap v745: 33 pgs: 33 active+clean; 1.0 GiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 4.8 MiB/s rd, 4.5 MiB/s wr, 483 op/s 2024-03-26T17:10:38.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:10:37 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:10:37] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:10:38.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:10:37 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:10:37] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:10:38.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:10:37 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:10:38.297 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:10:37 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:10:37] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:10:38.298 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:10:37 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:10:37] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:10:38.298 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:10:37 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:10:38.552 INFO:tasks.workunit.client.3.smithi157.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-26T17:10:38.552 INFO:tasks.workunit.client.3.smithi157.stdout:myimage8 5/s 3/s 116 KiB/s 54 KiB/s 2.82 ms 441.73 us 2024-03-26T17:10:38.552 INFO:tasks.workunit.client.3.smithi157.stdout:myimage57 5/s 2/s 82 KiB/s 46 KiB/s 3.09 ms 361.73 us 2024-03-26T17:10:38.552 INFO:tasks.workunit.client.3.smithi157.stdout:myimage45 5/s 2/s 92 KiB/s 54 KiB/s 2.96 ms 420.23 us 2024-03-26T17:10:38.552 INFO:tasks.workunit.client.3.smithi157.stdout:myimage49 5/s 3/s 105 KiB/s 76 KiB/s 2.93 ms 368.29 us 2024-03-26T17:10:38.552 INFO:tasks.workunit.client.3.smithi157.stdout:myimage53 5/s 3/s 86 KiB/s 60 KiB/s 2.69 ms 338.35 us 2024-03-26T17:10:38.552 INFO:tasks.workunit.client.3.smithi157.stdout:myimage47 5/s 5/s 69 KiB/s 102 KiB/s 2.70 ms 378.86 us 2024-03-26T17:10:38.553 INFO:tasks.workunit.client.3.smithi157.stdout:myimage48 4/s 3/s 73 KiB/s 57 KiB/s 2.46 ms 309.04 us 2024-03-26T17:10:38.553 INFO:tasks.workunit.client.3.smithi157.stdout:myimage59 4/s 4/s 62 KiB/s 86 KiB/s 3.02 ms 435.38 us 2024-03-26T17:10:38.553 INFO:tasks.workunit.client.3.smithi157.stdout:myimage32 4/s 4/s 77 KiB/s 67 KiB/s 3.07 ms 402.03 us 2024-03-26T17:10:38.553 INFO:tasks.workunit.client.3.smithi157.stdout:myimage5 4/s 3/s 72 KiB/s 61 KiB/s 2.70 ms 350.21 us 2024-03-26T17:10:38.553 INFO:tasks.workunit.client.3.smithi157.stdout:myimage33 4/s 3/s 92 KiB/s 86 KiB/s 3.03 ms 363.99 us 2024-03-26T17:10:38.553 INFO:tasks.workunit.client.3.smithi157.stdout:myimage31 4/s 3/s 69 KiB/s 57 KiB/s 3.51 ms 332.81 us 2024-03-26T17:10:38.553 INFO:tasks.workunit.client.3.smithi157.stdout:myimage17 4/s 3/s 71 KiB/s 36 KiB/s 2.76 ms 394.05 us 2024-03-26T17:10:38.553 INFO:tasks.workunit.client.3.smithi157.stdout:myimage19 4/s 4/s 85 KiB/s 96 KiB/s 3.01 ms 372.92 us 2024-03-26T17:10:38.553 INFO:tasks.workunit.client.3.smithi157.stdout:myimage28 4/s 3/s 110 KiB/s 94 KiB/s 3.80 ms 350.30 us 2024-03-26T17:10:38.553 INFO:tasks.workunit.client.3.smithi157.stdout:myimage51 4/s 2/s 94 KiB/s 44 KiB/s 3.24 ms 363.52 us 2024-03-26T17:10:38.553 INFO:tasks.workunit.client.3.smithi157.stdout:myimage34 4/s 3/s 77 KiB/s 67 KiB/s 2.63 ms 337.40 us 2024-03-26T17:10:38.553 INFO:tasks.workunit.client.3.smithi157.stdout:myimage38 4/s 4/s 69 KiB/s 99 KiB/s 2.25 ms 285.68 us 2024-03-26T17:10:38.553 INFO:tasks.workunit.client.3.smithi157.stdout:myimage44 4/s 3/s 85 KiB/s 77 KiB/s 3.24 ms 434.28 us 2024-03-26T17:10:38.553 INFO:tasks.workunit.client.3.smithi157.stdout:myimage58 4/s 3/s 76 KiB/s 74 KiB/s 2.76 ms 296.00 us 2024-03-26T17:10:38.554 INFO:tasks.workunit.client.3.smithi157.stdout:myimage1 4/s 4/s 136 KiB/s 128 KiB/s 2.45 ms 345.40 us 2024-03-26T17:10:38.554 INFO:tasks.workunit.client.3.smithi157.stdout:myimage24 4/s 5/s 86 KiB/s 106 KiB/s 2.83 ms 341.18 us 2024-03-26T17:10:38.554 INFO:tasks.workunit.client.3.smithi157.stdout:myimage29 4/s 3/s 62 KiB/s 57 KiB/s 2.63 ms 355.91 us 2024-03-26T17:10:38.554 INFO:tasks.workunit.client.3.smithi157.stdout:myimage39 4/s 4/s 73 KiB/s 94 KiB/s 2.87 ms 447.21 us 2024-03-26T17:10:38.554 INFO:tasks.workunit.client.3.smithi157.stdout:myimage56 4/s 4/s 104 KiB/s 128 KiB/s 3.68 ms 349.12 us 2024-03-26T17:10:38.554 INFO:tasks.workunit.client.3.smithi157.stdout:myimage16 4/s 3/s 69 KiB/s 49 KiB/s 2.43 ms 350.46 us 2024-03-26T17:10:38.554 INFO:tasks.workunit.client.3.smithi157.stdout:myimage22 4/s 5/s 74 KiB/s 103 KiB/s 3.09 ms 335.86 us 2024-03-26T17:10:38.554 INFO:tasks.workunit.client.3.smithi157.stdout:myimage40 4/s 3/s 75 KiB/s 65 KiB/s 2.64 ms 301.18 us 2024-03-26T17:10:38.554 INFO:tasks.workunit.client.3.smithi157.stdout:myimage15 4/s 3/s 127 KiB/s 119 KiB/s 2.77 ms 400.74 us 2024-03-26T17:10:38.554 INFO:tasks.workunit.client.3.smithi157.stdout:myimage52 3/s 4/s 119 KiB/s 122 KiB/s 3.49 ms 354.38 us 2024-03-26T17:10:38.554 INFO:tasks.workunit.client.3.smithi157.stdout:myimage12 3/s 4/s 70 KiB/s 78 KiB/s 2.92 ms 437.84 us 2024-03-26T17:10:38.554 INFO:tasks.workunit.client.3.smithi157.stdout:myimage27 3/s 4/s 100 KiB/s 116 KiB/s 2.38 ms 557.77 us 2024-03-26T17:10:38.554 INFO:tasks.workunit.client.3.smithi157.stdout:myimage60 3/s 2/s 73 KiB/s 46 KiB/s 3.05 ms 350.39 us 2024-03-26T17:10:38.555 INFO:tasks.workunit.client.3.smithi157.stdout:myimage30 3/s 3/s 70 KiB/s 63 KiB/s 3.44 ms 343.22 us 2024-03-26T17:10:38.555 INFO:tasks.workunit.client.3.smithi157.stdout:myimage11 3/s 3/s 70 KiB/s 55 KiB/s 3.38 ms 319.68 us 2024-03-26T17:10:38.555 INFO:tasks.workunit.client.3.smithi157.stdout:myimage21 3/s 5/s 90 KiB/s 165 KiB/s 3.65 ms 396.51 us 2024-03-26T17:10:38.555 INFO:tasks.workunit.client.3.smithi157.stdout:myimage25 3/s 3/s 73 KiB/s 67 KiB/s 3.99 ms 339.09 us 2024-03-26T17:10:38.555 INFO:tasks.workunit.client.3.smithi157.stdout:myimage41 3/s 4/s 53 KiB/s 48 KiB/s 3.27 ms 322.56 us 2024-03-26T17:10:38.555 INFO:tasks.workunit.client.3.smithi157.stdout:myimage46 3/s 3/s 60 KiB/s 57 KiB/s 2.96 ms 427.64 us 2024-03-26T17:10:38.555 INFO:tasks.workunit.client.3.smithi157.stdout:myimage23 3/s 5/s 50 KiB/s 95 KiB/s 2.61 ms 313.20 us 2024-03-26T17:10:38.555 INFO:tasks.workunit.client.3.smithi157.stdout:myimage35 3/s 4/s 72 KiB/s 89 KiB/s 3.06 ms 318.48 us 2024-03-26T17:10:38.555 INFO:tasks.workunit.client.3.smithi157.stdout:myimage37 3/s 4/s 84 KiB/s 87 KiB/s 2.85 ms 346.37 us 2024-03-26T17:10:38.555 INFO:tasks.workunit.client.3.smithi157.stdout:myimage4 3/s 4/s 71 KiB/s 88 KiB/s 2.83 ms 319.17 us 2024-03-26T17:10:38.555 INFO:tasks.workunit.client.3.smithi157.stdout:myimage6 3/s 4/s 68 KiB/s 73 KiB/s 3.55 ms 352.32 us 2024-03-26T17:10:38.555 INFO:tasks.workunit.client.3.smithi157.stdout:myimage18 3/s 4/s 66 KiB/s 73 KiB/s 2.86 ms 322.33 us 2024-03-26T17:10:38.555 INFO:tasks.workunit.client.3.smithi157.stdout:myimage26 3/s 4/s 49 KiB/s 74 KiB/s 3.07 ms 375.31 us 2024-03-26T17:10:38.555 INFO:tasks.workunit.client.3.smithi157.stdout:myimage7 3/s 4/s 96 KiB/s 138 KiB/s 3.10 ms 342.00 us 2024-03-26T17:10:38.555 INFO:tasks.workunit.client.3.smithi157.stdout:myimage9 3/s 4/s 63 KiB/s 90 KiB/s 3.33 ms 330.76 us 2024-03-26T17:10:38.556 INFO:tasks.workunit.client.3.smithi157.stdout:myimage20 3/s 3/s 75 KiB/s 108 KiB/s 2.74 ms 365.00 us 2024-03-26T17:10:38.556 INFO:tasks.workunit.client.3.smithi157.stdout:myimage43 3/s 5/s 78 KiB/s 98 KiB/s 3.57 ms 318.11 us 2024-03-26T17:10:38.556 INFO:tasks.workunit.client.3.smithi157.stdout:myimage54 3/s 5/s 94 KiB/s 133 KiB/s 2.80 ms 349.45 us 2024-03-26T17:10:38.556 INFO:tasks.workunit.client.3.smithi157.stdout:myimage55 3/s 4/s 94 KiB/s 112 KiB/s 3.35 ms 396.33 us 2024-03-26T17:10:38.556 INFO:tasks.workunit.client.3.smithi157.stdout:myimage10 3/s 2/s 52 KiB/s 39 KiB/s 2.75 ms 327.91 us 2024-03-26T17:10:38.556 INFO:tasks.workunit.client.3.smithi157.stdout:myimage36 2/s 4/s 53 KiB/s 104 KiB/s 2.76 ms 358.50 us 2024-03-26T17:10:38.556 INFO:tasks.workunit.client.3.smithi157.stdout:myimage2 2/s 3/s 36 KiB/s 50 KiB/s 3.23 ms 419.75 us 2024-03-26T17:10:38.556 INFO:tasks.workunit.client.3.smithi157.stdout:myimage50 2/s 5/s 28 KiB/s 74 KiB/s 3.07 ms 335.79 us 2024-03-26T17:10:38.556 INFO:tasks.workunit.client.3.smithi157.stdout:myimage3 2/s 5/s 46 KiB/s 114 KiB/s 2.22 ms 381.17 us 2024-03-26T17:10:38.556 INFO:tasks.workunit.client.3.smithi157.stdout:myimage13 2/s 6/s 38 KiB/s 124 KiB/s 2.63 ms 400.01 us 2024-03-26T17:10:38.556 INFO:tasks.workunit.client.3.smithi157.stdout:myimage14 2/s 4/s 45 KiB/s 86 KiB/s 3.06 ms 381.56 us 2024-03-26T17:10:38.556 INFO:tasks.workunit.client.3.smithi157.stdout:myimage42 2/s 3/s 40 KiB/s 54 KiB/s 2.73 ms 348.73 us 2024-03-26T17:10:38.556 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:10:39.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:10:39 smithi149 ceph-mon[34678]: pgmap v746: 33 pgs: 33 active+clean; 1.0 GiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 4.2 MiB/s rd, 4.0 MiB/s wr, 424 op/s 2024-03-26T17:10:39.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:10:39 smithi149 ceph-mon[34678]: Health check update: 3 slow ops, oldest one blocked for 733 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:10:39.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:10:39 smithi044 ceph-mon[30624]: pgmap v746: 33 pgs: 33 active+clean; 1.0 GiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 4.2 MiB/s rd, 4.0 MiB/s wr, 424 op/s 2024-03-26T17:10:39.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:10:39 smithi044 ceph-mon[30624]: Health check update: 3 slow ops, oldest one blocked for 733 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:10:39.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:10:39 smithi064 ceph-mon[34420]: pgmap v746: 33 pgs: 33 active+clean; 1.0 GiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 4.2 MiB/s rd, 4.0 MiB/s wr, 424 op/s 2024-03-26T17:10:39.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:10:39 smithi064 ceph-mon[34420]: Health check update: 3 slow ops, oldest one blocked for 733 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:10:40.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:10:39 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:10:39] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:10:40.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:10:39 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:10:39] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:10:40.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:10:39 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:10:40.297 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:10:40 smithi149 ceph-mon[34678]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:10:40.297 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:10:40 smithi149 ceph-mon[34678]: { 2024-03-26T17:10:40.297 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:10:40 smithi149 ceph-mon[34678]: "prefix": "rbd perf image stats", 2024-03-26T17:10:40.297 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:10:40 smithi149 ceph-mon[34678]: "pool_spec": "mypool", 2024-03-26T17:10:40.297 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:10:40 smithi149 ceph-mon[34678]: "sort_by": "write_ops", 2024-03-26T17:10:40.297 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:10:40 smithi149 ceph-mon[34678]: "format": "json" 2024-03-26T17:10:40.297 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:10:40 smithi149 ceph-mon[34678]: }"]: dispatch 2024-03-26T17:10:40.298 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:10:39 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:10:39] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:10:40.298 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:10:39 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:10:39] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:10:40.298 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:10:39 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:10:40.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:10:40 smithi044 ceph-mon[30624]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:10:40.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:10:40 smithi044 ceph-mon[30624]: { 2024-03-26T17:10:40.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:10:40 smithi044 ceph-mon[30624]: "prefix": "rbd perf image stats", 2024-03-26T17:10:40.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:10:40 smithi044 ceph-mon[30624]: "pool_spec": "mypool", 2024-03-26T17:10:40.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:10:40 smithi044 ceph-mon[30624]: "sort_by": "write_ops", 2024-03-26T17:10:40.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:10:40 smithi044 ceph-mon[30624]: "format": "json" 2024-03-26T17:10:40.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:10:40 smithi044 ceph-mon[30624]: }"]: dispatch 2024-03-26T17:10:40.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:10:40 smithi064 ceph-mon[34420]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:10:40.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:10:40 smithi064 ceph-mon[34420]: { 2024-03-26T17:10:40.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:10:40 smithi064 ceph-mon[34420]: "prefix": "rbd perf image stats", 2024-03-26T17:10:40.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:10:40 smithi064 ceph-mon[34420]: "pool_spec": "mypool", 2024-03-26T17:10:40.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:10:40 smithi064 ceph-mon[34420]: "sort_by": "write_ops", 2024-03-26T17:10:40.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:10:40 smithi064 ceph-mon[34420]: "format": "json" 2024-03-26T17:10:40.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:10:40 smithi064 ceph-mon[34420]: }"]: dispatch 2024-03-26T17:10:41.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:10:41 smithi149 ceph-mon[34678]: pgmap v747: 33 pgs: 33 active+clean; 1.0 GiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 4.6 MiB/s rd, 4.4 MiB/s wr, 465 op/s 2024-03-26T17:10:41.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:10:41 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 2024-03-26T17:10:41.243+0000 7fa707a55700 -1 mon.c@1(peon) e3 get_health_metrics reporting 3 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T17:10:41.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:10:41 smithi044 ceph-mon[30624]: pgmap v747: 33 pgs: 33 active+clean; 1.0 GiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 4.6 MiB/s rd, 4.4 MiB/s wr, 465 op/s 2024-03-26T17:10:41.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:10:41 smithi064 ceph-mon[34420]: pgmap v747: 33 pgs: 33 active+clean; 1.0 GiB data, 4.4 GiB used, 711 GiB / 715 GiB avail; 4.6 MiB/s rd, 4.4 MiB/s wr, 465 op/s 2024-03-26T17:10:42.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:10:41 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:10:41] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:10:42.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:10:41 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:10:41] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:10:42.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:10:41 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:10:42.396 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:10:41 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:10:41] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:10:42.396 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:10:41 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:10:41] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:10:42.396 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:10:41 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:10:43.063 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:10:43.071 INFO:tasks.workunit.client.3.smithi157.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2024-03-26T17:10:43.071 INFO:tasks.workunit.client.3.smithi157.stdout: 7.40 112.0k 126.4k 0.0k 1.1M 1.2M 0.0k nvme2n1 2024-03-26T17:10:43.071 INFO:tasks.workunit.client.3.smithi157.stdout: 7.50 80.0k 111.2k 0.0k 800.0k 1.1M 0.0k nvme2n10 2024-03-26T17:10:43.071 INFO:tasks.workunit.client.3.smithi157.stdout: 7.50 69.2k 72.4k 0.0k 692.0k 724.0k 0.0k nvme2n11 2024-03-26T17:10:43.072 INFO:tasks.workunit.client.3.smithi157.stdout: 7.50 46.4k 100.0k 0.0k 464.0k 1000.0k 0.0k nvme2n12 2024-03-26T17:10:43.072 INFO:tasks.workunit.client.3.smithi157.stdout: 7.40 118.4k 77.6k 0.0k 1.2M 776.0k 0.0k nvme2n13 2024-03-26T17:10:43.072 INFO:tasks.workunit.client.3.smithi157.stdout: 7.40 69.2k 62.8k 0.0k 692.0k 628.0k 0.0k nvme2n14 2024-03-26T17:10:43.072 INFO:tasks.workunit.client.3.smithi157.stdout: 7.40 107.2k 132.0k 0.0k 1.0M 1.3M 0.0k nvme2n15 2024-03-26T17:10:43.072 INFO:tasks.workunit.client.3.smithi157.stdout: 7.40 52.8k 72.8k 0.0k 528.0k 728.0k 0.0k nvme2n16 2024-03-26T17:10:43.072 INFO:tasks.workunit.client.3.smithi157.stdout: 7.40 44.0k 76.0k 0.0k 440.0k 760.0k 0.0k nvme2n17 2024-03-26T17:10:43.072 INFO:tasks.workunit.client.3.smithi157.stdout: 7.40 87.2k 56.4k 0.0k 872.0k 564.0k 0.0k nvme2n18 2024-03-26T17:10:43.072 INFO:tasks.workunit.client.3.smithi157.stdout: 7.40 83.2k 62.8k 0.0k 832.0k 628.0k 0.0k nvme2n19 2024-03-26T17:10:43.072 INFO:tasks.workunit.client.3.smithi157.stdout: 7.40 87.2k 75.6k 0.0k 872.0k 756.0k 0.0k nvme2n2 2024-03-26T17:10:43.072 INFO:tasks.workunit.client.3.smithi157.stdout: 7.40 122.8k 94.8k 0.0k 1.2M 948.0k 0.0k nvme2n20 2024-03-26T17:10:43.072 INFO:tasks.workunit.client.3.smithi157.stdout: 7.40 102.4k 60.4k 0.0k 1.0M 604.0k 0.0k nvme2n3 2024-03-26T17:10:43.072 INFO:tasks.workunit.client.3.smithi157.stdout: 7.40 82.4k 94.0k 0.0k 824.0k 940.0k 0.0k nvme2n4 2024-03-26T17:10:43.072 INFO:tasks.workunit.client.3.smithi157.stdout: 7.40 61.2k 82.0k 0.0k 612.0k 820.0k 0.0k nvme2n5 2024-03-26T17:10:43.073 INFO:tasks.workunit.client.3.smithi157.stdout: 7.40 69.6k 125.2k 0.0k 696.0k 1.2M 0.0k nvme2n6 2024-03-26T17:10:43.073 INFO:tasks.workunit.client.3.smithi157.stdout: 7.40 116.8k 92.8k 0.0k 1.1M 928.0k 0.0k nvme2n7 2024-03-26T17:10:43.073 INFO:tasks.workunit.client.3.smithi157.stdout: 7.40 49.6k 84.4k 0.0k 496.0k 844.0k 0.0k nvme2n8 2024-03-26T17:10:43.073 INFO:tasks.workunit.client.3.smithi157.stdout: 7.40 58.8k 59.2k 0.0k 588.0k 592.0k 0.0k nvme2n9 2024-03-26T17:10:43.073 INFO:tasks.workunit.client.3.smithi157.stdout: 7.40 124.8k 86.0k 0.0k 1.2M 860.0k 0.0k nvme5n1 2024-03-26T17:10:43.073 INFO:tasks.workunit.client.3.smithi157.stdout: 7.50 66.8k 68.0k 0.0k 668.0k 680.0k 0.0k nvme5n10 2024-03-26T17:10:43.073 INFO:tasks.workunit.client.3.smithi157.stdout: 7.50 72.4k 63.2k 0.0k 724.0k 632.0k 0.0k nvme5n11 2024-03-26T17:10:43.073 INFO:tasks.workunit.client.3.smithi157.stdout: 7.50 47.6k 80.8k 0.0k 476.0k 808.0k 0.0k nvme5n12 2024-03-26T17:10:43.073 INFO:tasks.workunit.client.3.smithi157.stdout: 7.50 108.8k 62.4k 0.0k 1.1M 624.0k 0.0k nvme5n13 2024-03-26T17:10:43.073 INFO:tasks.workunit.client.3.smithi157.stdout: 7.40 73.6k 61.6k 0.0k 736.0k 616.0k 0.0k nvme5n14 2024-03-26T17:10:43.073 INFO:tasks.workunit.client.3.smithi157.stdout: 7.40 93.2k 61.6k 0.0k 932.0k 616.0k 0.0k nvme5n15 2024-03-26T17:10:43.074 INFO:tasks.workunit.client.3.smithi157.stdout: 7.40 104.8k 86.8k 0.0k 1.0M 868.0k 0.0k nvme5n16 2024-03-26T17:10:43.074 INFO:tasks.workunit.client.3.smithi157.stdout: 7.40 92.8k 110.4k 0.0k 928.0k 1.1M 0.0k nvme5n17 2024-03-26T17:10:43.074 INFO:tasks.workunit.client.3.smithi157.stdout: 7.40 77.6k 62.8k 0.0k 776.0k 628.0k 0.0k nvme5n18 2024-03-26T17:10:43.074 INFO:tasks.workunit.client.3.smithi157.stdout: 7.40 74.4k 95.2k 0.0k 744.0k 952.0k 0.0k nvme5n19 2024-03-26T17:10:43.074 INFO:tasks.workunit.client.3.smithi157.stdout: 7.40 80.4k 81.2k 0.0k 804.0k 812.0k 0.0k nvme5n2 2024-03-26T17:10:43.074 INFO:tasks.workunit.client.3.smithi157.stdout: 7.40 69.2k 66.0k 0.0k 692.0k 660.0k 0.0k nvme5n20 2024-03-26T17:10:43.074 INFO:tasks.workunit.client.3.smithi157.stdout: 7.40 51.6k 64.4k 0.0k 516.0k 644.0k 0.0k nvme5n3 2024-03-26T17:10:43.074 INFO:tasks.workunit.client.3.smithi157.stdout: 7.40 70.8k 71.2k 0.0k 708.0k 712.0k 0.0k nvme5n4 2024-03-26T17:10:43.074 INFO:tasks.workunit.client.3.smithi157.stdout: 7.40 67.6k 72.8k 0.0k 676.0k 728.0k 0.0k nvme5n5 2024-03-26T17:10:43.074 INFO:tasks.workunit.client.3.smithi157.stdout: 7.40 80.4k 62.4k 0.0k 804.0k 624.0k 0.0k nvme5n6 2024-03-26T17:10:43.074 INFO:tasks.workunit.client.3.smithi157.stdout: 7.40 112.4k 88.8k 0.0k 1.1M 888.0k 0.0k nvme5n7 2024-03-26T17:10:43.075 INFO:tasks.workunit.client.3.smithi157.stdout: 7.40 62.8k 80.4k 0.0k 628.0k 804.0k 0.0k nvme5n8 2024-03-26T17:10:43.075 INFO:tasks.workunit.client.3.smithi157.stdout: 7.40 59.2k 60.0k 0.0k 592.0k 600.0k 0.0k nvme5n9 2024-03-26T17:10:43.075 INFO:tasks.workunit.client.3.smithi157.stdout: 7.40 64.8k 66.0k 0.0k 648.0k 660.0k 0.0k nvme8n1 2024-03-26T17:10:43.075 INFO:tasks.workunit.client.3.smithi157.stdout: 7.50 78.0k 52.0k 0.0k 780.0k 520.0k 0.0k nvme8n10 2024-03-26T17:10:43.075 INFO:tasks.workunit.client.3.smithi157.stdout: 7.50 96.8k 82.0k 0.0k 968.0k 820.0k 0.0k nvme8n11 2024-03-26T17:10:43.075 INFO:tasks.workunit.client.3.smithi157.stdout: 7.50 136.0k 130.8k 0.0k 1.3M 1.3M 0.0k nvme8n12 2024-03-26T17:10:43.075 INFO:tasks.workunit.client.3.smithi157.stdout: 7.40 67.2k 71.2k 0.0k 672.0k 712.0k 0.0k nvme8n13 2024-03-26T17:10:43.075 INFO:tasks.workunit.client.3.smithi157.stdout: 7.40 122.8k 104.8k 0.0k 1.2M 1.0M 0.0k nvme8n14 2024-03-26T17:10:43.075 INFO:tasks.workunit.client.3.smithi157.stdout: 7.40 93.2k 67.2k 0.0k 932.0k 672.0k 0.0k nvme8n15 2024-03-26T17:10:43.075 INFO:tasks.workunit.client.3.smithi157.stdout: 7.40 110.0k 134.4k 0.0k 1.1M 1.3M 0.0k nvme8n16 2024-03-26T17:10:43.075 INFO:tasks.workunit.client.3.smithi157.stdout: 7.40 56.4k 55.6k 0.0k 564.0k 556.0k 0.0k nvme8n17 2024-03-26T17:10:43.075 INFO:tasks.workunit.client.3.smithi157.stdout: 7.40 62.8k 58.4k 0.0k 628.0k 584.0k 0.0k nvme8n18 2024-03-26T17:10:43.075 INFO:tasks.workunit.client.3.smithi157.stdout: 7.40 66.0k 59.6k 0.0k 660.0k 596.0k 0.0k nvme8n19 2024-03-26T17:10:43.075 INFO:tasks.workunit.client.3.smithi157.stdout: 7.40 105.2k 91.2k 0.0k 1.0M 912.0k 0.0k nvme8n2 2024-03-26T17:10:43.076 INFO:tasks.workunit.client.3.smithi157.stdout: 7.40 42.4k 94.4k 0.0k 424.0k 944.0k 0.0k nvme8n20 2024-03-26T17:10:43.076 INFO:tasks.workunit.client.3.smithi157.stdout: 7.40 66.8k 84.0k 0.0k 668.0k 840.0k 0.0k nvme8n3 2024-03-26T17:10:43.076 INFO:tasks.workunit.client.3.smithi157.stdout: 7.40 84.0k 85.6k 0.0k 840.0k 856.0k 0.0k nvme8n4 2024-03-26T17:10:43.076 INFO:tasks.workunit.client.3.smithi157.stdout: 7.40 70.0k 75.2k 0.0k 700.0k 752.0k 0.0k nvme8n5 2024-03-26T17:10:43.076 INFO:tasks.workunit.client.3.smithi157.stdout: 7.40 115.2k 97.2k 0.0k 1.1M 972.0k 0.0k nvme8n6 2024-03-26T17:10:43.076 INFO:tasks.workunit.client.3.smithi157.stdout: 7.40 73.2k 52.8k 0.0k 732.0k 528.0k 0.0k nvme8n7 2024-03-26T17:10:43.076 INFO:tasks.workunit.client.3.smithi157.stdout: 7.40 57.6k 102.4k 0.0k 576.0k 1.0M 0.0k nvme8n8 2024-03-26T17:10:43.076 INFO:tasks.workunit.client.3.smithi157.stdout: 7.40 73.2k 72.0k 0.0k 732.0k 720.0k 0.0k nvme8n9 2024-03-26T17:10:43.076 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:10:43.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:10:43 smithi149 ceph-mon[34678]: pgmap v748: 33 pgs: 33 active+clean; 1.0 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 4.6 MiB/s rd, 4.4 MiB/s wr, 449 op/s 2024-03-26T17:10:43.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:10:43 smithi044 ceph-mon[30624]: pgmap v748: 33 pgs: 33 active+clean; 1.0 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 4.6 MiB/s rd, 4.4 MiB/s wr, 449 op/s 2024-03-26T17:10:43.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:10:43 smithi064 ceph-mon[34420]: pgmap v748: 33 pgs: 33 active+clean; 1.0 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 4.6 MiB/s rd, 4.4 MiB/s wr, 449 op/s 2024-03-26T17:10:43.555 INFO:tasks.workunit.client.3.smithi157.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-26T17:10:43.556 INFO:tasks.workunit.client.3.smithi157.stdout:myimage10 5/s 3/s 167 KiB/s 69 KiB/s 2.81 ms 312.89 us 2024-03-26T17:10:43.556 INFO:tasks.workunit.client.3.smithi157.stdout:myimage2 5/s 3/s 94 KiB/s 79 KiB/s 3.55 ms 376.66 us 2024-03-26T17:10:43.556 INFO:tasks.workunit.client.3.smithi157.stdout:myimage6 5/s 3/s 171 KiB/s 78 KiB/s 3.18 ms 349.83 us 2024-03-26T17:10:43.556 INFO:tasks.workunit.client.3.smithi157.stdout:myimage59 5/s 4/s 88 KiB/s 76 KiB/s 3.05 ms 390.39 us 2024-03-26T17:10:43.556 INFO:tasks.workunit.client.3.smithi157.stdout:myimage29 4/s 4/s 75 KiB/s 64 KiB/s 2.58 ms 436.83 us 2024-03-26T17:10:43.556 INFO:tasks.workunit.client.3.smithi157.stdout:myimage14 4/s 3/s 82 KiB/s 58 KiB/s 2.89 ms 424.33 us 2024-03-26T17:10:43.556 INFO:tasks.workunit.client.3.smithi157.stdout:myimage4 4/s 3/s 88 KiB/s 79 KiB/s 3.17 ms 367.67 us 2024-03-26T17:10:43.556 INFO:tasks.workunit.client.3.smithi157.stdout:myimage5 4/s 3/s 81 KiB/s 62 KiB/s 2.76 ms 360.26 us 2024-03-26T17:10:43.556 INFO:tasks.workunit.client.3.smithi157.stdout:myimage25 4/s 3/s 78 KiB/s 86 KiB/s 3.76 ms 360.51 us 2024-03-26T17:10:43.556 INFO:tasks.workunit.client.3.smithi157.stdout:myimage16 4/s 2/s 62 KiB/s 58 KiB/s 2.88 ms 324.89 us 2024-03-26T17:10:43.557 INFO:tasks.workunit.client.3.smithi157.stdout:myimage8 4/s 3/s 82 KiB/s 62 KiB/s 2.76 ms 364.74 us 2024-03-26T17:10:43.557 INFO:tasks.workunit.client.3.smithi157.stdout:myimage26 4/s 3/s 74 KiB/s 75 KiB/s 3.30 ms 349.16 us 2024-03-26T17:10:43.557 INFO:tasks.workunit.client.3.smithi157.stdout:myimage51 4/s 5/s 119 KiB/s 136 KiB/s 3.09 ms 474.56 us 2024-03-26T17:10:43.557 INFO:tasks.workunit.client.3.smithi157.stdout:myimage23 4/s 3/s 66 KiB/s 51 KiB/s 2.63 ms 343.04 us 2024-03-26T17:10:43.557 INFO:tasks.workunit.client.3.smithi157.stdout:myimage7 4/s 3/s 122 KiB/s 120 KiB/s 3.21 ms 370.36 us 2024-03-26T17:10:43.557 INFO:tasks.workunit.client.3.smithi157.stdout:myimage11 4/s 4/s 87 KiB/s 86 KiB/s 2.75 ms 316.72 us 2024-03-26T17:10:43.557 INFO:tasks.workunit.client.3.smithi157.stdout:myimage12 4/s 3/s 119 KiB/s 61 KiB/s 2.98 ms 379.69 us 2024-03-26T17:10:43.557 INFO:tasks.workunit.client.3.smithi157.stdout:myimage24 4/s 2/s 68 KiB/s 65 KiB/s 3.50 ms 435.47 us 2024-03-26T17:10:43.557 INFO:tasks.workunit.client.3.smithi157.stdout:myimage56 4/s 3/s 153 KiB/s 114 KiB/s 3.65 ms 374.29 us 2024-03-26T17:10:43.557 INFO:tasks.workunit.client.3.smithi157.stdout:myimage32 4/s 3/s 85 KiB/s 66 KiB/s 3.23 ms 389.45 us 2024-03-26T17:10:43.557 INFO:tasks.workunit.client.3.smithi157.stdout:myimage40 4/s 4/s 60 KiB/s 74 KiB/s 2.58 ms 392.83 us 2024-03-26T17:10:43.557 INFO:tasks.workunit.client.3.smithi157.stdout:myimage52 4/s 4/s 133 KiB/s 160 KiB/s 3.46 ms 352.93 us 2024-03-26T17:10:43.557 INFO:tasks.workunit.client.3.smithi157.stdout:myimage48 3/s 1/s 106 KiB/s 46 KiB/s 3.06 ms 341.78 us 2024-03-26T17:10:43.558 INFO:tasks.workunit.client.3.smithi157.stdout:myimage15 3/s 3/s 120 KiB/s 87 KiB/s 2.41 ms 315.56 us 2024-03-26T17:10:43.558 INFO:tasks.workunit.client.3.smithi157.stdout:myimage28 3/s 4/s 53 KiB/s 66 KiB/s 4.04 ms 332.00 us 2024-03-26T17:10:43.558 INFO:tasks.workunit.client.3.smithi157.stdout:myimage36 3/s 4/s 108 KiB/s 124 KiB/s 2.88 ms 450.99 us 2024-03-26T17:10:43.558 INFO:tasks.workunit.client.3.smithi157.stdout:myimage42 3/s 5/s 88 KiB/s 168 KiB/s 2.62 ms 419.22 us 2024-03-26T17:10:43.558 INFO:tasks.workunit.client.3.smithi157.stdout:myimage54 3/s 3/s 118 KiB/s 110 KiB/s 2.89 ms 562.16 us 2024-03-26T17:10:43.558 INFO:tasks.workunit.client.3.smithi157.stdout:myimage44 3/s 4/s 82 KiB/s 117 KiB/s 3.26 ms 325.90 us 2024-03-26T17:10:43.558 INFO:tasks.workunit.client.3.smithi157.stdout:myimage1 3/s 3/s 113 KiB/s 93 KiB/s 2.91 ms 335.25 us 2024-03-26T17:10:43.558 INFO:tasks.workunit.client.3.smithi157.stdout:myimage21 3/s 3/s 83 KiB/s 110 KiB/s 4.04 ms 530.29 us 2024-03-26T17:10:43.558 INFO:tasks.workunit.client.3.smithi157.stdout:myimage43 3/s 3/s 82 KiB/s 60 KiB/s 3.29 ms 332.35 us 2024-03-26T17:10:43.558 INFO:tasks.workunit.client.3.smithi157.stdout:myimage45 3/s 3/s 69 KiB/s 61 KiB/s 3.10 ms 313.34 us 2024-03-26T17:10:43.558 INFO:tasks.workunit.client.3.smithi157.stdout:myimage46 3/s 4/s 134 KiB/s 159 KiB/s 3.04 ms 378.52 us 2024-03-26T17:10:43.559 INFO:tasks.workunit.client.3.smithi157.stdout:myimage55 3/s 4/s 50 KiB/s 81 KiB/s 3.68 ms 438.09 us 2024-03-26T17:10:43.559 INFO:tasks.workunit.client.3.smithi157.stdout:myimage31 3/s 2/s 61 KiB/s 53 KiB/s 4.15 ms 345.70 us 2024-03-26T17:10:43.559 INFO:tasks.workunit.client.3.smithi157.stdout:myimage37 3/s 3/s 92 KiB/s 103 KiB/s 2.98 ms 376.08 us 2024-03-26T17:10:43.559 INFO:tasks.workunit.client.3.smithi157.stdout:myimage20 3/s 4/s 100 KiB/s 116 KiB/s 3.01 ms 334.94 us 2024-03-26T17:10:43.559 INFO:tasks.workunit.client.3.smithi157.stdout:myimage50 3/s 2/s 60 KiB/s 68 KiB/s 3.46 ms 357.72 us 2024-03-26T17:10:43.559 INFO:tasks.workunit.client.3.smithi157.stdout:myimage3 3/s 3/s 84 KiB/s 78 KiB/s 2.26 ms 425.90 us 2024-03-26T17:10:43.559 INFO:tasks.workunit.client.3.smithi157.stdout:myimage30 3/s 4/s 54 KiB/s 75 KiB/s 3.80 ms 306.87 us 2024-03-26T17:10:43.559 INFO:tasks.workunit.client.3.smithi157.stdout:myimage35 3/s 5/s 63 KiB/s 120 KiB/s 2.89 ms 384.95 us 2024-03-26T17:10:43.559 INFO:tasks.workunit.client.3.smithi157.stdout:myimage58 3/s 3/s 50 KiB/s 56 KiB/s 2.61 ms 301.89 us 2024-03-26T17:10:43.559 INFO:tasks.workunit.client.3.smithi157.stdout:myimage39 3/s 2/s 83 KiB/s 60 KiB/s 3.17 ms 343.47 us 2024-03-26T17:10:43.559 INFO:tasks.workunit.client.3.smithi157.stdout:myimage53 3/s 3/s 72 KiB/s 71 KiB/s 2.51 ms 514.85 us 2024-03-26T17:10:43.559 INFO:tasks.workunit.client.3.smithi157.stdout:myimage9 3/s 3/s 38 KiB/s 40 KiB/s 3.22 ms 298.73 us 2024-03-26T17:10:43.559 INFO:tasks.workunit.client.3.smithi157.stdout:myimage18 3/s 3/s 47 KiB/s 74 KiB/s 2.91 ms 460.71 us 2024-03-26T17:10:43.560 INFO:tasks.workunit.client.3.smithi157.stdout:myimage19 3/s 4/s 62 KiB/s 83 KiB/s 3.20 ms 356.22 us 2024-03-26T17:10:43.560 INFO:tasks.workunit.client.3.smithi157.stdout:myimage27 3/s 3/s 81 KiB/s 94 KiB/s 2.54 ms 357.64 us 2024-03-26T17:10:43.560 INFO:tasks.workunit.client.3.smithi157.stdout:myimage22 2/s 4/s 51 KiB/s 98 KiB/s 2.75 ms 325.96 us 2024-03-26T17:10:43.560 INFO:tasks.workunit.client.3.smithi157.stdout:myimage49 2/s 3/s 57 KiB/s 63 KiB/s 2.91 ms 323.30 us 2024-03-26T17:10:43.560 INFO:tasks.workunit.client.3.smithi157.stdout:myimage41 2/s 3/s 42 KiB/s 63 KiB/s 3.09 ms 447.79 us 2024-03-26T17:10:43.560 INFO:tasks.workunit.client.3.smithi157.stdout:myimage57 2/s 5/s 56 KiB/s 71 KiB/s 2.67 ms 331.37 us 2024-03-26T17:10:43.560 INFO:tasks.workunit.client.3.smithi157.stdout:myimage60 2/s 2/s 66 KiB/s 40 KiB/s 3.63 ms 427.80 us 2024-03-26T17:10:43.560 INFO:tasks.workunit.client.3.smithi157.stdout:myimage13 2/s 3/s 82 KiB/s 121 KiB/s 2.41 ms 364.85 us 2024-03-26T17:10:43.561 INFO:tasks.workunit.client.3.smithi157.stdout:myimage17 2/s 3/s 43 KiB/s 45 KiB/s 3.03 ms 374.44 us 2024-03-26T17:10:43.561 INFO:tasks.workunit.client.3.smithi157.stdout:myimage34 2/s 4/s 52 KiB/s 82 KiB/s 2.66 ms 330.03 us 2024-03-26T17:10:43.561 INFO:tasks.workunit.client.3.smithi157.stdout:myimage33 2/s 4/s 42 KiB/s 95 KiB/s 3.05 ms 360.53 us 2024-03-26T17:10:43.561 INFO:tasks.workunit.client.3.smithi157.stdout:myimage47 2/s 2/s 24 KiB/s 53 KiB/s 2.85 ms 332.88 us 2024-03-26T17:10:43.561 INFO:tasks.workunit.client.3.smithi157.stdout:myimage38 1/s 2/s 15 KiB/s 63 KiB/s 2.28 ms 309.41 us 2024-03-26T17:10:43.561 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:10:44.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:10:43 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:10:43] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:10:44.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:10:43 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:10:43] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:10:44.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:10:43 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:10:44.297 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:10:44 smithi149 ceph-mon[34678]: Health check update: 3 slow ops, oldest one blocked for 738 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:10:44.298 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:10:43 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:10:43] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:10:44.298 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:10:43 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:10:43] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:10:44.298 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:10:43 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:10:44.456 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:10:44 smithi064 ceph-mon[34420]: Health check update: 3 slow ops, oldest one blocked for 738 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:10:44.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:10:44 smithi044 ceph-mon[30624]: Health check update: 3 slow ops, oldest one blocked for 738 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:10:45.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:10:45 smithi149 ceph-mon[34678]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:10:45.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:10:45 smithi149 ceph-mon[34678]: { 2024-03-26T17:10:45.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:10:45 smithi149 ceph-mon[34678]: "prefix": "rbd perf image stats", 2024-03-26T17:10:45.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:10:45 smithi149 ceph-mon[34678]: "pool_spec": "mypool", 2024-03-26T17:10:45.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:10:45 smithi149 ceph-mon[34678]: "sort_by": "write_ops", 2024-03-26T17:10:45.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:10:45 smithi149 ceph-mon[34678]: "format": "json" 2024-03-26T17:10:45.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:10:45 smithi149 ceph-mon[34678]: }"]: dispatch 2024-03-26T17:10:45.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:10:45 smithi149 ceph-mon[34678]: pgmap v749: 33 pgs: 33 active+clean; 1.0 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 5.0 MiB/s rd, 4.8 MiB/s wr, 475 op/s 2024-03-26T17:10:45.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:10:45 smithi044 ceph-mon[30624]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:10:45.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:10:45 smithi044 ceph-mon[30624]: { 2024-03-26T17:10:45.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:10:45 smithi044 ceph-mon[30624]: "prefix": "rbd perf image stats", 2024-03-26T17:10:45.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:10:45 smithi044 ceph-mon[30624]: "pool_spec": "mypool", 2024-03-26T17:10:45.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:10:45 smithi044 ceph-mon[30624]: "sort_by": "write_ops", 2024-03-26T17:10:45.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:10:45 smithi044 ceph-mon[30624]: "format": "json" 2024-03-26T17:10:45.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:10:45 smithi044 ceph-mon[30624]: }"]: dispatch 2024-03-26T17:10:45.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:10:45 smithi044 ceph-mon[30624]: pgmap v749: 33 pgs: 33 active+clean; 1.0 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 5.0 MiB/s rd, 4.8 MiB/s wr, 475 op/s 2024-03-26T17:10:45.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:10:45 smithi064 ceph-mon[34420]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:10:45.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:10:45 smithi064 ceph-mon[34420]: { 2024-03-26T17:10:45.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:10:45 smithi064 ceph-mon[34420]: "prefix": "rbd perf image stats", 2024-03-26T17:10:45.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:10:45 smithi064 ceph-mon[34420]: "pool_spec": "mypool", 2024-03-26T17:10:45.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:10:45 smithi064 ceph-mon[34420]: "sort_by": "write_ops", 2024-03-26T17:10:45.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:10:45 smithi064 ceph-mon[34420]: "format": "json" 2024-03-26T17:10:45.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:10:45 smithi064 ceph-mon[34420]: }"]: dispatch 2024-03-26T17:10:45.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:10:45 smithi064 ceph-mon[34420]: pgmap v749: 33 pgs: 33 active+clean; 1.0 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 5.0 MiB/s rd, 4.8 MiB/s wr, 475 op/s 2024-03-26T17:10:46.245 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:10:45 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:10:45] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:10:46.245 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:10:45 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:10:45] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:10:46.245 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:10:45 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:10:46.265 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:10:45 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:10:45] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:10:46.265 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:10:45 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:10:45] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:10:46.265 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:10:45 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:10:46.645 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:10:46 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 2024-03-26T17:10:46.243+0000 7fa707a55700 -1 mon.c@1(peon) e3 get_health_metrics reporting 3 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T17:10:47.395 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:10:47 smithi149 ceph-mon[34678]: pgmap v750: 33 pgs: 33 active+clean; 1.0 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 5.1 MiB/s rd, 4.9 MiB/s wr, 477 op/s 2024-03-26T17:10:47.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:10:47 smithi044 ceph-mon[30624]: pgmap v750: 33 pgs: 33 active+clean; 1.0 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 5.1 MiB/s rd, 4.9 MiB/s wr, 477 op/s 2024-03-26T17:10:47.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:10:47 smithi064 ceph-mon[34420]: pgmap v750: 33 pgs: 33 active+clean; 1.0 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 5.1 MiB/s rd, 4.9 MiB/s wr, 477 op/s 2024-03-26T17:10:48.103 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:10:47 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:10:47] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:10:48.103 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:10:47 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:10:47] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:10:48.103 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:10:47 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:10:48.297 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:10:48 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-26T17:10:48.298 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:10:47 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:10:47] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:10:48.298 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:10:47 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:10:47] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:10:48.298 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:10:47 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:10:48.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:10:48 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-26T17:10:48.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:10:48 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-26T17:10:48.565 INFO:tasks.workunit.client.3.smithi157.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-26T17:10:48.565 INFO:tasks.workunit.client.3.smithi157.stdout:myimage9 5/s 3/s 95 KiB/s 83 KiB/s 3.46 ms 342.15 us 2024-03-26T17:10:48.565 INFO:tasks.workunit.client.3.smithi157.stdout:myimage41 5/s 4/s 104 KiB/s 90 KiB/s 3.13 ms 329.16 us 2024-03-26T17:10:48.565 INFO:tasks.workunit.client.3.smithi157.stdout:myimage39 4/s 4/s 153 KiB/s 100 KiB/s 2.89 ms 334.99 us 2024-03-26T17:10:48.565 INFO:tasks.workunit.client.3.smithi157.stdout:myimage34 4/s 3/s 81 KiB/s 34 KiB/s 2.82 ms 364.59 us 2024-03-26T17:10:48.565 INFO:tasks.workunit.client.3.smithi157.stdout:myimage37 4/s 2/s 172 KiB/s 86 KiB/s 3.20 ms 615.04 us 2024-03-26T17:10:48.566 INFO:tasks.workunit.client.3.smithi157.stdout:myimage12 4/s 2/s 90 KiB/s 29 KiB/s 3.12 ms 501.39 us 2024-03-26T17:10:48.566 INFO:tasks.workunit.client.3.smithi157.stdout:myimage60 4/s 3/s 122 KiB/s 66 KiB/s 3.44 ms 503.45 us 2024-03-26T17:10:48.566 INFO:tasks.workunit.client.3.smithi157.stdout:myimage32 4/s 3/s 89 KiB/s 54 KiB/s 3.33 ms 424.50 us 2024-03-26T17:10:48.566 INFO:tasks.workunit.client.3.smithi157.stdout:myimage38 4/s 4/s 109 KiB/s 113 KiB/s 2.15 ms 355.80 us 2024-03-26T17:10:48.566 INFO:tasks.workunit.client.3.smithi157.stdout:myimage8 4/s 2/s 102 KiB/s 34 KiB/s 3.52 ms 306.64 us 2024-03-26T17:10:48.566 INFO:tasks.workunit.client.3.smithi157.stdout:myimage21 4/s 2/s 122 KiB/s 67 KiB/s 3.99 ms 385.60 us 2024-03-26T17:10:48.566 INFO:tasks.workunit.client.3.smithi157.stdout:myimage45 4/s 4/s 105 KiB/s 82 KiB/s 3.06 ms 320.57 us 2024-03-26T17:10:48.566 INFO:tasks.workunit.client.3.smithi157.stdout:myimage40 4/s 2/s 139 KiB/s 86 KiB/s 2.78 ms 360.00 us 2024-03-26T17:10:48.566 INFO:tasks.workunit.client.3.smithi157.stdout:myimage48 4/s 2/s 135 KiB/s 83 KiB/s 3.42 ms 304.11 us 2024-03-26T17:10:48.566 INFO:tasks.workunit.client.3.smithi157.stdout:myimage24 4/s 3/s 82 KiB/s 50 KiB/s 3.26 ms 365.36 us 2024-03-26T17:10:48.566 INFO:tasks.workunit.client.3.smithi157.stdout:myimage36 4/s 2/s 112 KiB/s 70 KiB/s 3.01 ms 344.89 us 2024-03-26T17:10:48.567 INFO:tasks.workunit.client.3.smithi157.stdout:myimage50 4/s 4/s 106 KiB/s 94 KiB/s 3.71 ms 400.71 us 2024-03-26T17:10:48.567 INFO:tasks.workunit.client.3.smithi157.stdout:myimage54 4/s 2/s 94 KiB/s 93 KiB/s 2.76 ms 558.00 us 2024-03-26T17:10:48.567 INFO:tasks.workunit.client.3.smithi157.stdout:myimage13 3/s 3/s 128 KiB/s 102 KiB/s 2.70 ms 355.71 us 2024-03-26T17:10:48.567 INFO:tasks.workunit.client.3.smithi157.stdout:myimage44 3/s 4/s 108 KiB/s 142 KiB/s 2.88 ms 432.54 us 2024-03-26T17:10:48.567 INFO:tasks.workunit.client.3.smithi157.stdout:myimage47 3/s 3/s 95 KiB/s 75 KiB/s 3.08 ms 323.69 us 2024-03-26T17:10:48.567 INFO:tasks.workunit.client.3.smithi157.stdout:myimage15 3/s 3/s 144 KiB/s 98 KiB/s 2.66 ms 427.67 us 2024-03-26T17:10:48.567 INFO:tasks.workunit.client.3.smithi157.stdout:myimage43 3/s 3/s 50 KiB/s 48 KiB/s 3.63 ms 327.30 us 2024-03-26T17:10:48.567 INFO:tasks.workunit.client.3.smithi157.stdout:myimage46 3/s 3/s 102 KiB/s 115 KiB/s 2.96 ms 356.73 us 2024-03-26T17:10:48.567 INFO:tasks.workunit.client.3.smithi157.stdout:myimage57 3/s 3/s 70 KiB/s 59 KiB/s 3.24 ms 350.31 us 2024-03-26T17:10:48.567 INFO:tasks.workunit.client.3.smithi157.stdout:myimage14 3/s 3/s 86 KiB/s 93 KiB/s 3.03 ms 316.27 us 2024-03-26T17:10:48.567 INFO:tasks.workunit.client.3.smithi157.stdout:myimage16 3/s 5/s 72 KiB/s 102 KiB/s 3.40 ms 351.78 us 2024-03-26T17:10:48.567 INFO:tasks.workunit.client.3.smithi157.stdout:myimage31 3/s 5/s 82 KiB/s 178 KiB/s 4.19 ms 467.62 us 2024-03-26T17:10:48.567 INFO:tasks.workunit.client.3.smithi157.stdout:myimage18 3/s 3/s 89 KiB/s 101 KiB/s 3.19 ms 345.98 us 2024-03-26T17:10:48.567 INFO:tasks.workunit.client.3.smithi157.stdout:myimage29 3/s 3/s 82 KiB/s 52 KiB/s 2.75 ms 327.58 us 2024-03-26T17:10:48.568 INFO:tasks.workunit.client.3.smithi157.stdout:myimage55 3/s 3/s 76 KiB/s 85 KiB/s 3.35 ms 359.49 us 2024-03-26T17:10:48.568 INFO:tasks.workunit.client.3.smithi157.stdout:myimage56 3/s 3/s 102 KiB/s 85 KiB/s 3.80 ms 412.83 us 2024-03-26T17:10:48.568 INFO:tasks.workunit.client.3.smithi157.stdout:myimage3 3/s 4/s 87 KiB/s 130 KiB/s 2.49 ms 413.87 us 2024-03-26T17:10:48.568 INFO:tasks.workunit.client.3.smithi157.stdout:myimage22 3/s 2/s 100 KiB/s 87 KiB/s 3.32 ms 329.54 us 2024-03-26T17:10:48.568 INFO:tasks.workunit.client.3.smithi157.stdout:myimage52 3/s 3/s 97 KiB/s 106 KiB/s 3.46 ms 509.75 us 2024-03-26T17:10:48.568 INFO:tasks.workunit.client.3.smithi157.stdout:myimage7 3/s 3/s 99 KiB/s 104 KiB/s 3.08 ms 412.59 us 2024-03-26T17:10:48.568 INFO:tasks.workunit.client.3.smithi157.stdout:myimage11 3/s 3/s 67 KiB/s 71 KiB/s 3.23 ms 464.17 us 2024-03-26T17:10:48.568 INFO:tasks.workunit.client.3.smithi157.stdout:myimage26 3/s 3/s 42 KiB/s 79 KiB/s 3.12 ms 379.69 us 2024-03-26T17:10:48.568 INFO:tasks.workunit.client.3.smithi157.stdout:myimage42 3/s 3/s 130 KiB/s 82 KiB/s 2.97 ms 391.81 us 2024-03-26T17:10:48.568 INFO:tasks.workunit.client.3.smithi157.stdout:myimage51 3/s 3/s 87 KiB/s 75 KiB/s 3.20 ms 331.39 us 2024-03-26T17:10:48.568 INFO:tasks.workunit.client.3.smithi157.stdout:myimage10 3/s 3/s 105 KiB/s 141 KiB/s 2.97 ms 334.50 us 2024-03-26T17:10:48.568 INFO:tasks.workunit.client.3.smithi157.stdout:myimage35 3/s 3/s 70 KiB/s 82 KiB/s 3.04 ms 463.33 us 2024-03-26T17:10:48.568 INFO:tasks.workunit.client.3.smithi157.stdout:myimage49 3/s 3/s 46 KiB/s 64 KiB/s 3.26 ms 308.51 us 2024-03-26T17:10:48.568 INFO:tasks.workunit.client.3.smithi157.stdout:myimage1 3/s 4/s 83 KiB/s 133 KiB/s 2.57 ms 321.35 us 2024-03-26T17:10:48.569 INFO:tasks.workunit.client.3.smithi157.stdout:myimage25 3/s 3/s 62 KiB/s 126 KiB/s 3.38 ms 385.74 us 2024-03-26T17:10:48.569 INFO:tasks.workunit.client.3.smithi157.stdout:myimage28 3/s 3/s 74 KiB/s 67 KiB/s 4.10 ms 331.57 us 2024-03-26T17:10:48.569 INFO:tasks.workunit.client.3.smithi157.stdout:myimage23 3/s 3/s 54 KiB/s 57 KiB/s 2.65 ms 296.74 us 2024-03-26T17:10:48.569 INFO:tasks.workunit.client.3.smithi157.stdout:myimage58 3/s 3/s 83 KiB/s 102 KiB/s 2.92 ms 473.34 us 2024-03-26T17:10:48.569 INFO:tasks.workunit.client.3.smithi157.stdout:myimage5 3/s 3/s 58 KiB/s 42 KiB/s 2.52 ms 294.29 us 2024-03-26T17:10:48.569 INFO:tasks.workunit.client.3.smithi157.stdout:myimage6 3/s 4/s 82 KiB/s 161 KiB/s 3.19 ms 403.28 us 2024-03-26T17:10:48.569 INFO:tasks.workunit.client.3.smithi157.stdout:myimage17 3/s 4/s 92 KiB/s 146 KiB/s 3.04 ms 402.58 us 2024-03-26T17:10:48.569 INFO:tasks.workunit.client.3.smithi157.stdout:myimage33 3/s 4/s 106 KiB/s 118 KiB/s 3.14 ms 389.34 us 2024-03-26T17:10:48.569 INFO:tasks.workunit.client.3.smithi157.stdout:myimage53 3/s 4/s 53 KiB/s 81 KiB/s 2.97 ms 306.05 us 2024-03-26T17:10:48.569 INFO:tasks.workunit.client.3.smithi157.stdout:myimage4 2/s 3/s 95 KiB/s 120 KiB/s 3.00 ms 333.01 us 2024-03-26T17:10:48.569 INFO:tasks.workunit.client.3.smithi157.stdout:myimage19 2/s 4/s 32 KiB/s 87 KiB/s 2.60 ms 434.34 us 2024-03-26T17:10:48.569 INFO:tasks.workunit.client.3.smithi157.stdout:myimage20 2/s 3/s 74 KiB/s 112 KiB/s 2.95 ms 364.71 us 2024-03-26T17:10:48.569 INFO:tasks.workunit.client.3.smithi157.stdout:myimage30 2/s 5/s 40 KiB/s 86 KiB/s 3.79 ms 328.09 us 2024-03-26T17:10:48.570 INFO:tasks.workunit.client.3.smithi157.stdout:myimage27 2/s 3/s 79 KiB/s 106 KiB/s 2.72 ms 343.91 us 2024-03-26T17:10:48.570 INFO:tasks.workunit.client.3.smithi157.stdout:myimage2 1/s 4/s 49 KiB/s 138 KiB/s 3.08 ms 394.75 us 2024-03-26T17:10:48.570 INFO:tasks.workunit.client.3.smithi157.stdout:myimage59 1/s 2/s 24 KiB/s 58 KiB/s 2.53 ms 383.58 us 2024-03-26T17:10:48.570 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:10:49.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:10:49 smithi149 ceph-mon[34678]: pgmap v751: 33 pgs: 33 active+clean; 1.0 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 4.6 MiB/s rd, 4.6 MiB/s wr, 418 op/s 2024-03-26T17:10:49.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:10:49 smithi149 ceph-mon[34678]: Health check update: 3 slow ops, oldest one blocked for 743 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:10:49.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:10:49 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T17:10:49.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:10:49 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-26T17:10:49.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:10:49 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T17:10:49.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:10:49 smithi044 ceph-mon[30624]: pgmap v751: 33 pgs: 33 active+clean; 1.0 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 4.6 MiB/s rd, 4.6 MiB/s wr, 418 op/s 2024-03-26T17:10:49.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:10:49 smithi044 ceph-mon[30624]: Health check update: 3 slow ops, oldest one blocked for 743 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:10:49.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:10:49 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T17:10:49.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:10:49 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-26T17:10:49.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:10:49 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T17:10:49.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:10:49 smithi064 ceph-mon[34420]: pgmap v751: 33 pgs: 33 active+clean; 1.0 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 4.6 MiB/s rd, 4.6 MiB/s wr, 418 op/s 2024-03-26T17:10:49.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:10:49 smithi064 ceph-mon[34420]: Health check update: 3 slow ops, oldest one blocked for 743 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:10:49.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:10:49 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T17:10:49.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:10:49 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-26T17:10:49.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:10:49 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T17:10:50.108 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:10:49 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:10:49] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:10:50.108 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:10:49 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:10:49] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:10:50.109 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:10:49 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:10:50.297 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:10:50 smithi149 ceph-mon[34678]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:10:50.297 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:10:50 smithi149 ceph-mon[34678]: { 2024-03-26T17:10:50.297 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:10:50 smithi149 ceph-mon[34678]: "prefix": "rbd perf image stats", 2024-03-26T17:10:50.297 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:10:50 smithi149 ceph-mon[34678]: "pool_spec": "mypool", 2024-03-26T17:10:50.297 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:10:50 smithi149 ceph-mon[34678]: "sort_by": "write_ops", 2024-03-26T17:10:50.297 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:10:50 smithi149 ceph-mon[34678]: "format": "json" 2024-03-26T17:10:50.298 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:10:50 smithi149 ceph-mon[34678]: }"]: dispatch 2024-03-26T17:10:50.298 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:10:50 smithi149 ceph-mon[34678]: pgmap v752: 33 pgs: 33 active+clean; 1.0 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 5.1 MiB/s rd, 5.0 MiB/s wr, 447 op/s 2024-03-26T17:10:50.298 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:10:50 smithi149 ceph-mon[34678]: pgmap v753: 33 pgs: 33 active+clean; 1.0 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 5.1 MiB/s rd, 4.9 MiB/s wr, 425 op/s 2024-03-26T17:10:50.298 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:10:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:10:49] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:10:50.298 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:10:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:10:49] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:10:50.298 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:10:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:10:50.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:10:50 smithi044 ceph-mon[30624]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:10:50.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:10:50 smithi044 ceph-mon[30624]: { 2024-03-26T17:10:50.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:10:50 smithi044 ceph-mon[30624]: "prefix": "rbd perf image stats", 2024-03-26T17:10:50.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:10:50 smithi044 ceph-mon[30624]: "pool_spec": "mypool", 2024-03-26T17:10:50.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:10:50 smithi044 ceph-mon[30624]: "sort_by": "write_ops", 2024-03-26T17:10:50.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:10:50 smithi044 ceph-mon[30624]: "format": "json" 2024-03-26T17:10:50.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:10:50 smithi044 ceph-mon[30624]: }"]: dispatch 2024-03-26T17:10:50.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:10:50 smithi044 ceph-mon[30624]: pgmap v752: 33 pgs: 33 active+clean; 1.0 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 5.1 MiB/s rd, 5.0 MiB/s wr, 447 op/s 2024-03-26T17:10:50.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:10:50 smithi044 ceph-mon[30624]: pgmap v753: 33 pgs: 33 active+clean; 1.0 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 5.1 MiB/s rd, 4.9 MiB/s wr, 425 op/s 2024-03-26T17:10:50.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:10:50 smithi064 ceph-mon[34420]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:10:50.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:10:50 smithi064 ceph-mon[34420]: { 2024-03-26T17:10:50.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:10:50 smithi064 ceph-mon[34420]: "prefix": "rbd perf image stats", 2024-03-26T17:10:50.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:10:50 smithi064 ceph-mon[34420]: "pool_spec": "mypool", 2024-03-26T17:10:50.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:10:50 smithi064 ceph-mon[34420]: "sort_by": "write_ops", 2024-03-26T17:10:50.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:10:50 smithi064 ceph-mon[34420]: "format": "json" 2024-03-26T17:10:50.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:10:50 smithi064 ceph-mon[34420]: }"]: dispatch 2024-03-26T17:10:50.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:10:50 smithi064 ceph-mon[34420]: pgmap v752: 33 pgs: 33 active+clean; 1.0 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 5.1 MiB/s rd, 5.0 MiB/s wr, 447 op/s 2024-03-26T17:10:50.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:10:50 smithi064 ceph-mon[34420]: pgmap v753: 33 pgs: 33 active+clean; 1.0 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 5.1 MiB/s rd, 4.9 MiB/s wr, 425 op/s 2024-03-26T17:10:51.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:10:51 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 2024-03-26T17:10:51.244+0000 7fa707a55700 -1 mon.c@1(peon) e3 get_health_metrics reporting 3 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T17:10:52.110 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:10:51 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:10:51] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:10:52.110 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:10:51 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:10:51] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:10:52.111 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:10:51 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:10:52.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:10:52 smithi149 ceph-mon[34678]: pgmap v754: 33 pgs: 33 active+clean; 1.0 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 5.9 MiB/s rd, 5.7 MiB/s wr, 471 op/s 2024-03-26T17:10:52.396 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:10:51 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:10:51] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:10:52.396 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:10:51 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:10:51] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:10:52.396 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:10:51 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:10:52.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:10:52 smithi044 ceph-mon[30624]: pgmap v754: 33 pgs: 33 active+clean; 1.0 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 5.9 MiB/s rd, 5.7 MiB/s wr, 471 op/s 2024-03-26T17:10:52.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:10:52 smithi064 ceph-mon[34420]: pgmap v754: 33 pgs: 33 active+clean; 1.0 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 5.9 MiB/s rd, 5.7 MiB/s wr, 471 op/s 2024-03-26T17:10:53.063 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:10:53.076 INFO:tasks.workunit.client.3.smithi157.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2024-03-26T17:10:53.076 INFO:tasks.workunit.client.3.smithi157.stdout: 7.30 102.4k 94.4k 0.0k 1.0M 944.0k 0.0k nvme2n1 2024-03-26T17:10:53.076 INFO:tasks.workunit.client.3.smithi157.stdout: 7.20 88.4k 130.0k 0.0k 884.0k 1.3M 0.0k nvme2n10 2024-03-26T17:10:53.076 INFO:tasks.workunit.client.3.smithi157.stdout: 7.20 77.6k 66.4k 0.0k 776.0k 664.0k 0.0k nvme2n11 2024-03-26T17:10:53.076 INFO:tasks.workunit.client.3.smithi157.stdout: 7.20 49.2k 79.2k 0.0k 492.0k 792.0k 0.0k nvme2n12 2024-03-26T17:10:53.076 INFO:tasks.workunit.client.3.smithi157.stdout: 7.30 125.6k 106.0k 0.0k 1.2M 1.0M 0.0k nvme2n13 2024-03-26T17:10:53.076 INFO:tasks.workunit.client.3.smithi157.stdout: 7.30 105.6k 139.6k 0.0k 1.0M 1.4M 0.0k nvme2n14 2024-03-26T17:10:53.076 INFO:tasks.workunit.client.3.smithi157.stdout: 7.30 126.8k 125.6k 0.0k 1.2M 1.2M 0.0k nvme2n15 2024-03-26T17:10:53.076 INFO:tasks.workunit.client.3.smithi157.stdout: 7.30 79.2k 99.6k 0.0k 792.0k 996.0k 0.0k nvme2n16 2024-03-26T17:10:53.076 INFO:tasks.workunit.client.3.smithi157.stdout: 7.30 140.4k 99.2k 0.0k 1.4M 992.0k 0.0k nvme2n17 2024-03-26T17:10:53.076 INFO:tasks.workunit.client.3.smithi157.stdout: 7.30 116.0k 119.6k 0.0k 1.1M 1.2M 0.0k nvme2n18 2024-03-26T17:10:53.076 INFO:tasks.workunit.client.3.smithi157.stdout: 7.30 100.0k 109.6k 0.0k 1000.0k 1.1M 0.0k nvme2n19 2024-03-26T17:10:53.077 INFO:tasks.workunit.client.3.smithi157.stdout: 7.30 125.2k 81.2k 0.0k 1.2M 812.0k 0.0k nvme2n2 2024-03-26T17:10:53.077 INFO:tasks.workunit.client.3.smithi157.stdout: 7.30 151.2k 90.4k 0.0k 1.5M 904.0k 0.0k nvme2n20 2024-03-26T17:10:53.077 INFO:tasks.workunit.client.3.smithi157.stdout: 7.30 112.0k 110.8k 0.0k 1.1M 1.1M 0.0k nvme2n3 2024-03-26T17:10:53.077 INFO:tasks.workunit.client.3.smithi157.stdout: 7.30 110.0k 120.0k 0.0k 1.1M 1.2M 0.0k nvme2n4 2024-03-26T17:10:53.077 INFO:tasks.workunit.client.3.smithi157.stdout: 7.20 89.6k 73.2k 0.0k 896.0k 732.0k 0.0k nvme2n5 2024-03-26T17:10:53.077 INFO:tasks.workunit.client.3.smithi157.stdout: 7.20 116.8k 105.2k 0.0k 1.1M 1.0M 0.0k nvme2n6 2024-03-26T17:10:53.077 INFO:tasks.workunit.client.3.smithi157.stdout: 7.20 126.4k 90.4k 0.0k 1.2M 904.0k 0.0k nvme2n7 2024-03-26T17:10:53.077 INFO:tasks.workunit.client.3.smithi157.stdout: 7.20 98.0k 94.0k 0.0k 980.0k 940.0k 0.0k nvme2n8 2024-03-26T17:10:53.077 INFO:tasks.workunit.client.3.smithi157.stdout: 7.20 110.0k 113.2k 0.0k 1.1M 1.1M 0.0k nvme2n9 2024-03-26T17:10:53.077 INFO:tasks.workunit.client.3.smithi157.stdout: 7.30 89.6k 121.2k 0.0k 896.0k 1.2M 0.0k nvme5n1 2024-03-26T17:10:53.077 INFO:tasks.workunit.client.3.smithi157.stdout: 7.20 60.4k 64.0k 0.0k 604.0k 640.0k 0.0k nvme5n10 2024-03-26T17:10:53.077 INFO:tasks.workunit.client.3.smithi157.stdout: 7.20 149.2k 87.6k 0.0k 1.5M 876.0k 0.0k nvme5n11 2024-03-26T17:10:53.077 INFO:tasks.workunit.client.3.smithi157.stdout: 7.20 89.6k 42.4k 0.0k 896.0k 424.0k 0.0k nvme5n12 2024-03-26T17:10:53.077 INFO:tasks.workunit.client.3.smithi157.stdout: 7.20 155.2k 90.0k 0.0k 1.5M 900.0k 0.0k nvme5n13 2024-03-26T17:10:53.078 INFO:tasks.workunit.client.3.smithi157.stdout: 7.30 71.2k 81.6k 0.0k 712.0k 816.0k 0.0k nvme5n14 2024-03-26T17:10:53.078 INFO:tasks.workunit.client.3.smithi157.stdout: 7.30 75.6k 83.2k 0.0k 756.0k 832.0k 0.0k nvme5n15 2024-03-26T17:10:53.078 INFO:tasks.workunit.client.3.smithi157.stdout: 7.30 116.4k 96.4k 0.0k 1.1M 964.0k 0.0k nvme5n16 2024-03-26T17:10:53.078 INFO:tasks.workunit.client.3.smithi157.stdout: 7.30 89.6k 134.8k 0.0k 896.0k 1.3M 0.0k nvme5n17 2024-03-26T17:10:53.078 INFO:tasks.workunit.client.3.smithi157.stdout: 7.30 140.4k 108.4k 0.0k 1.4M 1.1M 0.0k nvme5n18 2024-03-26T17:10:53.078 INFO:tasks.workunit.client.3.smithi157.stdout: 7.30 102.0k 143.2k 0.0k 1020.0k 1.4M 0.0k nvme5n19 2024-03-26T17:10:53.078 INFO:tasks.workunit.client.3.smithi157.stdout: 7.30 135.2k 108.0k 0.0k 1.3M 1.1M 0.0k nvme5n2 2024-03-26T17:10:53.078 INFO:tasks.workunit.client.3.smithi157.stdout: 7.30 111.2k 123.6k 0.0k 1.1M 1.2M 0.0k nvme5n20 2024-03-26T17:10:53.078 INFO:tasks.workunit.client.3.smithi157.stdout: 7.30 92.0k 75.6k 0.0k 920.0k 756.0k 0.0k nvme5n3 2024-03-26T17:10:53.078 INFO:tasks.workunit.client.3.smithi157.stdout: 7.30 61.6k 82.0k 0.0k 616.0k 820.0k 0.0k nvme5n4 2024-03-26T17:10:53.078 INFO:tasks.workunit.client.3.smithi157.stdout: 7.30 150.4k 99.2k 0.0k 1.5M 992.0k 0.0k nvme5n5 2024-03-26T17:10:53.078 INFO:tasks.workunit.client.3.smithi157.stdout: 7.20 63.6k 58.4k 0.0k 636.0k 584.0k 0.0k nvme5n6 2024-03-26T17:10:53.078 INFO:tasks.workunit.client.3.smithi157.stdout: 7.20 87.6k 119.6k 0.0k 876.0k 1.2M 0.0k nvme5n7 2024-03-26T17:10:53.078 INFO:tasks.workunit.client.3.smithi157.stdout: 7.20 109.6k 85.6k 0.0k 1.1M 856.0k 0.0k nvme5n8 2024-03-26T17:10:53.079 INFO:tasks.workunit.client.3.smithi157.stdout: 7.20 112.4k 103.2k 0.0k 1.1M 1.0M 0.0k nvme5n9 2024-03-26T17:10:53.079 INFO:tasks.workunit.client.3.smithi157.stdout: 7.30 112.4k 92.8k 0.0k 1.1M 928.0k 0.0k nvme8n1 2024-03-26T17:10:53.079 INFO:tasks.workunit.client.3.smithi157.stdout: 7.20 118.0k 103.2k 0.0k 1.2M 1.0M 0.0k nvme8n10 2024-03-26T17:10:53.079 INFO:tasks.workunit.client.3.smithi157.stdout: 7.20 115.2k 114.0k 0.0k 1.1M 1.1M 0.0k nvme8n11 2024-03-26T17:10:53.079 INFO:tasks.workunit.client.3.smithi157.stdout: 7.20 114.0k 67.6k 0.0k 1.1M 676.0k 0.0k nvme8n12 2024-03-26T17:10:53.079 INFO:tasks.workunit.client.3.smithi157.stdout: 7.30 61.6k 62.4k 0.0k 616.0k 624.0k 0.0k nvme8n13 2024-03-26T17:10:53.079 INFO:tasks.workunit.client.3.smithi157.stdout: 7.30 112.4k 106.0k 0.0k 1.1M 1.0M 0.0k nvme8n14 2024-03-26T17:10:53.079 INFO:tasks.workunit.client.3.smithi157.stdout: 7.30 85.6k 93.2k 0.0k 856.0k 932.0k 0.0k nvme8n15 2024-03-26T17:10:53.079 INFO:tasks.workunit.client.3.smithi157.stdout: 7.30 98.8k 104.8k 0.0k 988.0k 1.0M 0.0k nvme8n16 2024-03-26T17:10:53.080 INFO:tasks.workunit.client.3.smithi157.stdout: 7.30 84.8k 81.6k 0.0k 848.0k 816.0k 0.0k nvme8n17 2024-03-26T17:10:53.080 INFO:tasks.workunit.client.3.smithi157.stdout: 7.30 114.0k 116.8k 0.0k 1.1M 1.1M 0.0k nvme8n18 2024-03-26T17:10:53.080 INFO:tasks.workunit.client.3.smithi157.stdout: 7.30 132.0k 82.0k 0.0k 1.3M 820.0k 0.0k nvme8n19 2024-03-26T17:10:53.080 INFO:tasks.workunit.client.3.smithi157.stdout: 7.30 134.4k 105.6k 0.0k 1.3M 1.0M 0.0k nvme8n2 2024-03-26T17:10:53.080 INFO:tasks.workunit.client.3.smithi157.stdout: 7.30 86.8k 114.0k 0.0k 868.0k 1.1M 0.0k nvme8n20 2024-03-26T17:10:53.080 INFO:tasks.workunit.client.3.smithi157.stdout: 7.30 88.8k 76.0k 0.0k 888.0k 760.0k 0.0k nvme8n3 2024-03-26T17:10:53.080 INFO:tasks.workunit.client.3.smithi157.stdout: 7.30 141.6k 94.8k 0.0k 1.4M 948.0k 0.0k nvme8n4 2024-03-26T17:10:53.080 INFO:tasks.workunit.client.3.smithi157.stdout: 7.20 103.2k 121.2k 0.0k 1.0M 1.2M 0.0k nvme8n5 2024-03-26T17:10:53.080 INFO:tasks.workunit.client.3.smithi157.stdout: 7.20 117.2k 132.8k 0.0k 1.1M 1.3M 0.0k nvme8n6 2024-03-26T17:10:53.080 INFO:tasks.workunit.client.3.smithi157.stdout: 7.20 94.0k 116.0k 0.0k 940.0k 1.1M 0.0k nvme8n7 2024-03-26T17:10:53.080 INFO:tasks.workunit.client.3.smithi157.stdout: 7.20 93.2k 130.8k 0.0k 932.0k 1.3M 0.0k nvme8n8 2024-03-26T17:10:53.080 INFO:tasks.workunit.client.3.smithi157.stdout: 7.20 62.8k 58.4k 0.0k 628.0k 584.0k 0.0k nvme8n9 2024-03-26T17:10:53.080 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:10:53.569 INFO:tasks.workunit.client.3.smithi157.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-26T17:10:53.570 INFO:tasks.workunit.client.3.smithi157.stdout:myimage47 5/s 3/s 162 KiB/s 74 KiB/s 3.20 ms 493.16 us 2024-03-26T17:10:53.570 INFO:tasks.workunit.client.3.smithi157.stdout:myimage60 5/s 4/s 143 KiB/s 105 KiB/s 3.28 ms 351.54 us 2024-03-26T17:10:53.570 INFO:tasks.workunit.client.3.smithi157.stdout:myimage5 5/s 3/s 90 KiB/s 110 KiB/s 2.56 ms 354.26 us 2024-03-26T17:10:53.570 INFO:tasks.workunit.client.3.smithi157.stdout:myimage10 4/s 3/s 143 KiB/s 107 KiB/s 3.03 ms 340.06 us 2024-03-26T17:10:53.570 INFO:tasks.workunit.client.3.smithi157.stdout:myimage30 4/s 4/s 89 KiB/s 74 KiB/s 3.50 ms 341.82 us 2024-03-26T17:10:53.570 INFO:tasks.workunit.client.3.smithi157.stdout:myimage21 4/s 3/s 150 KiB/s 110 KiB/s 3.90 ms 327.07 us 2024-03-26T17:10:53.570 INFO:tasks.workunit.client.3.smithi157.stdout:myimage27 4/s 4/s 140 KiB/s 111 KiB/s 2.59 ms 438.22 us 2024-03-26T17:10:53.570 INFO:tasks.workunit.client.3.smithi157.stdout:myimage14 4/s 2/s 124 KiB/s 81 KiB/s 3.53 ms 429.28 us 2024-03-26T17:10:53.570 INFO:tasks.workunit.client.3.smithi157.stdout:myimage16 4/s 2/s 100 KiB/s 65 KiB/s 2.69 ms 380.40 us 2024-03-26T17:10:53.570 INFO:tasks.workunit.client.3.smithi157.stdout:myimage58 4/s 2/s 130 KiB/s 89 KiB/s 2.40 ms 346.11 us 2024-03-26T17:10:53.570 INFO:tasks.workunit.client.3.smithi157.stdout:myimage4 4/s 2/s 128 KiB/s 72 KiB/s 3.02 ms 325.16 us 2024-03-26T17:10:53.571 INFO:tasks.workunit.client.3.smithi157.stdout:myimage12 4/s 2/s 94 KiB/s 50 KiB/s 2.85 ms 385.48 us 2024-03-26T17:10:53.571 INFO:tasks.workunit.client.3.smithi157.stdout:myimage17 4/s 3/s 127 KiB/s 90 KiB/s 3.38 ms 354.18 us 2024-03-26T17:10:53.571 INFO:tasks.workunit.client.3.smithi157.stdout:myimage24 4/s 4/s 78 KiB/s 96 KiB/s 3.68 ms 347.65 us 2024-03-26T17:10:53.571 INFO:tasks.workunit.client.3.smithi157.stdout:myimage44 4/s 3/s 111 KiB/s 114 KiB/s 2.93 ms 381.01 us 2024-03-26T17:10:53.571 INFO:tasks.workunit.client.3.smithi157.stdout:myimage6 4/s 3/s 108 KiB/s 78 KiB/s 3.53 ms 507.77 us 2024-03-26T17:10:53.571 INFO:tasks.workunit.client.3.smithi157.stdout:myimage42 4/s 4/s 120 KiB/s 157 KiB/s 2.72 ms 455.17 us 2024-03-26T17:10:53.571 INFO:tasks.workunit.client.3.smithi157.stdout:myimage56 4/s 3/s 122 KiB/s 96 KiB/s 3.60 ms 351.22 us 2024-03-26T17:10:53.571 INFO:tasks.workunit.client.3.smithi157.stdout:myimage22 4/s 4/s 146 KiB/s 126 KiB/s 2.94 ms 327.58 us 2024-03-26T17:10:53.571 INFO:tasks.workunit.client.3.smithi157.stdout:myimage50 4/s 4/s 90 KiB/s 122 KiB/s 3.01 ms 406.64 us 2024-03-26T17:10:53.571 INFO:tasks.workunit.client.3.smithi157.stdout:myimage55 4/s 2/s 101 KiB/s 45 KiB/s 3.48 ms 344.61 us 2024-03-26T17:10:53.571 INFO:tasks.workunit.client.3.smithi157.stdout:myimage57 4/s 2/s 78 KiB/s 48 KiB/s 2.95 ms 393.06 us 2024-03-26T17:10:53.571 INFO:tasks.workunit.client.3.smithi157.stdout:myimage23 3/s 5/s 94 KiB/s 104 KiB/s 2.15 ms 303.73 us 2024-03-26T17:10:53.571 INFO:tasks.workunit.client.3.smithi157.stdout:myimage19 3/s 3/s 112 KiB/s 112 KiB/s 3.05 ms 563.53 us 2024-03-26T17:10:53.571 INFO:tasks.workunit.client.3.smithi157.stdout:myimage20 3/s 4/s 103 KiB/s 166 KiB/s 2.99 ms 360.35 us 2024-03-26T17:10:53.572 INFO:tasks.workunit.client.3.smithi157.stdout:myimage2 3/s 3/s 104 KiB/s 86 KiB/s 3.30 ms 339.81 us 2024-03-26T17:10:53.572 INFO:tasks.workunit.client.3.smithi157.stdout:myimage31 3/s 3/s 105 KiB/s 87 KiB/s 3.74 ms 351.58 us 2024-03-26T17:10:53.572 INFO:tasks.workunit.client.3.smithi157.stdout:myimage34 3/s 4/s 58 KiB/s 98 KiB/s 3.56 ms 317.51 us 2024-03-26T17:10:53.572 INFO:tasks.workunit.client.3.smithi157.stdout:myimage37 3/s 2/s 105 KiB/s 62 KiB/s 3.42 ms 349.95 us 2024-03-26T17:10:53.572 INFO:tasks.workunit.client.3.smithi157.stdout:myimage48 3/s 3/s 123 KiB/s 98 KiB/s 3.49 ms 353.76 us 2024-03-26T17:10:53.572 INFO:tasks.workunit.client.3.smithi157.stdout:myimage28 3/s 3/s 109 KiB/s 120 KiB/s 3.87 ms 509.09 us 2024-03-26T17:10:53.572 INFO:tasks.workunit.client.3.smithi157.stdout:myimage36 3/s 4/s 76 KiB/s 113 KiB/s 2.95 ms 309.33 us 2024-03-26T17:10:53.572 INFO:tasks.workunit.client.3.smithi157.stdout:myimage46 3/s 3/s 139 KiB/s 120 KiB/s 2.93 ms 506.92 us 2024-03-26T17:10:53.572 INFO:tasks.workunit.client.3.smithi157.stdout:myimage51 3/s 3/s 130 KiB/s 124 KiB/s 3.33 ms 390.94 us 2024-03-26T17:10:53.572 INFO:tasks.workunit.client.3.smithi157.stdout:myimage40 3/s 4/s 113 KiB/s 123 KiB/s 2.77 ms 380.41 us 2024-03-26T17:10:53.572 INFO:tasks.workunit.client.3.smithi157.stdout:myimage9 3/s 3/s 112 KiB/s 118 KiB/s 3.50 ms 390.73 us 2024-03-26T17:10:53.572 INFO:tasks.workunit.client.3.smithi157.stdout:myimage18 3/s 4/s 118 KiB/s 180 KiB/s 2.74 ms 475.99 us 2024-03-26T17:10:53.572 INFO:tasks.workunit.client.3.smithi157.stdout:myimage25 3/s 3/s 110 KiB/s 103 KiB/s 4.07 ms 333.50 us 2024-03-26T17:10:53.572 INFO:tasks.workunit.client.3.smithi157.stdout:myimage39 3/s 3/s 122 KiB/s 122 KiB/s 2.84 ms 331.13 us 2024-03-26T17:10:53.572 INFO:tasks.workunit.client.3.smithi157.stdout:myimage45 3/s 3/s 121 KiB/s 118 KiB/s 3.14 ms 391.46 us 2024-03-26T17:10:53.573 INFO:tasks.workunit.client.3.smithi157.stdout:myimage3 3/s 3/s 117 KiB/s 96 KiB/s 2.60 ms 320.67 us 2024-03-26T17:10:53.573 INFO:tasks.workunit.client.3.smithi157.stdout:myimage35 3/s 3/s 61 KiB/s 47 KiB/s 3.62 ms 316.34 us 2024-03-26T17:10:53.573 INFO:tasks.workunit.client.3.smithi157.stdout:myimage38 3/s 4/s 112 KiB/s 145 KiB/s 2.39 ms 316.22 us 2024-03-26T17:10:53.573 INFO:tasks.workunit.client.3.smithi157.stdout:myimage1 3/s 3/s 113 KiB/s 78 KiB/s 2.38 ms 294.64 us 2024-03-26T17:10:53.573 INFO:tasks.workunit.client.3.smithi157.stdout:myimage11 3/s 3/s 66 KiB/s 73 KiB/s 3.36 ms 359.84 us 2024-03-26T17:10:53.573 INFO:tasks.workunit.client.3.smithi157.stdout:myimage15 3/s 4/s 110 KiB/s 167 KiB/s 2.51 ms 418.95 us 2024-03-26T17:10:53.573 INFO:tasks.workunit.client.3.smithi157.stdout:myimage26 3/s 3/s 50 KiB/s 41 KiB/s 2.97 ms 434.65 us 2024-03-26T17:10:53.573 INFO:tasks.workunit.client.3.smithi157.stdout:myimage43 3/s 4/s 92 KiB/s 78 KiB/s 3.40 ms 446.96 us 2024-03-26T17:10:53.573 INFO:tasks.workunit.client.3.smithi157.stdout:myimage53 3/s 3/s 65 KiB/s 58 KiB/s 3.22 ms 329.30 us 2024-03-26T17:10:53.573 INFO:tasks.workunit.client.3.smithi157.stdout:myimage7 3/s 4/s 96 KiB/s 122 KiB/s 2.93 ms 403.30 us 2024-03-26T17:10:53.573 INFO:tasks.workunit.client.3.smithi157.stdout:myimage29 3/s 4/s 101 KiB/s 166 KiB/s 2.76 ms 451.56 us 2024-03-26T17:10:53.573 INFO:tasks.workunit.client.3.smithi157.stdout:myimage41 3/s 3/s 91 KiB/s 105 KiB/s 2.95 ms 353.84 us 2024-03-26T17:10:53.573 INFO:tasks.workunit.client.3.smithi157.stdout:myimage32 2/s 5/s 30 KiB/s 114 KiB/s 2.69 ms 342.39 us 2024-03-26T17:10:53.573 INFO:tasks.workunit.client.3.smithi157.stdout:myimage33 2/s 5/s 86 KiB/s 180 KiB/s 3.01 ms 452.10 us 2024-03-26T17:10:53.574 INFO:tasks.workunit.client.3.smithi157.stdout:myimage13 2/s 4/s 82 KiB/s 144 KiB/s 2.52 ms 448.96 us 2024-03-26T17:10:53.574 INFO:tasks.workunit.client.3.smithi157.stdout:myimage8 2/s 4/s 73 KiB/s 119 KiB/s 3.02 ms 372.36 us 2024-03-26T17:10:53.574 INFO:tasks.workunit.client.3.smithi157.stdout:myimage54 2/s 4/s 92 KiB/s 153 KiB/s 2.57 ms 384.25 us 2024-03-26T17:10:53.574 INFO:tasks.workunit.client.3.smithi157.stdout:myimage49 2/s 3/s 47 KiB/s 58 KiB/s 3.69 ms 414.29 us 2024-03-26T17:10:53.574 INFO:tasks.workunit.client.3.smithi157.stdout:myimage52 2/s 4/s 66 KiB/s 116 KiB/s 3.23 ms 343.91 us 2024-03-26T17:10:53.574 INFO:tasks.workunit.client.3.smithi157.stdout:myimage59 2/s 3/s 81 KiB/s 128 KiB/s 3.48 ms 432.77 us 2024-03-26T17:10:53.574 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:10:54.112 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:10:53 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:10:53] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:10:54.112 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:10:53 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:10:53] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:10:54.113 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:10:53 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:10:54.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:10:54 smithi149 ceph-mon[34678]: pgmap v755: 33 pgs: 33 active+clean; 1.0 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 5.7 MiB/s rd, 5.7 MiB/s wr, 442 op/s 2024-03-26T17:10:54.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:10:54 smithi149 ceph-mon[34678]: Health check update: 3 slow ops, oldest one blocked for 748 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:10:54.396 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:10:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:10:53] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:10:54.396 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:10:54 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:10:54] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:10:54.396 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:10:54 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:10:54.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:10:54 smithi044 ceph-mon[30624]: pgmap v755: 33 pgs: 33 active+clean; 1.0 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 5.7 MiB/s rd, 5.7 MiB/s wr, 442 op/s 2024-03-26T17:10:54.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:10:54 smithi044 ceph-mon[30624]: Health check update: 3 slow ops, oldest one blocked for 748 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:10:54.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:10:54 smithi064 ceph-mon[34420]: pgmap v755: 33 pgs: 33 active+clean; 1.0 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 5.7 MiB/s rd, 5.7 MiB/s wr, 442 op/s 2024-03-26T17:10:54.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:10:54 smithi064 ceph-mon[34420]: Health check update: 3 slow ops, oldest one blocked for 748 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:10:55.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:10:55 smithi149 ceph-mon[34678]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:10:55.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:10:55 smithi149 ceph-mon[34678]: { 2024-03-26T17:10:55.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:10:55 smithi149 ceph-mon[34678]: "prefix": "rbd perf image stats", 2024-03-26T17:10:55.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:10:55 smithi149 ceph-mon[34678]: "pool_spec": "mypool", 2024-03-26T17:10:55.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:10:55 smithi149 ceph-mon[34678]: "sort_by": "write_ops", 2024-03-26T17:10:55.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:10:55 smithi149 ceph-mon[34678]: "format": "json" 2024-03-26T17:10:55.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:10:55 smithi149 ceph-mon[34678]: }"]: dispatch 2024-03-26T17:10:55.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:10:55 smithi044 ceph-mon[30624]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:10:55.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:10:55 smithi044 ceph-mon[30624]: { 2024-03-26T17:10:55.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:10:55 smithi044 ceph-mon[30624]: "prefix": "rbd perf image stats", 2024-03-26T17:10:55.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:10:55 smithi044 ceph-mon[30624]: "pool_spec": "mypool", 2024-03-26T17:10:55.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:10:55 smithi044 ceph-mon[30624]: "sort_by": "write_ops", 2024-03-26T17:10:55.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:10:55 smithi044 ceph-mon[30624]: "format": "json" 2024-03-26T17:10:55.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:10:55 smithi044 ceph-mon[30624]: }"]: dispatch 2024-03-26T17:10:55.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:10:55 smithi064 ceph-mon[34420]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:10:55.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:10:55 smithi064 ceph-mon[34420]: { 2024-03-26T17:10:55.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:10:55 smithi064 ceph-mon[34420]: "prefix": "rbd perf image stats", 2024-03-26T17:10:55.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:10:55 smithi064 ceph-mon[34420]: "pool_spec": "mypool", 2024-03-26T17:10:55.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:10:55 smithi064 ceph-mon[34420]: "sort_by": "write_ops", 2024-03-26T17:10:55.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:10:55 smithi064 ceph-mon[34420]: "format": "json" 2024-03-26T17:10:55.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:10:55 smithi064 ceph-mon[34420]: }"]: dispatch 2024-03-26T17:10:56.119 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:10:55 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:10:55] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:10:56.120 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:10:55 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:10:55] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:10:56.120 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:10:55 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:10:56.297 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:10:56 smithi149 ceph-mon[34678]: pgmap v756: 33 pgs: 33 active+clean; 1.0 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 5.5 MiB/s rd, 5.3 MiB/s wr, 396 op/s 2024-03-26T17:10:56.297 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:10:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 2024-03-26T17:10:56.244+0000 7fa707a55700 -1 mon.c@1(peon) e3 get_health_metrics reporting 3 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T17:10:56.297 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:10:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:10:56] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:10:56.298 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:10:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:10:56] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:10:56.298 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:10:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:10:56.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:10:56 smithi044 ceph-mon[30624]: pgmap v756: 33 pgs: 33 active+clean; 1.0 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 5.5 MiB/s rd, 5.3 MiB/s wr, 396 op/s 2024-03-26T17:10:56.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:10:56 smithi064 ceph-mon[34420]: pgmap v756: 33 pgs: 33 active+clean; 1.0 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 5.5 MiB/s rd, 5.3 MiB/s wr, 396 op/s 2024-03-26T17:10:58.122 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:10:57 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:10:57] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:10:58.122 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:10:57 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:10:57] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:10:58.122 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:10:57 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:10:58.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:10:58 smithi149 ceph-mon[34678]: pgmap v757: 33 pgs: 33 active+clean; 1.0 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 5.9 MiB/s rd, 5.6 MiB/s wr, 419 op/s 2024-03-26T17:10:58.396 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:10:58 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:10:58] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:10:58.397 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:10:58 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:10:58] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:10:58.397 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:10:58 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:10:58.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:10:58 smithi044 ceph-mon[30624]: pgmap v757: 33 pgs: 33 active+clean; 1.0 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 5.9 MiB/s rd, 5.6 MiB/s wr, 419 op/s 2024-03-26T17:10:58.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:10:58 smithi064 ceph-mon[34420]: pgmap v757: 33 pgs: 33 active+clean; 1.0 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 5.9 MiB/s rd, 5.6 MiB/s wr, 419 op/s 2024-03-26T17:10:58.574 INFO:tasks.workunit.client.3.smithi157.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-26T17:10:58.574 INFO:tasks.workunit.client.3.smithi157.stdout:myimage14 5/s 3/s 177 KiB/s 153 KiB/s 3.15 ms 369.00 us 2024-03-26T17:10:58.574 INFO:tasks.workunit.client.3.smithi157.stdout:myimage48 4/s 3/s 128 KiB/s 114 KiB/s 3.23 ms 359.23 us 2024-03-26T17:10:58.574 INFO:tasks.workunit.client.3.smithi157.stdout:myimage8 4/s 3/s 124 KiB/s 124 KiB/s 3.05 ms 344.87 us 2024-03-26T17:10:58.574 INFO:tasks.workunit.client.3.smithi157.stdout:myimage38 4/s 3/s 142 KiB/s 132 KiB/s 2.36 ms 438.60 us 2024-03-26T17:10:58.574 INFO:tasks.workunit.client.3.smithi157.stdout:myimage12 4/s 3/s 57 KiB/s 54 KiB/s 3.14 ms 439.89 us 2024-03-26T17:10:58.574 INFO:tasks.workunit.client.3.smithi157.stdout:myimage26 4/s 3/s 123 KiB/s 102 KiB/s 2.79 ms 370.95 us 2024-03-26T17:10:58.574 INFO:tasks.workunit.client.3.smithi157.stdout:myimage40 4/s 2/s 115 KiB/s 68 KiB/s 2.80 ms 394.43 us 2024-03-26T17:10:58.574 INFO:tasks.workunit.client.3.smithi157.stdout:myimage49 4/s 5/s 76 KiB/s 92 KiB/s 3.47 ms 393.31 us 2024-03-26T17:10:58.574 INFO:tasks.workunit.client.3.smithi157.stdout:myimage17 4/s 3/s 158 KiB/s 112 KiB/s 3.01 ms 397.76 us 2024-03-26T17:10:58.575 INFO:tasks.workunit.client.3.smithi157.stdout:myimage16 4/s 2/s 128 KiB/s 49 KiB/s 3.09 ms 322.72 us 2024-03-26T17:10:58.575 INFO:tasks.workunit.client.3.smithi157.stdout:myimage6 4/s 2/s 137 KiB/s 78 KiB/s 3.34 ms 440.29 us 2024-03-26T17:10:58.575 INFO:tasks.workunit.client.3.smithi157.stdout:myimage18 4/s 3/s 111 KiB/s 91 KiB/s 2.73 ms 435.91 us 2024-03-26T17:10:58.575 INFO:tasks.workunit.client.3.smithi157.stdout:myimage19 4/s 4/s 154 KiB/s 123 KiB/s 3.01 ms 393.66 us 2024-03-26T17:10:58.575 INFO:tasks.workunit.client.3.smithi157.stdout:myimage53 4/s 3/s 90 KiB/s 80 KiB/s 3.11 ms 341.41 us 2024-03-26T17:10:58.575 INFO:tasks.workunit.client.3.smithi157.stdout:myimage2 4/s 3/s 94 KiB/s 142 KiB/s 3.26 ms 372.11 us 2024-03-26T17:10:58.575 INFO:tasks.workunit.client.3.smithi157.stdout:myimage23 4/s 3/s 121 KiB/s 108 KiB/s 2.58 ms 377.20 us 2024-03-26T17:10:58.575 INFO:tasks.workunit.client.3.smithi157.stdout:myimage37 4/s 3/s 110 KiB/s 114 KiB/s 3.07 ms 370.14 us 2024-03-26T17:10:58.575 INFO:tasks.workunit.client.3.smithi157.stdout:myimage52 4/s 4/s 106 KiB/s 106 KiB/s 3.45 ms 483.35 us 2024-03-26T17:10:58.575 INFO:tasks.workunit.client.3.smithi157.stdout:myimage13 3/s 3/s 112 KiB/s 66 KiB/s 2.65 ms 363.73 us 2024-03-26T17:10:58.575 INFO:tasks.workunit.client.3.smithi157.stdout:myimage31 3/s 3/s 113 KiB/s 132 KiB/s 3.04 ms 482.68 us 2024-03-26T17:10:58.575 INFO:tasks.workunit.client.3.smithi157.stdout:myimage20 3/s 4/s 119 KiB/s 124 KiB/s 2.89 ms 332.08 us 2024-03-26T17:10:58.575 INFO:tasks.workunit.client.3.smithi157.stdout:myimage54 3/s 3/s 114 KiB/s 81 KiB/s 2.91 ms 401.54 us 2024-03-26T17:10:58.575 INFO:tasks.workunit.client.3.smithi157.stdout:myimage60 3/s 3/s 91 KiB/s 117 KiB/s 3.22 ms 362.62 us 2024-03-26T17:10:58.576 INFO:tasks.workunit.client.3.smithi157.stdout:myimage59 3/s 3/s 117 KiB/s 113 KiB/s 3.56 ms 584.85 us 2024-03-26T17:10:58.576 INFO:tasks.workunit.client.3.smithi157.stdout:myimage30 3/s 1/s 67 KiB/s 54 KiB/s 3.74 ms 399.17 us 2024-03-26T17:10:58.576 INFO:tasks.workunit.client.3.smithi157.stdout:myimage34 3/s 4/s 110 KiB/s 118 KiB/s 2.93 ms 323.89 us 2024-03-26T17:10:58.576 INFO:tasks.workunit.client.3.smithi157.stdout:myimage1 3/s 4/s 106 KiB/s 91 KiB/s 2.52 ms 296.76 us 2024-03-26T17:10:58.576 INFO:tasks.workunit.client.3.smithi157.stdout:myimage15 3/s 3/s 100 KiB/s 74 KiB/s 2.64 ms 318.16 us 2024-03-26T17:10:58.576 INFO:tasks.workunit.client.3.smithi157.stdout:myimage24 3/s 2/s 128 KiB/s 65 KiB/s 2.58 ms 353.14 us 2024-03-26T17:10:58.576 INFO:tasks.workunit.client.3.smithi157.stdout:myimage25 3/s 4/s 95 KiB/s 154 KiB/s 4.12 ms 454.24 us 2024-03-26T17:10:58.576 INFO:tasks.workunit.client.3.smithi157.stdout:myimage39 3/s 3/s 89 KiB/s 109 KiB/s 2.97 ms 455.15 us 2024-03-26T17:10:58.576 INFO:tasks.workunit.client.3.smithi157.stdout:myimage43 3/s 4/s 122 KiB/s 110 KiB/s 3.25 ms 351.62 us 2024-03-26T17:10:58.576 INFO:tasks.workunit.client.3.smithi157.stdout:myimage45 3/s 3/s 129 KiB/s 77 KiB/s 2.82 ms 358.53 us 2024-03-26T17:10:58.576 INFO:tasks.workunit.client.3.smithi157.stdout:myimage3 3/s 3/s 102 KiB/s 123 KiB/s 2.74 ms 432.05 us 2024-03-26T17:10:58.576 INFO:tasks.workunit.client.3.smithi157.stdout:myimage22 3/s 3/s 99 KiB/s 120 KiB/s 3.12 ms 319.42 us 2024-03-26T17:10:58.576 INFO:tasks.workunit.client.3.smithi157.stdout:myimage35 3/s 4/s 97 KiB/s 72 KiB/s 3.16 ms 337.53 us 2024-03-26T17:10:58.576 INFO:tasks.workunit.client.3.smithi157.stdout:myimage58 3/s 3/s 146 KiB/s 102 KiB/s 2.58 ms 337.92 us 2024-03-26T17:10:58.576 INFO:tasks.workunit.client.3.smithi157.stdout:myimage4 3/s 4/s 138 KiB/s 121 KiB/s 2.90 ms 329.11 us 2024-03-26T17:10:58.577 INFO:tasks.workunit.client.3.smithi157.stdout:myimage28 3/s 4/s 98 KiB/s 153 KiB/s 4.04 ms 388.37 us 2024-03-26T17:10:58.577 INFO:tasks.workunit.client.3.smithi157.stdout:myimage29 3/s 4/s 118 KiB/s 133 KiB/s 2.64 ms 362.25 us 2024-03-26T17:10:58.577 INFO:tasks.workunit.client.3.smithi157.stdout:myimage55 3/s 4/s 108 KiB/s 115 KiB/s 3.32 ms 387.84 us 2024-03-26T17:10:58.577 INFO:tasks.workunit.client.3.smithi157.stdout:myimage5 3/s 3/s 96 KiB/s 134 KiB/s 2.98 ms 371.05 us 2024-03-26T17:10:58.577 INFO:tasks.workunit.client.3.smithi157.stdout:myimage9 3/s 4/s 105 KiB/s 152 KiB/s 3.26 ms 450.81 us 2024-03-26T17:10:58.577 INFO:tasks.workunit.client.3.smithi157.stdout:myimage46 3/s 4/s 106 KiB/s 113 KiB/s 3.01 ms 443.79 us 2024-03-26T17:10:58.577 INFO:tasks.workunit.client.3.smithi157.stdout:myimage44 3/s 3/s 84 KiB/s 114 KiB/s 2.85 ms 314.90 us 2024-03-26T17:10:58.577 INFO:tasks.workunit.client.3.smithi157.stdout:myimage11 3/s 4/s 57 KiB/s 62 KiB/s 3.93 ms 331.68 us 2024-03-26T17:10:58.577 INFO:tasks.workunit.client.3.smithi157.stdout:myimage33 3/s 4/s 77 KiB/s 159 KiB/s 3.12 ms 353.45 us 2024-03-26T17:10:58.577 INFO:tasks.workunit.client.3.smithi157.stdout:myimage41 3/s 3/s 114 KiB/s 128 KiB/s 3.14 ms 358.71 us 2024-03-26T17:10:58.577 INFO:tasks.workunit.client.3.smithi157.stdout:myimage42 3/s 3/s 89 KiB/s 106 KiB/s 2.87 ms 349.07 us 2024-03-26T17:10:58.577 INFO:tasks.workunit.client.3.smithi157.stdout:myimage51 3/s 4/s 71 KiB/s 155 KiB/s 3.06 ms 370.13 us 2024-03-26T17:10:58.577 INFO:tasks.workunit.client.3.smithi157.stdout:myimage56 3/s 4/s 96 KiB/s 106 KiB/s 3.50 ms 340.31 us 2024-03-26T17:10:58.577 INFO:tasks.workunit.client.3.smithi157.stdout:myimage57 3/s 4/s 98 KiB/s 146 KiB/s 3.05 ms 407.92 us 2024-03-26T17:10:58.577 INFO:tasks.workunit.client.3.smithi157.stdout:myimage10 3/s 3/s 82 KiB/s 117 KiB/s 2.90 ms 413.09 us 2024-03-26T17:10:58.578 INFO:tasks.workunit.client.3.smithi157.stdout:myimage21 2/s 4/s 67 KiB/s 112 KiB/s 3.61 ms 506.89 us 2024-03-26T17:10:58.578 INFO:tasks.workunit.client.3.smithi157.stdout:myimage27 2/s 3/s 104 KiB/s 91 KiB/s 2.91 ms 452.28 us 2024-03-26T17:10:58.578 INFO:tasks.workunit.client.3.smithi157.stdout:myimage36 2/s 5/s 73 KiB/s 188 KiB/s 2.92 ms 380.68 us 2024-03-26T17:10:58.578 INFO:tasks.workunit.client.3.smithi157.stdout:myimage32 2/s 2/s 78 KiB/s 75 KiB/s 2.92 ms 311.12 us 2024-03-26T17:10:58.578 INFO:tasks.workunit.client.3.smithi157.stdout:myimage47 2/s 3/s 78 KiB/s 117 KiB/s 2.99 ms 451.32 us 2024-03-26T17:10:58.578 INFO:tasks.workunit.client.3.smithi157.stdout:myimage50 2/s 4/s 68 KiB/s 161 KiB/s 3.14 ms 389.93 us 2024-03-26T17:10:58.578 INFO:tasks.workunit.client.3.smithi157.stdout:myimage7 1/s 5/s 30 KiB/s 128 KiB/s 2.60 ms 361.94 us 2024-03-26T17:10:58.578 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:10:59.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:10:59 smithi149 ceph-mon[34678]: Health check update: 3 slow ops, oldest one blocked for 753 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:10:59.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:10:59 smithi044 ceph-mon[30624]: Health check update: 3 slow ops, oldest one blocked for 753 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:10:59.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:10:59 smithi064 ceph-mon[34420]: Health check update: 3 slow ops, oldest one blocked for 753 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:11:00.130 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:10:59 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:10:59] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:11:00.131 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:10:59 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:10:59] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:11:00.131 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:10:59 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:11:00.297 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:00 smithi149 ceph-mon[34678]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:11:00.297 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:00 smithi149 ceph-mon[34678]: { 2024-03-26T17:11:00.297 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:00 smithi149 ceph-mon[34678]: "prefix": "rbd perf image stats", 2024-03-26T17:11:00.298 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:00 smithi149 ceph-mon[34678]: "pool_spec": "mypool", 2024-03-26T17:11:00.298 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:00 smithi149 ceph-mon[34678]: "sort_by": "write_ops", 2024-03-26T17:11:00.298 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:00 smithi149 ceph-mon[34678]: "format": "json" 2024-03-26T17:11:00.298 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:00 smithi149 ceph-mon[34678]: }"]: dispatch 2024-03-26T17:11:00.298 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:00 smithi149 ceph-mon[34678]: pgmap v758: 33 pgs: 33 active+clean; 1.0 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 6.3 MiB/s rd, 6.0 MiB/s wr, 446 op/s 2024-03-26T17:11:00.298 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:11:00 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:11:00] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:11:00.299 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:11:00 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:11:00] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:11:00.299 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:11:00 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:11:00.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:00 smithi044 ceph-mon[30624]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:11:00.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:00 smithi044 ceph-mon[30624]: { 2024-03-26T17:11:00.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:00 smithi044 ceph-mon[30624]: "prefix": "rbd perf image stats", 2024-03-26T17:11:00.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:00 smithi044 ceph-mon[30624]: "pool_spec": "mypool", 2024-03-26T17:11:00.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:00 smithi044 ceph-mon[30624]: "sort_by": "write_ops", 2024-03-26T17:11:00.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:00 smithi044 ceph-mon[30624]: "format": "json" 2024-03-26T17:11:00.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:00 smithi044 ceph-mon[30624]: }"]: dispatch 2024-03-26T17:11:00.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:00 smithi044 ceph-mon[30624]: pgmap v758: 33 pgs: 33 active+clean; 1.0 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 6.3 MiB/s rd, 6.0 MiB/s wr, 446 op/s 2024-03-26T17:11:00.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:00 smithi064 ceph-mon[34420]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:11:00.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:00 smithi064 ceph-mon[34420]: { 2024-03-26T17:11:00.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:00 smithi064 ceph-mon[34420]: "prefix": "rbd perf image stats", 2024-03-26T17:11:00.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:00 smithi064 ceph-mon[34420]: "pool_spec": "mypool", 2024-03-26T17:11:00.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:00 smithi064 ceph-mon[34420]: "sort_by": "write_ops", 2024-03-26T17:11:00.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:00 smithi064 ceph-mon[34420]: "format": "json" 2024-03-26T17:11:00.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:00 smithi064 ceph-mon[34420]: }"]: dispatch 2024-03-26T17:11:00.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:00 smithi064 ceph-mon[34420]: pgmap v758: 33 pgs: 33 active+clean; 1.0 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 6.3 MiB/s rd, 6.0 MiB/s wr, 446 op/s 2024-03-26T17:11:01.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:01 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 2024-03-26T17:11:01.244+0000 7fa707a55700 -1 mon.c@1(peon) e3 get_health_metrics reporting 3 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T17:11:02.132 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:11:01 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:11:01] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:11:02.132 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:11:01 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:11:01] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:11:02.132 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:11:01 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:11:02.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:02 smithi149 ceph-mon[34678]: pgmap v759: 33 pgs: 33 active+clean; 1.0 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 6.5 MiB/s rd, 6.4 MiB/s wr, 468 op/s 2024-03-26T17:11:02.396 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:11:02 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:11:02] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:11:02.396 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:11:02 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:11:02] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:11:02.396 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:11:02 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:11:02.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:02 smithi044 ceph-mon[30624]: pgmap v759: 33 pgs: 33 active+clean; 1.0 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 6.5 MiB/s rd, 6.4 MiB/s wr, 468 op/s 2024-03-26T17:11:02.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:02 smithi064 ceph-mon[34420]: pgmap v759: 33 pgs: 33 active+clean; 1.0 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 6.5 MiB/s rd, 6.4 MiB/s wr, 468 op/s 2024-03-26T17:11:03.071 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:11:03.071 INFO:tasks.workunit.client.3.smithi157.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2024-03-26T17:11:03.072 INFO:tasks.workunit.client.3.smithi157.stdout: 7.10 90.8k 126.0k 0.0k 908.0k 1.2M 0.0k nvme2n1 2024-03-26T17:11:03.072 INFO:tasks.workunit.client.3.smithi157.stdout: 7.20 126.0k 88.4k 0.0k 1.2M 884.0k 0.0k nvme2n10 2024-03-26T17:11:03.072 INFO:tasks.workunit.client.3.smithi157.stdout: 7.20 52.0k 76.8k 0.0k 520.0k 768.0k 0.0k nvme2n11 2024-03-26T17:11:03.072 INFO:tasks.workunit.client.3.smithi157.stdout: 7.20 70.0k 61.6k 0.0k 700.0k 616.0k 0.0k nvme2n12 2024-03-26T17:11:03.072 INFO:tasks.workunit.client.3.smithi157.stdout: 7.20 77.2k 108.8k 0.0k 772.0k 1.1M 0.0k nvme2n13 2024-03-26T17:11:03.072 INFO:tasks.workunit.client.3.smithi157.stdout: 7.20 109.6k 113.2k 0.0k 1.1M 1.1M 0.0k nvme2n14 2024-03-26T17:11:03.072 INFO:tasks.workunit.client.3.smithi157.stdout: 7.20 92.0k 99.6k 0.0k 920.0k 996.0k 0.0k nvme2n15 2024-03-26T17:11:03.072 INFO:tasks.workunit.client.3.smithi157.stdout: 7.20 105.6k 107.2k 0.0k 1.0M 1.0M 0.0k nvme2n16 2024-03-26T17:11:03.072 INFO:tasks.workunit.client.3.smithi157.stdout: 7.20 92.4k 156.8k 0.0k 924.0k 1.5M 0.0k nvme2n17 2024-03-26T17:11:03.072 INFO:tasks.workunit.client.3.smithi157.stdout: 7.20 78.8k 128.0k 0.0k 788.0k 1.2M 0.0k nvme2n18 2024-03-26T17:11:03.073 INFO:tasks.workunit.client.3.smithi157.stdout: 7.20 127.2k 98.0k 0.0k 1.2M 980.0k 0.0k nvme2n19 2024-03-26T17:11:03.073 INFO:tasks.workunit.client.3.smithi157.stdout: 7.10 92.0k 120.0k 0.0k 920.0k 1.2M 0.0k nvme2n2 2024-03-26T17:11:03.073 INFO:tasks.workunit.client.3.smithi157.stdout: 7.20 94.8k 96.8k 0.0k 948.0k 968.0k 0.0k nvme2n20 2024-03-26T17:11:03.073 INFO:tasks.workunit.client.3.smithi157.stdout: 7.10 105.2k 113.2k 0.0k 1.0M 1.1M 0.0k nvme2n3 2024-03-26T17:11:03.073 INFO:tasks.workunit.client.3.smithi157.stdout: 7.10 108.0k 92.0k 0.0k 1.1M 920.0k 0.0k nvme2n4 2024-03-26T17:11:03.073 INFO:tasks.workunit.client.3.smithi157.stdout: 7.20 112.4k 113.6k 0.0k 1.1M 1.1M 0.0k nvme2n5 2024-03-26T17:11:03.073 INFO:tasks.workunit.client.3.smithi157.stdout: 7.20 103.6k 90.0k 0.0k 1.0M 900.0k 0.0k nvme2n6 2024-03-26T17:11:03.073 INFO:tasks.workunit.client.3.smithi157.stdout: 7.20 109.6k 63.6k 0.0k 1.1M 636.0k 0.0k nvme2n7 2024-03-26T17:11:03.073 INFO:tasks.workunit.client.3.smithi157.stdout: 7.20 106.4k 132.4k 0.0k 1.0M 1.3M 0.0k nvme2n8 2024-03-26T17:11:03.073 INFO:tasks.workunit.client.3.smithi157.stdout: 7.20 140.8k 108.0k 0.0k 1.4M 1.1M 0.0k nvme2n9 2024-03-26T17:11:03.073 INFO:tasks.workunit.client.3.smithi157.stdout: 7.10 108.4k 66.0k 0.0k 1.1M 660.0k 0.0k nvme5n1 2024-03-26T17:11:03.073 INFO:tasks.workunit.client.3.smithi157.stdout: 7.20 129.6k 94.8k 0.0k 1.3M 948.0k 0.0k nvme5n10 2024-03-26T17:11:03.073 INFO:tasks.workunit.client.3.smithi157.stdout: 7.20 95.6k 146.0k 0.0k 956.0k 1.4M 0.0k nvme5n11 2024-03-26T17:11:03.073 INFO:tasks.workunit.client.3.smithi157.stdout: 7.20 116.8k 106.4k 0.0k 1.1M 1.0M 0.0k nvme5n12 2024-03-26T17:11:03.074 INFO:tasks.workunit.client.3.smithi157.stdout: 7.20 150.0k 69.2k 0.0k 1.5M 692.0k 0.0k nvme5n13 2024-03-26T17:11:03.074 INFO:tasks.workunit.client.3.smithi157.stdout: 7.20 90.4k 122.0k 0.0k 904.0k 1.2M 0.0k nvme5n14 2024-03-26T17:11:03.074 INFO:tasks.workunit.client.3.smithi157.stdout: 7.20 79.6k 118.4k 0.0k 796.0k 1.2M 0.0k nvme5n15 2024-03-26T17:11:03.074 INFO:tasks.workunit.client.3.smithi157.stdout: 7.20 126.8k 94.0k 0.0k 1.2M 940.0k 0.0k nvme5n16 2024-03-26T17:11:03.074 INFO:tasks.workunit.client.3.smithi157.stdout: 7.20 101.2k 102.8k 0.0k 1012.0k 1.0M 0.0k nvme5n17 2024-03-26T17:11:03.074 INFO:tasks.workunit.client.3.smithi157.stdout: 7.20 100.4k 114.8k 0.0k 1004.0k 1.1M 0.0k nvme5n18 2024-03-26T17:11:03.074 INFO:tasks.workunit.client.3.smithi157.stdout: 7.20 125.2k 80.4k 0.0k 1.2M 804.0k 0.0k nvme5n19 2024-03-26T17:11:03.074 INFO:tasks.workunit.client.3.smithi157.stdout: 7.10 119.6k 102.0k 0.0k 1.2M 1020.0k 0.0k nvme5n2 2024-03-26T17:11:03.074 INFO:tasks.workunit.client.3.smithi157.stdout: 7.20 100.4k 120.0k 0.0k 1004.0k 1.2M 0.0k nvme5n20 2024-03-26T17:11:03.074 INFO:tasks.workunit.client.3.smithi157.stdout: 7.10 94.8k 125.6k 0.0k 948.0k 1.2M 0.0k nvme5n3 2024-03-26T17:11:03.074 INFO:tasks.workunit.client.3.smithi157.stdout: 7.10 108.4k 128.0k 0.0k 1.1M 1.2M 0.0k nvme5n4 2024-03-26T17:11:03.074 INFO:tasks.workunit.client.3.smithi157.stdout: 7.10 105.6k 97.2k 0.0k 1.0M 972.0k 0.0k nvme5n5 2024-03-26T17:11:03.074 INFO:tasks.workunit.client.3.smithi157.stdout: 7.20 111.6k 142.8k 0.0k 1.1M 1.4M 0.0k nvme5n6 2024-03-26T17:11:03.074 INFO:tasks.workunit.client.3.smithi157.stdout: 7.20 94.8k 122.8k 0.0k 948.0k 1.2M 0.0k nvme5n7 2024-03-26T17:11:03.075 INFO:tasks.workunit.client.3.smithi157.stdout: 7.20 132.0k 125.6k 0.0k 1.3M 1.2M 0.0k nvme5n8 2024-03-26T17:11:03.075 INFO:tasks.workunit.client.3.smithi157.stdout: 7.20 127.6k 97.6k 0.0k 1.2M 976.0k 0.0k nvme5n9 2024-03-26T17:11:03.075 INFO:tasks.workunit.client.3.smithi157.stdout: 7.10 98.8k 135.6k 0.0k 988.0k 1.3M 0.0k nvme8n1 2024-03-26T17:11:03.075 INFO:tasks.workunit.client.3.smithi157.stdout: 7.20 119.6k 78.4k 0.0k 1.2M 784.0k 0.0k nvme8n10 2024-03-26T17:11:03.075 INFO:tasks.workunit.client.3.smithi157.stdout: 7.20 110.8k 80.4k 0.0k 1.1M 804.0k 0.0k nvme8n11 2024-03-26T17:11:03.075 INFO:tasks.workunit.client.3.smithi157.stdout: 7.20 89.2k 97.6k 0.0k 892.0k 976.0k 0.0k nvme8n12 2024-03-26T17:11:03.075 INFO:tasks.workunit.client.3.smithi157.stdout: 7.20 108.8k 118.4k 0.0k 1.1M 1.2M 0.0k nvme8n13 2024-03-26T17:11:03.075 INFO:tasks.workunit.client.3.smithi157.stdout: 7.20 122.4k 84.0k 0.0k 1.2M 840.0k 0.0k nvme8n14 2024-03-26T17:11:03.075 INFO:tasks.workunit.client.3.smithi157.stdout: 7.20 106.0k 103.6k 0.0k 1.0M 1.0M 0.0k nvme8n15 2024-03-26T17:11:03.075 INFO:tasks.workunit.client.3.smithi157.stdout: 7.20 111.2k 78.8k 0.0k 1.1M 788.0k 0.0k nvme8n16 2024-03-26T17:11:03.075 INFO:tasks.workunit.client.3.smithi157.stdout: 7.20 114.8k 135.6k 0.0k 1.1M 1.3M 0.0k nvme8n17 2024-03-26T17:11:03.075 INFO:tasks.workunit.client.3.smithi157.stdout: 7.20 105.6k 148.0k 0.0k 1.0M 1.4M 0.0k nvme8n18 2024-03-26T17:11:03.075 INFO:tasks.workunit.client.3.smithi157.stdout: 7.20 130.4k 82.0k 0.0k 1.3M 820.0k 0.0k nvme8n19 2024-03-26T17:11:03.075 INFO:tasks.workunit.client.3.smithi157.stdout: 7.10 82.4k 89.6k 0.0k 824.0k 896.0k 0.0k nvme8n2 2024-03-26T17:11:03.076 INFO:tasks.workunit.client.3.smithi157.stdout: 7.20 119.6k 112.4k 0.0k 1.2M 1.1M 0.0k nvme8n20 2024-03-26T17:11:03.076 INFO:tasks.workunit.client.3.smithi157.stdout: 7.10 88.4k 129.6k 0.0k 884.0k 1.3M 0.0k nvme8n3 2024-03-26T17:11:03.076 INFO:tasks.workunit.client.3.smithi157.stdout: 7.10 96.0k 101.6k 0.0k 960.0k 1016.0k 0.0k nvme8n4 2024-03-26T17:11:03.076 INFO:tasks.workunit.client.3.smithi157.stdout: 7.20 102.0k 118.0k 0.0k 1020.0k 1.2M 0.0k nvme8n5 2024-03-26T17:11:03.076 INFO:tasks.workunit.client.3.smithi157.stdout: 7.20 96.0k 79.2k 0.0k 960.0k 792.0k 0.0k nvme8n6 2024-03-26T17:11:03.076 INFO:tasks.workunit.client.3.smithi157.stdout: 7.20 89.2k 108.4k 0.0k 892.0k 1.1M 0.0k nvme8n7 2024-03-26T17:11:03.076 INFO:tasks.workunit.client.3.smithi157.stdout: 7.20 91.2k 114.4k 0.0k 912.0k 1.1M 0.0k nvme8n8 2024-03-26T17:11:03.076 INFO:tasks.workunit.client.3.smithi157.stdout: 7.20 72.4k 93.6k 0.0k 724.0k 936.0k 0.0k nvme8n9 2024-03-26T17:11:03.076 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:11:03.579 INFO:tasks.workunit.client.3.smithi157.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-26T17:11:03.579 INFO:tasks.workunit.client.3.smithi157.stdout:myimage47 5/s 2/s 130 KiB/s 58 KiB/s 3.17 ms 362.66 us 2024-03-26T17:11:03.579 INFO:tasks.workunit.client.3.smithi157.stdout:myimage11 5/s 4/s 75 KiB/s 69 KiB/s 2.99 ms 367.65 us 2024-03-26T17:11:03.579 INFO:tasks.workunit.client.3.smithi157.stdout:myimage35 4/s 3/s 126 KiB/s 101 KiB/s 3.27 ms 340.99 us 2024-03-26T17:11:03.579 INFO:tasks.workunit.client.3.smithi157.stdout:myimage31 4/s 3/s 141 KiB/s 125 KiB/s 3.51 ms 488.12 us 2024-03-26T17:11:03.579 INFO:tasks.workunit.client.3.smithi157.stdout:myimage58 4/s 3/s 145 KiB/s 140 KiB/s 2.95 ms 405.00 us 2024-03-26T17:11:03.579 INFO:tasks.workunit.client.3.smithi157.stdout:myimage27 4/s 3/s 125 KiB/s 90 KiB/s 2.68 ms 379.13 us 2024-03-26T17:11:03.579 INFO:tasks.workunit.client.3.smithi157.stdout:myimage56 4/s 2/s 78 KiB/s 94 KiB/s 3.55 ms 319.28 us 2024-03-26T17:11:03.579 INFO:tasks.workunit.client.3.smithi157.stdout:myimage2 4/s 3/s 140 KiB/s 85 KiB/s 3.88 ms 379.45 us 2024-03-26T17:11:03.579 INFO:tasks.workunit.client.3.smithi157.stdout:myimage1 4/s 3/s 136 KiB/s 100 KiB/s 2.53 ms 328.31 us 2024-03-26T17:11:03.579 INFO:tasks.workunit.client.3.smithi157.stdout:myimage8 4/s 2/s 130 KiB/s 77 KiB/s 3.29 ms 375.43 us 2024-03-26T17:11:03.580 INFO:tasks.workunit.client.3.smithi157.stdout:myimage9 4/s 2/s 146 KiB/s 65 KiB/s 3.07 ms 330.25 us 2024-03-26T17:11:03.580 INFO:tasks.workunit.client.3.smithi157.stdout:myimage15 4/s 3/s 126 KiB/s 90 KiB/s 2.70 ms 469.56 us 2024-03-26T17:11:03.580 INFO:tasks.workunit.client.3.smithi157.stdout:myimage57 4/s 3/s 130 KiB/s 110 KiB/s 3.15 ms 547.70 us 2024-03-26T17:11:03.580 INFO:tasks.workunit.client.3.smithi157.stdout:myimage23 4/s 2/s 120 KiB/s 53 KiB/s 2.72 ms 306.71 us 2024-03-26T17:11:03.580 INFO:tasks.workunit.client.3.smithi157.stdout:myimage17 4/s 3/s 156 KiB/s 113 KiB/s 3.11 ms 376.01 us 2024-03-26T17:11:03.580 INFO:tasks.workunit.client.3.smithi157.stdout:myimage25 4/s 3/s 112 KiB/s 100 KiB/s 4.01 ms 560.53 us 2024-03-26T17:11:03.580 INFO:tasks.workunit.client.3.smithi157.stdout:myimage46 4/s 3/s 85 KiB/s 76 KiB/s 2.75 ms 393.99 us 2024-03-26T17:11:03.580 INFO:tasks.workunit.client.3.smithi157.stdout:myimage16 3/s 3/s 112 KiB/s 134 KiB/s 3.00 ms 362.29 us 2024-03-26T17:11:03.580 INFO:tasks.workunit.client.3.smithi157.stdout:myimage49 3/s 2/s 118 KiB/s 43 KiB/s 2.67 ms 305.78 us 2024-03-26T17:11:03.580 INFO:tasks.workunit.client.3.smithi157.stdout:myimage18 3/s 1/s 139 KiB/s 49 KiB/s 2.86 ms 356.40 us 2024-03-26T17:11:03.580 INFO:tasks.workunit.client.3.smithi157.stdout:myimage26 3/s 3/s 123 KiB/s 138 KiB/s 3.11 ms 395.75 us 2024-03-26T17:11:03.580 INFO:tasks.workunit.client.3.smithi157.stdout:myimage36 3/s 3/s 111 KiB/s 90 KiB/s 2.82 ms 354.58 us 2024-03-26T17:11:03.580 INFO:tasks.workunit.client.3.smithi157.stdout:myimage45 3/s 4/s 119 KiB/s 138 KiB/s 2.82 ms 346.48 us 2024-03-26T17:11:03.580 INFO:tasks.workunit.client.3.smithi157.stdout:myimage55 3/s 4/s 94 KiB/s 133 KiB/s 3.50 ms 494.03 us 2024-03-26T17:11:03.581 INFO:tasks.workunit.client.3.smithi157.stdout:myimage10 3/s 3/s 101 KiB/s 102 KiB/s 3.00 ms 335.49 us 2024-03-26T17:11:03.581 INFO:tasks.workunit.client.3.smithi157.stdout:myimage37 3/s 3/s 120 KiB/s 90 KiB/s 2.92 ms 369.93 us 2024-03-26T17:11:03.581 INFO:tasks.workunit.client.3.smithi157.stdout:myimage44 3/s 4/s 110 KiB/s 99 KiB/s 3.10 ms 341.37 us 2024-03-26T17:11:03.581 INFO:tasks.workunit.client.3.smithi157.stdout:myimage7 3/s 4/s 83 KiB/s 102 KiB/s 3.11 ms 396.13 us 2024-03-26T17:11:03.581 INFO:tasks.workunit.client.3.smithi157.stdout:myimage28 3/s 3/s 136 KiB/s 102 KiB/s 3.65 ms 460.74 us 2024-03-26T17:11:03.581 INFO:tasks.workunit.client.3.smithi157.stdout:myimage41 3/s 3/s 151 KiB/s 74 KiB/s 3.24 ms 321.78 us 2024-03-26T17:11:03.581 INFO:tasks.workunit.client.3.smithi157.stdout:myimage43 3/s 3/s 126 KiB/s 110 KiB/s 3.14 ms 395.40 us 2024-03-26T17:11:03.581 INFO:tasks.workunit.client.3.smithi157.stdout:myimage53 3/s 3/s 122 KiB/s 94 KiB/s 3.19 ms 314.86 us 2024-03-26T17:11:03.581 INFO:tasks.workunit.client.3.smithi157.stdout:myimage5 3/s 3/s 122 KiB/s 113 KiB/s 2.87 ms 334.90 us 2024-03-26T17:11:03.581 INFO:tasks.workunit.client.3.smithi157.stdout:myimage21 3/s 4/s 78 KiB/s 99 KiB/s 4.08 ms 319.28 us 2024-03-26T17:11:03.581 INFO:tasks.workunit.client.3.smithi157.stdout:myimage24 3/s 3/s 106 KiB/s 107 KiB/s 3.17 ms 365.20 us 2024-03-26T17:11:03.581 INFO:tasks.workunit.client.3.smithi157.stdout:myimage39 3/s 3/s 106 KiB/s 102 KiB/s 2.77 ms 378.00 us 2024-03-26T17:11:03.581 INFO:tasks.workunit.client.3.smithi157.stdout:myimage42 3/s 4/s 94 KiB/s 75 KiB/s 2.98 ms 358.23 us 2024-03-26T17:11:03.581 INFO:tasks.workunit.client.3.smithi157.stdout:myimage50 3/s 3/s 94 KiB/s 90 KiB/s 3.24 ms 354.94 us 2024-03-26T17:11:03.581 INFO:tasks.workunit.client.3.smithi157.stdout:myimage3 3/s 4/s 103 KiB/s 114 KiB/s 2.75 ms 358.11 us 2024-03-26T17:11:03.582 INFO:tasks.workunit.client.3.smithi157.stdout:myimage13 3/s 3/s 102 KiB/s 78 KiB/s 2.66 ms 323.19 us 2024-03-26T17:11:03.582 INFO:tasks.workunit.client.3.smithi157.stdout:myimage4 3/s 3/s 83 KiB/s 72 KiB/s 3.12 ms 305.54 us 2024-03-26T17:11:03.582 INFO:tasks.workunit.client.3.smithi157.stdout:myimage19 3/s 4/s 92 KiB/s 137 KiB/s 2.89 ms 418.82 us 2024-03-26T17:11:03.582 INFO:tasks.workunit.client.3.smithi157.stdout:myimage60 3/s 3/s 97 KiB/s 114 KiB/s 3.31 ms 377.78 us 2024-03-26T17:11:03.582 INFO:tasks.workunit.client.3.smithi157.stdout:myimage59 3/s 5/s 74 KiB/s 156 KiB/s 3.60 ms 356.51 us 2024-03-26T17:11:03.582 INFO:tasks.workunit.client.3.smithi157.stdout:myimage32 3/s 4/s 109 KiB/s 142 KiB/s 3.17 ms 392.67 us 2024-03-26T17:11:03.582 INFO:tasks.workunit.client.3.smithi157.stdout:myimage34 3/s 2/s 111 KiB/s 56 KiB/s 2.84 ms 319.54 us 2024-03-26T17:11:03.582 INFO:tasks.workunit.client.3.smithi157.stdout:myimage40 3/s 4/s 113 KiB/s 123 KiB/s 2.87 ms 440.70 us 2024-03-26T17:11:03.582 INFO:tasks.workunit.client.3.smithi157.stdout:myimage20 3/s 3/s 81 KiB/s 90 KiB/s 2.86 ms 310.05 us 2024-03-26T17:11:03.582 INFO:tasks.workunit.client.3.smithi157.stdout:myimage54 3/s 4/s 71 KiB/s 141 KiB/s 2.99 ms 477.76 us 2024-03-26T17:11:03.582 INFO:tasks.workunit.client.3.smithi157.stdout:myimage22 2/s 3/s 92 KiB/s 139 KiB/s 2.65 ms 346.96 us 2024-03-26T17:11:03.582 INFO:tasks.workunit.client.3.smithi157.stdout:myimage30 2/s 4/s 94 KiB/s 145 KiB/s 3.91 ms 516.13 us 2024-03-26T17:11:03.582 INFO:tasks.workunit.client.3.smithi157.stdout:myimage38 2/s 3/s 82 KiB/s 104 KiB/s 2.47 ms 337.38 us 2024-03-26T17:11:03.582 INFO:tasks.workunit.client.3.smithi157.stdout:myimage48 2/s 3/s 108 KiB/s 78 KiB/s 2.99 ms 356.01 us 2024-03-26T17:11:03.583 INFO:tasks.workunit.client.3.smithi157.stdout:myimage6 2/s 4/s 65 KiB/s 122 KiB/s 3.69 ms 365.93 us 2024-03-26T17:11:03.583 INFO:tasks.workunit.client.3.smithi157.stdout:myimage29 2/s 4/s 101 KiB/s 110 KiB/s 2.75 ms 341.89 us 2024-03-26T17:11:03.583 INFO:tasks.workunit.client.3.smithi157.stdout:myimage14 2/s 3/s 72 KiB/s 100 KiB/s 3.24 ms 338.88 us 2024-03-26T17:11:03.583 INFO:tasks.workunit.client.3.smithi157.stdout:myimage51 2/s 3/s 59 KiB/s 98 KiB/s 3.50 ms 349.87 us 2024-03-26T17:11:03.583 INFO:tasks.workunit.client.3.smithi157.stdout:myimage52 2/s 3/s 61 KiB/s 79 KiB/s 3.60 ms 493.08 us 2024-03-26T17:11:03.583 INFO:tasks.workunit.client.3.smithi157.stdout:myimage33 2/s 5/s 78 KiB/s 155 KiB/s 3.22 ms 464.34 us 2024-03-26T17:11:03.583 INFO:tasks.workunit.client.3.smithi157.stdout:myimage12 2/s 4/s 27 KiB/s 83 KiB/s 2.81 ms 423.65 us 2024-03-26T17:11:03.583 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:11:04.135 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:11:03 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:11:03] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:11:04.135 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:11:03 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:11:03] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:11:04.135 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:11:03 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:11:04.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:04 smithi149 ceph-mon[34678]: pgmap v760: 33 pgs: 33 active+clean; 1.0 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 6.2 MiB/s rd, 6.0 MiB/s wr, 439 op/s 2024-03-26T17:11:04.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:04 smithi149 ceph-mon[34678]: Health check update: 3 slow ops, oldest one blocked for 758 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:11:04.396 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:11:04 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:11:04] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:11:04.397 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:11:04 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:11:04] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:11:04.397 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:11:04 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:11:04.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:04 smithi044 ceph-mon[30624]: pgmap v760: 33 pgs: 33 active+clean; 1.0 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 6.2 MiB/s rd, 6.0 MiB/s wr, 439 op/s 2024-03-26T17:11:04.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:04 smithi044 ceph-mon[30624]: Health check update: 3 slow ops, oldest one blocked for 758 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:11:04.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:04 smithi064 ceph-mon[34420]: pgmap v760: 33 pgs: 33 active+clean; 1.0 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 6.2 MiB/s rd, 6.0 MiB/s wr, 439 op/s 2024-03-26T17:11:04.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:04 smithi064 ceph-mon[34420]: Health check update: 3 slow ops, oldest one blocked for 758 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:11:05.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:05 smithi149 ceph-mon[34678]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:11:05.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:05 smithi149 ceph-mon[34678]: { 2024-03-26T17:11:05.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:05 smithi149 ceph-mon[34678]: "prefix": "rbd perf image stats", 2024-03-26T17:11:05.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:05 smithi149 ceph-mon[34678]: "pool_spec": "mypool", 2024-03-26T17:11:05.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:05 smithi149 ceph-mon[34678]: "sort_by": "write_ops", 2024-03-26T17:11:05.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:05 smithi149 ceph-mon[34678]: "format": "json" 2024-03-26T17:11:05.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:05 smithi149 ceph-mon[34678]: }"]: dispatch 2024-03-26T17:11:05.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:05 smithi044 ceph-mon[30624]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:11:05.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:05 smithi044 ceph-mon[30624]: { 2024-03-26T17:11:05.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:05 smithi044 ceph-mon[30624]: "prefix": "rbd perf image stats", 2024-03-26T17:11:05.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:05 smithi044 ceph-mon[30624]: "pool_spec": "mypool", 2024-03-26T17:11:05.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:05 smithi044 ceph-mon[30624]: "sort_by": "write_ops", 2024-03-26T17:11:05.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:05 smithi044 ceph-mon[30624]: "format": "json" 2024-03-26T17:11:05.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:05 smithi044 ceph-mon[30624]: }"]: dispatch 2024-03-26T17:11:05.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:05 smithi064 ceph-mon[34420]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:11:05.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:05 smithi064 ceph-mon[34420]: { 2024-03-26T17:11:05.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:05 smithi064 ceph-mon[34420]: "prefix": "rbd perf image stats", 2024-03-26T17:11:05.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:05 smithi064 ceph-mon[34420]: "pool_spec": "mypool", 2024-03-26T17:11:05.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:05 smithi064 ceph-mon[34420]: "sort_by": "write_ops", 2024-03-26T17:11:05.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:05 smithi064 ceph-mon[34420]: "format": "json" 2024-03-26T17:11:05.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:05 smithi064 ceph-mon[34420]: }"]: dispatch 2024-03-26T17:11:06.142 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:11:05 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:11:05] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:11:06.142 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:11:05 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:11:05] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:11:06.142 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:11:05 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:11:06.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:06 smithi149 ceph-mon[34678]: pgmap v761: 33 pgs: 33 active+clean; 1.0 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 6.1 MiB/s rd, 5.9 MiB/s wr, 431 op/s 2024-03-26T17:11:06.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 2024-03-26T17:11:06.245+0000 7fa707a55700 -1 mon.c@1(peon) e3 get_health_metrics reporting 3 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T17:11:06.396 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:11:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:11:06] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:11:06.397 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:11:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:11:06] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:11:06.397 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:11:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:11:06.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:06 smithi044 ceph-mon[30624]: pgmap v761: 33 pgs: 33 active+clean; 1.0 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 6.1 MiB/s rd, 5.9 MiB/s wr, 431 op/s 2024-03-26T17:11:06.557 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:06 smithi064 ceph-mon[34420]: pgmap v761: 33 pgs: 33 active+clean; 1.0 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 6.1 MiB/s rd, 5.9 MiB/s wr, 431 op/s 2024-03-26T17:11:08.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:08 smithi044 ceph-mon[30624]: pgmap v762: 33 pgs: 33 active+clean; 1.0 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 6.0 MiB/s rd, 5.9 MiB/s wr, 433 op/s 2024-03-26T17:11:08.266 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:11:07 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:11:07] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:11:08.266 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:11:07 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:11:07] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:11:08.266 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:11:07 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:11:08.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:08 smithi149 ceph-mon[34678]: pgmap v762: 33 pgs: 33 active+clean; 1.0 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 6.0 MiB/s rd, 5.9 MiB/s wr, 433 op/s 2024-03-26T17:11:08.396 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:11:08 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:11:08] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:11:08.396 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:11:08 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:11:08] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:11:08.397 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:11:08 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:11:08.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:08 smithi064 ceph-mon[34420]: pgmap v762: 33 pgs: 33 active+clean; 1.0 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 6.0 MiB/s rd, 5.9 MiB/s wr, 433 op/s 2024-03-26T17:11:08.583 INFO:tasks.workunit.client.3.smithi157.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-26T17:11:08.583 INFO:tasks.workunit.client.3.smithi157.stdout:myimage38 5/s 3/s 141 KiB/s 90 KiB/s 2.43 ms 336.13 us 2024-03-26T17:11:08.583 INFO:tasks.workunit.client.3.smithi157.stdout:myimage3 5/s 2/s 146 KiB/s 51 KiB/s 2.43 ms 340.75 us 2024-03-26T17:11:08.583 INFO:tasks.workunit.client.3.smithi157.stdout:myimage60 5/s 2/s 152 KiB/s 56 KiB/s 3.53 ms 321.34 us 2024-03-26T17:11:08.583 INFO:tasks.workunit.client.3.smithi157.stdout:myimage16 4/s 2/s 127 KiB/s 82 KiB/s 3.14 ms 482.10 us 2024-03-26T17:11:08.583 INFO:tasks.workunit.client.3.smithi157.stdout:myimage18 4/s 3/s 132 KiB/s 77 KiB/s 3.06 ms 319.35 us 2024-03-26T17:11:08.583 INFO:tasks.workunit.client.3.smithi157.stdout:myimage26 4/s 2/s 170 KiB/s 68 KiB/s 3.28 ms 416.86 us 2024-03-26T17:11:08.583 INFO:tasks.workunit.client.3.smithi157.stdout:myimage29 4/s 2/s 114 KiB/s 70 KiB/s 2.70 ms 400.69 us 2024-03-26T17:11:08.583 INFO:tasks.workunit.client.3.smithi157.stdout:myimage35 4/s 3/s 150 KiB/s 78 KiB/s 3.06 ms 322.14 us 2024-03-26T17:11:08.583 INFO:tasks.workunit.client.3.smithi157.stdout:myimage49 4/s 3/s 170 KiB/s 92 KiB/s 3.24 ms 362.60 us 2024-03-26T17:11:08.583 INFO:tasks.workunit.client.3.smithi157.stdout:myimage12 4/s 2/s 125 KiB/s 86 KiB/s 3.07 ms 397.38 us 2024-03-26T17:11:08.583 INFO:tasks.workunit.client.3.smithi157.stdout:myimage52 4/s 3/s 99 KiB/s 102 KiB/s 3.49 ms 328.00 us 2024-03-26T17:11:08.584 INFO:tasks.workunit.client.3.smithi157.stdout:myimage7 4/s 3/s 102 KiB/s 102 KiB/s 2.98 ms 500.55 us 2024-03-26T17:11:08.584 INFO:tasks.workunit.client.3.smithi157.stdout:myimage28 4/s 2/s 115 KiB/s 102 KiB/s 3.88 ms 610.45 us 2024-03-26T17:11:08.584 INFO:tasks.workunit.client.3.smithi157.stdout:myimage53 4/s 3/s 134 KiB/s 86 KiB/s 3.26 ms 514.12 us 2024-03-26T17:11:08.584 INFO:tasks.workunit.client.3.smithi157.stdout:myimage57 4/s 2/s 144 KiB/s 98 KiB/s 3.14 ms 344.99 us 2024-03-26T17:11:08.584 INFO:tasks.workunit.client.3.smithi157.stdout:myimage14 4/s 3/s 120 KiB/s 89 KiB/s 3.23 ms 462.02 us 2024-03-26T17:11:08.584 INFO:tasks.workunit.client.3.smithi157.stdout:myimage30 4/s 2/s 111 KiB/s 107 KiB/s 3.58 ms 355.91 us 2024-03-26T17:11:08.584 INFO:tasks.workunit.client.3.smithi157.stdout:myimage31 4/s 3/s 153 KiB/s 96 KiB/s 3.20 ms 395.28 us 2024-03-26T17:11:08.584 INFO:tasks.workunit.client.3.smithi157.stdout:myimage34 4/s 4/s 117 KiB/s 129 KiB/s 2.55 ms 359.70 us 2024-03-26T17:11:08.584 INFO:tasks.workunit.client.3.smithi157.stdout:myimage55 4/s 2/s 133 KiB/s 72 KiB/s 3.37 ms 329.83 us 2024-03-26T17:11:08.584 INFO:tasks.workunit.client.3.smithi157.stdout:myimage10 4/s 3/s 88 KiB/s 107 KiB/s 2.86 ms 313.79 us 2024-03-26T17:11:08.584 INFO:tasks.workunit.client.3.smithi157.stdout:myimage23 3/s 3/s 98 KiB/s 135 KiB/s 2.66 ms 429.61 us 2024-03-26T17:11:08.584 INFO:tasks.workunit.client.3.smithi157.stdout:myimage40 3/s 3/s 108 KiB/s 128 KiB/s 2.83 ms 454.01 us 2024-03-26T17:11:08.584 INFO:tasks.workunit.client.3.smithi157.stdout:myimage11 3/s 2/s 102 KiB/s 51 KiB/s 4.02 ms 372.42 us 2024-03-26T17:11:08.584 INFO:tasks.workunit.client.3.smithi157.stdout:myimage15 3/s 3/s 117 KiB/s 70 KiB/s 2.41 ms 355.86 us 2024-03-26T17:11:08.584 INFO:tasks.workunit.client.3.smithi157.stdout:myimage51 3/s 4/s 101 KiB/s 81 KiB/s 3.40 ms 316.60 us 2024-03-26T17:11:08.585 INFO:tasks.workunit.client.3.smithi157.stdout:myimage39 3/s 3/s 90 KiB/s 118 KiB/s 2.96 ms 356.56 us 2024-03-26T17:11:08.585 INFO:tasks.workunit.client.3.smithi157.stdout:myimage42 3/s 4/s 66 KiB/s 122 KiB/s 2.93 ms 398.00 us 2024-03-26T17:11:08.585 INFO:tasks.workunit.client.3.smithi157.stdout:myimage2 3/s 3/s 83 KiB/s 93 KiB/s 3.20 ms 358.40 us 2024-03-26T17:11:08.585 INFO:tasks.workunit.client.3.smithi157.stdout:myimage22 3/s 3/s 96 KiB/s 125 KiB/s 2.96 ms 425.35 us 2024-03-26T17:11:08.585 INFO:tasks.workunit.client.3.smithi157.stdout:myimage47 3/s 4/s 86 KiB/s 106 KiB/s 2.92 ms 343.35 us 2024-03-26T17:11:08.585 INFO:tasks.workunit.client.3.smithi157.stdout:myimage48 3/s 4/s 89 KiB/s 86 KiB/s 3.13 ms 353.93 us 2024-03-26T17:11:08.585 INFO:tasks.workunit.client.3.smithi157.stdout:myimage58 3/s 3/s 117 KiB/s 125 KiB/s 2.48 ms 356.27 us 2024-03-26T17:11:08.585 INFO:tasks.workunit.client.3.smithi157.stdout:myimage5 3/s 4/s 86 KiB/s 139 KiB/s 3.15 ms 338.68 us 2024-03-26T17:11:08.585 INFO:tasks.workunit.client.3.smithi157.stdout:myimage19 3/s 3/s 91 KiB/s 82 KiB/s 3.14 ms 360.89 us 2024-03-26T17:11:08.585 INFO:tasks.workunit.client.3.smithi157.stdout:myimage20 3/s 4/s 86 KiB/s 97 KiB/s 2.62 ms 353.39 us 2024-03-26T17:11:08.585 INFO:tasks.workunit.client.3.smithi157.stdout:myimage24 3/s 4/s 107 KiB/s 143 KiB/s 2.86 ms 352.21 us 2024-03-26T17:11:08.585 INFO:tasks.workunit.client.3.smithi157.stdout:myimage27 3/s 3/s 89 KiB/s 95 KiB/s 2.80 ms 342.26 us 2024-03-26T17:11:08.585 INFO:tasks.workunit.client.3.smithi157.stdout:myimage33 3/s 3/s 98 KiB/s 110 KiB/s 2.91 ms 359.39 us 2024-03-26T17:11:08.585 INFO:tasks.workunit.client.3.smithi157.stdout:myimage59 3/s 3/s 107 KiB/s 120 KiB/s 3.41 ms 403.33 us 2024-03-26T17:11:08.586 INFO:tasks.workunit.client.3.smithi157.stdout:myimage13 3/s 5/s 89 KiB/s 150 KiB/s 2.79 ms 338.64 us 2024-03-26T17:11:08.586 INFO:tasks.workunit.client.3.smithi157.stdout:myimage32 3/s 3/s 75 KiB/s 86 KiB/s 3.00 ms 403.29 us 2024-03-26T17:11:08.586 INFO:tasks.workunit.client.3.smithi157.stdout:myimage37 3/s 4/s 77 KiB/s 114 KiB/s 3.06 ms 477.57 us 2024-03-26T17:11:08.586 INFO:tasks.workunit.client.3.smithi157.stdout:myimage44 3/s 4/s 87 KiB/s 124 KiB/s 2.98 ms 334.59 us 2024-03-26T17:11:08.586 INFO:tasks.workunit.client.3.smithi157.stdout:myimage1 3/s 3/s 82 KiB/s 87 KiB/s 2.42 ms 346.42 us 2024-03-26T17:11:08.586 INFO:tasks.workunit.client.3.smithi157.stdout:myimage25 3/s 3/s 88 KiB/s 115 KiB/s 3.53 ms 383.89 us 2024-03-26T17:11:08.586 INFO:tasks.workunit.client.3.smithi157.stdout:myimage43 3/s 4/s 99 KiB/s 118 KiB/s 3.59 ms 418.23 us 2024-03-26T17:11:08.586 INFO:tasks.workunit.client.3.smithi157.stdout:myimage54 3/s 4/s 58 KiB/s 134 KiB/s 3.00 ms 333.63 us 2024-03-26T17:11:08.586 INFO:tasks.workunit.client.3.smithi157.stdout:myimage17 3/s 4/s 90 KiB/s 131 KiB/s 3.12 ms 376.70 us 2024-03-26T17:11:08.586 INFO:tasks.workunit.client.3.smithi157.stdout:myimage45 3/s 4/s 90 KiB/s 116 KiB/s 2.97 ms 389.56 us 2024-03-26T17:11:08.586 INFO:tasks.workunit.client.3.smithi157.stdout:myimage46 3/s 3/s 91 KiB/s 119 KiB/s 3.09 ms 355.12 us 2024-03-26T17:11:08.586 INFO:tasks.workunit.client.3.smithi157.stdout:myimage4 2/s 3/s 111 KiB/s 110 KiB/s 3.16 ms 321.25 us 2024-03-26T17:11:08.586 INFO:tasks.workunit.client.3.smithi157.stdout:myimage6 2/s 3/s 66 KiB/s 80 KiB/s 3.70 ms 644.42 us 2024-03-26T17:11:08.586 INFO:tasks.workunit.client.3.smithi157.stdout:myimage8 2/s 4/s 100 KiB/s 145 KiB/s 3.55 ms 330.90 us 2024-03-26T17:11:08.586 INFO:tasks.workunit.client.3.smithi157.stdout:myimage9 2/s 5/s 82 KiB/s 210 KiB/s 3.38 ms 370.55 us 2024-03-26T17:11:08.587 INFO:tasks.workunit.client.3.smithi157.stdout:myimage50 2/s 5/s 77 KiB/s 137 KiB/s 3.39 ms 356.20 us 2024-03-26T17:11:08.587 INFO:tasks.workunit.client.3.smithi157.stdout:myimage56 2/s 4/s 66 KiB/s 129 KiB/s 3.89 ms 392.20 us 2024-03-26T17:11:08.587 INFO:tasks.workunit.client.3.smithi157.stdout:myimage21 2/s 3/s 50 KiB/s 110 KiB/s 3.70 ms 358.06 us 2024-03-26T17:11:08.587 INFO:tasks.workunit.client.3.smithi157.stdout:myimage36 2/s 4/s 93 KiB/s 103 KiB/s 3.00 ms 360.59 us 2024-03-26T17:11:08.587 INFO:tasks.workunit.client.3.smithi157.stdout:myimage41 2/s 4/s 97 KiB/s 133 KiB/s 3.34 ms 440.07 us 2024-03-26T17:11:08.587 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:11:09.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:09 smithi044 ceph-mon[30624]: Health check update: 3 slow ops, oldest one blocked for 763 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:11:09.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:09 smithi064 ceph-mon[34420]: Health check update: 3 slow ops, oldest one blocked for 763 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:11:09.645 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:09 smithi149 ceph-mon[34678]: Health check update: 3 slow ops, oldest one blocked for 763 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:11:10.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:10 smithi044 ceph-mon[30624]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:11:10.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:10 smithi044 ceph-mon[30624]: { 2024-03-26T17:11:10.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:10 smithi044 ceph-mon[30624]: "prefix": "rbd perf image stats", 2024-03-26T17:11:10.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:10 smithi044 ceph-mon[30624]: "pool_spec": "mypool", 2024-03-26T17:11:10.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:10 smithi044 ceph-mon[30624]: "sort_by": "write_ops", 2024-03-26T17:11:10.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:10 smithi044 ceph-mon[30624]: "format": "json" 2024-03-26T17:11:10.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:10 smithi044 ceph-mon[30624]: }"]: dispatch 2024-03-26T17:11:10.266 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:10 smithi044 ceph-mon[30624]: pgmap v763: 33 pgs: 33 active+clean; 1.0 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 6.3 MiB/s rd, 6.4 MiB/s wr, 465 op/s 2024-03-26T17:11:10.266 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:11:09 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:11:09] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:11:10.266 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:11:09 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:11:09] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:11:10.266 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:11:09 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:11:10.396 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:11:10 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:11:10] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:11:10.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:10 smithi149 ceph-mon[34678]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:11:10.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:10 smithi149 ceph-mon[34678]: { 2024-03-26T17:11:10.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:10 smithi149 ceph-mon[34678]: "prefix": "rbd perf image stats", 2024-03-26T17:11:10.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:10 smithi149 ceph-mon[34678]: "pool_spec": "mypool", 2024-03-26T17:11:10.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:10 smithi149 ceph-mon[34678]: "sort_by": "write_ops", 2024-03-26T17:11:10.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:10 smithi149 ceph-mon[34678]: "format": "json" 2024-03-26T17:11:10.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:10 smithi149 ceph-mon[34678]: }"]: dispatch 2024-03-26T17:11:10.397 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:10 smithi149 ceph-mon[34678]: pgmap v763: 33 pgs: 33 active+clean; 1.0 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 6.3 MiB/s rd, 6.4 MiB/s wr, 465 op/s 2024-03-26T17:11:10.397 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:11:10 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:11:10] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:11:10.397 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:11:10 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:11:10.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:10 smithi064 ceph-mon[34420]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:11:10.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:10 smithi064 ceph-mon[34420]: { 2024-03-26T17:11:10.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:10 smithi064 ceph-mon[34420]: "prefix": "rbd perf image stats", 2024-03-26T17:11:10.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:10 smithi064 ceph-mon[34420]: "pool_spec": "mypool", 2024-03-26T17:11:10.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:10 smithi064 ceph-mon[34420]: "sort_by": "write_ops", 2024-03-26T17:11:10.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:10 smithi064 ceph-mon[34420]: "format": "json" 2024-03-26T17:11:10.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:10 smithi064 ceph-mon[34420]: }"]: dispatch 2024-03-26T17:11:10.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:10 smithi064 ceph-mon[34420]: pgmap v763: 33 pgs: 33 active+clean; 1.0 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 6.3 MiB/s rd, 6.4 MiB/s wr, 465 op/s 2024-03-26T17:11:11.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:11 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 2024-03-26T17:11:11.245+0000 7fa707a55700 -1 mon.c@1(peon) e3 get_health_metrics reporting 3 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T17:11:12.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:12 smithi044 ceph-mon[30624]: pgmap v764: 33 pgs: 33 active+clean; 1.0 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 6.4 MiB/s rd, 6.3 MiB/s wr, 470 op/s 2024-03-26T17:11:12.266 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:11:11 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:11:11] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:11:12.266 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:11:11 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:11:11] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:11:12.266 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:11:11 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:11:12.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:12 smithi149 ceph-mon[34678]: pgmap v764: 33 pgs: 33 active+clean; 1.0 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 6.4 MiB/s rd, 6.3 MiB/s wr, 470 op/s 2024-03-26T17:11:12.396 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:11:12 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:11:12] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:11:12.396 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:11:12 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:11:12] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:11:12.396 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:11:12 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:11:12.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:12 smithi064 ceph-mon[34420]: pgmap v764: 33 pgs: 33 active+clean; 1.0 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 6.4 MiB/s rd, 6.3 MiB/s wr, 470 op/s 2024-03-26T17:11:13.063 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:11:13.071 INFO:tasks.workunit.client.3.smithi157.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2024-03-26T17:11:13.071 INFO:tasks.workunit.client.3.smithi157.stdout: 7.20 86.4k 86.0k 0.0k 864.0k 860.0k 0.0k nvme2n1 2024-03-26T17:11:13.071 INFO:tasks.workunit.client.3.smithi157.stdout: 7.10 94.0k 98.8k 0.0k 940.0k 988.0k 0.0k nvme2n10 2024-03-26T17:11:13.071 INFO:tasks.workunit.client.3.smithi157.stdout: 7.10 96.0k 121.2k 0.0k 960.0k 1.2M 0.0k nvme2n11 2024-03-26T17:11:13.071 INFO:tasks.workunit.client.3.smithi157.stdout: 7.10 97.6k 121.2k 0.0k 976.0k 1.2M 0.0k nvme2n12 2024-03-26T17:11:13.071 INFO:tasks.workunit.client.3.smithi157.stdout: 7.10 97.2k 100.0k 0.0k 972.0k 1000.0k 0.0k nvme2n13 2024-03-26T17:11:13.071 INFO:tasks.workunit.client.3.smithi157.stdout: 7.10 86.8k 81.2k 0.0k 868.0k 812.0k 0.0k nvme2n14 2024-03-26T17:11:13.071 INFO:tasks.workunit.client.3.smithi157.stdout: 7.10 66.4k 122.4k 0.0k 664.0k 1.2M 0.0k nvme2n15 2024-03-26T17:11:13.071 INFO:tasks.workunit.client.3.smithi157.stdout: 7.10 96.8k 130.8k 0.0k 968.0k 1.3M 0.0k nvme2n16 2024-03-26T17:11:13.071 INFO:tasks.workunit.client.3.smithi157.stdout: 7.10 114.8k 65.2k 0.0k 1.1M 652.0k 0.0k nvme2n17 2024-03-26T17:11:13.071 INFO:tasks.workunit.client.3.smithi157.stdout: 7.10 82.0k 97.2k 0.0k 820.0k 972.0k 0.0k nvme2n18 2024-03-26T17:11:13.071 INFO:tasks.workunit.client.3.smithi157.stdout: 7.10 95.6k 92.0k 0.0k 956.0k 920.0k 0.0k nvme2n19 2024-03-26T17:11:13.072 INFO:tasks.workunit.client.3.smithi157.stdout: 7.20 117.6k 79.6k 0.0k 1.1M 796.0k 0.0k nvme2n2 2024-03-26T17:11:13.072 INFO:tasks.workunit.client.3.smithi157.stdout: 7.10 99.2k 62.8k 0.0k 992.0k 628.0k 0.0k nvme2n20 2024-03-26T17:11:13.072 INFO:tasks.workunit.client.3.smithi157.stdout: 7.20 71.6k 105.2k 0.0k 716.0k 1.0M 0.0k nvme2n3 2024-03-26T17:11:13.072 INFO:tasks.workunit.client.3.smithi157.stdout: 7.20 72.4k 124.4k 0.0k 724.0k 1.2M 0.0k nvme2n4 2024-03-26T17:11:13.072 INFO:tasks.workunit.client.3.smithi157.stdout: 7.20 113.6k 87.2k 0.0k 1.1M 872.0k 0.0k nvme2n5 2024-03-26T17:11:13.072 INFO:tasks.workunit.client.3.smithi157.stdout: 7.10 77.2k 86.4k 0.0k 772.0k 864.0k 0.0k nvme2n6 2024-03-26T17:11:13.072 INFO:tasks.workunit.client.3.smithi157.stdout: 7.10 78.8k 73.2k 0.0k 788.0k 732.0k 0.0k nvme2n7 2024-03-26T17:11:13.072 INFO:tasks.workunit.client.3.smithi157.stdout: 7.10 124.8k 80.4k 0.0k 1.2M 804.0k 0.0k nvme2n8 2024-03-26T17:11:13.072 INFO:tasks.workunit.client.3.smithi157.stdout: 7.10 97.6k 118.4k 0.0k 976.0k 1.2M 0.0k nvme2n9 2024-03-26T17:11:13.072 INFO:tasks.workunit.client.3.smithi157.stdout: 7.20 100.0k 61.2k 0.0k 1000.0k 612.0k 0.0k nvme5n1 2024-03-26T17:11:13.072 INFO:tasks.workunit.client.3.smithi157.stdout: 7.10 118.0k 112.0k 0.0k 1.2M 1.1M 0.0k nvme5n10 2024-03-26T17:11:13.072 INFO:tasks.workunit.client.3.smithi157.stdout: 7.10 103.6k 113.2k 0.0k 1.0M 1.1M 0.0k nvme5n11 2024-03-26T17:11:13.072 INFO:tasks.workunit.client.3.smithi157.stdout: 7.10 94.0k 101.6k 0.0k 940.0k 1016.0k 0.0k nvme5n12 2024-03-26T17:11:13.073 INFO:tasks.workunit.client.3.smithi157.stdout: 7.10 98.8k 105.6k 0.0k 988.0k 1.0M 0.0k nvme5n13 2024-03-26T17:11:13.073 INFO:tasks.workunit.client.3.smithi157.stdout: 7.10 108.8k 94.4k 0.0k 1.1M 944.0k 0.0k nvme5n14 2024-03-26T17:11:13.073 INFO:tasks.workunit.client.3.smithi157.stdout: 7.10 84.0k 147.2k 0.0k 840.0k 1.4M 0.0k nvme5n15 2024-03-26T17:11:13.073 INFO:tasks.workunit.client.3.smithi157.stdout: 7.10 114.0k 83.6k 0.0k 1.1M 836.0k 0.0k nvme5n16 2024-03-26T17:11:13.073 INFO:tasks.workunit.client.3.smithi157.stdout: 7.10 127.2k 76.0k 0.0k 1.2M 760.0k 0.0k nvme5n17 2024-03-26T17:11:13.073 INFO:tasks.workunit.client.3.smithi157.stdout: 7.10 94.0k 75.6k 0.0k 940.0k 756.0k 0.0k nvme5n18 2024-03-26T17:11:13.073 INFO:tasks.workunit.client.3.smithi157.stdout: 7.10 95.6k 105.6k 0.0k 956.0k 1.0M 0.0k nvme5n19 2024-03-26T17:11:13.073 INFO:tasks.workunit.client.3.smithi157.stdout: 7.20 107.2k 99.6k 0.0k 1.0M 996.0k 0.0k nvme5n2 2024-03-26T17:11:13.073 INFO:tasks.workunit.client.3.smithi157.stdout: 7.10 83.6k 92.4k 0.0k 836.0k 924.0k 0.0k nvme5n20 2024-03-26T17:11:13.073 INFO:tasks.workunit.client.3.smithi157.stdout: 7.20 100.4k 97.2k 0.0k 1004.0k 972.0k 0.0k nvme5n3 2024-03-26T17:11:13.073 INFO:tasks.workunit.client.3.smithi157.stdout: 7.20 117.2k 106.8k 0.0k 1.1M 1.0M 0.0k nvme5n4 2024-03-26T17:11:13.073 INFO:tasks.workunit.client.3.smithi157.stdout: 7.20 115.2k 98.0k 0.0k 1.1M 980.0k 0.0k nvme5n5 2024-03-26T17:11:13.073 INFO:tasks.workunit.client.3.smithi157.stdout: 7.10 71.2k 103.6k 0.0k 712.0k 1.0M 0.0k nvme5n6 2024-03-26T17:11:13.073 INFO:tasks.workunit.client.3.smithi157.stdout: 7.10 93.2k 80.8k 0.0k 932.0k 808.0k 0.0k nvme5n7 2024-03-26T17:11:13.073 INFO:tasks.workunit.client.3.smithi157.stdout: 7.10 77.2k 111.2k 0.0k 772.0k 1.1M 0.0k nvme5n8 2024-03-26T17:11:13.074 INFO:tasks.workunit.client.3.smithi157.stdout: 7.10 68.4k 108.0k 0.0k 684.0k 1.1M 0.0k nvme5n9 2024-03-26T17:11:13.074 INFO:tasks.workunit.client.3.smithi157.stdout: 7.20 137.2k 96.8k 0.0k 1.3M 968.0k 0.0k nvme8n1 2024-03-26T17:11:13.074 INFO:tasks.workunit.client.3.smithi157.stdout: 7.10 112.0k 91.6k 0.0k 1.1M 916.0k 0.0k nvme8n10 2024-03-26T17:11:13.074 INFO:tasks.workunit.client.3.smithi157.stdout: 7.10 105.6k 95.2k 0.0k 1.0M 952.0k 0.0k nvme8n11 2024-03-26T17:11:13.074 INFO:tasks.workunit.client.3.smithi157.stdout: 7.10 96.0k 76.0k 0.0k 960.0k 760.0k 0.0k nvme8n12 2024-03-26T17:11:13.074 INFO:tasks.workunit.client.3.smithi157.stdout: 7.10 89.2k 108.8k 0.0k 892.0k 1.1M 0.0k nvme8n13 2024-03-26T17:11:13.074 INFO:tasks.workunit.client.3.smithi157.stdout: 7.10 115.6k 45.6k 0.0k 1.1M 456.0k 0.0k nvme8n14 2024-03-26T17:11:13.074 INFO:tasks.workunit.client.3.smithi157.stdout: 7.10 94.0k 118.4k 0.0k 940.0k 1.2M 0.0k nvme8n15 2024-03-26T17:11:13.074 INFO:tasks.workunit.client.3.smithi157.stdout: 7.10 98.0k 110.8k 0.0k 980.0k 1.1M 0.0k nvme8n16 2024-03-26T17:11:13.074 INFO:tasks.workunit.client.3.smithi157.stdout: 7.10 84.8k 108.8k 0.0k 848.0k 1.1M 0.0k nvme8n17 2024-03-26T17:11:13.074 INFO:tasks.workunit.client.3.smithi157.stdout: 7.10 95.2k 88.8k 0.0k 952.0k 888.0k 0.0k nvme8n18 2024-03-26T17:11:13.074 INFO:tasks.workunit.client.3.smithi157.stdout: 7.10 124.0k 110.8k 0.0k 1.2M 1.1M 0.0k nvme8n19 2024-03-26T17:11:13.074 INFO:tasks.workunit.client.3.smithi157.stdout: 7.20 101.2k 95.2k 0.0k 1012.0k 952.0k 0.0k nvme8n2 2024-03-26T17:11:13.075 INFO:tasks.workunit.client.3.smithi157.stdout: 7.10 80.8k 122.4k 0.0k 808.0k 1.2M 0.0k nvme8n20 2024-03-26T17:11:13.075 INFO:tasks.workunit.client.3.smithi157.stdout: 7.20 98.8k 116.4k 0.0k 988.0k 1.1M 0.0k nvme8n3 2024-03-26T17:11:13.075 INFO:tasks.workunit.client.3.smithi157.stdout: 7.20 108.8k 74.4k 0.0k 1.1M 744.0k 0.0k nvme8n4 2024-03-26T17:11:13.075 INFO:tasks.workunit.client.3.smithi157.stdout: 7.20 117.6k 100.8k 0.0k 1.1M 1008.0k 0.0k nvme8n5 2024-03-26T17:11:13.075 INFO:tasks.workunit.client.3.smithi157.stdout: 7.10 98.0k 94.0k 0.0k 980.0k 940.0k 0.0k nvme8n6 2024-03-26T17:11:13.075 INFO:tasks.workunit.client.3.smithi157.stdout: 7.10 99.6k 102.4k 0.0k 996.0k 1.0M 0.0k nvme8n7 2024-03-26T17:11:13.075 INFO:tasks.workunit.client.3.smithi157.stdout: 7.10 95.2k 74.4k 0.0k 952.0k 744.0k 0.0k nvme8n8 2024-03-26T17:11:13.075 INFO:tasks.workunit.client.3.smithi157.stdout: 7.10 120.8k 135.2k 0.0k 1.2M 1.3M 0.0k nvme8n9 2024-03-26T17:11:13.075 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:11:13.587 INFO:tasks.workunit.client.3.smithi157.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-26T17:11:13.587 INFO:tasks.workunit.client.3.smithi157.stdout:myimage43 5/s 2/s 134 KiB/s 68 KiB/s 3.43 ms 398.98 us 2024-03-26T17:11:13.587 INFO:tasks.workunit.client.3.smithi157.stdout:myimage15 5/s 2/s 114 KiB/s 78 KiB/s 2.89 ms 347.58 us 2024-03-26T17:11:13.587 INFO:tasks.workunit.client.3.smithi157.stdout:myimage60 4/s 2/s 102 KiB/s 93 KiB/s 3.49 ms 562.55 us 2024-03-26T17:11:13.587 INFO:tasks.workunit.client.3.smithi157.stdout:myimage40 4/s 2/s 98 KiB/s 52 KiB/s 2.95 ms 476.18 us 2024-03-26T17:11:13.587 INFO:tasks.workunit.client.3.smithi157.stdout:myimage13 4/s 2/s 125 KiB/s 45 KiB/s 2.81 ms 542.26 us 2024-03-26T17:11:13.587 INFO:tasks.workunit.client.3.smithi157.stdout:myimage4 4/s 3/s 118 KiB/s 82 KiB/s 2.89 ms 370.76 us 2024-03-26T17:11:13.588 INFO:tasks.workunit.client.3.smithi157.stdout:myimage12 4/s 3/s 145 KiB/s 95 KiB/s 3.31 ms 344.04 us 2024-03-26T17:11:13.588 INFO:tasks.workunit.client.3.smithi157.stdout:myimage58 4/s 3/s 73 KiB/s 74 KiB/s 2.83 ms 461.30 us 2024-03-26T17:11:13.588 INFO:tasks.workunit.client.3.smithi157.stdout:myimage6 4/s 4/s 90 KiB/s 99 KiB/s 3.43 ms 425.20 us 2024-03-26T17:11:13.588 INFO:tasks.workunit.client.3.smithi157.stdout:myimage19 4/s 3/s 117 KiB/s 109 KiB/s 2.98 ms 335.93 us 2024-03-26T17:11:13.588 INFO:tasks.workunit.client.3.smithi157.stdout:myimage26 4/s 3/s 93 KiB/s 69 KiB/s 3.32 ms 336.28 us 2024-03-26T17:11:13.588 INFO:tasks.workunit.client.3.smithi157.stdout:myimage55 4/s 3/s 118 KiB/s 88 KiB/s 3.47 ms 369.62 us 2024-03-26T17:11:13.588 INFO:tasks.workunit.client.3.smithi157.stdout:myimage48 4/s 4/s 84 KiB/s 100 KiB/s 3.39 ms 368.58 us 2024-03-26T17:11:13.588 INFO:tasks.workunit.client.3.smithi157.stdout:myimage49 4/s 3/s 126 KiB/s 154 KiB/s 3.05 ms 456.96 us 2024-03-26T17:11:13.588 INFO:tasks.workunit.client.3.smithi157.stdout:myimage1 4/s 3/s 90 KiB/s 72 KiB/s 2.57 ms 345.73 us 2024-03-26T17:11:13.588 INFO:tasks.workunit.client.3.smithi157.stdout:myimage10 4/s 3/s 102 KiB/s 86 KiB/s 2.94 ms 323.06 us 2024-03-26T17:11:13.588 INFO:tasks.workunit.client.3.smithi157.stdout:myimage3 3/s 3/s 100 KiB/s 83 KiB/s 2.75 ms 342.66 us 2024-03-26T17:11:13.588 INFO:tasks.workunit.client.3.smithi157.stdout:myimage22 3/s 4/s 93 KiB/s 102 KiB/s 2.94 ms 349.92 us 2024-03-26T17:11:13.588 INFO:tasks.workunit.client.3.smithi157.stdout:myimage34 3/s 3/s 102 KiB/s 92 KiB/s 2.81 ms 292.66 us 2024-03-26T17:11:13.588 INFO:tasks.workunit.client.3.smithi157.stdout:myimage35 3/s 3/s 133 KiB/s 80 KiB/s 3.36 ms 323.06 us 2024-03-26T17:11:13.589 INFO:tasks.workunit.client.3.smithi157.stdout:myimage8 3/s 2/s 91 KiB/s 92 KiB/s 2.82 ms 440.48 us 2024-03-26T17:11:13.589 INFO:tasks.workunit.client.3.smithi157.stdout:myimage9 3/s 2/s 126 KiB/s 81 KiB/s 3.39 ms 417.53 us 2024-03-26T17:11:13.589 INFO:tasks.workunit.client.3.smithi157.stdout:myimage28 3/s 3/s 111 KiB/s 71 KiB/s 3.98 ms 335.54 us 2024-03-26T17:11:13.589 INFO:tasks.workunit.client.3.smithi157.stdout:myimage39 3/s 3/s 108 KiB/s 91 KiB/s 2.98 ms 366.78 us 2024-03-26T17:11:13.589 INFO:tasks.workunit.client.3.smithi157.stdout:myimage45 3/s 4/s 129 KiB/s 117 KiB/s 3.29 ms 351.41 us 2024-03-26T17:11:13.589 INFO:tasks.workunit.client.3.smithi157.stdout:myimage2 3/s 4/s 85 KiB/s 132 KiB/s 3.45 ms 469.44 us 2024-03-26T17:11:13.589 INFO:tasks.workunit.client.3.smithi157.stdout:myimage30 3/s 4/s 95 KiB/s 150 KiB/s 3.90 ms 369.66 us 2024-03-26T17:11:13.589 INFO:tasks.workunit.client.3.smithi157.stdout:myimage52 3/s 3/s 71 KiB/s 73 KiB/s 3.36 ms 326.75 us 2024-03-26T17:11:13.589 INFO:tasks.workunit.client.3.smithi157.stdout:myimage5 3/s 3/s 95 KiB/s 87 KiB/s 3.06 ms 421.51 us 2024-03-26T17:11:13.589 INFO:tasks.workunit.client.3.smithi157.stdout:myimage11 3/s 3/s 118 KiB/s 105 KiB/s 3.20 ms 363.37 us 2024-03-26T17:11:13.589 INFO:tasks.workunit.client.3.smithi157.stdout:myimage41 3/s 3/s 107 KiB/s 141 KiB/s 3.15 ms 466.69 us 2024-03-26T17:11:13.589 INFO:tasks.workunit.client.3.smithi157.stdout:myimage56 3/s 3/s 132 KiB/s 98 KiB/s 3.68 ms 368.97 us 2024-03-26T17:11:13.589 INFO:tasks.workunit.client.3.smithi157.stdout:myimage59 3/s 4/s 129 KiB/s 133 KiB/s 3.24 ms 429.43 us 2024-03-26T17:11:13.589 INFO:tasks.workunit.client.3.smithi157.stdout:myimage32 3/s 3/s 116 KiB/s 96 KiB/s 3.20 ms 416.53 us 2024-03-26T17:11:13.589 INFO:tasks.workunit.client.3.smithi157.stdout:myimage37 3/s 3/s 83 KiB/s 136 KiB/s 3.28 ms 407.93 us 2024-03-26T17:11:13.590 INFO:tasks.workunit.client.3.smithi157.stdout:myimage17 3/s 3/s 63 KiB/s 95 KiB/s 2.80 ms 456.25 us 2024-03-26T17:11:13.590 INFO:tasks.workunit.client.3.smithi157.stdout:myimage42 3/s 2/s 102 KiB/s 74 KiB/s 3.11 ms 318.28 us 2024-03-26T17:11:13.590 INFO:tasks.workunit.client.3.smithi157.stdout:myimage46 3/s 4/s 94 KiB/s 102 KiB/s 2.87 ms 365.48 us 2024-03-26T17:11:13.590 INFO:tasks.workunit.client.3.smithi157.stdout:myimage16 3/s 3/s 109 KiB/s 122 KiB/s 3.16 ms 369.37 us 2024-03-26T17:11:13.590 INFO:tasks.workunit.client.3.smithi157.stdout:myimage31 3/s 3/s 102 KiB/s 96 KiB/s 3.73 ms 422.82 us 2024-03-26T17:11:13.590 INFO:tasks.workunit.client.3.smithi157.stdout:myimage38 3/s 3/s 59 KiB/s 95 KiB/s 2.36 ms 495.43 us 2024-03-26T17:11:13.590 INFO:tasks.workunit.client.3.smithi157.stdout:myimage21 3/s 4/s 56 KiB/s 114 KiB/s 4.07 ms 346.45 us 2024-03-26T17:11:13.590 INFO:tasks.workunit.client.3.smithi157.stdout:myimage36 3/s 4/s 78 KiB/s 122 KiB/s 2.98 ms 465.26 us 2024-03-26T17:11:13.590 INFO:tasks.workunit.client.3.smithi157.stdout:myimage50 3/s 3/s 95 KiB/s 95 KiB/s 3.38 ms 385.30 us 2024-03-26T17:11:13.590 INFO:tasks.workunit.client.3.smithi157.stdout:myimage51 3/s 3/s 72 KiB/s 112 KiB/s 3.17 ms 336.14 us 2024-03-26T17:11:13.590 INFO:tasks.workunit.client.3.smithi157.stdout:myimage47 3/s 3/s 100 KiB/s 117 KiB/s 3.41 ms 399.67 us 2024-03-26T17:11:13.590 INFO:tasks.workunit.client.3.smithi157.stdout:myimage18 3/s 4/s 79 KiB/s 83 KiB/s 2.79 ms 418.59 us 2024-03-26T17:11:13.590 INFO:tasks.workunit.client.3.smithi157.stdout:myimage20 3/s 3/s 43 KiB/s 90 KiB/s 2.90 ms 405.47 us 2024-03-26T17:11:13.590 INFO:tasks.workunit.client.3.smithi157.stdout:myimage25 3/s 3/s 90 KiB/s 111 KiB/s 3.94 ms 476.38 us 2024-03-26T17:11:13.591 INFO:tasks.workunit.client.3.smithi157.stdout:myimage27 3/s 4/s 82 KiB/s 99 KiB/s 3.02 ms 415.32 us 2024-03-26T17:11:13.591 INFO:tasks.workunit.client.3.smithi157.stdout:myimage29 3/s 3/s 86 KiB/s 90 KiB/s 2.85 ms 329.80 us 2024-03-26T17:11:13.591 INFO:tasks.workunit.client.3.smithi157.stdout:myimage53 3/s 4/s 105 KiB/s 129 KiB/s 2.76 ms 338.50 us 2024-03-26T17:11:13.591 INFO:tasks.workunit.client.3.smithi157.stdout:myimage57 3/s 3/s 88 KiB/s 98 KiB/s 3.00 ms 329.37 us 2024-03-26T17:11:13.591 INFO:tasks.workunit.client.3.smithi157.stdout:myimage14 2/s 3/s 82 KiB/s 74 KiB/s 3.47 ms 331.65 us 2024-03-26T17:11:13.591 INFO:tasks.workunit.client.3.smithi157.stdout:myimage24 2/s 3/s 92 KiB/s 110 KiB/s 3.04 ms 535.90 us 2024-03-26T17:11:13.591 INFO:tasks.workunit.client.3.smithi157.stdout:myimage54 2/s 4/s 59 KiB/s 117 KiB/s 2.77 ms 506.40 us 2024-03-26T17:11:13.591 INFO:tasks.workunit.client.3.smithi157.stdout:myimage23 2/s 4/s 74 KiB/s 102 KiB/s 2.66 ms 270.04 us 2024-03-26T17:11:13.591 INFO:tasks.workunit.client.3.smithi157.stdout:myimage33 2/s 3/s 69 KiB/s 92 KiB/s 3.31 ms 325.08 us 2024-03-26T17:11:13.591 INFO:tasks.workunit.client.3.smithi157.stdout:myimage7 2/s 3/s 54 KiB/s 74 KiB/s 3.03 ms 487.27 us 2024-03-26T17:11:13.591 INFO:tasks.workunit.client.3.smithi157.stdout:myimage44 1/s 4/s 41 KiB/s 88 KiB/s 3.17 ms 374.83 us 2024-03-26T17:11:13.591 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:11:14.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:14 smithi044 ceph-mon[30624]: pgmap v765: 33 pgs: 33 active+clean; 1.0 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 5.9 MiB/s rd, 5.8 MiB/s wr, 434 op/s 2024-03-26T17:11:14.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:14 smithi044 ceph-mon[30624]: Health check update: 3 slow ops, oldest one blocked for 768 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:11:14.266 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:11:13 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:11:13] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:11:14.266 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:11:13 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:11:13] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:11:14.266 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:11:13 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:11:14.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:14 smithi149 ceph-mon[34678]: pgmap v765: 33 pgs: 33 active+clean; 1.0 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 5.9 MiB/s rd, 5.8 MiB/s wr, 434 op/s 2024-03-26T17:11:14.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:14 smithi149 ceph-mon[34678]: Health check update: 3 slow ops, oldest one blocked for 768 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:11:14.396 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:11:14 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:11:14] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:11:14.396 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:11:14 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:11:14] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:11:14.397 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:11:14 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:11:14.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:14 smithi064 ceph-mon[34420]: pgmap v765: 33 pgs: 33 active+clean; 1.0 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 5.9 MiB/s rd, 5.8 MiB/s wr, 434 op/s 2024-03-26T17:11:14.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:14 smithi064 ceph-mon[34420]: Health check update: 3 slow ops, oldest one blocked for 768 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:11:15.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:15 smithi044 ceph-mon[30624]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:11:15.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:15 smithi044 ceph-mon[30624]: { 2024-03-26T17:11:15.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:15 smithi044 ceph-mon[30624]: "prefix": "rbd perf image stats", 2024-03-26T17:11:15.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:15 smithi044 ceph-mon[30624]: "pool_spec": "mypool", 2024-03-26T17:11:15.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:15 smithi044 ceph-mon[30624]: "sort_by": "write_ops", 2024-03-26T17:11:15.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:15 smithi044 ceph-mon[30624]: "format": "json" 2024-03-26T17:11:15.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:15 smithi044 ceph-mon[30624]: }"]: dispatch 2024-03-26T17:11:15.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:15 smithi064 ceph-mon[34420]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:11:15.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:15 smithi064 ceph-mon[34420]: { 2024-03-26T17:11:15.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:15 smithi064 ceph-mon[34420]: "prefix": "rbd perf image stats", 2024-03-26T17:11:15.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:15 smithi064 ceph-mon[34420]: "pool_spec": "mypool", 2024-03-26T17:11:15.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:15 smithi064 ceph-mon[34420]: "sort_by": "write_ops", 2024-03-26T17:11:15.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:15 smithi064 ceph-mon[34420]: "format": "json" 2024-03-26T17:11:15.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:15 smithi064 ceph-mon[34420]: }"]: dispatch 2024-03-26T17:11:15.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:15 smithi149 ceph-mon[34678]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:11:15.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:15 smithi149 ceph-mon[34678]: { 2024-03-26T17:11:15.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:15 smithi149 ceph-mon[34678]: "prefix": "rbd perf image stats", 2024-03-26T17:11:15.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:15 smithi149 ceph-mon[34678]: "pool_spec": "mypool", 2024-03-26T17:11:15.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:15 smithi149 ceph-mon[34678]: "sort_by": "write_ops", 2024-03-26T17:11:15.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:15 smithi149 ceph-mon[34678]: "format": "json" 2024-03-26T17:11:15.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:15 smithi149 ceph-mon[34678]: }"]: dispatch 2024-03-26T17:11:16.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:16 smithi044 ceph-mon[30624]: pgmap v766: 33 pgs: 33 active+clean; 1.0 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 5.7 MiB/s rd, 5.7 MiB/s wr, 428 op/s 2024-03-26T17:11:16.265 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:11:15 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:11:15] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:11:16.265 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:11:15 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:11:15] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:11:16.266 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:11:15 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:11:16.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:16 smithi149 ceph-mon[34678]: pgmap v766: 33 pgs: 33 active+clean; 1.0 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 5.7 MiB/s rd, 5.7 MiB/s wr, 428 op/s 2024-03-26T17:11:16.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:16 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 2024-03-26T17:11:16.245+0000 7fa707a55700 -1 mon.c@1(peon) e3 get_health_metrics reporting 3 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T17:11:16.396 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:11:16 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:11:16] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:11:16.397 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:11:16 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:11:16] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:11:16.397 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:11:16 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:11:16.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:16 smithi064 ceph-mon[34420]: pgmap v766: 33 pgs: 33 active+clean; 1.0 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 5.7 MiB/s rd, 5.7 MiB/s wr, 428 op/s 2024-03-26T17:11:18.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:18 smithi044 ceph-mon[30624]: pgmap v767: 33 pgs: 33 active+clean; 1.0 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 5.7 MiB/s rd, 5.6 MiB/s wr, 429 op/s 2024-03-26T17:11:18.266 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:11:17 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:11:17] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:11:18.266 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:11:17 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:11:17] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:11:18.266 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:11:17 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:11:18.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:18 smithi149 ceph-mon[34678]: pgmap v767: 33 pgs: 33 active+clean; 1.0 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 5.7 MiB/s rd, 5.6 MiB/s wr, 429 op/s 2024-03-26T17:11:18.396 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:11:18 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:11:18] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:11:18.396 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:11:18 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:11:18] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:11:18.397 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:11:18 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:11:18.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:18 smithi064 ceph-mon[34420]: pgmap v767: 33 pgs: 33 active+clean; 1.0 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 5.7 MiB/s rd, 5.6 MiB/s wr, 429 op/s 2024-03-26T17:11:18.591 INFO:tasks.workunit.client.3.smithi157.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-26T17:11:18.591 INFO:tasks.workunit.client.3.smithi157.stdout:myimage57 5/s 3/s 150 KiB/s 47 KiB/s 3.12 ms 297.62 us 2024-03-26T17:11:18.591 INFO:tasks.workunit.client.3.smithi157.stdout:myimage20 5/s 3/s 102 KiB/s 76 KiB/s 2.70 ms 503.60 us 2024-03-26T17:11:18.591 INFO:tasks.workunit.client.3.smithi157.stdout:myimage22 4/s 1/s 130 KiB/s 55 KiB/s 2.97 ms 355.11 us 2024-03-26T17:11:18.591 INFO:tasks.workunit.client.3.smithi157.stdout:myimage35 4/s 3/s 127 KiB/s 84 KiB/s 3.30 ms 302.61 us 2024-03-26T17:11:18.591 INFO:tasks.workunit.client.3.smithi157.stdout:myimage18 4/s 3/s 120 KiB/s 70 KiB/s 2.87 ms 346.99 us 2024-03-26T17:11:18.591 INFO:tasks.workunit.client.3.smithi157.stdout:myimage24 4/s 3/s 122 KiB/s 76 KiB/s 3.17 ms 417.05 us 2024-03-26T17:11:18.591 INFO:tasks.workunit.client.3.smithi157.stdout:myimage6 4/s 2/s 106 KiB/s 55 KiB/s 3.64 ms 308.36 us 2024-03-26T17:11:18.591 INFO:tasks.workunit.client.3.smithi157.stdout:myimage44 4/s 4/s 100 KiB/s 106 KiB/s 2.98 ms 347.34 us 2024-03-26T17:11:18.592 INFO:tasks.workunit.client.3.smithi157.stdout:myimage27 4/s 3/s 121 KiB/s 54 KiB/s 2.81 ms 317.08 us 2024-03-26T17:11:18.592 INFO:tasks.workunit.client.3.smithi157.stdout:myimage33 4/s 3/s 132 KiB/s 103 KiB/s 3.09 ms 446.31 us 2024-03-26T17:11:18.592 INFO:tasks.workunit.client.3.smithi157.stdout:myimage10 4/s 2/s 145 KiB/s 77 KiB/s 2.90 ms 456.10 us 2024-03-26T17:11:18.592 INFO:tasks.workunit.client.3.smithi157.stdout:myimage14 4/s 5/s 91 KiB/s 131 KiB/s 3.14 ms 343.09 us 2024-03-26T17:11:18.592 INFO:tasks.workunit.client.3.smithi157.stdout:myimage1 4/s 3/s 97 KiB/s 99 KiB/s 2.59 ms 289.76 us 2024-03-26T17:11:18.592 INFO:tasks.workunit.client.3.smithi157.stdout:myimage41 4/s 3/s 106 KiB/s 138 KiB/s 3.18 ms 357.29 us 2024-03-26T17:11:18.592 INFO:tasks.workunit.client.3.smithi157.stdout:myimage30 4/s 3/s 127 KiB/s 93 KiB/s 3.89 ms 396.70 us 2024-03-26T17:11:18.592 INFO:tasks.workunit.client.3.smithi157.stdout:myimage13 3/s 2/s 94 KiB/s 70 KiB/s 2.71 ms 350.91 us 2024-03-26T17:11:18.592 INFO:tasks.workunit.client.3.smithi157.stdout:myimage16 3/s 3/s 124 KiB/s 106 KiB/s 2.92 ms 564.87 us 2024-03-26T17:11:18.592 INFO:tasks.workunit.client.3.smithi157.stdout:myimage11 3/s 3/s 118 KiB/s 106 KiB/s 3.78 ms 319.58 us 2024-03-26T17:11:18.592 INFO:tasks.workunit.client.3.smithi157.stdout:myimage39 3/s 3/s 118 KiB/s 84 KiB/s 2.92 ms 350.12 us 2024-03-26T17:11:18.592 INFO:tasks.workunit.client.3.smithi157.stdout:myimage43 3/s 3/s 99 KiB/s 93 KiB/s 3.20 ms 364.20 us 2024-03-26T17:11:18.592 INFO:tasks.workunit.client.3.smithi157.stdout:myimage51 3/s 3/s 111 KiB/s 102 KiB/s 3.82 ms 359.05 us 2024-03-26T17:11:18.592 INFO:tasks.workunit.client.3.smithi157.stdout:myimage55 3/s 3/s 108 KiB/s 121 KiB/s 3.61 ms 471.26 us 2024-03-26T17:11:18.592 INFO:tasks.workunit.client.3.smithi157.stdout:myimage56 3/s 3/s 103 KiB/s 68 KiB/s 3.78 ms 368.28 us 2024-03-26T17:11:18.593 INFO:tasks.workunit.client.3.smithi157.stdout:myimage32 3/s 4/s 100 KiB/s 111 KiB/s 3.19 ms 463.11 us 2024-03-26T17:11:18.593 INFO:tasks.workunit.client.3.smithi157.stdout:myimage47 3/s 3/s 110 KiB/s 114 KiB/s 3.32 ms 369.11 us 2024-03-26T17:11:18.593 INFO:tasks.workunit.client.3.smithi157.stdout:myimage48 3/s 3/s 79 KiB/s 138 KiB/s 3.13 ms 450.24 us 2024-03-26T17:11:18.593 INFO:tasks.workunit.client.3.smithi157.stdout:myimage4 3/s 3/s 92 KiB/s 83 KiB/s 3.32 ms 410.33 us 2024-03-26T17:11:18.593 INFO:tasks.workunit.client.3.smithi157.stdout:myimage9 3/s 2/s 94 KiB/s 70 KiB/s 3.33 ms 285.83 us 2024-03-26T17:11:18.593 INFO:tasks.workunit.client.3.smithi157.stdout:myimage15 3/s 4/s 73 KiB/s 112 KiB/s 2.88 ms 377.31 us 2024-03-26T17:11:18.593 INFO:tasks.workunit.client.3.smithi157.stdout:myimage21 3/s 4/s 85 KiB/s 83 KiB/s 3.97 ms 467.38 us 2024-03-26T17:11:18.593 INFO:tasks.workunit.client.3.smithi157.stdout:myimage25 3/s 4/s 94 KiB/s 103 KiB/s 4.02 ms 326.21 us 2024-03-26T17:11:18.593 INFO:tasks.workunit.client.3.smithi157.stdout:myimage29 3/s 4/s 85 KiB/s 106 KiB/s 2.72 ms 387.91 us 2024-03-26T17:11:18.593 INFO:tasks.workunit.client.3.smithi157.stdout:myimage3 3/s 3/s 74 KiB/s 82 KiB/s 2.26 ms 365.28 us 2024-03-26T17:11:18.593 INFO:tasks.workunit.client.3.smithi157.stdout:myimage23 3/s 4/s 98 KiB/s 118 KiB/s 2.63 ms 404.41 us 2024-03-26T17:11:18.593 INFO:tasks.workunit.client.3.smithi157.stdout:myimage34 3/s 3/s 103 KiB/s 78 KiB/s 3.10 ms 347.37 us 2024-03-26T17:11:18.593 INFO:tasks.workunit.client.3.smithi157.stdout:myimage40 3/s 4/s 77 KiB/s 98 KiB/s 2.76 ms 338.59 us 2024-03-26T17:11:18.593 INFO:tasks.workunit.client.3.smithi157.stdout:myimage26 3/s 3/s 97 KiB/s 90 KiB/s 3.09 ms 381.47 us 2024-03-26T17:11:18.593 INFO:tasks.workunit.client.3.smithi157.stdout:myimage28 3/s 3/s 100 KiB/s 130 KiB/s 4.03 ms 346.81 us 2024-03-26T17:11:18.594 INFO:tasks.workunit.client.3.smithi157.stdout:myimage53 3/s 3/s 110 KiB/s 99 KiB/s 3.07 ms 337.72 us 2024-03-26T17:11:18.594 INFO:tasks.workunit.client.3.smithi157.stdout:myimage7 3/s 4/s 84 KiB/s 82 KiB/s 3.44 ms 418.56 us 2024-03-26T17:11:18.594 INFO:tasks.workunit.client.3.smithi157.stdout:myimage36 3/s 4/s 98 KiB/s 122 KiB/s 3.02 ms 428.93 us 2024-03-26T17:11:18.594 INFO:tasks.workunit.client.3.smithi157.stdout:myimage42 3/s 4/s 80 KiB/s 110 KiB/s 2.74 ms 420.29 us 2024-03-26T17:11:18.594 INFO:tasks.workunit.client.3.smithi157.stdout:myimage60 3/s 4/s 98 KiB/s 106 KiB/s 3.16 ms 422.21 us 2024-03-26T17:11:18.594 INFO:tasks.workunit.client.3.smithi157.stdout:myimage2 3/s 4/s 76 KiB/s 99 KiB/s 3.46 ms 408.97 us 2024-03-26T17:11:18.594 INFO:tasks.workunit.client.3.smithi157.stdout:myimage31 3/s 4/s 60 KiB/s 118 KiB/s 3.23 ms 369.15 us 2024-03-26T17:11:18.594 INFO:tasks.workunit.client.3.smithi157.stdout:myimage5 3/s 4/s 75 KiB/s 121 KiB/s 2.72 ms 344.87 us 2024-03-26T17:11:18.594 INFO:tasks.workunit.client.3.smithi157.stdout:myimage8 3/s 5/s 81 KiB/s 144 KiB/s 2.87 ms 359.86 us 2024-03-26T17:11:18.594 INFO:tasks.workunit.client.3.smithi157.stdout:myimage12 3/s 4/s 98 KiB/s 99 KiB/s 3.14 ms 300.30 us 2024-03-26T17:11:18.594 INFO:tasks.workunit.client.3.smithi157.stdout:myimage54 3/s 3/s 50 KiB/s 90 KiB/s 2.95 ms 451.12 us 2024-03-26T17:11:18.594 INFO:tasks.workunit.client.3.smithi157.stdout:myimage38 2/s 2/s 63 KiB/s 76 KiB/s 2.48 ms 401.22 us 2024-03-26T17:11:18.594 INFO:tasks.workunit.client.3.smithi157.stdout:myimage58 2/s 4/s 72 KiB/s 85 KiB/s 2.73 ms 396.86 us 2024-03-26T17:11:18.594 INFO:tasks.workunit.client.3.smithi157.stdout:myimage17 2/s 4/s 71 KiB/s 94 KiB/s 3.26 ms 362.06 us 2024-03-26T17:11:18.595 INFO:tasks.workunit.client.3.smithi157.stdout:myimage59 2/s 3/s 67 KiB/s 98 KiB/s 3.18 ms 451.14 us 2024-03-26T17:11:18.595 INFO:tasks.workunit.client.3.smithi157.stdout:myimage37 2/s 4/s 50 KiB/s 136 KiB/s 3.82 ms 351.64 us 2024-03-26T17:11:18.595 INFO:tasks.workunit.client.3.smithi157.stdout:myimage52 2/s 4/s 68 KiB/s 116 KiB/s 3.49 ms 358.67 us 2024-03-26T17:11:18.595 INFO:tasks.workunit.client.3.smithi157.stdout:myimage19 2/s 3/s 57 KiB/s 86 KiB/s 2.90 ms 393.98 us 2024-03-26T17:11:18.595 INFO:tasks.workunit.client.3.smithi157.stdout:myimage45 2/s 3/s 63 KiB/s 106 KiB/s 3.01 ms 351.63 us 2024-03-26T17:11:18.595 INFO:tasks.workunit.client.3.smithi157.stdout:myimage50 2/s 5/s 78 KiB/s 134 KiB/s 3.35 ms 363.80 us 2024-03-26T17:11:18.595 INFO:tasks.workunit.client.3.smithi157.stdout:myimage49 2/s 4/s 74 KiB/s 141 KiB/s 2.75 ms 333.03 us 2024-03-26T17:11:18.595 INFO:tasks.workunit.client.3.smithi157.stdout:myimage46 2/s 4/s 23 KiB/s 141 KiB/s 2.93 ms 425.94 us 2024-03-26T17:11:18.595 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:11:19.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:19 smithi044 ceph-mon[30624]: Health check update: 3 slow ops, oldest one blocked for 773 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:11:19.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:19 smithi064 ceph-mon[34420]: Health check update: 3 slow ops, oldest one blocked for 773 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:11:19.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:19 smithi149 ceph-mon[34678]: Health check update: 3 slow ops, oldest one blocked for 773 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:11:20.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:20 smithi044 ceph-mon[30624]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:11:20.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:20 smithi044 ceph-mon[30624]: { 2024-03-26T17:11:20.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:20 smithi044 ceph-mon[30624]: "prefix": "rbd perf image stats", 2024-03-26T17:11:20.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:20 smithi044 ceph-mon[30624]: "pool_spec": "mypool", 2024-03-26T17:11:20.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:20 smithi044 ceph-mon[30624]: "sort_by": "write_ops", 2024-03-26T17:11:20.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:20 smithi044 ceph-mon[30624]: "format": "json" 2024-03-26T17:11:20.266 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:20 smithi044 ceph-mon[30624]: }"]: dispatch 2024-03-26T17:11:20.266 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:20 smithi044 ceph-mon[30624]: pgmap v768: 33 pgs: 33 active+clean; 1.0 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 6.1 MiB/s rd, 5.9 MiB/s wr, 457 op/s 2024-03-26T17:11:20.266 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:11:19 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:11:19] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:11:20.266 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:11:19 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:11:19] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:11:20.267 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:11:19 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:11:20.547 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:20 smithi149 ceph-mon[34678]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:11:20.548 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:20 smithi149 ceph-mon[34678]: { 2024-03-26T17:11:20.548 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:20 smithi149 ceph-mon[34678]: "prefix": "rbd perf image stats", 2024-03-26T17:11:20.548 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:20 smithi149 ceph-mon[34678]: "pool_spec": "mypool", 2024-03-26T17:11:20.548 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:20 smithi149 ceph-mon[34678]: "sort_by": "write_ops", 2024-03-26T17:11:20.548 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:20 smithi149 ceph-mon[34678]: "format": "json" 2024-03-26T17:11:20.548 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:20 smithi149 ceph-mon[34678]: }"]: dispatch 2024-03-26T17:11:20.548 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:20 smithi149 ceph-mon[34678]: pgmap v768: 33 pgs: 33 active+clean; 1.0 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 6.1 MiB/s rd, 5.9 MiB/s wr, 457 op/s 2024-03-26T17:11:20.549 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:11:20 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:11:20] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:11:20.549 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:11:20 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:11:20] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:11:20.549 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:11:20 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:11:20.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:20 smithi064 ceph-mon[34420]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:11:20.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:20 smithi064 ceph-mon[34420]: { 2024-03-26T17:11:20.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:20 smithi064 ceph-mon[34420]: "prefix": "rbd perf image stats", 2024-03-26T17:11:20.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:20 smithi064 ceph-mon[34420]: "pool_spec": "mypool", 2024-03-26T17:11:20.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:20 smithi064 ceph-mon[34420]: "sort_by": "write_ops", 2024-03-26T17:11:20.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:20 smithi064 ceph-mon[34420]: "format": "json" 2024-03-26T17:11:20.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:20 smithi064 ceph-mon[34420]: }"]: dispatch 2024-03-26T17:11:20.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:20 smithi064 ceph-mon[34420]: pgmap v768: 33 pgs: 33 active+clean; 1.0 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 6.1 MiB/s rd, 5.9 MiB/s wr, 457 op/s 2024-03-26T17:11:21.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:21 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 2024-03-26T17:11:21.246+0000 7fa707a55700 -1 mon.c@1(peon) e3 get_health_metrics reporting 3 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T17:11:22.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:22 smithi044 ceph-mon[30624]: pgmap v769: 33 pgs: 33 active+clean; 1.0 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 6.0 MiB/s rd, 5.7 MiB/s wr, 457 op/s 2024-03-26T17:11:22.266 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:11:21 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:11:21] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:11:22.266 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:11:21 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:11:21] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:11:22.266 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:11:21 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:11:22.547 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:22 smithi149 ceph-mon[34678]: pgmap v769: 33 pgs: 33 active+clean; 1.0 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 6.0 MiB/s rd, 5.7 MiB/s wr, 457 op/s 2024-03-26T17:11:22.547 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:11:22 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:11:22] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:11:22.548 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:11:22 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:11:22] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:11:22.548 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:11:22 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:11:22.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:22 smithi064 ceph-mon[34420]: pgmap v769: 33 pgs: 33 active+clean; 1.0 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 6.0 MiB/s rd, 5.7 MiB/s wr, 457 op/s 2024-03-26T17:11:23.063 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:11:23.073 INFO:tasks.workunit.client.3.smithi157.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2024-03-26T17:11:23.073 INFO:tasks.workunit.client.3.smithi157.stdout: 7.20 88.4k 65.2k 0.0k 884.0k 652.0k 0.0k nvme2n1 2024-03-26T17:11:23.073 INFO:tasks.workunit.client.3.smithi157.stdout: 7.20 87.6k 94.0k 0.0k 876.0k 940.0k 0.0k nvme2n10 2024-03-26T17:11:23.073 INFO:tasks.workunit.client.3.smithi157.stdout: 7.20 116.4k 96.4k 0.0k 1.1M 964.0k 0.0k nvme2n11 2024-03-26T17:11:23.073 INFO:tasks.workunit.client.3.smithi157.stdout: 7.20 105.2k 114.4k 0.0k 1.0M 1.1M 0.0k nvme2n12 2024-03-26T17:11:23.073 INFO:tasks.workunit.client.3.smithi157.stdout: 7.20 100.4k 76.0k 0.0k 1004.0k 760.0k 0.0k nvme2n13 2024-03-26T17:11:23.073 INFO:tasks.workunit.client.3.smithi157.stdout: 7.20 84.0k 90.8k 0.0k 840.0k 908.0k 0.0k nvme2n14 2024-03-26T17:11:23.073 INFO:tasks.workunit.client.3.smithi157.stdout: 7.20 87.6k 81.2k 0.0k 876.0k 812.0k 0.0k nvme2n15 2024-03-26T17:11:23.073 INFO:tasks.workunit.client.3.smithi157.stdout: 7.20 95.2k 103.2k 0.0k 952.0k 1.0M 0.0k nvme2n16 2024-03-26T17:11:23.073 INFO:tasks.workunit.client.3.smithi157.stdout: 7.20 90.8k 88.8k 0.0k 908.0k 888.0k 0.0k nvme2n17 2024-03-26T17:11:23.073 INFO:tasks.workunit.client.3.smithi157.stdout: 7.20 89.6k 86.4k 0.0k 896.0k 864.0k 0.0k nvme2n18 2024-03-26T17:11:23.073 INFO:tasks.workunit.client.3.smithi157.stdout: 7.20 94.4k 88.8k 0.0k 944.0k 888.0k 0.0k nvme2n19 2024-03-26T17:11:23.074 INFO:tasks.workunit.client.3.smithi157.stdout: 7.20 100.4k 69.6k 0.0k 1004.0k 696.0k 0.0k nvme2n2 2024-03-26T17:11:23.074 INFO:tasks.workunit.client.3.smithi157.stdout: 7.20 54.4k 88.0k 0.0k 544.0k 880.0k 0.0k nvme2n20 2024-03-26T17:11:23.074 INFO:tasks.workunit.client.3.smithi157.stdout: 7.20 89.2k 70.8k 0.0k 892.0k 708.0k 0.0k nvme2n3 2024-03-26T17:11:23.074 INFO:tasks.workunit.client.3.smithi157.stdout: 7.20 118.4k 84.0k 0.0k 1.2M 840.0k 0.0k nvme2n4 2024-03-26T17:11:23.074 INFO:tasks.workunit.client.3.smithi157.stdout: 7.20 126.4k 84.4k 0.0k 1.2M 844.0k 0.0k nvme2n5 2024-03-26T17:11:23.074 INFO:tasks.workunit.client.3.smithi157.stdout: 7.30 76.0k 97.6k 0.0k 760.0k 976.0k 0.0k nvme2n6 2024-03-26T17:11:23.075 INFO:tasks.workunit.client.3.smithi157.stdout: 7.30 85.6k 85.2k 0.0k 856.0k 852.0k 0.0k nvme2n7 2024-03-26T17:11:23.075 INFO:tasks.workunit.client.3.smithi157.stdout: 7.30 90.0k 88.0k 0.0k 900.0k 880.0k 0.0k nvme2n8 2024-03-26T17:11:23.075 INFO:tasks.workunit.client.3.smithi157.stdout: 7.30 88.8k 91.6k 0.0k 888.0k 916.0k 0.0k nvme2n9 2024-03-26T17:11:23.075 INFO:tasks.workunit.client.3.smithi157.stdout: 7.20 63.2k 102.4k 0.0k 632.0k 1.0M 0.0k nvme5n1 2024-03-26T17:11:23.075 INFO:tasks.workunit.client.3.smithi157.stdout: 7.20 86.0k 118.8k 0.0k 860.0k 1.2M 0.0k nvme5n10 2024-03-26T17:11:23.075 INFO:tasks.workunit.client.3.smithi157.stdout: 7.20 84.4k 92.4k 0.0k 844.0k 924.0k 0.0k nvme5n11 2024-03-26T17:11:23.075 INFO:tasks.workunit.client.3.smithi157.stdout: 7.20 104.0k 85.2k 0.0k 1.0M 852.0k 0.0k nvme5n12 2024-03-26T17:11:23.075 INFO:tasks.workunit.client.3.smithi157.stdout: 7.20 79.6k 79.2k 0.0k 796.0k 792.0k 0.0k nvme5n13 2024-03-26T17:11:23.075 INFO:tasks.workunit.client.3.smithi157.stdout: 7.20 88.4k 85.6k 0.0k 884.0k 856.0k 0.0k nvme5n14 2024-03-26T17:11:23.075 INFO:tasks.workunit.client.3.smithi157.stdout: 7.20 100.0k 96.8k 0.0k 1000.0k 968.0k 0.0k nvme5n15 2024-03-26T17:11:23.075 INFO:tasks.workunit.client.3.smithi157.stdout: 7.20 104.0k 78.4k 0.0k 1.0M 784.0k 0.0k nvme5n16 2024-03-26T17:11:23.075 INFO:tasks.workunit.client.3.smithi157.stdout: 7.20 132.8k 56.0k 0.0k 1.3M 560.0k 0.0k nvme5n17 2024-03-26T17:11:23.075 INFO:tasks.workunit.client.3.smithi157.stdout: 7.20 111.6k 76.0k 0.0k 1.1M 760.0k 0.0k nvme5n18 2024-03-26T17:11:23.075 INFO:tasks.workunit.client.3.smithi157.stdout: 7.20 78.0k 107.6k 0.0k 780.0k 1.1M 0.0k nvme5n19 2024-03-26T17:11:23.076 INFO:tasks.workunit.client.3.smithi157.stdout: 7.20 61.6k 109.2k 0.0k 616.0k 1.1M 0.0k nvme5n2 2024-03-26T17:11:23.076 INFO:tasks.workunit.client.3.smithi157.stdout: 7.20 105.2k 91.2k 0.0k 1.0M 912.0k 0.0k nvme5n20 2024-03-26T17:11:23.076 INFO:tasks.workunit.client.3.smithi157.stdout: 7.20 92.8k 78.8k 0.0k 928.0k 788.0k 0.0k nvme5n3 2024-03-26T17:11:23.076 INFO:tasks.workunit.client.3.smithi157.stdout: 7.20 85.2k 84.4k 0.0k 852.0k 844.0k 0.0k nvme5n4 2024-03-26T17:11:23.076 INFO:tasks.workunit.client.3.smithi157.stdout: 7.20 78.8k 114.8k 0.0k 788.0k 1.1M 0.0k nvme5n5 2024-03-26T17:11:23.076 INFO:tasks.workunit.client.3.smithi157.stdout: 7.30 101.2k 116.0k 0.0k 1012.0k 1.1M 0.0k nvme5n6 2024-03-26T17:11:23.076 INFO:tasks.workunit.client.3.smithi157.stdout: 7.30 85.6k 125.2k 0.0k 856.0k 1.2M 0.0k nvme5n7 2024-03-26T17:11:23.076 INFO:tasks.workunit.client.3.smithi157.stdout: 7.30 87.2k 102.8k 0.0k 872.0k 1.0M 0.0k nvme5n8 2024-03-26T17:11:23.076 INFO:tasks.workunit.client.3.smithi157.stdout: 7.30 110.4k 95.2k 0.0k 1.1M 952.0k 0.0k nvme5n9 2024-03-26T17:11:23.076 INFO:tasks.workunit.client.3.smithi157.stdout: 7.20 87.6k 95.2k 0.0k 876.0k 952.0k 0.0k nvme8n1 2024-03-26T17:11:23.076 INFO:tasks.workunit.client.3.smithi157.stdout: 7.20 97.2k 69.6k 0.0k 972.0k 696.0k 0.0k nvme8n10 2024-03-26T17:11:23.076 INFO:tasks.workunit.client.3.smithi157.stdout: 7.20 98.4k 61.6k 0.0k 984.0k 616.0k 0.0k nvme8n11 2024-03-26T17:11:23.076 INFO:tasks.workunit.client.3.smithi157.stdout: 7.20 88.0k 78.0k 0.0k 880.0k 780.0k 0.0k nvme8n12 2024-03-26T17:11:23.076 INFO:tasks.workunit.client.3.smithi157.stdout: 7.20 110.0k 93.6k 0.0k 1.1M 936.0k 0.0k nvme8n13 2024-03-26T17:11:23.076 INFO:tasks.workunit.client.3.smithi157.stdout: 7.20 100.0k 55.2k 0.0k 1000.0k 552.0k 0.0k nvme8n14 2024-03-26T17:11:23.077 INFO:tasks.workunit.client.3.smithi157.stdout: 7.20 97.6k 82.0k 0.0k 976.0k 820.0k 0.0k nvme8n15 2024-03-26T17:11:23.077 INFO:tasks.workunit.client.3.smithi157.stdout: 7.20 86.0k 104.4k 0.0k 860.0k 1.0M 0.0k nvme8n16 2024-03-26T17:11:23.077 INFO:tasks.workunit.client.3.smithi157.stdout: 7.20 46.4k 146.0k 0.0k 464.0k 1.4M 0.0k nvme8n17 2024-03-26T17:11:23.077 INFO:tasks.workunit.client.3.smithi157.stdout: 7.20 91.2k 86.4k 0.0k 912.0k 864.0k 0.0k nvme8n18 2024-03-26T17:11:23.077 INFO:tasks.workunit.client.3.smithi157.stdout: 7.20 76.4k 112.4k 0.0k 764.0k 1.1M 0.0k nvme8n19 2024-03-26T17:11:23.077 INFO:tasks.workunit.client.3.smithi157.stdout: 7.20 108.0k 64.4k 0.0k 1.1M 644.0k 0.0k nvme8n2 2024-03-26T17:11:23.077 INFO:tasks.workunit.client.3.smithi157.stdout: 7.20 108.0k 72.0k 0.0k 1.1M 720.0k 0.0k nvme8n20 2024-03-26T17:11:23.077 INFO:tasks.workunit.client.3.smithi157.stdout: 7.20 100.8k 83.6k 0.0k 1008.0k 836.0k 0.0k nvme8n3 2024-03-26T17:11:23.077 INFO:tasks.workunit.client.3.smithi157.stdout: 7.20 82.4k 86.8k 0.0k 824.0k 868.0k 0.0k nvme8n4 2024-03-26T17:11:23.077 INFO:tasks.workunit.client.3.smithi157.stdout: 7.20 124.0k 101.6k 0.0k 1.2M 1016.0k 0.0k nvme8n5 2024-03-26T17:11:23.077 INFO:tasks.workunit.client.3.smithi157.stdout: 7.30 105.6k 55.6k 0.0k 1.0M 556.0k 0.0k nvme8n6 2024-03-26T17:11:23.077 INFO:tasks.workunit.client.3.smithi157.stdout: 7.30 112.0k 92.0k 0.0k 1.1M 920.0k 0.0k nvme8n7 2024-03-26T17:11:23.077 INFO:tasks.workunit.client.3.smithi157.stdout: 7.30 107.2k 106.0k 0.0k 1.0M 1.0M 0.0k nvme8n8 2024-03-26T17:11:23.077 INFO:tasks.workunit.client.3.smithi157.stdout: 7.30 147.6k 111.6k 0.0k 1.4M 1.1M 0.0k nvme8n9 2024-03-26T17:11:23.077 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:11:23.595 INFO:tasks.workunit.client.3.smithi157.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-26T17:11:23.595 INFO:tasks.workunit.client.3.smithi157.stdout:myimage59 5/s 2/s 148 KiB/s 62 KiB/s 3.50 ms 368.34 us 2024-03-26T17:11:23.595 INFO:tasks.workunit.client.3.smithi157.stdout:myimage57 4/s 2/s 131 KiB/s 43 KiB/s 3.37 ms 314.28 us 2024-03-26T17:11:23.595 INFO:tasks.workunit.client.3.smithi157.stdout:myimage56 4/s 3/s 122 KiB/s 87 KiB/s 3.66 ms 322.78 us 2024-03-26T17:11:23.595 INFO:tasks.workunit.client.3.smithi157.stdout:myimage22 4/s 3/s 95 KiB/s 81 KiB/s 3.05 ms 354.42 us 2024-03-26T17:11:23.595 INFO:tasks.workunit.client.3.smithi157.stdout:myimage47 4/s 3/s 102 KiB/s 101 KiB/s 3.41 ms 590.09 us 2024-03-26T17:11:23.595 INFO:tasks.workunit.client.3.smithi157.stdout:myimage11 4/s 2/s 101 KiB/s 95 KiB/s 3.59 ms 343.07 us 2024-03-26T17:11:23.596 INFO:tasks.workunit.client.3.smithi157.stdout:myimage19 4/s 4/s 105 KiB/s 93 KiB/s 3.08 ms 374.95 us 2024-03-26T17:11:23.596 INFO:tasks.workunit.client.3.smithi157.stdout:myimage26 4/s 4/s 131 KiB/s 105 KiB/s 3.13 ms 575.17 us 2024-03-26T17:11:23.596 INFO:tasks.workunit.client.3.smithi157.stdout:myimage45 4/s 3/s 135 KiB/s 88 KiB/s 2.79 ms 362.88 us 2024-03-26T17:11:23.596 INFO:tasks.workunit.client.3.smithi157.stdout:myimage16 4/s 2/s 97 KiB/s 74 KiB/s 3.46 ms 346.62 us 2024-03-26T17:11:23.596 INFO:tasks.workunit.client.3.smithi157.stdout:myimage48 4/s 2/s 109 KiB/s 85 KiB/s 3.05 ms 520.25 us 2024-03-26T17:11:23.596 INFO:tasks.workunit.client.3.smithi157.stdout:myimage58 4/s 2/s 90 KiB/s 62 KiB/s 2.79 ms 380.71 us 2024-03-26T17:11:23.596 INFO:tasks.workunit.client.3.smithi157.stdout:myimage6 4/s 3/s 90 KiB/s 87 KiB/s 3.07 ms 419.56 us 2024-03-26T17:11:23.596 INFO:tasks.workunit.client.3.smithi157.stdout:myimage9 4/s 4/s 102 KiB/s 97 KiB/s 3.79 ms 357.14 us 2024-03-26T17:11:23.596 INFO:tasks.workunit.client.3.smithi157.stdout:myimage15 4/s 2/s 102 KiB/s 62 KiB/s 2.67 ms 332.54 us 2024-03-26T17:11:23.596 INFO:tasks.workunit.client.3.smithi157.stdout:myimage20 4/s 3/s 72 KiB/s 74 KiB/s 3.03 ms 337.30 us 2024-03-26T17:11:23.596 INFO:tasks.workunit.client.3.smithi157.stdout:myimage21 4/s 3/s 94 KiB/s 70 KiB/s 3.84 ms 415.85 us 2024-03-26T17:11:23.596 INFO:tasks.workunit.client.3.smithi157.stdout:myimage33 4/s 3/s 82 KiB/s 83 KiB/s 3.07 ms 434.88 us 2024-03-26T17:11:23.596 INFO:tasks.workunit.client.3.smithi157.stdout:myimage43 4/s 3/s 113 KiB/s 92 KiB/s 3.24 ms 358.44 us 2024-03-26T17:11:23.596 INFO:tasks.workunit.client.3.smithi157.stdout:myimage5 3/s 3/s 84 KiB/s 131 KiB/s 2.80 ms 346.99 us 2024-03-26T17:11:23.597 INFO:tasks.workunit.client.3.smithi157.stdout:myimage12 3/s 3/s 92 KiB/s 123 KiB/s 2.96 ms 468.24 us 2024-03-26T17:11:23.597 INFO:tasks.workunit.client.3.smithi157.stdout:myimage41 3/s 3/s 70 KiB/s 78 KiB/s 3.42 ms 360.37 us 2024-03-26T17:11:23.597 INFO:tasks.workunit.client.3.smithi157.stdout:myimage42 3/s 4/s 78 KiB/s 130 KiB/s 3.01 ms 497.11 us 2024-03-26T17:11:23.597 INFO:tasks.workunit.client.3.smithi157.stdout:myimage55 3/s 3/s 88 KiB/s 65 KiB/s 3.45 ms 343.87 us 2024-03-26T17:11:23.597 INFO:tasks.workunit.client.3.smithi157.stdout:myimage23 3/s 4/s 88 KiB/s 73 KiB/s 2.54 ms 315.09 us 2024-03-26T17:11:23.597 INFO:tasks.workunit.client.3.smithi157.stdout:myimage31 3/s 3/s 114 KiB/s 82 KiB/s 3.73 ms 432.93 us 2024-03-26T17:11:23.597 INFO:tasks.workunit.client.3.smithi157.stdout:myimage35 3/s 3/s 106 KiB/s 128 KiB/s 2.89 ms 376.80 us 2024-03-26T17:11:23.597 INFO:tasks.workunit.client.3.smithi157.stdout:myimage52 3/s 4/s 83 KiB/s 97 KiB/s 3.42 ms 317.14 us 2024-03-26T17:11:23.597 INFO:tasks.workunit.client.3.smithi157.stdout:myimage8 3/s 3/s 86 KiB/s 54 KiB/s 3.43 ms 317.47 us 2024-03-26T17:11:23.597 INFO:tasks.workunit.client.3.smithi157.stdout:myimage29 3/s 3/s 114 KiB/s 94 KiB/s 2.65 ms 352.26 us 2024-03-26T17:11:23.597 INFO:tasks.workunit.client.3.smithi157.stdout:myimage39 3/s 3/s 98 KiB/s 83 KiB/s 3.25 ms 345.80 us 2024-03-26T17:11:23.597 INFO:tasks.workunit.client.3.smithi157.stdout:myimage30 3/s 3/s 94 KiB/s 90 KiB/s 4.04 ms 537.30 us 2024-03-26T17:11:23.597 INFO:tasks.workunit.client.3.smithi157.stdout:myimage34 3/s 4/s 97 KiB/s 106 KiB/s 2.93 ms 361.05 us 2024-03-26T17:11:23.597 INFO:tasks.workunit.client.3.smithi157.stdout:myimage40 3/s 3/s 87 KiB/s 103 KiB/s 2.88 ms 352.39 us 2024-03-26T17:11:23.597 INFO:tasks.workunit.client.3.smithi157.stdout:myimage1 3/s 4/s 72 KiB/s 81 KiB/s 2.44 ms 329.66 us 2024-03-26T17:11:23.598 INFO:tasks.workunit.client.3.smithi157.stdout:myimage4 3/s 5/s 98 KiB/s 154 KiB/s 2.99 ms 331.66 us 2024-03-26T17:11:23.598 INFO:tasks.workunit.client.3.smithi157.stdout:myimage7 3/s 3/s 82 KiB/s 94 KiB/s 3.15 ms 370.95 us 2024-03-26T17:11:23.598 INFO:tasks.workunit.client.3.smithi157.stdout:myimage17 3/s 3/s 90 KiB/s 94 KiB/s 3.15 ms 436.84 us 2024-03-26T17:11:23.598 INFO:tasks.workunit.client.3.smithi157.stdout:myimage24 3/s 3/s 79 KiB/s 75 KiB/s 2.88 ms 316.94 us 2024-03-26T17:11:23.598 INFO:tasks.workunit.client.3.smithi157.stdout:myimage25 3/s 4/s 126 KiB/s 95 KiB/s 4.03 ms 341.00 us 2024-03-26T17:11:23.598 INFO:tasks.workunit.client.3.smithi157.stdout:myimage50 3/s 3/s 65 KiB/s 71 KiB/s 3.02 ms 385.53 us 2024-03-26T17:11:23.598 INFO:tasks.workunit.client.3.smithi157.stdout:myimage53 3/s 2/s 77 KiB/s 96 KiB/s 3.17 ms 390.59 us 2024-03-26T17:11:23.598 INFO:tasks.workunit.client.3.smithi157.stdout:myimage60 3/s 4/s 57 KiB/s 131 KiB/s 3.58 ms 372.89 us 2024-03-26T17:11:23.598 INFO:tasks.workunit.client.3.smithi157.stdout:myimage3 3/s 4/s 62 KiB/s 98 KiB/s 2.59 ms 355.34 us 2024-03-26T17:11:23.598 INFO:tasks.workunit.client.3.smithi157.stdout:myimage14 3/s 2/s 85 KiB/s 53 KiB/s 3.64 ms 399.54 us 2024-03-26T17:11:23.598 INFO:tasks.workunit.client.3.smithi157.stdout:myimage32 3/s 4/s 78 KiB/s 116 KiB/s 2.96 ms 341.07 us 2024-03-26T17:11:23.598 INFO:tasks.workunit.client.3.smithi157.stdout:myimage38 3/s 4/s 70 KiB/s 142 KiB/s 2.55 ms 374.36 us 2024-03-26T17:11:23.598 INFO:tasks.workunit.client.3.smithi157.stdout:myimage27 3/s 4/s 110 KiB/s 110 KiB/s 2.76 ms 421.81 us 2024-03-26T17:11:23.598 INFO:tasks.workunit.client.3.smithi157.stdout:myimage28 3/s 3/s 74 KiB/s 63 KiB/s 4.09 ms 528.91 us 2024-03-26T17:11:23.599 INFO:tasks.workunit.client.3.smithi157.stdout:myimage36 3/s 3/s 66 KiB/s 72 KiB/s 3.11 ms 359.25 us 2024-03-26T17:11:23.599 INFO:tasks.workunit.client.3.smithi157.stdout:myimage46 3/s 3/s 59 KiB/s 66 KiB/s 2.86 ms 405.63 us 2024-03-26T17:11:23.599 INFO:tasks.workunit.client.3.smithi157.stdout:myimage2 3/s 3/s 72 KiB/s 93 KiB/s 2.92 ms 326.58 us 2024-03-26T17:11:23.599 INFO:tasks.workunit.client.3.smithi157.stdout:myimage37 3/s 5/s 70 KiB/s 148 KiB/s 2.73 ms 438.56 us 2024-03-26T17:11:23.599 INFO:tasks.workunit.client.3.smithi157.stdout:myimage44 3/s 2/s 86 KiB/s 58 KiB/s 3.07 ms 298.53 us 2024-03-26T17:11:23.599 INFO:tasks.workunit.client.3.smithi157.stdout:myimage18 3/s 4/s 64 KiB/s 106 KiB/s 2.87 ms 358.43 us 2024-03-26T17:11:23.599 INFO:tasks.workunit.client.3.smithi157.stdout:myimage13 2/s 4/s 73 KiB/s 116 KiB/s 2.53 ms 354.71 us 2024-03-26T17:11:23.599 INFO:tasks.workunit.client.3.smithi157.stdout:myimage49 2/s 4/s 116 KiB/s 162 KiB/s 2.84 ms 454.04 us 2024-03-26T17:11:23.599 INFO:tasks.workunit.client.3.smithi157.stdout:myimage51 2/s 4/s 69 KiB/s 74 KiB/s 3.53 ms 324.93 us 2024-03-26T17:11:23.599 INFO:tasks.workunit.client.3.smithi157.stdout:myimage54 2/s 5/s 38 KiB/s 129 KiB/s 3.01 ms 425.28 us 2024-03-26T17:11:23.599 INFO:tasks.workunit.client.3.smithi157.stdout:myimage10 2/s 3/s 71 KiB/s 89 KiB/s 3.05 ms 414.39 us 2024-03-26T17:11:23.599 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:11:24.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:24 smithi044 ceph-mon[30624]: pgmap v770: 33 pgs: 33 active+clean; 1.0 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 5.5 MiB/s rd, 5.3 MiB/s wr, 427 op/s 2024-03-26T17:11:24.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:24 smithi044 ceph-mon[30624]: Health check update: 3 slow ops, oldest one blocked for 778 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:11:24.265 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:11:23 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:11:23] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:11:24.266 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:11:24 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:11:24] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:11:24.266 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:11:24 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:11:24.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:24 smithi064 ceph-mon[34420]: pgmap v770: 33 pgs: 33 active+clean; 1.0 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 5.5 MiB/s rd, 5.3 MiB/s wr, 427 op/s 2024-03-26T17:11:24.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:24 smithi064 ceph-mon[34420]: Health check update: 3 slow ops, oldest one blocked for 778 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:11:24.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:24 smithi149 ceph-mon[34678]: pgmap v770: 33 pgs: 33 active+clean; 1.0 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 5.5 MiB/s rd, 5.3 MiB/s wr, 427 op/s 2024-03-26T17:11:24.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:24 smithi149 ceph-mon[34678]: Health check update: 3 slow ops, oldest one blocked for 778 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:11:24.646 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:11:24 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:11:24] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:11:24.646 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:11:24 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:11:24] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:11:24.647 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:11:24 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:11:25.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:25 smithi044 ceph-mon[30624]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:11:25.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:25 smithi044 ceph-mon[30624]: { 2024-03-26T17:11:25.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:25 smithi044 ceph-mon[30624]: "prefix": "rbd perf image stats", 2024-03-26T17:11:25.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:25 smithi044 ceph-mon[30624]: "pool_spec": "mypool", 2024-03-26T17:11:25.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:25 smithi044 ceph-mon[30624]: "sort_by": "write_ops", 2024-03-26T17:11:25.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:25 smithi044 ceph-mon[30624]: "format": "json" 2024-03-26T17:11:25.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:25 smithi044 ceph-mon[30624]: }"]: dispatch 2024-03-26T17:11:25.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:25 smithi064 ceph-mon[34420]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:11:25.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:25 smithi064 ceph-mon[34420]: { 2024-03-26T17:11:25.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:25 smithi064 ceph-mon[34420]: "prefix": "rbd perf image stats", 2024-03-26T17:11:25.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:25 smithi064 ceph-mon[34420]: "pool_spec": "mypool", 2024-03-26T17:11:25.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:25 smithi064 ceph-mon[34420]: "sort_by": "write_ops", 2024-03-26T17:11:25.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:25 smithi064 ceph-mon[34420]: "format": "json" 2024-03-26T17:11:25.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:25 smithi064 ceph-mon[34420]: }"]: dispatch 2024-03-26T17:11:25.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:25 smithi149 ceph-mon[34678]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:11:25.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:25 smithi149 ceph-mon[34678]: { 2024-03-26T17:11:25.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:25 smithi149 ceph-mon[34678]: "prefix": "rbd perf image stats", 2024-03-26T17:11:25.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:25 smithi149 ceph-mon[34678]: "pool_spec": "mypool", 2024-03-26T17:11:25.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:25 smithi149 ceph-mon[34678]: "sort_by": "write_ops", 2024-03-26T17:11:25.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:25 smithi149 ceph-mon[34678]: "format": "json" 2024-03-26T17:11:25.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:25 smithi149 ceph-mon[34678]: }"]: dispatch 2024-03-26T17:11:26.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:26 smithi044 ceph-mon[30624]: pgmap v771: 33 pgs: 33 active+clean; 1.0 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 5.4 MiB/s rd, 5.2 MiB/s wr, 423 op/s 2024-03-26T17:11:26.265 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:11:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:11:26] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:11:26.265 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:11:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:11:26] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:11:26.266 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:11:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:11:26.547 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:26 smithi149 ceph-mon[34678]: pgmap v771: 33 pgs: 33 active+clean; 1.0 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 5.4 MiB/s rd, 5.2 MiB/s wr, 423 op/s 2024-03-26T17:11:26.547 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:26 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 2024-03-26T17:11:26.246+0000 7fa707a55700 -1 mon.c@1(peon) e3 get_health_metrics reporting 3 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T17:11:26.548 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:11:26 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:11:26] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:11:26.548 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:11:26 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:11:26] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:11:26.548 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:11:26 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:11:26.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:26 smithi064 ceph-mon[34420]: pgmap v771: 33 pgs: 33 active+clean; 1.0 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 5.4 MiB/s rd, 5.2 MiB/s wr, 423 op/s 2024-03-26T17:11:28.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:28 smithi044 ceph-mon[30624]: pgmap v772: 33 pgs: 33 active+clean; 1.0 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 5.4 MiB/s rd, 5.1 MiB/s wr, 425 op/s 2024-03-26T17:11:28.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:11:28 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:11:28] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:11:28.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:11:28 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:11:28] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:11:28.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:11:28 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:11:28.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:28 smithi064 ceph-mon[34420]: pgmap v772: 33 pgs: 33 active+clean; 1.0 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 5.4 MiB/s rd, 5.1 MiB/s wr, 425 op/s 2024-03-26T17:11:28.599 INFO:tasks.workunit.client.3.smithi157.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-26T17:11:28.599 INFO:tasks.workunit.client.3.smithi157.stdout:myimage41 5/s 2/s 122 KiB/s 82 KiB/s 3.23 ms 409.02 us 2024-03-26T17:11:28.599 INFO:tasks.workunit.client.3.smithi157.stdout:myimage28 5/s 3/s 148 KiB/s 83 KiB/s 4.03 ms 393.68 us 2024-03-26T17:11:28.599 INFO:tasks.workunit.client.3.smithi157.stdout:myimage30 4/s 1/s 144 KiB/s 38 KiB/s 4.10 ms 320.47 us 2024-03-26T17:11:28.599 INFO:tasks.workunit.client.3.smithi157.stdout:myimage21 4/s 2/s 125 KiB/s 34 KiB/s 3.72 ms 325.89 us 2024-03-26T17:11:28.599 INFO:tasks.workunit.client.3.smithi157.stdout:myimage35 4/s 3/s 141 KiB/s 56 KiB/s 3.02 ms 324.77 us 2024-03-26T17:11:28.599 INFO:tasks.workunit.client.3.smithi157.stdout:myimage12 4/s 2/s 132 KiB/s 89 KiB/s 3.09 ms 327.12 us 2024-03-26T17:11:28.599 INFO:tasks.workunit.client.3.smithi157.stdout:myimage23 4/s 4/s 97 KiB/s 95 KiB/s 2.78 ms 303.22 us 2024-03-26T17:11:28.599 INFO:tasks.workunit.client.3.smithi157.stdout:myimage9 4/s 4/s 83 KiB/s 86 KiB/s 3.49 ms 315.64 us 2024-03-26T17:11:28.599 INFO:tasks.workunit.client.3.smithi157.stdout:myimage36 4/s 4/s 106 KiB/s 126 KiB/s 3.03 ms 426.54 us 2024-03-26T17:11:28.599 INFO:tasks.workunit.client.3.smithi157.stdout:myimage46 4/s 3/s 82 KiB/s 83 KiB/s 2.97 ms 382.83 us 2024-03-26T17:11:28.600 INFO:tasks.workunit.client.3.smithi157.stdout:myimage53 4/s 4/s 108 KiB/s 115 KiB/s 2.84 ms 400.34 us 2024-03-26T17:11:28.600 INFO:tasks.workunit.client.3.smithi157.stdout:myimage32 4/s 2/s 101 KiB/s 39 KiB/s 3.09 ms 360.52 us 2024-03-26T17:11:28.600 INFO:tasks.workunit.client.3.smithi157.stdout:myimage49 4/s 3/s 101 KiB/s 95 KiB/s 2.80 ms 461.48 us 2024-03-26T17:11:28.600 INFO:tasks.workunit.client.3.smithi157.stdout:myimage6 4/s 3/s 90 KiB/s 74 KiB/s 3.64 ms 450.39 us 2024-03-26T17:11:28.600 INFO:tasks.workunit.client.3.smithi157.stdout:myimage15 4/s 3/s 94 KiB/s 76 KiB/s 2.74 ms 373.53 us 2024-03-26T17:11:28.600 INFO:tasks.workunit.client.3.smithi157.stdout:myimage10 4/s 4/s 102 KiB/s 85 KiB/s 2.85 ms 426.34 us 2024-03-26T17:11:28.600 INFO:tasks.workunit.client.3.smithi157.stdout:myimage14 3/s 4/s 89 KiB/s 81 KiB/s 3.28 ms 325.90 us 2024-03-26T17:11:28.600 INFO:tasks.workunit.client.3.smithi157.stdout:myimage38 3/s 3/s 121 KiB/s 74 KiB/s 2.61 ms 327.12 us 2024-03-26T17:11:28.600 INFO:tasks.workunit.client.3.smithi157.stdout:myimage40 3/s 4/s 109 KiB/s 86 KiB/s 2.96 ms 341.66 us 2024-03-26T17:11:28.600 INFO:tasks.workunit.client.3.smithi157.stdout:myimage44 3/s 3/s 90 KiB/s 93 KiB/s 3.17 ms 430.64 us 2024-03-26T17:11:28.600 INFO:tasks.workunit.client.3.smithi157.stdout:myimage58 3/s 3/s 98 KiB/s 78 KiB/s 2.52 ms 302.53 us 2024-03-26T17:11:28.600 INFO:tasks.workunit.client.3.smithi157.stdout:myimage18 3/s 3/s 96 KiB/s 99 KiB/s 2.77 ms 463.08 us 2024-03-26T17:11:28.600 INFO:tasks.workunit.client.3.smithi157.stdout:myimage25 3/s 2/s 92 KiB/s 61 KiB/s 3.94 ms 406.61 us 2024-03-26T17:11:28.600 INFO:tasks.workunit.client.3.smithi157.stdout:myimage57 3/s 3/s 126 KiB/s 76 KiB/s 3.42 ms 389.72 us 2024-03-26T17:11:28.600 INFO:tasks.workunit.client.3.smithi157.stdout:myimage22 3/s 3/s 94 KiB/s 69 KiB/s 2.78 ms 328.48 us 2024-03-26T17:11:28.601 INFO:tasks.workunit.client.3.smithi157.stdout:myimage31 3/s 3/s 83 KiB/s 70 KiB/s 3.18 ms 371.84 us 2024-03-26T17:11:28.601 INFO:tasks.workunit.client.3.smithi157.stdout:myimage7 3/s 4/s 85 KiB/s 86 KiB/s 3.04 ms 353.55 us 2024-03-26T17:11:28.601 INFO:tasks.workunit.client.3.smithi157.stdout:myimage17 3/s 4/s 84 KiB/s 110 KiB/s 3.27 ms 331.76 us 2024-03-26T17:11:28.601 INFO:tasks.workunit.client.3.smithi157.stdout:myimage42 3/s 2/s 70 KiB/s 74 KiB/s 2.86 ms 459.95 us 2024-03-26T17:11:28.601 INFO:tasks.workunit.client.3.smithi157.stdout:myimage51 3/s 5/s 72 KiB/s 147 KiB/s 3.46 ms 357.47 us 2024-03-26T17:11:28.601 INFO:tasks.workunit.client.3.smithi157.stdout:myimage2 3/s 3/s 81 KiB/s 121 KiB/s 3.32 ms 340.33 us 2024-03-26T17:11:28.601 INFO:tasks.workunit.client.3.smithi157.stdout:myimage37 3/s 3/s 62 KiB/s 80 KiB/s 3.26 ms 477.66 us 2024-03-26T17:11:28.601 INFO:tasks.workunit.client.3.smithi157.stdout:myimage52 3/s 5/s 71 KiB/s 101 KiB/s 3.41 ms 411.28 us 2024-03-26T17:11:28.601 INFO:tasks.workunit.client.3.smithi157.stdout:myimage4 3/s 3/s 86 KiB/s 77 KiB/s 2.88 ms 349.57 us 2024-03-26T17:11:28.601 INFO:tasks.workunit.client.3.smithi157.stdout:myimage27 3/s 4/s 90 KiB/s 97 KiB/s 2.91 ms 335.22 us 2024-03-26T17:11:28.601 INFO:tasks.workunit.client.3.smithi157.stdout:myimage29 3/s 4/s 64 KiB/s 109 KiB/s 2.78 ms 359.01 us 2024-03-26T17:11:28.601 INFO:tasks.workunit.client.3.smithi157.stdout:myimage33 3/s 3/s 82 KiB/s 78 KiB/s 3.02 ms 356.65 us 2024-03-26T17:11:28.601 INFO:tasks.workunit.client.3.smithi157.stdout:myimage54 3/s 4/s 87 KiB/s 66 KiB/s 3.03 ms 353.73 us 2024-03-26T17:11:28.601 INFO:tasks.workunit.client.3.smithi157.stdout:myimage56 3/s 3/s 70 KiB/s 103 KiB/s 3.99 ms 399.19 us 2024-03-26T17:11:28.602 INFO:tasks.workunit.client.3.smithi157.stdout:myimage60 3/s 3/s 84 KiB/s 82 KiB/s 3.46 ms 317.51 us 2024-03-26T17:11:28.602 INFO:tasks.workunit.client.3.smithi157.stdout:myimage16 3/s 5/s 86 KiB/s 100 KiB/s 3.24 ms 328.46 us 2024-03-26T17:11:28.602 INFO:tasks.workunit.client.3.smithi157.stdout:myimage48 3/s 3/s 79 KiB/s 88 KiB/s 2.97 ms 364.51 us 2024-03-26T17:11:28.602 INFO:tasks.workunit.client.3.smithi157.stdout:myimage19 3/s 3/s 110 KiB/s 93 KiB/s 3.02 ms 355.59 us 2024-03-26T17:11:28.602 INFO:tasks.workunit.client.3.smithi157.stdout:myimage55 3/s 4/s 116 KiB/s 129 KiB/s 3.28 ms 402.11 us 2024-03-26T17:11:28.602 INFO:tasks.workunit.client.3.smithi157.stdout:myimage3 3/s 4/s 79 KiB/s 106 KiB/s 2.43 ms 396.60 us 2024-03-26T17:11:28.602 INFO:tasks.workunit.client.3.smithi157.stdout:myimage34 3/s 4/s 69 KiB/s 55 KiB/s 2.73 ms 272.54 us 2024-03-26T17:11:28.602 INFO:tasks.workunit.client.3.smithi157.stdout:myimage47 3/s 5/s 70 KiB/s 138 KiB/s 3.13 ms 375.90 us 2024-03-26T17:11:28.602 INFO:tasks.workunit.client.3.smithi157.stdout:myimage5 3/s 4/s 86 KiB/s 124 KiB/s 2.89 ms 386.53 us 2024-03-26T17:11:28.602 INFO:tasks.workunit.client.3.smithi157.stdout:myimage8 3/s 4/s 61 KiB/s 112 KiB/s 2.96 ms 373.60 us 2024-03-26T17:11:28.602 INFO:tasks.workunit.client.3.smithi157.stdout:myimage11 3/s 4/s 85 KiB/s 171 KiB/s 3.01 ms 387.29 us 2024-03-26T17:11:28.602 INFO:tasks.workunit.client.3.smithi157.stdout:myimage20 3/s 4/s 62 KiB/s 120 KiB/s 3.08 ms 347.65 us 2024-03-26T17:11:28.602 INFO:tasks.workunit.client.3.smithi157.stdout:myimage50 3/s 3/s 71 KiB/s 87 KiB/s 3.19 ms 362.77 us 2024-03-26T17:11:28.603 INFO:tasks.workunit.client.3.smithi157.stdout:myimage13 2/s 3/s 56 KiB/s 106 KiB/s 2.66 ms 345.08 us 2024-03-26T17:11:28.603 INFO:tasks.workunit.client.3.smithi157.stdout:myimage26 2/s 3/s 80 KiB/s 110 KiB/s 3.15 ms 393.19 us 2024-03-26T17:11:28.603 INFO:tasks.workunit.client.3.smithi157.stdout:myimage59 2/s 4/s 54 KiB/s 123 KiB/s 3.36 ms 418.36 us 2024-03-26T17:11:28.603 INFO:tasks.workunit.client.3.smithi157.stdout:myimage24 2/s 4/s 60 KiB/s 142 KiB/s 3.05 ms 340.34 us 2024-03-26T17:11:28.603 INFO:tasks.workunit.client.3.smithi157.stdout:myimage43 2/s 4/s 58 KiB/s 107 KiB/s 3.01 ms 357.14 us 2024-03-26T17:11:28.603 INFO:tasks.workunit.client.3.smithi157.stdout:myimage45 2/s 4/s 78 KiB/s 126 KiB/s 2.96 ms 364.25 us 2024-03-26T17:11:28.603 INFO:tasks.workunit.client.3.smithi157.stdout:myimage1 2/s 4/s 60 KiB/s 87 KiB/s 2.56 ms 293.17 us 2024-03-26T17:11:28.603 INFO:tasks.workunit.client.3.smithi157.stdout:myimage39 2/s 4/s 60 KiB/s 98 KiB/s 2.86 ms 336.33 us 2024-03-26T17:11:28.603 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:11:28.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:28 smithi149 ceph-mon[34678]: pgmap v772: 33 pgs: 33 active+clean; 1.0 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 5.4 MiB/s rd, 5.1 MiB/s wr, 425 op/s 2024-03-26T17:11:28.646 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:11:28 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:11:28] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:11:28.646 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:11:28 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:11:28] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:11:28.646 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:11:28 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:11:29.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:29 smithi044 ceph-mon[30624]: Health check update: 3 slow ops, oldest one blocked for 783 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:11:29.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:29 smithi064 ceph-mon[34420]: Health check update: 3 slow ops, oldest one blocked for 783 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:11:29.645 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:29 smithi149 ceph-mon[34678]: Health check update: 3 slow ops, oldest one blocked for 783 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:11:30.416 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:30 smithi044 ceph-mon[30624]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:11:30.416 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:30 smithi044 ceph-mon[30624]: { 2024-03-26T17:11:30.416 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:30 smithi044 ceph-mon[30624]: "prefix": "rbd perf image stats", 2024-03-26T17:11:30.416 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:30 smithi044 ceph-mon[30624]: "pool_spec": "mypool", 2024-03-26T17:11:30.416 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:30 smithi044 ceph-mon[30624]: "sort_by": "write_ops", 2024-03-26T17:11:30.416 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:30 smithi044 ceph-mon[30624]: "format": "json" 2024-03-26T17:11:30.416 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:30 smithi044 ceph-mon[30624]: }"]: dispatch 2024-03-26T17:11:30.417 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:30 smithi044 ceph-mon[30624]: pgmap v773: 33 pgs: 33 active+clean; 1.0 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 5.7 MiB/s rd, 5.4 MiB/s wr, 456 op/s 2024-03-26T17:11:30.417 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:11:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:11:30] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:11:30.417 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:11:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:11:30] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:11:30.417 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:11:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:11:30.547 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:30 smithi149 ceph-mon[34678]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:11:30.548 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:30 smithi149 ceph-mon[34678]: { 2024-03-26T17:11:30.548 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:30 smithi149 ceph-mon[34678]: "prefix": "rbd perf image stats", 2024-03-26T17:11:30.548 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:30 smithi149 ceph-mon[34678]: "pool_spec": "mypool", 2024-03-26T17:11:30.548 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:30 smithi149 ceph-mon[34678]: "sort_by": "write_ops", 2024-03-26T17:11:30.548 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:30 smithi149 ceph-mon[34678]: "format": "json" 2024-03-26T17:11:30.548 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:30 smithi149 ceph-mon[34678]: }"]: dispatch 2024-03-26T17:11:30.548 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:30 smithi149 ceph-mon[34678]: pgmap v773: 33 pgs: 33 active+clean; 1.0 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 5.7 MiB/s rd, 5.4 MiB/s wr, 456 op/s 2024-03-26T17:11:30.549 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:11:30 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:11:30] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:11:30.549 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:11:30 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:11:30] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:11:30.549 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:11:30 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:11:30.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:30 smithi064 ceph-mon[34420]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:11:30.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:30 smithi064 ceph-mon[34420]: { 2024-03-26T17:11:30.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:30 smithi064 ceph-mon[34420]: "prefix": "rbd perf image stats", 2024-03-26T17:11:30.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:30 smithi064 ceph-mon[34420]: "pool_spec": "mypool", 2024-03-26T17:11:30.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:30 smithi064 ceph-mon[34420]: "sort_by": "write_ops", 2024-03-26T17:11:30.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:30 smithi064 ceph-mon[34420]: "format": "json" 2024-03-26T17:11:30.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:30 smithi064 ceph-mon[34420]: }"]: dispatch 2024-03-26T17:11:30.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:30 smithi064 ceph-mon[34420]: pgmap v773: 33 pgs: 33 active+clean; 1.0 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 5.7 MiB/s rd, 5.4 MiB/s wr, 456 op/s 2024-03-26T17:11:31.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:31 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 2024-03-26T17:11:31.245+0000 7fa707a55700 -1 mon.c@1(peon) e3 get_health_metrics reporting 3 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T17:11:32.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:32 smithi044 ceph-mon[30624]: pgmap v774: 33 pgs: 33 active+clean; 1.0 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 5.7 MiB/s rd, 5.5 MiB/s wr, 461 op/s 2024-03-26T17:11:32.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:11:32 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:11:32] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:11:32.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:11:32 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:11:32] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:11:32.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:11:32 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:11:32.547 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:32 smithi149 ceph-mon[34678]: pgmap v774: 33 pgs: 33 active+clean; 1.0 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 5.7 MiB/s rd, 5.5 MiB/s wr, 461 op/s 2024-03-26T17:11:32.548 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:11:32 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:11:32] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:11:32.548 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:11:32 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:11:32] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:11:32.548 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:11:32 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:11:32.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:32 smithi064 ceph-mon[34420]: pgmap v774: 33 pgs: 33 active+clean; 1.0 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 5.7 MiB/s rd, 5.5 MiB/s wr, 461 op/s 2024-03-26T17:11:33.063 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:11:33.070 INFO:tasks.workunit.client.3.smithi157.stdout: tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd Device 2024-03-26T17:11:33.070 INFO:tasks.workunit.client.3.smithi157.stdout: 7.20 71.6k 79.2k 0.0k 716.0k 792.0k 0.0k nvme2n1 2024-03-26T17:11:33.071 INFO:tasks.workunit.client.3.smithi157.stdout: 7.30 67.2k 95.2k 0.0k 672.0k 952.0k 0.0k nvme2n10 2024-03-26T17:11:33.071 INFO:tasks.workunit.client.3.smithi157.stdout: 7.30 118.8k 94.8k 0.0k 1.2M 948.0k 0.0k nvme2n11 2024-03-26T17:11:33.071 INFO:tasks.workunit.client.3.smithi157.stdout: 7.30 106.0k 115.2k 0.0k 1.0M 1.1M 0.0k nvme2n12 2024-03-26T17:11:33.071 INFO:tasks.workunit.client.3.smithi157.stdout: 7.30 92.0k 66.0k 0.0k 920.0k 660.0k 0.0k nvme2n13 2024-03-26T17:11:33.071 INFO:tasks.workunit.client.3.smithi157.stdout: 7.30 78.0k 107.6k 0.0k 780.0k 1.1M 0.0k nvme2n14 2024-03-26T17:11:33.071 INFO:tasks.workunit.client.3.smithi157.stdout: 7.30 86.4k 82.8k 0.0k 864.0k 828.0k 0.0k nvme2n15 2024-03-26T17:11:33.071 INFO:tasks.workunit.client.3.smithi157.stdout: 7.30 101.6k 64.0k 0.0k 1016.0k 640.0k 0.0k nvme2n16 2024-03-26T17:11:33.071 INFO:tasks.workunit.client.3.smithi157.stdout: 7.20 111.2k 74.0k 0.0k 1.1M 740.0k 0.0k nvme2n17 2024-03-26T17:11:33.071 INFO:tasks.workunit.client.3.smithi157.stdout: 7.20 92.0k 110.8k 0.0k 920.0k 1.1M 0.0k nvme2n18 2024-03-26T17:11:33.071 INFO:tasks.workunit.client.3.smithi157.stdout: 7.20 99.2k 89.6k 0.0k 992.0k 896.0k 0.0k nvme2n19 2024-03-26T17:11:33.071 INFO:tasks.workunit.client.3.smithi157.stdout: 7.20 86.0k 91.2k 0.0k 860.0k 912.0k 0.0k nvme2n2 2024-03-26T17:11:33.071 INFO:tasks.workunit.client.3.smithi157.stdout: 7.20 97.2k 70.0k 0.0k 972.0k 700.0k 0.0k nvme2n20 2024-03-26T17:11:33.071 INFO:tasks.workunit.client.3.smithi157.stdout: 7.20 88.0k 82.8k 0.0k 880.0k 828.0k 0.0k nvme2n3 2024-03-26T17:11:33.071 INFO:tasks.workunit.client.3.smithi157.stdout: 7.20 81.2k 87.6k 0.0k 812.0k 876.0k 0.0k nvme2n4 2024-03-26T17:11:33.072 INFO:tasks.workunit.client.3.smithi157.stdout: 7.20 106.0k 84.4k 0.0k 1.0M 844.0k 0.0k nvme2n5 2024-03-26T17:11:33.072 INFO:tasks.workunit.client.3.smithi157.stdout: 7.20 70.0k 74.8k 0.0k 700.0k 748.0k 0.0k nvme2n6 2024-03-26T17:11:33.072 INFO:tasks.workunit.client.3.smithi157.stdout: 7.20 85.6k 102.4k 0.0k 856.0k 1.0M 0.0k nvme2n7 2024-03-26T17:11:33.072 INFO:tasks.workunit.client.3.smithi157.stdout: 7.20 80.0k 106.8k 0.0k 800.0k 1.0M 0.0k nvme2n8 2024-03-26T17:11:33.072 INFO:tasks.workunit.client.3.smithi157.stdout: 7.20 94.8k 76.4k 0.0k 948.0k 764.0k 0.0k nvme2n9 2024-03-26T17:11:33.072 INFO:tasks.workunit.client.3.smithi157.stdout: 7.20 60.0k 85.6k 0.0k 600.0k 856.0k 0.0k nvme5n1 2024-03-26T17:11:33.072 INFO:tasks.workunit.client.3.smithi157.stdout: 7.30 77.6k 97.6k 0.0k 776.0k 976.0k 0.0k nvme5n10 2024-03-26T17:11:33.072 INFO:tasks.workunit.client.3.smithi157.stdout: 7.30 93.2k 75.6k 0.0k 932.0k 756.0k 0.0k nvme5n11 2024-03-26T17:11:33.072 INFO:tasks.workunit.client.3.smithi157.stdout: 7.30 80.8k 106.0k 0.0k 808.0k 1.0M 0.0k nvme5n12 2024-03-26T17:11:33.072 INFO:tasks.workunit.client.3.smithi157.stdout: 7.30 90.4k 80.0k 0.0k 904.0k 800.0k 0.0k nvme5n13 2024-03-26T17:11:33.072 INFO:tasks.workunit.client.3.smithi157.stdout: 7.30 81.6k 81.2k 0.0k 816.0k 812.0k 0.0k nvme5n14 2024-03-26T17:11:33.072 INFO:tasks.workunit.client.3.smithi157.stdout: 7.30 75.2k 119.2k 0.0k 752.0k 1.2M 0.0k nvme5n15 2024-03-26T17:11:33.072 INFO:tasks.workunit.client.3.smithi157.stdout: 7.30 100.4k 98.0k 0.0k 1004.0k 980.0k 0.0k nvme5n16 2024-03-26T17:11:33.072 INFO:tasks.workunit.client.3.smithi157.stdout: 7.30 74.8k 90.8k 0.0k 748.0k 908.0k 0.0k nvme5n17 2024-03-26T17:11:33.073 INFO:tasks.workunit.client.3.smithi157.stdout: 7.20 84.4k 111.2k 0.0k 844.0k 1.1M 0.0k nvme5n18 2024-03-26T17:11:33.073 INFO:tasks.workunit.client.3.smithi157.stdout: 7.20 130.8k 54.0k 0.0k 1.3M 540.0k 0.0k nvme5n19 2024-03-26T17:11:33.073 INFO:tasks.workunit.client.3.smithi157.stdout: 7.20 118.0k 55.6k 0.0k 1.2M 556.0k 0.0k nvme5n2 2024-03-26T17:11:33.073 INFO:tasks.workunit.client.3.smithi157.stdout: 7.20 60.8k 94.8k 0.0k 608.0k 948.0k 0.0k nvme5n20 2024-03-26T17:11:33.073 INFO:tasks.workunit.client.3.smithi157.stdout: 7.20 94.4k 94.8k 0.0k 944.0k 948.0k 0.0k nvme5n3 2024-03-26T17:11:33.073 INFO:tasks.workunit.client.3.smithi157.stdout: 7.20 106.4k 84.0k 0.0k 1.0M 840.0k 0.0k nvme5n4 2024-03-26T17:11:33.073 INFO:tasks.workunit.client.3.smithi157.stdout: 7.20 83.2k 103.6k 0.0k 832.0k 1.0M 0.0k nvme5n5 2024-03-26T17:11:33.073 INFO:tasks.workunit.client.3.smithi157.stdout: 7.20 101.2k 90.4k 0.0k 1012.0k 904.0k 0.0k nvme5n6 2024-03-26T17:11:33.073 INFO:tasks.workunit.client.3.smithi157.stdout: 7.20 114.8k 65.6k 0.0k 1.1M 656.0k 0.0k nvme5n7 2024-03-26T17:11:33.073 INFO:tasks.workunit.client.3.smithi157.stdout: 7.20 105.2k 79.2k 0.0k 1.0M 792.0k 0.0k nvme5n8 2024-03-26T17:11:33.073 INFO:tasks.workunit.client.3.smithi157.stdout: 7.20 100.4k 72.8k 0.0k 1004.0k 728.0k 0.0k nvme5n9 2024-03-26T17:11:33.073 INFO:tasks.workunit.client.3.smithi157.stdout: 7.20 80.4k 120.4k 0.0k 804.0k 1.2M 0.0k nvme8n1 2024-03-26T17:11:33.073 INFO:tasks.workunit.client.3.smithi157.stdout: 7.30 74.0k 95.2k 0.0k 740.0k 952.0k 0.0k nvme8n10 2024-03-26T17:11:33.073 INFO:tasks.workunit.client.3.smithi157.stdout: 7.30 90.0k 82.4k 0.0k 900.0k 824.0k 0.0k nvme8n11 2024-03-26T17:11:33.073 INFO:tasks.workunit.client.3.smithi157.stdout: 7.30 96.4k 58.4k 0.0k 964.0k 584.0k 0.0k nvme8n12 2024-03-26T17:11:33.074 INFO:tasks.workunit.client.3.smithi157.stdout: 7.30 112.0k 110.0k 0.0k 1.1M 1.1M 0.0k nvme8n13 2024-03-26T17:11:33.074 INFO:tasks.workunit.client.3.smithi157.stdout: 7.30 73.6k 84.0k 0.0k 736.0k 840.0k 0.0k nvme8n14 2024-03-26T17:11:33.074 INFO:tasks.workunit.client.3.smithi157.stdout: 7.30 121.2k 90.8k 0.0k 1.2M 908.0k 0.0k nvme8n15 2024-03-26T17:11:33.074 INFO:tasks.workunit.client.3.smithi157.stdout: 7.30 72.0k 74.8k 0.0k 720.0k 748.0k 0.0k nvme8n16 2024-03-26T17:11:33.074 INFO:tasks.workunit.client.3.smithi157.stdout: 7.20 83.2k 104.4k 0.0k 832.0k 1.0M 0.0k nvme8n17 2024-03-26T17:11:33.074 INFO:tasks.workunit.client.3.smithi157.stdout: 7.20 82.4k 71.2k 0.0k 824.0k 712.0k 0.0k nvme8n18 2024-03-26T17:11:33.074 INFO:tasks.workunit.client.3.smithi157.stdout: 7.20 116.4k 40.0k 0.0k 1.1M 400.0k 0.0k nvme8n19 2024-03-26T17:11:33.074 INFO:tasks.workunit.client.3.smithi157.stdout: 7.20 99.6k 88.0k 0.0k 996.0k 880.0k 0.0k nvme8n2 2024-03-26T17:11:33.074 INFO:tasks.workunit.client.3.smithi157.stdout: 7.20 94.0k 73.2k 0.0k 940.0k 732.0k 0.0k nvme8n20 2024-03-26T17:11:33.074 INFO:tasks.workunit.client.3.smithi157.stdout: 7.20 82.8k 88.8k 0.0k 828.0k 888.0k 0.0k nvme8n3 2024-03-26T17:11:33.074 INFO:tasks.workunit.client.3.smithi157.stdout: 7.20 92.0k 86.4k 0.0k 920.0k 864.0k 0.0k nvme8n4 2024-03-26T17:11:33.074 INFO:tasks.workunit.client.3.smithi157.stdout: 7.20 124.0k 63.6k 0.0k 1.2M 636.0k 0.0k nvme8n5 2024-03-26T17:11:33.074 INFO:tasks.workunit.client.3.smithi157.stdout: 7.20 81.6k 77.6k 0.0k 816.0k 776.0k 0.0k nvme8n6 2024-03-26T17:11:33.074 INFO:tasks.workunit.client.3.smithi157.stdout: 7.20 88.8k 84.0k 0.0k 888.0k 840.0k 0.0k nvme8n7 2024-03-26T17:11:33.075 INFO:tasks.workunit.client.3.smithi157.stdout: 7.20 85.2k 61.6k 0.0k 852.0k 616.0k 0.0k nvme8n8 2024-03-26T17:11:33.075 INFO:tasks.workunit.client.3.smithi157.stdout: 7.20 86.4k 118.0k 0.0k 864.0k 1.2M 0.0k nvme8n9 2024-03-26T17:11:33.075 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:11:33.075 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:11:33.603 INFO:tasks.workunit.client.3.smithi157.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-26T17:11:33.603 INFO:tasks.workunit.client.3.smithi157.stdout:myimage8 5/s 3/s 154 KiB/s 89 KiB/s 3.15 ms 344.02 us 2024-03-26T17:11:33.603 INFO:tasks.workunit.client.3.smithi157.stdout:myimage31 4/s 3/s 71 KiB/s 88 KiB/s 3.44 ms 518.15 us 2024-03-26T17:11:33.603 INFO:tasks.workunit.client.3.smithi157.stdout:myimage40 4/s 2/s 84 KiB/s 43 KiB/s 2.98 ms 319.30 us 2024-03-26T17:11:33.603 INFO:tasks.workunit.client.3.smithi157.stdout:myimage44 4/s 2/s 109 KiB/s 77 KiB/s 3.13 ms 342.76 us 2024-03-26T17:11:33.603 INFO:tasks.workunit.client.3.smithi157.stdout:myimage49 4/s 3/s 122 KiB/s 97 KiB/s 3.24 ms 457.84 us 2024-03-26T17:11:33.604 INFO:tasks.workunit.client.3.smithi157.stdout:myimage57 4/s 3/s 106 KiB/s 63 KiB/s 3.04 ms 400.88 us 2024-03-26T17:11:33.604 INFO:tasks.workunit.client.3.smithi157.stdout:myimage32 4/s 3/s 120 KiB/s 96 KiB/s 3.35 ms 377.96 us 2024-03-26T17:11:33.604 INFO:tasks.workunit.client.3.smithi157.stdout:myimage35 4/s 2/s 112 KiB/s 94 KiB/s 3.27 ms 357.71 us 2024-03-26T17:11:33.604 INFO:tasks.workunit.client.3.smithi157.stdout:myimage1 4/s 2/s 85 KiB/s 62 KiB/s 2.53 ms 306.66 us 2024-03-26T17:11:33.604 INFO:tasks.workunit.client.3.smithi157.stdout:myimage25 4/s 3/s 108 KiB/s 98 KiB/s 4.56 ms 378.64 us 2024-03-26T17:11:33.604 INFO:tasks.workunit.client.3.smithi157.stdout:myimage43 4/s 3/s 113 KiB/s 71 KiB/s 3.30 ms 362.72 us 2024-03-26T17:11:33.604 INFO:tasks.workunit.client.3.smithi157.stdout:myimage11 4/s 3/s 121 KiB/s 93 KiB/s 3.32 ms 352.43 us 2024-03-26T17:11:33.604 INFO:tasks.workunit.client.3.smithi157.stdout:myimage20 4/s 3/s 80 KiB/s 60 KiB/s 2.54 ms 292.53 us 2024-03-26T17:11:33.604 INFO:tasks.workunit.client.3.smithi157.stdout:myimage50 4/s 2/s 89 KiB/s 67 KiB/s 3.67 ms 339.69 us 2024-03-26T17:11:33.604 INFO:tasks.workunit.client.3.smithi157.stdout:myimage60 4/s 3/s 82 KiB/s 78 KiB/s 3.55 ms 403.48 us 2024-03-26T17:11:33.604 INFO:tasks.workunit.client.3.smithi157.stdout:myimage2 3/s 3/s 75 KiB/s 91 KiB/s 2.96 ms 308.97 us 2024-03-26T17:11:33.604 INFO:tasks.workunit.client.3.smithi157.stdout:myimage13 3/s 4/s 74 KiB/s 99 KiB/s 2.81 ms 355.41 us 2024-03-26T17:11:33.604 INFO:tasks.workunit.client.3.smithi157.stdout:myimage37 3/s 4/s 98 KiB/s 95 KiB/s 2.99 ms 496.04 us 2024-03-26T17:11:33.604 INFO:tasks.workunit.client.3.smithi157.stdout:myimage26 3/s 3/s 95 KiB/s 81 KiB/s 3.28 ms 401.59 us 2024-03-26T17:11:33.604 INFO:tasks.workunit.client.3.smithi157.stdout:myimage42 3/s 4/s 94 KiB/s 87 KiB/s 2.89 ms 354.93 us 2024-03-26T17:11:33.605 INFO:tasks.workunit.client.3.smithi157.stdout:myimage56 3/s 3/s 96 KiB/s 66 KiB/s 3.52 ms 429.39 us 2024-03-26T17:11:33.605 INFO:tasks.workunit.client.3.smithi157.stdout:myimage3 3/s 3/s 92 KiB/s 55 KiB/s 2.70 ms 323.40 us 2024-03-26T17:11:33.605 INFO:tasks.workunit.client.3.smithi157.stdout:myimage14 3/s 3/s 95 KiB/s 94 KiB/s 3.71 ms 372.22 us 2024-03-26T17:11:33.605 INFO:tasks.workunit.client.3.smithi157.stdout:myimage23 3/s 3/s 111 KiB/s 81 KiB/s 2.57 ms 351.26 us 2024-03-26T17:11:33.605 INFO:tasks.workunit.client.3.smithi157.stdout:myimage38 3/s 3/s 107 KiB/s 101 KiB/s 2.45 ms 465.67 us 2024-03-26T17:11:33.605 INFO:tasks.workunit.client.3.smithi157.stdout:myimage24 3/s 4/s 103 KiB/s 113 KiB/s 3.33 ms 346.19 us 2024-03-26T17:11:33.605 INFO:tasks.workunit.client.3.smithi157.stdout:myimage29 3/s 3/s 81 KiB/s 110 KiB/s 2.84 ms 415.82 us 2024-03-26T17:11:33.605 INFO:tasks.workunit.client.3.smithi157.stdout:myimage51 3/s 2/s 64 KiB/s 67 KiB/s 3.40 ms 313.11 us 2024-03-26T17:11:33.605 INFO:tasks.workunit.client.3.smithi157.stdout:myimage53 3/s 3/s 103 KiB/s 113 KiB/s 2.87 ms 488.32 us 2024-03-26T17:11:33.605 INFO:tasks.workunit.client.3.smithi157.stdout:myimage48 3/s 4/s 58 KiB/s 93 KiB/s 3.00 ms 321.49 us 2024-03-26T17:11:33.605 INFO:tasks.workunit.client.3.smithi157.stdout:myimage4 3/s 3/s 86 KiB/s 93 KiB/s 2.96 ms 334.58 us 2024-03-26T17:11:33.605 INFO:tasks.workunit.client.3.smithi157.stdout:myimage7 3/s 3/s 84 KiB/s 99 KiB/s 3.28 ms 407.45 us 2024-03-26T17:11:33.605 INFO:tasks.workunit.client.3.smithi157.stdout:myimage15 3/s 3/s 62 KiB/s 99 KiB/s 2.88 ms 329.61 us 2024-03-26T17:11:33.605 INFO:tasks.workunit.client.3.smithi157.stdout:myimage18 3/s 2/s 106 KiB/s 63 KiB/s 2.94 ms 330.45 us 2024-03-26T17:11:33.606 INFO:tasks.workunit.client.3.smithi157.stdout:myimage28 3/s 3/s 64 KiB/s 90 KiB/s 4.15 ms 356.43 us 2024-03-26T17:11:33.606 INFO:tasks.workunit.client.3.smithi157.stdout:myimage46 3/s 3/s 91 KiB/s 81 KiB/s 3.09 ms 346.28 us 2024-03-26T17:11:33.606 INFO:tasks.workunit.client.3.smithi157.stdout:myimage30 3/s 4/s 88 KiB/s 107 KiB/s 4.26 ms 476.08 us 2024-03-26T17:11:33.606 INFO:tasks.workunit.client.3.smithi157.stdout:myimage9 3/s 3/s 65 KiB/s 98 KiB/s 3.77 ms 528.44 us 2024-03-26T17:11:33.606 INFO:tasks.workunit.client.3.smithi157.stdout:myimage12 3/s 4/s 94 KiB/s 121 KiB/s 3.39 ms 366.25 us 2024-03-26T17:11:33.606 INFO:tasks.workunit.client.3.smithi157.stdout:myimage19 3/s 4/s 80 KiB/s 113 KiB/s 3.18 ms 414.16 us 2024-03-26T17:11:33.606 INFO:tasks.workunit.client.3.smithi157.stdout:myimage21 3/s 3/s 77 KiB/s 72 KiB/s 4.23 ms 331.16 us 2024-03-26T17:11:33.606 INFO:tasks.workunit.client.3.smithi157.stdout:myimage27 3/s 4/s 74 KiB/s 116 KiB/s 2.93 ms 438.02 us 2024-03-26T17:11:33.606 INFO:tasks.workunit.client.3.smithi157.stdout:myimage22 3/s 4/s 60 KiB/s 121 KiB/s 3.42 ms 446.86 us 2024-03-26T17:11:33.606 INFO:tasks.workunit.client.3.smithi157.stdout:myimage47 3/s 3/s 67 KiB/s 65 KiB/s 3.07 ms 325.65 us 2024-03-26T17:11:33.606 INFO:tasks.workunit.client.3.smithi157.stdout:myimage58 3/s 4/s 58 KiB/s 126 KiB/s 2.82 ms 404.78 us 2024-03-26T17:11:33.606 INFO:tasks.workunit.client.3.smithi157.stdout:myimage5 3/s 3/s 78 KiB/s 74 KiB/s 2.86 ms 335.21 us 2024-03-26T17:11:33.606 INFO:tasks.workunit.client.3.smithi157.stdout:myimage33 3/s 4/s 54 KiB/s 88 KiB/s 3.14 ms 344.56 us 2024-03-26T17:11:33.606 INFO:tasks.workunit.client.3.smithi157.stdout:myimage39 3/s 4/s 65 KiB/s 142 KiB/s 2.97 ms 350.22 us 2024-03-26T17:11:33.607 INFO:tasks.workunit.client.3.smithi157.stdout:myimage41 3/s 3/s 100 KiB/s 87 KiB/s 3.15 ms 352.62 us 2024-03-26T17:11:33.607 INFO:tasks.workunit.client.3.smithi157.stdout:myimage52 2/s 3/s 38 KiB/s 72 KiB/s 3.64 ms 342.49 us 2024-03-26T17:11:33.607 INFO:tasks.workunit.client.3.smithi157.stdout:myimage6 2/s 3/s 56 KiB/s 54 KiB/s 3.21 ms 348.53 us 2024-03-26T17:11:33.607 INFO:tasks.workunit.client.3.smithi157.stdout:myimage45 2/s 5/s 74 KiB/s 166 KiB/s 3.04 ms 386.55 us 2024-03-26T17:11:33.607 INFO:tasks.workunit.client.3.smithi157.stdout:myimage54 2/s 4/s 59 KiB/s 96 KiB/s 2.77 ms 353.43 us 2024-03-26T17:11:33.607 INFO:tasks.workunit.client.3.smithi157.stdout:myimage36 2/s 3/s 77 KiB/s 90 KiB/s 3.01 ms 382.82 us 2024-03-26T17:11:33.607 INFO:tasks.workunit.client.3.smithi157.stdout:myimage16 2/s 4/s 53 KiB/s 90 KiB/s 2.89 ms 342.91 us 2024-03-26T17:11:33.607 INFO:tasks.workunit.client.3.smithi157.stdout:myimage10 2/s 4/s 46 KiB/s 79 KiB/s 3.01 ms 390.27 us 2024-03-26T17:11:33.607 INFO:tasks.workunit.client.3.smithi157.stdout:myimage34 2/s 4/s 55 KiB/s 101 KiB/s 2.82 ms 321.13 us 2024-03-26T17:11:33.607 INFO:tasks.workunit.client.3.smithi157.stdout:myimage17 2/s 4/s 49 KiB/s 83 KiB/s 3.33 ms 356.22 us 2024-03-26T17:11:33.607 INFO:tasks.workunit.client.3.smithi157.stdout:myimage55 2/s 4/s 55 KiB/s 127 KiB/s 3.34 ms 440.49 us 2024-03-26T17:11:33.607 INFO:tasks.workunit.client.3.smithi157.stdout:myimage59 2/s 4/s 28 KiB/s 94 KiB/s 3.44 ms 391.55 us 2024-03-26T17:11:33.607 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:11:34.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:34 smithi044 ceph-mon[30624]: pgmap v775: 33 pgs: 33 active+clean; 1.0 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 5.2 MiB/s rd, 5.0 MiB/s wr, 427 op/s 2024-03-26T17:11:34.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:34 smithi044 ceph-mon[30624]: Health check update: 3 slow ops, oldest one blocked for 788 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:11:34.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:11:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:11:34] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:11:34.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:11:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:11:34] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:11:34.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:11:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:11:34.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:34 smithi064 ceph-mon[34420]: pgmap v775: 33 pgs: 33 active+clean; 1.0 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 5.2 MiB/s rd, 5.0 MiB/s wr, 427 op/s 2024-03-26T17:11:34.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:34 smithi064 ceph-mon[34420]: Health check update: 3 slow ops, oldest one blocked for 788 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:11:34.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:34 smithi149 ceph-mon[34678]: pgmap v775: 33 pgs: 33 active+clean; 1.0 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 5.2 MiB/s rd, 5.0 MiB/s wr, 427 op/s 2024-03-26T17:11:34.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:34 smithi149 ceph-mon[34678]: Health check update: 3 slow ops, oldest one blocked for 788 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:11:34.646 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:11:34 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:11:34] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:11:34.647 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:11:34 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:11:34] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:11:34.647 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:11:34 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:11:35.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:35 smithi044 ceph-mon[30624]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:11:35.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:35 smithi044 ceph-mon[30624]: { 2024-03-26T17:11:35.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:35 smithi044 ceph-mon[30624]: "prefix": "rbd perf image stats", 2024-03-26T17:11:35.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:35 smithi044 ceph-mon[30624]: "pool_spec": "mypool", 2024-03-26T17:11:35.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:35 smithi044 ceph-mon[30624]: "sort_by": "write_ops", 2024-03-26T17:11:35.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:35 smithi044 ceph-mon[30624]: "format": "json" 2024-03-26T17:11:35.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:35 smithi044 ceph-mon[30624]: }"]: dispatch 2024-03-26T17:11:35.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:35 smithi064 ceph-mon[34420]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:11:35.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:35 smithi064 ceph-mon[34420]: { 2024-03-26T17:11:35.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:35 smithi064 ceph-mon[34420]: "prefix": "rbd perf image stats", 2024-03-26T17:11:35.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:35 smithi064 ceph-mon[34420]: "pool_spec": "mypool", 2024-03-26T17:11:35.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:35 smithi064 ceph-mon[34420]: "sort_by": "write_ops", 2024-03-26T17:11:35.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:35 smithi064 ceph-mon[34420]: "format": "json" 2024-03-26T17:11:35.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:35 smithi064 ceph-mon[34420]: }"]: dispatch 2024-03-26T17:11:35.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:35 smithi149 ceph-mon[34678]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:11:35.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:35 smithi149 ceph-mon[34678]: { 2024-03-26T17:11:35.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:35 smithi149 ceph-mon[34678]: "prefix": "rbd perf image stats", 2024-03-26T17:11:35.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:35 smithi149 ceph-mon[34678]: "pool_spec": "mypool", 2024-03-26T17:11:35.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:35 smithi149 ceph-mon[34678]: "sort_by": "write_ops", 2024-03-26T17:11:35.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:35 smithi149 ceph-mon[34678]: "format": "json" 2024-03-26T17:11:35.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:35 smithi149 ceph-mon[34678]: }"]: dispatch 2024-03-26T17:11:36.416 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:36 smithi044 ceph-mon[30624]: pgmap v776: 33 pgs: 33 active+clean; 1.0 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 5.1 MiB/s rd, 4.8 MiB/s wr, 418 op/s 2024-03-26T17:11:36.417 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:11:36 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:11:36] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:11:36.417 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:11:36 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:11:36] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:11:36.417 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:11:36 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:11:36.547 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:36 smithi149 ceph-mon[34678]: pgmap v776: 33 pgs: 33 active+clean; 1.0 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 5.1 MiB/s rd, 4.8 MiB/s wr, 418 op/s 2024-03-26T17:11:36.547 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:36 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 2024-03-26T17:11:36.247+0000 7fa707a55700 -1 mon.c@1(peon) e3 get_health_metrics reporting 3 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T17:11:36.548 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:11:36 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:11:36] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:11:36.548 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:11:36 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:11:36] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:11:36.548 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:11:36 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:11:36.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:36 smithi064 ceph-mon[34420]: pgmap v776: 33 pgs: 33 active+clean; 1.0 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 5.1 MiB/s rd, 4.8 MiB/s wr, 418 op/s 2024-03-26T17:11:38.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:38 smithi044 ceph-mon[30624]: pgmap v777: 33 pgs: 33 active+clean; 1.0 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 5.1 MiB/s rd, 4.9 MiB/s wr, 421 op/s 2024-03-26T17:11:38.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:11:38 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:11:38] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:11:38.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:11:38 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:11:38] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:11:38.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:11:38 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:11:38.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:38 smithi064 ceph-mon[34420]: pgmap v777: 33 pgs: 33 active+clean; 1.0 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 5.1 MiB/s rd, 4.9 MiB/s wr, 421 op/s 2024-03-26T17:11:38.607 INFO:tasks.workunit.client.3.smithi157.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-26T17:11:38.608 INFO:tasks.workunit.client.3.smithi157.stdout:myimage34 5/s 2/s 126 KiB/s 57 KiB/s 2.86 ms 341.64 us 2024-03-26T17:11:38.608 INFO:tasks.workunit.client.3.smithi157.stdout:myimage2 5/s 2/s 121 KiB/s 68 KiB/s 3.32 ms 345.00 us 2024-03-26T17:11:38.608 INFO:tasks.workunit.client.3.smithi157.stdout:myimage58 5/s 3/s 110 KiB/s 60 KiB/s 2.74 ms 425.09 us 2024-03-26T17:11:38.608 INFO:tasks.workunit.client.3.smithi157.stdout:myimage10 5/s 3/s 133 KiB/s 48 KiB/s 3.07 ms 336.73 us 2024-03-26T17:11:38.608 INFO:tasks.workunit.client.3.smithi157.stdout:myimage30 5/s 3/s 129 KiB/s 87 KiB/s 4.05 ms 330.22 us 2024-03-26T17:11:38.608 INFO:tasks.workunit.client.3.smithi157.stdout:myimage7 4/s 2/s 91 KiB/s 62 KiB/s 3.17 ms 399.95 us 2024-03-26T17:11:38.608 INFO:tasks.workunit.client.3.smithi157.stdout:myimage57 4/s 3/s 130 KiB/s 100 KiB/s 3.07 ms 369.29 us 2024-03-26T17:11:38.608 INFO:tasks.workunit.client.3.smithi157.stdout:myimage17 4/s 3/s 128 KiB/s 74 KiB/s 3.20 ms 430.26 us 2024-03-26T17:11:38.608 INFO:tasks.workunit.client.3.smithi157.stdout:myimage23 4/s 2/s 79 KiB/s 69 KiB/s 2.68 ms 364.57 us 2024-03-26T17:11:38.608 INFO:tasks.workunit.client.3.smithi157.stdout:myimage4 4/s 3/s 74 KiB/s 54 KiB/s 3.00 ms 388.57 us 2024-03-26T17:11:38.608 INFO:tasks.workunit.client.3.smithi157.stdout:myimage5 4/s 2/s 101 KiB/s 84 KiB/s 3.06 ms 338.57 us 2024-03-26T17:11:38.608 INFO:tasks.workunit.client.3.smithi157.stdout:myimage50 4/s 4/s 108 KiB/s 113 KiB/s 3.02 ms 340.34 us 2024-03-26T17:11:38.608 INFO:tasks.workunit.client.3.smithi157.stdout:myimage54 4/s 3/s 105 KiB/s 61 KiB/s 3.12 ms 326.17 us 2024-03-26T17:11:38.609 INFO:tasks.workunit.client.3.smithi157.stdout:myimage16 4/s 3/s 118 KiB/s 100 KiB/s 2.84 ms 465.94 us 2024-03-26T17:11:38.609 INFO:tasks.workunit.client.3.smithi157.stdout:myimage49 4/s 3/s 114 KiB/s 68 KiB/s 2.79 ms 360.15 us 2024-03-26T17:11:38.609 INFO:tasks.workunit.client.3.smithi157.stdout:myimage39 4/s 3/s 65 KiB/s 66 KiB/s 2.86 ms 376.93 us 2024-03-26T17:11:38.609 INFO:tasks.workunit.client.3.smithi157.stdout:myimage41 4/s 2/s 122 KiB/s 56 KiB/s 3.19 ms 359.03 us 2024-03-26T17:11:38.609 INFO:tasks.workunit.client.3.smithi157.stdout:myimage38 4/s 4/s 94 KiB/s 90 KiB/s 2.51 ms 321.00 us 2024-03-26T17:11:38.609 INFO:tasks.workunit.client.3.smithi157.stdout:myimage53 4/s 2/s 105 KiB/s 71 KiB/s 2.85 ms 343.67 us 2024-03-26T17:11:38.609 INFO:tasks.workunit.client.3.smithi157.stdout:myimage35 3/s 3/s 82 KiB/s 61 KiB/s 3.04 ms 303.99 us 2024-03-26T17:11:38.609 INFO:tasks.workunit.client.3.smithi157.stdout:myimage40 3/s 3/s 92 KiB/s 58 KiB/s 2.97 ms 337.61 us 2024-03-26T17:11:38.610 INFO:tasks.workunit.client.3.smithi157.stdout:myimage8 3/s 2/s 107 KiB/s 52 KiB/s 3.28 ms 459.15 us 2024-03-26T17:11:38.610 INFO:tasks.workunit.client.3.smithi157.stdout:myimage15 3/s 3/s 86 KiB/s 71 KiB/s 2.77 ms 336.97 us 2024-03-26T17:11:38.610 INFO:tasks.workunit.client.3.smithi157.stdout:myimage20 3/s 3/s 66 KiB/s 58 KiB/s 2.87 ms 321.59 us 2024-03-26T17:11:38.610 INFO:tasks.workunit.client.3.smithi157.stdout:myimage29 3/s 2/s 58 KiB/s 58 KiB/s 2.82 ms 341.55 us 2024-03-26T17:11:38.610 INFO:tasks.workunit.client.3.smithi157.stdout:myimage51 3/s 3/s 104 KiB/s 84 KiB/s 3.44 ms 341.26 us 2024-03-26T17:11:38.610 INFO:tasks.workunit.client.3.smithi157.stdout:myimage56 3/s 3/s 69 KiB/s 80 KiB/s 3.93 ms 397.83 us 2024-03-26T17:11:38.611 INFO:tasks.workunit.client.3.smithi157.stdout:myimage13 3/s 4/s 90 KiB/s 58 KiB/s 2.79 ms 315.21 us 2024-03-26T17:11:38.611 INFO:tasks.workunit.client.3.smithi157.stdout:myimage44 3/s 3/s 78 KiB/s 93 KiB/s 3.25 ms 350.08 us 2024-03-26T17:11:38.611 INFO:tasks.workunit.client.3.smithi157.stdout:myimage48 3/s 4/s 86 KiB/s 100 KiB/s 3.23 ms 333.33 us 2024-03-26T17:11:38.611 INFO:tasks.workunit.client.3.smithi157.stdout:myimage1 3/s 4/s 85 KiB/s 101 KiB/s 2.78 ms 396.14 us 2024-03-26T17:11:38.611 INFO:tasks.workunit.client.3.smithi157.stdout:myimage6 3/s 4/s 108 KiB/s 97 KiB/s 3.32 ms 346.70 us 2024-03-26T17:11:38.611 INFO:tasks.workunit.client.3.smithi157.stdout:myimage9 3/s 4/s 78 KiB/s 91 KiB/s 3.54 ms 348.59 us 2024-03-26T17:11:38.611 INFO:tasks.workunit.client.3.smithi157.stdout:myimage12 3/s 3/s 111 KiB/s 71 KiB/s 3.06 ms 381.28 us 2024-03-26T17:11:38.612 INFO:tasks.workunit.client.3.smithi157.stdout:myimage18 3/s 4/s 82 KiB/s 97 KiB/s 2.98 ms 330.36 us 2024-03-26T17:11:38.612 INFO:tasks.workunit.client.3.smithi157.stdout:myimage21 3/s 3/s 82 KiB/s 70 KiB/s 4.25 ms 455.33 us 2024-03-26T17:11:38.612 INFO:tasks.workunit.client.3.smithi157.stdout:myimage36 3/s 4/s 88 KiB/s 63 KiB/s 2.97 ms 349.11 us 2024-03-26T17:11:38.612 INFO:tasks.workunit.client.3.smithi157.stdout:myimage43 3/s 2/s 53 KiB/s 82 KiB/s 3.20 ms 364.75 us 2024-03-26T17:11:38.612 INFO:tasks.workunit.client.3.smithi157.stdout:myimage46 3/s 3/s 70 KiB/s 78 KiB/s 2.90 ms 468.20 us 2024-03-26T17:11:38.612 INFO:tasks.workunit.client.3.smithi157.stdout:myimage3 3/s 4/s 66 KiB/s 93 KiB/s 2.79 ms 440.82 us 2024-03-26T17:11:38.612 INFO:tasks.workunit.client.3.smithi157.stdout:myimage32 3/s 4/s 90 KiB/s 94 KiB/s 3.07 ms 333.96 us 2024-03-26T17:11:38.613 INFO:tasks.workunit.client.3.smithi157.stdout:myimage47 3/s 3/s 68 KiB/s 74 KiB/s 3.48 ms 342.20 us 2024-03-26T17:11:38.613 INFO:tasks.workunit.client.3.smithi157.stdout:myimage27 3/s 4/s 58 KiB/s 75 KiB/s 2.74 ms 460.27 us 2024-03-26T17:11:38.613 INFO:tasks.workunit.client.3.smithi157.stdout:myimage42 3/s 3/s 90 KiB/s 78 KiB/s 3.18 ms 347.10 us 2024-03-26T17:11:38.613 INFO:tasks.workunit.client.3.smithi157.stdout:myimage45 3/s 5/s 60 KiB/s 107 KiB/s 3.06 ms 326.39 us 2024-03-26T17:11:38.613 INFO:tasks.workunit.client.3.smithi157.stdout:myimage55 3/s 3/s 81 KiB/s 110 KiB/s 3.45 ms 374.19 us 2024-03-26T17:11:38.613 INFO:tasks.workunit.client.3.smithi157.stdout:myimage14 3/s 4/s 94 KiB/s 62 KiB/s 3.30 ms 279.07 us 2024-03-26T17:11:38.613 INFO:tasks.workunit.client.3.smithi157.stdout:myimage31 3/s 3/s 90 KiB/s 96 KiB/s 3.74 ms 350.68 us 2024-03-26T17:11:38.613 INFO:tasks.workunit.client.3.smithi157.stdout:myimage52 3/s 4/s 74 KiB/s 86 KiB/s 3.65 ms 337.22 us 2024-03-26T17:11:38.614 INFO:tasks.workunit.client.3.smithi157.stdout:myimage19 3/s 3/s 59 KiB/s 68 KiB/s 3.11 ms 349.71 us 2024-03-26T17:11:38.614 INFO:tasks.workunit.client.3.smithi157.stdout:myimage25 3/s 3/s 81 KiB/s 54 KiB/s 3.98 ms 339.37 us 2024-03-26T17:11:38.614 INFO:tasks.workunit.client.3.smithi157.stdout:myimage26 3/s 4/s 102 KiB/s 86 KiB/s 3.10 ms 340.60 us 2024-03-26T17:11:38.614 INFO:tasks.workunit.client.3.smithi157.stdout:myimage37 3/s 3/s 50 KiB/s 84 KiB/s 3.41 ms 438.05 us 2024-03-26T17:11:38.614 INFO:tasks.workunit.client.3.smithi157.stdout:myimage28 3/s 4/s 74 KiB/s 84 KiB/s 4.37 ms 342.31 us 2024-03-26T17:11:38.614 INFO:tasks.workunit.client.3.smithi157.stdout:myimage22 2/s 5/s 66 KiB/s 138 KiB/s 3.37 ms 329.70 us 2024-03-26T17:11:38.614 INFO:tasks.workunit.client.3.smithi157.stdout:myimage24 2/s 3/s 67 KiB/s 46 KiB/s 3.39 ms 290.77 us 2024-03-26T17:11:38.615 INFO:tasks.workunit.client.3.smithi157.stdout:myimage59 2/s 5/s 50 KiB/s 134 KiB/s 3.30 ms 390.95 us 2024-03-26T17:11:38.615 INFO:tasks.workunit.client.3.smithi157.stdout:myimage60 2/s 4/s 66 KiB/s 94 KiB/s 3.54 ms 320.17 us 2024-03-26T17:11:38.615 INFO:tasks.workunit.client.3.smithi157.stdout:myimage11 2/s 4/s 57 KiB/s 107 KiB/s 3.41 ms 432.97 us 2024-03-26T17:11:38.615 INFO:tasks.workunit.client.3.smithi157.stdout:myimage33 2/s 4/s 56 KiB/s 108 KiB/s 3.00 ms 363.04 us 2024-03-26T17:11:38.615 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:11:38.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:38 smithi149 ceph-mon[34678]: pgmap v777: 33 pgs: 33 active+clean; 1.0 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 5.1 MiB/s rd, 4.9 MiB/s wr, 421 op/s 2024-03-26T17:11:38.646 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:11:38 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:11:38] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:11:38.647 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:11:38 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:11:38] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:11:38.647 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:11:38 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:11:39.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:39 smithi044 ceph-mon[30624]: Health check update: 3 slow ops, oldest one blocked for 793 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:11:39.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:39 smithi064 ceph-mon[34420]: Health check update: 3 slow ops, oldest one blocked for 793 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:11:39.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:39 smithi149 ceph-mon[34678]: Health check update: 3 slow ops, oldest one blocked for 793 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:11:40.416 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:40 smithi044 ceph-mon[30624]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:11:40.416 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:40 smithi044 ceph-mon[30624]: { 2024-03-26T17:11:40.416 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:40 smithi044 ceph-mon[30624]: "prefix": "rbd perf image stats", 2024-03-26T17:11:40.416 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:40 smithi044 ceph-mon[30624]: "pool_spec": "mypool", 2024-03-26T17:11:40.416 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:40 smithi044 ceph-mon[30624]: "sort_by": "write_ops", 2024-03-26T17:11:40.416 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:40 smithi044 ceph-mon[30624]: "format": "json" 2024-03-26T17:11:40.416 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:40 smithi044 ceph-mon[30624]: }"]: dispatch 2024-03-26T17:11:40.416 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:40 smithi044 ceph-mon[30624]: pgmap v778: 33 pgs: 33 active+clean; 1.0 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 5.2 MiB/s rd, 5.2 MiB/s wr, 451 op/s 2024-03-26T17:11:40.417 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:11:40 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:11:40] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:11:40.417 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:11:40 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:11:40] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:11:40.417 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:11:40 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:11:40.547 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:40 smithi149 ceph-mon[34678]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:11:40.548 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:40 smithi149 ceph-mon[34678]: { 2024-03-26T17:11:40.548 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:40 smithi149 ceph-mon[34678]: "prefix": "rbd perf image stats", 2024-03-26T17:11:40.548 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:40 smithi149 ceph-mon[34678]: "pool_spec": "mypool", 2024-03-26T17:11:40.548 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:40 smithi149 ceph-mon[34678]: "sort_by": "write_ops", 2024-03-26T17:11:40.548 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:40 smithi149 ceph-mon[34678]: "format": "json" 2024-03-26T17:11:40.548 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:40 smithi149 ceph-mon[34678]: }"]: dispatch 2024-03-26T17:11:40.548 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:40 smithi149 ceph-mon[34678]: pgmap v778: 33 pgs: 33 active+clean; 1.0 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 5.2 MiB/s rd, 5.2 MiB/s wr, 451 op/s 2024-03-26T17:11:40.549 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:11:40 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:11:40] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:11:40.549 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:11:40 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:11:40] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:11:40.549 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:11:40 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:11:40.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:40 smithi064 ceph-mon[34420]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:11:40.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:40 smithi064 ceph-mon[34420]: { 2024-03-26T17:11:40.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:40 smithi064 ceph-mon[34420]: "prefix": "rbd perf image stats", 2024-03-26T17:11:40.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:40 smithi064 ceph-mon[34420]: "pool_spec": "mypool", 2024-03-26T17:11:40.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:40 smithi064 ceph-mon[34420]: "sort_by": "write_ops", 2024-03-26T17:11:40.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:40 smithi064 ceph-mon[34420]: "format": "json" 2024-03-26T17:11:40.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:40 smithi064 ceph-mon[34420]: }"]: dispatch 2024-03-26T17:11:40.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:40 smithi064 ceph-mon[34420]: pgmap v778: 33 pgs: 33 active+clean; 1.0 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 5.2 MiB/s rd, 5.2 MiB/s wr, 451 op/s 2024-03-26T17:11:41.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:41 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 2024-03-26T17:11:41.247+0000 7fa707a55700 -1 mon.c@1(peon) e3 get_health_metrics reporting 3 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T17:11:42.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:42 smithi044 ceph-mon[30624]: pgmap v779: 33 pgs: 33 active+clean; 1.0 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 5.2 MiB/s rd, 5.1 MiB/s wr, 453 op/s 2024-03-26T17:11:42.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:11:42 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:11:42] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:11:42.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:11:42 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:11:42] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:11:42.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:11:42 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:11:42.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:42 smithi064 ceph-mon[34420]: pgmap v779: 33 pgs: 33 active+clean; 1.0 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 5.2 MiB/s rd, 5.1 MiB/s wr, 453 op/s 2024-03-26T17:11:42.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:42 smithi149 ceph-mon[34678]: pgmap v779: 33 pgs: 33 active+clean; 1.0 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 5.2 MiB/s rd, 5.1 MiB/s wr, 453 op/s 2024-03-26T17:11:42.646 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:11:42 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:11:42] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:11:42.647 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:11:42 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:11:42] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:11:42.647 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:11:42 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:11:43.611 INFO:tasks.workunit.client.3.smithi157.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-26T17:11:43.611 INFO:tasks.workunit.client.3.smithi157.stdout:myimage6 5/s 3/s 108 KiB/s 48 KiB/s 3.15 ms 371.60 us 2024-03-26T17:11:43.612 INFO:tasks.workunit.client.3.smithi157.stdout:myimage27 5/s 2/s 122 KiB/s 66 KiB/s 2.96 ms 347.11 us 2024-03-26T17:11:43.612 INFO:tasks.workunit.client.3.smithi157.stdout:myimage32 4/s 2/s 147 KiB/s 53 KiB/s 3.23 ms 350.45 us 2024-03-26T17:11:43.612 INFO:tasks.workunit.client.3.smithi157.stdout:myimage47 4/s 3/s 126 KiB/s 65 KiB/s 3.61 ms 348.87 us 2024-03-26T17:11:43.612 INFO:tasks.workunit.client.3.smithi157.stdout:myimage19 4/s 4/s 91 KiB/s 89 KiB/s 3.26 ms 395.22 us 2024-03-26T17:11:43.612 INFO:tasks.workunit.client.3.smithi157.stdout:myimage42 4/s 3/s 98 KiB/s 85 KiB/s 2.98 ms 446.93 us 2024-03-26T17:11:43.612 INFO:tasks.workunit.client.3.smithi157.stdout:myimage34 4/s 3/s 133 KiB/s 72 KiB/s 3.11 ms 324.38 us 2024-03-26T17:11:43.612 INFO:tasks.workunit.client.3.smithi157.stdout:myimage23 4/s 3/s 127 KiB/s 69 KiB/s 2.78 ms 310.42 us 2024-03-26T17:11:43.612 INFO:tasks.workunit.client.3.smithi157.stdout:myimage4 4/s 3/s 74 KiB/s 54 KiB/s 2.91 ms 314.81 us 2024-03-26T17:11:43.612 INFO:tasks.workunit.client.3.smithi157.stdout:myimage20 4/s 2/s 95 KiB/s 58 KiB/s 3.41 ms 324.28 us 2024-03-26T17:11:43.612 INFO:tasks.workunit.client.3.smithi157.stdout:myimage41 4/s 3/s 76 KiB/s 81 KiB/s 3.40 ms 317.72 us 2024-03-26T17:11:43.612 INFO:tasks.workunit.client.3.smithi157.stdout:myimage43 4/s 3/s 113 KiB/s 96 KiB/s 3.17 ms 410.91 us 2024-03-26T17:11:43.612 INFO:tasks.workunit.client.3.smithi157.stdout:myimage60 4/s 4/s 98 KiB/s 96 KiB/s 3.32 ms 360.99 us 2024-03-26T17:11:43.612 INFO:tasks.workunit.client.3.smithi157.stdout:myimage22 4/s 2/s 119 KiB/s 71 KiB/s 2.94 ms 328.60 us 2024-03-26T17:11:43.613 INFO:tasks.workunit.client.3.smithi157.stdout:myimage40 4/s 3/s 87 KiB/s 70 KiB/s 2.90 ms 396.66 us 2024-03-26T17:11:43.613 INFO:tasks.workunit.client.3.smithi157.stdout:myimage58 4/s 3/s 83 KiB/s 72 KiB/s 3.00 ms 345.75 us 2024-03-26T17:11:43.613 INFO:tasks.workunit.client.3.smithi157.stdout:myimage50 4/s 2/s 73 KiB/s 82 KiB/s 3.15 ms 383.59 us 2024-03-26T17:11:43.613 INFO:tasks.workunit.client.3.smithi157.stdout:myimage2 3/s 3/s 78 KiB/s 42 KiB/s 3.50 ms 290.06 us 2024-03-26T17:11:43.613 INFO:tasks.workunit.client.3.smithi157.stdout:myimage49 3/s 3/s 101 KiB/s 92 KiB/s 3.15 ms 352.28 us 2024-03-26T17:11:43.613 INFO:tasks.workunit.client.3.smithi157.stdout:myimage5 3/s 2/s 102 KiB/s 55 KiB/s 2.83 ms 365.15 us 2024-03-26T17:11:43.613 INFO:tasks.workunit.client.3.smithi157.stdout:myimage17 3/s 3/s 85 KiB/s 63 KiB/s 3.19 ms 441.35 us 2024-03-26T17:11:43.613 INFO:tasks.workunit.client.3.smithi157.stdout:myimage21 3/s 2/s 80 KiB/s 59 KiB/s 4.28 ms 341.77 us 2024-03-26T17:11:43.613 INFO:tasks.workunit.client.3.smithi157.stdout:myimage57 3/s 3/s 80 KiB/s 68 KiB/s 2.93 ms 340.59 us 2024-03-26T17:11:43.613 INFO:tasks.workunit.client.3.smithi157.stdout:myimage16 3/s 2/s 109 KiB/s 50 KiB/s 3.06 ms 453.56 us 2024-03-26T17:11:43.613 INFO:tasks.workunit.client.3.smithi157.stdout:myimage31 3/s 3/s 90 KiB/s 85 KiB/s 3.41 ms 342.76 us 2024-03-26T17:11:43.613 INFO:tasks.workunit.client.3.smithi157.stdout:myimage35 3/s 4/s 90 KiB/s 110 KiB/s 3.06 ms 330.45 us 2024-03-26T17:11:43.613 INFO:tasks.workunit.client.3.smithi157.stdout:myimage3 3/s 3/s 90 KiB/s 88 KiB/s 2.43 ms 321.81 us 2024-03-26T17:11:43.613 INFO:tasks.workunit.client.3.smithi157.stdout:myimage38 3/s 2/s 74 KiB/s 80 KiB/s 2.51 ms 348.74 us 2024-03-26T17:11:43.614 INFO:tasks.workunit.client.3.smithi157.stdout:myimage9 3/s 3/s 65 KiB/s 86 KiB/s 3.19 ms 335.32 us 2024-03-26T17:11:43.614 INFO:tasks.workunit.client.3.smithi157.stdout:myimage12 3/s 4/s 86 KiB/s 103 KiB/s 2.77 ms 493.31 us 2024-03-26T17:11:43.614 INFO:tasks.workunit.client.3.smithi157.stdout:myimage15 3/s 4/s 100 KiB/s 95 KiB/s 2.98 ms 338.97 us 2024-03-26T17:11:43.614 INFO:tasks.workunit.client.3.smithi157.stdout:myimage25 3/s 4/s 76 KiB/s 79 KiB/s 3.92 ms 366.00 us 2024-03-26T17:11:43.614 INFO:tasks.workunit.client.3.smithi157.stdout:myimage39 3/s 3/s 76 KiB/s 74 KiB/s 3.08 ms 355.50 us 2024-03-26T17:11:43.614 INFO:tasks.workunit.client.3.smithi157.stdout:myimage45 3/s 2/s 65 KiB/s 42 KiB/s 2.91 ms 300.22 us 2024-03-26T17:11:43.614 INFO:tasks.workunit.client.3.smithi157.stdout:myimage51 3/s 3/s 74 KiB/s 102 KiB/s 3.40 ms 426.44 us 2024-03-26T17:11:43.614 INFO:tasks.workunit.client.3.smithi157.stdout:myimage55 3/s 3/s 92 KiB/s 73 KiB/s 3.48 ms 374.94 us 2024-03-26T17:11:43.614 INFO:tasks.workunit.client.3.smithi157.stdout:myimage13 3/s 3/s 71 KiB/s 65 KiB/s 2.96 ms 400.09 us 2024-03-26T17:11:43.614 INFO:tasks.workunit.client.3.smithi157.stdout:myimage7 3/s 4/s 62 KiB/s 81 KiB/s 3.12 ms 621.92 us 2024-03-26T17:11:43.614 INFO:tasks.workunit.client.3.smithi157.stdout:myimage24 3/s 4/s 88 KiB/s 126 KiB/s 2.84 ms 351.07 us 2024-03-26T17:11:43.614 INFO:tasks.workunit.client.3.smithi157.stdout:myimage53 3/s 4/s 81 KiB/s 120 KiB/s 3.21 ms 343.97 us 2024-03-26T17:11:43.614 INFO:tasks.workunit.client.3.smithi157.stdout:myimage14 3/s 3/s 86 KiB/s 78 KiB/s 3.20 ms 343.73 us 2024-03-26T17:11:43.615 INFO:tasks.workunit.client.3.smithi157.stdout:myimage30 3/s 4/s 99 KiB/s 109 KiB/s 4.20 ms 340.78 us 2024-03-26T17:11:43.615 INFO:tasks.workunit.client.3.smithi157.stdout:myimage37 3/s 3/s 69 KiB/s 79 KiB/s 3.02 ms 404.53 us 2024-03-26T17:11:43.615 INFO:tasks.workunit.client.3.smithi157.stdout:myimage48 3/s 3/s 91 KiB/s 86 KiB/s 3.14 ms 355.57 us 2024-03-26T17:11:43.615 INFO:tasks.workunit.client.3.smithi157.stdout:myimage18 3/s 3/s 47 KiB/s 70 KiB/s 2.72 ms 324.06 us 2024-03-26T17:11:43.615 INFO:tasks.workunit.client.3.smithi157.stdout:myimage56 3/s 3/s 62 KiB/s 97 KiB/s 4.05 ms 385.42 us 2024-03-26T17:11:43.615 INFO:tasks.workunit.client.3.smithi157.stdout:myimage36 2/s 3/s 70 KiB/s 72 KiB/s 2.98 ms 322.13 us 2024-03-26T17:11:43.615 INFO:tasks.workunit.client.3.smithi157.stdout:myimage44 2/s 4/s 47 KiB/s 74 KiB/s 3.38 ms 351.83 us 2024-03-26T17:11:43.615 INFO:tasks.workunit.client.3.smithi157.stdout:myimage29 2/s 4/s 46 KiB/s 122 KiB/s 2.85 ms 454.88 us 2024-03-26T17:11:43.615 INFO:tasks.workunit.client.3.smithi157.stdout:myimage33 2/s 4/s 65 KiB/s 72 KiB/s 3.26 ms 330.11 us 2024-03-26T17:11:43.615 INFO:tasks.workunit.client.3.smithi157.stdout:myimage46 2/s 5/s 41 KiB/s 118 KiB/s 3.04 ms 378.58 us 2024-03-26T17:11:43.615 INFO:tasks.workunit.client.3.smithi157.stdout:myimage54 2/s 3/s 54 KiB/s 54 KiB/s 3.61 ms 354.70 us 2024-03-26T17:11:43.615 INFO:tasks.workunit.client.3.smithi157.stdout:myimage10 2/s 3/s 63 KiB/s 80 KiB/s 2.98 ms 344.71 us 2024-03-26T17:11:43.615 INFO:tasks.workunit.client.3.smithi157.stdout:myimage52 2/s 4/s 48 KiB/s 104 KiB/s 3.25 ms 450.16 us 2024-03-26T17:11:43.615 INFO:tasks.workunit.client.3.smithi157.stdout:myimage1 2/s 4/s 39 KiB/s 70 KiB/s 2.83 ms 296.66 us 2024-03-26T17:11:43.615 INFO:tasks.workunit.client.3.smithi157.stdout:myimage26 2/s 4/s 53 KiB/s 114 KiB/s 3.19 ms 384.27 us 2024-03-26T17:11:43.616 INFO:tasks.workunit.client.3.smithi157.stdout:myimage28 2/s 4/s 55 KiB/s 110 KiB/s 4.29 ms 371.59 us 2024-03-26T17:11:43.616 INFO:tasks.workunit.client.3.smithi157.stdout:myimage59 2/s 4/s 71 KiB/s 94 KiB/s 3.49 ms 329.36 us 2024-03-26T17:11:43.616 INFO:tasks.workunit.client.3.smithi157.stdout:myimage8 2/s 4/s 50 KiB/s 102 KiB/s 3.37 ms 407.63 us 2024-03-26T17:11:43.616 INFO:tasks.workunit.client.3.smithi157.stdout:myimage11 2/s 4/s 51 KiB/s 134 KiB/s 3.29 ms 344.30 us 2024-03-26T17:11:43.616 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:11:44.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:44 smithi044 ceph-mon[30624]: pgmap v780: 33 pgs: 33 active+clean; 1.0 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 4.7 MiB/s rd, 4.8 MiB/s wr, 424 op/s 2024-03-26T17:11:44.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:44 smithi044 ceph-mon[30624]: Health check update: 3 slow ops, oldest one blocked for 798 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:11:44.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:11:44 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:11:44] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:11:44.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:11:44 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:11:44] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:11:44.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:11:44 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:11:44.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:44 smithi064 ceph-mon[34420]: pgmap v780: 33 pgs: 33 active+clean; 1.0 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 4.7 MiB/s rd, 4.8 MiB/s wr, 424 op/s 2024-03-26T17:11:44.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:44 smithi064 ceph-mon[34420]: Health check update: 3 slow ops, oldest one blocked for 798 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:11:44.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:44 smithi149 ceph-mon[34678]: pgmap v780: 33 pgs: 33 active+clean; 1.0 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 4.7 MiB/s rd, 4.8 MiB/s wr, 424 op/s 2024-03-26T17:11:44.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:44 smithi149 ceph-mon[34678]: Health check update: 3 slow ops, oldest one blocked for 798 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:11:44.646 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:11:44 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:11:44] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:11:44.646 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:11:44 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:11:44] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:11:44.647 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:11:44 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:11:45.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:45 smithi044 ceph-mon[30624]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:11:45.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:45 smithi044 ceph-mon[30624]: { 2024-03-26T17:11:45.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:45 smithi044 ceph-mon[30624]: "prefix": "rbd perf image stats", 2024-03-26T17:11:45.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:45 smithi044 ceph-mon[30624]: "pool_spec": "mypool", 2024-03-26T17:11:45.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:45 smithi044 ceph-mon[30624]: "sort_by": "write_ops", 2024-03-26T17:11:45.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:45 smithi044 ceph-mon[30624]: "format": "json" 2024-03-26T17:11:45.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:45 smithi044 ceph-mon[30624]: }"]: dispatch 2024-03-26T17:11:45.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:45 smithi064 ceph-mon[34420]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:11:45.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:45 smithi064 ceph-mon[34420]: { 2024-03-26T17:11:45.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:45 smithi064 ceph-mon[34420]: "prefix": "rbd perf image stats", 2024-03-26T17:11:45.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:45 smithi064 ceph-mon[34420]: "pool_spec": "mypool", 2024-03-26T17:11:45.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:45 smithi064 ceph-mon[34420]: "sort_by": "write_ops", 2024-03-26T17:11:45.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:45 smithi064 ceph-mon[34420]: "format": "json" 2024-03-26T17:11:45.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:45 smithi064 ceph-mon[34420]: }"]: dispatch 2024-03-26T17:11:45.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:45 smithi149 ceph-mon[34678]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:11:45.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:45 smithi149 ceph-mon[34678]: { 2024-03-26T17:11:45.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:45 smithi149 ceph-mon[34678]: "prefix": "rbd perf image stats", 2024-03-26T17:11:45.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:45 smithi149 ceph-mon[34678]: "pool_spec": "mypool", 2024-03-26T17:11:45.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:45 smithi149 ceph-mon[34678]: "sort_by": "write_ops", 2024-03-26T17:11:45.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:45 smithi149 ceph-mon[34678]: "format": "json" 2024-03-26T17:11:45.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:45 smithi149 ceph-mon[34678]: }"]: dispatch 2024-03-26T17:11:46.416 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:46 smithi044 ceph-mon[30624]: pgmap v781: 33 pgs: 33 active+clean; 1.0 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 4.6 MiB/s rd, 4.7 MiB/s wr, 417 op/s 2024-03-26T17:11:46.417 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:11:46 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:11:46] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:11:46.417 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:11:46 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:11:46] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:11:46.417 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:11:46 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:11:46.547 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:46 smithi149 ceph-mon[34678]: pgmap v781: 33 pgs: 33 active+clean; 1.0 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 4.6 MiB/s rd, 4.7 MiB/s wr, 417 op/s 2024-03-26T17:11:46.547 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:46 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 2024-03-26T17:11:46.247+0000 7fa707a55700 -1 mon.c@1(peon) e3 get_health_metrics reporting 3 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T17:11:46.548 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:11:46 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:11:46] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:11:46.548 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:11:46 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:11:46] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:11:46.548 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:11:46 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:11:46.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:46 smithi064 ceph-mon[34420]: pgmap v781: 33 pgs: 33 active+clean; 1.0 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 4.6 MiB/s rd, 4.7 MiB/s wr, 417 op/s 2024-03-26T17:11:47.226 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:11:47.226 INFO:tasks.workunit.client.3.smithi157.stdout:nvmeof-fio-test: (groupid=0, jobs=1): err= 0: pid=48802: Tue Mar 26 17:11:47 2024 2024-03-26T17:11:47.226 INFO:tasks.workunit.client.3.smithi157.stdout: read: IOPS=275, BW=6742KiB/s (6904kB/s)(3950MiB/600001msec) 2024-03-26T17:11:47.226 INFO:tasks.workunit.client.3.smithi157.stdout: clat (usec): min=82, max=17114, avg=780.71, stdev=275.10 2024-03-26T17:11:47.226 INFO:tasks.workunit.client.3.smithi157.stdout: lat (usec): min=82, max=17115, avg=781.06, stdev=275.11 2024-03-26T17:11:47.226 INFO:tasks.workunit.client.3.smithi157.stdout: clat percentiles (usec): 2024-03-26T17:11:47.226 INFO:tasks.workunit.client.3.smithi157.stdout: | 1.00th=[ 441], 5.00th=[ 498], 10.00th=[ 545], 20.00th=[ 619], 2024-03-26T17:11:47.227 INFO:tasks.workunit.client.3.smithi157.stdout: | 30.00th=[ 668], 40.00th=[ 717], 50.00th=[ 758], 60.00th=[ 791], 2024-03-26T17:11:47.227 INFO:tasks.workunit.client.3.smithi157.stdout: | 70.00th=[ 840], 80.00th=[ 889], 90.00th=[ 988], 95.00th=[ 1074], 2024-03-26T17:11:47.227 INFO:tasks.workunit.client.3.smithi157.stdout: | 99.00th=[ 2147], 99.50th=[ 2573], 99.90th=[ 2868], 99.95th=[ 2933], 2024-03-26T17:11:47.227 INFO:tasks.workunit.client.3.smithi157.stdout: | 99.99th=[ 3785] 2024-03-26T17:11:47.227 INFO:tasks.workunit.client.3.smithi157.stdout: bw ( KiB/s): min= 32, max=15696, per=100.00%, avg=7017.06, stdev=2334.36, samples=1153 2024-03-26T17:11:47.227 INFO:tasks.workunit.client.3.smithi157.stdout: iops : min= 2, max= 544, avg=286.36, stdev=81.54, samples=1153 2024-03-26T17:11:47.227 INFO:tasks.workunit.client.3.smithi157.stdout: write: IOPS=275, BW=6725KiB/s (6886kB/s)(3940MiB/600001msec); 0 zone resets 2024-03-26T17:11:47.227 INFO:tasks.workunit.client.3.smithi157.stdout: clat (usec): min=1042, max=13338k, avg=2760.11, stdev=34509.95 2024-03-26T17:11:47.227 INFO:tasks.workunit.client.3.smithi157.stdout: lat (usec): min=1065, max=13338k, avg=2842.06, stdev=34509.90 2024-03-26T17:11:47.227 INFO:tasks.workunit.client.3.smithi157.stdout: clat percentiles (usec): 2024-03-26T17:11:47.227 INFO:tasks.workunit.client.3.smithi157.stdout: | 1.00th=[ 1303], 5.00th=[ 1434], 10.00th=[ 1549], 20.00th=[ 1778], 2024-03-26T17:11:47.228 INFO:tasks.workunit.client.3.smithi157.stdout: | 30.00th=[ 1991], 40.00th=[ 2212], 50.00th=[ 2442], 60.00th=[ 2638], 2024-03-26T17:11:47.228 INFO:tasks.workunit.client.3.smithi157.stdout: | 70.00th=[ 2900], 80.00th=[ 3228], 90.00th=[ 3720], 95.00th=[ 4228], 2024-03-26T17:11:47.228 INFO:tasks.workunit.client.3.smithi157.stdout: | 99.00th=[ 5276], 99.50th=[ 5604], 99.90th=[ 6259], 99.95th=[ 7046], 2024-03-26T17:11:47.228 INFO:tasks.workunit.client.3.smithi157.stdout: | 99.99th=[977273] 2024-03-26T17:11:47.228 INFO:tasks.workunit.client.3.smithi157.stdout: bw ( KiB/s): min= 40, max=15480, per=100.00%, avg=6986.94, stdev=2275.05, samples=1155 2024-03-26T17:11:47.228 INFO:tasks.workunit.client.3.smithi157.stdout: iops : min= 2, max= 494, avg=285.70, stdev=77.85, samples=1155 2024-03-26T17:11:47.228 INFO:tasks.workunit.client.3.smithi157.stdout: lat (usec) : 100=0.01%, 250=0.07%, 500=2.52%, 750=21.84%, 1000=21.17% 2024-03-26T17:11:47.228 INFO:tasks.workunit.client.3.smithi157.stdout: lat (msec) : 2=18.87%, 4=32.11%, 10=3.41%, 20=0.01%, 50=0.01% 2024-03-26T17:11:47.228 INFO:tasks.workunit.client.3.smithi157.stdout: lat (msec) : 100=0.01%, 250=0.01%, 1000=0.01%, 2000=0.01%, >=2000=0.01% 2024-03-26T17:11:47.228 INFO:tasks.workunit.client.3.smithi157.stdout: cpu : usr=2.67%, sys=1.26%, ctx=330335, majf=0, minf=4590 2024-03-26T17:11:47.228 INFO:tasks.workunit.client.3.smithi157.stdout: IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 2024-03-26T17:11:47.228 INFO:tasks.workunit.client.3.smithi157.stdout: submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 2024-03-26T17:11:47.228 INFO:tasks.workunit.client.3.smithi157.stdout: complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 2024-03-26T17:11:47.228 INFO:tasks.workunit.client.3.smithi157.stdout: issued rwts: total=165119,165024,0,0 short=0,0,0,0 dropped=0,0,0,0 2024-03-26T17:11:47.229 INFO:tasks.workunit.client.3.smithi157.stdout: latency : target=0, window=0, percentile=100.00%, depth=1 2024-03-26T17:11:47.229 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:11:47.229 INFO:tasks.workunit.client.3.smithi157.stdout:Run status group 0 (all jobs): 2024-03-26T17:11:47.229 INFO:tasks.workunit.client.3.smithi157.stdout: READ: bw=6742KiB/s (6904kB/s), 6742KiB/s-6742KiB/s (6904kB/s-6904kB/s), io=3950MiB (4142MB), run=600001-600001msec 2024-03-26T17:11:47.229 INFO:tasks.workunit.client.3.smithi157.stdout: WRITE: bw=6725KiB/s (6886kB/s), 6725KiB/s-6725KiB/s (6886kB/s-6886kB/s), io=3940MiB (4132MB), run=600001-600001msec 2024-03-26T17:11:47.229 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:11:47.229 INFO:tasks.workunit.client.3.smithi157.stdout:Disk stats (read/write): 2024-03-26T17:11:47.229 INFO:tasks.workunit.client.3.smithi157.stdout: nvme5n1: ios=2692/2811, merge=0/0, ticks=2061/8314, in_queue=10375, util=2.64% 2024-03-26T17:11:47.229 INFO:tasks.workunit.client.3.smithi157.stdout: nvme2n1: ios=2758/2745, merge=0/0, ticks=1901/7090, in_queue=8991, util=2.41% 2024-03-26T17:11:47.229 INFO:tasks.workunit.client.3.smithi157.stdout: nvme8n1: ios=2716/2787, merge=0/0, ticks=1924/7053, in_queue=8977, util=2.41% 2024-03-26T17:11:47.229 INFO:tasks.workunit.client.3.smithi157.stdout: nvme5n2: ios=2809/2694, merge=0/0, ticks=1946/7764, in_queue=9710, util=2.53% 2024-03-26T17:11:47.229 INFO:tasks.workunit.client.3.smithi157.stdout: nvme2n2: ios=2745/2758, merge=0/0, ticks=1964/7158, in_queue=9122, util=2.43% 2024-03-26T17:11:47.229 INFO:tasks.workunit.client.3.smithi157.stdout: nvme8n2: ios=2748/2755, merge=0/0, ticks=2074/6693, in_queue=8767, util=2.37% 2024-03-26T17:11:47.230 INFO:tasks.workunit.client.3.smithi157.stdout: nvme5n3: ios=2775/2727, merge=0/0, ticks=1999/6204, in_queue=8203, util=2.28% 2024-03-26T17:11:47.230 INFO:tasks.workunit.client.3.smithi157.stdout: nvme2n3: ios=2777/2725, merge=0/0, ticks=1945/6021, in_queue=7966, util=2.24% 2024-03-26T17:11:47.230 INFO:tasks.workunit.client.3.smithi157.stdout: nvme8n3: ios=2747/2755, merge=0/0, ticks=2177/8341, in_queue=10518, util=2.66% 2024-03-26T17:11:47.230 INFO:tasks.workunit.client.3.smithi157.stdout: nvme5n4: ios=2716/2786, merge=0/0, ticks=1993/6941, in_queue=8934, util=2.40% 2024-03-26T17:11:47.230 INFO:tasks.workunit.client.3.smithi157.stdout: nvme2n4: ios=2734/2768, merge=0/0, ticks=1980/7668, in_queue=9648, util=2.52% 2024-03-26T17:11:47.230 INFO:tasks.workunit.client.3.smithi157.stdout: nvme8n4: ios=2778/2724, merge=0/0, ticks=1993/6762, in_queue=8755, util=2.37% 2024-03-26T17:11:47.230 INFO:tasks.workunit.client.3.smithi157.stdout: nvme5n5: ios=2807/2695, merge=0/0, ticks=2094/8906, in_queue=11000, util=2.75% 2024-03-26T17:11:47.230 INFO:tasks.workunit.client.3.smithi157.stdout: nvme2n5: ios=2749/2753, merge=0/0, ticks=1934/6683, in_queue=8617, util=2.35% 2024-03-26T17:11:47.230 INFO:tasks.workunit.client.3.smithi157.stdout: nvme8n5: ios=2760/2742, merge=0/0, ticks=2103/6819, in_queue=8922, util=2.40% 2024-03-26T17:11:47.230 INFO:tasks.workunit.client.3.smithi157.stdout: nvme5n6: ios=2713/2789, merge=0/0, ticks=2039/7117, in_queue=9156, util=2.44% 2024-03-26T17:11:47.230 INFO:tasks.workunit.client.3.smithi157.stdout: nvme2n6: ios=2762/2740, merge=0/0, ticks=2050/7182, in_queue=9232, util=2.45% 2024-03-26T17:11:47.230 INFO:tasks.workunit.client.3.smithi157.stdout: nvme8n6: ios=2796/2706, merge=0/0, ticks=2140/7629, in_queue=9769, util=2.54% 2024-03-26T17:11:47.231 INFO:tasks.workunit.client.3.smithi157.stdout: nvme5n7: ios=2807/2695, merge=0/0, ticks=2084/6280, in_queue=8364, util=2.31% 2024-03-26T17:11:47.231 INFO:tasks.workunit.client.3.smithi157.stdout: nvme2n7: ios=2773/2729, merge=0/0, ticks=2087/7962, in_queue=10049, util=2.59% 2024-03-26T17:11:47.231 INFO:tasks.workunit.client.3.smithi157.stdout: nvme8n7: ios=2745/2757, merge=0/0, ticks=2080/7220, in_queue=9300, util=2.46% 2024-03-26T17:11:47.231 INFO:tasks.workunit.client.3.smithi157.stdout: nvme5n8: ios=2738/2765, merge=0/0, ticks=2083/9226, in_queue=11309, util=26.71% 2024-03-26T17:11:47.231 INFO:tasks.workunit.client.3.smithi157.stdout: nvme2n8: ios=2713/2789, merge=0/0, ticks=1969/7140, in_queue=9109, util=2.43% 2024-03-26T17:11:47.231 INFO:tasks.workunit.client.3.smithi157.stdout: nvme8n8: ios=2759/2743, merge=0/0, ticks=2064/7086, in_queue=9150, util=2.44% 2024-03-26T17:11:47.231 INFO:tasks.workunit.client.3.smithi157.stdout: nvme5n9: ios=2718/2784, merge=0/0, ticks=2100/6552, in_queue=8652, util=2.36% 2024-03-26T17:11:47.231 INFO:tasks.workunit.client.3.smithi157.stdout: nvme2n9: ios=2832/2670, merge=0/0, ticks=2133/7170, in_queue=9303, util=2.47% 2024-03-26T17:11:47.231 INFO:tasks.workunit.client.3.smithi157.stdout: nvme8n9: ios=2789/2713, merge=0/0, ticks=2100/7780, in_queue=9880, util=2.56% 2024-03-26T17:11:47.231 INFO:tasks.workunit.client.3.smithi157.stdout: nvme5n10: ios=2720/2782, merge=0/0, ticks=2063/8054, in_queue=10117, util=2.60% 2024-03-26T17:11:47.231 INFO:tasks.workunit.client.3.smithi157.stdout: nvme2n10: ios=2679/2823, merge=0/0, ticks=1953/7920, in_queue=9873, util=2.56% 2024-03-26T17:11:47.231 INFO:tasks.workunit.client.3.smithi157.stdout: nvme8n10: ios=2787/2715, merge=0/0, ticks=1995/7105, in_queue=9100, util=2.43% 2024-03-26T17:11:47.231 INFO:tasks.workunit.client.3.smithi157.stdout: nvme5n11: ios=2719/2783, merge=0/0, ticks=2058/8438, in_queue=10496, util=2.67% 2024-03-26T17:11:47.231 INFO:tasks.workunit.client.3.smithi157.stdout: nvme2n11: ios=2772/2730, merge=0/0, ticks=2006/7221, in_queue=9227, util=2.45% 2024-03-26T17:11:47.232 INFO:tasks.workunit.client.3.smithi157.stdout: nvme8n11: ios=2768/2734, merge=0/0, ticks=2058/7347, in_queue=9405, util=2.48% 2024-03-26T17:11:47.232 INFO:tasks.workunit.client.3.smithi157.stdout: nvme5n12: ios=2748/2754, merge=0/0, ticks=2028/7086, in_queue=9114, util=2.44% 2024-03-26T17:11:47.232 INFO:tasks.workunit.client.3.smithi157.stdout: nvme2n12: ios=2718/2784, merge=0/0, ticks=2171/7140, in_queue=9311, util=2.47% 2024-03-26T17:11:47.232 INFO:tasks.workunit.client.3.smithi157.stdout: nvme8n12: ios=2749/2753, merge=0/0, ticks=2086/8509, in_queue=10595, util=2.68% 2024-03-26T17:11:47.232 INFO:tasks.workunit.client.3.smithi157.stdout: nvme5n13: ios=2788/2714, merge=0/0, ticks=2141/6786, in_queue=8927, util=2.41% 2024-03-26T17:11:47.232 INFO:tasks.workunit.client.3.smithi157.stdout: nvme2n13: ios=2800/2702, merge=0/0, ticks=2112/7316, in_queue=9428, util=2.49% 2024-03-26T17:11:47.232 INFO:tasks.workunit.client.3.smithi157.stdout: nvme8n13: ios=2768/2734, merge=0/0, ticks=1977/6681, in_queue=8658, util=2.36% 2024-03-26T17:11:47.232 INFO:tasks.workunit.client.3.smithi157.stdout: nvme5n14: ios=2743/2759, merge=0/0, ticks=1938/7465, in_queue=9403, util=2.48% 2024-03-26T17:11:47.232 INFO:tasks.workunit.client.3.smithi157.stdout: nvme2n14: ios=2758/2744, merge=0/0, ticks=1966/7219, in_queue=9185, util=2.45% 2024-03-26T17:11:47.232 INFO:tasks.workunit.client.3.smithi157.stdout: nvme8n14: ios=2829/2673, merge=0/0, ticks=2263/6560, in_queue=8823, util=2.39% 2024-03-26T17:11:47.232 INFO:tasks.workunit.client.3.smithi157.stdout: nvme5n15: ios=2792/2710, merge=0/0, ticks=1948/6820, in_queue=8768, util=2.38% 2024-03-26T17:11:47.232 INFO:tasks.workunit.client.3.smithi157.stdout: nvme2n15: ios=2715/2787, merge=0/0, ticks=1937/6455, in_queue=8392, util=2.32% 2024-03-26T17:11:47.232 INFO:tasks.workunit.client.3.smithi157.stdout: nvme8n15: ios=2723/2779, merge=0/0, ticks=2004/8276, in_queue=10280, util=2.63% 2024-03-26T17:11:47.232 INFO:tasks.workunit.client.3.smithi157.stdout: nvme5n16: ios=2746/2756, merge=0/0, ticks=2106/6726, in_queue=8832, util=2.39% 2024-03-26T17:11:47.233 INFO:tasks.workunit.client.3.smithi157.stdout: nvme2n16: ios=2757/2745, merge=0/0, ticks=1998/7958, in_queue=9956, util=2.58% 2024-03-26T17:11:47.233 INFO:tasks.workunit.client.3.smithi157.stdout: nvme8n16: ios=2821/2681, merge=0/0, ticks=1997/7640, in_queue=9637, util=2.53% 2024-03-26T17:11:47.233 INFO:tasks.workunit.client.3.smithi157.stdout: nvme5n17: ios=2746/2756, merge=0/0, ticks=2072/8229, in_queue=10301, util=2.64% 2024-03-26T17:11:47.233 INFO:tasks.workunit.client.3.smithi157.stdout: nvme2n17: ios=2751/2751, merge=0/0, ticks=2081/7065, in_queue=9146, util=2.45% 2024-03-26T17:11:47.233 INFO:tasks.workunit.client.3.smithi157.stdout: nvme8n17: ios=2684/2818, merge=0/0, ticks=2031/7195, in_queue=9226, util=2.46% 2024-03-26T17:11:47.233 INFO:tasks.workunit.client.3.smithi157.stdout: nvme5n18: ios=2747/2755, merge=0/0, ticks=1949/6068, in_queue=8017, util=2.26% 2024-03-26T17:11:47.233 INFO:tasks.workunit.client.3.smithi157.stdout: nvme2n18: ios=2722/2780, merge=0/0, ticks=1976/6658, in_queue=8634, util=2.36% 2024-03-26T17:11:47.233 INFO:tasks.workunit.client.3.smithi157.stdout: nvme8n18: ios=2687/2815, merge=0/0, ticks=1996/7648, in_queue=9644, util=2.53% 2024-03-26T17:11:47.233 INFO:tasks.workunit.client.3.smithi157.stdout: nvme5n19: ios=2738/2764, merge=0/0, ticks=2003/6519, in_queue=8522, util=2.34% 2024-03-26T17:11:47.233 INFO:tasks.workunit.client.3.smithi157.stdout: nvme2n19: ios=2759/2743, merge=0/0, ticks=2096/7915, in_queue=10011, util=2.59% 2024-03-26T17:11:47.233 INFO:tasks.workunit.client.3.smithi157.stdout: nvme8n19: ios=2777/2725, merge=0/0, ticks=2112/7193, in_queue=9305, util=2.47% 2024-03-26T17:11:47.233 INFO:tasks.workunit.client.3.smithi157.stdout: nvme5n20: ios=2666/2836, merge=0/0, ticks=2037/7808, in_queue=9845, util=2.56% 2024-03-26T17:11:47.233 INFO:tasks.workunit.client.3.smithi157.stdout: nvme2n20: ios=2743/2759, merge=0/0, ticks=2030/6911, in_queue=8941, util=2.41% 2024-03-26T17:11:47.234 INFO:tasks.workunit.client.3.smithi157.stdout: nvme8n20: ios=2734/2768, merge=0/0, ticks=2025/7369, in_queue=9394, util=2.49% 2024-03-26T17:11:47.234 INFO:tasks.workunit.client.3.smithi157.stderr:+ wait 2024-03-26T17:11:48.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:48 smithi044 ceph-mon[30624]: pgmap v782: 33 pgs: 33 active+clean; 1.0 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 4.6 MiB/s rd, 4.7 MiB/s wr, 420 op/s 2024-03-26T17:11:48.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:11:48 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:11:48] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:11:48.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:11:48 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:11:48] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:11:48.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:11:48 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:11:48.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:48 smithi064 ceph-mon[34420]: pgmap v782: 33 pgs: 33 active+clean; 1.0 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 4.6 MiB/s rd, 4.7 MiB/s wr, 420 op/s 2024-03-26T17:11:48.615 INFO:tasks.workunit.client.3.smithi157.stdout:NAME WR RD WR_BYTES RD_BYTES WR_LAT RD_LAT 2024-03-26T17:11:48.615 INFO:tasks.workunit.client.3.smithi157.stdout:myimage16 4/s 7/s 104 KiB/s 174 KiB/s 3.11 ms 560.35 us 2024-03-26T17:11:48.615 INFO:tasks.workunit.client.3.smithi157.stdout:myimage26 4/s 2/s 102 KiB/s 58 KiB/s 3.19 ms 473.67 us 2024-03-26T17:11:48.615 INFO:tasks.workunit.client.3.smithi157.stdout:myimage5 4/s 7/s 82 KiB/s 191 KiB/s 2.86 ms 500.43 us 2024-03-26T17:11:48.616 INFO:tasks.workunit.client.3.smithi157.stdout:myimage50 4/s 3/s 95 KiB/s 78 KiB/s 3.42 ms 348.07 us 2024-03-26T17:11:48.616 INFO:tasks.workunit.client.3.smithi157.stdout:myimage54 4/s 7/s 85 KiB/s 155 KiB/s 3.04 ms 568.04 us 2024-03-26T17:11:48.616 INFO:tasks.workunit.client.3.smithi157.stdout:myimage56 4/s 2/s 84 KiB/s 49 KiB/s 4.03 ms 468.52 us 2024-03-26T17:11:48.616 INFO:tasks.workunit.client.3.smithi157.stdout:myimage30 4/s 2/s 113 KiB/s 58 KiB/s 4.03 ms 353.48 us 2024-03-26T17:11:48.616 INFO:tasks.workunit.client.3.smithi157.stdout:myimage40 4/s 6/s 98 KiB/s 148 KiB/s 3.13 ms 379.10 us 2024-03-26T17:11:48.616 INFO:tasks.workunit.client.3.smithi157.stdout:myimage28 4/s 2/s 83 KiB/s 40 KiB/s 4.64 ms 347.89 us 2024-03-26T17:11:48.616 INFO:tasks.workunit.client.3.smithi157.stdout:myimage34 4/s 7/s 91 KiB/s 151 KiB/s 3.13 ms 392.00 us 2024-03-26T17:11:48.616 INFO:tasks.workunit.client.3.smithi157.stdout:myimage47 4/s 2/s 94 KiB/s 51 KiB/s 3.00 ms 370.92 us 2024-03-26T17:11:48.616 INFO:tasks.workunit.client.3.smithi157.stdout:myimage1 4/s 3/s 70 KiB/s 53 KiB/s 2.55 ms 315.96 us 2024-03-26T17:11:48.616 INFO:tasks.workunit.client.3.smithi157.stdout:myimage36 4/s 3/s 94 KiB/s 57 KiB/s 2.96 ms 383.94 us 2024-03-26T17:11:48.616 INFO:tasks.workunit.client.3.smithi157.stdout:myimage10 4/s 2/s 75 KiB/s 66 KiB/s 3.10 ms 416.38 us 2024-03-26T17:11:48.617 INFO:tasks.workunit.client.3.smithi157.stdout:myimage23 3/s 1/s 109 KiB/s 33 KiB/s 2.54 ms 417.25 us 2024-03-26T17:11:48.617 INFO:tasks.workunit.client.3.smithi157.stdout:myimage42 3/s 3/s 98 KiB/s 56 KiB/s 3.04 ms 346.76 us 2024-03-26T17:11:48.617 INFO:tasks.workunit.client.3.smithi157.stdout:myimage45 3/s 4/s 58 KiB/s 111 KiB/s 3.12 ms 452.25 us 2024-03-26T17:11:48.617 INFO:tasks.workunit.client.3.smithi157.stdout:myimage51 3/s 3/s 53 KiB/s 70 KiB/s 3.52 ms 303.79 us 2024-03-26T17:11:48.617 INFO:tasks.workunit.client.3.smithi157.stdout:myimage44 3/s 3/s 95 KiB/s 77 KiB/s 3.36 ms 317.16 us 2024-03-26T17:11:48.617 INFO:tasks.workunit.client.3.smithi157.stdout:myimage11 3/s 3/s 113 KiB/s 96 KiB/s 3.54 ms 426.13 us 2024-03-26T17:11:48.617 INFO:tasks.workunit.client.3.smithi157.stdout:myimage12 3/s 4/s 86 KiB/s 81 KiB/s 3.11 ms 421.69 us 2024-03-26T17:11:48.617 INFO:tasks.workunit.client.3.smithi157.stdout:myimage17 3/s 3/s 91 KiB/s 85 KiB/s 3.29 ms 348.85 us 2024-03-26T17:11:48.617 INFO:tasks.workunit.client.3.smithi157.stdout:myimage19 3/s 2/s 82 KiB/s 65 KiB/s 3.41 ms 430.67 us 2024-03-26T17:11:48.617 INFO:tasks.workunit.client.3.smithi157.stdout:myimage20 3/s 7/s 75 KiB/s 148 KiB/s 3.58 ms 384.26 us 2024-03-26T17:11:48.617 INFO:tasks.workunit.client.3.smithi157.stdout:myimage3 3/s 7/s 66 KiB/s 168 KiB/s 2.57 ms 626.99 us 2024-03-26T17:11:48.618 INFO:tasks.workunit.client.3.smithi157.stdout:myimage13 3/s 8/s 70 KiB/s 178 KiB/s 2.97 ms 452.37 us 2024-03-26T17:11:48.618 INFO:tasks.workunit.client.3.smithi157.stdout:myimage14 3/s 4/s 55 KiB/s 104 KiB/s 3.36 ms 366.87 us 2024-03-26T17:11:48.618 INFO:tasks.workunit.client.3.smithi157.stdout:myimage52 3/s 3/s 92 KiB/s 74 KiB/s 3.84 ms 431.37 us 2024-03-26T17:11:48.618 INFO:tasks.workunit.client.3.smithi157.stdout:myimage4 3/s 8/s 77 KiB/s 176 KiB/s 3.05 ms 418.66 us 2024-03-26T17:11:48.618 INFO:tasks.workunit.client.3.smithi157.stdout:myimage46 3/s 3/s 78 KiB/s 65 KiB/s 3.23 ms 340.00 us 2024-03-26T17:11:48.618 INFO:tasks.workunit.client.3.smithi157.stdout:myimage53 3/s 4/s 58 KiB/s 107 KiB/s 2.91 ms 317.90 us 2024-03-26T17:11:48.618 INFO:tasks.workunit.client.3.smithi157.stdout:myimage59 3/s 8/s 86 KiB/s 214 KiB/s 3.68 ms 401.10 us 2024-03-26T17:11:48.618 INFO:tasks.workunit.client.3.smithi157.stdout:myimage37 3/s 3/s 71 KiB/s 74 KiB/s 3.21 ms 460.70 us 2024-03-26T17:11:48.618 INFO:tasks.workunit.client.3.smithi157.stdout:myimage9 3/s 3/s 74 KiB/s 69 KiB/s 3.87 ms 333.82 us 2024-03-26T17:11:48.618 INFO:tasks.workunit.client.3.smithi157.stdout:myimage15 3/s 7/s 50 KiB/s 163 KiB/s 2.88 ms 424.01 us 2024-03-26T17:11:48.619 INFO:tasks.workunit.client.3.smithi157.stdout:myimage25 3/s 4/s 57 KiB/s 75 KiB/s 3.95 ms 375.02 us 2024-03-26T17:11:48.619 INFO:tasks.workunit.client.3.smithi157.stdout:myimage33 3/s 3/s 83 KiB/s 60 KiB/s 3.21 ms 322.39 us 2024-03-26T17:11:48.619 INFO:tasks.workunit.client.3.smithi157.stdout:myimage39 3/s 4/s 74 KiB/s 70 KiB/s 3.23 ms 335.31 us 2024-03-26T17:11:48.619 INFO:tasks.workunit.client.3.smithi157.stdout:myimage57 3/s 3/s 58 KiB/s 79 KiB/s 3.38 ms 349.56 us 2024-03-26T17:11:48.619 INFO:tasks.workunit.client.3.smithi157.stdout:myimage22 3/s 4/s 49 KiB/s 93 KiB/s 2.98 ms 415.07 us 2024-03-26T17:11:48.619 INFO:tasks.workunit.client.3.smithi157.stdout:myimage58 3/s 7/s 55 KiB/s 177 KiB/s 2.70 ms 445.88 us 2024-03-26T17:11:48.619 INFO:tasks.workunit.client.3.smithi157.stdout:myimage7 3/s 4/s 50 KiB/s 81 KiB/s 3.27 ms 321.90 us 2024-03-26T17:11:48.619 INFO:tasks.workunit.client.3.smithi157.stdout:myimage21 3/s 4/s 65 KiB/s 94 KiB/s 3.76 ms 412.76 us 2024-03-26T17:11:48.619 INFO:tasks.workunit.client.3.smithi157.stdout:myimage29 3/s 3/s 71 KiB/s 64 KiB/s 2.90 ms 335.41 us 2024-03-26T17:11:48.619 INFO:tasks.workunit.client.3.smithi157.stdout:myimage41 3/s 3/s 58 KiB/s 91 KiB/s 3.31 ms 372.97 us 2024-03-26T17:11:48.619 INFO:tasks.workunit.client.3.smithi157.stdout:myimage55 3/s 5/s 48 KiB/s 98 KiB/s 3.01 ms 308.40 us 2024-03-26T17:11:48.620 INFO:tasks.workunit.client.3.smithi157.stdout:myimage2 2/s 8/s 63 KiB/s 212 KiB/s 2.83 ms 534.07 us 2024-03-26T17:11:48.620 INFO:tasks.workunit.client.3.smithi157.stdout:myimage31 2/s 8/s 52 KiB/s 202 KiB/s 3.02 ms 500.67 us 2024-03-26T17:11:48.620 INFO:tasks.workunit.client.3.smithi157.stdout:myimage32 2/s 3/s 65 KiB/s 70 KiB/s 3.35 ms 330.21 us 2024-03-26T17:11:48.620 INFO:tasks.workunit.client.3.smithi157.stdout:myimage48 2/s 8/s 64 KiB/s 187 KiB/s 3.23 ms 495.08 us 2024-03-26T17:11:48.620 INFO:tasks.workunit.client.3.smithi157.stdout:myimage8 2/s 4/s 51 KiB/s 115 KiB/s 3.37 ms 460.63 us 2024-03-26T17:11:48.620 INFO:tasks.workunit.client.3.smithi157.stdout:myimage43 2/s 8/s 45 KiB/s 171 KiB/s 3.33 ms 522.84 us 2024-03-26T17:11:48.620 INFO:tasks.workunit.client.3.smithi157.stdout:myimage24 2/s 7/s 64 KiB/s 191 KiB/s 3.37 ms 523.66 us 2024-03-26T17:11:48.620 INFO:tasks.workunit.client.3.smithi157.stdout:myimage60 2/s 3/s 57 KiB/s 82 KiB/s 3.56 ms 338.13 us 2024-03-26T17:11:48.620 INFO:tasks.workunit.client.3.smithi157.stdout:myimage18 2/s 8/s 50 KiB/s 218 KiB/s 3.32 ms 430.14 us 2024-03-26T17:11:48.620 INFO:tasks.workunit.client.3.smithi157.stdout:myimage27 2/s 6/s 36 KiB/s 142 KiB/s 2.88 ms 534.28 us 2024-03-26T17:11:48.620 INFO:tasks.workunit.client.3.smithi157.stdout:myimage49 2/s 8/s 50 KiB/s 195 KiB/s 3.38 ms 501.21 us 2024-03-26T17:11:48.621 INFO:tasks.workunit.client.3.smithi157.stdout:myimage6 2/s 3/s 54 KiB/s 76 KiB/s 3.05 ms 346.24 us 2024-03-26T17:11:48.621 INFO:tasks.workunit.client.3.smithi157.stdout:myimage35 2/s 3/s 60 KiB/s 70 KiB/s 3.07 ms 433.60 us 2024-03-26T17:11:48.621 INFO:tasks.workunit.client.3.smithi157.stdout:myimage38 2/s 4/s 44 KiB/s 104 KiB/s 2.69 ms 336.27 us 2024-03-26T17:11:48.621 INFO:tasks.workunit.client.3.smithi157.stdout: 2024-03-26T17:11:48.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:48 smithi149 ceph-mon[34678]: pgmap v782: 33 pgs: 33 active+clean; 1.0 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 4.6 MiB/s rd, 4.7 MiB/s wr, 420 op/s 2024-03-26T17:11:48.646 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:11:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:11:48] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:11:48.646 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:11:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:11:48] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:11:48.647 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:11:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:11:49.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:49 smithi044 ceph-mon[30624]: Health check update: 3 slow ops, oldest one blocked for 803 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:11:49.515 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:49 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-26T17:11:49.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:49 smithi064 ceph-mon[34420]: Health check update: 3 slow ops, oldest one blocked for 803 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:11:49.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:49 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-26T17:11:49.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:49 smithi149 ceph-mon[34678]: Health check update: 3 slow ops, oldest one blocked for 803 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:11:49.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:49 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-03-26T17:11:50.416 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:11:50 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:11:50] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:11:50.416 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:50 smithi044 ceph-mon[30624]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:11:50.416 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:50 smithi044 ceph-mon[30624]: { 2024-03-26T17:11:50.416 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:50 smithi044 ceph-mon[30624]: "prefix": "rbd perf image stats", 2024-03-26T17:11:50.416 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:50 smithi044 ceph-mon[30624]: "pool_spec": "mypool", 2024-03-26T17:11:50.416 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:50 smithi044 ceph-mon[30624]: "sort_by": "write_ops", 2024-03-26T17:11:50.417 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:50 smithi044 ceph-mon[30624]: "format": "json" 2024-03-26T17:11:50.417 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:50 smithi044 ceph-mon[30624]: }"]: dispatch 2024-03-26T17:11:50.417 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:50 smithi044 ceph-mon[30624]: pgmap v783: 33 pgs: 33 active+clean; 1.0 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 5.7 MiB/s rd, 4.8 MiB/s wr, 477 op/s 2024-03-26T17:11:50.417 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:50 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T17:11:50.417 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:50 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-26T17:11:50.417 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:50 smithi044 ceph-mon[30624]: pgmap v784: 33 pgs: 33 active+clean; 1.0 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 6.1 MiB/s rd, 4.3 MiB/s wr, 474 op/s 2024-03-26T17:11:50.417 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:50 smithi044 ceph-mon[30624]: pgmap v785: 33 pgs: 33 active+clean; 1.0 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 6.1 MiB/s rd, 4.0 MiB/s wr, 456 op/s 2024-03-26T17:11:50.417 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:50 smithi044 ceph-mon[30624]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T17:11:50.417 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:11:50 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:11:50] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:11:50.417 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:11:50 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:11:50.548 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:50 smithi149 ceph-mon[34678]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:11:50.548 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:50 smithi149 ceph-mon[34678]: { 2024-03-26T17:11:50.548 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:50 smithi149 ceph-mon[34678]: "prefix": "rbd perf image stats", 2024-03-26T17:11:50.548 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:50 smithi149 ceph-mon[34678]: "pool_spec": "mypool", 2024-03-26T17:11:50.548 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:50 smithi149 ceph-mon[34678]: "sort_by": "write_ops", 2024-03-26T17:11:50.548 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:50 smithi149 ceph-mon[34678]: "format": "json" 2024-03-26T17:11:50.548 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:50 smithi149 ceph-mon[34678]: }"]: dispatch 2024-03-26T17:11:50.549 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:50 smithi149 ceph-mon[34678]: pgmap v783: 33 pgs: 33 active+clean; 1.0 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 5.7 MiB/s rd, 4.8 MiB/s wr, 477 op/s 2024-03-26T17:11:50.549 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:50 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T17:11:50.549 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:50 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-26T17:11:50.549 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:50 smithi149 ceph-mon[34678]: pgmap v784: 33 pgs: 33 active+clean; 1.0 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 6.1 MiB/s rd, 4.3 MiB/s wr, 474 op/s 2024-03-26T17:11:50.549 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:50 smithi149 ceph-mon[34678]: pgmap v785: 33 pgs: 33 active+clean; 1.0 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 6.1 MiB/s rd, 4.0 MiB/s wr, 456 op/s 2024-03-26T17:11:50.549 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:50 smithi149 ceph-mon[34678]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T17:11:50.549 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:11:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:11:50] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:11:50.549 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:11:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:11:50] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:11:50.550 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:11:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:11:50.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:50 smithi064 ceph-mon[34420]: from='client.15129 -' entity='client.admin' cmd=[ 2024-03-26T17:11:50.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:50 smithi064 ceph-mon[34420]: { 2024-03-26T17:11:50.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:50 smithi064 ceph-mon[34420]: "prefix": "rbd perf image stats", 2024-03-26T17:11:50.555 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:50 smithi064 ceph-mon[34420]: "pool_spec": "mypool", 2024-03-26T17:11:50.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:50 smithi064 ceph-mon[34420]: "sort_by": "write_ops", 2024-03-26T17:11:50.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:50 smithi064 ceph-mon[34420]: "format": "json" 2024-03-26T17:11:50.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:50 smithi064 ceph-mon[34420]: }"]: dispatch 2024-03-26T17:11:50.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:50 smithi064 ceph-mon[34420]: pgmap v783: 33 pgs: 33 active+clean; 1.0 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 5.7 MiB/s rd, 4.8 MiB/s wr, 477 op/s 2024-03-26T17:11:50.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:50 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-03-26T17:11:50.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:50 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-03-26T17:11:50.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:50 smithi064 ceph-mon[34420]: pgmap v784: 33 pgs: 33 active+clean; 1.0 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 6.1 MiB/s rd, 4.3 MiB/s wr, 474 op/s 2024-03-26T17:11:50.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:50 smithi064 ceph-mon[34420]: pgmap v785: 33 pgs: 33 active+clean; 1.0 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 6.1 MiB/s rd, 4.0 MiB/s wr, 456 op/s 2024-03-26T17:11:50.556 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:50 smithi064 ceph-mon[34420]: from='mgr.14152 172.21.15.44:0/2967104978' entity='mgr.x' 2024-03-26T17:11:51.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:51 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 2024-03-26T17:11:51.247+0000 7fa707a55700 -1 mon.c@1(peon) e3 get_health_metrics reporting 3 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T17:11:52.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:11:52 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:11:52] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:11:52.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:11:52 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:11:52] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:11:52.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:11:52 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:11:52.646 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:11:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:11:52] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:11:52.646 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:11:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:11:52] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:11:52.646 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:11:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:11:53.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:52 smithi044 ceph-mon[30624]: pgmap v786: 33 pgs: 33 active+clean; 1.0 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 6.4 MiB/s rd, 3.3 MiB/s wr, 443 op/s 2024-03-26T17:11:53.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:52 smithi064 ceph-mon[34420]: pgmap v786: 33 pgs: 33 active+clean; 1.0 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 6.4 MiB/s rd, 3.3 MiB/s wr, 443 op/s 2024-03-26T17:11:53.396 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:52 smithi149 ceph-mon[34678]: pgmap v786: 33 pgs: 33 active+clean; 1.0 GiB data, 4.5 GiB used, 711 GiB / 715 GiB avail; 6.4 MiB/s rd, 3.3 MiB/s wr, 443 op/s 2024-03-26T17:11:53.634 INFO:tasks.workunit.client.3.smithi157.stdout:[nvmeo.fio] fio test successful! 2024-03-26T17:11:53.635 INFO:tasks.workunit.client.3.smithi157.stderr:+ echo '[nvmeo.fio] fio test successful!' 2024-03-26T17:11:53.636 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-03-26T17:11:53.636 DEBUG:teuthology.orchestra.run.smithi157:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.3/client.3/tmp 2024-03-26T17:11:53.671 INFO:tasks.workunit:Stopping ['rbd/nvmeof_fio_test.sh --rbd_iostat'] on client.3... 2024-03-26T17:11:53.671 DEBUG:teuthology.orchestra.run.smithi157:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.3 /home/ubuntu/cephtest/clone.client.3 2024-03-26T17:11:53.992 DEBUG:teuthology.parallel:result is None 2024-03-26T17:11:53.993 DEBUG:teuthology.orchestra.run.smithi157:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.3/client.3 2024-03-26T17:11:54.020 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.3/client.3 2024-03-26T17:11:54.021 DEBUG:teuthology.orchestra.run.smithi157:> rmdir -- /home/ubuntu/cephtest/mnt.3 2024-03-26T17:11:54.075 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.3/client.3 2024-03-26T17:11:54.075 DEBUG:teuthology.run_tasks:Unwinding manager nvmeof.thrash 2024-03-26T17:11:54.089 INFO:tasks.nvmeof:joining nvmeof.thrash 2024-03-26T17:11:54.089 ERROR:teuthology.run_tasks:Manager failed: nvmeof.thrash Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_7c79d572ca9e89ddbdc2c40bbb7dac4f505c80ce/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/home/teuthworker/src/git.ceph.com_teuthology_7c79d572ca9e89ddbdc2c40bbb7dac4f505c80ce/teuthology/task/__init__.py", line 132, in __exit__ self.end() File "/home/teuthworker/src/github.com_vallariag_ceph_b4c4828f419f1247fc297e8069c1036b1d6151f2/qa/tasks/nvmeof.py", line 295, in end raise RuntimeError('error during thrashing') RuntimeError: error during thrashing 2024-03-26T17:11:54.090 DEBUG:teuthology.run_tasks:Unwinding manager nvmeof 2024-03-26T17:11:54.108 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-03-26T17:11:54.122 INFO:tasks.cephadm:Teardown begin 2024-03-26T17:11:54.123 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_7c79d572ca9e89ddbdc2c40bbb7dac4f505c80ce/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_vallariag_ceph_b4c4828f419f1247fc297e8069c1036b1d6151f2/qa/tasks/cephadm.py", line 1807, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_7c79d572ca9e89ddbdc2c40bbb7dac4f505c80ce/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/home/teuthworker/src/git.ceph.com_teuthology_7c79d572ca9e89ddbdc2c40bbb7dac4f505c80ce/teuthology/task/__init__.py", line 132, in __exit__ self.end() File "/home/teuthworker/src/github.com_vallariag_ceph_b4c4828f419f1247fc297e8069c1036b1d6151f2/qa/tasks/nvmeof.py", line 295, in end raise RuntimeError('error during thrashing') RuntimeError: error during thrashing 2024-03-26T17:11:54.151 DEBUG:teuthology.orchestra.run.smithi044:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-03-26T17:11:54.181 DEBUG:teuthology.orchestra.run.smithi064:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-03-26T17:11:54.215 DEBUG:teuthology.orchestra.run.smithi149:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-03-26T17:11:54.265 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:53 smithi044 ceph-mon[30624]: Health check update: 3 slow ops, oldest one blocked for 808 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:11:54.265 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:11:54 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:11:54] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:11:54.266 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:11:54 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:11:54] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:11:54.266 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:11:54 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:11:54.305 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:53 smithi064 ceph-mon[34420]: Health check update: 3 slow ops, oldest one blocked for 808 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:11:54.327 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:53 smithi149 ceph-mon[34678]: Health check update: 3 slow ops, oldest one blocked for 808 sec, mon.c has slow ops (SLOW_OPS) 2024-03-26T17:11:54.369 DEBUG:teuthology.orchestra.run.smithi157:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-03-26T17:11:54.397 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-03-26T17:11:54.397 DEBUG:teuthology.orchestra.run.smithi044:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-03-26T17:11:54.412 DEBUG:teuthology.orchestra.run.smithi064:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-03-26T17:11:54.431 DEBUG:teuthology.orchestra.run.smithi149:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-03-26T17:11:54.455 DEBUG:teuthology.orchestra.run.smithi157:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-03-26T17:11:54.470 INFO:tasks.cephadm:Stopping all daemons... 2024-03-26T17:11:54.470 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-03-26T17:11:54.470 DEBUG:teuthology.orchestra.run.smithi044:> sudo systemctl stop ceph-4394d798-eb90-11ee-95d0-87774f69a715@mon.a 2024-03-26T17:11:54.646 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:11:54 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:11:54] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:11:54.646 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:11:54 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:11:54] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:11:54.646 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:11:54 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:11:54.765 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:54 smithi044 systemd[1]: Stopping Ceph mon.a for 4394d798-eb90-11ee-95d0-87774f69a715... 2024-03-26T17:11:55.109 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:54 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30620]: 2024-03-26T17:11:54.773+0000 7fdc08389700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-03-26T17:11:55.109 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:54 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30620]: 2024-03-26T17:11:54.773+0000 7fdc08389700 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-03-26T17:11:55.109 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:54 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30620]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2382-gbf9505fb/rpm/el8/BUILD/ceph-19.0.0-2382-gbf9505fb/src/common/config_obs_mgr.h: In function 'ObserverMgr::config_obs_wptr ObserverMgr::remove_observer(ConfigObs*) [with ConfigObs = ceph::md_config_obs_impl; ObserverMgr::config_obs_wptr = std::weak_ptr*>]' thread 7fdc08389700 time 2024-03-26T17:11:54.775385+0000 2024-03-26T17:11:55.109 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:54 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30620]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2382-gbf9505fb/rpm/el8/BUILD/ceph-19.0.0-2382-gbf9505fb/src/common/config_obs_mgr.h: 84: FAILED ceph_assert(found_obs) 2024-03-26T17:11:55.110 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:54 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30620]: ceph version 19.0.0-2382-gbf9505fb (bf9505fb569e9b95a78f9700ed8c4bd20508ef55) squid (dev) 2024-03-26T17:11:55.110 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:54 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30620]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fdc107ea3cd] 2024-03-26T17:11:55.110 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:54 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30620]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2db593) [0x7fdc107ea593] 2024-03-26T17:11:55.110 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:54 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30620]: 3: (ObserverMgr >::remove_observer(ceph::md_config_obs_impl*)+0x196) [0x55c4e0010166] 2024-03-26T17:11:55.110 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:54 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30620]: 4: (NVMeofGwMon::on_shutdown()+0x72) [0x55c4e00f8742] 2024-03-26T17:11:55.110 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:54 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30620]: 5: (Monitor::shutdown()+0x2bc) [0x55c4dffe055c] 2024-03-26T17:11:55.110 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:54 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30620]: 6: (SignalHandler::entry()+0x659) [0x55c4e02c5869] 2024-03-26T17:11:55.110 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:54 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30620]: 7: /lib64/libpthread.so.0(+0x81ca) [0x7fdc0dfcf1ca] 2024-03-26T17:11:55.110 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:54 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30620]: 8: clone() 2024-03-26T17:11:55.110 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:54 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30620]: 2024-03-26T17:11:54.774+0000 7fdc08389700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2382-gbf9505fb/rpm/el8/BUILD/ceph-19.0.0-2382-gbf9505fb/src/common/config_obs_mgr.h: In function 'ObserverMgr::config_obs_wptr ObserverMgr::remove_observer(ConfigObs*) [with ConfigObs = ceph::md_config_obs_impl; ObserverMgr::config_obs_wptr = std::weak_ptr*>]' thread 7fdc08389700 time 2024-03-26T17:11:54.775385+0000 2024-03-26T17:11:55.111 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:54 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30620]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2382-gbf9505fb/rpm/el8/BUILD/ceph-19.0.0-2382-gbf9505fb/src/common/config_obs_mgr.h: 84: FAILED ceph_assert(found_obs) 2024-03-26T17:11:55.112 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:54 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30620]: 2024-03-26T17:11:55.112 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:54 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30620]: ceph version 19.0.0-2382-gbf9505fb (bf9505fb569e9b95a78f9700ed8c4bd20508ef55) squid (dev) 2024-03-26T17:11:55.112 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:54 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30620]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fdc107ea3cd] 2024-03-26T17:11:55.112 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:54 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30620]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2db593) [0x7fdc107ea593] 2024-03-26T17:11:55.112 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:54 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30620]: 3: (ObserverMgr >::remove_observer(ceph::md_config_obs_impl*)+0x196) [0x55c4e0010166] 2024-03-26T17:11:55.112 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:54 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30620]: 4: (NVMeofGwMon::on_shutdown()+0x72) [0x55c4e00f8742] 2024-03-26T17:11:55.112 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:54 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30620]: 5: (Monitor::shutdown()+0x2bc) [0x55c4dffe055c] 2024-03-26T17:11:55.112 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:54 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30620]: 6: (SignalHandler::entry()+0x659) [0x55c4e02c5869] 2024-03-26T17:11:55.112 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:54 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30620]: 7: /lib64/libpthread.so.0(+0x81ca) [0x7fdc0dfcf1ca] 2024-03-26T17:11:55.112 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:54 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30620]: 8: clone() 2024-03-26T17:11:55.113 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:54 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30620]: 2024-03-26T17:11:55.113 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:54 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30620]: *** Caught signal (Aborted) ** 2024-03-26T17:11:55.113 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:54 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30620]: in thread 7fdc08389700 thread_name:signal_handler 2024-03-26T17:11:55.113 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:54 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30620]: ceph version 19.0.0-2382-gbf9505fb (bf9505fb569e9b95a78f9700ed8c4bd20508ef55) squid (dev) 2024-03-26T17:11:55.113 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:54 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30620]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7fdc0dfd9d20] 2024-03-26T17:11:55.113 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:54 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30620]: 2: gsignal() 2024-03-26T17:11:55.113 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:54 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30620]: 3: abort() 2024-03-26T17:11:55.113 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:54 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30620]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fdc107ea427] 2024-03-26T17:11:55.113 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:54 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30620]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2db593) [0x7fdc107ea593] 2024-03-26T17:11:55.113 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:54 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30620]: 6: (ObserverMgr >::remove_observer(ceph::md_config_obs_impl*)+0x196) [0x55c4e0010166] 2024-03-26T17:11:55.113 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:54 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30620]: 7: (NVMeofGwMon::on_shutdown()+0x72) [0x55c4e00f8742] 2024-03-26T17:11:55.114 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:54 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30620]: 8: (Monitor::shutdown()+0x2bc) [0x55c4dffe055c] 2024-03-26T17:11:55.114 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:54 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30620]: 9: (SignalHandler::entry()+0x659) [0x55c4e02c5869] 2024-03-26T17:11:55.114 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:54 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30620]: 10: /lib64/libpthread.so.0(+0x81ca) [0x7fdc0dfcf1ca] 2024-03-26T17:11:55.114 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:54 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30620]: 11: clone() 2024-03-26T17:11:55.114 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:54 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30620]: 2024-03-26T17:11:54.776+0000 7fdc08389700 -1 *** Caught signal (Aborted) ** 2024-03-26T17:11:55.114 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:54 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30620]: in thread 7fdc08389700 thread_name:signal_handler 2024-03-26T17:11:55.114 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:54 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30620]: 2024-03-26T17:11:55.114 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:54 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30620]: ceph version 19.0.0-2382-gbf9505fb (bf9505fb569e9b95a78f9700ed8c4bd20508ef55) squid (dev) 2024-03-26T17:11:55.114 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:54 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30620]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7fdc0dfd9d20] 2024-03-26T17:11:55.114 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:54 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30620]: 2: gsignal() 2024-03-26T17:11:55.114 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:54 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30620]: 3: abort() 2024-03-26T17:11:55.115 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:54 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30620]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fdc107ea427] 2024-03-26T17:11:55.115 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:54 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30620]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2db593) [0x7fdc107ea593] 2024-03-26T17:11:55.115 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:54 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30620]: 6: (ObserverMgr >::remove_observer(ceph::md_config_obs_impl*)+0x196) [0x55c4e0010166] 2024-03-26T17:11:55.115 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:54 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30620]: 7: (NVMeofGwMon::on_shutdown()+0x72) [0x55c4e00f8742] 2024-03-26T17:11:55.115 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:54 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30620]: 8: (Monitor::shutdown()+0x2bc) [0x55c4dffe055c] 2024-03-26T17:11:55.115 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:54 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30620]: 9: (SignalHandler::entry()+0x659) [0x55c4e02c5869] 2024-03-26T17:11:55.115 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:54 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30620]: 10: /lib64/libpthread.so.0(+0x81ca) [0x7fdc0dfcf1ca] 2024-03-26T17:11:55.115 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:54 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30620]: 11: clone() 2024-03-26T17:11:55.115 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:54 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30620]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-26T17:11:55.115 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:54 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30620]: 2024-03-26T17:11:55.115 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:54 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30620]: -30> 2024-03-26T17:11:54.773+0000 7fdc08389700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-03-26T17:11:55.115 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:54 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30620]: -29> 2024-03-26T17:11:54.773+0000 7fdc08389700 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-03-26T17:11:55.116 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:54 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30620]: -1> 2024-03-26T17:11:54.774+0000 7fdc08389700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2382-gbf9505fb/rpm/el8/BUILD/ceph-19.0.0-2382-gbf9505fb/src/common/config_obs_mgr.h: In function 'ObserverMgr::config_obs_wptr ObserverMgr::remove_observer(ConfigObs*) [with ConfigObs = ceph::md_config_obs_impl; ObserverMgr::config_obs_wptr = std::weak_ptr*>]' thread 7fdc08389700 time 2024-03-26T17:11:54.775385+0000 2024-03-26T17:11:55.116 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:54 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30620]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2382-gbf9505fb/rpm/el8/BUILD/ceph-19.0.0-2382-gbf9505fb/src/common/config_obs_mgr.h: 84: FAILED ceph_assert(found_obs) 2024-03-26T17:11:55.116 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:54 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30620]: 2024-03-26T17:11:55.116 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:54 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30620]: ceph version 19.0.0-2382-gbf9505fb (bf9505fb569e9b95a78f9700ed8c4bd20508ef55) squid (dev) 2024-03-26T17:11:55.116 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:54 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30620]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fdc107ea3cd] 2024-03-26T17:11:55.116 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:54 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30620]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2db593) [0x7fdc107ea593] 2024-03-26T17:11:55.116 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:54 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30620]: 3: (ObserverMgr >::remove_observer(ceph::md_config_obs_impl*)+0x196) [0x55c4e0010166] 2024-03-26T17:11:55.116 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:54 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30620]: 4: (NVMeofGwMon::on_shutdown()+0x72) [0x55c4e00f8742] 2024-03-26T17:11:55.116 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:54 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30620]: 5: (Monitor::shutdown()+0x2bc) [0x55c4dffe055c] 2024-03-26T17:11:55.117 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:54 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30620]: 6: (SignalHandler::entry()+0x659) [0x55c4e02c5869] 2024-03-26T17:11:55.117 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:54 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30620]: 7: /lib64/libpthread.so.0(+0x81ca) [0x7fdc0dfcf1ca] 2024-03-26T17:11:55.117 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:54 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30620]: 8: clone() 2024-03-26T17:11:55.117 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:54 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30620]: 2024-03-26T17:11:55.117 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:54 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30620]: 0> 2024-03-26T17:11:54.776+0000 7fdc08389700 -1 *** Caught signal (Aborted) ** 2024-03-26T17:11:55.117 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:54 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30620]: in thread 7fdc08389700 thread_name:signal_handler 2024-03-26T17:11:55.117 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:54 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30620]: 2024-03-26T17:11:55.117 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:54 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30620]: ceph version 19.0.0-2382-gbf9505fb (bf9505fb569e9b95a78f9700ed8c4bd20508ef55) squid (dev) 2024-03-26T17:11:55.117 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:54 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30620]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7fdc0dfd9d20] 2024-03-26T17:11:55.117 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:54 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30620]: 2: gsignal() 2024-03-26T17:11:55.117 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:54 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30620]: 3: abort() 2024-03-26T17:11:55.118 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:54 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30620]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fdc107ea427] 2024-03-26T17:11:55.118 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:54 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30620]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2db593) [0x7fdc107ea593] 2024-03-26T17:11:55.118 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:54 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30620]: 6: (ObserverMgr >::remove_observer(ceph::md_config_obs_impl*)+0x196) [0x55c4e0010166] 2024-03-26T17:11:55.118 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:54 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30620]: 7: (NVMeofGwMon::on_shutdown()+0x72) [0x55c4e00f8742] 2024-03-26T17:11:55.118 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:54 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30620]: 8: (Monitor::shutdown()+0x2bc) [0x55c4dffe055c] 2024-03-26T17:11:55.118 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:54 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30620]: 9: (SignalHandler::entry()+0x659) [0x55c4e02c5869] 2024-03-26T17:11:55.118 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:54 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30620]: 10: /lib64/libpthread.so.0(+0x81ca) [0x7fdc0dfcf1ca] 2024-03-26T17:11:55.118 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:54 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30620]: 11: clone() 2024-03-26T17:11:55.118 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:54 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30620]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-26T17:11:55.118 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:54 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30620]: 2024-03-26T17:11:55.118 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:54 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30620]: -30> 2024-03-26T17:11:54.773+0000 7fdc08389700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-03-26T17:11:55.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:54 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30620]: -29> 2024-03-26T17:11:54.773+0000 7fdc08389700 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-03-26T17:11:55.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:54 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30620]: -1> 2024-03-26T17:11:54.774+0000 7fdc08389700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2382-gbf9505fb/rpm/el8/BUILD/ceph-19.0.0-2382-gbf9505fb/src/common/config_obs_mgr.h: In function 'ObserverMgr::config_obs_wptr ObserverMgr::remove_observer(ConfigObs*) [with ConfigObs = ceph::md_config_obs_impl; ObserverMgr::config_obs_wptr = std::weak_ptr*>]' thread 7fdc08389700 time 2024-03-26T17:11:54.775385+0000 2024-03-26T17:11:55.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:54 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30620]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2382-gbf9505fb/rpm/el8/BUILD/ceph-19.0.0-2382-gbf9505fb/src/common/config_obs_mgr.h: 84: FAILED ceph_assert(found_obs) 2024-03-26T17:11:55.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:54 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30620]: 2024-03-26T17:11:55.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:54 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30620]: ceph version 19.0.0-2382-gbf9505fb (bf9505fb569e9b95a78f9700ed8c4bd20508ef55) squid (dev) 2024-03-26T17:11:55.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:54 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30620]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fdc107ea3cd] 2024-03-26T17:11:55.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:54 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30620]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2db593) [0x7fdc107ea593] 2024-03-26T17:11:55.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:54 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30620]: 3: (ObserverMgr >::remove_observer(ceph::md_config_obs_impl*)+0x196) [0x55c4e0010166] 2024-03-26T17:11:55.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:54 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30620]: 4: (NVMeofGwMon::on_shutdown()+0x72) [0x55c4e00f8742] 2024-03-26T17:11:55.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:54 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30620]: 5: (Monitor::shutdown()+0x2bc) [0x55c4dffe055c] 2024-03-26T17:11:55.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:54 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30620]: 6: (SignalHandler::entry()+0x659) [0x55c4e02c5869] 2024-03-26T17:11:55.119 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:54 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30620]: 7: /lib64/libpthread.so.0(+0x81ca) [0x7fdc0dfcf1ca] 2024-03-26T17:11:55.120 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:54 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30620]: 8: clone() 2024-03-26T17:11:55.120 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:54 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30620]: 2024-03-26T17:11:55.120 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:54 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30620]: 0> 2024-03-26T17:11:54.776+0000 7fdc08389700 -1 *** Caught signal (Aborted) ** 2024-03-26T17:11:55.120 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:54 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30620]: in thread 7fdc08389700 thread_name:signal_handler 2024-03-26T17:11:55.120 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:54 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30620]: 2024-03-26T17:11:55.120 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:54 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30620]: ceph version 19.0.0-2382-gbf9505fb (bf9505fb569e9b95a78f9700ed8c4bd20508ef55) squid (dev) 2024-03-26T17:11:55.120 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:54 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30620]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7fdc0dfd9d20] 2024-03-26T17:11:55.120 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:54 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30620]: 2: gsignal() 2024-03-26T17:11:55.120 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:54 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30620]: 3: abort() 2024-03-26T17:11:55.120 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:54 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30620]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fdc107ea427] 2024-03-26T17:11:55.120 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:54 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30620]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2db593) [0x7fdc107ea593] 2024-03-26T17:11:55.120 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:54 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30620]: 6: (ObserverMgr >::remove_observer(ceph::md_config_obs_impl*)+0x196) [0x55c4e0010166] 2024-03-26T17:11:55.121 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:54 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30620]: 7: (NVMeofGwMon::on_shutdown()+0x72) [0x55c4e00f8742] 2024-03-26T17:11:55.121 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:54 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30620]: 8: (Monitor::shutdown()+0x2bc) [0x55c4dffe055c] 2024-03-26T17:11:55.121 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:54 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30620]: 9: (SignalHandler::entry()+0x659) [0x55c4e02c5869] 2024-03-26T17:11:55.121 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:54 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30620]: 10: /lib64/libpthread.so.0(+0x81ca) [0x7fdc0dfcf1ca] 2024-03-26T17:11:55.121 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:54 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30620]: 11: clone() 2024-03-26T17:11:55.121 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:54 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30620]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-26T17:11:55.121 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:54 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a[30620]: 2024-03-26T17:11:55.121 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:54 smithi044 podman[74931]: 2024-03-26 17:11:54.815352913 +0000 UTC m=+0.142502282 container died c1736fb672320b87ad4069e87f56b069d808cc11e111230b4e8ce7e9fbdd898d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bf9505fb569e9b95a78f9700ed8c4bd20508ef55, name=ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240319, org.label-schema.license=GPLv2, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=ceph-nvmeof-mon-bf9505f, ceph=True, org.label-schema.schema-version=1.0) 2024-03-26T17:11:55.710 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:55 smithi044 podman[74931]: 2024-03-26 17:11:55.458962583 +0000 UTC m=+0.786111950 container cleanup c1736fb672320b87ad4069e87f56b069d808cc11e111230b4e8ce7e9fbdd898d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bf9505fb569e9b95a78f9700ed8c4bd20508ef55, name=ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=ceph-nvmeof-mon-bf9505f, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240319, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True) 2024-03-26T17:11:55.710 INFO:journalctl@ceph.mon.a.smithi044.stdout:Mar 26 17:11:55 smithi044 bash[74931]: ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-a 2024-03-26T17:11:55.828 DEBUG:teuthology.orchestra.run.smithi044:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4394d798-eb90-11ee-95d0-87774f69a715@mon.a.service' 2024-03-26T17:11:55.875 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-26T17:11:55.875 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-03-26T17:11:55.876 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2024-03-26T17:11:55.876 DEBUG:teuthology.orchestra.run.smithi064:> sudo systemctl stop ceph-4394d798-eb90-11ee-95d0-87774f69a715@mon.b 2024-03-26T17:11:56.199 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:55 smithi064 systemd[1]: Stopping Ceph mon.b for 4394d798-eb90-11ee-95d0-87774f69a715... 2024-03-26T17:11:56.500 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:56 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-b[34416]: 2024-03-26T17:11:56.198+0000 7ff02591c700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-03-26T17:11:56.500 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:56 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-b[34416]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2382-gbf9505fb/rpm/el8/BUILD/ceph-19.0.0-2382-gbf9505fb/src/common/config_obs_mgr.h: In function 'ObserverMgr::config_obs_wptr ObserverMgr::remove_observer(ConfigObs*) [with ConfigObs = ceph::md_config_obs_impl; ObserverMgr::config_obs_wptr = std::weak_ptr*>]' thread 7ff02591c700 time 2024-03-26T17:11:56.199375+0000 2024-03-26T17:11:56.500 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:56 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-b[34416]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2382-gbf9505fb/rpm/el8/BUILD/ceph-19.0.0-2382-gbf9505fb/src/common/config_obs_mgr.h: 84: FAILED ceph_assert(found_obs) 2024-03-26T17:11:56.500 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:56 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-b[34416]: 2024-03-26T17:11:56.198+0000 7ff02591c700 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-03-26T17:11:56.501 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:56 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-b[34416]: ceph version 19.0.0-2382-gbf9505fb (bf9505fb569e9b95a78f9700ed8c4bd20508ef55) squid (dev) 2024-03-26T17:11:56.501 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:56 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-b[34416]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7ff02dd7d3cd] 2024-03-26T17:11:56.501 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:56 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-b[34416]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2db593) [0x7ff02dd7d593] 2024-03-26T17:11:56.501 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:56 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-b[34416]: 3: (ObserverMgr >::remove_observer(ceph::md_config_obs_impl*)+0x196) [0x560cdfc79166] 2024-03-26T17:11:56.501 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:56 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-b[34416]: 4: (NVMeofGwMon::on_shutdown()+0x72) [0x560cdfd61742] 2024-03-26T17:11:56.501 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:56 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-b[34416]: 5: (Monitor::shutdown()+0x2bc) [0x560cdfc4955c] 2024-03-26T17:11:56.501 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:56 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-b[34416]: 6: (SignalHandler::entry()+0x659) [0x560cdff2e869] 2024-03-26T17:11:56.501 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:56 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-b[34416]: 7: /lib64/libpthread.so.0(+0x81ca) [0x7ff02b5621ca] 2024-03-26T17:11:56.501 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:56 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-b[34416]: 8: clone() 2024-03-26T17:11:56.501 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:56 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-b[34416]: 2024-03-26T17:11:56.199+0000 7ff02591c700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2382-gbf9505fb/rpm/el8/BUILD/ceph-19.0.0-2382-gbf9505fb/src/common/config_obs_mgr.h: In function 'ObserverMgr::config_obs_wptr ObserverMgr::remove_observer(ConfigObs*) [with ConfigObs = ceph::md_config_obs_impl; ObserverMgr::config_obs_wptr = std::weak_ptr*>]' thread 7ff02591c700 time 2024-03-26T17:11:56.199375+0000 2024-03-26T17:11:56.502 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:56 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-b[34416]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2382-gbf9505fb/rpm/el8/BUILD/ceph-19.0.0-2382-gbf9505fb/src/common/config_obs_mgr.h: 84: FAILED ceph_assert(found_obs) 2024-03-26T17:11:56.502 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:56 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-b[34416]: 2024-03-26T17:11:56.502 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:56 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-b[34416]: ceph version 19.0.0-2382-gbf9505fb (bf9505fb569e9b95a78f9700ed8c4bd20508ef55) squid (dev) 2024-03-26T17:11:56.502 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:56 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-b[34416]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7ff02dd7d3cd] 2024-03-26T17:11:56.503 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:56 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-b[34416]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2db593) [0x7ff02dd7d593] 2024-03-26T17:11:56.503 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:56 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-b[34416]: 3: (ObserverMgr >::remove_observer(ceph::md_config_obs_impl*)+0x196) [0x560cdfc79166] 2024-03-26T17:11:56.503 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:56 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-b[34416]: 4: (NVMeofGwMon::on_shutdown()+0x72) [0x560cdfd61742] 2024-03-26T17:11:56.503 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:56 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-b[34416]: 5: (Monitor::shutdown()+0x2bc) [0x560cdfc4955c] 2024-03-26T17:11:56.503 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:56 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-b[34416]: 6: (SignalHandler::entry()+0x659) [0x560cdff2e869] 2024-03-26T17:11:56.503 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:56 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-b[34416]: 7: /lib64/libpthread.so.0(+0x81ca) [0x7ff02b5621ca] 2024-03-26T17:11:56.503 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:56 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-b[34416]: 8: clone() 2024-03-26T17:11:56.503 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:56 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-b[34416]: 2024-03-26T17:11:56.503 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:56 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-b[34416]: *** Caught signal (Aborted) ** 2024-03-26T17:11:56.505 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:56 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-b[34416]: in thread 7ff02591c700 thread_name:signal_handler 2024-03-26T17:11:56.505 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:56 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-b[34416]: ceph version 19.0.0-2382-gbf9505fb (bf9505fb569e9b95a78f9700ed8c4bd20508ef55) squid (dev) 2024-03-26T17:11:56.505 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:56 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-b[34416]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7ff02b56cd20] 2024-03-26T17:11:56.505 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:56 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-b[34416]: 2: gsignal() 2024-03-26T17:11:56.506 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:56 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-b[34416]: 3: abort() 2024-03-26T17:11:56.506 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:56 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-b[34416]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7ff02dd7d427] 2024-03-26T17:11:56.506 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:56 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-b[34416]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2db593) [0x7ff02dd7d593] 2024-03-26T17:11:56.506 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:56 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-b[34416]: 6: (ObserverMgr >::remove_observer(ceph::md_config_obs_impl*)+0x196) [0x560cdfc79166] 2024-03-26T17:11:56.506 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:56 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-b[34416]: 7: (NVMeofGwMon::on_shutdown()+0x72) [0x560cdfd61742] 2024-03-26T17:11:56.506 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:56 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-b[34416]: 8: (Monitor::shutdown()+0x2bc) [0x560cdfc4955c] 2024-03-26T17:11:56.506 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:56 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-b[34416]: 9: (SignalHandler::entry()+0x659) [0x560cdff2e869] 2024-03-26T17:11:56.506 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:56 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-b[34416]: 10: /lib64/libpthread.so.0(+0x81ca) [0x7ff02b5621ca] 2024-03-26T17:11:56.506 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:56 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-b[34416]: 11: clone() 2024-03-26T17:11:56.506 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:56 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-b[34416]: 2024-03-26T17:11:56.200+0000 7ff02591c700 -1 *** Caught signal (Aborted) ** 2024-03-26T17:11:56.506 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:56 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-b[34416]: in thread 7ff02591c700 thread_name:signal_handler 2024-03-26T17:11:56.506 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:56 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-b[34416]: 2024-03-26T17:11:56.506 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:56 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-b[34416]: ceph version 19.0.0-2382-gbf9505fb (bf9505fb569e9b95a78f9700ed8c4bd20508ef55) squid (dev) 2024-03-26T17:11:56.506 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:56 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-b[34416]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7ff02b56cd20] 2024-03-26T17:11:56.507 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:56 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-b[34416]: 2: gsignal() 2024-03-26T17:11:56.507 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:56 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-b[34416]: 3: abort() 2024-03-26T17:11:56.507 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:56 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-b[34416]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7ff02dd7d427] 2024-03-26T17:11:56.507 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:56 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-b[34416]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2db593) [0x7ff02dd7d593] 2024-03-26T17:11:56.507 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:56 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-b[34416]: 6: (ObserverMgr >::remove_observer(ceph::md_config_obs_impl*)+0x196) [0x560cdfc79166] 2024-03-26T17:11:56.507 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:56 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-b[34416]: 7: (NVMeofGwMon::on_shutdown()+0x72) [0x560cdfd61742] 2024-03-26T17:11:56.507 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:56 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-b[34416]: 8: (Monitor::shutdown()+0x2bc) [0x560cdfc4955c] 2024-03-26T17:11:56.507 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:56 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-b[34416]: 9: (SignalHandler::entry()+0x659) [0x560cdff2e869] 2024-03-26T17:11:56.507 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:56 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-b[34416]: 10: /lib64/libpthread.so.0(+0x81ca) [0x7ff02b5621ca] 2024-03-26T17:11:56.507 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:56 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-b[34416]: 11: clone() 2024-03-26T17:11:56.507 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:56 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-b[34416]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-26T17:11:56.507 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:56 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-b[34416]: 2024-03-26T17:11:56.507 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:56 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-b[34416]: -26> 2024-03-26T17:11:56.198+0000 7ff02591c700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-03-26T17:11:56.507 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:56 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-b[34416]: -25> 2024-03-26T17:11:56.198+0000 7ff02591c700 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-03-26T17:11:56.508 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:56 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-b[34416]: -1> 2024-03-26T17:11:56.199+0000 7ff02591c700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2382-gbf9505fb/rpm/el8/BUILD/ceph-19.0.0-2382-gbf9505fb/src/common/config_obs_mgr.h: In function 'ObserverMgr::config_obs_wptr ObserverMgr::remove_observer(ConfigObs*) [with ConfigObs = ceph::md_config_obs_impl; ObserverMgr::config_obs_wptr = std::weak_ptr*>]' thread 7ff02591c700 time 2024-03-26T17:11:56.199375+0000 2024-03-26T17:11:56.508 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:56 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-b[34416]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2382-gbf9505fb/rpm/el8/BUILD/ceph-19.0.0-2382-gbf9505fb/src/common/config_obs_mgr.h: 84: FAILED ceph_assert(found_obs) 2024-03-26T17:11:56.508 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:56 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-b[34416]: 2024-03-26T17:11:56.508 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:56 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-b[34416]: ceph version 19.0.0-2382-gbf9505fb (bf9505fb569e9b95a78f9700ed8c4bd20508ef55) squid (dev) 2024-03-26T17:11:56.508 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:56 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-b[34416]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7ff02dd7d3cd] 2024-03-26T17:11:56.508 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:56 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-b[34416]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2db593) [0x7ff02dd7d593] 2024-03-26T17:11:56.508 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:56 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-b[34416]: 3: (ObserverMgr >::remove_observer(ceph::md_config_obs_impl*)+0x196) [0x560cdfc79166] 2024-03-26T17:11:56.508 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:56 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-b[34416]: 4: (NVMeofGwMon::on_shutdown()+0x72) [0x560cdfd61742] 2024-03-26T17:11:56.508 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:56 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-b[34416]: 5: (Monitor::shutdown()+0x2bc) [0x560cdfc4955c] 2024-03-26T17:11:56.508 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:56 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-b[34416]: 6: (SignalHandler::entry()+0x659) [0x560cdff2e869] 2024-03-26T17:11:56.508 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:56 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-b[34416]: 7: /lib64/libpthread.so.0(+0x81ca) [0x7ff02b5621ca] 2024-03-26T17:11:56.508 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:56 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-b[34416]: 8: clone() 2024-03-26T17:11:56.508 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:56 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-b[34416]: 2024-03-26T17:11:56.508 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:56 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-b[34416]: 0> 2024-03-26T17:11:56.200+0000 7ff02591c700 -1 *** Caught signal (Aborted) ** 2024-03-26T17:11:56.509 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:56 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-b[34416]: in thread 7ff02591c700 thread_name:signal_handler 2024-03-26T17:11:56.509 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:56 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-b[34416]: 2024-03-26T17:11:56.509 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:56 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-b[34416]: ceph version 19.0.0-2382-gbf9505fb (bf9505fb569e9b95a78f9700ed8c4bd20508ef55) squid (dev) 2024-03-26T17:11:56.509 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:56 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-b[34416]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7ff02b56cd20] 2024-03-26T17:11:56.509 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:56 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-b[34416]: 2: gsignal() 2024-03-26T17:11:56.509 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:56 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-b[34416]: 3: abort() 2024-03-26T17:11:56.509 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:56 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-b[34416]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7ff02dd7d427] 2024-03-26T17:11:56.509 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:56 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-b[34416]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2db593) [0x7ff02dd7d593] 2024-03-26T17:11:56.509 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:56 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-b[34416]: 6: (ObserverMgr >::remove_observer(ceph::md_config_obs_impl*)+0x196) [0x560cdfc79166] 2024-03-26T17:11:56.509 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:56 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-b[34416]: 7: (NVMeofGwMon::on_shutdown()+0x72) [0x560cdfd61742] 2024-03-26T17:11:56.509 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:56 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-b[34416]: 8: (Monitor::shutdown()+0x2bc) [0x560cdfc4955c] 2024-03-26T17:11:56.509 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:56 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-b[34416]: 9: (SignalHandler::entry()+0x659) [0x560cdff2e869] 2024-03-26T17:11:56.509 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:56 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-b[34416]: 10: /lib64/libpthread.so.0(+0x81ca) [0x7ff02b5621ca] 2024-03-26T17:11:56.509 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:56 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-b[34416]: 11: clone() 2024-03-26T17:11:56.510 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:56 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-b[34416]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-26T17:11:56.510 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:56 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-b[34416]: 2024-03-26T17:11:56.510 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:56 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-b[34416]: -27> 2024-03-26T17:11:56.198+0000 7ff02591c700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-03-26T17:11:56.510 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:56 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-b[34416]: -26> 2024-03-26T17:11:56.198+0000 7ff02591c700 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-03-26T17:11:56.510 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:56 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-b[34416]: -2> 2024-03-26T17:11:56.199+0000 7ff02591c700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2382-gbf9505fb/rpm/el8/BUILD/ceph-19.0.0-2382-gbf9505fb/src/common/config_obs_mgr.h: In function 'ObserverMgr::config_obs_wptr ObserverMgr::remove_observer(ConfigObs*) [with ConfigObs = ceph::md_config_obs_impl; ObserverMgr::config_obs_wptr = std::weak_ptr*>]' thread 7ff02591c700 time 2024-03-26T17:11:56.199375+0000 2024-03-26T17:11:56.510 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:56 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-b[34416]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2382-gbf9505fb/rpm/el8/BUILD/ceph-19.0.0-2382-gbf9505fb/src/common/config_obs_mgr.h: 84: FAILED ceph_assert(found_obs) 2024-03-26T17:11:56.510 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:56 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-b[34416]: 2024-03-26T17:11:56.510 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:56 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-b[34416]: ceph version 19.0.0-2382-gbf9505fb (bf9505fb569e9b95a78f9700ed8c4bd20508ef55) squid (dev) 2024-03-26T17:11:56.510 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:56 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-b[34416]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7ff02dd7d3cd] 2024-03-26T17:11:56.510 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:56 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-b[34416]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2db593) [0x7ff02dd7d593] 2024-03-26T17:11:56.510 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:56 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-b[34416]: 3: (ObserverMgr >::remove_observer(ceph::md_config_obs_impl*)+0x196) [0x560cdfc79166] 2024-03-26T17:11:56.510 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:56 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-b[34416]: 4: (NVMeofGwMon::on_shutdown()+0x72) [0x560cdfd61742] 2024-03-26T17:11:56.510 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:56 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-b[34416]: 5: (Monitor::shutdown()+0x2bc) [0x560cdfc4955c] 2024-03-26T17:11:56.510 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:56 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-b[34416]: 6: (SignalHandler::entry()+0x659) [0x560cdff2e869] 2024-03-26T17:11:56.511 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:56 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-b[34416]: 7: /lib64/libpthread.so.0(+0x81ca) [0x7ff02b5621ca] 2024-03-26T17:11:56.511 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:56 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-b[34416]: 8: clone() 2024-03-26T17:11:56.511 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:56 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-b[34416]: 2024-03-26T17:11:56.511 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:56 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-b[34416]: -1> 2024-03-26T17:11:56.200+0000 7ff02591c700 -1 *** Caught signal (Aborted) ** 2024-03-26T17:11:56.511 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:56 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-b[34416]: in thread 7ff02591c700 thread_name:signal_handler 2024-03-26T17:11:56.511 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:56 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-b[34416]: 2024-03-26T17:11:56.511 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:56 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-b[34416]: ceph version 19.0.0-2382-gbf9505fb (bf9505fb569e9b95a78f9700ed8c4bd20508ef55) squid (dev) 2024-03-26T17:11:56.511 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:56 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-b[34416]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7ff02b56cd20] 2024-03-26T17:11:56.511 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:56 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-b[34416]: 2: gsignal() 2024-03-26T17:11:56.511 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:56 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-b[34416]: 3: abort() 2024-03-26T17:11:56.511 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:56 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-b[34416]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7ff02dd7d427] 2024-03-26T17:11:56.511 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:56 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-b[34416]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2db593) [0x7ff02dd7d593] 2024-03-26T17:11:56.511 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:56 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-b[34416]: 6: (ObserverMgr >::remove_observer(ceph::md_config_obs_impl*)+0x196) [0x560cdfc79166] 2024-03-26T17:11:56.511 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:56 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-b[34416]: 7: (NVMeofGwMon::on_shutdown()+0x72) [0x560cdfd61742] 2024-03-26T17:11:56.512 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:56 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-b[34416]: 8: (Monitor::shutdown()+0x2bc) [0x560cdfc4955c] 2024-03-26T17:11:56.512 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:56 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-b[34416]: 9: (SignalHandler::entry()+0x659) [0x560cdff2e869] 2024-03-26T17:11:56.512 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:56 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-b[34416]: 10: /lib64/libpthread.so.0(+0x81ca) [0x7ff02b5621ca] 2024-03-26T17:11:56.512 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:56 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-b[34416]: 11: clone() 2024-03-26T17:11:56.512 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:56 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-b[34416]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-26T17:11:56.512 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:56 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-b[34416]: 2024-03-26T17:11:56.512 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:56 smithi064 podman[58162]: 2024-03-26 17:11:56.239733249 +0000 UTC m=+0.166901016 container died 615ecaad5c112654f68dec6eb1e2d4ce1e7f4be2830e3e305b0e8fa5a9991a88 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:01ae7457193b3f46a870db683661dbc281d60ce54f0968f4de09bc4e5ad0a734, name=ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-b, RELEASE=ceph-nvmeof-mon-bf9505f, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240319, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, io.buildah.version=1.33.5, ceph=True) 2024-03-26T17:11:56.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:11:56 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:11:56] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:11:56.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:11:56 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:11:56] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:11:56.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:11:56 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:11:56.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 2024-03-26T17:11:56.248+0000 7fa707a55700 -1 mon.c@1(peon) e3 get_health_metrics reporting 3 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T17:11:56.647 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:11:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:11:56] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:11:56.647 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:11:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:11:56] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:11:56.647 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:11:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:11:56.805 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:56 smithi064 podman[58162]: 2024-03-26 17:11:56.724621164 +0000 UTC m=+0.651788977 container cleanup 615ecaad5c112654f68dec6eb1e2d4ce1e7f4be2830e3e305b0e8fa5a9991a88 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:01ae7457193b3f46a870db683661dbc281d60ce54f0968f4de09bc4e5ad0a734, name=ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-b, RELEASE=ceph-nvmeof-mon-bf9505f, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240319, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-03-26T17:11:56.805 INFO:journalctl@ceph.mon.b.smithi064.stdout:Mar 26 17:11:56 smithi064 bash[58162]: ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-b 2024-03-26T17:11:57.153 DEBUG:teuthology.orchestra.run.smithi064:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4394d798-eb90-11ee-95d0-87774f69a715@mon.b.service' 2024-03-26T17:11:57.192 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-26T17:11:57.192 INFO:tasks.cephadm.mon.c:Stopped mon.b 2024-03-26T17:11:57.192 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2024-03-26T17:11:57.192 DEBUG:teuthology.orchestra.run.smithi149:> sudo systemctl stop ceph-4394d798-eb90-11ee-95d0-87774f69a715@mon.c 2024-03-26T17:11:57.646 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:57 smithi149 systemd[1]: Stopping Ceph mon.c for 4394d798-eb90-11ee-95d0-87774f69a715... 2024-03-26T17:11:57.988 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 2024-03-26T17:11:57.662+0000 7fa70aa5b700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-03-26T17:11:57.988 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 2024-03-26T17:11:57.663+0000 7fa70aa5b700 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-03-26T17:11:57.989 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2382-gbf9505fb/rpm/el8/BUILD/ceph-19.0.0-2382-gbf9505fb/src/common/config_obs_mgr.h: In function 'ObserverMgr::config_obs_wptr ObserverMgr::remove_observer(ConfigObs*) [with ConfigObs = ceph::md_config_obs_impl; ObserverMgr::config_obs_wptr = std::weak_ptr*>]' thread 7fa70aa5b700 time 2024-03-26T17:11:57.664123+0000 2024-03-26T17:11:57.989 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2382-gbf9505fb/rpm/el8/BUILD/ceph-19.0.0-2382-gbf9505fb/src/common/config_obs_mgr.h: 84: FAILED ceph_assert(found_obs) 2024-03-26T17:11:57.989 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: ceph version 19.0.0-2382-gbf9505fb (bf9505fb569e9b95a78f9700ed8c4bd20508ef55) squid (dev) 2024-03-26T17:11:57.989 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fa712ebc3cd] 2024-03-26T17:11:57.989 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2db593) [0x7fa712ebc593] 2024-03-26T17:11:57.989 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 3: (ObserverMgr >::remove_observer(ceph::md_config_obs_impl*)+0x196) [0x562e6b770166] 2024-03-26T17:11:57.989 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 4: (NVMeofGwMon::on_shutdown()+0x72) [0x562e6b858742] 2024-03-26T17:11:57.989 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 5: (Monitor::shutdown()+0x2bc) [0x562e6b74055c] 2024-03-26T17:11:57.989 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 6: (SignalHandler::entry()+0x659) [0x562e6ba25869] 2024-03-26T17:11:57.989 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 7: /lib64/libpthread.so.0(+0x81ca) [0x7fa7106a11ca] 2024-03-26T17:11:57.989 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 8: clone() 2024-03-26T17:11:57.989 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 2024-03-26T17:11:57.664+0000 7fa70aa5b700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2382-gbf9505fb/rpm/el8/BUILD/ceph-19.0.0-2382-gbf9505fb/src/common/config_obs_mgr.h: In function 'ObserverMgr::config_obs_wptr ObserverMgr::remove_observer(ConfigObs*) [with ConfigObs = ceph::md_config_obs_impl; ObserverMgr::config_obs_wptr = std::weak_ptr*>]' thread 7fa70aa5b700 time 2024-03-26T17:11:57.664123+0000 2024-03-26T17:11:57.990 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2382-gbf9505fb/rpm/el8/BUILD/ceph-19.0.0-2382-gbf9505fb/src/common/config_obs_mgr.h: 84: FAILED ceph_assert(found_obs) 2024-03-26T17:11:57.990 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 2024-03-26T17:11:57.990 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: ceph version 19.0.0-2382-gbf9505fb (bf9505fb569e9b95a78f9700ed8c4bd20508ef55) squid (dev) 2024-03-26T17:11:57.990 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fa712ebc3cd] 2024-03-26T17:11:57.990 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2db593) [0x7fa712ebc593] 2024-03-26T17:11:57.991 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 3: (ObserverMgr >::remove_observer(ceph::md_config_obs_impl*)+0x196) [0x562e6b770166] 2024-03-26T17:11:57.991 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 4: (NVMeofGwMon::on_shutdown()+0x72) [0x562e6b858742] 2024-03-26T17:11:57.991 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 5: (Monitor::shutdown()+0x2bc) [0x562e6b74055c] 2024-03-26T17:11:57.991 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 6: (SignalHandler::entry()+0x659) [0x562e6ba25869] 2024-03-26T17:11:57.991 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 7: /lib64/libpthread.so.0(+0x81ca) [0x7fa7106a11ca] 2024-03-26T17:11:57.991 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 8: clone() 2024-03-26T17:11:57.991 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 2024-03-26T17:11:57.991 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: *** Caught signal (Aborted) ** 2024-03-26T17:11:57.991 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: in thread 7fa70aa5b700 thread_name:signal_handler 2024-03-26T17:11:57.991 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: ceph version 19.0.0-2382-gbf9505fb (bf9505fb569e9b95a78f9700ed8c4bd20508ef55) squid (dev) 2024-03-26T17:11:57.991 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7fa7106abd20] 2024-03-26T17:11:57.991 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 2: gsignal() 2024-03-26T17:11:57.991 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 3: abort() 2024-03-26T17:11:57.991 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fa712ebc427] 2024-03-26T17:11:57.992 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2db593) [0x7fa712ebc593] 2024-03-26T17:11:57.992 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 6: (ObserverMgr >::remove_observer(ceph::md_config_obs_impl*)+0x196) [0x562e6b770166] 2024-03-26T17:11:57.992 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 7: (NVMeofGwMon::on_shutdown()+0x72) [0x562e6b858742] 2024-03-26T17:11:57.992 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 8: (Monitor::shutdown()+0x2bc) [0x562e6b74055c] 2024-03-26T17:11:57.992 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 9: (SignalHandler::entry()+0x659) [0x562e6ba25869] 2024-03-26T17:11:57.992 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 10: /lib64/libpthread.so.0(+0x81ca) [0x7fa7106a11ca] 2024-03-26T17:11:57.992 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 11: clone() 2024-03-26T17:11:57.992 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 2024-03-26T17:11:57.685+0000 7fa70aa5b700 -1 *** Caught signal (Aborted) ** 2024-03-26T17:11:57.992 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: in thread 7fa70aa5b700 thread_name:signal_handler 2024-03-26T17:11:57.992 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 2024-03-26T17:11:57.992 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: ceph version 19.0.0-2382-gbf9505fb (bf9505fb569e9b95a78f9700ed8c4bd20508ef55) squid (dev) 2024-03-26T17:11:57.992 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7fa7106abd20] 2024-03-26T17:11:57.992 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 2: gsignal() 2024-03-26T17:11:57.992 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 3: abort() 2024-03-26T17:11:57.992 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fa712ebc427] 2024-03-26T17:11:57.993 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2db593) [0x7fa712ebc593] 2024-03-26T17:11:57.993 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 6: (ObserverMgr >::remove_observer(ceph::md_config_obs_impl*)+0x196) [0x562e6b770166] 2024-03-26T17:11:57.993 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 7: (NVMeofGwMon::on_shutdown()+0x72) [0x562e6b858742] 2024-03-26T17:11:57.993 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 8: (Monitor::shutdown()+0x2bc) [0x562e6b74055c] 2024-03-26T17:11:57.993 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 9: (SignalHandler::entry()+0x659) [0x562e6ba25869] 2024-03-26T17:11:57.993 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 10: /lib64/libpthread.so.0(+0x81ca) [0x7fa7106a11ca] 2024-03-26T17:11:57.993 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 11: clone() 2024-03-26T17:11:57.993 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-26T17:11:57.993 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 2024-03-26T17:11:57.993 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: -9426> 2024-03-26T17:11:11.245+0000 7fa707a55700 -1 mon.c@1(peon) e3 get_health_metrics reporting 3 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T17:11:57.993 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: -8508> 2024-03-26T17:11:16.245+0000 7fa707a55700 -1 mon.c@1(peon) e3 get_health_metrics reporting 3 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T17:11:57.993 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: -7594> 2024-03-26T17:11:21.246+0000 7fa707a55700 -1 mon.c@1(peon) e3 get_health_metrics reporting 3 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T17:11:57.993 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: -6568> 2024-03-26T17:11:26.246+0000 7fa707a55700 -1 mon.c@1(peon) e3 get_health_metrics reporting 3 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T17:11:57.994 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: -5680> 2024-03-26T17:11:31.245+0000 7fa707a55700 -1 mon.c@1(peon) e3 get_health_metrics reporting 3 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T17:11:57.994 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: -4787> 2024-03-26T17:11:36.247+0000 7fa707a55700 -1 mon.c@1(peon) e3 get_health_metrics reporting 3 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T17:11:57.994 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: -3874> 2024-03-26T17:11:41.247+0000 7fa707a55700 -1 mon.c@1(peon) e3 get_health_metrics reporting 3 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T17:11:57.994 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: -2981> 2024-03-26T17:11:46.247+0000 7fa707a55700 -1 mon.c@1(peon) e3 get_health_metrics reporting 3 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T17:11:57.994 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: -1971> 2024-03-26T17:11:51.247+0000 7fa707a55700 -1 mon.c@1(peon) e3 get_health_metrics reporting 3 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T17:11:57.994 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: -98> 2024-03-26T17:11:56.248+0000 7fa707a55700 -1 mon.c@1(peon) e3 get_health_metrics reporting 3 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T17:11:57.994 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: -26> 2024-03-26T17:11:57.662+0000 7fa70aa5b700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-03-26T17:11:57.994 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: -25> 2024-03-26T17:11:57.663+0000 7fa70aa5b700 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-03-26T17:11:57.994 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: -1> 2024-03-26T17:11:57.664+0000 7fa70aa5b700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2382-gbf9505fb/rpm/el8/BUILD/ceph-19.0.0-2382-gbf9505fb/src/common/config_obs_mgr.h: In function 'ObserverMgr::config_obs_wptr ObserverMgr::remove_observer(ConfigObs*) [with ConfigObs = ceph::md_config_obs_impl; ObserverMgr::config_obs_wptr = std::weak_ptr*>]' thread 7fa70aa5b700 time 2024-03-26T17:11:57.664123+0000 2024-03-26T17:11:57.994 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2382-gbf9505fb/rpm/el8/BUILD/ceph-19.0.0-2382-gbf9505fb/src/common/config_obs_mgr.h: 84: FAILED ceph_assert(found_obs) 2024-03-26T17:11:57.994 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 2024-03-26T17:11:57.994 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: ceph version 19.0.0-2382-gbf9505fb (bf9505fb569e9b95a78f9700ed8c4bd20508ef55) squid (dev) 2024-03-26T17:11:57.994 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fa712ebc3cd] 2024-03-26T17:11:57.995 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2db593) [0x7fa712ebc593] 2024-03-26T17:11:57.995 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 3: (ObserverMgr >::remove_observer(ceph::md_config_obs_impl*)+0x196) [0x562e6b770166] 2024-03-26T17:11:57.995 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 4: (NVMeofGwMon::on_shutdown()+0x72) [0x562e6b858742] 2024-03-26T17:11:57.995 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 5: (Monitor::shutdown()+0x2bc) [0x562e6b74055c] 2024-03-26T17:11:57.995 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 6: (SignalHandler::entry()+0x659) [0x562e6ba25869] 2024-03-26T17:11:57.995 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 7: /lib64/libpthread.so.0(+0x81ca) [0x7fa7106a11ca] 2024-03-26T17:11:57.995 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 8: clone() 2024-03-26T17:11:57.995 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 2024-03-26T17:11:57.995 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 0> 2024-03-26T17:11:57.685+0000 7fa70aa5b700 -1 *** Caught signal (Aborted) ** 2024-03-26T17:11:57.995 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: in thread 7fa70aa5b700 thread_name:signal_handler 2024-03-26T17:11:57.995 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 2024-03-26T17:11:57.995 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: ceph version 19.0.0-2382-gbf9505fb (bf9505fb569e9b95a78f9700ed8c4bd20508ef55) squid (dev) 2024-03-26T17:11:57.995 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7fa7106abd20] 2024-03-26T17:11:57.995 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 2: gsignal() 2024-03-26T17:11:57.996 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 3: abort() 2024-03-26T17:11:57.996 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fa712ebc427] 2024-03-26T17:11:57.996 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2db593) [0x7fa712ebc593] 2024-03-26T17:11:57.996 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 6: (ObserverMgr >::remove_observer(ceph::md_config_obs_impl*)+0x196) [0x562e6b770166] 2024-03-26T17:11:57.996 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 7: (NVMeofGwMon::on_shutdown()+0x72) [0x562e6b858742] 2024-03-26T17:11:57.996 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 8: (Monitor::shutdown()+0x2bc) [0x562e6b74055c] 2024-03-26T17:11:57.996 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 9: (SignalHandler::entry()+0x659) [0x562e6ba25869] 2024-03-26T17:11:57.996 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 10: /lib64/libpthread.so.0(+0x81ca) [0x7fa7106a11ca] 2024-03-26T17:11:57.996 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 11: clone() 2024-03-26T17:11:57.996 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-26T17:11:57.996 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 2024-03-26T17:11:57.996 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: -9426> 2024-03-26T17:11:11.245+0000 7fa707a55700 -1 mon.c@1(peon) e3 get_health_metrics reporting 3 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T17:11:57.996 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: -8508> 2024-03-26T17:11:16.245+0000 7fa707a55700 -1 mon.c@1(peon) e3 get_health_metrics reporting 3 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T17:11:57.996 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: -7594> 2024-03-26T17:11:21.246+0000 7fa707a55700 -1 mon.c@1(peon) e3 get_health_metrics reporting 3 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T17:11:57.997 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: -6568> 2024-03-26T17:11:26.246+0000 7fa707a55700 -1 mon.c@1(peon) e3 get_health_metrics reporting 3 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T17:11:57.997 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: -5680> 2024-03-26T17:11:31.245+0000 7fa707a55700 -1 mon.c@1(peon) e3 get_health_metrics reporting 3 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T17:11:57.997 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: -4787> 2024-03-26T17:11:36.247+0000 7fa707a55700 -1 mon.c@1(peon) e3 get_health_metrics reporting 3 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T17:11:57.997 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: -3874> 2024-03-26T17:11:41.247+0000 7fa707a55700 -1 mon.c@1(peon) e3 get_health_metrics reporting 3 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T17:11:57.997 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: -2981> 2024-03-26T17:11:46.247+0000 7fa707a55700 -1 mon.c@1(peon) e3 get_health_metrics reporting 3 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T17:11:57.997 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: -1971> 2024-03-26T17:11:51.247+0000 7fa707a55700 -1 mon.c@1(peon) e3 get_health_metrics reporting 3 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T17:11:57.997 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: -98> 2024-03-26T17:11:56.248+0000 7fa707a55700 -1 mon.c@1(peon) e3 get_health_metrics reporting 3 slow ops, oldest is nvmeofgwbeacon magic: 0 2024-03-26T17:11:57.998 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: -26> 2024-03-26T17:11:57.662+0000 7fa70aa5b700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-03-26T17:11:57.998 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: -25> 2024-03-26T17:11:57.663+0000 7fa70aa5b700 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-03-26T17:11:57.998 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: -1> 2024-03-26T17:11:57.664+0000 7fa70aa5b700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2382-gbf9505fb/rpm/el8/BUILD/ceph-19.0.0-2382-gbf9505fb/src/common/config_obs_mgr.h: In function 'ObserverMgr::config_obs_wptr ObserverMgr::remove_observer(ConfigObs*) [with ConfigObs = ceph::md_config_obs_impl; ObserverMgr::config_obs_wptr = std::weak_ptr*>]' thread 7fa70aa5b700 time 2024-03-26T17:11:57.664123+0000 2024-03-26T17:11:57.998 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-2382-gbf9505fb/rpm/el8/BUILD/ceph-19.0.0-2382-gbf9505fb/src/common/config_obs_mgr.h: 84: FAILED ceph_assert(found_obs) 2024-03-26T17:11:57.998 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 2024-03-26T17:11:57.998 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: ceph version 19.0.0-2382-gbf9505fb (bf9505fb569e9b95a78f9700ed8c4bd20508ef55) squid (dev) 2024-03-26T17:11:57.998 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fa712ebc3cd] 2024-03-26T17:11:57.998 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2db593) [0x7fa712ebc593] 2024-03-26T17:11:57.999 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 3: (ObserverMgr >::remove_observer(ceph::md_config_obs_impl*)+0x196) [0x562e6b770166] 2024-03-26T17:11:57.999 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 4: (NVMeofGwMon::on_shutdown()+0x72) [0x562e6b858742] 2024-03-26T17:11:57.999 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 5: (Monitor::shutdown()+0x2bc) [0x562e6b74055c] 2024-03-26T17:11:57.999 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 6: (SignalHandler::entry()+0x659) [0x562e6ba25869] 2024-03-26T17:11:57.999 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 7: /lib64/libpthread.so.0(+0x81ca) [0x7fa7106a11ca] 2024-03-26T17:11:57.999 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 8: clone() 2024-03-26T17:11:57.999 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 2024-03-26T17:11:57.999 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 0> 2024-03-26T17:11:57.685+0000 7fa70aa5b700 -1 *** Caught signal (Aborted) ** 2024-03-26T17:11:57.999 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: in thread 7fa70aa5b700 thread_name:signal_handler 2024-03-26T17:11:57.999 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 2024-03-26T17:11:57.999 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: ceph version 19.0.0-2382-gbf9505fb (bf9505fb569e9b95a78f9700ed8c4bd20508ef55) squid (dev) 2024-03-26T17:11:57.999 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7fa7106abd20] 2024-03-26T17:11:57.999 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 2: gsignal() 2024-03-26T17:11:57.999 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 3: abort() 2024-03-26T17:11:57.999 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fa712ebc427] 2024-03-26T17:11:58.000 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2db593) [0x7fa712ebc593] 2024-03-26T17:11:58.000 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 6: (ObserverMgr >::remove_observer(ceph::md_config_obs_impl*)+0x196) [0x562e6b770166] 2024-03-26T17:11:58.000 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 7: (NVMeofGwMon::on_shutdown()+0x72) [0x562e6b858742] 2024-03-26T17:11:58.000 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 8: (Monitor::shutdown()+0x2bc) [0x562e6b74055c] 2024-03-26T17:11:58.000 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 9: (SignalHandler::entry()+0x659) [0x562e6ba25869] 2024-03-26T17:11:58.000 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 10: /lib64/libpthread.so.0(+0x81ca) [0x7fa7106a11ca] 2024-03-26T17:11:58.000 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 11: clone() 2024-03-26T17:11:58.000 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-26T17:11:58.000 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c[34672]: 2024-03-26T17:11:58.000 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:57 smithi149 podman[60258]: 2024-03-26 17:11:57.724670193 +0000 UTC m=+0.198726143 container died b3ca6d321ad12af1f8bcf05a6f2e49657f2b7d2f528f5ada141a03de8d7dbbad (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:01ae7457193b3f46a870db683661dbc281d60ce54f0968f4de09bc4e5ad0a734, name=ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, RELEASE=ceph-nvmeof-mon-bf9505f, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240319, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-03-26T17:11:58.388 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:58 smithi149 podman[60258]: 2024-03-26 17:11:58.162144828 +0000 UTC m=+0.636200781 container cleanup b3ca6d321ad12af1f8bcf05a6f2e49657f2b7d2f528f5ada141a03de8d7dbbad (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:01ae7457193b3f46a870db683661dbc281d60ce54f0968f4de09bc4e5ad0a734, name=ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240319, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=ceph-nvmeof-mon-bf9505f, io.buildah.version=1.33.5) 2024-03-26T17:11:58.388 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:58 smithi149 bash[60258]: ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c 2024-03-26T17:11:58.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:11:58 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:11:58] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:11:58.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:11:58 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:11:58] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:11:58.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:11:58 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:11:58.639 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:58 smithi149 podman[60270]: 2024-03-26 17:11:58.405219764 +0000 UTC m=+0.674435344 container remove b3ca6d321ad12af1f8bcf05a6f2e49657f2b7d2f528f5ada141a03de8d7dbbad (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:01ae7457193b3f46a870db683661dbc281d60ce54f0968f4de09bc4e5ad0a734, name=ceph-4394d798-eb90-11ee-95d0-87774f69a715-mon-c, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240319, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=ceph-nvmeof-mon-bf9505f) 2024-03-26T17:11:58.639 INFO:journalctl@ceph.mon.c.smithi149.stdout:Mar 26 17:11:58 smithi149 systemd[1]: ceph-4394d798-eb90-11ee-95d0-87774f69a715@mon.c.service: Main process exited, code=exited, status=134/n/a 2024-03-26T17:11:58.640 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:11:58 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:11:58] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:11:58.640 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:11:58 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:11:58] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:11:58.640 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:11:58 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:11:58.642 DEBUG:teuthology.orchestra.run.smithi149:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4394d798-eb90-11ee-95d0-87774f69a715@mon.c.service' 2024-03-26T17:11:58.698 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-26T17:11:58.698 INFO:tasks.cephadm.mon.c:Stopped mon.c 2024-03-26T17:11:58.698 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-03-26T17:11:58.698 DEBUG:teuthology.orchestra.run.smithi044:> sudo systemctl stop ceph-4394d798-eb90-11ee-95d0-87774f69a715@mgr.x 2024-03-26T17:11:59.015 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Mar 26 17:11:58 smithi044 systemd[1]: Stopping Ceph mgr.x for 4394d798-eb90-11ee-95d0-87774f69a715... 2024-03-26T17:11:59.431 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Mar 26 17:11:59 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-mgr-x[30858]: 2024-03-26T17:11:59.029+0000 7f4040cdc700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-26T17:11:59.431 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Mar 26 17:11:59 smithi044 podman[75058]: 2024-03-26 17:11:59.061189446 +0000 UTC m=+0.157217450 container died f79a52394b04b43ce91387a88757f723f93cea89c04d754612bff04569d8a169 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bf9505fb569e9b95a78f9700ed8c4bd20508ef55, name=ceph-4394d798-eb90-11ee-95d0-87774f69a715-mgr-x, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=ceph-nvmeof-mon-bf9505f, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240319, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_CLEAN=True, io.buildah.version=1.33.5) 2024-03-26T17:11:59.765 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Mar 26 17:11:59 smithi044 podman[75058]: 2024-03-26 17:11:59.513400982 +0000 UTC m=+0.609428969 container cleanup f79a52394b04b43ce91387a88757f723f93cea89c04d754612bff04569d8a169 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bf9505fb569e9b95a78f9700ed8c4bd20508ef55, name=ceph-4394d798-eb90-11ee-95d0-87774f69a715-mgr-x, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240319, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, RELEASE=ceph-nvmeof-mon-bf9505f, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, maintainer=Guillaume Abrioux ) 2024-03-26T17:11:59.765 INFO:journalctl@ceph.mgr.x.smithi044.stdout:Mar 26 17:11:59 smithi044 bash[75058]: ceph-4394d798-eb90-11ee-95d0-87774f69a715-mgr-x 2024-03-26T17:11:59.935 DEBUG:teuthology.orchestra.run.smithi044:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4394d798-eb90-11ee-95d0-87774f69a715@mgr.x.service' 2024-03-26T17:11:59.971 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-26T17:11:59.971 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-03-26T17:11:59.971 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-03-26T17:11:59.971 DEBUG:teuthology.orchestra.run.smithi044:> sudo systemctl stop ceph-4394d798-eb90-11ee-95d0-87774f69a715@osd.0 2024-03-26T17:12:00.218 INFO:journalctl@ceph.osd.0.smithi044.stdout:Mar 26 17:12:00 smithi044 systemd[1]: Stopping Ceph osd.0 for 4394d798-eb90-11ee-95d0-87774f69a715... 2024-03-26T17:12:00.515 INFO:journalctl@ceph.osd.0.smithi044.stdout:Mar 26 17:12:00 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-0[45343]: 2024-03-26T17:12:00.400+0000 7ffa35a3a700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-26T17:12:00.515 INFO:journalctl@ceph.osd.0.smithi044.stdout:Mar 26 17:12:00 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-0[45343]: 2024-03-26T17:12:00.400+0000 7ffa35a3a700 -1 osd.0 80 *** Got signal Terminated *** 2024-03-26T17:12:00.515 INFO:journalctl@ceph.osd.0.smithi044.stdout:Mar 26 17:12:00 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-0[45343]: 2024-03-26T17:12:00.400+0000 7ffa35a3a700 -1 osd.0 80 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-26T17:12:00.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:12:00 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:12:00] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:12:00.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:12:00 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:12:00] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:12:00.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:12:00 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:12:00.897 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:12:00 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:12:00] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:12:00.897 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:12:00 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:12:00] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:12:00.897 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:12:00 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:12:02.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:12:02 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:12:02] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:12:02.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:12:02 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:12:02] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:12:02.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:12:02 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:12:02.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:12:02 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:12:02] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:12:02.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:12:02 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:12:02] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:12:02.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:12:02 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:12:04.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:12:04 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:12:04] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:12:04.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:12:04 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:12:04] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:12:04.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:12:04 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:12:04.897 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:12:04 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:12:04] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:12:04.897 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:12:04 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:12:04] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:12:04.897 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:12:04 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:12:06.194 INFO:journalctl@ceph.osd.0.smithi044.stdout:Mar 26 17:12:05 smithi044 podman[75181]: 2024-03-26 17:12:05.930075989 +0000 UTC m=+5.736285093 container died e723e35691bcaad598be1891a9d763e4e784f3adef2077067978da7654d20326 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:01ae7457193b3f46a870db683661dbc281d60ce54f0968f4de09bc4e5ad0a734, name=ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=ceph-nvmeof-mon-bf9505f, GIT_CLEAN=True, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.build-date=20240319) 2024-03-26T17:12:06.515 INFO:journalctl@ceph.osd.0.smithi044.stdout:Mar 26 17:12:06 smithi044 podman[75181]: 2024-03-26 17:12:06.292837084 +0000 UTC m=+6.099046188 container cleanup e723e35691bcaad598be1891a9d763e4e784f3adef2077067978da7654d20326 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:01ae7457193b3f46a870db683661dbc281d60ce54f0968f4de09bc4e5ad0a734, name=ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=ceph-nvmeof-mon-bf9505f, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240319, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux ) 2024-03-26T17:12:06.515 INFO:journalctl@ceph.osd.0.smithi044.stdout:Mar 26 17:12:06 smithi044 bash[75181]: ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-0 2024-03-26T17:12:06.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:12:06 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:12:06] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:12:06.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:12:06 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:12:06] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:12:06.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:12:06 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:12:06.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:12:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:12:06] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:12:06.897 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:12:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:12:06] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:12:06.897 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:12:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:12:06.903 INFO:journalctl@ceph.osd.0.smithi044.stdout:Mar 26 17:12:06 smithi044 podman[75209]: 2024-03-26 17:12:06.586081685 +0000 UTC m=+0.660885129 container remove e723e35691bcaad598be1891a9d763e4e784f3adef2077067978da7654d20326 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:01ae7457193b3f46a870db683661dbc281d60ce54f0968f4de09bc4e5ad0a734, name=ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-0, org.label-schema.license=GPLv2, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.build-date=20240319, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=ceph-nvmeof-mon-bf9505f) 2024-03-26T17:12:07.265 INFO:journalctl@ceph.osd.0.smithi044.stdout:Mar 26 17:12:06 smithi044 podman[75305]: 2024-03-26 17:12:06.903583763 +0000 UTC m=+0.107598849 container create 7964182dba544f0abc8845b55222c3a3905f5b697cd4912f753cd984c49bf548 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:01ae7457193b3f46a870db683661dbc281d60ce54f0968f4de09bc4e5ad0a734, name=ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-0-deactivate, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, RELEASE=ceph-nvmeof-mon-bf9505f, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.build-date=20240319, GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-03-26T17:12:07.266 INFO:journalctl@ceph.osd.0.smithi044.stdout:Mar 26 17:12:06 smithi044 podman[75305]: 2024-03-26 17:12:06.813974205 +0000 UTC m=+0.017989301 image pull 5795ddf102746261652aa1cd1f517ace4dcfb8739ebbf229aeb81830d793ada0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:01ae7457193b3f46a870db683661dbc281d60ce54f0968f4de09bc4e5ad0a734 2024-03-26T17:12:07.266 INFO:journalctl@ceph.osd.0.smithi044.stdout:Mar 26 17:12:07 smithi044 podman[75305]: 2024-03-26 17:12:07.147894237 +0000 UTC m=+0.351909320 container init 7964182dba544f0abc8845b55222c3a3905f5b697cd4912f753cd984c49bf548 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:01ae7457193b3f46a870db683661dbc281d60ce54f0968f4de09bc4e5ad0a734, name=ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-0-deactivate, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, ceph=True, RELEASE=ceph-nvmeof-mon-bf9505f, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240319, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30) 2024-03-26T17:12:07.266 INFO:journalctl@ceph.osd.0.smithi044.stdout:Mar 26 17:12:07 smithi044 podman[75305]: 2024-03-26 17:12:07.152056573 +0000 UTC m=+0.356071670 container start 7964182dba544f0abc8845b55222c3a3905f5b697cd4912f753cd984c49bf548 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:01ae7457193b3f46a870db683661dbc281d60ce54f0968f4de09bc4e5ad0a734, name=ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-0-deactivate, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.build-date=20240319, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=ceph-nvmeof-mon-bf9505f) 2024-03-26T17:12:07.735 INFO:journalctl@ceph.osd.0.smithi044.stdout:Mar 26 17:12:07 smithi044 podman[75305]: 2024-03-26 17:12:07.381557319 +0000 UTC m=+0.585572412 container attach 7964182dba544f0abc8845b55222c3a3905f5b697cd4912f753cd984c49bf548 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:01ae7457193b3f46a870db683661dbc281d60ce54f0968f4de09bc4e5ad0a734, name=ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-0-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240319, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=ceph-nvmeof-mon-bf9505f, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True) 2024-03-26T17:12:07.735 INFO:journalctl@ceph.osd.0.smithi044.stdout:Mar 26 17:12:07 smithi044 podman[75305]: 2024-03-26 17:12:07.458812334 +0000 UTC m=+0.662827418 container died 7964182dba544f0abc8845b55222c3a3905f5b697cd4912f753cd984c49bf548 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:01ae7457193b3f46a870db683661dbc281d60ce54f0968f4de09bc4e5ad0a734, name=ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-0-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, ceph=True, org.label-schema.license=GPLv2, RELEASE=ceph-nvmeof-mon-bf9505f, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240319, GIT_BRANCH=HEAD, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0) 2024-03-26T17:12:08.004 DEBUG:teuthology.orchestra.run.smithi044:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4394d798-eb90-11ee-95d0-87774f69a715@osd.0.service' 2024-03-26T17:12:08.045 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-26T17:12:08.045 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-03-26T17:12:08.045 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-03-26T17:12:08.046 DEBUG:teuthology.orchestra.run.smithi044:> sudo systemctl stop ceph-4394d798-eb90-11ee-95d0-87774f69a715@osd.1 2024-03-26T17:12:08.265 INFO:journalctl@ceph.osd.1.smithi044.stdout:Mar 26 17:12:08 smithi044 systemd[1]: Stopping Ceph osd.1 for 4394d798-eb90-11ee-95d0-87774f69a715... 2024-03-26T17:12:08.765 INFO:journalctl@ceph.osd.1.smithi044.stdout:Mar 26 17:12:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-1[50862]: 2024-03-26T17:12:08.379+0000 7f2366ef0700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-26T17:12:08.765 INFO:journalctl@ceph.osd.1.smithi044.stdout:Mar 26 17:12:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-1[50862]: 2024-03-26T17:12:08.379+0000 7f2366ef0700 -1 osd.1 80 *** Got signal Terminated *** 2024-03-26T17:12:08.765 INFO:journalctl@ceph.osd.1.smithi044.stdout:Mar 26 17:12:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-1[50862]: 2024-03-26T17:12:08.379+0000 7f2366ef0700 -1 osd.1 80 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-26T17:12:08.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:12:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:12:08] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:12:08.766 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:12:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:12:08] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:12:08.766 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:12:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:12:08.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:12:08 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:12:08] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:12:08.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:12:08 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:12:08] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:12:08.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:12:08 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:12:10.668 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:12:10 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:12:10] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:12:10.668 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:12:10 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:12:10] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:12:10.668 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:12:10 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:12:10.798 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:12:10 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:12:10] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:12:10.798 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:12:10 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:12:10] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:12:10.798 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:12:10 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:12:12.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:12:12 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:12:12] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:12:12.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:12:12 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:12:12] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:12:12.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:12:12 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:12:12.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:12:12 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:12:12] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:12:12.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:12:12 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:12:12] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:12:12.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:12:12 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:12:14.223 INFO:journalctl@ceph.osd.1.smithi044.stdout:Mar 26 17:12:13 smithi044 podman[75415]: 2024-03-26 17:12:13.955084889 +0000 UTC m=+5.661464197 container died d584602f10304ccd592137265d787c6621fa0f4b8a0d26cf12177565db1b4503 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:01ae7457193b3f46a870db683661dbc281d60ce54f0968f4de09bc4e5ad0a734, name=ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-1, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240319, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=ceph-nvmeof-mon-bf9505f, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30) 2024-03-26T17:12:14.515 INFO:journalctl@ceph.osd.1.smithi044.stdout:Mar 26 17:12:14 smithi044 podman[75415]: 2024-03-26 17:12:14.313649436 +0000 UTC m=+6.020028759 container cleanup d584602f10304ccd592137265d787c6621fa0f4b8a0d26cf12177565db1b4503 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:01ae7457193b3f46a870db683661dbc281d60ce54f0968f4de09bc4e5ad0a734, name=ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-1, org.label-schema.build-date=20240319, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=ceph-nvmeof-mon-bf9505f, maintainer=Guillaume Abrioux , GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-03-26T17:12:14.515 INFO:journalctl@ceph.osd.1.smithi044.stdout:Mar 26 17:12:14 smithi044 bash[75415]: ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-1 2024-03-26T17:12:14.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:12:14 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:12:14] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:12:14.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:12:14 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:12:14] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:12:14.516 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:12:14 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:12:14.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:12:14 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:12:14] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:12:14.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:12:14 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:12:14] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:12:14.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:12:14 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:12:14.925 INFO:journalctl@ceph.osd.1.smithi044.stdout:Mar 26 17:12:14 smithi044 podman[75441]: 2024-03-26 17:12:14.606576956 +0000 UTC m=+0.649265195 container remove d584602f10304ccd592137265d787c6621fa0f4b8a0d26cf12177565db1b4503 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:01ae7457193b3f46a870db683661dbc281d60ce54f0968f4de09bc4e5ad0a734, name=ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-1, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, RELEASE=ceph-nvmeof-mon-bf9505f, ceph=True, org.label-schema.build-date=20240319, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.license=GPLv2) 2024-03-26T17:12:15.201 INFO:journalctl@ceph.osd.1.smithi044.stdout:Mar 26 17:12:14 smithi044 podman[75531]: 2024-03-26 17:12:14.828886828 +0000 UTC m=+0.018956719 image pull 5795ddf102746261652aa1cd1f517ace4dcfb8739ebbf229aeb81830d793ada0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:01ae7457193b3f46a870db683661dbc281d60ce54f0968f4de09bc4e5ad0a734 2024-03-26T17:12:15.206 INFO:journalctl@ceph.osd.1.smithi044.stdout:Mar 26 17:12:14 smithi044 podman[75531]: 2024-03-26 17:12:14.932419237 +0000 UTC m=+0.122489115 container create 113fd231fadba511248510d0d42c42eab223fa9c2810ebaa4f84b80ba5b9cd49 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:01ae7457193b3f46a870db683661dbc281d60ce54f0968f4de09bc4e5ad0a734, name=ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-1-deactivate, io.buildah.version=1.33.5, ceph=True, org.label-schema.schema-version=1.0, RELEASE=ceph-nvmeof-mon-bf9505f, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240319, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, maintainer=Guillaume Abrioux ) 2024-03-26T17:12:15.206 INFO:journalctl@ceph.osd.1.smithi044.stdout:Mar 26 17:12:15 smithi044 podman[75531]: 2024-03-26 17:12:15.12631447 +0000 UTC m=+0.316384351 container init 113fd231fadba511248510d0d42c42eab223fa9c2810ebaa4f84b80ba5b9cd49 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:01ae7457193b3f46a870db683661dbc281d60ce54f0968f4de09bc4e5ad0a734, name=ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-1-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240319, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=ceph-nvmeof-mon-bf9505f, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, io.buildah.version=1.33.5) 2024-03-26T17:12:15.206 INFO:journalctl@ceph.osd.1.smithi044.stdout:Mar 26 17:12:15 smithi044 podman[75531]: 2024-03-26 17:12:15.129260161 +0000 UTC m=+0.319330040 container start 113fd231fadba511248510d0d42c42eab223fa9c2810ebaa4f84b80ba5b9cd49 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:01ae7457193b3f46a870db683661dbc281d60ce54f0968f4de09bc4e5ad0a734, name=ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-1-deactivate, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=ceph-nvmeof-mon-bf9505f, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240319) 2024-03-26T17:12:15.206 INFO:journalctl@ceph.osd.1.smithi044.stdout:Mar 26 17:12:15 smithi044 podman[75531]: 2024-03-26 17:12:15.201381578 +0000 UTC m=+0.391451472 container attach 113fd231fadba511248510d0d42c42eab223fa9c2810ebaa4f84b80ba5b9cd49 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:01ae7457193b3f46a870db683661dbc281d60ce54f0968f4de09bc4e5ad0a734, name=ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-1-deactivate, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.build-date=20240319, maintainer=Guillaume Abrioux , RELEASE=ceph-nvmeof-mon-bf9505f, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-03-26T17:12:15.515 INFO:journalctl@ceph.osd.1.smithi044.stdout:Mar 26 17:12:15 smithi044 podman[75531]: 2024-03-26 17:12:15.426787549 +0000 UTC m=+0.616857440 container died 113fd231fadba511248510d0d42c42eab223fa9c2810ebaa4f84b80ba5b9cd49 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:01ae7457193b3f46a870db683661dbc281d60ce54f0968f4de09bc4e5ad0a734, name=ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-1-deactivate, io.buildah.version=1.33.5, ceph=True, org.label-schema.build-date=20240319, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=ceph-nvmeof-mon-bf9505f, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-03-26T17:12:16.020 DEBUG:teuthology.orchestra.run.smithi044:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4394d798-eb90-11ee-95d0-87774f69a715@osd.1.service' 2024-03-26T17:12:16.059 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-26T17:12:16.059 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-03-26T17:12:16.059 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-03-26T17:12:16.059 DEBUG:teuthology.orchestra.run.smithi064:> sudo systemctl stop ceph-4394d798-eb90-11ee-95d0-87774f69a715@osd.2 2024-03-26T17:12:16.378 INFO:journalctl@ceph.osd.2.smithi064.stdout:Mar 26 17:12:16 smithi064 systemd[1]: Stopping Ceph osd.2 for 4394d798-eb90-11ee-95d0-87774f69a715... 2024-03-26T17:12:16.766 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:12:16 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:12:16] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:12:16.766 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:12:16 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:12:16] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:12:16.766 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:12:16 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:12:16.805 INFO:journalctl@ceph.osd.2.smithi064.stdout:Mar 26 17:12:16 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-2[38089]: 2024-03-26T17:12:16.376+0000 7f54a3eef700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-26T17:12:16.805 INFO:journalctl@ceph.osd.2.smithi064.stdout:Mar 26 17:12:16 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-2[38089]: 2024-03-26T17:12:16.376+0000 7f54a3eef700 -1 osd.2 80 *** Got signal Terminated *** 2024-03-26T17:12:16.805 INFO:journalctl@ceph.osd.2.smithi064.stdout:Mar 26 17:12:16 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-2[38089]: 2024-03-26T17:12:16.376+0000 7f54a3eef700 -1 osd.2 80 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-26T17:12:16.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:12:16 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:12:16] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:12:16.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:12:16 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:12:16] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:12:16.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:12:16 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:12:18.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:12:18 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:12:18] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:12:18.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:12:18 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:12:18] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:12:18.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:12:18 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:12:18.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:12:18 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:12:18] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:12:18.897 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:12:18 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:12:18] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:12:18.897 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:12:18 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:12:20.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:12:20 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:12:20] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:12:20.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:12:20 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:12:20] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:12:20.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:12:20 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:12:20.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:12:20 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:12:20] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:12:20.897 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:12:20 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:12:20] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:12:20.897 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:12:20 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:12:22.204 INFO:journalctl@ceph.osd.2.smithi064.stdout:Mar 26 17:12:21 smithi064 podman[58291]: 2024-03-26 17:12:21.922824789 +0000 UTC m=+5.652862925 container died 7c60314918e5770a82bb64a7ea08af22d653c910602c988ef3ec74eb093d4f27 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:01ae7457193b3f46a870db683661dbc281d60ce54f0968f4de09bc4e5ad0a734, name=ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-2, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240319, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=ceph-nvmeof-mon-bf9505f, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0) 2024-03-26T17:12:22.555 INFO:journalctl@ceph.osd.2.smithi064.stdout:Mar 26 17:12:22 smithi064 podman[58291]: 2024-03-26 17:12:22.285879368 +0000 UTC m=+6.015917489 container cleanup 7c60314918e5770a82bb64a7ea08af22d653c910602c988ef3ec74eb093d4f27 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:01ae7457193b3f46a870db683661dbc281d60ce54f0968f4de09bc4e5ad0a734, name=ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240319, GIT_CLEAN=True, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, RELEASE=ceph-nvmeof-mon-bf9505f) 2024-03-26T17:12:22.555 INFO:journalctl@ceph.osd.2.smithi064.stdout:Mar 26 17:12:22 smithi064 bash[58291]: ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-2 2024-03-26T17:12:22.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:12:22 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:12:22] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:12:22.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:12:22 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:12:22] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:12:22.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:12:22 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:12:22.893 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:12:22 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:12:22] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:12:22.894 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:12:22 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:12:22] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:12:22.894 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:12:22 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:12:23.055 INFO:journalctl@ceph.osd.2.smithi064.stdout:Mar 26 17:12:22 smithi064 podman[58320]: 2024-03-26 17:12:22.729237578 +0000 UTC m=+0.800003103 container remove 7c60314918e5770a82bb64a7ea08af22d653c910602c988ef3ec74eb093d4f27 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:01ae7457193b3f46a870db683661dbc281d60ce54f0968f4de09bc4e5ad0a734, name=ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240319, org.label-schema.schema-version=1.0, RELEASE=ceph-nvmeof-mon-bf9505f, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, ceph=True, io.buildah.version=1.33.5, GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-03-26T17:12:23.306 INFO:journalctl@ceph.osd.2.smithi064.stdout:Mar 26 17:12:23 smithi064 podman[58415]: 2024-03-26 17:12:23.054868631 +0000 UTC m=+0.114063386 container create 4b6894b20cdaea01bac3f11b0848688bcbfb779a84b011fc85ac8d0c1a6f8d86 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:01ae7457193b3f46a870db683661dbc281d60ce54f0968f4de09bc4e5ad0a734, name=ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-2-deactivate, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.schema-version=1.0, RELEASE=ceph-nvmeof-mon-bf9505f, org.label-schema.build-date=20240319, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.vendor=CentOS) 2024-03-26T17:12:23.306 INFO:journalctl@ceph.osd.2.smithi064.stdout:Mar 26 17:12:23 smithi064 podman[58415]: 2024-03-26 17:12:22.958453666 +0000 UTC m=+0.017648440 image pull 5795ddf102746261652aa1cd1f517ace4dcfb8739ebbf229aeb81830d793ada0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:01ae7457193b3f46a870db683661dbc281d60ce54f0968f4de09bc4e5ad0a734 2024-03-26T17:12:23.306 INFO:journalctl@ceph.osd.2.smithi064.stdout:Mar 26 17:12:23 smithi064 podman[58415]: 2024-03-26 17:12:23.257134623 +0000 UTC m=+0.316329378 container init 4b6894b20cdaea01bac3f11b0848688bcbfb779a84b011fc85ac8d0c1a6f8d86 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:01ae7457193b3f46a870db683661dbc281d60ce54f0968f4de09bc4e5ad0a734, name=ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-2-deactivate, org.label-schema.vendor=CentOS, ceph=True, RELEASE=ceph-nvmeof-mon-bf9505f, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_CLEAN=True, org.label-schema.build-date=20240319, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-03-26T17:12:23.306 INFO:journalctl@ceph.osd.2.smithi064.stdout:Mar 26 17:12:23 smithi064 podman[58415]: 2024-03-26 17:12:23.260108995 +0000 UTC m=+0.319303755 container start 4b6894b20cdaea01bac3f11b0848688bcbfb779a84b011fc85ac8d0c1a6f8d86 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:01ae7457193b3f46a870db683661dbc281d60ce54f0968f4de09bc4e5ad0a734, name=ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-2-deactivate, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240319, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=ceph-nvmeof-mon-bf9505f, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-03-26T17:12:23.561 INFO:journalctl@ceph.osd.2.smithi064.stdout:Mar 26 17:12:23 smithi064 podman[58415]: 2024-03-26 17:12:23.340874107 +0000 UTC m=+0.400068870 container attach 4b6894b20cdaea01bac3f11b0848688bcbfb779a84b011fc85ac8d0c1a6f8d86 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:01ae7457193b3f46a870db683661dbc281d60ce54f0968f4de09bc4e5ad0a734, name=ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-2-deactivate, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240319, ceph=True, RELEASE=ceph-nvmeof-mon-bf9505f, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, maintainer=Guillaume Abrioux ) 2024-03-26T17:12:23.844 INFO:journalctl@ceph.osd.2.smithi064.stdout:Mar 26 17:12:23 smithi064 podman[58415]: 2024-03-26 17:12:23.561627662 +0000 UTC m=+0.620822425 container died 4b6894b20cdaea01bac3f11b0848688bcbfb779a84b011fc85ac8d0c1a6f8d86 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:01ae7457193b3f46a870db683661dbc281d60ce54f0968f4de09bc4e5ad0a734, name=ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-2-deactivate, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=ceph-nvmeof-mon-bf9505f, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240319, org.label-schema.license=GPLv2, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30) 2024-03-26T17:12:24.139 DEBUG:teuthology.orchestra.run.smithi064:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4394d798-eb90-11ee-95d0-87774f69a715@osd.2.service' 2024-03-26T17:12:24.185 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-26T17:12:24.185 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-03-26T17:12:24.185 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-03-26T17:12:24.185 DEBUG:teuthology.orchestra.run.smithi064:> sudo systemctl stop ceph-4394d798-eb90-11ee-95d0-87774f69a715@osd.3 2024-03-26T17:12:24.514 INFO:journalctl@ceph.osd.3.smithi064.stdout:Mar 26 17:12:24 smithi064 systemd[1]: Stopping Ceph osd.3 for 4394d798-eb90-11ee-95d0-87774f69a715... 2024-03-26T17:12:24.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:12:24 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:12:24] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:12:24.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:12:24 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:12:24] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:12:24.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:12:24 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:12:24.805 INFO:journalctl@ceph.osd.3.smithi064.stdout:Mar 26 17:12:24 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-3[43541]: 2024-03-26T17:12:24.512+0000 7f1867352700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-26T17:12:24.805 INFO:journalctl@ceph.osd.3.smithi064.stdout:Mar 26 17:12:24 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-3[43541]: 2024-03-26T17:12:24.512+0000 7f1867352700 -1 osd.3 80 *** Got signal Terminated *** 2024-03-26T17:12:24.805 INFO:journalctl@ceph.osd.3.smithi064.stdout:Mar 26 17:12:24 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-3[43541]: 2024-03-26T17:12:24.512+0000 7f1867352700 -1 osd.3 80 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-26T17:12:24.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:12:24 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:12:24] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:12:24.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:12:24 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:12:24] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:12:24.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:12:24 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:12:26.396 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 26 17:12:26 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-7[50917]: 2024-03-26T17:12:26.090+0000 7f68c422d700 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-03-26T17:12:02.662964+0000 front 2024-03-26T17:12:02.662885+0000 (oldest deadline 2024-03-26T17:12:26.063366+0000) 2024-03-26T17:12:26.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:12:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:12:26] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:12:26.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:12:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:12:26] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:12:26.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:12:26 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:12:26.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:12:26 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:12:26] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:12:26.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:12:26 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:12:26] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:12:26.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:12:26 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:12:27.395 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 26 17:12:27 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-7[50917]: 2024-03-26T17:12:27.084+0000 7f68c422d700 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-03-26T17:12:02.662964+0000 front 2024-03-26T17:12:02.662885+0000 (oldest deadline 2024-03-26T17:12:26.063366+0000) 2024-03-26T17:12:28.305 INFO:journalctl@ceph.osd.3.smithi064.stdout:Mar 26 17:12:27 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-3[43541]: 2024-03-26T17:12:27.918+0000 7f185f93e700 -1 osd.3 80 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-03-26T17:12:05.225463+0000 front 2024-03-26T17:12:05.225486+0000 (oldest deadline 2024-03-26T17:12:26.925663+0000) 2024-03-26T17:12:28.396 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 26 17:12:28 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-7[50917]: 2024-03-26T17:12:28.100+0000 7f68c422d700 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-03-26T17:12:02.662964+0000 front 2024-03-26T17:12:02.662885+0000 (oldest deadline 2024-03-26T17:12:26.063366+0000) 2024-03-26T17:12:28.396 INFO:journalctl@ceph.osd.5.smithi149.stdout:Mar 26 17:12:27 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-5[38953]: 2024-03-26T17:12:27.938+0000 7fdfaef6b700 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-03-26T17:12:03.295055+0000 front 2024-03-26T17:12:03.295081+0000 (oldest deadline 2024-03-26T17:12:27.395124+0000) 2024-03-26T17:12:28.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:12:28 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:12:28] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:12:28.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:12:28 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:12:28] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:12:28.766 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:12:28 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:12:28.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:12:28 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:12:28] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:12:28.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:12:28 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:12:28] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:12:28.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:12:28 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:12:29.305 INFO:journalctl@ceph.osd.3.smithi064.stdout:Mar 26 17:12:28 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-3[43541]: 2024-03-26T17:12:28.946+0000 7f185f93e700 -1 osd.3 80 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-03-26T17:12:05.225463+0000 front 2024-03-26T17:12:05.225486+0000 (oldest deadline 2024-03-26T17:12:26.925663+0000) 2024-03-26T17:12:29.306 INFO:journalctl@ceph.osd.4.smithi064.stdout:Mar 26 17:12:29 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-4[49575]: 2024-03-26T17:12:29.016+0000 7fdce7d87700 -1 osd.4 80 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-03-26T17:12:03.569317+0000 front 2024-03-26T17:12:03.569219+0000 (oldest deadline 2024-03-26T17:12:28.169776+0000) 2024-03-26T17:12:29.396 INFO:journalctl@ceph.osd.5.smithi149.stdout:Mar 26 17:12:28 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-5[38953]: 2024-03-26T17:12:28.956+0000 7fdfaef6b700 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-03-26T17:12:03.295055+0000 front 2024-03-26T17:12:03.295081+0000 (oldest deadline 2024-03-26T17:12:27.395124+0000) 2024-03-26T17:12:29.396 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 26 17:12:29 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-7[50917]: 2024-03-26T17:12:29.072+0000 7f68c422d700 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-03-26T17:12:02.662964+0000 front 2024-03-26T17:12:02.662885+0000 (oldest deadline 2024-03-26T17:12:26.063366+0000) 2024-03-26T17:12:30.120 INFO:journalctl@ceph.osd.5.smithi149.stdout:Mar 26 17:12:29 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-5[38953]: 2024-03-26T17:12:29.972+0000 7fdfaef6b700 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-03-26T17:12:03.295055+0000 front 2024-03-26T17:12:03.295081+0000 (oldest deadline 2024-03-26T17:12:27.395124+0000) 2024-03-26T17:12:30.120 INFO:journalctl@ceph.osd.6.smithi149.stdout:Mar 26 17:12:29 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-6[44855]: 2024-03-26T17:12:29.785+0000 7ffbc1ab7700 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-03-26T17:12:05.220703+0000 front 2024-03-26T17:12:05.220772+0000 (oldest deadline 2024-03-26T17:12:29.320723+0000) 2024-03-26T17:12:30.223 INFO:journalctl@ceph.osd.3.smithi064.stdout:Mar 26 17:12:29 smithi064 podman[58522]: 2024-03-26 17:12:29.953968264 +0000 UTC m=+5.551406854 container died b7da0fdb38e5c7412bedf371d0e7789551edbea660566cad50739a4660b3e9a1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:01ae7457193b3f46a870db683661dbc281d60ce54f0968f4de09bc4e5ad0a734, name=ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-3, RELEASE=ceph-nvmeof-mon-bf9505f, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240319, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-03-26T17:12:30.223 INFO:journalctl@ceph.osd.4.smithi064.stdout:Mar 26 17:12:30 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-4[49575]: 2024-03-26T17:12:30.019+0000 7fdce7d87700 -1 osd.4 80 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-03-26T17:12:03.569317+0000 front 2024-03-26T17:12:03.569219+0000 (oldest deadline 2024-03-26T17:12:28.169776+0000) 2024-03-26T17:12:30.395 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 26 17:12:30 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-7[50917]: 2024-03-26T17:12:30.119+0000 7f68c422d700 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-03-26T17:12:02.662964+0000 front 2024-03-26T17:12:02.662885+0000 (oldest deadline 2024-03-26T17:12:26.063366+0000) 2024-03-26T17:12:30.489 INFO:journalctl@ceph.osd.3.smithi064.stdout:Mar 26 17:12:30 smithi064 podman[58522]: 2024-03-26 17:12:30.296539585 +0000 UTC m=+5.893978174 container cleanup b7da0fdb38e5c7412bedf371d0e7789551edbea660566cad50739a4660b3e9a1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:01ae7457193b3f46a870db683661dbc281d60ce54f0968f4de09bc4e5ad0a734, name=ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-3, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, RELEASE=ceph-nvmeof-mon-bf9505f, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.build-date=20240319, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-26T17:12:30.489 INFO:journalctl@ceph.osd.3.smithi064.stdout:Mar 26 17:12:30 smithi064 bash[58522]: ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-3 2024-03-26T17:12:30.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:12:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:12:30] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:12:30.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:12:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:12:30] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:12:30.766 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:12:30 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:12:30.805 INFO:journalctl@ceph.osd.3.smithi064.stdout:Mar 26 17:12:30 smithi064 podman[58539]: 2024-03-26 17:12:30.489558702 +0000 UTC m=+0.530632069 container remove b7da0fdb38e5c7412bedf371d0e7789551edbea660566cad50739a4660b3e9a1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:01ae7457193b3f46a870db683661dbc281d60ce54f0968f4de09bc4e5ad0a734, name=ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-3, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240319, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=ceph-nvmeof-mon-bf9505f) 2024-03-26T17:12:30.896 INFO:journalctl@ceph.osd.6.smithi149.stdout:Mar 26 17:12:30 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-6[44855]: 2024-03-26T17:12:30.806+0000 7ffbc1ab7700 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-03-26T17:12:05.220703+0000 front 2024-03-26T17:12:05.220772+0000 (oldest deadline 2024-03-26T17:12:29.320723+0000) 2024-03-26T17:12:30.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:12:30 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:12:30] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:12:30.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:12:30 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:12:30] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:12:30.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:12:30 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:12:31.184 INFO:journalctl@ceph.osd.4.smithi064.stdout:Mar 26 17:12:31 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-4[49575]: 2024-03-26T17:12:31.032+0000 7fdce7d87700 -1 osd.4 80 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-03-26T17:12:03.569317+0000 front 2024-03-26T17:12:03.569219+0000 (oldest deadline 2024-03-26T17:12:28.169776+0000) 2024-03-26T17:12:31.184 INFO:journalctl@ceph.osd.3.smithi064.stdout:Mar 26 17:12:30 smithi064 podman[58628]: 2024-03-26 17:12:30.907176458 +0000 UTC m=+0.114287428 container create 1f60126547d875e87680c25d07af6e23443528133e226fc8457c5f31bc5c3cb8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:01ae7457193b3f46a870db683661dbc281d60ce54f0968f4de09bc4e5ad0a734, name=ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-3-deactivate, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.build-date=20240319, RELEASE=ceph-nvmeof-mon-bf9505f, org.label-schema.schema-version=1.0, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-03-26T17:12:31.185 INFO:journalctl@ceph.osd.3.smithi064.stdout:Mar 26 17:12:30 smithi064 podman[58628]: 2024-03-26 17:12:30.810455014 +0000 UTC m=+0.017565998 image pull 5795ddf102746261652aa1cd1f517ace4dcfb8739ebbf229aeb81830d793ada0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:01ae7457193b3f46a870db683661dbc281d60ce54f0968f4de09bc4e5ad0a734 2024-03-26T17:12:31.185 INFO:journalctl@ceph.osd.3.smithi064.stdout:Mar 26 17:12:31 smithi064 podman[58628]: 2024-03-26 17:12:31.109251703 +0000 UTC m=+0.316362673 container init 1f60126547d875e87680c25d07af6e23443528133e226fc8457c5f31bc5c3cb8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:01ae7457193b3f46a870db683661dbc281d60ce54f0968f4de09bc4e5ad0a734, name=ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-3-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.build-date=20240319, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, RELEASE=ceph-nvmeof-mon-bf9505f, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, ceph=True) 2024-03-26T17:12:31.185 INFO:journalctl@ceph.osd.3.smithi064.stdout:Mar 26 17:12:31 smithi064 podman[58628]: 2024-03-26 17:12:31.11229005 +0000 UTC m=+0.319401021 container start 1f60126547d875e87680c25d07af6e23443528133e226fc8457c5f31bc5c3cb8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:01ae7457193b3f46a870db683661dbc281d60ce54f0968f4de09bc4e5ad0a734, name=ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-3-deactivate, org.label-schema.schema-version=1.0, RELEASE=ceph-nvmeof-mon-bf9505f, io.buildah.version=1.33.5, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240319, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-03-26T17:12:31.185 INFO:journalctl@ceph.osd.3.smithi064.stdout:Mar 26 17:12:31 smithi064 podman[58628]: 2024-03-26 17:12:31.18425555 +0000 UTC m=+0.391366521 container attach 1f60126547d875e87680c25d07af6e23443528133e226fc8457c5f31bc5c3cb8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:01ae7457193b3f46a870db683661dbc281d60ce54f0968f4de09bc4e5ad0a734, name=ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-3-deactivate, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240319, GIT_CLEAN=True, RELEASE=ceph-nvmeof-mon-bf9505f, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-03-26T17:12:31.396 INFO:journalctl@ceph.osd.5.smithi149.stdout:Mar 26 17:12:30 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-5[38953]: 2024-03-26T17:12:30.949+0000 7fdfaef6b700 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-03-26T17:12:03.295055+0000 front 2024-03-26T17:12:03.295081+0000 (oldest deadline 2024-03-26T17:12:27.395124+0000) 2024-03-26T17:12:31.396 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 26 17:12:31 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-7[50917]: 2024-03-26T17:12:31.103+0000 7f68c422d700 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-03-26T17:12:02.662964+0000 front 2024-03-26T17:12:02.662885+0000 (oldest deadline 2024-03-26T17:12:26.063366+0000) 2024-03-26T17:12:31.555 INFO:journalctl@ceph.osd.3.smithi064.stdout:Mar 26 17:12:31 smithi064 podman[58628]: 2024-03-26 17:12:31.407677071 +0000 UTC m=+0.614788034 container died 1f60126547d875e87680c25d07af6e23443528133e226fc8457c5f31bc5c3cb8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:01ae7457193b3f46a870db683661dbc281d60ce54f0968f4de09bc4e5ad0a734, name=ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-3-deactivate, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.build-date=20240319, org.label-schema.vendor=CentOS, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=ceph-nvmeof-mon-bf9505f, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-03-26T17:12:32.031 DEBUG:teuthology.orchestra.run.smithi064:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4394d798-eb90-11ee-95d0-87774f69a715@osd.3.service' 2024-03-26T17:12:32.073 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-26T17:12:32.073 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-03-26T17:12:32.073 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-03-26T17:12:32.074 DEBUG:teuthology.orchestra.run.smithi064:> sudo systemctl stop ceph-4394d798-eb90-11ee-95d0-87774f69a715@osd.4 2024-03-26T17:12:32.083 INFO:journalctl@ceph.osd.5.smithi149.stdout:Mar 26 17:12:31 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-5[38953]: 2024-03-26T17:12:31.955+0000 7fdfaef6b700 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-03-26T17:12:03.295055+0000 front 2024-03-26T17:12:03.295081+0000 (oldest deadline 2024-03-26T17:12:27.395124+0000) 2024-03-26T17:12:32.084 INFO:journalctl@ceph.osd.6.smithi149.stdout:Mar 26 17:12:31 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-6[44855]: 2024-03-26T17:12:31.806+0000 7ffbc1ab7700 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-03-26T17:12:05.220703+0000 front 2024-03-26T17:12:05.220772+0000 (oldest deadline 2024-03-26T17:12:29.320723+0000) 2024-03-26T17:12:32.305 INFO:journalctl@ceph.osd.4.smithi064.stdout:Mar 26 17:12:32 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-4[49575]: 2024-03-26T17:12:32.047+0000 7fdce7d87700 -1 osd.4 80 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-03-26T17:12:03.569317+0000 front 2024-03-26T17:12:03.569219+0000 (oldest deadline 2024-03-26T17:12:28.169776+0000) 2024-03-26T17:12:32.305 INFO:journalctl@ceph.osd.4.smithi064.stdout:Mar 26 17:12:32 smithi064 systemd[1]: Stopping Ceph osd.4 for 4394d798-eb90-11ee-95d0-87774f69a715... 2024-03-26T17:12:32.396 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 26 17:12:32 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-7[50917]: 2024-03-26T17:12:32.082+0000 7f68c422d700 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-03-26T17:12:02.662964+0000 front 2024-03-26T17:12:02.662885+0000 (oldest deadline 2024-03-26T17:12:26.063366+0000) 2024-03-26T17:12:32.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:12:32 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:12:32] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:12:32.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:12:32 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:12:32] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:12:32.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:12:32 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:12:32.805 INFO:journalctl@ceph.osd.4.smithi064.stdout:Mar 26 17:12:32 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-4[49575]: 2024-03-26T17:12:32.389+0000 7fdceb793700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-26T17:12:32.805 INFO:journalctl@ceph.osd.4.smithi064.stdout:Mar 26 17:12:32 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-4[49575]: 2024-03-26T17:12:32.389+0000 7fdceb793700 -1 osd.4 80 *** Got signal Terminated *** 2024-03-26T17:12:32.805 INFO:journalctl@ceph.osd.4.smithi064.stdout:Mar 26 17:12:32 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-4[49575]: 2024-03-26T17:12:32.389+0000 7fdceb793700 -1 osd.4 80 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-26T17:12:32.896 INFO:journalctl@ceph.osd.6.smithi149.stdout:Mar 26 17:12:32 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-6[44855]: 2024-03-26T17:12:32.758+0000 7ffbc1ab7700 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-03-26T17:12:05.220703+0000 front 2024-03-26T17:12:05.220772+0000 (oldest deadline 2024-03-26T17:12:29.320723+0000) 2024-03-26T17:12:32.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:12:32 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:12:32] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:12:32.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:12:32 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:12:32] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:12:32.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:12:32 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:12:33.396 INFO:journalctl@ceph.osd.5.smithi149.stdout:Mar 26 17:12:32 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-5[38953]: 2024-03-26T17:12:32.908+0000 7fdfaef6b700 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-03-26T17:12:03.295055+0000 front 2024-03-26T17:12:03.295081+0000 (oldest deadline 2024-03-26T17:12:27.395124+0000) 2024-03-26T17:12:33.396 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 26 17:12:33 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-7[50917]: 2024-03-26T17:12:33.034+0000 7f68c422d700 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-03-26T17:12:02.662964+0000 front 2024-03-26T17:12:02.662885+0000 (oldest deadline 2024-03-26T17:12:26.063366+0000) 2024-03-26T17:12:33.555 INFO:journalctl@ceph.osd.4.smithi064.stdout:Mar 26 17:12:33 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-4[49575]: 2024-03-26T17:12:33.064+0000 7fdce7d87700 -1 osd.4 80 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-03-26T17:12:03.569317+0000 front 2024-03-26T17:12:03.569219+0000 (oldest deadline 2024-03-26T17:12:28.169776+0000) 2024-03-26T17:12:34.033 INFO:journalctl@ceph.osd.5.smithi149.stdout:Mar 26 17:12:33 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-5[38953]: 2024-03-26T17:12:33.955+0000 7fdfaef6b700 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-03-26T17:12:03.295055+0000 front 2024-03-26T17:12:03.295081+0000 (oldest deadline 2024-03-26T17:12:27.395124+0000) 2024-03-26T17:12:34.033 INFO:journalctl@ceph.osd.6.smithi149.stdout:Mar 26 17:12:33 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-6[44855]: 2024-03-26T17:12:33.753+0000 7ffbc1ab7700 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-03-26T17:12:05.220703+0000 front 2024-03-26T17:12:05.220772+0000 (oldest deadline 2024-03-26T17:12:29.320723+0000) 2024-03-26T17:12:34.305 INFO:journalctl@ceph.osd.4.smithi064.stdout:Mar 26 17:12:34 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-4[49575]: 2024-03-26T17:12:34.045+0000 7fdce7d87700 -1 osd.4 80 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-03-26T17:12:03.569317+0000 front 2024-03-26T17:12:03.569219+0000 (oldest deadline 2024-03-26T17:12:28.169776+0000) 2024-03-26T17:12:34.395 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 26 17:12:34 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-7[50917]: 2024-03-26T17:12:34.032+0000 7f68c422d700 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-03-26T17:12:02.662964+0000 front 2024-03-26T17:12:02.662885+0000 (oldest deadline 2024-03-26T17:12:26.063366+0000) 2024-03-26T17:12:34.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:12:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:12:34] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:12:34.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:12:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:12:34] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:12:34.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:12:34 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:12:34.896 INFO:journalctl@ceph.osd.6.smithi149.stdout:Mar 26 17:12:34 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-6[44855]: 2024-03-26T17:12:34.780+0000 7ffbc1ab7700 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-03-26T17:12:05.220703+0000 front 2024-03-26T17:12:05.220772+0000 (oldest deadline 2024-03-26T17:12:29.320723+0000) 2024-03-26T17:12:34.896 INFO:journalctl@ceph.osd.6.smithi149.stdout:Mar 26 17:12:34 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-6[44855]: 2024-03-26T17:12:34.780+0000 7ffbc1ab7700 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.44:6814 osd.1 since back 2024-03-26T17:12:12.821454+0000 front 2024-03-26T17:12:12.821572+0000 (oldest deadline 2024-03-26T17:12:34.521568+0000) 2024-03-26T17:12:34.897 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:12:34 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:12:34] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:12:34.897 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:12:34 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:12:34] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:12:34.897 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:12:34 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:12:35.305 INFO:journalctl@ceph.osd.4.smithi064.stdout:Mar 26 17:12:35 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-4[49575]: 2024-03-26T17:12:35.046+0000 7fdce7d87700 -1 osd.4 80 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-03-26T17:12:03.569317+0000 front 2024-03-26T17:12:03.569219+0000 (oldest deadline 2024-03-26T17:12:28.169776+0000) 2024-03-26T17:12:35.396 INFO:journalctl@ceph.osd.5.smithi149.stdout:Mar 26 17:12:34 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-5[38953]: 2024-03-26T17:12:34.987+0000 7fdfaef6b700 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-03-26T17:12:03.295055+0000 front 2024-03-26T17:12:03.295081+0000 (oldest deadline 2024-03-26T17:12:27.395124+0000) 2024-03-26T17:12:35.396 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 26 17:12:35 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-7[50917]: 2024-03-26T17:12:35.010+0000 7f68c422d700 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-03-26T17:12:02.662964+0000 front 2024-03-26T17:12:02.662885+0000 (oldest deadline 2024-03-26T17:12:26.063366+0000) 2024-03-26T17:12:35.397 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 26 17:12:35 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-7[50917]: 2024-03-26T17:12:35.010+0000 7f68c422d700 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.44:6814 osd.1 since back 2024-03-26T17:12:11.864335+0000 front 2024-03-26T17:12:11.864356+0000 (oldest deadline 2024-03-26T17:12:34.764412+0000) 2024-03-26T17:12:36.146 INFO:journalctl@ceph.osd.5.smithi149.stdout:Mar 26 17:12:36 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-5[38953]: 2024-03-26T17:12:36.009+0000 7fdfaef6b700 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-03-26T17:12:03.295055+0000 front 2024-03-26T17:12:03.295081+0000 (oldest deadline 2024-03-26T17:12:27.395124+0000) 2024-03-26T17:12:36.146 INFO:journalctl@ceph.osd.5.smithi149.stdout:Mar 26 17:12:36 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-5[38953]: 2024-03-26T17:12:36.009+0000 7fdfaef6b700 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.44:6814 osd.1 since back 2024-03-26T17:12:11.495757+0000 front 2024-03-26T17:12:11.495740+0000 (oldest deadline 2024-03-26T17:12:34.995726+0000) 2024-03-26T17:12:36.146 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 26 17:12:35 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-7[50917]: 2024-03-26T17:12:35.977+0000 7f68c422d700 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-03-26T17:12:02.662964+0000 front 2024-03-26T17:12:02.662885+0000 (oldest deadline 2024-03-26T17:12:26.063366+0000) 2024-03-26T17:12:36.146 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 26 17:12:35 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-7[50917]: 2024-03-26T17:12:35.977+0000 7f68c422d700 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.44:6814 osd.1 since back 2024-03-26T17:12:11.864335+0000 front 2024-03-26T17:12:11.864356+0000 (oldest deadline 2024-03-26T17:12:34.764412+0000) 2024-03-26T17:12:36.147 INFO:journalctl@ceph.osd.6.smithi149.stdout:Mar 26 17:12:35 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-6[44855]: 2024-03-26T17:12:35.806+0000 7ffbc1ab7700 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-03-26T17:12:05.220703+0000 front 2024-03-26T17:12:05.220772+0000 (oldest deadline 2024-03-26T17:12:29.320723+0000) 2024-03-26T17:12:36.147 INFO:journalctl@ceph.osd.6.smithi149.stdout:Mar 26 17:12:35 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-6[44855]: 2024-03-26T17:12:35.806+0000 7ffbc1ab7700 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.44:6814 osd.1 since back 2024-03-26T17:12:12.821454+0000 front 2024-03-26T17:12:12.821572+0000 (oldest deadline 2024-03-26T17:12:34.521568+0000) 2024-03-26T17:12:36.555 INFO:journalctl@ceph.osd.4.smithi064.stdout:Mar 26 17:12:36 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-4[49575]: 2024-03-26T17:12:36.095+0000 7fdce7d87700 -1 osd.4 80 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-03-26T17:12:03.569317+0000 front 2024-03-26T17:12:03.569219+0000 (oldest deadline 2024-03-26T17:12:28.169776+0000) 2024-03-26T17:12:36.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:12:36 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:12:36] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:12:36.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:12:36 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:12:36] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:12:36.766 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:12:36 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:12:36.896 INFO:journalctl@ceph.osd.6.smithi149.stdout:Mar 26 17:12:36 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-6[44855]: 2024-03-26T17:12:36.774+0000 7ffbc1ab7700 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-03-26T17:12:05.220703+0000 front 2024-03-26T17:12:05.220772+0000 (oldest deadline 2024-03-26T17:12:29.320723+0000) 2024-03-26T17:12:36.896 INFO:journalctl@ceph.osd.6.smithi149.stdout:Mar 26 17:12:36 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-6[44855]: 2024-03-26T17:12:36.774+0000 7ffbc1ab7700 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.44:6814 osd.1 since back 2024-03-26T17:12:12.821454+0000 front 2024-03-26T17:12:12.821572+0000 (oldest deadline 2024-03-26T17:12:34.521568+0000) 2024-03-26T17:12:36.896 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:12:36 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:12:36] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:12:36.897 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:12:36 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:12:36] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:12:36.897 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:12:36 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:12:37.396 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 26 17:12:36 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-7[50917]: 2024-03-26T17:12:36.946+0000 7f68c422d700 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-03-26T17:12:02.662964+0000 front 2024-03-26T17:12:02.662885+0000 (oldest deadline 2024-03-26T17:12:26.063366+0000) 2024-03-26T17:12:37.396 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 26 17:12:36 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-7[50917]: 2024-03-26T17:12:36.946+0000 7f68c422d700 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.44:6814 osd.1 since back 2024-03-26T17:12:11.864335+0000 front 2024-03-26T17:12:11.864356+0000 (oldest deadline 2024-03-26T17:12:34.764412+0000) 2024-03-26T17:12:37.396 INFO:journalctl@ceph.osd.5.smithi149.stdout:Mar 26 17:12:36 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-5[38953]: 2024-03-26T17:12:36.980+0000 7fdfaef6b700 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-03-26T17:12:03.295055+0000 front 2024-03-26T17:12:03.295081+0000 (oldest deadline 2024-03-26T17:12:27.395124+0000) 2024-03-26T17:12:37.396 INFO:journalctl@ceph.osd.5.smithi149.stdout:Mar 26 17:12:36 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-5[38953]: 2024-03-26T17:12:36.980+0000 7fdfaef6b700 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.44:6814 osd.1 since back 2024-03-26T17:12:11.495757+0000 front 2024-03-26T17:12:11.495740+0000 (oldest deadline 2024-03-26T17:12:34.995726+0000) 2024-03-26T17:12:37.555 INFO:journalctl@ceph.osd.4.smithi064.stdout:Mar 26 17:12:37 smithi064 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-4[49575]: 2024-03-26T17:12:37.131+0000 7fdce7d87700 -1 osd.4 80 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-03-26T17:12:03.569317+0000 front 2024-03-26T17:12:03.569219+0000 (oldest deadline 2024-03-26T17:12:28.169776+0000) 2024-03-26T17:12:38.015 INFO:journalctl@ceph.osd.6.smithi149.stdout:Mar 26 17:12:37 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-6[44855]: 2024-03-26T17:12:37.744+0000 7ffbc1ab7700 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-03-26T17:12:05.220703+0000 front 2024-03-26T17:12:05.220772+0000 (oldest deadline 2024-03-26T17:12:29.320723+0000) 2024-03-26T17:12:38.015 INFO:journalctl@ceph.osd.6.smithi149.stdout:Mar 26 17:12:37 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-6[44855]: 2024-03-26T17:12:37.744+0000 7ffbc1ab7700 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.44:6814 osd.1 since back 2024-03-26T17:12:12.821454+0000 front 2024-03-26T17:12:12.821572+0000 (oldest deadline 2024-03-26T17:12:34.521568+0000) 2024-03-26T17:12:38.015 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 26 17:12:37 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-7[50917]: 2024-03-26T17:12:37.971+0000 7f68c422d700 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-03-26T17:12:02.662964+0000 front 2024-03-26T17:12:02.662885+0000 (oldest deadline 2024-03-26T17:12:26.063366+0000) 2024-03-26T17:12:38.016 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 26 17:12:37 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-7[50917]: 2024-03-26T17:12:37.971+0000 7f68c422d700 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.44:6814 osd.1 since back 2024-03-26T17:12:11.864335+0000 front 2024-03-26T17:12:11.864356+0000 (oldest deadline 2024-03-26T17:12:34.764412+0000) 2024-03-26T17:12:38.224 INFO:journalctl@ceph.osd.4.smithi064.stdout:Mar 26 17:12:37 smithi064 podman[58736]: 2024-03-26 17:12:37.952018385 +0000 UTC m=+5.657956911 container died 55660b3b2db21b1482ac68adb40c6979db3051c8d25c69362f8dc680340d773a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:01ae7457193b3f46a870db683661dbc281d60ce54f0968f4de09bc4e5ad0a734, name=ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-4, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, RELEASE=ceph-nvmeof-mon-bf9505f, org.label-schema.build-date=20240319, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-03-26T17:12:38.396 INFO:journalctl@ceph.osd.5.smithi149.stdout:Mar 26 17:12:38 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-5[38953]: 2024-03-26T17:12:38.014+0000 7fdfaef6b700 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-03-26T17:12:03.295055+0000 front 2024-03-26T17:12:03.295081+0000 (oldest deadline 2024-03-26T17:12:27.395124+0000) 2024-03-26T17:12:38.396 INFO:journalctl@ceph.osd.5.smithi149.stdout:Mar 26 17:12:38 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-5[38953]: 2024-03-26T17:12:38.014+0000 7fdfaef6b700 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.44:6814 osd.1 since back 2024-03-26T17:12:11.495757+0000 front 2024-03-26T17:12:11.495740+0000 (oldest deadline 2024-03-26T17:12:34.995726+0000) 2024-03-26T17:12:38.509 INFO:journalctl@ceph.osd.4.smithi064.stdout:Mar 26 17:12:38 smithi064 podman[58736]: 2024-03-26 17:12:38.3235517 +0000 UTC m=+6.029490226 container cleanup 55660b3b2db21b1482ac68adb40c6979db3051c8d25c69362f8dc680340d773a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:01ae7457193b3f46a870db683661dbc281d60ce54f0968f4de09bc4e5ad0a734, name=ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-4, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, RELEASE=ceph-nvmeof-mon-bf9505f, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240319, org.label-schema.vendor=CentOS, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-03-26T17:12:38.509 INFO:journalctl@ceph.osd.4.smithi064.stdout:Mar 26 17:12:38 smithi064 bash[58736]: ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-4 2024-03-26T17:12:38.766 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:12:38 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:12:38] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:12:38.766 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:12:38 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:12:38] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:12:38.766 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:12:38 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:12:38.805 INFO:journalctl@ceph.osd.4.smithi064.stdout:Mar 26 17:12:38 smithi064 podman[58751]: 2024-03-26 17:12:38.699601682 +0000 UTC m=+0.744146709 container remove 55660b3b2db21b1482ac68adb40c6979db3051c8d25c69362f8dc680340d773a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:01ae7457193b3f46a870db683661dbc281d60ce54f0968f4de09bc4e5ad0a734, name=ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-4, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240319, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, RELEASE=ceph-nvmeof-mon-bf9505f, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-26T17:12:38.896 INFO:journalctl@ceph.osd.6.smithi149.stdout:Mar 26 17:12:38 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-6[44855]: 2024-03-26T17:12:38.770+0000 7ffbc1ab7700 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-03-26T17:12:05.220703+0000 front 2024-03-26T17:12:05.220772+0000 (oldest deadline 2024-03-26T17:12:29.320723+0000) 2024-03-26T17:12:38.896 INFO:journalctl@ceph.osd.6.smithi149.stdout:Mar 26 17:12:38 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-6[44855]: 2024-03-26T17:12:38.770+0000 7ffbc1ab7700 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.44:6814 osd.1 since back 2024-03-26T17:12:12.821454+0000 front 2024-03-26T17:12:12.821572+0000 (oldest deadline 2024-03-26T17:12:34.521568+0000) 2024-03-26T17:12:38.897 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:12:38 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:12:38] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:12:38.897 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:12:38 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:12:38] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:12:38.897 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:12:38 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:12:39.245 INFO:journalctl@ceph.osd.4.smithi064.stdout:Mar 26 17:12:38 smithi064 podman[58845]: 2024-03-26 17:12:38.991936665 +0000 UTC m=+0.108073059 container create b300f5bdf28d35e182caf0db3c0732e79d28d33fcbcde63ec5f38d400e3027c9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:01ae7457193b3f46a870db683661dbc281d60ce54f0968f4de09bc4e5ad0a734, name=ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-4-deactivate, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240319, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=ceph-nvmeof-mon-bf9505f, ceph=True, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30) 2024-03-26T17:12:39.245 INFO:journalctl@ceph.osd.4.smithi064.stdout:Mar 26 17:12:38 smithi064 podman[58845]: 2024-03-26 17:12:38.901643473 +0000 UTC m=+0.017779887 image pull 5795ddf102746261652aa1cd1f517ace4dcfb8739ebbf229aeb81830d793ada0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:01ae7457193b3f46a870db683661dbc281d60ce54f0968f4de09bc4e5ad0a734 2024-03-26T17:12:39.245 INFO:journalctl@ceph.osd.4.smithi064.stdout:Mar 26 17:12:39 smithi064 podman[58845]: 2024-03-26 17:12:39.24454181 +0000 UTC m=+0.360678222 container init b300f5bdf28d35e182caf0db3c0732e79d28d33fcbcde63ec5f38d400e3027c9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:01ae7457193b3f46a870db683661dbc281d60ce54f0968f4de09bc4e5ad0a734, name=ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-4-deactivate, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=ceph-nvmeof-mon-bf9505f, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.build-date=20240319, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-03-26T17:12:39.396 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 26 17:12:38 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-7[50917]: 2024-03-26T17:12:38.946+0000 7f68c422d700 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-03-26T17:12:02.662964+0000 front 2024-03-26T17:12:02.662885+0000 (oldest deadline 2024-03-26T17:12:26.063366+0000) 2024-03-26T17:12:39.396 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 26 17:12:38 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-7[50917]: 2024-03-26T17:12:38.946+0000 7f68c422d700 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.44:6814 osd.1 since back 2024-03-26T17:12:11.864335+0000 front 2024-03-26T17:12:11.864356+0000 (oldest deadline 2024-03-26T17:12:34.764412+0000) 2024-03-26T17:12:39.396 INFO:journalctl@ceph.osd.5.smithi149.stdout:Mar 26 17:12:39 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-5[38953]: 2024-03-26T17:12:39.062+0000 7fdfaef6b700 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-03-26T17:12:03.295055+0000 front 2024-03-26T17:12:03.295081+0000 (oldest deadline 2024-03-26T17:12:27.395124+0000) 2024-03-26T17:12:39.396 INFO:journalctl@ceph.osd.5.smithi149.stdout:Mar 26 17:12:39 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-5[38953]: 2024-03-26T17:12:39.062+0000 7fdfaef6b700 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.44:6814 osd.1 since back 2024-03-26T17:12:11.495757+0000 front 2024-03-26T17:12:11.495740+0000 (oldest deadline 2024-03-26T17:12:34.995726+0000) 2024-03-26T17:12:39.543 INFO:journalctl@ceph.osd.4.smithi064.stdout:Mar 26 17:12:39 smithi064 podman[58845]: 2024-03-26 17:12:39.24808109 +0000 UTC m=+0.364217487 container start b300f5bdf28d35e182caf0db3c0732e79d28d33fcbcde63ec5f38d400e3027c9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:01ae7457193b3f46a870db683661dbc281d60ce54f0968f4de09bc4e5ad0a734, name=ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-4-deactivate, org.label-schema.build-date=20240319, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.33.5, RELEASE=ceph-nvmeof-mon-bf9505f, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30) 2024-03-26T17:12:39.544 INFO:journalctl@ceph.osd.4.smithi064.stdout:Mar 26 17:12:39 smithi064 podman[58845]: 2024-03-26 17:12:39.327543257 +0000 UTC m=+0.443679660 container attach b300f5bdf28d35e182caf0db3c0732e79d28d33fcbcde63ec5f38d400e3027c9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:01ae7457193b3f46a870db683661dbc281d60ce54f0968f4de09bc4e5ad0a734, name=ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-4-deactivate, GIT_CLEAN=True, org.label-schema.build-date=20240319, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=ceph-nvmeof-mon-bf9505f, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5) 2024-03-26T17:12:39.805 INFO:journalctl@ceph.osd.4.smithi064.stdout:Mar 26 17:12:39 smithi064 podman[58845]: 2024-03-26 17:12:39.543683829 +0000 UTC m=+0.659820224 container died b300f5bdf28d35e182caf0db3c0732e79d28d33fcbcde63ec5f38d400e3027c9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:01ae7457193b3f46a870db683661dbc281d60ce54f0968f4de09bc4e5ad0a734, name=ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-4-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=ceph-nvmeof-mon-bf9505f, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240319, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30) 2024-03-26T17:12:40.079 INFO:journalctl@ceph.osd.4.smithi064.stdout:Mar 26 17:12:40 smithi064 podman[58871]: 2024-03-26 17:12:40.063896452 +0000 UTC m=+0.515389838 container remove b300f5bdf28d35e182caf0db3c0732e79d28d33fcbcde63ec5f38d400e3027c9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:01ae7457193b3f46a870db683661dbc281d60ce54f0968f4de09bc4e5ad0a734, name=ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-4-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=ceph-nvmeof-mon-bf9505f, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240319, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-03-26T17:12:40.084 DEBUG:teuthology.orchestra.run.smithi064:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4394d798-eb90-11ee-95d0-87774f69a715@osd.4.service' 2024-03-26T17:12:40.100 INFO:journalctl@ceph.osd.6.smithi149.stdout:Mar 26 17:12:39 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-6[44855]: 2024-03-26T17:12:39.778+0000 7ffbc1ab7700 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-03-26T17:12:05.220703+0000 front 2024-03-26T17:12:05.220772+0000 (oldest deadline 2024-03-26T17:12:29.320723+0000) 2024-03-26T17:12:40.100 INFO:journalctl@ceph.osd.6.smithi149.stdout:Mar 26 17:12:39 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-6[44855]: 2024-03-26T17:12:39.778+0000 7ffbc1ab7700 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.44:6814 osd.1 since back 2024-03-26T17:12:12.821454+0000 front 2024-03-26T17:12:12.821572+0000 (oldest deadline 2024-03-26T17:12:34.521568+0000) 2024-03-26T17:12:40.100 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 26 17:12:39 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-7[50917]: 2024-03-26T17:12:39.974+0000 7f68c422d700 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-03-26T17:12:02.662964+0000 front 2024-03-26T17:12:02.662885+0000 (oldest deadline 2024-03-26T17:12:26.063366+0000) 2024-03-26T17:12:40.100 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 26 17:12:39 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-7[50917]: 2024-03-26T17:12:39.974+0000 7f68c422d700 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.44:6814 osd.1 since back 2024-03-26T17:12:11.864335+0000 front 2024-03-26T17:12:11.864356+0000 (oldest deadline 2024-03-26T17:12:34.764412+0000) 2024-03-26T17:12:40.123 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-26T17:12:40.123 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-03-26T17:12:40.123 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-03-26T17:12:40.124 DEBUG:teuthology.orchestra.run.smithi149:> sudo systemctl stop ceph-4394d798-eb90-11ee-95d0-87774f69a715@osd.5 2024-03-26T17:12:40.396 INFO:journalctl@ceph.osd.5.smithi149.stdout:Mar 26 17:12:40 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-5[38953]: 2024-03-26T17:12:40.099+0000 7fdfaef6b700 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-03-26T17:12:03.295055+0000 front 2024-03-26T17:12:03.295081+0000 (oldest deadline 2024-03-26T17:12:27.395124+0000) 2024-03-26T17:12:40.396 INFO:journalctl@ceph.osd.5.smithi149.stdout:Mar 26 17:12:40 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-5[38953]: 2024-03-26T17:12:40.099+0000 7fdfaef6b700 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.44:6814 osd.1 since back 2024-03-26T17:12:11.495757+0000 front 2024-03-26T17:12:11.495740+0000 (oldest deadline 2024-03-26T17:12:34.995726+0000) 2024-03-26T17:12:40.396 INFO:journalctl@ceph.osd.5.smithi149.stdout:Mar 26 17:12:40 smithi149 systemd[1]: Stopping Ceph osd.5 for 4394d798-eb90-11ee-95d0-87774f69a715... 2024-03-26T17:12:40.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:12:40 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:12:40] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:12:40.766 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:12:40 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:12:40] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:12:40.766 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:12:40 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:12:40.773 INFO:journalctl@ceph.osd.5.smithi149.stdout:Mar 26 17:12:40 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-5[38953]: 2024-03-26T17:12:40.447+0000 7fdfb2977700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-26T17:12:40.773 INFO:journalctl@ceph.osd.5.smithi149.stdout:Mar 26 17:12:40 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-5[38953]: 2024-03-26T17:12:40.447+0000 7fdfb2977700 -1 osd.5 80 *** Got signal Terminated *** 2024-03-26T17:12:40.773 INFO:journalctl@ceph.osd.5.smithi149.stdout:Mar 26 17:12:40 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-5[38953]: 2024-03-26T17:12:40.447+0000 7fdfb2977700 -1 osd.5 80 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-26T17:12:40.774 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:12:40 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:12:40] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:12:40.774 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:12:40 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:12:40] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:12:40.774 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:12:40 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:12:41.060 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 26 17:12:40 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-7[50917]: 2024-03-26T17:12:40.945+0000 7f68c422d700 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-03-26T17:12:02.662964+0000 front 2024-03-26T17:12:02.662885+0000 (oldest deadline 2024-03-26T17:12:26.063366+0000) 2024-03-26T17:12:41.061 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 26 17:12:40 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-7[50917]: 2024-03-26T17:12:40.945+0000 7f68c422d700 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.44:6814 osd.1 since back 2024-03-26T17:12:11.864335+0000 front 2024-03-26T17:12:11.864356+0000 (oldest deadline 2024-03-26T17:12:34.764412+0000) 2024-03-26T17:12:41.061 INFO:journalctl@ceph.osd.6.smithi149.stdout:Mar 26 17:12:40 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-6[44855]: 2024-03-26T17:12:40.772+0000 7ffbc1ab7700 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-03-26T17:12:05.220703+0000 front 2024-03-26T17:12:05.220772+0000 (oldest deadline 2024-03-26T17:12:29.320723+0000) 2024-03-26T17:12:41.061 INFO:journalctl@ceph.osd.6.smithi149.stdout:Mar 26 17:12:40 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-6[44855]: 2024-03-26T17:12:40.772+0000 7ffbc1ab7700 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.44:6814 osd.1 since back 2024-03-26T17:12:12.821454+0000 front 2024-03-26T17:12:12.821572+0000 (oldest deadline 2024-03-26T17:12:34.521568+0000) 2024-03-26T17:12:41.332 INFO:journalctl@ceph.osd.5.smithi149.stdout:Mar 26 17:12:41 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-5[38953]: 2024-03-26T17:12:41.059+0000 7fdfaef6b700 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-03-26T17:12:03.295055+0000 front 2024-03-26T17:12:03.295081+0000 (oldest deadline 2024-03-26T17:12:27.395124+0000) 2024-03-26T17:12:41.332 INFO:journalctl@ceph.osd.5.smithi149.stdout:Mar 26 17:12:41 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-5[38953]: 2024-03-26T17:12:41.059+0000 7fdfaef6b700 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.44:6814 osd.1 since back 2024-03-26T17:12:11.495757+0000 front 2024-03-26T17:12:11.495740+0000 (oldest deadline 2024-03-26T17:12:34.995726+0000) 2024-03-26T17:12:42.018 INFO:journalctl@ceph.osd.6.smithi149.stdout:Mar 26 17:12:41 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-6[44855]: 2024-03-26T17:12:41.761+0000 7ffbc1ab7700 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-03-26T17:12:05.220703+0000 front 2024-03-26T17:12:05.220772+0000 (oldest deadline 2024-03-26T17:12:29.320723+0000) 2024-03-26T17:12:42.019 INFO:journalctl@ceph.osd.6.smithi149.stdout:Mar 26 17:12:41 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-6[44855]: 2024-03-26T17:12:41.761+0000 7ffbc1ab7700 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.44:6814 osd.1 since back 2024-03-26T17:12:12.821454+0000 front 2024-03-26T17:12:12.821572+0000 (oldest deadline 2024-03-26T17:12:34.521568+0000) 2024-03-26T17:12:42.019 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 26 17:12:41 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-7[50917]: 2024-03-26T17:12:41.922+0000 7f68c422d700 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-03-26T17:12:02.662964+0000 front 2024-03-26T17:12:02.662885+0000 (oldest deadline 2024-03-26T17:12:26.063366+0000) 2024-03-26T17:12:42.019 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 26 17:12:41 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-7[50917]: 2024-03-26T17:12:41.922+0000 7f68c422d700 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.44:6814 osd.1 since back 2024-03-26T17:12:11.864335+0000 front 2024-03-26T17:12:11.864356+0000 (oldest deadline 2024-03-26T17:12:34.764412+0000) 2024-03-26T17:12:42.291 INFO:journalctl@ceph.osd.5.smithi149.stdout:Mar 26 17:12:42 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-5[38953]: 2024-03-26T17:12:42.017+0000 7fdfaef6b700 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-03-26T17:12:03.295055+0000 front 2024-03-26T17:12:03.295081+0000 (oldest deadline 2024-03-26T17:12:27.395124+0000) 2024-03-26T17:12:42.291 INFO:journalctl@ceph.osd.5.smithi149.stdout:Mar 26 17:12:42 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-5[38953]: 2024-03-26T17:12:42.017+0000 7fdfaef6b700 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.44:6814 osd.1 since back 2024-03-26T17:12:11.495757+0000 front 2024-03-26T17:12:11.495740+0000 (oldest deadline 2024-03-26T17:12:34.995726+0000) 2024-03-26T17:12:42.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:12:42 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:12:42] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:12:42.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:12:42 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:12:42] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:12:42.766 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:12:42 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:12:42.939 INFO:journalctl@ceph.osd.6.smithi149.stdout:Mar 26 17:12:42 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-6[44855]: 2024-03-26T17:12:42.778+0000 7ffbc1ab7700 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-03-26T17:12:05.220703+0000 front 2024-03-26T17:12:05.220772+0000 (oldest deadline 2024-03-26T17:12:29.320723+0000) 2024-03-26T17:12:42.939 INFO:journalctl@ceph.osd.6.smithi149.stdout:Mar 26 17:12:42 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-6[44855]: 2024-03-26T17:12:42.778+0000 7ffbc1ab7700 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.44:6814 osd.1 since back 2024-03-26T17:12:12.821454+0000 front 2024-03-26T17:12:12.821572+0000 (oldest deadline 2024-03-26T17:12:34.521568+0000) 2024-03-26T17:12:42.939 INFO:journalctl@ceph.osd.6.smithi149.stdout:Mar 26 17:12:42 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-6[44855]: 2024-03-26T17:12:42.778+0000 7ffbc1ab7700 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-03-26T17:12:18.422753+0000 front 2024-03-26T17:12:18.422695+0000 (oldest deadline 2024-03-26T17:12:41.922614+0000) 2024-03-26T17:12:42.940 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:12:42 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:12:42] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:12:42.940 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:12:42 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:12:42] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:12:42.940 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:12:42 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:12:43.396 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 26 17:12:42 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-7[50917]: 2024-03-26T17:12:42.938+0000 7f68c422d700 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-03-26T17:12:02.662964+0000 front 2024-03-26T17:12:02.662885+0000 (oldest deadline 2024-03-26T17:12:26.063366+0000) 2024-03-26T17:12:43.396 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 26 17:12:42 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-7[50917]: 2024-03-26T17:12:42.938+0000 7f68c422d700 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.44:6814 osd.1 since back 2024-03-26T17:12:11.864335+0000 front 2024-03-26T17:12:11.864356+0000 (oldest deadline 2024-03-26T17:12:34.764412+0000) 2024-03-26T17:12:43.396 INFO:journalctl@ceph.osd.5.smithi149.stdout:Mar 26 17:12:43 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-5[38953]: 2024-03-26T17:12:43.041+0000 7fdfaef6b700 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-03-26T17:12:03.295055+0000 front 2024-03-26T17:12:03.295081+0000 (oldest deadline 2024-03-26T17:12:27.395124+0000) 2024-03-26T17:12:43.396 INFO:journalctl@ceph.osd.5.smithi149.stdout:Mar 26 17:12:43 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-5[38953]: 2024-03-26T17:12:43.041+0000 7fdfaef6b700 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.44:6814 osd.1 since back 2024-03-26T17:12:11.495757+0000 front 2024-03-26T17:12:11.495740+0000 (oldest deadline 2024-03-26T17:12:34.995726+0000) 2024-03-26T17:12:44.069 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 26 17:12:43 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-7[50917]: 2024-03-26T17:12:43.949+0000 7f68c422d700 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-03-26T17:12:02.662964+0000 front 2024-03-26T17:12:02.662885+0000 (oldest deadline 2024-03-26T17:12:26.063366+0000) 2024-03-26T17:12:44.069 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 26 17:12:43 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-7[50917]: 2024-03-26T17:12:43.949+0000 7f68c422d700 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.44:6814 osd.1 since back 2024-03-26T17:12:11.864335+0000 front 2024-03-26T17:12:11.864356+0000 (oldest deadline 2024-03-26T17:12:34.764412+0000) 2024-03-26T17:12:44.069 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 26 17:12:43 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-7[50917]: 2024-03-26T17:12:43.949+0000 7f68c422d700 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-03-26T17:12:18.265205+0000 front 2024-03-26T17:12:18.265194+0000 (oldest deadline 2024-03-26T17:12:43.565110+0000) 2024-03-26T17:12:44.070 INFO:journalctl@ceph.osd.6.smithi149.stdout:Mar 26 17:12:43 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-6[44855]: 2024-03-26T17:12:43.785+0000 7ffbc1ab7700 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-03-26T17:12:05.220703+0000 front 2024-03-26T17:12:05.220772+0000 (oldest deadline 2024-03-26T17:12:29.320723+0000) 2024-03-26T17:12:44.070 INFO:journalctl@ceph.osd.6.smithi149.stdout:Mar 26 17:12:43 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-6[44855]: 2024-03-26T17:12:43.785+0000 7ffbc1ab7700 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.44:6814 osd.1 since back 2024-03-26T17:12:12.821454+0000 front 2024-03-26T17:12:12.821572+0000 (oldest deadline 2024-03-26T17:12:34.521568+0000) 2024-03-26T17:12:44.070 INFO:journalctl@ceph.osd.6.smithi149.stdout:Mar 26 17:12:43 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-6[44855]: 2024-03-26T17:12:43.785+0000 7ffbc1ab7700 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-03-26T17:12:18.422753+0000 front 2024-03-26T17:12:18.422695+0000 (oldest deadline 2024-03-26T17:12:41.922614+0000) 2024-03-26T17:12:44.395 INFO:journalctl@ceph.osd.5.smithi149.stdout:Mar 26 17:12:44 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-5[38953]: 2024-03-26T17:12:44.068+0000 7fdfaef6b700 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-03-26T17:12:03.295055+0000 front 2024-03-26T17:12:03.295081+0000 (oldest deadline 2024-03-26T17:12:27.395124+0000) 2024-03-26T17:12:44.396 INFO:journalctl@ceph.osd.5.smithi149.stdout:Mar 26 17:12:44 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-5[38953]: 2024-03-26T17:12:44.068+0000 7fdfaef6b700 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.44:6814 osd.1 since back 2024-03-26T17:12:11.495757+0000 front 2024-03-26T17:12:11.495740+0000 (oldest deadline 2024-03-26T17:12:34.995726+0000) 2024-03-26T17:12:44.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:12:44 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:12:44] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:12:44.766 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:12:44 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:12:44] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:12:44.766 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:12:44 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:12:44.987 INFO:journalctl@ceph.osd.6.smithi149.stdout:Mar 26 17:12:44 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-6[44855]: 2024-03-26T17:12:44.797+0000 7ffbc1ab7700 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-03-26T17:12:05.220703+0000 front 2024-03-26T17:12:05.220772+0000 (oldest deadline 2024-03-26T17:12:29.320723+0000) 2024-03-26T17:12:44.987 INFO:journalctl@ceph.osd.6.smithi149.stdout:Mar 26 17:12:44 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-6[44855]: 2024-03-26T17:12:44.797+0000 7ffbc1ab7700 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.44:6814 osd.1 since back 2024-03-26T17:12:12.821454+0000 front 2024-03-26T17:12:12.821572+0000 (oldest deadline 2024-03-26T17:12:34.521568+0000) 2024-03-26T17:12:44.987 INFO:journalctl@ceph.osd.6.smithi149.stdout:Mar 26 17:12:44 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-6[44855]: 2024-03-26T17:12:44.797+0000 7ffbc1ab7700 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-03-26T17:12:18.422753+0000 front 2024-03-26T17:12:18.422695+0000 (oldest deadline 2024-03-26T17:12:41.922614+0000) 2024-03-26T17:12:44.988 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:12:44 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:12:44] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:12:44.988 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:12:44 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:12:44] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:12:44.988 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:12:44 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:12:45.396 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 26 17:12:44 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-7[50917]: 2024-03-26T17:12:44.986+0000 7f68c422d700 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-03-26T17:12:02.662964+0000 front 2024-03-26T17:12:02.662885+0000 (oldest deadline 2024-03-26T17:12:26.063366+0000) 2024-03-26T17:12:45.396 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 26 17:12:44 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-7[50917]: 2024-03-26T17:12:44.986+0000 7f68c422d700 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.44:6814 osd.1 since back 2024-03-26T17:12:11.864335+0000 front 2024-03-26T17:12:11.864356+0000 (oldest deadline 2024-03-26T17:12:34.764412+0000) 2024-03-26T17:12:45.396 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 26 17:12:44 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-7[50917]: 2024-03-26T17:12:44.986+0000 7f68c422d700 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-03-26T17:12:18.265205+0000 front 2024-03-26T17:12:18.265194+0000 (oldest deadline 2024-03-26T17:12:43.565110+0000) 2024-03-26T17:12:45.396 INFO:journalctl@ceph.osd.5.smithi149.stdout:Mar 26 17:12:45 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-5[38953]: 2024-03-26T17:12:45.019+0000 7fdfaef6b700 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-03-26T17:12:03.295055+0000 front 2024-03-26T17:12:03.295081+0000 (oldest deadline 2024-03-26T17:12:27.395124+0000) 2024-03-26T17:12:45.396 INFO:journalctl@ceph.osd.5.smithi149.stdout:Mar 26 17:12:45 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-5[38953]: 2024-03-26T17:12:45.019+0000 7fdfaef6b700 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.44:6814 osd.1 since back 2024-03-26T17:12:11.495757+0000 front 2024-03-26T17:12:11.495740+0000 (oldest deadline 2024-03-26T17:12:34.995726+0000) 2024-03-26T17:12:45.396 INFO:journalctl@ceph.osd.5.smithi149.stdout:Mar 26 17:12:45 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-5[38953]: 2024-03-26T17:12:45.019+0000 7fdfaef6b700 -1 osd.5 80 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-03-26T17:12:20.296446+0000 front 2024-03-26T17:12:20.296378+0000 (oldest deadline 2024-03-26T17:12:44.396305+0000) 2024-03-26T17:12:46.035 INFO:journalctl@ceph.osd.5.smithi149.stdout:Mar 26 17:12:45 smithi149 podman[60460]: 2024-03-26 17:12:45.951640986 +0000 UTC m=+5.603733637 container died f609cac03816a667892f2a2d688613c8b1783aac13fb6dec36947fc157282878 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:01ae7457193b3f46a870db683661dbc281d60ce54f0968f4de09bc4e5ad0a734, name=ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-5, GIT_CLEAN=True, org.label-schema.build-date=20240319, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=ceph-nvmeof-mon-bf9505f, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-26T17:12:46.035 INFO:journalctl@ceph.osd.6.smithi149.stdout:Mar 26 17:12:45 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-6[44855]: 2024-03-26T17:12:45.762+0000 7ffbc1ab7700 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-03-26T17:12:05.220703+0000 front 2024-03-26T17:12:05.220772+0000 (oldest deadline 2024-03-26T17:12:29.320723+0000) 2024-03-26T17:12:46.035 INFO:journalctl@ceph.osd.6.smithi149.stdout:Mar 26 17:12:45 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-6[44855]: 2024-03-26T17:12:45.762+0000 7ffbc1ab7700 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.44:6814 osd.1 since back 2024-03-26T17:12:12.821454+0000 front 2024-03-26T17:12:12.821572+0000 (oldest deadline 2024-03-26T17:12:34.521568+0000) 2024-03-26T17:12:46.035 INFO:journalctl@ceph.osd.6.smithi149.stdout:Mar 26 17:12:45 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-6[44855]: 2024-03-26T17:12:45.762+0000 7ffbc1ab7700 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-03-26T17:12:18.422753+0000 front 2024-03-26T17:12:18.422695+0000 (oldest deadline 2024-03-26T17:12:41.922614+0000) 2024-03-26T17:12:46.339 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 26 17:12:46 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-7[50917]: 2024-03-26T17:12:46.033+0000 7f68c422d700 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-03-26T17:12:02.662964+0000 front 2024-03-26T17:12:02.662885+0000 (oldest deadline 2024-03-26T17:12:26.063366+0000) 2024-03-26T17:12:46.339 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 26 17:12:46 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-7[50917]: 2024-03-26T17:12:46.033+0000 7f68c422d700 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.44:6814 osd.1 since back 2024-03-26T17:12:11.864335+0000 front 2024-03-26T17:12:11.864356+0000 (oldest deadline 2024-03-26T17:12:34.764412+0000) 2024-03-26T17:12:46.339 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 26 17:12:46 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-7[50917]: 2024-03-26T17:12:46.033+0000 7f68c422d700 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-03-26T17:12:18.265205+0000 front 2024-03-26T17:12:18.265194+0000 (oldest deadline 2024-03-26T17:12:43.565110+0000) 2024-03-26T17:12:46.616 INFO:journalctl@ceph.osd.5.smithi149.stdout:Mar 26 17:12:46 smithi149 podman[60460]: 2024-03-26 17:12:46.338954316 +0000 UTC m=+5.991046968 container cleanup f609cac03816a667892f2a2d688613c8b1783aac13fb6dec36947fc157282878 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:01ae7457193b3f46a870db683661dbc281d60ce54f0968f4de09bc4e5ad0a734, name=ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-5, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, RELEASE=ceph-nvmeof-mon-bf9505f, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240319, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-03-26T17:12:46.616 INFO:journalctl@ceph.osd.5.smithi149.stdout:Mar 26 17:12:46 smithi149 bash[60460]: ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-5 2024-03-26T17:12:46.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:12:46 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:12:46] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:12:46.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:12:46 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:12:46] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:12:46.766 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:12:46 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:12:46.896 INFO:journalctl@ceph.osd.5.smithi149.stdout:Mar 26 17:12:46 smithi149 podman[60499]: 2024-03-26 17:12:46.61547122 +0000 UTC m=+0.654862189 container remove f609cac03816a667892f2a2d688613c8b1783aac13fb6dec36947fc157282878 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:01ae7457193b3f46a870db683661dbc281d60ce54f0968f4de09bc4e5ad0a734, name=ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-5, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240319, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=ceph-nvmeof-mon-bf9505f, org.label-schema.vendor=CentOS, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0) 2024-03-26T17:12:46.896 INFO:journalctl@ceph.osd.6.smithi149.stdout:Mar 26 17:12:46 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-6[44855]: 2024-03-26T17:12:46.723+0000 7ffbc1ab7700 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-03-26T17:12:05.220703+0000 front 2024-03-26T17:12:05.220772+0000 (oldest deadline 2024-03-26T17:12:29.320723+0000) 2024-03-26T17:12:46.896 INFO:journalctl@ceph.osd.6.smithi149.stdout:Mar 26 17:12:46 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-6[44855]: 2024-03-26T17:12:46.723+0000 7ffbc1ab7700 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.44:6814 osd.1 since back 2024-03-26T17:12:12.821454+0000 front 2024-03-26T17:12:12.821572+0000 (oldest deadline 2024-03-26T17:12:34.521568+0000) 2024-03-26T17:12:46.896 INFO:journalctl@ceph.osd.6.smithi149.stdout:Mar 26 17:12:46 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-6[44855]: 2024-03-26T17:12:46.723+0000 7ffbc1ab7700 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-03-26T17:12:18.422753+0000 front 2024-03-26T17:12:18.422695+0000 (oldest deadline 2024-03-26T17:12:41.922614+0000) 2024-03-26T17:12:46.897 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:12:46 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:12:46] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:12:46.897 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:12:46 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:12:46] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:12:46.897 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:12:46 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:12:47.252 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 26 17:12:46 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-7[50917]: 2024-03-26T17:12:46.995+0000 7f68c422d700 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-03-26T17:12:02.662964+0000 front 2024-03-26T17:12:02.662885+0000 (oldest deadline 2024-03-26T17:12:26.063366+0000) 2024-03-26T17:12:47.253 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 26 17:12:46 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-7[50917]: 2024-03-26T17:12:46.995+0000 7f68c422d700 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.44:6814 osd.1 since back 2024-03-26T17:12:11.864335+0000 front 2024-03-26T17:12:11.864356+0000 (oldest deadline 2024-03-26T17:12:34.764412+0000) 2024-03-26T17:12:47.253 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 26 17:12:46 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-7[50917]: 2024-03-26T17:12:46.995+0000 7f68c422d700 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-03-26T17:12:18.265205+0000 front 2024-03-26T17:12:18.265194+0000 (oldest deadline 2024-03-26T17:12:43.565110+0000) 2024-03-26T17:12:47.253 INFO:journalctl@ceph.osd.5.smithi149.stdout:Mar 26 17:12:46 smithi149 podman[60589]: 2024-03-26 17:12:46.822325387 +0000 UTC m=+0.018203581 image pull 5795ddf102746261652aa1cd1f517ace4dcfb8739ebbf229aeb81830d793ada0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:01ae7457193b3f46a870db683661dbc281d60ce54f0968f4de09bc4e5ad0a734 2024-03-26T17:12:47.253 INFO:journalctl@ceph.osd.5.smithi149.stdout:Mar 26 17:12:46 smithi149 podman[60589]: 2024-03-26 17:12:46.958351557 +0000 UTC m=+0.154229750 container create d109635944fd2ab9d4abb55a418df23f1b262897cdc17df6b70ce1e14243efd5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:01ae7457193b3f46a870db683661dbc281d60ce54f0968f4de09bc4e5ad0a734, name=ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-5-deactivate, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240319, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.33.5, RELEASE=ceph-nvmeof-mon-bf9505f) 2024-03-26T17:12:47.253 INFO:journalctl@ceph.osd.5.smithi149.stdout:Mar 26 17:12:47 smithi149 podman[60589]: 2024-03-26 17:12:47.252363969 +0000 UTC m=+0.448242163 container init d109635944fd2ab9d4abb55a418df23f1b262897cdc17df6b70ce1e14243efd5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:01ae7457193b3f46a870db683661dbc281d60ce54f0968f4de09bc4e5ad0a734, name=ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-5-deactivate, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.build-date=20240319, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=ceph-nvmeof-mon-bf9505f, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.license=GPLv2) 2024-03-26T17:12:47.646 INFO:journalctl@ceph.osd.5.smithi149.stdout:Mar 26 17:12:47 smithi149 podman[60589]: 2024-03-26 17:12:47.255922438 +0000 UTC m=+0.451800640 container start d109635944fd2ab9d4abb55a418df23f1b262897cdc17df6b70ce1e14243efd5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:01ae7457193b3f46a870db683661dbc281d60ce54f0968f4de09bc4e5ad0a734, name=ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-5-deactivate, RELEASE=ceph-nvmeof-mon-bf9505f, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240319, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-26T17:12:47.646 INFO:journalctl@ceph.osd.5.smithi149.stdout:Mar 26 17:12:47 smithi149 podman[60589]: 2024-03-26 17:12:47.403894512 +0000 UTC m=+0.599772718 container attach d109635944fd2ab9d4abb55a418df23f1b262897cdc17df6b70ce1e14243efd5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:01ae7457193b3f46a870db683661dbc281d60ce54f0968f4de09bc4e5ad0a734, name=ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-5-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=ceph-nvmeof-mon-bf9505f, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.build-date=20240319) 2024-03-26T17:12:48.146 INFO:journalctl@ceph.osd.6.smithi149.stdout:Mar 26 17:12:47 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-6[44855]: 2024-03-26T17:12:47.745+0000 7ffbc1ab7700 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-03-26T17:12:05.220703+0000 front 2024-03-26T17:12:05.220772+0000 (oldest deadline 2024-03-26T17:12:29.320723+0000) 2024-03-26T17:12:48.146 INFO:journalctl@ceph.osd.6.smithi149.stdout:Mar 26 17:12:47 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-6[44855]: 2024-03-26T17:12:47.745+0000 7ffbc1ab7700 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.44:6814 osd.1 since back 2024-03-26T17:12:12.821454+0000 front 2024-03-26T17:12:12.821572+0000 (oldest deadline 2024-03-26T17:12:34.521568+0000) 2024-03-26T17:12:48.146 INFO:journalctl@ceph.osd.6.smithi149.stdout:Mar 26 17:12:47 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-6[44855]: 2024-03-26T17:12:47.745+0000 7ffbc1ab7700 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-03-26T17:12:18.422753+0000 front 2024-03-26T17:12:18.422695+0000 (oldest deadline 2024-03-26T17:12:41.922614+0000) 2024-03-26T17:12:48.146 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 26 17:12:47 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-7[50917]: 2024-03-26T17:12:47.990+0000 7f68c422d700 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-03-26T17:12:02.662964+0000 front 2024-03-26T17:12:02.662885+0000 (oldest deadline 2024-03-26T17:12:26.063366+0000) 2024-03-26T17:12:48.146 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 26 17:12:47 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-7[50917]: 2024-03-26T17:12:47.990+0000 7f68c422d700 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.44:6814 osd.1 since back 2024-03-26T17:12:11.864335+0000 front 2024-03-26T17:12:11.864356+0000 (oldest deadline 2024-03-26T17:12:34.764412+0000) 2024-03-26T17:12:48.146 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 26 17:12:47 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-7[50917]: 2024-03-26T17:12:47.990+0000 7f68c422d700 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-03-26T17:12:18.265205+0000 front 2024-03-26T17:12:18.265194+0000 (oldest deadline 2024-03-26T17:12:43.565110+0000) 2024-03-26T17:12:48.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:12:48 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:12:48] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:12:48.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:12:48 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:12:48] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:12:48.765 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:12:48 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:12:48.973 INFO:journalctl@ceph.osd.5.smithi149.stdout:Mar 26 17:12:48 smithi149 podman[60589]: 2024-03-26 17:12:48.793102315 +0000 UTC m=+1.988980518 container died d109635944fd2ab9d4abb55a418df23f1b262897cdc17df6b70ce1e14243efd5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:01ae7457193b3f46a870db683661dbc281d60ce54f0968f4de09bc4e5ad0a734, name=ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-5-deactivate, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.build-date=20240319, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, RELEASE=ceph-nvmeof-mon-bf9505f) 2024-03-26T17:12:48.974 INFO:journalctl@ceph.osd.6.smithi149.stdout:Mar 26 17:12:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-6[44855]: 2024-03-26T17:12:48.719+0000 7ffbc1ab7700 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-03-26T17:12:05.220703+0000 front 2024-03-26T17:12:05.220772+0000 (oldest deadline 2024-03-26T17:12:29.320723+0000) 2024-03-26T17:12:48.974 INFO:journalctl@ceph.osd.6.smithi149.stdout:Mar 26 17:12:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-6[44855]: 2024-03-26T17:12:48.719+0000 7ffbc1ab7700 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.44:6814 osd.1 since back 2024-03-26T17:12:12.821454+0000 front 2024-03-26T17:12:12.821572+0000 (oldest deadline 2024-03-26T17:12:34.521568+0000) 2024-03-26T17:12:48.974 INFO:journalctl@ceph.osd.6.smithi149.stdout:Mar 26 17:12:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-6[44855]: 2024-03-26T17:12:48.719+0000 7ffbc1ab7700 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-03-26T17:12:18.422753+0000 front 2024-03-26T17:12:18.422695+0000 (oldest deadline 2024-03-26T17:12:41.922614+0000) 2024-03-26T17:12:48.974 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 26 17:12:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-7[50917]: 2024-03-26T17:12:48.972+0000 7f68c422d700 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-03-26T17:12:02.662964+0000 front 2024-03-26T17:12:02.662885+0000 (oldest deadline 2024-03-26T17:12:26.063366+0000) 2024-03-26T17:12:48.974 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 26 17:12:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-7[50917]: 2024-03-26T17:12:48.972+0000 7f68c422d700 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.44:6814 osd.1 since back 2024-03-26T17:12:11.864335+0000 front 2024-03-26T17:12:11.864356+0000 (oldest deadline 2024-03-26T17:12:34.764412+0000) 2024-03-26T17:12:48.974 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 26 17:12:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-7[50917]: 2024-03-26T17:12:48.972+0000 7f68c422d700 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-03-26T17:12:18.265205+0000 front 2024-03-26T17:12:18.265194+0000 (oldest deadline 2024-03-26T17:12:43.565110+0000) 2024-03-26T17:12:48.974 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 26 17:12:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-7[50917]: 2024-03-26T17:12:48.972+0000 7f68c422d700 -1 osd.7 80 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.15123.0:102940 2.5 2:a401fdfb:::rbd_header.39dee715f51e:head [watch ping cookie 139816687863840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80) 2024-03-26T17:12:48.975 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:12:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:12:48] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:12:48.975 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:12:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:12:48] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:12:48.975 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:12:48 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:12:49.390 DEBUG:teuthology.orchestra.run.smithi149:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4394d798-eb90-11ee-95d0-87774f69a715@osd.5.service' 2024-03-26T17:12:49.431 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-26T17:12:49.431 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-03-26T17:12:49.431 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-03-26T17:12:49.431 DEBUG:teuthology.orchestra.run.smithi149:> sudo systemctl stop ceph-4394d798-eb90-11ee-95d0-87774f69a715@osd.6 2024-03-26T17:12:49.646 INFO:journalctl@ceph.osd.6.smithi149.stdout:Mar 26 17:12:49 smithi149 systemd[1]: Stopping Ceph osd.6 for 4394d798-eb90-11ee-95d0-87774f69a715... 2024-03-26T17:12:50.146 INFO:journalctl@ceph.osd.6.smithi149.stdout:Mar 26 17:12:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-6[44855]: 2024-03-26T17:12:49.760+0000 7ffbc1ab7700 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-03-26T17:12:05.220703+0000 front 2024-03-26T17:12:05.220772+0000 (oldest deadline 2024-03-26T17:12:29.320723+0000) 2024-03-26T17:12:50.146 INFO:journalctl@ceph.osd.6.smithi149.stdout:Mar 26 17:12:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-6[44855]: 2024-03-26T17:12:49.760+0000 7ffbc1ab7700 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.44:6814 osd.1 since back 2024-03-26T17:12:12.821454+0000 front 2024-03-26T17:12:12.821572+0000 (oldest deadline 2024-03-26T17:12:34.521568+0000) 2024-03-26T17:12:50.147 INFO:journalctl@ceph.osd.6.smithi149.stdout:Mar 26 17:12:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-6[44855]: 2024-03-26T17:12:49.760+0000 7ffbc1ab7700 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-03-26T17:12:18.422753+0000 front 2024-03-26T17:12:18.422695+0000 (oldest deadline 2024-03-26T17:12:41.922614+0000) 2024-03-26T17:12:50.147 INFO:journalctl@ceph.osd.6.smithi149.stdout:Mar 26 17:12:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-6[44855]: 2024-03-26T17:12:49.791+0000 7ffbc94cb700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-26T17:12:50.147 INFO:journalctl@ceph.osd.6.smithi149.stdout:Mar 26 17:12:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-6[44855]: 2024-03-26T17:12:49.791+0000 7ffbc94cb700 -1 osd.6 80 *** Got signal Terminated *** 2024-03-26T17:12:50.147 INFO:journalctl@ceph.osd.6.smithi149.stdout:Mar 26 17:12:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-6[44855]: 2024-03-26T17:12:49.791+0000 7ffbc94cb700 -1 osd.6 80 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-26T17:12:50.147 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 26 17:12:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-7[50917]: 2024-03-26T17:12:49.929+0000 7f68c422d700 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-03-26T17:12:02.662964+0000 front 2024-03-26T17:12:02.662885+0000 (oldest deadline 2024-03-26T17:12:26.063366+0000) 2024-03-26T17:12:50.147 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 26 17:12:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-7[50917]: 2024-03-26T17:12:49.929+0000 7f68c422d700 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.44:6814 osd.1 since back 2024-03-26T17:12:11.864335+0000 front 2024-03-26T17:12:11.864356+0000 (oldest deadline 2024-03-26T17:12:34.764412+0000) 2024-03-26T17:12:50.147 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 26 17:12:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-7[50917]: 2024-03-26T17:12:49.929+0000 7f68c422d700 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-03-26T17:12:18.265205+0000 front 2024-03-26T17:12:18.265194+0000 (oldest deadline 2024-03-26T17:12:43.565110+0000) 2024-03-26T17:12:50.147 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 26 17:12:49 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-7[50917]: 2024-03-26T17:12:49.929+0000 7f68c422d700 -1 osd.7 80 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.15123.0:102940 2.5 2:a401fdfb:::rbd_header.39dee715f51e:head [watch ping cookie 139816687863840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80) 2024-03-26T17:12:50.971 INFO:journalctl@ceph.osd.6.smithi149.stdout:Mar 26 17:12:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-6[44855]: 2024-03-26T17:12:50.801+0000 7ffbc1ab7700 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-03-26T17:12:05.220703+0000 front 2024-03-26T17:12:05.220772+0000 (oldest deadline 2024-03-26T17:12:29.320723+0000) 2024-03-26T17:12:50.971 INFO:journalctl@ceph.osd.6.smithi149.stdout:Mar 26 17:12:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-6[44855]: 2024-03-26T17:12:50.801+0000 7ffbc1ab7700 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.44:6814 osd.1 since back 2024-03-26T17:12:12.821454+0000 front 2024-03-26T17:12:12.821572+0000 (oldest deadline 2024-03-26T17:12:34.521568+0000) 2024-03-26T17:12:50.971 INFO:journalctl@ceph.osd.6.smithi149.stdout:Mar 26 17:12:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-6[44855]: 2024-03-26T17:12:50.801+0000 7ffbc1ab7700 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-03-26T17:12:18.422753+0000 front 2024-03-26T17:12:18.422695+0000 (oldest deadline 2024-03-26T17:12:41.922614+0000) 2024-03-26T17:12:50.971 INFO:journalctl@ceph.osd.6.smithi149.stdout:Mar 26 17:12:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-6[44855]: 2024-03-26T17:12:50.801+0000 7ffbc1ab7700 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.64:6812 osd.3 since back 2024-03-26T17:12:26.623392+0000 front 2024-03-26T17:12:26.623421+0000 (oldest deadline 2024-03-26T17:12:50.723266+0000) 2024-03-26T17:12:50.971 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:12:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:12:50] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:12:50.971 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:12:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:12:50] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:12:50.972 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:12:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:12:51.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:12:50 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:12:50] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:12:51.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:12:50 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:12:50] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:12:51.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:12:50 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:12:51.396 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 26 17:12:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-7[50917]: 2024-03-26T17:12:50.969+0000 7f68c422d700 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-03-26T17:12:02.662964+0000 front 2024-03-26T17:12:02.662885+0000 (oldest deadline 2024-03-26T17:12:26.063366+0000) 2024-03-26T17:12:51.396 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 26 17:12:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-7[50917]: 2024-03-26T17:12:50.969+0000 7f68c422d700 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.44:6814 osd.1 since back 2024-03-26T17:12:11.864335+0000 front 2024-03-26T17:12:11.864356+0000 (oldest deadline 2024-03-26T17:12:34.764412+0000) 2024-03-26T17:12:51.396 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 26 17:12:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-7[50917]: 2024-03-26T17:12:50.969+0000 7f68c422d700 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-03-26T17:12:18.265205+0000 front 2024-03-26T17:12:18.265194+0000 (oldest deadline 2024-03-26T17:12:43.565110+0000) 2024-03-26T17:12:51.396 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 26 17:12:50 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-7[50917]: 2024-03-26T17:12:50.970+0000 7f68c422d700 -1 osd.7 80 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.15123.0:102940 2.5 2:a401fdfb:::rbd_header.39dee715f51e:head [watch ping cookie 139816687863840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80) 2024-03-26T17:12:52.146 INFO:journalctl@ceph.osd.6.smithi149.stdout:Mar 26 17:12:51 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-6[44855]: 2024-03-26T17:12:51.782+0000 7ffbc1ab7700 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-03-26T17:12:05.220703+0000 front 2024-03-26T17:12:05.220772+0000 (oldest deadline 2024-03-26T17:12:29.320723+0000) 2024-03-26T17:12:52.146 INFO:journalctl@ceph.osd.6.smithi149.stdout:Mar 26 17:12:51 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-6[44855]: 2024-03-26T17:12:51.782+0000 7ffbc1ab7700 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.44:6814 osd.1 since back 2024-03-26T17:12:12.821454+0000 front 2024-03-26T17:12:12.821572+0000 (oldest deadline 2024-03-26T17:12:34.521568+0000) 2024-03-26T17:12:52.146 INFO:journalctl@ceph.osd.6.smithi149.stdout:Mar 26 17:12:51 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-6[44855]: 2024-03-26T17:12:51.782+0000 7ffbc1ab7700 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-03-26T17:12:18.422753+0000 front 2024-03-26T17:12:18.422695+0000 (oldest deadline 2024-03-26T17:12:41.922614+0000) 2024-03-26T17:12:52.146 INFO:journalctl@ceph.osd.6.smithi149.stdout:Mar 26 17:12:51 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-6[44855]: 2024-03-26T17:12:51.782+0000 7ffbc1ab7700 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.64:6812 osd.3 since back 2024-03-26T17:12:26.623392+0000 front 2024-03-26T17:12:26.623421+0000 (oldest deadline 2024-03-26T17:12:50.723266+0000) 2024-03-26T17:12:52.146 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 26 17:12:51 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-7[50917]: 2024-03-26T17:12:51.980+0000 7f68c422d700 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-03-26T17:12:02.662964+0000 front 2024-03-26T17:12:02.662885+0000 (oldest deadline 2024-03-26T17:12:26.063366+0000) 2024-03-26T17:12:52.146 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 26 17:12:51 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-7[50917]: 2024-03-26T17:12:51.980+0000 7f68c422d700 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.44:6814 osd.1 since back 2024-03-26T17:12:11.864335+0000 front 2024-03-26T17:12:11.864356+0000 (oldest deadline 2024-03-26T17:12:34.764412+0000) 2024-03-26T17:12:52.146 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 26 17:12:51 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-7[50917]: 2024-03-26T17:12:51.980+0000 7f68c422d700 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-03-26T17:12:18.265205+0000 front 2024-03-26T17:12:18.265194+0000 (oldest deadline 2024-03-26T17:12:43.565110+0000) 2024-03-26T17:12:52.147 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 26 17:12:51 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-7[50917]: 2024-03-26T17:12:51.980+0000 7f68c422d700 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.64:6812 osd.3 since back 2024-03-26T17:12:28.766050+0000 front 2024-03-26T17:12:28.765976+0000 (oldest deadline 2024-03-26T17:12:51.665984+0000) 2024-03-26T17:12:52.147 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 26 17:12:51 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-7[50917]: 2024-03-26T17:12:51.980+0000 7f68c422d700 -1 osd.7 80 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.15123.0:102940 2.5 2:a401fdfb:::rbd_header.39dee715f51e:head [watch ping cookie 139816687863840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80) 2024-03-26T17:12:53.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:12:52 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:12:52] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:12:53.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:12:52 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:12:52] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:12:53.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:12:52 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:12:53.146 INFO:journalctl@ceph.osd.6.smithi149.stdout:Mar 26 17:12:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-6[44855]: 2024-03-26T17:12:52.827+0000 7ffbc1ab7700 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-03-26T17:12:05.220703+0000 front 2024-03-26T17:12:05.220772+0000 (oldest deadline 2024-03-26T17:12:29.320723+0000) 2024-03-26T17:12:53.146 INFO:journalctl@ceph.osd.6.smithi149.stdout:Mar 26 17:12:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-6[44855]: 2024-03-26T17:12:52.827+0000 7ffbc1ab7700 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.44:6814 osd.1 since back 2024-03-26T17:12:12.821454+0000 front 2024-03-26T17:12:12.821572+0000 (oldest deadline 2024-03-26T17:12:34.521568+0000) 2024-03-26T17:12:53.146 INFO:journalctl@ceph.osd.6.smithi149.stdout:Mar 26 17:12:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-6[44855]: 2024-03-26T17:12:52.827+0000 7ffbc1ab7700 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-03-26T17:12:18.422753+0000 front 2024-03-26T17:12:18.422695+0000 (oldest deadline 2024-03-26T17:12:41.922614+0000) 2024-03-26T17:12:53.146 INFO:journalctl@ceph.osd.6.smithi149.stdout:Mar 26 17:12:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-6[44855]: 2024-03-26T17:12:52.827+0000 7ffbc1ab7700 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.64:6812 osd.3 since back 2024-03-26T17:12:26.623392+0000 front 2024-03-26T17:12:26.623421+0000 (oldest deadline 2024-03-26T17:12:50.723266+0000) 2024-03-26T17:12:53.146 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 26 17:12:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-7[50917]: 2024-03-26T17:12:52.950+0000 7f68c422d700 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-03-26T17:12:02.662964+0000 front 2024-03-26T17:12:02.662885+0000 (oldest deadline 2024-03-26T17:12:26.063366+0000) 2024-03-26T17:12:53.146 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 26 17:12:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-7[50917]: 2024-03-26T17:12:52.950+0000 7f68c422d700 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.44:6814 osd.1 since back 2024-03-26T17:12:11.864335+0000 front 2024-03-26T17:12:11.864356+0000 (oldest deadline 2024-03-26T17:12:34.764412+0000) 2024-03-26T17:12:53.146 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 26 17:12:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-7[50917]: 2024-03-26T17:12:52.950+0000 7f68c422d700 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-03-26T17:12:18.265205+0000 front 2024-03-26T17:12:18.265194+0000 (oldest deadline 2024-03-26T17:12:43.565110+0000) 2024-03-26T17:12:53.146 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 26 17:12:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-7[50917]: 2024-03-26T17:12:52.950+0000 7f68c422d700 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.64:6812 osd.3 since back 2024-03-26T17:12:28.766050+0000 front 2024-03-26T17:12:28.765976+0000 (oldest deadline 2024-03-26T17:12:51.665984+0000) 2024-03-26T17:12:53.146 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 26 17:12:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-7[50917]: 2024-03-26T17:12:52.950+0000 7f68c422d700 -1 osd.7 80 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.15123.0:102940 2.5 2:a401fdfb:::rbd_header.39dee715f51e:head [watch ping cookie 139816687863840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80) 2024-03-26T17:12:53.147 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:12:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:12:52] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:12:53.147 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:12:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:12:52] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:12:53.147 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:12:52 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:12:54.146 INFO:journalctl@ceph.osd.6.smithi149.stdout:Mar 26 17:12:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-6[44855]: 2024-03-26T17:12:53.860+0000 7ffbc1ab7700 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-03-26T17:12:05.220703+0000 front 2024-03-26T17:12:05.220772+0000 (oldest deadline 2024-03-26T17:12:29.320723+0000) 2024-03-26T17:12:54.146 INFO:journalctl@ceph.osd.6.smithi149.stdout:Mar 26 17:12:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-6[44855]: 2024-03-26T17:12:53.860+0000 7ffbc1ab7700 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.44:6814 osd.1 since back 2024-03-26T17:12:12.821454+0000 front 2024-03-26T17:12:12.821572+0000 (oldest deadline 2024-03-26T17:12:34.521568+0000) 2024-03-26T17:12:54.146 INFO:journalctl@ceph.osd.6.smithi149.stdout:Mar 26 17:12:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-6[44855]: 2024-03-26T17:12:53.860+0000 7ffbc1ab7700 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-03-26T17:12:18.422753+0000 front 2024-03-26T17:12:18.422695+0000 (oldest deadline 2024-03-26T17:12:41.922614+0000) 2024-03-26T17:12:54.146 INFO:journalctl@ceph.osd.6.smithi149.stdout:Mar 26 17:12:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-6[44855]: 2024-03-26T17:12:53.860+0000 7ffbc1ab7700 -1 osd.6 80 heartbeat_check: no reply from 172.21.15.64:6812 osd.3 since back 2024-03-26T17:12:26.623392+0000 front 2024-03-26T17:12:26.623421+0000 (oldest deadline 2024-03-26T17:12:50.723266+0000) 2024-03-26T17:12:54.146 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 26 17:12:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-7[50917]: 2024-03-26T17:12:53.949+0000 7f68c422d700 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-03-26T17:12:02.662964+0000 front 2024-03-26T17:12:02.662885+0000 (oldest deadline 2024-03-26T17:12:26.063366+0000) 2024-03-26T17:12:54.147 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 26 17:12:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-7[50917]: 2024-03-26T17:12:53.949+0000 7f68c422d700 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.44:6814 osd.1 since back 2024-03-26T17:12:11.864335+0000 front 2024-03-26T17:12:11.864356+0000 (oldest deadline 2024-03-26T17:12:34.764412+0000) 2024-03-26T17:12:54.147 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 26 17:12:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-7[50917]: 2024-03-26T17:12:53.949+0000 7f68c422d700 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-03-26T17:12:18.265205+0000 front 2024-03-26T17:12:18.265194+0000 (oldest deadline 2024-03-26T17:12:43.565110+0000) 2024-03-26T17:12:54.147 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 26 17:12:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-7[50917]: 2024-03-26T17:12:53.949+0000 7f68c422d700 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.64:6812 osd.3 since back 2024-03-26T17:12:28.766050+0000 front 2024-03-26T17:12:28.765976+0000 (oldest deadline 2024-03-26T17:12:51.665984+0000) 2024-03-26T17:12:54.147 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 26 17:12:53 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-7[50917]: 2024-03-26T17:12:53.949+0000 7f68c422d700 -1 osd.7 80 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.15123.0:102940 2.5 2:a401fdfb:::rbd_header.39dee715f51e:head [watch ping cookie 139816687863840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80) 2024-03-26T17:12:55.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:12:54 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:12:54] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:12:55.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:12:54 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:12:54] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:12:55.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:12:54 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:12:55.048 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 26 17:12:54 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-7[50917]: 2024-03-26T17:12:54.926+0000 7f68c422d700 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-03-26T17:12:02.662964+0000 front 2024-03-26T17:12:02.662885+0000 (oldest deadline 2024-03-26T17:12:26.063366+0000) 2024-03-26T17:12:55.048 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 26 17:12:54 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-7[50917]: 2024-03-26T17:12:54.926+0000 7f68c422d700 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.44:6814 osd.1 since back 2024-03-26T17:12:11.864335+0000 front 2024-03-26T17:12:11.864356+0000 (oldest deadline 2024-03-26T17:12:34.764412+0000) 2024-03-26T17:12:55.048 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 26 17:12:54 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-7[50917]: 2024-03-26T17:12:54.926+0000 7f68c422d700 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-03-26T17:12:18.265205+0000 front 2024-03-26T17:12:18.265194+0000 (oldest deadline 2024-03-26T17:12:43.565110+0000) 2024-03-26T17:12:55.048 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 26 17:12:54 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-7[50917]: 2024-03-26T17:12:54.926+0000 7f68c422d700 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.64:6812 osd.3 since back 2024-03-26T17:12:28.766050+0000 front 2024-03-26T17:12:28.765976+0000 (oldest deadline 2024-03-26T17:12:51.665984+0000) 2024-03-26T17:12:55.048 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 26 17:12:54 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-7[50917]: 2024-03-26T17:12:54.926+0000 7f68c422d700 -1 osd.7 80 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.15123.0:102940 2.5 2:a401fdfb:::rbd_header.39dee715f51e:head [watch ping cookie 139816687863840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80) 2024-03-26T17:12:55.049 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:12:54 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:12:54] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:12:55.049 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:12:54 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:12:54] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:12:55.049 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:12:54 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:12:55.395 INFO:journalctl@ceph.osd.6.smithi149.stdout:Mar 26 17:12:55 smithi149 podman[60696]: 2024-03-26 17:12:55.210682583 +0000 UTC m=+5.535019589 container died 78e32de9715717ff2330ad52b7cf18f124639b83a414bd67d229c31bbdc6d530 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:01ae7457193b3f46a870db683661dbc281d60ce54f0968f4de09bc4e5ad0a734, name=ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-6, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240319, RELEASE=ceph-nvmeof-mon-bf9505f, GIT_BRANCH=HEAD, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-03-26T17:12:55.735 INFO:journalctl@ceph.osd.6.smithi149.stdout:Mar 26 17:12:55 smithi149 podman[60696]: 2024-03-26 17:12:55.541918684 +0000 UTC m=+5.866255679 container cleanup 78e32de9715717ff2330ad52b7cf18f124639b83a414bd67d229c31bbdc6d530 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:01ae7457193b3f46a870db683661dbc281d60ce54f0968f4de09bc4e5ad0a734, name=ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-6, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240319, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=ceph-nvmeof-mon-bf9505f, org.label-schema.license=GPLv2, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux ) 2024-03-26T17:12:55.735 INFO:journalctl@ceph.osd.6.smithi149.stdout:Mar 26 17:12:55 smithi149 bash[60696]: ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-6 2024-03-26T17:12:56.146 INFO:journalctl@ceph.osd.6.smithi149.stdout:Mar 26 17:12:55 smithi149 podman[60722]: 2024-03-26 17:12:55.734862685 +0000 UTC m=+0.522953336 container remove 78e32de9715717ff2330ad52b7cf18f124639b83a414bd67d229c31bbdc6d530 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:01ae7457193b3f46a870db683661dbc281d60ce54f0968f4de09bc4e5ad0a734, name=ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-6, RELEASE=ceph-nvmeof-mon-bf9505f, org.label-schema.schema-version=1.0, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, io.buildah.version=1.33.5, org.label-schema.build-date=20240319, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-03-26T17:12:56.146 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 26 17:12:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-7[50917]: 2024-03-26T17:12:55.891+0000 7f68c422d700 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-03-26T17:12:02.662964+0000 front 2024-03-26T17:12:02.662885+0000 (oldest deadline 2024-03-26T17:12:26.063366+0000) 2024-03-26T17:12:56.146 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 26 17:12:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-7[50917]: 2024-03-26T17:12:55.891+0000 7f68c422d700 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.44:6814 osd.1 since back 2024-03-26T17:12:11.864335+0000 front 2024-03-26T17:12:11.864356+0000 (oldest deadline 2024-03-26T17:12:34.764412+0000) 2024-03-26T17:12:56.146 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 26 17:12:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-7[50917]: 2024-03-26T17:12:55.891+0000 7f68c422d700 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-03-26T17:12:18.265205+0000 front 2024-03-26T17:12:18.265194+0000 (oldest deadline 2024-03-26T17:12:43.565110+0000) 2024-03-26T17:12:56.146 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 26 17:12:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-7[50917]: 2024-03-26T17:12:55.891+0000 7f68c422d700 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.64:6812 osd.3 since back 2024-03-26T17:12:28.766050+0000 front 2024-03-26T17:12:28.765976+0000 (oldest deadline 2024-03-26T17:12:51.665984+0000) 2024-03-26T17:12:56.146 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 26 17:12:55 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-7[50917]: 2024-03-26T17:12:55.891+0000 7f68c422d700 -1 osd.7 80 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.15123.0:102940 2.5 2:a401fdfb:::rbd_header.39dee715f51e:head [watch ping cookie 139816687863840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80) 2024-03-26T17:12:56.505 INFO:journalctl@ceph.osd.6.smithi149.stdout:Mar 26 17:12:56 smithi149 podman[60811]: 2024-03-26 17:12:56.053348769 +0000 UTC m=+0.017683496 image pull 5795ddf102746261652aa1cd1f517ace4dcfb8739ebbf229aeb81830d793ada0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:01ae7457193b3f46a870db683661dbc281d60ce54f0968f4de09bc4e5ad0a734 2024-03-26T17:12:56.505 INFO:journalctl@ceph.osd.6.smithi149.stdout:Mar 26 17:12:56 smithi149 podman[60811]: 2024-03-26 17:12:56.161465122 +0000 UTC m=+0.125799840 container create 036a305274a70fee04e4b8f128f5504e20d8d55723410d8486c23e9f52496e89 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:01ae7457193b3f46a870db683661dbc281d60ce54f0968f4de09bc4e5ad0a734, name=ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-6-deactivate, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, io.buildah.version=1.33.5, org.label-schema.build-date=20240319, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=ceph-nvmeof-mon-bf9505f, ceph=True) 2024-03-26T17:12:56.505 INFO:journalctl@ceph.osd.6.smithi149.stdout:Mar 26 17:12:56 smithi149 podman[60811]: 2024-03-26 17:12:56.379557587 +0000 UTC m=+0.343892305 container init 036a305274a70fee04e4b8f128f5504e20d8d55723410d8486c23e9f52496e89 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:01ae7457193b3f46a870db683661dbc281d60ce54f0968f4de09bc4e5ad0a734, name=ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-6-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240319, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, RELEASE=ceph-nvmeof-mon-bf9505f, org.label-schema.vendor=CentOS) 2024-03-26T17:12:56.505 INFO:journalctl@ceph.osd.6.smithi149.stdout:Mar 26 17:12:56 smithi149 podman[60811]: 2024-03-26 17:12:56.382751362 +0000 UTC m=+0.347086090 container start 036a305274a70fee04e4b8f128f5504e20d8d55723410d8486c23e9f52496e89 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:01ae7457193b3f46a870db683661dbc281d60ce54f0968f4de09bc4e5ad0a734, name=ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-6-deactivate, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, RELEASE=ceph-nvmeof-mon-bf9505f, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240319, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-03-26T17:12:56.505 INFO:journalctl@ceph.osd.6.smithi149.stdout:Mar 26 17:12:56 smithi149 podman[60811]: 2024-03-26 17:12:56.504666667 +0000 UTC m=+0.469001408 container attach 036a305274a70fee04e4b8f128f5504e20d8d55723410d8486c23e9f52496e89 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:01ae7457193b3f46a870db683661dbc281d60ce54f0968f4de09bc4e5ad0a734, name=ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-6-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=ceph-nvmeof-mon-bf9505f, org.label-schema.build-date=20240319, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, ceph=True) 2024-03-26T17:12:56.761 INFO:journalctl@ceph.osd.6.smithi149.stdout:Mar 26 17:12:56 smithi149 podman[60811]: 2024-03-26 17:12:56.693177611 +0000 UTC m=+0.657512323 container died 036a305274a70fee04e4b8f128f5504e20d8d55723410d8486c23e9f52496e89 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:01ae7457193b3f46a870db683661dbc281d60ce54f0968f4de09bc4e5ad0a734, name=ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-6-deactivate, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240319, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, RELEASE=ceph-nvmeof-mon-bf9505f, ceph=True, org.label-schema.vendor=CentOS) 2024-03-26T17:12:56.762 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:12:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:12:56] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:12:56.762 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:12:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:12:56] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:12:56.762 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:12:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:12:57.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:12:56 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:12:56] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:12:57.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:12:56 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:12:56] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:12:57.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:12:56 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:12:57.146 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 26 17:12:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-7[50917]: 2024-03-26T17:12:56.903+0000 7f68c422d700 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-03-26T17:12:02.662964+0000 front 2024-03-26T17:12:02.662885+0000 (oldest deadline 2024-03-26T17:12:26.063366+0000) 2024-03-26T17:12:57.146 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 26 17:12:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-7[50917]: 2024-03-26T17:12:56.903+0000 7f68c422d700 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.44:6814 osd.1 since back 2024-03-26T17:12:11.864335+0000 front 2024-03-26T17:12:11.864356+0000 (oldest deadline 2024-03-26T17:12:34.764412+0000) 2024-03-26T17:12:57.146 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 26 17:12:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-7[50917]: 2024-03-26T17:12:56.903+0000 7f68c422d700 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-03-26T17:12:18.265205+0000 front 2024-03-26T17:12:18.265194+0000 (oldest deadline 2024-03-26T17:12:43.565110+0000) 2024-03-26T17:12:57.146 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 26 17:12:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-7[50917]: 2024-03-26T17:12:56.903+0000 7f68c422d700 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.64:6812 osd.3 since back 2024-03-26T17:12:28.766050+0000 front 2024-03-26T17:12:28.765976+0000 (oldest deadline 2024-03-26T17:12:51.665984+0000) 2024-03-26T17:12:57.146 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 26 17:12:56 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-7[50917]: 2024-03-26T17:12:56.903+0000 7f68c422d700 -1 osd.7 80 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.15123.0:102940 2.5 2:a401fdfb:::rbd_header.39dee715f51e:head [watch ping cookie 139816687863840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80) 2024-03-26T17:12:57.270 DEBUG:teuthology.orchestra.run.smithi149:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4394d798-eb90-11ee-95d0-87774f69a715@osd.6.service' 2024-03-26T17:12:57.309 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-26T17:12:57.309 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-03-26T17:12:57.309 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-03-26T17:12:57.310 DEBUG:teuthology.orchestra.run.smithi149:> sudo systemctl stop ceph-4394d798-eb90-11ee-95d0-87774f69a715@osd.7 2024-03-26T17:12:57.646 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 26 17:12:57 smithi149 systemd[1]: Stopping Ceph osd.7 for 4394d798-eb90-11ee-95d0-87774f69a715... 2024-03-26T17:12:57.905 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 26 17:12:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-7[50917]: 2024-03-26T17:12:57.654+0000 7f68c7c39700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-26T17:12:57.906 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 26 17:12:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-7[50917]: 2024-03-26T17:12:57.654+0000 7f68c7c39700 -1 osd.7 80 *** Got signal Terminated *** 2024-03-26T17:12:57.906 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 26 17:12:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-7[50917]: 2024-03-26T17:12:57.654+0000 7f68c7c39700 -1 osd.7 80 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-26T17:12:58.396 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 26 17:12:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-7[50917]: 2024-03-26T17:12:57.905+0000 7f68c422d700 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-03-26T17:12:02.662964+0000 front 2024-03-26T17:12:02.662885+0000 (oldest deadline 2024-03-26T17:12:26.063366+0000) 2024-03-26T17:12:58.396 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 26 17:12:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-7[50917]: 2024-03-26T17:12:57.905+0000 7f68c422d700 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.44:6814 osd.1 since back 2024-03-26T17:12:11.864335+0000 front 2024-03-26T17:12:11.864356+0000 (oldest deadline 2024-03-26T17:12:34.764412+0000) 2024-03-26T17:12:58.396 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 26 17:12:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-7[50917]: 2024-03-26T17:12:57.905+0000 7f68c422d700 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-03-26T17:12:18.265205+0000 front 2024-03-26T17:12:18.265194+0000 (oldest deadline 2024-03-26T17:12:43.565110+0000) 2024-03-26T17:12:58.396 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 26 17:12:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-7[50917]: 2024-03-26T17:12:57.905+0000 7f68c422d700 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.64:6812 osd.3 since back 2024-03-26T17:12:28.766050+0000 front 2024-03-26T17:12:28.765976+0000 (oldest deadline 2024-03-26T17:12:51.665984+0000) 2024-03-26T17:12:58.396 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 26 17:12:57 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-7[50917]: 2024-03-26T17:12:57.905+0000 7f68c422d700 -1 osd.7 80 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.15123.0:102940 2.5 2:a401fdfb:::rbd_header.39dee715f51e:head [watch ping cookie 139816687863840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80) 2024-03-26T17:12:59.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:12:58 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:12:58] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:12:59.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:12:58 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:12:58] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:12:59.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:12:58 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:12:59.146 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 26 17:12:58 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-7[50917]: 2024-03-26T17:12:58.874+0000 7f68c422d700 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-03-26T17:12:02.662964+0000 front 2024-03-26T17:12:02.662885+0000 (oldest deadline 2024-03-26T17:12:26.063366+0000) 2024-03-26T17:12:59.146 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 26 17:12:58 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-7[50917]: 2024-03-26T17:12:58.874+0000 7f68c422d700 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.44:6814 osd.1 since back 2024-03-26T17:12:11.864335+0000 front 2024-03-26T17:12:11.864356+0000 (oldest deadline 2024-03-26T17:12:34.764412+0000) 2024-03-26T17:12:59.146 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 26 17:12:58 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-7[50917]: 2024-03-26T17:12:58.874+0000 7f68c422d700 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-03-26T17:12:18.265205+0000 front 2024-03-26T17:12:18.265194+0000 (oldest deadline 2024-03-26T17:12:43.565110+0000) 2024-03-26T17:12:59.146 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 26 17:12:58 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-7[50917]: 2024-03-26T17:12:58.874+0000 7f68c422d700 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.64:6812 osd.3 since back 2024-03-26T17:12:28.766050+0000 front 2024-03-26T17:12:28.765976+0000 (oldest deadline 2024-03-26T17:12:51.665984+0000) 2024-03-26T17:12:59.146 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 26 17:12:58 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-7[50917]: 2024-03-26T17:12:58.874+0000 7f68c422d700 -1 osd.7 80 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.15123.0:102940 2.5 2:a401fdfb:::rbd_header.39dee715f51e:head [watch ping cookie 139816687863840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80) 2024-03-26T17:12:59.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:12:58 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:12:58] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:12:59.147 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:12:58 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:12:58] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:12:59.147 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:12:58 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:13:00.396 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 26 17:12:59 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-7[50917]: 2024-03-26T17:12:59.901+0000 7f68c422d700 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-03-26T17:12:02.662964+0000 front 2024-03-26T17:12:02.662885+0000 (oldest deadline 2024-03-26T17:12:26.063366+0000) 2024-03-26T17:13:00.396 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 26 17:12:59 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-7[50917]: 2024-03-26T17:12:59.901+0000 7f68c422d700 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.44:6814 osd.1 since back 2024-03-26T17:12:11.864335+0000 front 2024-03-26T17:12:11.864356+0000 (oldest deadline 2024-03-26T17:12:34.764412+0000) 2024-03-26T17:13:00.396 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 26 17:12:59 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-7[50917]: 2024-03-26T17:12:59.901+0000 7f68c422d700 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-03-26T17:12:18.265205+0000 front 2024-03-26T17:12:18.265194+0000 (oldest deadline 2024-03-26T17:12:43.565110+0000) 2024-03-26T17:13:00.396 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 26 17:12:59 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-7[50917]: 2024-03-26T17:12:59.901+0000 7f68c422d700 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.64:6812 osd.3 since back 2024-03-26T17:12:28.766050+0000 front 2024-03-26T17:12:28.765976+0000 (oldest deadline 2024-03-26T17:12:51.665984+0000) 2024-03-26T17:13:00.396 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 26 17:12:59 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-7[50917]: 2024-03-26T17:12:59.901+0000 7f68c422d700 -1 osd.7 80 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.15123.0:102940 2.5 2:a401fdfb:::rbd_header.39dee715f51e:head [watch ping cookie 139816687863840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80) 2024-03-26T17:13:01.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:13:00 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:13:00] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:13:01.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:13:00 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:13:00] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:13:01.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:13:00 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:13:01.146 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 26 17:13:00 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-7[50917]: 2024-03-26T17:13:00.890+0000 7f68c422d700 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-03-26T17:12:02.662964+0000 front 2024-03-26T17:12:02.662885+0000 (oldest deadline 2024-03-26T17:12:26.063366+0000) 2024-03-26T17:13:01.146 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 26 17:13:00 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-7[50917]: 2024-03-26T17:13:00.890+0000 7f68c422d700 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.44:6814 osd.1 since back 2024-03-26T17:12:11.864335+0000 front 2024-03-26T17:12:11.864356+0000 (oldest deadline 2024-03-26T17:12:34.764412+0000) 2024-03-26T17:13:01.146 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 26 17:13:00 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-7[50917]: 2024-03-26T17:13:00.890+0000 7f68c422d700 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-03-26T17:12:18.265205+0000 front 2024-03-26T17:12:18.265194+0000 (oldest deadline 2024-03-26T17:12:43.565110+0000) 2024-03-26T17:13:01.146 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 26 17:13:00 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-7[50917]: 2024-03-26T17:13:00.890+0000 7f68c422d700 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.64:6812 osd.3 since back 2024-03-26T17:12:28.766050+0000 front 2024-03-26T17:12:28.765976+0000 (oldest deadline 2024-03-26T17:12:51.665984+0000) 2024-03-26T17:13:01.146 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 26 17:13:00 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-7[50917]: 2024-03-26T17:13:00.890+0000 7f68c422d700 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.64:6820 osd.4 since back 2024-03-26T17:12:35.766699+0000 front 2024-03-26T17:12:35.766786+0000 (oldest deadline 2024-03-26T17:13:00.466621+0000) 2024-03-26T17:13:01.146 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 26 17:13:00 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-7[50917]: 2024-03-26T17:13:00.890+0000 7f68c422d700 -1 osd.7 80 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.15123.0:102940 2.5 2:a401fdfb:::rbd_header.39dee715f51e:head [watch ping cookie 139816687863840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80) 2024-03-26T17:13:01.147 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:13:00 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:13:00] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:13:01.147 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:13:00 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:13:00] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:13:01.147 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:13:00 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:13:02.396 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 26 17:13:01 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-7[50917]: 2024-03-26T17:13:01.899+0000 7f68c422d700 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-03-26T17:12:02.662964+0000 front 2024-03-26T17:12:02.662885+0000 (oldest deadline 2024-03-26T17:12:26.063366+0000) 2024-03-26T17:13:02.396 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 26 17:13:01 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-7[50917]: 2024-03-26T17:13:01.900+0000 7f68c422d700 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.44:6814 osd.1 since back 2024-03-26T17:12:11.864335+0000 front 2024-03-26T17:12:11.864356+0000 (oldest deadline 2024-03-26T17:12:34.764412+0000) 2024-03-26T17:13:02.396 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 26 17:13:01 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-7[50917]: 2024-03-26T17:13:01.900+0000 7f68c422d700 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.64:6804 osd.2 since back 2024-03-26T17:12:18.265205+0000 front 2024-03-26T17:12:18.265194+0000 (oldest deadline 2024-03-26T17:12:43.565110+0000) 2024-03-26T17:13:02.396 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 26 17:13:01 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-7[50917]: 2024-03-26T17:13:01.900+0000 7f68c422d700 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.64:6812 osd.3 since back 2024-03-26T17:12:28.766050+0000 front 2024-03-26T17:12:28.765976+0000 (oldest deadline 2024-03-26T17:12:51.665984+0000) 2024-03-26T17:13:02.396 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 26 17:13:01 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-7[50917]: 2024-03-26T17:13:01.900+0000 7f68c422d700 -1 osd.7 80 heartbeat_check: no reply from 172.21.15.64:6820 osd.4 since back 2024-03-26T17:12:35.766699+0000 front 2024-03-26T17:12:35.766786+0000 (oldest deadline 2024-03-26T17:13:00.466621+0000) 2024-03-26T17:13:02.396 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 26 17:13:01 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-7[50917]: 2024-03-26T17:13:01.900+0000 7f68c422d700 -1 osd.7 80 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.15123.0:102940 2.5 2:a401fdfb:::rbd_header.39dee715f51e:head [watch ping cookie 139816687863840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e80) 2024-03-26T17:13:03.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:13:02 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:13:02] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:13:03.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:13:02 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:13:02] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:13:03.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:13:02 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:13:03.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:13:02 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:13:02] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:13:03.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:13:02 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:13:02] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:13:03.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:13:02 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:13:03.521 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 26 17:13:03 smithi149 podman[60919]: 2024-03-26 17:13:03.228657762 +0000 UTC m=+5.683117978 container died 423971a0fd4e56b41e151b0e2a5091854aa17132963f981df528c96d738697a7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:01ae7457193b3f46a870db683661dbc281d60ce54f0968f4de09bc4e5ad0a734, name=ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-7, org.label-schema.license=GPLv2, RELEASE=ceph-nvmeof-mon-bf9505f, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, ceph=True, io.buildah.version=1.33.5, org.label-schema.build-date=20240319, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-03-26T17:13:03.855 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 26 17:13:03 smithi149 podman[60919]: 2024-03-26 17:13:03.612246852 +0000 UTC m=+6.066707067 container cleanup 423971a0fd4e56b41e151b0e2a5091854aa17132963f981df528c96d738697a7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:01ae7457193b3f46a870db683661dbc281d60ce54f0968f4de09bc4e5ad0a734, name=ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-7, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=ceph-nvmeof-mon-bf9505f, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240319, ceph=True, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS) 2024-03-26T17:13:03.855 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 26 17:13:03 smithi149 bash[60919]: ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-7 2024-03-26T17:13:04.146 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 26 17:13:03 smithi149 podman[60946]: 2024-03-26 17:13:03.854954663 +0000 UTC m=+0.620230339 container remove 423971a0fd4e56b41e151b0e2a5091854aa17132963f981df528c96d738697a7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:01ae7457193b3f46a870db683661dbc281d60ce54f0968f4de09bc4e5ad0a734, name=ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-7, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, RELEASE=ceph-nvmeof-mon-bf9505f, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240319) 2024-03-26T17:13:04.459 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 26 17:13:04 smithi149 podman[61034]: 2024-03-26 17:13:04.164003034 +0000 UTC m=+0.100634974 container create a69579a4471fcb20ed5b66c57f8a134afff87e7417c83dcbbf7343e0865d265a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:01ae7457193b3f46a870db683661dbc281d60ce54f0968f4de09bc4e5ad0a734, name=ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-7-deactivate, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , RELEASE=ceph-nvmeof-mon-bf9505f, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240319, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-03-26T17:13:04.459 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 26 17:13:04 smithi149 podman[61034]: 2024-03-26 17:13:04.081166469 +0000 UTC m=+0.017798431 image pull 5795ddf102746261652aa1cd1f517ace4dcfb8739ebbf229aeb81830d793ada0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:01ae7457193b3f46a870db683661dbc281d60ce54f0968f4de09bc4e5ad0a734 2024-03-26T17:13:04.459 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 26 17:13:04 smithi149 podman[61034]: 2024-03-26 17:13:04.379827073 +0000 UTC m=+0.316459015 container init a69579a4471fcb20ed5b66c57f8a134afff87e7417c83dcbbf7343e0865d265a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:01ae7457193b3f46a870db683661dbc281d60ce54f0968f4de09bc4e5ad0a734, name=ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-7-deactivate, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240319, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, RELEASE=ceph-nvmeof-mon-bf9505f) 2024-03-26T17:13:04.460 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 26 17:13:04 smithi149 podman[61034]: 2024-03-26 17:13:04.38398625 +0000 UTC m=+0.320618196 container start a69579a4471fcb20ed5b66c57f8a134afff87e7417c83dcbbf7343e0865d265a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:01ae7457193b3f46a870db683661dbc281d60ce54f0968f4de09bc4e5ad0a734, name=ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-7-deactivate, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240319, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, RELEASE=ceph-nvmeof-mon-bf9505f, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=) 2024-03-26T17:13:04.460 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 26 17:13:04 smithi149 podman[61034]: 2024-03-26 17:13:04.458894695 +0000 UTC m=+0.395526637 container attach a69579a4471fcb20ed5b66c57f8a134afff87e7417c83dcbbf7343e0865d265a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:01ae7457193b3f46a870db683661dbc281d60ce54f0968f4de09bc4e5ad0a734, name=ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-7-deactivate, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240319, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=ceph-nvmeof-mon-bf9505f, org.label-schema.schema-version=1.0) 2024-03-26T17:13:04.812 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 26 17:13:04 smithi149 podman[61034]: 2024-03-26 17:13:04.680814884 +0000 UTC m=+0.617446813 container died a69579a4471fcb20ed5b66c57f8a134afff87e7417c83dcbbf7343e0865d265a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:01ae7457193b3f46a870db683661dbc281d60ce54f0968f4de09bc4e5ad0a734, name=ceph-4394d798-eb90-11ee-95d0-87774f69a715-osd-7-deactivate, RELEASE=ceph-nvmeof-mon-bf9505f, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=08b1ab54e11946f162e232e2750e80887689df30, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240319) 2024-03-26T17:13:05.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:13:04 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:13:04] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:13:05.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:13:04 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:13:04] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:13:05.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:13:04 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:13:05.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:13:04 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:13:04] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:13:05.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:13:04 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:13:04] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:13:05.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:13:04 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:13:05.279 DEBUG:teuthology.orchestra.run.smithi149:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4394d798-eb90-11ee-95d0-87774f69a715@osd.7.service' 2024-03-26T17:13:05.318 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-26T17:13:05.318 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-03-26T17:13:05.319 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 4394d798-eb90-11ee-95d0-87774f69a715 --force --keep-logs 2024-03-26T17:13:05.503 INFO:teuthology.orchestra.run.smithi044.stdout:Deleting cluster with fsid: 4394d798-eb90-11ee-95d0-87774f69a715 2024-03-26T17:13:06.515 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:13:06 smithi044 systemd[1]: Stopping Ceph nvmeof.nvmeof.a for 4394d798-eb90-11ee-95d0-87774f69a715... 2024-03-26T17:13:07.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:13:06 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:13:06] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:13:07.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:13:06 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:13:06] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:13:07.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:13:06 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:13:07.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:13:06 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:13:06] INFO utils.py:391: Will compress log file /var/log/ceph/nvmeof-client.nvmeof.nvmeof.a/nvmeof-log to /var/log/ceph/nvmeof-client.nvmeof.nvmeof.a/nvmeof-log.gz 2024-03-26T17:13:07.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:13:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:13:06] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:13:07.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:13:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:13:06] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:13:07.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:13:06 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:13:09.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:13:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:13:08] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:13:09.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:13:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:13:08] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:13:09.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:13:08 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:13:09.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:13:08 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:13:08] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:13:09.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:13:08 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:13:08] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:13:09.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:13:08 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:13:11.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:13:10 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:13:10] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:13:11.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:13:10 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:13:10] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:13:11.016 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:13:10 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:13:11.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:13:10 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:13:10] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:13:11.147 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:13:10 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:13:10] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:13:11.147 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:13:10 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:13:13.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:13:12 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:13:12] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:13:13.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:13:12 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:13:12] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:13:13.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:13:12 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:13:13.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:13:12 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:13:12] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:13:13.147 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:13:12 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:13:12] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:13:13.147 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:13:12 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:13:15.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:13:14 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:13:14] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:13:15.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:13:14 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: [26-Mar-2024 17:13:14] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 2024-03-26T17:13:15.015 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:13:14 smithi044 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a[63181]: 'f39c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.44', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 4081, 'max_cntlid': 6120, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:13:15.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:13:14 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:13:14] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:13:15.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:13:14 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:13:14] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:13:15.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:13:14 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:13:16.881 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:13:16 smithi044 bash[75934]: time="2024-03-26T17:13:16Z" level=warning msg="StopSignal SIGTERM failed to stop container ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a in 10 seconds, resorting to SIGKILL" 2024-03-26T17:13:16.881 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:13:16 smithi044 podman[75934]: 2024-03-26 17:13:16.632719921 +0000 UTC m=+10.167676017 container died 8f63be595cf4ba9f1b2b76c3dfc555ab96f097eb86d11bb63ab1746dcc71e7ce (image=quay.io/barakda1/nvmeof:qe_ceph_devel_21e59b2, name=ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a, io.spdk.git.branch=ceph-nvmeof, io.spdk.build.ceph-release=18.2.2, summary=Ceph NVMe over Fabrics Gateway, name=ceph-nvmeof, vendor=Red Hat, Inc., io.ceph.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., maintainer=Ceph Developers , description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., url=https://github.com/ceph/ceph-nvmeof, io.k8s.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., distribution-scope=public, io.ceph.maintainer=Ceph Developers , io.spdk.build.target-arch=, io.spdk.version=23.01.1, io.spdk.build.configure-args=--with-rbd --disable-tests --disable-unit-tests --disable-examples --enable-debug, version=1.1.0, io.spdk.git.commit=85a10c98e70a1d3bc6c166e2f2939b3e5bae37dc, io.ceph.nvmeof=None, io.k8s.display-name=Ceph NVMe over Fabrics Gateway, vcs-ref=21e59b2fb3a6ffd41c9aa2b981db0415f3d8768c, io.openshift.tags=ceph,nvme-of,nvme-of gateway,rbd,block storage, io.spdk.build.pkgdep-args=--rbd, io.ceph.version=1.1.0, architecture=x86_64, io.ceph.summary=Ceph NVMe over Fabrics Gateway, io.spdk.build.makeflags=, io.ceph.component=ceph-nvmeof, io.openshift.wants=ceph,rbd, vcs-type=git, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, io.buildah.version=1.29.0, io.openshift.expose-services=4420/tcp:nvme,5500/tcp:grpc,8009/tcp:nvme-disc,10008/tcp:prom, org.centos.version=9.0-21.el9, release=, io.ceph.git.branch=devel, com.redhat.component=ubi9-container, org.centos.url=https://mirror.stream.centos.org/9-stream/BaseOS/x86_64/os/Packages/, io.ceph.url=https://github.com/ceph/ceph-nvmeof, io.spdk.git.repo=https://github.com/ceph/spdk.git, build-date=2024-03-26 07:40:14 UTC, io.ceph.git.commit=21e59b2fb3a6ffd41c9aa2b981db0415f3d8768c, io.ceph.git.repo=https://github.com/ceph/ceph-nvmeof) 2024-03-26T17:13:17.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:13:16 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:13:16] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:13:17.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:13:16 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:13:16] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:13:17.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:13:16 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:13:17.148 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:13:16 smithi044 podman[75934]: 2024-03-26 17:13:16.95485519 +0000 UTC m=+10.489811285 container cleanup 8f63be595cf4ba9f1b2b76c3dfc555ab96f097eb86d11bb63ab1746dcc71e7ce (image=quay.io/barakda1/nvmeof:qe_ceph_devel_21e59b2, name=ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a, io.openshift.wants=ceph,rbd, com.redhat.component=ubi9-container, io.spdk.git.branch=ceph-nvmeof, io.ceph.url=https://github.com/ceph/ceph-nvmeof, io.spdk.build.pkgdep-args=--rbd, distribution-scope=public, io.ceph.maintainer=Ceph Developers , vcs-ref=21e59b2fb3a6ffd41c9aa2b981db0415f3d8768c, vcs-type=git, io.ceph.component=ceph-nvmeof, maintainer=Ceph Developers , release=, io.spdk.build.ceph-release=18.2.2, io.ceph.summary=Ceph NVMe over Fabrics Gateway, io.spdk.build.configure-args=--with-rbd --disable-tests --disable-unit-tests --disable-examples --enable-debug, vendor=Red Hat, Inc., io.buildah.version=1.29.0, io.ceph.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.spdk.git.commit=85a10c98e70a1d3bc6c166e2f2939b3e5bae37dc, io.openshift.expose-services=4420/tcp:nvme,5500/tcp:grpc,8009/tcp:nvme-disc,10008/tcp:prom, io.spdk.git.repo=https://github.com/ceph/spdk.git, io.k8s.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., summary=Ceph NVMe over Fabrics Gateway, version=1.1.0, io.spdk.build.target-arch=, name=ceph-nvmeof, description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.spdk.version=23.01.1, architecture=x86_64, org.centos.url=https://mirror.stream.centos.org/9-stream/BaseOS/x86_64/os/Packages/, io.ceph.version=1.1.0, build-date=2024-03-26 07:40:14 UTC, io.ceph.git.repo=https://github.com/ceph/ceph-nvmeof, io.ceph.nvmeof=None, io.k8s.display-name=Ceph NVMe over Fabrics Gateway, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, url=https://github.com/ceph/ceph-nvmeof, io.spdk.build.makeflags=, io.ceph.git.commit=21e59b2fb3a6ffd41c9aa2b981db0415f3d8768c, org.centos.version=9.0-21.el9, io.ceph.git.branch=devel, io.openshift.tags=ceph,nvme-of,nvme-of gateway,rbd,block storage) 2024-03-26T17:13:17.148 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:13:16 smithi044 bash[75934]: ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a 2024-03-26T17:13:17.401 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:13:17 smithi044 podman[75964]: 2024-03-26 17:13:17.148131513 +0000 UTC m=+0.510675950 container remove 8f63be595cf4ba9f1b2b76c3dfc555ab96f097eb86d11bb63ab1746dcc71e7ce (image=quay.io/barakda1/nvmeof:qe_ceph_devel_21e59b2, name=ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-a, io.spdk.build.ceph-release=18.2.2, io.ceph.summary=Ceph NVMe over Fabrics Gateway, vcs-ref=21e59b2fb3a6ffd41c9aa2b981db0415f3d8768c, io.ceph.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., maintainer=Ceph Developers , distribution-scope=public, io.spdk.build.pkgdep-args=--rbd, io.spdk.git.commit=85a10c98e70a1d3bc6c166e2f2939b3e5bae37dc, org.centos.version=9.0-21.el9, io.spdk.build.target-arch=, io.ceph.nvmeof=None, description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.spdk.git.branch=ceph-nvmeof, io.spdk.git.repo=https://github.com/ceph/spdk.git, io.ceph.version=1.1.0, io.spdk.version=23.01.1, io.k8s.display-name=Ceph NVMe over Fabrics Gateway, io.ceph.maintainer=Ceph Developers , io.buildah.version=1.29.0, io.spdk.build.configure-args=--with-rbd --disable-tests --disable-unit-tests --disable-examples --enable-debug, com.redhat.component=ubi9-container, name=ceph-nvmeof, org.centos.url=https://mirror.stream.centos.org/9-stream/BaseOS/x86_64/os/Packages/, vendor=Red Hat, Inc., io.ceph.git.repo=https://github.com/ceph/ceph-nvmeof, version=1.1.0, io.ceph.component=ceph-nvmeof, io.openshift.expose-services=4420/tcp:nvme,5500/tcp:grpc,8009/tcp:nvme-disc,10008/tcp:prom, io.spdk.build.makeflags=, build-date=2024-03-26 07:40:14 UTC, summary=Ceph NVMe over Fabrics Gateway, io.ceph.git.commit=21e59b2fb3a6ffd41c9aa2b981db0415f3d8768c, url=https://github.com/ceph/ceph-nvmeof, architecture=x86_64, io.k8s.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.openshift.tags=ceph,nvme-of,nvme-of gateway,rbd,block storage, vcs-type=git, io.ceph.url=https://github.com/ceph/ceph-nvmeof, io.ceph.git.branch=devel, io.openshift.wants=ceph,rbd, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, release=) 2024-03-26T17:13:17.401 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:13:17 smithi044 systemd[1]: ceph-4394d798-eb90-11ee-95d0-87774f69a715@nvmeof.nvmeof.a.service: Main process exited, code=exited, status=137/n/a 2024-03-26T17:13:17.402 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:13:17 smithi044 systemd[1]: ceph-4394d798-eb90-11ee-95d0-87774f69a715@nvmeof.nvmeof.a.service: Failed with result 'exit-code'. 2024-03-26T17:13:17.402 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:13:17 smithi044 systemd[1]: Stopped Ceph nvmeof.nvmeof.a for 4394d798-eb90-11ee-95d0-87774f69a715. 2024-03-26T17:13:17.402 INFO:journalctl@ceph.nvmeof.nvmeof.a.smithi044.stdout:Mar 26 17:13:17 smithi044 systemd[1]: ceph-4394d798-eb90-11ee-95d0-87774f69a715@nvmeof.nvmeof.a.service: Consumed 18min 37.231s CPU time. 2024-03-26T17:13:18.044 DEBUG:teuthology.orchestra.run.smithi064:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 4394d798-eb90-11ee-95d0-87774f69a715 --force --keep-logs 2024-03-26T17:13:18.240 INFO:teuthology.orchestra.run.smithi064.stdout:Deleting cluster with fsid: 4394d798-eb90-11ee-95d0-87774f69a715 2024-03-26T17:13:19.396 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:13:18 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:13:18] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:13:19.396 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:13:18 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:13:18] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:13:19.396 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:13:18 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:13:19.722 DEBUG:teuthology.orchestra.run.smithi149:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 4394d798-eb90-11ee-95d0-87774f69a715 --force --keep-logs 2024-03-26T17:13:19.939 INFO:teuthology.orchestra.run.smithi149.stdout:Deleting cluster with fsid: 4394d798-eb90-11ee-95d0-87774f69a715 2024-03-26T17:13:21.286 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:13:20 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:13:20] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:13:21.286 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:13:20 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:13:20] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:13:21.287 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:13:20 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:13:21.646 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:13:21 smithi149 systemd[1]: Stopping Ceph nvmeof.nvmeof.c for 4394d798-eb90-11ee-95d0-87774f69a715... 2024-03-26T17:13:22.146 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:13:21 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:13:21] INFO utils.py:391: Will compress log file /var/log/ceph/nvmeof-client.nvmeof.nvmeof.c/nvmeof-log to /var/log/ceph/nvmeof-client.nvmeof.nvmeof.c/nvmeof-log.gz 2024-03-26T17:13:23.396 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:13:22 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:13:22] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:13:23.396 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:13:22 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:13:22] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:13:23.397 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:13:22 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:13:25.396 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:13:24 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:13:24] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:13:25.396 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:13:24 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:13:24] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:13:25.396 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:13:24 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:13:27.396 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:13:26 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:13:26] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:13:27.396 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:13:26 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:13:26] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:13:27.397 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:13:26 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:13:29.398 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:13:28 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:13:28] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:13:29.399 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:13:28 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:13:28] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:13:29.399 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:13:28 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:13:31.396 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:13:30 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:13:30] INFO grpc.py:2287: Received request to get subsystems, context: 2024-03-26T17:13:31.396 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:13:30 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: [26-Mar-2024 17:13:30] INFO grpc.py:2291: get_subsystems: [{'nqn': 'nqn.2016-06.io.spdk:cnode1', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph14383361503536', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'name': 'bdev_da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'nguid': 'DA4A45802A9D4CE8974082CEBDEE1A5B', 'uuid': 'da4a4580-2a9d-4ce8-9740-82cebdee1a5b', 'anagrpid': 2}, {'nsid': 2, 'bdev_name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'name': 'bdev_a1755742-338c-47ea-8ef2-33f2fc007e14', 'nguid': 'A1755742338C47EA8EF233F2FC007E14', 'uuid': 'a1755742-338c-47ea-8ef2-33f2fc007e14', 'anagrpid': 3}, {'nsid': 3, 'bdev_name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'name': 'bdev_7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'nguid': '7717F2C59BB649248148ADF5C9E343BF', 'uuid': '7717f2c5-9bb6-4924-8148-adf5c9e343bf', 'anagrpid': 1}, {'nsid': 4, 'bdev_name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'name': 'bdev_6060c284-177d-4f51-aee2-022f2e268fb6', 'nguid': '6060C284177D4F51AEE2022F2E268FB6', 'uuid': '6060c284-177d-4f51-aee2-022f2e268fb6', 'anagrpid': 2}, {'nsid': 5, 'bdev_name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'name': 'bdev_9f5354a4-1a93-4270-b370-63e819567f34', 'nguid': '9F5354A41A934270B37063E819567F34', 'uuid': '9f5354a4-1a93-4270-b370-63e819567f34', 'anagrpid': 3}, {'nsid': 6, 'bdev_name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'name': 'bdev_c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'nguid': 'C4744537F8B34B2085745FCD7B0891E9', 'uuid': 'c4744537-f8b3-4b20-8574-5fcd7b0891e9', 'anagrpid': 1}, {'nsid': 7, 'bdev_name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'name': 'bdev_0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'nguid': '0FBD24ECF9254370B9A55F94BCCB6786', 'uuid': '0fbd24ec-f925-4370-b9a5-5f94bccb6786', 'anagrpid': 2}, {'nsid': 8, 'bdev_name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'name': 'bdev_082e5959-2b79-418e-99dc-c3195cfa988f', 'nguid': '082E59592B79418E99DCC3195CFA988F', 'uuid': '082e5959-2b79-418e-99dc-c3195cfa988f', 'anagrpid': 3}, {'nsid': 9, 'bdev_name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'name': 'bdev_534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'nguid': '534EF0BB59D3439AB8D0C3542AB84F6C', 'uuid': '534ef0bb-59d3-439a-b8d0-c3542ab84f6c', 'anagrpid': 1}, {'nsid': 10, 'bdev_name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'name': 'bdev_a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'nguid': 'A8F5F33BB8E147DF85BB973D3BACA17A', 'uuid': 'a8f5f33b-b8e1-47df-85bb-973d3baca17a', 'anagrpid': 2}, {'nsid': 11, 'bdev_name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'name': 'bdev_ba551130-b365-468c-9ac2-2c5c81e90eda', 'nguid': 'BA551130B365468C9AC22C5C81E90EDA', 'uuid': 'ba551130-b365-468c-9ac2-2c5c81e90eda', 'anagrpid': 3}, {'nsid': 12, 'bdev_name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'name': 'bdev_dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'nguid': 'DC39FF2861DD4E08B69E0A8559AE9FEB', 'uuid': 'dc39ff28-61dd-4e08-b69e-0a8559ae9feb', 'anagrpid': 1}, {'nsid': 13, 'bdev_name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'name': 'bdev_9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'nguid': '9E6E9CCD76F6452DB3D74BCB00171E17', 'uuid': '9e6e9ccd-76f6-452d-b3d7-4bcb00171e17', 'anagrpid': 2}, {'nsid': 14, 'bdev_name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'name': 'bdev_89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'nguid': '89D6E70DB953455192561DD8E30B2D0F', 'uuid': '89d6e70d-b953-4551-9256-1dd8e30b2d0f', 'anagrpid': 3}, {'nsid': 15, 'bdev_name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'name': 'bdev_48c15cff-e791-4341-9256-88cfb39f6693', 'nguid': '48C15CFFE7914341925688CFB39F6693', 'uuid': '48c15cff-e791-4341-9256-88cfb39f6693', 'anagrpid': 1}, {'nsid': 16, 'bdev_name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'name': 'bdev_38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'nguid': '38E87F8CE7D94D69AB3E6FEA8F4EFE47', 'uuid': '38e87f8c-e7d9-4d69-ab3e-6fea8f4efe47', 'anagrpid': 2}, {'nsid': 17, 'bdev_name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'name': 'bdev_0aaf3983-217a-4d6b-a3aa-63888b07164a', 'nguid': '0AAF3983217A4D6BA3AA63888B07164A', 'uuid': '0aaf3983-217a-4d6b-a3aa-63888b07164a', 'anagrpid': 3}, {'nsid': 18, 'bdev_name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'name': 'bdev_c6887013-be71-4aaf-b084-84236db9e43d', 'nguid': 'C6887013BE714AAFB08484236DB9E43D', 'uuid': 'c6887013-be71-4aaf-b084-84236db9e43d', 'anagrpid': 1}, {'nsid': 19, 'bdev_name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'name': 'bdev_d686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'nguid': 'D686AB7C1ACE4FF8AEC0B3B6741B3361', 'uuid': 'd686ab7c-1ace-4ff8-aec0-b3b6741b3361', 'anagrpid': 2}, {'nsid': 20, 'bdev_name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'name': 'bdev_c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'nguid': 'C358261A15A04E6486407FF4CF1C4B95', 'uuid': 'c358261a-15a0-4e64-8640-7ff4cf1c4b95', 'anagrpid': 3}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode2', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph44698087180525', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'name': 'bdev_05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'nguid': '05B2E1A63D5A4B69871C1AC01C6D8776', 'uuid': '05b2e1a6-3d5a-4b69-871c-1ac01c6d8776', 'anagrpid': 1}, {'nsid': 2, 'bdev_name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'name': 'bdev_8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'nguid': '8CB4FB23EE034621A45CB79E612FBAA4', 'uuid': '8cb4fb23-ee03-4621-a45c-b79e612fbaa4', 'anagrpid': 2}, {'nsid': 3, 'bdev_name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'name': 'bdev_cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'nguid': 'CDFC396B491147EBA9EAA3AF2AC6CC80', 'uuid': 'cdfc396b-4911-47eb-a9ea-a3af2ac6cc80', 'anagrpid': 3}, {'nsid': 4, 'bdev_name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'name': 'bdev_fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'nguid': 'FA7D8C135EDF4558A74D2C9100ECC792', 'uuid': 'fa7d8c13-5edf-4558-a74d-2c9100ecc792', 'anagrpid': 1}, {'nsid': 5, 'bdev_name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'name': 'bdev_dbd3d055-7949-4d28-88b7-dcced8014e1e', 'nguid': 'DBD3D05579494D2888B7DCCED8014E1E', 'uuid': 'dbd3d055-7949-4d28-88b7-dcced8014e1e', 'anagrpid': 2}, {'nsid': 6, 'bdev_name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'name': 'bdev_b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'nguid': 'B2A9455CAF1849F2A3F07F6F12F2BB0F', 'uuid': 'b2a9455c-af18-49f2-a3f0-7f6f12f2bb0f', 'anagrpid': 3}, {'nsid': 7, 'bdev_name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'name': 'bdev_58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'nguid': '58FE2E66C15A4E648A9E47CC37BE9CE9', 'uuid': '58fe2e66-c15a-4e64-8a9e-47cc37be9ce9', 'anagrpid': 1}, {'nsid': 8, 'bdev_name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'name': 'bdev_df083c66-8523-462f-b725-47c2fbdeb60d', 'nguid': 'DF083C668523462FB72547C2FBDEB60D', 'uuid': 'df083c66-8523-462f-b725-47c2fbdeb60d', 'anagrpid': 2}, {'nsid': 9, 'bdev_name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'name': 'bdev_0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'nguid': '0213ED81DC604B5EAC6B64BDF671F2C3', 'uuid': '0213ed81-dc60-4b5e-ac6b-64bdf671f2c3', 'anagrpid': 3}, {'nsid': 10, 'bdev_name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'name': 'bdev_b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'nguid': 'B19DD95558CE4F68B8CB4F2022EDF2C8', 'uuid': 'b19dd955-58ce-4f68-b8cb-4f2022edf2c8', 'anagrpid': 1}, {'nsid': 11, 'bdev_name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'name': 'bdev_64dd9e25-4738-44d3-b164-38aca4721574', 'nguid': '64DD9E25473844D3B16438ACA4721574', 'uuid': '64dd9e25-4738-44d3-b164-38aca4721574', 'anagrpid': 2}, {'nsid': 12, 'bdev_name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'name': 'bdev_f39c41fc-2f73-4d4b-9972-e1a944915be2', 'nguid': 'F39C41FC2F734D4B9972E1A944915BE2', 'uuid': 'f3 2024-03-26T17:13:31.396 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:13:30 smithi149 ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c[55356]: 9c41fc-2f73-4d4b-9972-e1a944915be2', 'anagrpid': 3}, {'nsid': 13, 'bdev_name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'name': 'bdev_b0126702-a889-4773-8787-b89b9db99211', 'nguid': 'B0126702A88947738787B89B9DB99211', 'uuid': 'b0126702-a889-4773-8787-b89b9db99211', 'anagrpid': 1}, {'nsid': 14, 'bdev_name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'name': 'bdev_6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'nguid': '6DE556CEFD3A4E65A5EFE98B3708C676', 'uuid': '6de556ce-fd3a-4e65-a5ef-e98b3708c676', 'anagrpid': 2}, {'nsid': 15, 'bdev_name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'name': 'bdev_3e830603-72e5-456c-88e5-7bb0898fd4ab', 'nguid': '3E83060372E5456C88E57BB0898FD4AB', 'uuid': '3e830603-72e5-456c-88e5-7bb0898fd4ab', 'anagrpid': 3}, {'nsid': 16, 'bdev_name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'name': 'bdev_b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'nguid': 'B5B1B5EAD9FA48A2A8F88E2544C8A27C', 'uuid': 'b5b1b5ea-d9fa-48a2-a8f8-8e2544c8a27c', 'anagrpid': 1}, {'nsid': 17, 'bdev_name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'name': 'bdev_ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'nguid': 'CA27FDBBDF6D4379A6B38550EDF613BB', 'uuid': 'ca27fdbb-df6d-4379-a6b3-8550edf613bb', 'anagrpid': 2}, {'nsid': 18, 'bdev_name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'name': 'bdev_856c7df5-918e-47bc-865f-bf945817a40a', 'nguid': '856C7DF5918E47BC865FBF945817A40A', 'uuid': '856c7df5-918e-47bc-865f-bf945817a40a', 'anagrpid': 3}, {'nsid': 19, 'bdev_name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'name': 'bdev_73911108-c449-4dde-9e0b-f3c55fa58540', 'nguid': '73911108C4494DDE9E0BF3C55FA58540', 'uuid': '73911108-c449-4dde-9e0b-f3c55fa58540', 'anagrpid': 1}, {'nsid': 20, 'bdev_name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'name': 'bdev_10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'nguid': '10B25A6D4C8343AC82BE34E5F35E18EB', 'uuid': '10b25a6d-4c83-43ac-82be-34e5f35e18eb', 'anagrpid': 2}]}, {'nqn': 'nqn.2016-06.io.spdk:cnode3', 'subtype': 'NVMe', 'listen_addresses': [{'transport': 'TCP', 'trtype': 'TCP', 'adrfam': 'IPv4', 'traddr': '172.21.15.149', 'trsvcid': '4420'}], 'allow_any_host': True, 'hosts': [], 'serial_number': 'Ceph20558982565741', 'model_number': 'Ceph bdev Controller', 'max_namespaces': 256, 'min_cntlid': 1, 'max_cntlid': 2040, 'namespaces': [{'nsid': 1, 'bdev_name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'name': 'bdev_3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'nguid': '3C661BBB5E4A4C0485A7F1CAF0B1F9BE', 'uuid': '3c661bbb-5e4a-4c04-85a7-f1caf0b1f9be', 'anagrpid': 3}, {'nsid': 2, 'bdev_name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'name': 'bdev_50b4cca3-174e-43d5-9104-42a67f5e6251', 'nguid': '50B4CCA3174E43D5910442A67F5E6251', 'uuid': '50b4cca3-174e-43d5-9104-42a67f5e6251', 'anagrpid': 1}, {'nsid': 3, 'bdev_name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'name': 'bdev_3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'nguid': '3B4CD01B2E99465288A6FA90062DDCB2', 'uuid': '3b4cd01b-2e99-4652-88a6-fa90062ddcb2', 'anagrpid': 2}, {'nsid': 4, 'bdev_name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'name': 'bdev_207949ff-8335-45b5-ada4-b479b5c558f0', 'nguid': '207949FF833545B5ADA4B479B5C558F0', 'uuid': '207949ff-8335-45b5-ada4-b479b5c558f0', 'anagrpid': 3}, {'nsid': 5, 'bdev_name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'name': 'bdev_3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'nguid': '3C6807E76CA5409197D34325DC5C205D', 'uuid': '3c6807e7-6ca5-4091-97d3-4325dc5c205d', 'anagrpid': 1}, {'nsid': 6, 'bdev_name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'name': 'bdev_93238733-93e8-4537-9db8-9a632ba1968b', 'nguid': '9323873393E845379DB89A632BA1968B', 'uuid': '93238733-93e8-4537-9db8-9a632ba1968b', 'anagrpid': 2}, {'nsid': 7, 'bdev_name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'name': 'bdev_93abae22-a363-48f4-af52-0cb060c979a9', 'nguid': '93ABAE22A36348F4AF520CB060C979A9', 'uuid': '93abae22-a363-48f4-af52-0cb060c979a9', 'anagrpid': 3}, {'nsid': 8, 'bdev_name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'name': 'bdev_921a1ef8-41d8-474b-93fd-035acb5ad32e', 'nguid': '921A1EF841D8474B93FD035ACB5AD32E', 'uuid': '921a1ef8-41d8-474b-93fd-035acb5ad32e', 'anagrpid': 1}, {'nsid': 9, 'bdev_name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'name': 'bdev_8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'nguid': '8E46188484604C4AAB6C8245C6EC1EE9', 'uuid': '8e461884-8460-4c4a-ab6c-8245c6ec1ee9', 'anagrpid': 2}, {'nsid': 10, 'bdev_name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'name': 'bdev_6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'nguid': '6DD22A0FF02E4022B87477A8C16D2B34', 'uuid': '6dd22a0f-f02e-4022-b874-77a8c16d2b34', 'anagrpid': 3}, {'nsid': 11, 'bdev_name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'name': 'bdev_be42afac-1bb1-49d7-891e-1520dab96fea', 'nguid': 'BE42AFAC1BB149D7891E1520DAB96FEA', 'uuid': 'be42afac-1bb1-49d7-891e-1520dab96fea', 'anagrpid': 1}, {'nsid': 12, 'bdev_name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'name': 'bdev_2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'nguid': '2D7CAE06634E4D4E84F63FD8B256908B', 'uuid': '2d7cae06-634e-4d4e-84f6-3fd8b256908b', 'anagrpid': 2}, {'nsid': 13, 'bdev_name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'name': 'bdev_c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'nguid': 'C8BDC24B3BEB44168E5E29302AB1738E', 'uuid': 'c8bdc24b-3beb-4416-8e5e-29302ab1738e', 'anagrpid': 3}, {'nsid': 14, 'bdev_name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'name': 'bdev_880553c4-26f3-4feb-954f-8823b018602d', 'nguid': '880553C426F34FEB954F8823B018602D', 'uuid': '880553c4-26f3-4feb-954f-8823b018602d', 'anagrpid': 1}, {'nsid': 15, 'bdev_name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'name': 'bdev_6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'nguid': '6D3B5BAFA7C74CA5BAD0337B93CBB81D', 'uuid': '6d3b5baf-a7c7-4ca5-bad0-337b93cbb81d', 'anagrpid': 2}, {'nsid': 16, 'bdev_name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'name': 'bdev_2cad5054-30eb-42c3-8147-56ca2066bb5e', 'nguid': '2CAD505430EB42C3814756CA2066BB5E', 'uuid': '2cad5054-30eb-42c3-8147-56ca2066bb5e', 'anagrpid': 3}, {'nsid': 17, 'bdev_name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'name': 'bdev_c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'nguid': 'C8D8F2481A234AA6B0D64CE8BC32FE9F', 'uuid': 'c8d8f248-1a23-4aa6-b0d6-4ce8bc32fe9f', 'anagrpid': 1}, {'nsid': 18, 'bdev_name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'name': 'bdev_8fab603e-43d8-40fa-a513-509c13e98869', 'nguid': '8FAB603E43D840FAA513509C13E98869', 'uuid': '8fab603e-43d8-40fa-a513-509c13e98869', 'anagrpid': 2}, {'nsid': 19, 'bdev_name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'name': 'bdev_d1568c59-1c06-4a94-adf0-389db9d95681', 'nguid': 'D1568C591C064A94ADF0389DB9D95681', 'uuid': 'd1568c59-1c06-4a94-adf0-389db9d95681', 'anagrpid': 3}, {'nsid': 20, 'bdev_name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'name': 'bdev_811fc261-889a-479a-9e58-cc5cc9b1fca9', 'nguid': '811FC261889A479A9E58CC5CC9B1FCA9', 'uuid': '811fc261-889a-479a-9e58-cc5cc9b1fca9', 'anagrpid': 1}]}] 2024-03-26T17:13:32.031 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:13:31 smithi149 bash[61387]: time="2024-03-26T17:13:31Z" level=warning msg="StopSignal SIGTERM failed to stop container ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c in 10 seconds, resorting to SIGKILL" 2024-03-26T17:13:32.031 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:13:31 smithi149 podman[61387]: 2024-03-26 17:13:31.767283694 +0000 UTC m=+10.128631220 container died e76306598f8c279db42bf9fb3cb008d3bffb44012a2cee82ed52bf1a23649181 (image=quay.io/barakda1/nvmeof:qe_ceph_devel_21e59b2, name=ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c, io.spdk.build.pkgdep-args=--rbd, vcs-type=git, io.k8s.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.openshift.expose-services=4420/tcp:nvme,5500/tcp:grpc,8009/tcp:nvme-disc,10008/tcp:prom, io.buildah.version=1.29.0, io.ceph.url=https://github.com/ceph/ceph-nvmeof, summary=Ceph NVMe over Fabrics Gateway, io.ceph.git.repo=https://github.com/ceph/ceph-nvmeof, vendor=Red Hat, Inc., description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.openshift.tags=ceph,nvme-of,nvme-of gateway,rbd,block storage, vcs-ref=21e59b2fb3a6ffd41c9aa2b981db0415f3d8768c, version=1.1.0, io.spdk.build.ceph-release=18.2.2, io.spdk.git.repo=https://github.com/ceph/spdk.git, io.ceph.summary=Ceph NVMe over Fabrics Gateway, io.ceph.version=1.1.0, io.spdk.build.configure-args=--with-rbd --disable-tests --disable-unit-tests --disable-examples --enable-debug, architecture=x86_64, io.ceph.maintainer=Ceph Developers , com.redhat.component=ubi9-container, io.ceph.nvmeof=None, release=, build-date=2024-03-26 07:40:14 UTC, io.spdk.build.target-arch=, io.k8s.display-name=Ceph NVMe over Fabrics Gateway, io.spdk.build.makeflags=, io.ceph.git.commit=21e59b2fb3a6ffd41c9aa2b981db0415f3d8768c, org.centos.url=https://mirror.stream.centos.org/9-stream/BaseOS/x86_64/os/Packages/, io.ceph.component=ceph-nvmeof, io.ceph.git.branch=devel, distribution-scope=public, io.spdk.git.commit=85a10c98e70a1d3bc6c166e2f2939b3e5bae37dc, name=ceph-nvmeof, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, io.spdk.version=23.01.1, io.spdk.git.branch=ceph-nvmeof, maintainer=Ceph Developers , org.centos.version=9.0-21.el9, io.ceph.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., url=https://github.com/ceph/ceph-nvmeof, io.openshift.wants=ceph,rbd) 2024-03-26T17:13:32.314 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:13:32 smithi149 podman[61387]: 2024-03-26 17:13:32.113432706 +0000 UTC m=+10.474780286 container cleanup e76306598f8c279db42bf9fb3cb008d3bffb44012a2cee82ed52bf1a23649181 (image=quay.io/barakda1/nvmeof:qe_ceph_devel_21e59b2, name=ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c, io.k8s.display-name=Ceph NVMe over Fabrics Gateway, io.ceph.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.openshift.expose-services=4420/tcp:nvme,5500/tcp:grpc,8009/tcp:nvme-disc,10008/tcp:prom, build-date=2024-03-26 07:40:14 UTC, description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.ceph.component=ceph-nvmeof, maintainer=Ceph Developers , architecture=x86_64, io.spdk.git.commit=85a10c98e70a1d3bc6c166e2f2939b3e5bae37dc, io.spdk.build.target-arch=, io.spdk.git.branch=ceph-nvmeof, version=1.1.0, io.k8s.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., vendor=Red Hat, Inc., io.ceph.git.branch=devel, distribution-scope=public, release=, url=https://github.com/ceph/ceph-nvmeof, io.spdk.build.configure-args=--with-rbd --disable-tests --disable-unit-tests --disable-examples --enable-debug, com.redhat.component=ubi9-container, org.centos.url=https://mirror.stream.centos.org/9-stream/BaseOS/x86_64/os/Packages/, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, io.ceph.version=1.1.0, io.ceph.git.commit=21e59b2fb3a6ffd41c9aa2b981db0415f3d8768c, io.ceph.url=https://github.com/ceph/ceph-nvmeof, summary=Ceph NVMe over Fabrics Gateway, vcs-ref=21e59b2fb3a6ffd41c9aa2b981db0415f3d8768c, vcs-type=git, io.ceph.nvmeof=None, io.openshift.wants=ceph,rbd, io.spdk.build.ceph-release=18.2.2, io.spdk.git.repo=https://github.com/ceph/spdk.git, io.spdk.version=23.01.1, org.centos.version=9.0-21.el9, io.ceph.maintainer=Ceph Developers , io.spdk.build.makeflags=, io.ceph.summary=Ceph NVMe over Fabrics Gateway, io.buildah.version=1.29.0, io.spdk.build.pkgdep-args=--rbd, io.ceph.git.repo=https://github.com/ceph/ceph-nvmeof, io.openshift.tags=ceph,nvme-of,nvme-of gateway,rbd,block storage, name=ceph-nvmeof) 2024-03-26T17:13:32.315 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:13:32 smithi149 bash[61387]: ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c 2024-03-26T17:13:32.646 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:13:32 smithi149 podman[61418]: 2024-03-26 17:13:32.314446756 +0000 UTC m=+0.543204508 container remove e76306598f8c279db42bf9fb3cb008d3bffb44012a2cee82ed52bf1a23649181 (image=quay.io/barakda1/nvmeof:qe_ceph_devel_21e59b2, name=ceph-4394d798-eb90-11ee-95d0-87774f69a715-nvmeof-nvmeof-c, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, io.buildah.version=1.29.0, io.spdk.build.pkgdep-args=--rbd, io.spdk.build.ceph-release=18.2.2, vendor=Red Hat, Inc., io.ceph.git.commit=21e59b2fb3a6ffd41c9aa2b981db0415f3d8768c, org.centos.url=https://mirror.stream.centos.org/9-stream/BaseOS/x86_64/os/Packages/, io.ceph.version=1.1.0, vcs-ref=21e59b2fb3a6ffd41c9aa2b981db0415f3d8768c, version=1.1.0, io.openshift.expose-services=4420/tcp:nvme,5500/tcp:grpc,8009/tcp:nvme-disc,10008/tcp:prom, io.ceph.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.ceph.git.branch=devel, io.k8s.description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.spdk.build.configure-args=--with-rbd --disable-tests --disable-unit-tests --disable-examples --enable-debug, name=ceph-nvmeof, io.spdk.git.repo=https://github.com/ceph/spdk.git, io.spdk.git.branch=ceph-nvmeof, io.openshift.wants=ceph,rbd, org.centos.version=9.0-21.el9, url=https://github.com/ceph/ceph-nvmeof, vcs-type=git, summary=Ceph NVMe over Fabrics Gateway, distribution-scope=public, io.spdk.version=23.01.1, com.redhat.component=ubi9-container, io.ceph.nvmeof=None, io.ceph.summary=Ceph NVMe over Fabrics Gateway, io.ceph.git.repo=https://github.com/ceph/ceph-nvmeof, io.openshift.tags=ceph,nvme-of,nvme-of gateway,rbd,block storage, io.spdk.build.makeflags=, description=Service to provide block storage on top of Ceph for platforms (e.g.: VMWare) without native Ceph support (RBD), replacing existing approaches (iSCSI) with a newer and more versatile standard (NVMe-oF)., io.k8s.display-name=Ceph NVMe over Fabrics Gateway, io.ceph.maintainer=Ceph Developers , io.ceph.component=ceph-nvmeof, release=, architecture=x86_64, io.ceph.url=https://github.com/ceph/ceph-nvmeof, io.spdk.build.target-arch=, maintainer=Ceph Developers , build-date=2024-03-26 07:40:14 UTC, io.spdk.git.commit=85a10c98e70a1d3bc6c166e2f2939b3e5bae37dc) 2024-03-26T17:13:32.646 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:13:32 smithi149 systemd[1]: ceph-4394d798-eb90-11ee-95d0-87774f69a715@nvmeof.nvmeof.c.service: Main process exited, code=exited, status=137/n/a 2024-03-26T17:13:32.646 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:13:32 smithi149 systemd[1]: ceph-4394d798-eb90-11ee-95d0-87774f69a715@nvmeof.nvmeof.c.service: Failed with result 'exit-code'. 2024-03-26T17:13:32.646 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:13:32 smithi149 systemd[1]: Stopped Ceph nvmeof.nvmeof.c for 4394d798-eb90-11ee-95d0-87774f69a715. 2024-03-26T17:13:32.646 INFO:journalctl@ceph.nvmeof.nvmeof.c.smithi149.stdout:Mar 26 17:13:32 smithi149 systemd[1]: ceph-4394d798-eb90-11ee-95d0-87774f69a715@nvmeof.nvmeof.c.service: Consumed 19min 12.192s CPU time. 2024-03-26T17:13:33.281 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 4394d798-eb90-11ee-95d0-87774f69a715 --force --keep-logs 2024-03-26T17:13:33.472 INFO:teuthology.orchestra.run.smithi157.stdout:Deleting cluster with fsid: 4394d798-eb90-11ee-95d0-87774f69a715 2024-03-26T17:13:33.955 DEBUG:teuthology.orchestra.run.smithi044:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-03-26T17:13:33.990 DEBUG:teuthology.orchestra.run.smithi064:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-03-26T17:13:34.027 DEBUG:teuthology.orchestra.run.smithi149:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-03-26T17:13:34.063 DEBUG:teuthology.orchestra.run.smithi157:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-03-26T17:13:34.093 INFO:tasks.cephadm:Archiving crash dumps... 2024-03-26T17:13:34.096 DEBUG:teuthology.misc:Transferring archived files from smithi044:/var/lib/ceph/4394d798-eb90-11ee-95d0-87774f69a715/crash to /home/teuthworker/archive/vallariag-2024-03-26_16:25:34-rbd:nvmeof-ceph-nvmeof-mon-distro-default-smithi/7623742/remote/smithi044/crash 2024-03-26T17:13:34.096 DEBUG:teuthology.orchestra.run.smithi044:> sudo tar c -f - -C /var/lib/ceph/4394d798-eb90-11ee-95d0-87774f69a715/crash -- . 2024-03-26T17:13:34.140 INFO:teuthology.orchestra.run.smithi044.stderr:tar: /var/lib/ceph/4394d798-eb90-11ee-95d0-87774f69a715/crash: Cannot open: No such file or directory 2024-03-26T17:13:34.140 INFO:teuthology.orchestra.run.smithi044.stderr:tar: Error is not recoverable: exiting now 2024-03-26T17:13:34.143 DEBUG:teuthology.misc:Transferring archived files from smithi064:/var/lib/ceph/4394d798-eb90-11ee-95d0-87774f69a715/crash to /home/teuthworker/archive/vallariag-2024-03-26_16:25:34-rbd:nvmeof-ceph-nvmeof-mon-distro-default-smithi/7623742/remote/smithi064/crash 2024-03-26T17:13:34.144 DEBUG:teuthology.orchestra.run.smithi064:> sudo tar c -f - -C /var/lib/ceph/4394d798-eb90-11ee-95d0-87774f69a715/crash -- . 2024-03-26T17:13:34.185 INFO:teuthology.orchestra.run.smithi064.stderr:tar: /var/lib/ceph/4394d798-eb90-11ee-95d0-87774f69a715/crash: Cannot open: No such file or directory 2024-03-26T17:13:34.186 INFO:teuthology.orchestra.run.smithi064.stderr:tar: Error is not recoverable: exiting now 2024-03-26T17:13:34.187 DEBUG:teuthology.misc:Transferring archived files from smithi149:/var/lib/ceph/4394d798-eb90-11ee-95d0-87774f69a715/crash to /home/teuthworker/archive/vallariag-2024-03-26_16:25:34-rbd:nvmeof-ceph-nvmeof-mon-distro-default-smithi/7623742/remote/smithi149/crash 2024-03-26T17:13:34.188 DEBUG:teuthology.orchestra.run.smithi149:> sudo tar c -f - -C /var/lib/ceph/4394d798-eb90-11ee-95d0-87774f69a715/crash -- . 2024-03-26T17:13:34.239 INFO:teuthology.orchestra.run.smithi149.stderr:tar: /var/lib/ceph/4394d798-eb90-11ee-95d0-87774f69a715/crash: Cannot open: No such file or directory 2024-03-26T17:13:34.239 INFO:teuthology.orchestra.run.smithi149.stderr:tar: Error is not recoverable: exiting now 2024-03-26T17:13:34.241 DEBUG:teuthology.misc:Transferring archived files from smithi157:/var/lib/ceph/4394d798-eb90-11ee-95d0-87774f69a715/crash to /home/teuthworker/archive/vallariag-2024-03-26_16:25:34-rbd:nvmeof-ceph-nvmeof-mon-distro-default-smithi/7623742/remote/smithi157/crash 2024-03-26T17:13:34.242 DEBUG:teuthology.orchestra.run.smithi157:> sudo tar c -f - -C /var/lib/ceph/4394d798-eb90-11ee-95d0-87774f69a715/crash -- . 2024-03-26T17:13:34.327 INFO:teuthology.orchestra.run.smithi157.stderr:tar: /var/lib/ceph/4394d798-eb90-11ee-95d0-87774f69a715/crash: Cannot open: No such file or directory 2024-03-26T17:13:34.327 INFO:teuthology.orchestra.run.smithi157.stderr:tar: Error is not recoverable: exiting now 2024-03-26T17:13:34.328 INFO:tasks.cephadm:Checking cluster log for badness... 2024-03-26T17:13:34.328 DEBUG:teuthology.orchestra.run.smithi044:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/4394d798-eb90-11ee-95d0-87774f69a715/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | head -n 1 2024-03-26T17:13:34.360 INFO:teuthology.orchestra.run.smithi044.stdout:2024-03-26T16:49:30.286281+0000 mon.a (mon.0) 222 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,c (MON_DOWN) 2024-03-26T17:13:34.362 WARNING:tasks.cephadm:Found errors (ERR|WRN|SEC) in cluster log 2024-03-26T17:13:34.362 INFO:tasks.cephadm:Compressing logs... 2024-03-26T17:13:34.362 DEBUG:teuthology.orchestra.run.smithi044:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-03-26T17:13:34.404 DEBUG:teuthology.orchestra.run.smithi064:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-03-26T17:13:34.407 DEBUG:teuthology.orchestra.run.smithi149:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-03-26T17:13:34.409 DEBUG:teuthology.orchestra.run.smithi157:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-03-26T17:13:34.432 INFO:teuthology.orchestra.run.smithi044.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-03-26T17:13:34.432 INFO:teuthology.orchestra.run.smithi044.stderr:: No such file or directory 2024-03-26T17:13:34.433 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/4394d798-eb90-11ee-95d0-87774f69a715/ceph-mon.a.log 2024-03-26T17:13:34.433 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/4394d798-eb90-11ee-95d0-87774f69a715/ceph.audit.log 2024-03-26T17:13:34.433 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/4394d798-eb90-11ee-95d0-87774f69a715/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/4394d798-eb90-11ee-95d0-87774f69a715/ceph-osd.1.log 2024-03-26T17:13:34.433 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/4394d798-eb90-11ee-95d0-87774f69a715/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/4394d798-eb90-11ee-95d0-87774f69a715/ceph-mgr.x.log 2024-03-26T17:13:34.433 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/4394d798-eb90-11ee-95d0-87774f69a715/ceph-osd.0.log 2024-03-26T17:13:34.436 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/4394d798-eb90-11ee-95d0-87774f69a715/ceph-osd.1.log: /var/log/ceph/4394d798-eb90-11ee-95d0-87774f69a715/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/4394d798-eb90-11ee-95d0-87774f69a715/ceph.cephadm.log 2024-03-26T17:13:34.436 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/4394d798-eb90-11ee-95d0-87774f69a715/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/4394d798-eb90-11ee-95d0-87774f69a715/ceph.log 2024-03-26T17:13:34.436 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/4394d798-eb90-11ee-95d0-87774f69a715/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/4394d798-eb90-11ee-95d0-87774f69a715/ceph-volume.log 2024-03-26T17:13:34.436 INFO:teuthology.orchestra.run.smithi044.stderr: 82.3% -- replaced with /var/log/ceph/4394d798-eb90-11ee-95d0-87774f69a715/ceph.cephadm.log.gz 2024-03-26T17:13:34.438 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/4394d798-eb90-11ee-95d0-87774f69a715/ceph.log: 93.2% -- replaced with /var/log/ceph/cephadm.log.gz 2024-03-26T17:13:34.438 INFO:teuthology.orchestra.run.smithi044.stderr: 90.5% -- replaced with /var/log/ceph/4394d798-eb90-11ee-95d0-87774f69a715/ceph.audit.log.gz 2024-03-26T17:13:34.440 INFO:teuthology.orchestra.run.smithi157.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose: No such file or directory -- 2024-03-26T17:13:34.440 INFO:teuthology.orchestra.run.smithi157.stderr: /var/log/ceph/cephadm.log 2024-03-26T17:13:34.440 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/4394d798-eb90-11ee-95d0-87774f69a715/ceph-volume.log 2024-03-26T17:13:34.440 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/cephadm.log: 86.0% -- replaced with /var/log/ceph/cephadm.log.gz 2024-03-26T17:13:34.440 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/4394d798-eb90-11ee-95d0-87774f69a715/ceph-volume.log: 89.9% -- replaced with /var/log/ceph/4394d798-eb90-11ee-95d0-87774f69a715/ceph-volume.log.gz 2024-03-26T17:13:34.440 INFO:teuthology.orchestra.run.smithi157.stderr: 2024-03-26T17:13:34.440 INFO:teuthology.orchestra.run.smithi157.stderr:real 0m0.016s 2024-03-26T17:13:34.440 INFO:teuthology.orchestra.run.smithi157.stderr:user 0m0.016s 2024-03-26T17:13:34.440 INFO:teuthology.orchestra.run.smithi157.stderr:sys 0m0.013s 2024-03-26T17:13:34.442 INFO:teuthology.orchestra.run.smithi064.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-03-26T17:13:34.442 INFO:teuthology.orchestra.run.smithi064.stderr:: No such file or directory 2024-03-26T17:13:34.442 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/4394d798-eb90-11ee-95d0-87774f69a715/ceph.audit.log 2024-03-26T17:13:34.442 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/4394d798-eb90-11ee-95d0-87774f69a715/ceph-osd.4.log 2024-03-26T17:13:34.442 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/4394d798-eb90-11ee-95d0-87774f69a715/ceph-osd.3.log 2024-03-26T17:13:34.442 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/4394d798-eb90-11ee-95d0-87774f69a715/ceph.audit.log: /var/log/ceph/4394d798-eb90-11ee-95d0-87774f69a715/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/4394d798-eb90-11ee-95d0-87774f69a715/ceph.cephadm.log 2024-03-26T17:13:34.442 INFO:teuthology.orchestra.run.smithi064.stderr: 89.5% -- replaced with /var/log/ceph/cephadm.log.gz 2024-03-26T17:13:34.442 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/4394d798-eb90-11ee-95d0-87774f69a715/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/4394d798-eb90-11ee-95d0-87774f69a715/ceph.log 2024-03-26T17:13:34.442 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose/var/log/ceph/4394d798-eb90-11ee-95d0-87774f69a715/ceph.cephadm.log: -- /var/log/ceph/4394d798-eb90-11ee-95d0-87774f69a715/ceph-osd.2.log 2024-03-26T17:13:34.442 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/4394d798-eb90-11ee-95d0-87774f69a715/ceph.log: 80.8% -- replaced with /var/log/ceph/4394d798-eb90-11ee-95d0-87774f69a715/ceph.cephadm.log.gz 2024-03-26T17:13:34.443 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/4394d798-eb90-11ee-95d0-87774f69a715/ceph-volume.log 2024-03-26T17:13:34.443 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/4394d798-eb90-11ee-95d0-87774f69a715/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/4394d798-eb90-11ee-95d0-87774f69a715/ceph-mon.b.log 2024-03-26T17:13:34.443 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/4394d798-eb90-11ee-95d0-87774f69a715/ceph-volume.log: /var/log/ceph/4394d798-eb90-11ee-95d0-87774f69a715/ceph-mon.b.log: 90.7% -- replaced with /var/log/ceph/4394d798-eb90-11ee-95d0-87774f69a715/ceph.audit.log.gz 2024-03-26T17:13:34.443 INFO:teuthology.orchestra.run.smithi064.stderr: 88.1% -- replaced with /var/log/ceph/4394d798-eb90-11ee-95d0-87774f69a715/ceph.log.gz 2024-03-26T17:13:34.443 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/4394d798-eb90-11ee-95d0-87774f69a715/ceph-volume.log: 88.0% -- replaced with /var/log/ceph/4394d798-eb90-11ee-95d0-87774f69a715/ceph.log.gz 2024-03-26T17:13:34.445 INFO:teuthology.orchestra.run.smithi064.stderr: 91.1% -- replaced with /var/log/ceph/4394d798-eb90-11ee-95d0-87774f69a715/ceph-volume.log.gz 2024-03-26T17:13:34.445 INFO:teuthology.orchestra.run.smithi044.stderr: 91.1% -- replaced with /var/log/ceph/4394d798-eb90-11ee-95d0-87774f69a715/ceph-volume.log.gz 2024-03-26T17:13:34.468 INFO:teuthology.orchestra.run.smithi149.stderr:find: ‘/var/log/rbd-target-api’gzip: No such file or directory 2024-03-26T17:13:34.468 INFO:teuthology.orchestra.run.smithi149.stderr: -5 --verbose -- /var/log/ceph/cephadm.log 2024-03-26T17:13:34.477 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/4394d798-eb90-11ee-95d0-87774f69a715/ceph-osd.6.log 2024-03-26T17:13:34.477 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/4394d798-eb90-11ee-95d0-87774f69a715/ceph.audit.log 2024-03-26T17:13:34.478 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/cephadm.log: /var/log/ceph/4394d798-eb90-11ee-95d0-87774f69a715/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/4394d798-eb90-11ee-95d0-87774f69a715/ceph-osd.7.log 2024-03-26T17:13:34.479 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/4394d798-eb90-11ee-95d0-87774f69a715/ceph-osd.5.log 2024-03-26T17:13:34.479 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/4394d798-eb90-11ee-95d0-87774f69a715/ceph.audit.log: /var/log/ceph/4394d798-eb90-11ee-95d0-87774f69a715/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/4394d798-eb90-11ee-95d0-87774f69a715/ceph.cephadm.log 2024-03-26T17:13:34.480 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/4394d798-eb90-11ee-95d0-87774f69a715/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/4394d798-eb90-11ee-95d0-87774f69a715/ceph.log 2024-03-26T17:13:34.480 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/4394d798-eb90-11ee-95d0-87774f69a715/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/4394d798-eb90-11ee-95d0-87774f69a715/ceph-volume.log 2024-03-26T17:13:34.480 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/4394d798-eb90-11ee-95d0-87774f69a715/ceph.log: gzip -5 --verbose -- /var/log/ceph/4394d798-eb90-11ee-95d0-87774f69a715/ceph-mon.c.log 2024-03-26T17:13:34.542 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/4394d798-eb90-11ee-95d0-87774f69a715/ceph-volume.log: /var/log/ceph/4394d798-eb90-11ee-95d0-87774f69a715/ceph-mon.c.log: 80.7% -- replaced with /var/log/ceph/4394d798-eb90-11ee-95d0-87774f69a715/ceph.cephadm.log.gz 2024-03-26T17:13:34.594 INFO:teuthology.orchestra.run.smithi149.stderr: 91.1% -- replaced with /var/log/ceph/4394d798-eb90-11ee-95d0-87774f69a715/ceph-volume.log.gz 2024-03-26T17:13:34.634 INFO:teuthology.orchestra.run.smithi149.stderr: 90.1% -- replaced with /var/log/ceph/cephadm.log.gz 2024-03-26T17:13:34.636 INFO:teuthology.orchestra.run.smithi149.stderr: 90.7% -- replaced with /var/log/ceph/4394d798-eb90-11ee-95d0-87774f69a715/ceph.audit.log.gz 2024-03-26T17:13:34.654 INFO:teuthology.orchestra.run.smithi149.stderr: 88.1% -- replaced with /var/log/ceph/4394d798-eb90-11ee-95d0-87774f69a715/ceph.log.gz 2024-03-26T17:13:34.713 INFO:teuthology.orchestra.run.smithi064.stderr: 92.7% -- replaced with /var/log/ceph/4394d798-eb90-11ee-95d0-87774f69a715/ceph-mon.b.log.gz 2024-03-26T17:13:34.843 INFO:teuthology.orchestra.run.smithi044.stderr: 89.6% -- replaced with /var/log/ceph/4394d798-eb90-11ee-95d0-87774f69a715/ceph-mgr.x.log.gz 2024-03-26T17:13:35.233 INFO:teuthology.orchestra.run.smithi044.stderr: 90.5% -- replaced with /var/log/ceph/4394d798-eb90-11ee-95d0-87774f69a715/ceph-mon.a.log.gz 2024-03-26T17:13:35.634 INFO:teuthology.orchestra.run.smithi149.stderr: 92.4% -- replaced with /var/log/ceph/4394d798-eb90-11ee-95d0-87774f69a715/ceph-mon.c.log.gz 2024-03-26T17:13:39.489 INFO:teuthology.orchestra.run.smithi044.stderr: 93.4% -- replaced with /var/log/ceph/4394d798-eb90-11ee-95d0-87774f69a715/ceph-osd.0.log.gz 2024-03-26T17:13:41.945 INFO:teuthology.orchestra.run.smithi064.stderr: 93.5% -- replaced with /var/log/ceph/4394d798-eb90-11ee-95d0-87774f69a715/ceph-osd.2.log.gz 2024-03-26T17:13:43.857 INFO:teuthology.orchestra.run.smithi064.stderr: 93.6% -- replaced with /var/log/ceph/4394d798-eb90-11ee-95d0-87774f69a715/ceph-osd.4.log.gz 2024-03-26T17:13:48.946 INFO:teuthology.orchestra.run.smithi149.stderr: 93.6% -- replaced with /var/log/ceph/4394d798-eb90-11ee-95d0-87774f69a715/ceph-osd.7.log.gz 2024-03-26T17:13:49.587 INFO:teuthology.orchestra.run.smithi149.stderr: 93.4% -- replaced with /var/log/ceph/4394d798-eb90-11ee-95d0-87774f69a715/ceph-osd.6.log.gz 2024-03-26T17:13:49.895 INFO:teuthology.orchestra.run.smithi044.stderr: 93.6% -- replaced with /var/log/ceph/4394d798-eb90-11ee-95d0-87774f69a715/ceph-osd.1.log.gz 2024-03-26T17:13:49.897 INFO:teuthology.orchestra.run.smithi044.stderr: 2024-03-26T17:13:49.897 INFO:teuthology.orchestra.run.smithi044.stderr:real 0m15.479s 2024-03-26T17:13:49.897 INFO:teuthology.orchestra.run.smithi044.stderr:user 0m21.034s 2024-03-26T17:13:49.897 INFO:teuthology.orchestra.run.smithi044.stderr:sys 0m0.706s 2024-03-26T17:13:50.593 INFO:teuthology.orchestra.run.smithi064.stderr: 93.6% -- replaced with /var/log/ceph/4394d798-eb90-11ee-95d0-87774f69a715/ceph-osd.3.log.gz 2024-03-26T17:13:50.595 INFO:teuthology.orchestra.run.smithi064.stderr: 2024-03-26T17:13:50.595 INFO:teuthology.orchestra.run.smithi064.stderr:real 0m16.174s 2024-03-26T17:13:50.595 INFO:teuthology.orchestra.run.smithi064.stderr:user 0m32.298s 2024-03-26T17:13:50.595 INFO:teuthology.orchestra.run.smithi064.stderr:sys 0m1.055s 2024-03-26T17:13:53.118 INFO:teuthology.orchestra.run.smithi149.stderr: 93.4% -- replaced with /var/log/ceph/4394d798-eb90-11ee-95d0-87774f69a715/ceph-osd.5.log.gz 2024-03-26T17:13:53.120 INFO:teuthology.orchestra.run.smithi149.stderr: 2024-03-26T17:13:53.120 INFO:teuthology.orchestra.run.smithi149.stderr:real 0m18.697s 2024-03-26T17:13:53.121 INFO:teuthology.orchestra.run.smithi149.stderr:user 0m31.287s 2024-03-26T17:13:53.121 INFO:teuthology.orchestra.run.smithi149.stderr:sys 0m1.269s 2024-03-26T17:13:53.121 INFO:tasks.cephadm:Archiving logs... 2024-03-26T17:13:53.121 DEBUG:teuthology.misc:Transferring archived files from smithi044:/var/log/ceph to /home/teuthworker/archive/vallariag-2024-03-26_16:25:34-rbd:nvmeof-ceph-nvmeof-mon-distro-default-smithi/7623742/remote/smithi044/log 2024-03-26T17:13:53.122 DEBUG:teuthology.orchestra.run.smithi044:> sudo tar c -f - -C /var/log/ceph -- . 2024-03-26T17:13:56.330 DEBUG:teuthology.misc:Transferring archived files from smithi064:/var/log/ceph to /home/teuthworker/archive/vallariag-2024-03-26_16:25:34-rbd:nvmeof-ceph-nvmeof-mon-distro-default-smithi/7623742/remote/smithi064/log 2024-03-26T17:13:56.331 DEBUG:teuthology.orchestra.run.smithi064:> sudo tar c -f - -C /var/log/ceph -- . 2024-03-26T17:14:01.129 DEBUG:teuthology.misc:Transferring archived files from smithi149:/var/log/ceph to /home/teuthworker/archive/vallariag-2024-03-26_16:25:34-rbd:nvmeof-ceph-nvmeof-mon-distro-default-smithi/7623742/remote/smithi149/log 2024-03-26T17:14:01.130 DEBUG:teuthology.orchestra.run.smithi149:> sudo tar c -f - -C /var/log/ceph -- . 2024-03-26T17:14:06.146 DEBUG:teuthology.misc:Transferring archived files from smithi157:/var/log/ceph to /home/teuthworker/archive/vallariag-2024-03-26_16:25:34-rbd:nvmeof-ceph-nvmeof-mon-distro-default-smithi/7623742/remote/smithi157/log 2024-03-26T17:14:06.147 DEBUG:teuthology.orchestra.run.smithi157:> sudo tar c -f - -C /var/log/ceph -- . 2024-03-26T17:14:06.186 INFO:tasks.cephadm:Removing cluster... 2024-03-26T17:14:06.186 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 4394d798-eb90-11ee-95d0-87774f69a715 --force 2024-03-26T17:14:06.384 INFO:teuthology.orchestra.run.smithi044.stdout:Deleting cluster with fsid: 4394d798-eb90-11ee-95d0-87774f69a715 2024-03-26T17:14:06.660 DEBUG:teuthology.orchestra.run.smithi064:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 4394d798-eb90-11ee-95d0-87774f69a715 --force 2024-03-26T17:14:06.859 INFO:teuthology.orchestra.run.smithi064.stdout:Deleting cluster with fsid: 4394d798-eb90-11ee-95d0-87774f69a715 2024-03-26T17:14:07.152 DEBUG:teuthology.orchestra.run.smithi149:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 4394d798-eb90-11ee-95d0-87774f69a715 --force 2024-03-26T17:14:07.346 INFO:teuthology.orchestra.run.smithi149.stdout:Deleting cluster with fsid: 4394d798-eb90-11ee-95d0-87774f69a715 2024-03-26T17:14:07.669 DEBUG:teuthology.orchestra.run.smithi157:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 4394d798-eb90-11ee-95d0-87774f69a715 --force 2024-03-26T17:14:07.862 INFO:teuthology.orchestra.run.smithi157.stdout:Deleting cluster with fsid: 4394d798-eb90-11ee-95d0-87774f69a715 2024-03-26T17:14:08.316 INFO:tasks.cephadm:Removing cephadm ... 2024-03-26T17:14:08.316 DEBUG:teuthology.orchestra.run.smithi044:> rm -rf /home/ubuntu/cephtest/cephadm 2024-03-26T17:14:08.334 DEBUG:teuthology.orchestra.run.smithi064:> rm -rf /home/ubuntu/cephtest/cephadm 2024-03-26T17:14:08.352 DEBUG:teuthology.orchestra.run.smithi149:> rm -rf /home/ubuntu/cephtest/cephadm 2024-03-26T17:14:08.379 DEBUG:teuthology.orchestra.run.smithi157:> rm -rf /home/ubuntu/cephtest/cephadm 2024-03-26T17:14:08.394 INFO:tasks.cephadm:Teardown complete 2024-03-26T17:14:08.395 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-03-26T17:14:08.405 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_7c79d572ca9e89ddbdc2c40bbb7dac4f505c80ce/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_7c79d572ca9e89ddbdc2c40bbb7dac4f505c80ce/teuthology/task/install/__init__.py", line 626, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_7c79d572ca9e89ddbdc2c40bbb7dac4f505c80ce/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/home/teuthworker/src/git.ceph.com_teuthology_7c79d572ca9e89ddbdc2c40bbb7dac4f505c80ce/teuthology/task/__init__.py", line 132, in __exit__ self.end() File "/home/teuthworker/src/github.com_vallariag_ceph_b4c4828f419f1247fc297e8069c1036b1d6151f2/qa/tasks/nvmeof.py", line 295, in end raise RuntimeError('error during thrashing') RuntimeError: error during thrashing 2024-03-26T17:14:08.406 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-03-26T17:14:08.406 DEBUG:teuthology.orchestra.run.smithi044:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-03-26T17:14:08.409 DEBUG:teuthology.orchestra.run.smithi064:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-03-26T17:14:08.411 DEBUG:teuthology.orchestra.run.smithi149:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-03-26T17:14:08.421 DEBUG:teuthology.orchestra.run.smithi157:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-03-26T17:14:08.552 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-03-26T17:14:08.563 INFO:teuthology.task.clock:Checking final clock skew... 2024-03-26T17:14:08.563 DEBUG:teuthology.orchestra.run.smithi044:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-26T17:14:08.566 DEBUG:teuthology.orchestra.run.smithi064:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-26T17:14:08.568 DEBUG:teuthology.orchestra.run.smithi149:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-26T17:14:08.571 DEBUG:teuthology.orchestra.run.smithi157:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-26T17:14:08.580 INFO:teuthology.orchestra.run.smithi044.stderr:bash: line 1: ntpq: command not found 2024-03-26T17:14:08.581 INFO:teuthology.orchestra.run.smithi064.stderr:bash: line 1: ntpq: command not found 2024-03-26T17:14:08.585 INFO:teuthology.orchestra.run.smithi157.stderr:bash: line 1: ntpq: command not found 2024-03-26T17:14:08.586 INFO:teuthology.orchestra.run.smithi064.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-26T17:14:08.586 INFO:teuthology.orchestra.run.smithi064.stdout:=============================================================================== 2024-03-26T17:14:08.586 INFO:teuthology.orchestra.run.smithi064.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 46 +113us[ +113us] +/- 79ms 2024-03-26T17:14:08.587 INFO:teuthology.orchestra.run.smithi064.stdout:^* hv02.front.sepia.ceph.com 3 6 377 45 -295us[ -295us] +/- 60ms 2024-03-26T17:14:08.587 INFO:teuthology.orchestra.run.smithi064.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 46 +348us[ +348us] +/- 80ms 2024-03-26T17:14:08.587 INFO:teuthology.orchestra.run.smithi064.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-03-26T17:14:08.587 INFO:teuthology.orchestra.run.smithi044.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-26T17:14:08.587 INFO:teuthology.orchestra.run.smithi044.stdout:=============================================================================== 2024-03-26T17:14:08.587 INFO:teuthology.orchestra.run.smithi044.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 48 +110us[ +110us] +/- 79ms 2024-03-26T17:14:08.587 INFO:teuthology.orchestra.run.smithi044.stdout:^* hv02.front.sepia.ceph.com 3 6 377 48 -293us[ -293us] +/- 60ms 2024-03-26T17:14:08.587 INFO:teuthology.orchestra.run.smithi044.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 45 +330us[ +330us] +/- 80ms 2024-03-26T17:14:08.587 INFO:teuthology.orchestra.run.smithi044.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-03-26T17:14:08.588 INFO:teuthology.orchestra.run.smithi157.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-26T17:14:08.588 INFO:teuthology.orchestra.run.smithi157.stdout:=============================================================================== 2024-03-26T17:14:08.589 INFO:teuthology.orchestra.run.smithi157.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 45 +93us[ +104us] +/- 79ms 2024-03-26T17:14:08.589 INFO:teuthology.orchestra.run.smithi157.stdout:^* hv02.front.sepia.ceph.com 3 6 377 43 -302us[ -290us] +/- 60ms 2024-03-26T17:14:08.589 INFO:teuthology.orchestra.run.smithi157.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 46 +319us[ +330us] +/- 80ms 2024-03-26T17:14:08.589 INFO:teuthology.orchestra.run.smithi157.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-03-26T17:14:08.594 INFO:teuthology.orchestra.run.smithi149.stderr:bash: line 1: ntpq: command not found 2024-03-26T17:14:08.615 INFO:teuthology.orchestra.run.smithi149.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-26T17:14:08.615 INFO:teuthology.orchestra.run.smithi149.stdout:=============================================================================== 2024-03-26T17:14:08.615 INFO:teuthology.orchestra.run.smithi149.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 45 +102us[ +108us] +/- 79ms 2024-03-26T17:14:08.615 INFO:teuthology.orchestra.run.smithi149.stdout:^* hv02.front.sepia.ceph.com 3 6 377 43 -304us[ -299us] +/- 60ms 2024-03-26T17:14:08.615 INFO:teuthology.orchestra.run.smithi149.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 45 +320us[ +326us] +/- 80ms 2024-03-26T17:14:08.615 INFO:teuthology.orchestra.run.smithi149.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-03-26T17:14:08.616 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-03-26T17:14:08.625 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-03-26T17:14:08.626 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-03-26T17:14:08.689 DEBUG:teuthology.orchestra.run.smithi044:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-03-26T17:14:08.773 DEBUG:teuthology.orchestra.run.smithi064:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-03-26T17:14:08.848 DEBUG:teuthology.orchestra.run.smithi149:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-03-26T17:14:09.003 DEBUG:teuthology.orchestra.run.smithi157:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-03-26T17:14:09.091 DEBUG:teuthology.orchestra.run.smithi044:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-03-26T17:14:09.126 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-26T17:14:09.127 DEBUG:teuthology.orchestra.run.smithi064:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-03-26T17:14:09.161 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-26T17:14:09.162 DEBUG:teuthology.orchestra.run.smithi149:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-03-26T17:14:09.193 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-26T17:14:09.194 DEBUG:teuthology.orchestra.run.smithi157:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-03-26T17:14:09.225 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-26T17:14:09.226 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-03-26T17:14:09.236 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-03-26T17:14:09.300 INFO:teuthology.task.internal:Duration was 2259.441031 seconds 2024-03-26T17:14:09.300 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-03-26T17:14:09.350 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-03-26T17:14:09.350 DEBUG:teuthology.orchestra.run.smithi044:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-03-26T17:14:09.353 DEBUG:teuthology.orchestra.run.smithi064:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-03-26T17:14:09.355 DEBUG:teuthology.orchestra.run.smithi149:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-03-26T17:14:09.358 DEBUG:teuthology.orchestra.run.smithi157:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-03-26T17:14:09.400 INFO:teuthology.orchestra.run.smithi044.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-26T17:14:09.402 INFO:teuthology.orchestra.run.smithi157.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-26T17:14:09.402 INFO:teuthology.orchestra.run.smithi064.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-26T17:14:09.435 INFO:teuthology.orchestra.run.smithi149.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-26T17:14:09.803 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-03-26T17:14:09.804 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi044.front.sepia.ceph.com 2024-03-26T17:14:09.804 DEBUG:teuthology.orchestra.run.smithi044:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-03-26T17:14:09.826 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi064.front.sepia.ceph.com 2024-03-26T17:14:09.826 DEBUG:teuthology.orchestra.run.smithi064:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-03-26T17:14:09.861 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi149.front.sepia.ceph.com 2024-03-26T17:14:09.861 DEBUG:teuthology.orchestra.run.smithi149:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-03-26T17:14:09.902 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi157.front.sepia.ceph.com 2024-03-26T17:14:09.902 DEBUG:teuthology.orchestra.run.smithi157:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-03-26T17:14:09.926 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-03-26T17:14:09.926 DEBUG:teuthology.orchestra.run.smithi044:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-03-26T17:14:09.929 DEBUG:teuthology.orchestra.run.smithi064:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-03-26T17:14:09.931 DEBUG:teuthology.orchestra.run.smithi149:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-03-26T17:14:09.945 DEBUG:teuthology.orchestra.run.smithi157:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-03-26T17:14:09.996 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-03-26T17:14:09.996 DEBUG:teuthology.orchestra.run.smithi044:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-03-26T17:14:10.002 DEBUG:teuthology.orchestra.run.smithi064:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-03-26T17:14:10.005 DEBUG:teuthology.orchestra.run.smithi149:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-03-26T17:14:10.014 DEBUG:teuthology.orchestra.run.smithi157:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-03-26T17:14:10.514 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-03-26T17:14:10.526 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-03-26T17:14:10.526 DEBUG:teuthology.orchestra.run.smithi044:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-03-26T17:14:10.553 DEBUG:teuthology.orchestra.run.smithi064:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-03-26T17:14:10.581 DEBUG:teuthology.orchestra.run.smithi149:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-03-26T17:14:10.614 DEBUG:teuthology.orchestra.run.smithi157:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-03-26T17:14:10.642 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-03-26T17:14:10.653 DEBUG:teuthology.orchestra.run.smithi044:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-03-26T17:14:10.656 DEBUG:teuthology.orchestra.run.smithi064:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-03-26T17:14:10.658 DEBUG:teuthology.orchestra.run.smithi149:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-03-26T17:14:10.660 DEBUG:teuthology.orchestra.run.smithi157:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-03-26T17:14:10.678 INFO:teuthology.orchestra.run.smithi044.stdout:kernel.core_pattern = core 2024-03-26T17:14:10.681 INFO:teuthology.orchestra.run.smithi064.stdout:kernel.core_pattern = core 2024-03-26T17:14:10.691 INFO:teuthology.orchestra.run.smithi149.stdout:kernel.core_pattern = core 2024-03-26T17:14:10.708 INFO:teuthology.orchestra.run.smithi157.stdout:kernel.core_pattern = core 2024-03-26T17:14:10.724 DEBUG:teuthology.orchestra.run.smithi044:> test -e /home/ubuntu/cephtest/archive/coredump 2024-03-26T17:14:10.769 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-26T17:14:10.769 DEBUG:teuthology.orchestra.run.smithi064:> test -e /home/ubuntu/cephtest/archive/coredump 2024-03-26T17:14:10.783 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-26T17:14:10.783 DEBUG:teuthology.orchestra.run.smithi149:> test -e /home/ubuntu/cephtest/archive/coredump 2024-03-26T17:14:10.797 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-26T17:14:10.798 DEBUG:teuthology.orchestra.run.smithi157:> test -e /home/ubuntu/cephtest/archive/coredump 2024-03-26T17:14:10.812 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-26T17:14:10.812 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-03-26T17:14:10.823 INFO:teuthology.task.internal:Transferring archived files... 2024-03-26T17:14:10.824 DEBUG:teuthology.misc:Transferring archived files from smithi044:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vallariag-2024-03-26_16:25:34-rbd:nvmeof-ceph-nvmeof-mon-distro-default-smithi/7623742/remote/smithi044 2024-03-26T17:14:10.824 DEBUG:teuthology.orchestra.run.smithi044:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-03-26T17:14:10.867 DEBUG:teuthology.misc:Transferring archived files from smithi064:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vallariag-2024-03-26_16:25:34-rbd:nvmeof-ceph-nvmeof-mon-distro-default-smithi/7623742/remote/smithi064 2024-03-26T17:14:10.867 DEBUG:teuthology.orchestra.run.smithi064:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-03-26T17:14:10.905 DEBUG:teuthology.misc:Transferring archived files from smithi149:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vallariag-2024-03-26_16:25:34-rbd:nvmeof-ceph-nvmeof-mon-distro-default-smithi/7623742/remote/smithi149 2024-03-26T17:14:10.905 DEBUG:teuthology.orchestra.run.smithi149:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-03-26T17:14:10.945 DEBUG:teuthology.misc:Transferring archived files from smithi157:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vallariag-2024-03-26_16:25:34-rbd:nvmeof-ceph-nvmeof-mon-distro-default-smithi/7623742/remote/smithi157 2024-03-26T17:14:10.946 DEBUG:teuthology.orchestra.run.smithi157:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-03-26T17:14:10.985 INFO:teuthology.task.internal:Removing archive directory... 2024-03-26T17:14:10.985 DEBUG:teuthology.orchestra.run.smithi044:> rm -rf -- /home/ubuntu/cephtest/archive 2024-03-26T17:14:10.987 DEBUG:teuthology.orchestra.run.smithi064:> rm -rf -- /home/ubuntu/cephtest/archive 2024-03-26T17:14:10.990 DEBUG:teuthology.orchestra.run.smithi149:> rm -rf -- /home/ubuntu/cephtest/archive 2024-03-26T17:14:10.992 DEBUG:teuthology.orchestra.run.smithi157:> rm -rf -- /home/ubuntu/cephtest/archive 2024-03-26T17:14:11.034 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-03-26T17:14:11.048 INFO:teuthology.task.internal:Not uploading archives. 2024-03-26T17:14:11.048 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-03-26T17:14:11.100 INFO:teuthology.task.internal:Tidying up after the test... 2024-03-26T17:14:11.100 DEBUG:teuthology.orchestra.run.smithi044:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-03-26T17:14:11.102 DEBUG:teuthology.orchestra.run.smithi064:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-03-26T17:14:11.105 DEBUG:teuthology.orchestra.run.smithi149:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-03-26T17:14:11.108 DEBUG:teuthology.orchestra.run.smithi157:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-03-26T17:14:11.114 INFO:teuthology.orchestra.run.smithi044.stdout: 262166 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 26 17:14 /home/ubuntu/cephtest 2024-03-26T17:14:11.116 INFO:teuthology.orchestra.run.smithi064.stdout: 262166 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 26 17:14 /home/ubuntu/cephtest 2024-03-26T17:14:11.120 INFO:teuthology.orchestra.run.smithi149.stdout: 262166 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 26 17:14 /home/ubuntu/cephtest 2024-03-26T17:14:11.122 INFO:teuthology.orchestra.run.smithi157.stdout: 265705 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 26 17:14 /home/ubuntu/cephtest 2024-03-26T17:14:11.124 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-03-26T17:14:11.160 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-03-26T17:14:11.207 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: RuntimeError: error during thrashing 2024-03-26T17:14:11.207 INFO:teuthology.nuke:Checking targets against current locks 2024-03-26T17:14:11.234 DEBUG:teuthology.nuke:shortname: smithi044 2024-03-26T17:14:11.234 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-26T17:14:11.258 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi044.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vallariag-2024-03-26_16:25:34-rbd:nvmeof-ceph-nvmeof-mon-distro-default-smithi/7623742', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-26 16:27:25.959558', 'locked_by': 'scheduled_vallariag@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFSIashjG9T3vuQwjf4YXFXPlv1lbAByFjFa+ONeLiRwIxbjPXU4QQmMh6t2A0PL7bjHyBgE1ZHrTa/TOl2+K2A='} 2024-03-26T17:14:11.262 DEBUG:teuthology.nuke:shortname: smithi064 2024-03-26T17:14:11.262 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-26T17:14:11.288 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi064.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vallariag-2024-03-26_16:25:34-rbd:nvmeof-ceph-nvmeof-mon-distro-default-smithi/7623742', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-26 16:27:25.961405', 'locked_by': 'scheduled_vallariag@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMJOzji330iAheGPVl6Q67rmi0g72/pPL2waU/cL4nkSlz1G6Me2lzOcsiBmxXDX0VD5lrP+e1qSK3FcZf8/IEs='} 2024-03-26T17:14:11.288 DEBUG:teuthology.nuke:shortname: smithi149 2024-03-26T17:14:11.289 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-26T17:14:11.314 DEBUG:teuthology.nuke:shortname: smithi157 2024-03-26T17:14:11.314 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-26T17:14:11.319 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi149.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vallariag-2024-03-26_16:25:34-rbd:nvmeof-ceph-nvmeof-mon-distro-default-smithi/7623742', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-26 16:27:25.963060', 'locked_by': 'scheduled_vallariag@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCyr4TzjgsEn9ZiQfzSIaVsWpJ5zjF6U7LMmRBDc4OVueteU+pLAnUDBQYSHf1483kAv8jdZiZme6d2hUI9TORc='} 2024-03-26T17:14:11.326 INFO:teuthology.orchestra.console.smithi044:Power off 2024-03-26T17:14:11.326 DEBUG:teuthology.orchestra.console.smithi044:pexpect command: ipmitool -H smithi044.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-26T17:14:11.350 DEBUG:teuthology.orchestra.console.smithi044:power off output: Chassis Power Control: Down/Off 2024-03-26T17:14:11.350 DEBUG:teuthology.orchestra.console.smithi044:pexpect command: ipmitool -H smithi044.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-26T17:14:11.364 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi157.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vallariag-2024-03-26_16:25:34-rbd:nvmeof-ceph-nvmeof-mon-distro-default-smithi/7623742', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-26 16:27:25.964759', 'locked_by': 'scheduled_vallariag@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIOO/CWoMI2n8sWrMzIM8IdSzbprJfalVZ8iDWsIoU88YAyo2DenTY1H0sxVNrcrzUBJ6TRW8t5UM3Bv6vxuJJU='} 2024-03-26T17:14:11.375 INFO:teuthology.orchestra.console.smithi064:Power off 2024-03-26T17:14:11.375 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-26T17:14:11.385 DEBUG:teuthology.orchestra.console.smithi044:check power output: Chassis Power is on 2024-03-26T17:14:11.392 INFO:teuthology.orchestra.console.smithi149:Power off 2024-03-26T17:14:11.392 DEBUG:teuthology.orchestra.console.smithi149:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-26T17:14:11.402 DEBUG:teuthology.orchestra.console.smithi064:power off output: Chassis Power Control: Down/Off 2024-03-26T17:14:11.402 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-26T17:14:11.415 DEBUG:teuthology.orchestra.console.smithi149:power off output: Chassis Power Control: Down/Off 2024-03-26T17:14:11.415 DEBUG:teuthology.orchestra.console.smithi149:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-26T17:14:11.426 DEBUG:teuthology.orchestra.console.smithi064:check power output: Chassis Power is on 2024-03-26T17:14:11.441 INFO:teuthology.orchestra.console.smithi157:Power off 2024-03-26T17:14:11.442 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-26T17:14:11.452 DEBUG:teuthology.orchestra.console.smithi149:check power output: Chassis Power is on 2024-03-26T17:14:11.468 DEBUG:teuthology.orchestra.console.smithi157:power off output: Chassis Power Control: Down/Off 2024-03-26T17:14:11.468 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-26T17:14:11.491 DEBUG:teuthology.orchestra.console.smithi157:check power output: Chassis Power is on 2024-03-26T17:14:15.386 DEBUG:teuthology.orchestra.console.smithi044:pexpect command: ipmitool -H smithi044.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-26T17:14:15.427 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-26T17:14:15.453 DEBUG:teuthology.orchestra.console.smithi149:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-26T17:14:15.493 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-26T17:14:15.503 DEBUG:teuthology.orchestra.console.smithi044:check power output: Chassis Power is on 2024-03-26T17:14:15.538 DEBUG:teuthology.orchestra.console.smithi064:check power output: Chassis Power is on 2024-03-26T17:14:15.564 DEBUG:teuthology.orchestra.console.smithi149:check power output: Chassis Power is on 2024-03-26T17:14:15.603 DEBUG:teuthology.orchestra.console.smithi157:check power output: Chassis Power is on 2024-03-26T17:14:19.507 DEBUG:teuthology.orchestra.console.smithi044:pexpect command: ipmitool -H smithi044.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-26T17:14:19.539 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-26T17:14:19.565 DEBUG:teuthology.orchestra.console.smithi149:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-26T17:14:19.604 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-26T17:14:19.619 DEBUG:teuthology.orchestra.console.smithi044:check power output: Chassis Power is on 2024-03-26T17:14:19.651 DEBUG:teuthology.orchestra.console.smithi064:check power output: Chassis Power is off 2024-03-26T17:14:19.677 DEBUG:teuthology.orchestra.console.smithi149:check power output: Chassis Power is off 2024-03-26T17:14:19.715 DEBUG:teuthology.orchestra.console.smithi157:check power output: Chassis Power is off 2024-03-26T17:14:19.753 INFO:teuthology.orchestra.console.smithi064:Power off completed 2024-03-26T17:14:19.778 INFO:teuthology.orchestra.console.smithi149:Power off completed 2024-03-26T17:14:19.817 INFO:teuthology.orchestra.console.smithi157:Power off completed 2024-03-26T17:14:23.624 DEBUG:teuthology.orchestra.console.smithi044:pexpect command: ipmitool -H smithi044.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-26T17:14:23.738 DEBUG:teuthology.orchestra.console.smithi044:check power output: Chassis Power is off 2024-03-26T17:14:23.839 INFO:teuthology.orchestra.console.smithi044:Power off completed 2024-03-26T17:14:23.942 INFO:teuthology.run:Summary data: description: rbd:nvmeof/{base/install centos_latest conf/{disable-pool-app} workloads/nvmeof_thrash} duration: 2259.4410305023193 failure_reason: error during thrashing flavor: default owner: scheduled_vallariag@teuthology status: fail success: false 2024-03-26T17:14:23.943 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-26T17:14:24.019 INFO:teuthology.run:FAIL